<<< Importing an External robots.txt File
Spiders List Tab >>>
In this window you can check and modify the parameters of the main page of the site, for which the imported instructions file was created. Later you'll be able to modify this file by adding new or removing existing restrictions and spiders.
You may select either local PC or a remote FTP server, where the content of your site is stored.
When working locally, you need to specify the path to the website root folder. Just press the Browse... button , locate the folder and select its name, or type in the path directly in the space provided.

When working with a remote FTP server, you need to enter the address of your FTP server, e.g., ftp.server.com, port number (default 21), user name and password for access to the FTP server as well as path to the root folder on the server, where the site contents are stored. The path should start with slash (/), e.g., /pub/MySite/ . If you are not sure about the exact path, you may check on the server by pressing the FTP Browse button.

<<< Importing an External robots.txt File
Spiders List Tab >>>
|