<<< Proxy Settings
Creating robots.txt File >>>

The spider database, available at the manufacturer's website, is updated periodically. You can update your database via HTTP protocol from a strictly selected Internet location. To start the update, enter the appropriate proxy settings and select Update Database in the Options submenu of the main program menu, or through the popup menu on the Spiders List page.

During the update the new database file is downloaded from the program server and compared to the existing spider database. Only new records are added to the existing database. The entries present in the existing database but not present in the update will not be removed. The entries you had edited in your database will not be updated.

For the time of the update the program will save and close the current open project and create a blank one.

<<< Proxy Settings
Creating robots.txt File >>>