<<< Home Page settings
Disallow Tab >>>

Spiders List page consists of the table of spiders and a status bar that relfects the number of selected spiders against the total number of spiders.

The spider table contains the following fields: spider selection checkbox that serves to indicate that restrictions specified at the Disallow Tab will be applied to this spider, spider name, and User-Agent name in brackets, country and language. The spiders table is stored in the main program folder at your disk.

You may call up the context menu by right-clicking anywhere on the table. The menu includes options of adding, editing, or deleting spiders from the list, as well as lets you select all spiders, de-select all spiders, select all spiders by certain criteria (by counrty or language), invert the previous selection, and open the spider's home page by clicking on the Spider Homepage.

The same options may be accessed through program main menu (Spider).

When you select Add or Edit, a Spider data editing window would open. If you pressed Edit, the fields will contain current properties of the selected spider, and if you chose Add, all fields will be empty, except for fields Country and Language, where default values: USA and English (USA) will be inserted, and Domains (default value ALL).

When you left-click anywhere on the spider, but not on the checkbox, you select this spider, and the line is highlighted, but this spider is not added to (and neither removed from) the list of selected spiders at the Disallow Tab.

When you left- or right-click on the checkbox for a given spider, the spider is selected and added to the list (the checkbox appears checked and selected spiders counter value is increased by 1). Another click on the same checkbox removes the spider from the list of selected spiders and decreases the counter value by 1.

When you click on Select All, all spiders in the table will be added to the list.

A click on Deselect All unchecks all selection checkboxes and removes all spiders form the list on Disallow Tab.

When you click on Select By..., the criteria selection window will appear.

When you click on Invert Selection , spiders that were selected become de-selected, and vice versa.

The information in the table may be sorted by any column. A simple mouse click on the coulmn header will sort the table by the contents of that column.

When the program is not registered, it works in the demo mode. In this mode the work is restricted to the standard spider list and Add spider, Edit spider and Delete spider options are disabled.

Filtering spiders

This option allows you to select spiders from the list according to certain criteria. You may select all spiders that have the required values of Country and/or Language fields. You may select several values for each field simultaneously.

When selecting, you have two options: select only these spiders, or add these spiders to the ones you have selected before.

To pick the appropriate option, you need to do the following:

1. Point your mouse onto the appropriate field or onto the button next to this field and click the left button.
2. On the list that appears, select one or more country or language by ticking the box to the left of the name.
3. Press the button next to the list of selected countries/languages, or click anywhere on the list to close it.
4. Select one of the options: Only these spiders or Extra spiders selection

After that confirm your choice by pressing OK or reject it by pressing Cancel.

Editing Spider Info

This window allows you to edit the data of a selected spider from the list and to add new spiders. The window contains the following fields:

1. Spider name
2. User-Agent
3. Alternative User-Agents
4. Country
5. Language
6. Domains
7. Spider Home Page field

The country and language lists are defined strictly in the program and can not be altered. The country and language of each spider are selected according to these lists.

The User Agent field reflects the Internet name of the spider. This is the name to be added into the standard instructions file and this is the name spider will search for in the User-Agent directive to determine its limitations on this site.

In the User Agent Alternative field, there are other User-Agent names this spider uses. Each User-Agent is recorded in a new line. The trick is in the fact that some spiders use several different User-Agent names when visiting different pages. That's why to recognize the spider properly in the Log Analyzer module, you'll need to enter all User-Agent names this spider uses.

The Domains field contains domain types this spider may visit. When the spider has no domain restrictions, select ALL in this field. When you have selected ALL from the list, you will not be able to select any additional domain type. To select other domain types, you'll need to de-select ALL.

To close the editing window and save the changes, press OK.

To reject the changes you made and return to the program, press Cancel.

Recommend us a new spider

If you know of a spider that is not included in the program database, you may want to tell us about it. To do this, write an e-mail for our support department, providing detailed information on the spider. We will review the information and when all data proves to be correct, the spider will be included in the next database update available via database updater module.

<<< Home Page settings
Disallow Tab >>>