Robots.txt on a web site

[recumbent615]

The message that I get in some of the web pages generated by the web capture is:

This file was not retrieved by Teleport Pro, because it is addressed on a path excluded by the site\'s Robot Exclusion parameters. (Teleport Pro\'s compliance with this system is optional; see the Project Properties, Netiquette page.


Where do I locate this setting?

[TSC2]

TechSmith does not make Teleport Pro. You may wish to visit:
http://www.tenmax.com/teleport/pro/home.htm

[ancutaandrei]

You can use other program but I don't have any problems using Teleport Pro (http://www.soft82.com/download/Windows/Teleport_Pro) for a long time, try the latest versions.