standard for robot exclusion
<World-Wide Web> A proposal to try to prevent the havoc wreaked by many
of the early World-Wide Web robots when they retrieved documents too rapidly or
retrieved documents that had side effects (such as voting). The proposed
standard for robot exclusion offers a solution to these problems.
http://info.webcrawler.com/mak/projects/robots/norobots.html.
(1996-03-23)
Nearby terms:
Standard Commands for Programmable Instruments «
Standard d'Echange et de Transfert « standard
deviation « standard for robot exclusion »
Standard for the exchange of product model data »
Standard Generalised Markup Language » Standard
Generalized Markup Language
|
