A method and system for retrieving web-site based information by a spider engine at a target bandwidth is described. A target band width is received from the spider engine. A wait time is calculated by a timing module. Data retrieval from a web site is delayed by the calculated wait time so that data...http://www.google.fr/patents/US20080270604?utm_source=gb-gplus-shareBrevet US20080270604 - Timing Module for Regulating Hits by a Spidering Engine
Timing Module for Regulating Hits by a Spidering Engine
Numéro de demande: 12/170,676 Numéro de publication: US 2008/0270604 A1 Date de dépôt: 10 juil. 2008 Brevet délivré: US7949748 ( Date de délivrance 24 mai 2011)