NAME

Labrador::Dispatcher::CrawlerAlloc

SYPNOPSIS

	use Labrador::Dispatcher::CrawlerAlloc;

Call this module to get URLs for a crawler to process. NB: This module is abstract.

new($data, $urlalloc, $urlstates, @params): Construct a new CrawlerAlloc module. Calls init() automatically.
init()
register_crawler($hostname): A crawler with from $hostname just connected. Register it
unregister_crawler($crawler_hostname): Crawler $crawler_hostname just disconnected.
get_urls($crawler_hostname, $count): Obtains upto $count URLs for $crawler_hostname
update_queues(): Dispatcher thinks we have some time free, so we should use it to build up the crawler queues
empty_queues(): Remove all items in all queues,
queue_sizes(): Return the total size of all queues
get_stats: Return any statistics provided

	$Revision: 1.8 $