A partitioning Crawler Allocator. URLs are allocated to crawlers based on the partition they fall in. This is done using Labrador::Common::Partition::* modules.
Returns an array of $count URLs that are in the partition named $crawler_name.
Move URLs from URLAlloc to here.
This crawler may now have partitions assigned to it.
De-assign partitions for $crawler
Returns the total size of the crawler queues
Returns some statistics about partitions.
$Revision: 1.5 $