Labrador::Crawler::Manager::Simple
This Manager handles simple operations with the dispatcher, in relation to enqueuing and dequeueing. No attempt is made to queue any URLs locally. Using this manager is not as fast as using a partitioned manager.
Initialise the module. Called automatically by new()
Fetch the next url to crawl from the dispatcher
Mark $url as finished.
Mark $url as failed.
Enqeueue @urls that were found on $url
If no work available, when to try next.
A simple message for waiting.
Returns an empty array, this implementation does not support any statistics
$Revision: 1.5 $