NAME

SYNOPSIS 

	use Labrador::Crawler::Manager;
	my $manager = new Labrador::Crawler::Manager(
		'Partitioned', $data, $disp_client,
		$config, @params);

DESCRIPTION

Base class for crawler Manager classes. Known implementors are Simple and Partitioned.

METHODS

new($manager_name, $data, $disp_client, $config, @params)

Constructs a new manager module inherited from this one.

init()
next_url

Provide the next URL to fetch.

finished_url($url)

Mark $url as finished.

failed_url($url)

Mark $url as failed.

found_urls($url, @urls_found)

Process the @urls_found that were found in $url.

queue_status()
get_stats()

PRIVATE METHODS

_load_module($name)

Load the module called $name.

REVISION 

	$Revision: 1.14 $