NAME

Labrador::Crawler::ContentFilter::Fingerprint

DESCRIPTION

This content filter responsible for filtering out documents that have been seen before, according to a lookup on the dispatcher.

METHODS

filter($document, $privs)

Looks up the MD5 fingerprint of $document in the hashtable the dispatcher maintains. Note this method may be a bottleneck in performance.

REVISION

	$Revision: 1.1 $