scone.robot
Interface LinkFilter

public interface LinkFilter

This interface defines the functionaltity of a link filter.

Author:

Frank Wollenweber

Method Summary

boolean

filter(RobotLink robotLink, RobotHtmlNode robotHtmlNode, QueueEntry qe) When a page is loaded the filter method is called for each link of the page.

Method Detail

filter

boolean filter(RobotLink robotLink,
               RobotHtmlNode robotHtmlNode,
               QueueEntry qe)

When a page is loaded the filter method is called for each link of the page. Filter gets a robotLink and can use the getAttribute method to get the attributes attached to the robotLink. This method decides, if the crawling should be continued with this link or not. The values of all filters are combined with the and operator

Parameters:

robotLink - the link to filter

robotHtmlNode - The document where the link was found

qe - The entry of the queue which causes the robot to download robotHtmlNode. This parameter gives the filter access to the RobotTask and the current scanning-depth.

Returns:

True, if the crawling should be continued.