edu.unika.aifb.rdf.crawler
Class RobotCheck

java.lang.Object
  |
  +--edu.unika.aifb.rdf.crawler.RobotCheck

public class RobotCheck
extends java.lang.Object

Finds out the host's robot policy


Constructor Summary
RobotCheck()
           
 
Method Summary
static boolean check(java.lang.String nuri)
          So far we ignore ROBOTS.TXT files
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

RobotCheck

public RobotCheck()
Method Detail

check

public static boolean check(java.lang.String nuri)
                     throws FilterException
So far we ignore ROBOTS.TXT files