|
||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||
| SUMMARY: INNER | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||
java.lang.Object | +--edu.unika.aifb.rdf.crawler.RobotCheck
Finds out the host's robot policy
| Constructor Summary | |
RobotCheck()
|
|
| Method Summary | |
static boolean |
check(java.lang.String nuri)
So far we ignore ROBOTS.TXT files |
| Methods inherited from class java.lang.Object |
clone,
equals,
finalize,
getClass,
hashCode,
notify,
notifyAll,
toString,
wait,
wait,
wait |
| Constructor Detail |
public RobotCheck()
| Method Detail |
public static boolean check(java.lang.String nuri)
throws FilterException
|
||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||
| SUMMARY: INNER | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||