Uses of Class
edu.uci.ics.crawler4j.robotstxt.RobotstxtConfig

Packages that use RobotstxtConfig

Package	Description
edu.uci.ics.crawler4j.robotstxt

Uses of RobotstxtConfig in edu.uci.ics.crawler4j.robotstxt

Fields in edu.uci.ics.crawler4j.robotstxt declared as RobotstxtConfig

Modifier and Type	Field and Description
protected RobotstxtConfig	RobotstxtServer.config

Methods in edu.uci.ics.crawler4j.robotstxt with parameters of type RobotstxtConfig

Modifier and Type	Method and Description
static HostDirectives	RobotstxtParser.parse(String content, RobotstxtConfig config)

Constructors in edu.uci.ics.crawler4j.robotstxt with parameters of type RobotstxtConfig

Constructor and Description
HostDirectives(RobotstxtConfig configuration)
RobotstxtServer(RobotstxtConfig config, PageFetcher pageFetcher)
RobotstxtServer(RobotstxtConfig config, PageFetcher pageFetcher, int maxBytes)