| Class | Description |
|---|---|
| HostDirectives | |
| PathRule | |
| RobotstxtConfig | |
| RobotstxtParser | |
| RobotstxtServer | |
| UserAgentDirectives |
The UserAgentDirectives class stores the configuration for a single
user agent as defined in the robots.txt.
|
| UserAgentDirectives.UserAgentComparator |
Copyright © 2017. All rights reserved.