Table of Contents - webrobots-0.0.13 Documentation
Pages
LICENSE
README
webrobots
Usage
Requirements
Contributing to webrobots
Copyright
Classes/Modules
WebRobots
WebRobots::Error
WebRobots::ParseError
WebRobots::RobotsTxt
WebRobots::RobotsTxt::AccessControlLine
WebRobots::RobotsTxt::AgentLine
WebRobots::RobotsTxt::AllowLine
WebRobots::RobotsTxt::CrawlDelayLine
WebRobots::RobotsTxt::DisallowLine
WebRobots::RobotsTxt::ExtentionLine
WebRobots::RobotsTxt::Line
WebRobots::RobotsTxt::Parser
WebRobots::RobotsTxt::Record
Nokogiri
Nokogiri::HTML
Nokogiri::HTML::Document
Methods
::new — WebRobots
::new — WebRobots::ParseError
::new — WebRobots::RobotsTxt::Line
::new — WebRobots::RobotsTxt
::new — WebRobots::RobotsTxt::Record
::unfetchable — WebRobots::RobotsTxt
#_reduce_none — WebRobots::RobotsTxt::Parser
#allow? — WebRobots::RobotsTxt::AllowLine
#allow? — WebRobots::RobotsTxt::DisallowLine
#allow? — WebRobots::RobotsTxt
#allow? — WebRobots::RobotsTxt::Record
#compile — WebRobots::RobotsTxt::Line
#compile — WebRobots::RobotsTxt::AccessControlLine
#compile — WebRobots::RobotsTxt::CrawlDelayLine
#compile — WebRobots::RobotsTxt::AgentLine
#default? — WebRobots::RobotsTxt::Record
#error! — WebRobots::RobotsTxt
#match? — WebRobots::RobotsTxt::Record
#match? — WebRobots::RobotsTxt::AccessControlLine
#meta_robots — Nokogiri::HTML::Document
#nofollow? — Nokogiri::HTML::Document
#noindex? — Nokogiri::HTML::Document
#options — WebRobots::RobotsTxt
#to_s — WebRobots::ParseError