** Changes since 0.5 **

Added Andrew Kuchling's <akuchlin@cnri.reston.va.us> patch to show site map
breadth first instead of depth first.

Changed URL of official linbot home page.

The -x (or EXCLUDED_URLS list in config.py) is now a regular expression.

Added -y (or YANKED_URLS) option that will exclude it and also not check it. 
Also uses regular expressions.

** Changes since 0.4 **

Robot parser now supports proxies.

Added <BASE> element support.

Fixed 'recursion problem' with links having './' in them.

Clearer output messages.

Checks links in client-side image maps.

Fixed bug when parsing <TITLE>s with newlines. 

Can wait a number of seconds between processing links using -w flag or 
WAIT_BETWEEN_REQUESTS config file option.

** Changes since 0.3 **

Grabs "author" of HTML pages from the "<META>" tag.

New "No Titles" page lists HTML pages with no <TITLE>

New "Problems" page lists problem links sorted by author.

Proxy support via config file

Adds http header 'User-agent: Linbot $version' when talking to http server

Properly identifies text/html using various character sets (I hope).  Thanks to
Oleg Broytmann <phd2@earthlink.net> for finding this 'bug'.

Fixed bug in calling robot parser.  Thanks to Oleg Broytmann <phd2@earthlink.net>
for finding this bug and offering a patch.

Navigation bar can now support images via config file.

** Changes since 0.2 **

Fixed bug with redirected URLs not being flagged as visited.  Thanks to 
Chris Gutteridge for finding this bug.

Checks version of python running on system

Configure option to choose what kinds of URL schemes to avoid

Configure option to make broken links anchors in published reports

Configure option for defining maximum depth of Site Map

Configure option to define font size of Site Map

Added ALT attributes to logo and images.

Various clarifications in documentation.

** Changes since 0.1 **

Many visual enhancements, most of which are configurable via the config.py
file.

Fixed bug for 0-day old pages not showing up as new.

Added -x flag (and EXCLUDE_URLS config variable) to exclude URLs to be explored

Added -a flag (and AVOID_EXTERNAL_LINKS config variable) to indicate that
external links should not be checked for validity

Added -o flag (and OUTPUT_DIR config variable) to indicate the directory
report files will be generated

Fixed bug when referencing relative URLs

Fixed bug when getting "Unknown Error" at startup (actually, this is a bug in the
documentation).

Conforms to robots.txt protocol.  Note there is currently no method to
override this. 

What's Old/What's New pages are sorted by age
