mechanize : Stateful programmatic web browsing in Python, after Andy Lester’s Perl module

• mechanize.Browser and mechanize.UserAgentBase implement the interface of urllib2.OpenerDirector, so:
  
  • any URL can be opened, not just http:
  • mechanize.UserAgentBase offers easy dynamic configuration of user-agent features like protocol, cookie, redirection and robots.txt handling, without having to make a new OpenerDirector each time, e.g. by calling build_opener().
• Easy HTML form filling.
• Convenient link parsing and following.
• Browser history (.back() and .reload() methods).
• The Referer HTTP header is added properly (optional).
• Automatic observance of robots.txt.
• Automatic handling of HTTP-Equiv and Refresh.
  
  http://wwwsearch.sourceforge.net/mechanize/