http://code.activestate.com/recipes/users/4171484/2009-08-18T13:21:49-07:00ActiveState Code Recipes2009-08-18T13:21:49-07:00manuelaraozhttp://code.activestate.com/recipes/users/4171484/http://code.activestate.com/recipes/576884-simple-web-crawler/

<p style="color: grey"> Python recipe 576884 by <a href="/recipes/users/4171484/">manuelaraoz</a> (<a href="/recipes/tags/crawler/">crawler</a>, <a href="/recipes/tags/htmlparser/">htmlparser</a>, <a href="/recipes/tags/urllib2/">urllib2</a>). </p> <p>A simple class that starts in a url and follows links to a desired depth.</p>