A modified version of the snippet from: http://code.activestate.com/recipes/576551-simple-web-crawler/
Comment on This Data Unit