AkaSig - Web scraping with python

“This series of messages introduces my current hacks that automate web sites crawling and data extraction from HTML pages. Here is part One : how to crawl complex web sites with Python. The next part will deal with data extraction from the retrieved web pages, involving much HTML cleansing and parsing.”

Useful tips, tricks, and tools for anyone who scrapes the web using python.

We’re pleased to welcome Joe Goldberg to the Jobster team.

Joe joins us from the Amazon personalization team. Joe has a great track record in designing innovative features for collaborative filtering and personalized suggestions, and in building web services that work at a massive scale.