Beautiful Soup: We called him Tortoise because he taught us. [ Download | Documentation | Hall of Fame | For enterprise | Source | Changelog | Discussion group | Zine ] You didn't write that awful page. You're just trying to get some data out of it. Beautiful Soup is here to help. Morph.io. ScraperWiki. Outwit Hub. Scraper - Chrome Plugin. Top 5 Data-Scraping Tools for Would-Be Data Journalists. This post originally appeared on Northwestern University Knight Lab’s blog.
This past fall, I spent time with the NPR News Apps team (now known as NPR Visuals) coding up some projects, working mainly as a visual/interaction designer. But in the last few months, I’ve been working on a project that involves scraping newspaper articles and Twitter APIs for data.