Using PHP CURL Library To Scrape The Internet. Have you ever though how much information is there in DMOZ?
Your entire life won't be enough to collect and sort it. Taking the Web into our own hands, one computer at a time Well, we had to do part of that. P.I.M. Team Bulgaria was involved in scraping the technology directories of DMOZ, google, yahoo and many more. Scraping for Journalism: A Guide for Collecting Data.
Photo by Dan Nguyen/ProPublica Our Dollars for Docs news application lets readers search pharmaceutical company payments to doctors.
We’ve written a series of how-to guides explaining how we collected the data. Most of the techniques are within the ability of the moderately experienced programmer. Mashups, APIs, and the Web as Platform.