Beautiful Soup: We called him Tortoise because he taught us.
You didn't write that awful page. You're just trying to get some data out of it. Beautiful Soup is here to help. Since 2004, it's been saving programmers hours or days of work on quick-turnaround screen scraping projects. If you have questions, send them to the discussion group. If you find a bug, file it. Beautiful Soup is a Python library designed for quick turnaround projects like screen-scraping. Beautiful Soup provides a few simple methods and Pythonic idioms for navigating, searching, and modifying a parse tree: a toolkit for dissecting a document and extracting what you need. Beautiful Soup parses anything you give it, and does the tree traversal stuff for you. Valuable data that was once locked up in poorly-designed websites is now within your reach. Interested? Download Beautiful Soup The current release is Beautiful Soup 4.6.0 (May 7, 2017). In Debian and Ubuntu, Beautiful Soup is available as the python-bs4 package (for Python 2) or the python3-bs4 package (for Python 3).
Related: Web Scraping with Python
Related: Web Scraping
• web python
• python 2
• About Twitter