grafologizacja wikipedii
Get flash to fully experience Pearltrees
API:Query
The action=query module allows you to get most of the data stored in a wiki, including tokens for editing . The query module has many submodules (called query modules), each with a different function. There are three types of query modules:
I have a new position: Senior Lecturer and Larkins Fellow at Monash University, Australia. Dissertations Tim Dwyer (2005): "Two and a Half Dimensional Visualisation of Relational Networks", PhD Thesis, The University of Sydney. (23MB pdf) Tim Dwyer (2001): "Three Dimensional UML using Force Directed Layout", Honours Thesis, The University of Melbourne (TR download) Technical Reports T.
The unofficial homepage of Tim Dwyer
Helper Classes for the MediaWiki API page can be found in the package: info.bliki.api . All query parameters are described in the api.php page of the requested wiki. For example http://en.wikipedia.org/w/api.php lists all parameters for en.wikipedia.org. For example this snippet determines the categories used in the Wikimedia Main Page and [ API ] page:
MediaWikiAPISupport - gwtwiki - Helper classes for the MediaWiki api.php. - Java Wikipedia API (Bliki engine)
The action=query module allows you to get most of the data stored in a wiki, including tokens for editing . The query module has many submodules (called query modules), each with a different function. There are three types of query modules: Meta information about the wiki and the logged-in user Properties of pages, including page revisions and content Lists of pages that match certain criteria
API:Query - MediaWiki
The Mediawiki API makes it possible for web developers to access, search and integrate all Wikipedia content into their applications. Given that Wikipedia is the ultimate online encyclopedia, there are dozens of use cases in which this might be useful. I used to post a lot of articles about using the webservice APIS of third party sites on this blog.
Hook into Wikipedia using Java and the MediaWiki API | Integrating Stuff
Wikipedia offers free copies of all available content to interested users. These databases can be used for mirroring , personal use, informal backups, offline use or database queries (such as for Wikipedia:Maintenance ). All text content is multi-licensed under the Creative Commons Attribution-ShareAlike 3.0 License (CC-BY-SA) and the GNU Free Documentation License (GFDL). Images and other files are available under different terms , as detailed on their description pages.
Database download
Ways to process and use Wikipedia dumps – Prashanth Ellina
Wikipedia is a superb resource for reference (taken with a pinch of salt of course). I spend hours at a time spidering through its pages and always come away amazed at how much information it hosts. In my opinion this ranks amongst the defining milestones of mankind’s advancement. Apart from being available through http://www.wikipedia.org, the data is provided for download so that you can create a mirror locally for quicker access.
As a network visualization tool, node graphs are an intuitive method of communicating relationships between entities. I’ve been thinking a lot about the semantic web lately and thought it would be cool to visualize all of the links between articles in Wikipedia at once. I want to pull back and get the 10,000 foot view of the state of modern knowledge, which I don’t think has been done before in a comprehensible way. Chris Harrison’s WikiViz project comes closest but it quickly becomes incomprehensible and is not dynamic. I have not yet found a tool capable of pulling this off.
Visualizing Wikipedia As One Large Node Graph zachary::witte
Web scraping
Web scraping ( web harvesting or web data extraction ) is a computer software technique of extracting information from websites . Usually, such software programs simulate human exploration of the World Wide Web by either implementing low-level Hypertext Transfer Protocol (HTTP), or embedding a fully-fledged web browser, such as Internet Explorer or Mozilla Firefox . Web scraping is closely related to web indexing , which indexes information on the web using a bot or web crawler and is a universal technique adopted by most search engines. In contrast, web scraping focuses more on the transformation of unstructured data on the web, typically in HTML format, into structured data that can be stored and analyzed in a central local database or spreadsheet. Web scraping is also related to web automation, which simulates human browsing using computer software.
JWPL and the Wikipedia Revision Toolkit News JWPL 0.9.2 has been released and is now available via Maven Central . If you use Maven as your build tool, then you can directly add any JWPL component as a dependency to your pom.xml without having to perform any additional configuration. You can find more information on the DeveloperSetup page. Non-Maven users can find a prebuilt package with all JWPL components including a folder with all dependency jars on the download page .
jwpl - Java-based Wikipedia Library -- An application programming interface for Wikipedia
Back to overview page. Learn about the different ways to get JWPL and choose the one that is right for you! (You might want to get fatjars with built-in dependencies instead of the download package on Google Code) Download the Wikipedia data from the Wikimedia Download Site You need 3 files: [LANGCODE]wiki-[DATE]-pages-articles.xml.bz2 OR [LANGCODE]wiki-[DATE]-pages-meta-current.xml.bz2 [LANGCODE]wiki-[DATE]-pagelinks.sql.gz [LANGCODE]wiki-[DATE]-categorylinks.sql.gz Note: If you want to add discussion pages to the database, use [LANGCODE]wiki-[DATE]-pages-meta-current.xml.bz2 , otherwise [LANGCODE]wiki-[DATE]-pages-articles.xml.bz2 suffices.