Mining Data-text-web
Get flash to fully experience Pearltrees
Back in late 2006, Google released a massive set of web n-gram data (basically pieces of sentences). A trigram (n=3), for example, might be "I like food" or "frog is tasty." Each n-gram is also labeled with the number of times it appeared in Google's corpus.
Chris Harrison - Web Trigrams Visualization
Data mining
Browser Automation
Web mining
Fouille de textes
Un article de Wikipédia, l'encyclopédie libre. La fouille de textes ou l'extraction de connaissances dans les textes est une spécialisation de la fouille de données et fait partie du domaine de l' intelligence artificielle . Cette technique est souvent désignée sous l'anglicisme text mining .
Les outils de text-mining ont pour vocation d’ automatiser la structuration des documents peu ou faiblement structurés. Ainsi, à partir d’un document texte, un outil de text-mining va générer de l’information sur le contenu du document . Cette information n’était pas présente, ou explicite, dans le document sous sa forme initiale, elle va être rajoutée, et donc enrichir le document. A quoi cela peut bien servir ?
Introduction au Text-mining
Text mining
Text mining , also referred to as text data mining , roughly equivalent to text analytics , refers to the process of deriving high-quality information from text . High-quality information is typically derived through the devising of patterns and trends through means such as statistical pattern learning . Text mining usually involves the process of structuring the input text (usually parsing, along with the addition of some derived linguistic features and the removal of others, and subsequent insertion into a database ), deriving patterns within the structured data , and finally evaluation and interpretation of the output.
Eric Schmidt famously observed that every two days now, we create as much data as we did from the dawn of civilization until 2003. A lot of the new data is not locked away in enterprise databases, but is freely available to the world in the form of social media: status updates, tweets, blogs, and videos. At Kosmix, we’ve been building a platform, called the Social Genome, to organize this data deluge by adding a layer of semantic understanding. Conversations in social media revolve around “social elements” such as people, places, topics, products, and events. For example, when I tweet “Loved Angelina Jolie in Salt,” the tweet connects me (a user) to Angelia Jolie (an actress) and SALT (a movie). By analyzing the huge volume of data produced every day on social media, the Social Genome builds rich profiles of users, topics, products, places, and events.
Retail + Social + Mobile = @WalmartLabs
What is Maltego - Paterva Wiki
From Paterva Wiki What is Maltego? With the continued growth of your organization, the people and hardware deployed to ensure that it remains in working order is essential, yet the threat picture of your “environment” is not always clear or complete.
Cluster Execution
Compute clusters often run idle because of a lack of applications that can be run in the cluster environment and the enormous effort required to operate, maintain, and support applications on the grid. KNIME Cluster Execution tackles this problem by providing a thin connection layer between KNIME and the cluster, which allows every node running in KNIME and every application integrated in KNIME to be executed on the cluster. Submission of data to the cluster and collection of the results is made very simple. Long-running analysis workflows can be executed on the compute cluster, thus releasing local resources for other productive work. <p style="text-align:right;color:#A8A8A8"></p>Recherche d'information
Un article de Wikipédia, l'encyclopédie libre. Abrégée la recherche d' information ( RI [ 1 ] ) est le domaine qui étudie la manière de répondre pertinemment à une requête en retrouvant des informations dans un corpus. Celui-ci est composé de documents d'une ou plusieurs bases de données , qui sont décrits par un contenu ou les métadonnées associées. Les bases de données peuvent être relationnelles ou non structurées, telles celles mises en réseau par des liens hypertexte comme dans le World Wide Web , l' internet et les intranets . Le contenu des documents peut être du texte, des sons, ses images ou des données .