background preloader


Facebook Twitter

Database Revolution; Future of Information Publishing. Extract, transform, load. In computing, extract, transform, and load (ETL) refers to a process in database usage and especially in data warehousing that: Extracts data from outside sourcesTransforms it to fit operational needs, which can include quality levelsLoads it into the end target (database, more specifically, operational data store, data mart, or data warehouse) ETL systems are commonly used to integrate data from multiple applications, typically developed and supported by different vendors or hosted on separate computer hardware.

Extract, transform, load

The disparate systems containing the original data are frequently managed and operated by different employees. Neo4j. 0830 - Cypher and Neo4j. Neo4j Internals: File Storage. NOTE: This post is quite outdated, stuff has changed since i wrote this.

Neo4j Internals: File Storage

While you can somewhat safely ignore the alterations for increased address space of entities, the Property store has changed in a fundamental way. Please find the new implementation here. Ah, the physical layer! Storing bits and bytes on spinning metal, away from the security and comfort of objects and high-level abstractions. This is the realization of any database system, the sole purpose for which it is build. Which files again? By now you should be aware that your graph lives in a bunch of files under the directory which you instructed your instance to store them. Recycling Ids I will tell a lie now but I have to start somewhere. Neo4j open source nosql graph database. MongoDB. InfiniteGraph. Atomic Wiki. Higher-order functions are probably the most notable addition to the XQuery language in version 3.0 of the specification .

Atomic Wiki

Using A Graph Database To Power The “Web of Things” Bio Rick Bullotta is the co-founder and CTO of ThingWorx, a pioneer in the emerging field of real-world aware applications.

Using A Graph Database To Power The “Web of Things”

Mr. Bullotta was previously CTO at Invensys Wonderware, and VP with SAP Research. Emil Eifrem is CEO of Neo Technology and co-founder of the Neo4j project. Before founding Neo, he was the CTO of Windh AB. QCon is a conference that is organized by the community, for the community.The result is a high quality conference experience where a tremendous amount of attention and investment has gone into having the best content on the most important topics presented by the leaders in our community.QCon is designed with the technical depth and enterprise focus of interest to technical team leads, architects, and project managers.

Getting the most *out* of your data. PyTables is a package for managing hierarchical datasets and designed to efficiently and easily cope with extremely large amounts of data.

Getting the most *out* of your data

You can download PyTables and use it for free. You can access documentation, some examples of use and presentations in the HowToUse section. PyTables is built on top of the HDF5 library, using the Python language and the NumPy package. It features an object-oriented interface that, combined with C extensions for the performance-critical parts of the code (generated using Cython), makes it a fast, yet extremely easy to use tool for interactively browse, process and search very large amounts of data. AllegroGraph News August 2011. AllegroGraph News.

AllegroGraph News August 2011

Gremlin. Orient Technologies - Open source solutions built around the Orient DB. High-performance graph database, data deduplication and bibliographic exploration. Orient - NoSQL document database light, portable and fast. Supports ACID Tx, Indexes, asynch queries, SQL layer, clustering, etc. A Graph Database. Object-Oriented Database (OODBMS) Database Models: Hierarcical, Network, Relational, Object-Oriented, Semistructured, Associative and Context.

The context data model combines features of all the above models.

Database Models: Hierarcical, Network, Relational, Object-Oriented, Semistructured, Associative and Context.

It can be considered as a collection of object-oriented, network and semistructured models or as some kind of object database. In other words this is a flexible model, you can use any type of database structure depending on task. Such data model has been implemented in DBMS ConteXt. The fundamental unit of information storage of ConteXt is a CLASS. Class contains METHODS and describes OBJECT. Unified Modeling Language. The Unified Modeling Language (UML) is a general-purpose modeling language in the field of software engineering, which is designed to provide a standard way to visualize the design of a system.[1] It was created and developed by Grady Booch, Ivar Jacobson and James Rumbaugh at Rational Software during 1994–95 with further development led by them through 1996.[1] In 1997 it was adopted as a standard by the Object Management Group (OMG), and has been managed by this organization ever since.

Unified Modeling Language

In 2000 the Unified Modeling Language was also accepted by the International Organization for Standardization (ISO) as an approved ISO standard. Since then it has been periodically revised to cover the latest revision of UML.[2] Overview[edit] Associative model of data. The associative model of data is an alternative data model for database systems.

Associative model of data

Entity-relationship model. An entity–relationship diagram using Chen's notation In software engineering, an entity–relationship model (ER model) is a data model for describing the data or information aspects of a business domain or its process requirements, in an abstract way that lends itself to ultimately being implemented in a database such as a relational database.

Entity-relationship model

The main components of ER models are entities (things) and the relationships that can exist among them, and databases. Entity–relationship modeling was developed by Peter Chen and published in a 1976 paper.[1] However, variants of the idea existed previously,[2] and have been devised subsequently such as supertype and subtype data entities[3] and commonality relationships. Overview[edit] Jeremy Zawodny's blog. I found myself reading NoSQL is a Premature Optimization a few minutes ago and threw up in my mouth a little. That article is so far off base that I’m not even sure where to start, so I guess I’ll go in order. In fact, I would argue that starting with NoSQL because you think you might someday have enough traffic and scale to warrant it is a premature optimization, and as such, should be avoided by smaller and even medium sized organizations.

You will have plenty of time to switch to NoSQL as and if it becomes helpful. The Apache Cassandra Project. YAGO-NAGA - D5: Databases and Information Systems (Max-Planck-Institut für Informatik) Overview YAGO2s is a huge semantic knowledge base, derived from Wikipedia WordNet and GeoNames. Currently, YAGO2s has knowledge of more than 10 million entities (like persons, organizations, cities, etc.) and contains more than 120 million facts about these entities. YAGO is special in several ways: The accuracy of YAGO has been manually evaluated, proving a confirmed accuracy of 95%.

Every relation is annotated with its confidence value.YAGO combines the clean taxonomy of WordNet with the richness of the Wikipedia category system, assigning the entities to more than 350,000 classes.YAGO is an ontology that is anchored in time and space. News [March 22, 2013] The demo about the functionalities of YAGO2s got accepted for WWW 2013. Publications. Thomas Neumann: D5: Databases and Information Systems (Max-Planck-Institut für Informatik) [an error occurred while processing this directive] © 2008 Thomas Neumann Note: A more recent version of the RDF-3X code is available at Overview: RDF-3X is the experimental RDF storage and retrieval system described in Thomas Neumann, Gerhard Weikum.

RDF-3X by Thomas Neumann is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License. Usage: RDF-3X can import NTriples/Turtle RDF data. Rdf3xload db yago.n3 This takes ca. 30 minutes on a laptop with 2GB main memory. Rdf3xquery db This query interface accepts standard SPARQL queries, for example: select ? Source Code: The source code is available below.