background preloader

Db

Facebook Twitter

Data Modeling & Profiling Tool: SQL Power Architect | SQL Power Software. Features Accesses source databases via JDBC Connects to multiple source databases concurrently Compares data models & database structures and identifies discrepancies Drag-and-drop source tables & columns into the playpen Remembers the origin of each column Generates source-to-target visual Mapping Reports Forward/reverse engineers PostgreSQL, Oracle, MS SQL Server & more Saves source data structure snapshots in the project, so you can work remotely All project data is stored in an easy-to-parse XML format OLAP schema modeling: Cubes, Measures, Dimensions, Hierarchies & Levels Visual Mapping Report for data lineage tracking Free Download (Open Source, GPL v.3 licensed) (Community Edition) Data Architects, DBA's, Analysts and Designers rely on Data Modeling tools to facilitate and simplify their data Modeling efforts, while maximizing the use of their resources.

SQL Power Architect can also open multiple source databases concurrently, even if they are from competing database vendors. Open source data quality, data profiling and master data management | DataCleaner. The 38 Subsystems of ETL -- InformationWeek. Three little letters -- E,T, and L -- obscure the reality of 38 subsystems vital to successful data warehousing. The extract-transform-load (ETL) system, or more informally, the "back room," is often estimated to consume 70 percent of the time and effort of building a data warehouse.

But there hasn't been enough careful thinking about just why the ETL system is so complex and resource intensive. Everyone understands the three letters: You get the data out of its original source location (E), you do something to it (T), and then you load it (L) into a final set of tables for the users to query. When asked about breaking down the three big steps, many designers say, "Well, that depends. " It depends on the source, it depends on funny data idiosyncrasies, it depends on the scripting languages and ETL tools available, it depends on the skills of the in-house staff, and it depends on the query and reporting tools the end users have. The 38 Subsystems Extract system. More Insights. Liquibase | Database Refactoring | home.