background preloader

Data Architecture

Facebook Twitter

Modeling the enterprise data architecture. Unlike the simplistic models in books and training courses, a real enterprise has a very complicated data architecture. Most of the data will be held in large legacy or package systems, for which the details of data structure may be unknown. Other data will be held in spreadsheets and personal databases (such as Microsoft Access), and may be invisible to the IT department or senior business data administrators. Some key data may reside in external systems maintained by service providers or business partners. As you explore your own complex data architecture, you will come to accept two realities: You have little control over the way high-level business data concepts are realized. Data is likely to be highly dispersed, often without adequate controls on quality. These conditions have several important consequences. Note: Some of the later steps of this approach introduce techniques that may at first seem a little complicated.

What is a data architecture? Back to top High-level data models. Database Training Blog.

Reverse Engineering

DoITT - Open Government/Innovation - Open Data. Mayor Bloomberg’s Geek Squad. The antiquated answer would have been to have the health department send inspectors to restaurants on blocks with backed-up sewers and hope by chance to catch a busboy pouring the contents of a deep fryer into the street. Enter the city’s Office of Policy and Strategic Planning, a geek squad of civic-minded number-crunchers working from a pair of cluttered cubicles across from City Hall in the Municipal Building.

They dug up data from the Business Integrity Commission, an obscure city agency that among other tasks certifies that all local restaurants have a carting service to haul away their grease. With a few quick calculations, comparing restaurants that did not have a carter with geo-spatial data on the sewers, the team was able to hand inspectors a list of statistically likely suspects. The result: a 95 percent success rate in tracking down the dumpers.

With nothing grander than public data, the Case of the Grease-Clogged Sewers was solved. While serving in the Green Zone, Mr. Mr. DeBlasioRedTapeReport-Potholes&Sinkholes.pdf.