background preloader

First steps in data visualisation using d3.js, by Mike Dewar

First steps in data visualisation using d3.js, by Mike Dewar
This happens to be one of those rare instances where the benefit of hindsight does not make me regret something said flippantly on a panel. I deeply believe that in order to truly change the world we cannot simply "throw analytics at the problem." To that end, the medical and health industries are perhaps the most primed to be disrupted by data and analytics. It is incredibly exciting to be at an organization that is both working within the current framework of health care and data to create new insight for people, but also pushing the envelope with respect to individuals' relationships with their own health. I feel lucky to have an opportunity to move into the health data space now. Sensor data The past decade of development in "big data" has -- in large part -- been built on top of the need to understand web logs files. We have built technology and algorithms to understand the Web, and we have done a great job. Strength of team Here's to the next adventure! Related:  d3.js

D3 for Mere Mortals By Luke Francl (, August 2011 d3.js is a data visualization library by Mike Bostock, who is also the primary creator of Protovis, which D3 is designed to replace. D3 has a steep learning curve, especially if (like me) you are not used to the pixel-precision of graphics programming. The pay off is that you can create some amazing visualizations with D3 (just look at the examples!). I know very little about D3, but the best way to learn something is to teach here is a very simple introduction to D3 from the beginning. D3 shares similarities with its predecessor Protovis. SVG provides basic shape primitives like line, rect, and circle as well as text and path to build complicated lines and shapes. To place a rectangle on the canvas, you need to understand that the axis starts in the top left corner and counts up towards the bottom of the screen. Here's a diagram of a rectangle positioned at (100, 100) with a height of 100 pixels and a width of 200 pixels. Next Steps

Facing Afghan mistrust, al-Qaeda fighters take limited role in insurgency On Aug. 14, a U.S. airstrike in the northern Afghan province of Kunduz killed a Taliban commander known as Abu Baqir. In a country where insurgents are killed daily, this attack was notable for one unusual detail: Abu Baqir, the military said afterward, was also a member of al-Qaeda. Although U.S. officials have often said that al-Qaeda is a marginal player on the Afghan battlefield, an analysis of 76,000 classified U.S. military reports posted by the Web site WikiLeaks underscores the extent to which Osama bin Laden and his network have become an afterthought in the war. The reports, which cover the escalation of the insurgency between 2004 and the end of 2009, mention al-Qaeda only a few dozen times and even then just in passing. Bin Laden, thought to be hiding across the border in Pakistan, is scarcely mentioned in the reports. A year later, U.S. forces also saw his likeness on a jihadist propaganda poster near the Pakistan border. Change in strategy

How to be a data journalist Data journalism is huge. I don't mean 'huge' as in fashionable - although it has become that in recent months - but 'huge' as in 'incomprehensibly enormous'. It represents the convergence of a number of fields which are significant in their own right - from investigative research and statistics to design and programming. The idea of combining those skills to tell important stories is powerful - but also intimidating. Who can do all that? The reality is that almost no one is doing all of that, but there are enough different parts of the puzzle for people to easily get involved in, and go from there. 1. 'Finding data' can involve anything from having expert knowledge and contacts to being able to use computer assisted reporting skills or, for some, specific technical skills such as MySQL or Python to gather the data for you. 2. 3. 4. Tools such as ManyEyes for visualisation, and Yahoo! How to begin? So where does a budding data journalist start? Play around. And you know what?

CSI Math simpleR Using R for Introductory Statistics. By John Verzani Version 0.4 (August 22, 2002). printable versions Skip to the table of contents. [If the math symbols do not show up properly, you may need to configure your browser. Preface These notes are an introduction to using the statistical software package R for an introductory statistics course. These notes were written to take advantage of R version 1.5.0 or later. There are several references to data and functions in this text that need to be installed prior to their use. > install.packages("UsingR") THESE ARE OLD INSTRUCTIONS. for Windows users. for UNIX users. If necessary, the file can sent in an email. This is version 0.4 of these notes and were last generated on August 22, 2002. the CSI Math department. Copyright © John Verzani, 2001-2.

Compulsive Data Analysis D3.js is Not a Graphing Library, Let's Design a Line Graph Working with graphing libraries can be tedious. Designing them can be downright frustrating. Each one of them slightly different, but most of them share two common flaws: a design-by-configuration and template design approach. A bar graph can be just a few bars with labels and tick marks...until it isn't. Want to change the background color? As long as you stay within the confines of the template, it's simple, but, anytime you want customize a specific aspect of the original template, more configuration options are added to the library. I'm going to use jqplot, a pretty popular graphing library, in the following examples. {.note} Before we begin: This is not a LOC comparison. var plot1 = $.jqplot ('chart1', [[3,7,9,1,4,6,8,2,5]]); This looks simple enough. What happens when we need to tweak a few things? D3: Layers, Shapes, Text and Scales What about D3? At its core, a graph is just layers of paths, primitives, color and text—something SVG is perfectly suited for. See example in action →

Diary Dig -- Afghan War Diaries explorer Which school districts have high rates of poverty in Washington State? - Wiki Ed Data The R Project for Statistical Computing d3.js How this was released Julian Assange on the Afghanistan war logs: 'They show the true nature of this war' Link to video: Julian Assange on the Afghanistan war logs: 'They show the true nature of this war' US authorities have known for weeks that they have suffered a haemorrhage of secret information on a scale which makes even the leaking of the Pentagon Papers during the Vietnam war look limited by comparison. The Afghan war logs, from which the Guardian reports today, consist of 92,201 internal records of actions by the US military in Afghanistan between January 2004 and December 2009 – threat reports from intelligence agencies, plans and accounts of coalition operations, descriptions of enemy attacks and roadside bombs, records of meetings with local politicians, most of them classified secret. The Guardian's source for these is Wikileaks, the website which specialises in publishing untraceable material from whistleblowers, which is simultaneously publishing raw material from the logs.

Related:  Networks TheoryResearch BlogsWikiLeaks.3NEWSralgorithmsvarious stuff 3Unsorted 5/7/2012blogs