background preloader

1.0 Intro

Facebook Twitter

3 ways big data is transforming government. Management 3 ways big data is transforming government.

3 ways big data is transforming government

Big Data. Big Data: Are you ready for blast-off? As Technology of Business begins a month-long series of features on the theme of Big Data, we kick off with a Q&A backgrounder answering some of those basic questions you were too afraid to ask.

Big Data: Are you ready for blast-off?

What is big data exactly? Good question. Big Data’s Biggest Challenge? Convincing People NOT to Trust Their Judgment. Here’s a simple rule for the second machine age we’re in now: as the amount of data goes up, the importance of human judgment should go down.

Big Data’s Biggest Challenge? Convincing People NOT to Trust Their Judgment

The previous statement reads like heresy, doesn’t it? Management education today is largely about educating for judgment—developing future leaders’ pattern-matching abilities, usually via exposure to a lot of case studies and other examples, so that they’ll be able to confidently navigate the business landscape. And whether or not we’re in b-school, we’re told to trust our guts and instincts, and that (especially after we gain experience) we can make accurate assessments in a blink. This is the most harmful misconception in the business world today (maybe in the world full stop). As I’ve written here before, human intuition is real, but it’s also really faulty. I could go on and on, but I’ll leave the final word here to psychologist Paul Meehl, who started the research on human “experts” versus algorithms almost 60 years ago.

BigData.pdf. Charlie Rose and Jeff Hammerbacher talk Data Science in Healthcare. Creating Business Value with Big Data. DataScienceBook1_1. Deathtrap: Overlearning in Predictive Analytics. I am in the process of gathering survey data for the TDWI Predictive Analytics Best Practices Report.

Deathtrap: Overlearning in Predictive Analytics

Right now, I’m in the data analysis phase. It turns out (not surprisingly) that one of the biggest barriers to adoption of predictive analytics is understanding how the technology works. Education is definitely needed as more advanced forms of analytics move out to less experienced users. With regard to education, coincidentally I had the pleasure of speaking to Eric Siegel recently about his book, “Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die” (www.thepredictionbook.com). Eric Siegel is well known in analytics circles. Frontiers in Massive Data Analysis. In_idea_smarter_computing_to_big-data-analytics_and_path_from_insights-to-value.

Industrial_Internet.pdf. Magazine: How Big Data Will Change the Way You Code. Posted by editor on February 4, 2014 at 5:37 PM PST The January/February 2014 issue of Java Magazine came out recently.

Magazine: How Big Data Will Change the Way You Code

Making sense of too much data. Super Bowl Prostitution Digitally Mapped by Data Trackers. Jan. 31 (Bloomberg) -- Sitting in an operations center outside Washington, Josh Gearheart and his team have spent the last week tracing the digital footprints of Super Bowl sex traffickers with the same technology he once used to hunt insurgents in Afghanistan.

Super Bowl Prostitution Digitally Mapped by Data Trackers

A former Army intelligence officer, Gearheart is part of a two-year partnership between trafficking researchers and a defense contractor called Praescient Analytics, whose 100 employees normally provide intelligence analysis to the U.S. Special Operations Command, the Federal Bureau of Investigation and others from the company’s headquarters in Alexandria, Va. The group’s goal is to discern how gangs and traffickers operate as 400,000 fans descend on New Jersey and New York for the country’s biggest sports-themed bacchanal and then apply that knowledge to next year’s game in Arizona. Heavy Partying “Sex trafficking is a really hard-to-see problem,” said Dan Potocki, who directs the Initiatives Group at Praescient. Modern Slavery. Swiss-Analytics-Magazine-1.pdf. The Defense Department’s data strategy: Huge, massive and distributed. Ely Kahn has spent more than a decade working in the national security world, including stints at the Transportation Safety Administration, Department of Homeland Security and the Executive Office of the President, where he was director of cybersecurity.

The Defense Department’s data strategy: Huge, massive and distributed

In 2012, he joined up with a team of former National Security Agency engineers to create Sqrrl, a database company based on open-source Accumulo technology they created within the spy agency. The NHS plan to share our medical data can save lives – but must be done right. Everything would be much simpler if science really was "just another kind of religion".

The NHS plan to share our medical data can save lives – but must be done right

But medical knowledge doesn't appear out of nowhere, and there is no ancient text to guide us. Instead, we learn how to save lives by studying huge datasets on the medical histories of millions of people. This information helps us identify the causes of cancer and heart disease; it helps us to spot side-effects from beneficial treatments, and switch patients to the safest drugs; it helps us spot failing hospitals, or rubbish surgeons; and it helps us spot the areas of greatest need in the NHS. Numbers in medicine are not an abstract academic game: they are made of flesh and blood, and they show us how to prevent unnecessary pain, suffering and death. Now all this vital work is being put at risk, by the bungled implementation of the care.data project. Now the teams behind care.data are trying to row back, explaining that access will only be granted for research that benefits NHS patients. The One-Stop Shop for Big Data.

New technologies allow schools, colleges and universities to analyse absolutely everything that happens.

The One-Stop Shop for Big Data

From student behaviour, testing results, careers developments of students as well as educational needs based on changing societies. A lot of these data has already been stored and is used for statistical analysis by government agencies such as the National Center for Educational Statistics. With the rise of more and more online education and the development of MOOC’s all the data gets a completely new meaning. Big data allow for very exciting changes in the educational field that will revolutionize the way students learn and teachers teach. To stimulate this trend, the US Department of Education (DOE) was part of a host of agencies to share a $200 million initiative to begin applying Big Data analytics to their respective functions, as described in a post by James Locus.

Improve Student Results. Toward Scalable Systems for Big Data Analytics: A Technology Tutorial. Recent technological advancements have led to a deluge of data from distinctive domains (e.g., health care and scientific sensors, user-generated data, Internet and financial companies, and supply chain systems) over the past two decades.

Toward Scalable Systems for Big Data Analytics: A Technology Tutorial

The term big data was coined to capture the meaning of this emerging trend. UPMC’S ‘Big Data’ Technology Shows Promise in Breast Cancer Research. Views from the front lines of the data-analytics revolution. This past October, eight executives from companies that are leaders in data analytics got together to share perspectives on their biggest challenges. All were the most senior executives with data-analytics responsibility in their companies, which included AIG, American Express, Samsung Mobile, Siemens Healthcare, TD Bank, and Wal-Mart Stores. Their backgrounds varied, with chief information officers, a chief data officer, a chief marketing officer, a chief risk officer, and a chief science officer all represented. We had seeded the discussion by asking each of them in advance about the burning issues they were facing.

For these executives, the top five questions were: White House-MIT Big Data Privacy Workshop: Advancing the state of the art in technology and practice.