background preloader


Facebook Twitter

25 Definitions of Big Data. Big Data's Value Lies in Self-Regulation. John C.

Big Data's Value Lies in Self-Regulation

Havens is the founder of The H(app)athon Project and author of the upcoming book H(app)y — The Value of Well Being in a Digital Economy (Tarcher/Penguin, 2014). He can be reached @johnchavens. “The greatest trick the devil ever pulled was convincing the world he didn’t exist.” —Kevin Spacey as Verbal in The Usual Suspects. Nate Silver on the Art and Science of Prediction. Soon, You'll Know As Much About What You Buy As the Company That Made It. By David Berreby The term "Big Data" naturally conjures up images of Big Users, like the government or Google or Costco.

Soon, You'll Know As Much About What You Buy As the Company That Made It

It's easy to see why big enterprises crunch data to learn, for example, which groceries people want on the first day of a heat wave and which they want later on, or how warmed-up Scots buy different foods than people on a hot day in England, or how your recent Facebook activity hints that you're in the market for a new printer. The One Infographic About the Digital Revolution You Need to Understand. What You’ll Do Next. Other efforts to predict behavior were based on models of human nature.

What You’ll Do Next

The people using big data don’t presume to peer deeply into people’s souls. They don’t try to explain why people are doing things. They just want to observe what they are doing. The theory of big data is to have no theory, at least about human nature. You just gather huge amounts of information, observe the patterns and estimate probabilities about how people will act in the future. As Viktor Mayer-Schönberger and Kenneth Cukier write in their book, “Big Data,” this movement asks us to move from causation to correlation.

Instead, they aim to stand back nonjudgmentally and observe linkages: “Correlations are powerful not only because they offer insights, but also because the insights they offer are relatively clear. This method has yielded some impressive observations. How to Tell a Story with Data - Jim Stikeleather - Harvard Business Review. Cities and data: By the numbers. Making data analytics work: Three key challenges. By now, most companies recognize that they have opportunities to use data and analytics to raise productivity, improve decision making, and gain competitive advantage.

Making data analytics work: Three key challenges

“Analytics will define the difference between the losers and winners going forward,” says Tim McGuire, a McKinsey director. Video Building a data-driven organization Matt Ariker, COO, McKinsey Consumer Marketing Analytics Center Play video But actually mapping out an analytics plan is complicated. Pundits: Stop Sounding Ignorant About Data - Andrew McAfee. By Andrew McAfee | 11:00 AM April 23, 2013 The current surge of enthusiasm around big data has produced a predictable backlash.

Pundits: Stop Sounding Ignorant About Data - Andrew McAfee

Some of it, like Gary Marcus’s New Yorker post “Steamrolled by Big Data,” is insightful and well-reasoned (even though I have my quibbles with some of his points). This is not surprising, since he’s a neuroscientist as well as a writer, and so quite comfortable with data. Unfortunately, some other prominent commentators clearly aren’t. Eric Schmidt and Jared Cohen: The Dark Side of the Digital Revolution. 4 Barriers Stand Between You and Big Data Insight. CIO — Over the past three years or so, the buzz around big data has continued to grow.

4 Barriers Stand Between You and Big Data Insight

While some dismiss it as so much hype, businesses around the world are taking notice: In its recently released 5th annual Digital IQ Survey, consulting firm PwC found that 62 percent of respondents believe big data can give them a competitive advantage. But believing in the power of big data is one thing; leveraging big data for actionable insights is another. PwC also found that 58 percent of respondents agree that moving from data to insight is a major challenge.

"The amount of information and data that we're collecting now is truly enormous in terms of the volume that is outside the four walls of the organization," says Anand Rao, principal at PwC. "Organizations don't have the right people, they don't have the right structure in place and they're still struggling with some of the tools and techniques. " The Hidden Biases in Big Data - Kate Crawford. By Kate Crawford | 2:00 PM April 1, 2013 This looks to be the year that we reach peak big data hype.

The Hidden Biases in Big Data - Kate Crawford

From wildly popular big data conferences to columns in major newspapers, the business and science worlds are focused on how large datasets can give insight on previously intractable challenges. The hype becomes problematic when it leads to what I call “data fundamentalism,” the notion that correlation always indicates causation, and that massive data sets and predictive analytics always reflect objective truth. Former Wired editor-in-chief Chris Anderson embraced this idea in his comment, “with enough data, the numbers speak for themselves.” Big data and development organizations: What happens when you move from theory to practice? The overall interaction of suppliers of the major World Bank awarded projects through all sectors from 2007 to 2013 (see data) – each fully connected subnetwork (clique) represents a collaboration of all suppliers on at least one project It all sounds very good in principle, but what happens when you explore big data for development in practice?

Big data and development organizations: What happens when you move from theory to practice?

It is this “learning by doing” philosophy that inspired our big data for development challenge with the World Bank and the UN Global Pulse. The Promise And Peril Of Big Data. From health care to city management, we hold out a lot of hope for data--and even more, "Big Data"--to fix our problems.

The Promise And Peril Of Big Data

And, in many cases, it surely will. But the perils of personal information being freely available to all--from fraud, to identity theft, to authoritarian intrusion--are also clear. Data is a double-edged sword that’s just as likely to deprive us of our individualism, as serve up the perfect, and personalized, 21st-century solution. A new report from the World Economic Forum, developed by the Boston Consulting Group, looks at the implications for data rights in a world of omni-analytics and ubiquitous networks, including the so-called "Internet of Things," which will soon deliver data from more or less every machine we come across, not to mention our interactions with smart-phones, Web browsers, and Twitter channels. The report, which is based on interviews over nine months with private and public officials around the world, says it’s time for a rethink. Google's data mining raises questions of national security.

An imminent report on an emerging threat to individual privacy to be issued by the European data protection authorities raises even more serious issues than those it is likely to address.

Google's data mining raises questions of national security

The report will consider Google's asserted right to expand its data mining to combine users' personal data across all their accounts and services, including Gmail, internet searching, map and location information and photo sharing, with no way for individuals to opt out. At least one technology blogger has accused Microsoft of planning similar changes, while two new Facebook programmes to aggregate user data with other advertising and loyalty card data have also drawn concern. Whatever the merits of each case, the larger issue deserves greater public attention. Big Data Social Intelligence: Five Reasons Corporations Need It. Social media has made anyone and everyone a virtual broadcaster, delivering incredible reach to individuals and their messages like never before, regardless of the number of “friends” or “followers” they may have. With billions and billions of messages getting delivered across the Internet and social networks everyday, companies need to become more sophisticated and vigilant in their listening and understanding of these messages and how they can harm or help their business.

What many don’t understand is that social media has expanded into streaming big data. This unstructured data is not only big, but also fast and requires hypercomputing processing speed and sophisticated modeling to distill the relevant information and discover the real insight. First generation tactics like samples and keywords are obsolete given the big, fast, ugly nature of social media. Here are five major reasons that corporations need to incorporate advanced social intelligence (ASI) into their strategies:

Analytics Education in the era of Big Data. 5 Ways Big Data Will Change Lives In 2013. By Siddharth Taparia, Senior Director, Portfolio and Strategic Marketing, SAP Recently, I saw firsthand how a new “universal identification” program called Aadhar is taking shape in India. It has potential to improve the lives of millions of poor people via Big Data. Aadhar is an ambitious government Big Data project aimed at becoming the world’s largest biometric database by 2014, with a goal of capturing about 600 million Indian identities. This could help India’s government and businesses deliver more efficient public services and facilitate direct cash transfers to some of the world’s poorest people — while saving billions of dollars each year.

‘Big data’ is dead. What’s next? How can big data and smart analytics tools ignite growth for your company? Find out at DataBeat, May 19-20 in San Francisco, from top data scientists, analysts, investors, and entrepreneurs. Register now and save $200! This is a guest post by technology executive John De Goes. Big Data and Data Analysis Predictions for 2013. Chris Varley: Back To The Future Of Big Data. This post originally appeared, in a slightly different form, as part of the WeTheData project. If you aren't familiar with or Vibrant Data, I strongly encourge you to check them out here.Thirty years from now we will look back on what we call “Big Data” today aghast at our naiveté. “That,” we will quietly think to ourselves, too embarrassed to actually say the words out loud, “is what we thought were the important, world-changing things we could do (or, perhaps more importantly, should do) with all that data?

Bigdata-genomics.jpg (JPEG Image, 660×660 pixels) - Scaled (91%) Improving Decision Making in the World of Big Data. Big data and the democratisation of decisions.pdf (application/pdf Object) PanelPicker. Voting period for this idea type has passed There’s no longer much doubt about the opportunity for Big Data. It’s a $100 billion (and growing) market that is causing radical change in just about every industry, from marketing and retail to financial services and the supply chain. What Data Can’t Do.