background preloader

BigData

Facebook Twitter

Discovering Stolen Data with Hadoop. Every week, there are reports about new data breaches at organizations ranging from retailers to government agencies to, ahem, “dating services.”

Discovering Stolen Data with Hadoop

In fact, the theft of sensitive data costs global industry over $445 billion each year. Even the most robust security can’t guarantee stopping sophisticated attackers and insider threats. Given the fact that the average data breach takes over 200 days to discover, adversaries have months or even years to exploit a security incident. BeyondBigDataPaperFINAL. Data Scientists Sometimes Fool Themselves. Statistically Speaking, What Does the Average Startup Look Like? Santa Claus and Big Data. The holiday season operation is a big deal for Santa Claus.

Santa Claus and Big Data

Getting the wide range of presents to kids all over the world is a complex operation that needs to be carried out within just a few days. Of course, nothing can go wrong, as that would significantly depress kids and their parents. Fortunately he can turn to Big Data to drive his different operations, which range from personalization of presents, inventory management and of course elf resources. FTC to Examine Effects of Big Data on Low Income and Underserved Consumers at September Workshop; Project No. P145406. The Federal Trade Commission will host a public workshop entitled "Big Data: A Tool for Inclusion or Exclusion?

FTC to Examine Effects of Big Data on Low Income and Underserved Consumers at September Workshop; Project No. P145406

" in Washington on Sept. 15, 2014, to further explore the use of "big data" and its impact on American consumers, including low income and underserved consumers. "A growing number of companies are increasingly using big data analytics techniques to categorize consumers and make predictions about their behavior," said FTC Chairwoman Edith Ramirez. How One Woman Hid Her Pregnancy From Big Data. Enterprise Gamification Consultancy - An Overview of Gamification in Recruitment. Standard job interview questions, used by many recruiters and managers, seem to be really ill fitted to predict a candidate’s future performance.

Enterprise Gamification Consultancy - An Overview of Gamification in Recruitment

According to professor Allen Huffcutt from Bradley University, who’s been studying job interviews for the better part of the past 20 years, identified a number of problems with the recruitment process in general and the interview process in particular. In several blogs about the gamification score we talked already in length about how unrelated to facts today’s evaluation processes for employees are. But the problem starts way early, during recruiting.

Typical interview questions are ignoring highly relevant information. Huffcutt identified the following 10 questions as the most common in job interviews: The Work of Edward Tufte and Graphics Press. Edward Tufte is a statistician and artist, and Professor Emeritus of Political Science, Statistics, and Computer Science at Yale University.

The Work of Edward Tufte and Graphics Press

He wrote, designed, and self-published 4 classic books on data visualization. The New York Times described ET as the "Leonardo da Vinci of data," and Business Week as the "Galileo of graphics. " He is now writing a book/film The Thinking Eye and constructing a 234-acre tree farm and sculpture park in northwest Connecticut, which will show his artworks and remain open space in perpetuity.

He founded Graphics Press, ET Modern gallery/studio, and Hogpen Hill Farms LLC. Visual Display of Quantitative Information 200 pages Envisioning Information 128 pages Visual Explanations 160 pages Beautiful Evidence 214 pages. Blog - Off The Charts: An Interview with John Foreman, Chief Data Scientist at MailChimp. The Dangers of Faith In Data. BdeQ54cCQAAOGNc. Infografia_las_4_v_del_big_data. Business-models-for-data-economy. They're Watching You at Work - Don Peck. In 2003, thanks to Michael Lewis and his best seller Moneyball, the general manager of the Oakland A’s, Billy Beane, became a star.

They're Watching You at Work - Don Peck

The previous year, Beane had turned his back on his scouts and had instead entrusted player-acquisition decisions to mathematical models developed by a young, Harvard-trained statistical wizard on his staff. What happened next has become baseball lore. The A’s, a small-market team with a paltry budget, ripped off the longest winning streak in American League history and rolled up 103 wins for the season. Only the mighty Yankees, who had spent three times as much on player salaries, won as many games. The team’s success, in turn, launched a revolution. Most visited site by country. Sizing The Big Data Market: No One Has A Clue. Forget all the Big Data numbers you've seen.

Sizing The Big Data Market: No One Has A Clue

The reality is that no one has a clue how much Big Data adoption there is, because few actually know what Big Data means. Ian Bertram, managing vice president at Gartner, points this out, arguing that the industry is completely muddled over what Big Data means. In Head-Hunting, Big Data May Not Be Such a Big Deal. Robert McNamara and the Dangers of Big Data at Ford and in the Vietnam War.

Big data is poised to transform society, from how we diagnose illness to how we educate children, even making it possible for a car to drive itself.

Robert McNamara and the Dangers of Big Data at Ford and in the Vietnam War

Information is emerging as a new economic input, a vital resource. Companies, governments, and even individuals will be measuring and optimizing everything possible. But there is a dark side. Big data erodes privacy. Big Data, Trying to Build Better Workers. Antibiotics and drug resistance: how do we compare? Will antibiotics be able to fight superbugs like MRSA in future?

Antibiotics and drug resistance: how do we compare?

Antibiotics were the twentieth century's miracles - ever since Alexander Fleming discovered Penicillin, we have got in the habit of popping them every time we get a cold. But that habit could be coming back to bite us: the UK's Chief Medical Officer has warned that Antibiotic-resistant bacteria with the potential to cause untreatable infections pose "a catastrophic threat" to the population The annual report out today finds that While a new infectious disease has been discovered nearly every year over the past 30 years, there have been very few new antibiotics developed leaving our armoury nearly empty as diseases evolve and become resistant to existing drugs It has become an issue around the world.

The history of Hadoop: From 4 nodes to the future of data. Depending on how one defines its birth, Hadoop is now 10 years old.

The history of Hadoop: From 4 nodes to the future of data

In that decade, Hadoop has gone from being the hopeful answer to Yahoo’s search-engine woes to a general-purpose computing platform that’s poised to be the foundation for the next generation of data-based applications. Alone, Hadoop is a software market that IDC predicts will be worth $813 million in 2016 (although that number is likely very low), but it’s also driving a big data market the research firm predicts will hit more than $23 billion by 2016. Since Cloudera launched in 2008, Hadoop has spawned dozens of startups and spurred hundreds of millions in venture capital investment since 2008. Good Problems To Solve In Data Science. WSJ: Retailers adjusting online prices based on location and perceived income. Retailers such as Staples are modifying the prices displayed on their websites depending on the shopper’s location. In an investigation, The Wall Street Journal discovered that Staples is specifically adjusting item pricing for different people according to their distance from a rival’s store.

Army cuts: how have UK armed forces personnel numbers changed over time? The British army is facing huge cuts, in the latest round of spending details. This report, from the MoD, talks about cuts of 20,000 in regular forces. Nick Hopkins writes today that With the army needing to axe 20,000 posts because of budget cuts, commanders are pushing to downsize as quickly as possible rather than prolong the process.

Top 5 Myths About Big Data. Brian Gentile is the CEO of Jaspersoft, a commercial open source business intelligence software company. Folllow him @BrianG_Jasper. Data Mining Your Desktop. Google opens up its Biq Query data analytics service to all — Cloud Computing News. Big Data University. The Rise of Big Data Apps And The Fall of SaaS. Editor’s note: Raj De Datta is the CEO and co-founder of BloomReach. Follow @BloomReachInc on Twitter. 5 companies turning your data into dollars — Cloud Computing News.