background preloader

Big Data Right Now: Five Trendy Open Source Technologies

Big Data Right Now: Five Trendy Open Source Technologies
Big Data is on every CIO’s mind this quarter, and for good reason. Companies will have spent $4.3 billion on Big Data technologies by the end of 2012. But here’s where it gets interesting. Those initial investments will in turn trigger a domino effect of upgrades and new initiatives that are valued at $34 billion for 2013, per Gartner. Over a 5 year period, spend is estimated at $232 billion. What you’re seeing right now is only the tip of a gigantic iceberg. Big Data is presently synonymous with technologies like Hadoop, and the “NoSQL” class of databases including Mongo (document stores) and Cassandra (key-values). But there are new, untapped advantages and non-trivially large opportunities beyond these usual suspects. Did you know that there are over 250K viable open source technologies on the market today? We have a lot of…choices, to say the least. What’s on our own radar, and what’s coming down the pipe for Fortune 2000 companies? Storm and Kafka Why should you care? Drill and Dremel

What is Big Data, Hadoop and HDFS: 3 Must Watch YouTube Videos I received great response to one of my previous post titled 5 Must Watch YouTube Videos on Big Data and many of you reached out to me requesting for more such blog posts. Well, your request is granted. Here are three great videos on what is Big Data, Hadoop and HDFS. Hope you enjoy them and do let me know if it is useful. Based on your comments and feedback, I will share more such great resources on Big Data. So either leave a comment in comments section of this post or better still, tweet your comment, mentioning my twitter ID @HKotadia and I will surely reply to you. Enjoy and learn from these videos (double click on videos for full screen view). 1. 2. 3. Data Warehouse Junkie

Gartner: 10 Critical IT Trends for the Next Five Years Trying to stay ahead of the curve when it comes to IT issues is not a job for the faint of heart. That point was driven home at Gartner's IT annual IT Symposium fest here where analyst David Cappuccio outlined what he called "new forces that are not easily controlled by IT are pushing themselves to the forefront of IT spending." The forces of cloud computing, social media/networking, mobility and information management are all evolving at a rapid pace. These evolutions are largely happening despite the controls that IT normally places on the use of technologies, Cappuccio stated. "IT was forced to support tablets, and end users forced them to support IM and wireless networks a few years ago. And more such technologies are on the horizon," he said. Cappuccio's presentation listed the following as the "Ten Critical Trends and Technologies Impacting IT During the Next Five Years." 1. 2. 3. 4. Cloud computing is heavily influenced by the Internet and vendors that have sprung from it. 5. 6.

BYOD: Why Mobile Device Management Isn't Enough - Global-cio - Here's what to look for in MDM software and what limitations IT still faces in letting employees use personal devices for work. Nine out of 10 technology pros think smartphones and tablets will become more important to business productivity in the next couple of years. Seventy-two percent expect to offer more bring-your-own-device options so that employees can access company data with their personal gadgets. But IT doesn't necessarily see mobile device management software as essential to coping with this proliferation of devices in the workplace. Only 26% of respondents to the InformationWeek Mobile Device Management and Security Survey say their companies have implemented MDM software, and another 17% say they're in the process of deploying it. Even those companies that have implemented MDM need to make sure their technology and policies really deliver the data security and management efficiency they seek. Too many IT shops are working without this strategic view. The common trait?

Big data: Crunching the numbers A BIG BANK hires a star analyst from another firm, promising to pay a substantial bonus if the new hire increases revenue or cuts costs. In banking this happens all the time, but this deal differs from the rest in one small detail: the new hire, Watson, is an IBM computer. Watson became something of a celebrity after beating the champion human contestants on “Jeopardy”, an American quiz show. Its skill is to be able to process millions of documents quickly by reading and “understanding” ordinary written language. Computers have no trouble with searching data neatly sorted in databases. Citigroup has hired Watson to help it decide what new products and services (such as loans or credit cards) to offer its customers. In most financial institutions the immediate use of big data is in containing fraud and complying with rules on money-laundering and sanctions. A better kind of crystal ball A stablemate of sorts to Palantir is Xoom, a firm that specialises in cross-border remittances.

Salary/Income of Analytics/Data Mining/Data Science professionals The big demand for analytics, data mining, and data science professionals led to a significant jump in their salaries in 2013. Salaries are highest in US, Australia/NZ, and among self-employed and industry data scientists. See details. The 2013 KDnuggets Annual Salary Poll asked What is your annual salary/income range (in USD) and employment ? The big demand for data scientists led to a significant jump in overall compensation in 2013, including 12% increase globally, 13% increase in US/Canada, and 29% increase among self-employed. About 80% of the respondents were from companies or were self-employed. US and AU/NZ lead in salaries, with Western Europe and Middle East forming a strong second tier. The following graph shows the overall landscape of analytics compensation: Graph 1: Analytics Salary/Income by Region and Employment type excluding students and unemployed. Table 1: 2013 Annual Income/Salary by Employment type In Table 2 we break down the data by region.

Business Intelligence fácil Gartner: How Big Trends in Security, Mobile, Big data and Cloud will Change IT Trying to get through it all can be daunting so we've tried to simplify that process by distilling a variety of Gartner ITxpo presentations and coming up with the most salient information. So here goes. From the Gartner analysts, presentations on: The world of IT • Worldwide IT spending is forecast to surpass $3.7 trillion in 2013, a 3.8% increase from 2012's projected spending of $3.6 trillion, but it's the outlook for big data that is creating much excitement. Most of the current spending is used in adapting traditional solutions to the big data demands -- machine data, social data, widely varied data, unpredictable velocity, and so on -- and only $4.3 billion in software sales will be driven directly by demands for new big data functionality in 2012. • Big data currently has the most significant impact in social network analysis and content analytics with 45% of new spending each year. • In the next three years, the dominant consumer social networks will see the limits of their growth.

Big Idea 2013: The Web Grows Up Unlocking Big Data with R The explosion of big data has caused far-reaching ripples in the enterprise. Organizations today are faced with unprecedented challenges in sorting, processing and analyzing their data, which has in turn given rise to a new generation of technologies. One such example is the R statistics language, which was originally developed by noted statisticians Robert Gentleman and Ross Ihaka at the University of New Zealand in 1997. In recent years, R has emerged as a popular language for advanced analytics, and is also central to the emerging data science movement. David Smith is Vice President of Marketing & Community at Revolution Analytics, a Palo Alto, Calif. Over two million analysts worldwide use R, and they come from an extremely diverse pool of industries that ranges from journalism to financial services to life sciences. New York Times Co. The New York Times graphics department has long used R for its data visualization features. Orbitz Leading online travel site Orbitz OKCupid OKCupid!

Top Big Data VC Investors Companies in the Big Data industry have received close to $5B in VC financing in the last few years. We look at the top VC firms that invest in Big Data. Companies in the Big Data industry have received $4.9 billion in funding since 2008, with the bulk of financing in 2011 and 2012. According to CB Insights blog, here are the top 10 venture companies that invest in Big Data, and the number of their unique investments in Big Data related companies: SV Angel, 14 Big Data companies, including Quora, Dropbox, bitly Sequoia Capital, 13 Big Data companies, including Meebo, LogLogic IA Ventures, 13 companies, including Datapop, Datasift, MemSQL, Metamarkets, Recorded Future New Enterprise Associates, 12 companies, including 10gen, 23andMe, AddThis, AeroSpike, Coursera. First Round Capital, 10 companies, including AsterData, Curalate, Gigya, Gnip, memsql, StumbleUpon, and the ClimateCorporation. Khosla Ventures, 8 companies, including Ayasdi, ClearStory Data, Kaggle, Metamarkets, bitly

Related: