background preloader

Big Data

Facebook Twitter

Real-time Discovery Engine - YourVersion: Discover Your Version of the Web™

Products

Trends. Notable Experts. Abadi. Big data. Visualization of daily Wikipedia edits created by IBM.

Big data

At multiple terabytes in size, the text and images of Wikipedia are an example of big data. Growth of and Digitization of Global Information Storage Capacity Source Big data is a broad term for data sets so large or complex that traditional data processing applications are inadequate. Challenges include analysis, capture, curation, search, sharing, storage, transfer, visualization, and information privacy. The term often refers simply to the use of predictive analytics or other certain advanced methods to extract value from data, and seldom to a particular size of data set. Analysis of data sets can find new correlations, to "spot business trends, prevent diseases, combat crime and so on Work with big data is necessarily uncommon; most analysis is of "PC size" data, on a desktop PC or notebook[11] that can handle the available data set.

Definition[edit] Characteristics[edit] Big data can be described by the following characteristics: What is big data? Big data is data that exceeds the processing capacity of conventional database systems.

What is big data?

The data is too big, moves too fast, or doesn’t fit the strictures of your database architectures. To gain value from this data, you must choose an alternative way to process it. The hot IT buzzword of 2012, big data has become viable as cost-effective approaches have emerged to tame the volume, velocity and variability of massive data. Within this data lie valuable patterns and information, previously hidden because of the amount of work required to extract them. To leading corporations, such as Walmart or Google, this power has been in reach for some time, but at fantastic cost.

The value of big data to an organization falls into two categories: analytical use, and enabling new products. The past decade’s successful web startups are prime examples of big data used as an enabler of new products and services. What does big data look like? Volume Velocity Why is that so? As Chief Yahoo Resigns, Can Big Data Save Stumbling Company? Author: Linda RosencranceSpotfire Blogging Team Yesterday, Yahoo co-founder Jerry Yang resigned from the board of directors and all other positions at the troubled company.

As Chief Yahoo Resigns, Can Big Data Save Stumbling Company?

This comes on the tail of Yahoo recently naming a new CEO, Scott Thompson. What may save this stumbling company is the new CEO’s belief in big data. So much so that he says big data is the “key to Yahoo’s long-term health.” In fact, Thompson is counting on big data and analytics to help Yahoo compete with Facebook and Google. For Thompson, formerly the president of PayPal, making use of Yahoo’s data is crucial to building the best products for consumers and advertisers.

Thompson says he’s even more convinced that the same opportunity exists for Yahoo to use the data that’s at the heart of its business to make the company successful. “If this business is going to be really successful five years from now, we’ll get this right better than anyone else,” Thompson told AdAge. Microsoft Releases Hadoop Connector CTPs for SQL Server.

News Microsoft Releases Hadoop Connector CTPs for SQL Server Microsoft released two community technology preview (CTP) test versions of its Hadoop connectors today, one that works with Microsoft's current flagship SQL Server and other with its data warehouse product.

Microsoft Releases Hadoop Connector CTPs for SQL Server

One of the connectors is designed to work with SQL Server 2008 R2 and is currently available for download here as a CTP test release. The other connector is for SQL Server Parallel Data Warehouse (PDW), but there's no download page. Microsoft's PDW customers can get a copy of the Hadoop connector CTP release for PDW by requesting it through Microsoft's customer support service, according to Microsoft's announcement.

The announcement indicates that the Hadoop connector for SQL Server 2008 R2 is also compatible for use with SQL Server code-named "Denali," Microsoft's next-generation relational database management system. Microsoft had signaled its planned rollout of the two Hadoop connector CTP releases earlier this month. DataScientistProfession.