background preloader

Big Data

Facebook Twitter

Witter / ? Facial Analysis: Wall Street's Next Big-Data Tool. Researchers at the New Jersey Institute of Technology are analyzing facial expressions of corporate execs, as well as other data streams, to forecast stock market trends. 9 Google Apps Tips: Productivity Boosters (Click image for larger view and slideshow.)

Facial expressions can provide a window into a person's unspoken thoughts. But can these nonverbal tells provide real-time insights for financial traders? That's the goal of New Jersey Institute of Technology (NJIT) researchers, who are developing ways to filter and analyze corporate data to forecast future market trends. This effort includes the work of Dr. [Google's revised version of CAPTCHA promises to make life easier for users. "Specifically, I look at boards of directors, CEOs, things like that," said Cicon in a phone interview with InformationWeek.

"We track certain areas of the face," Cicon explained. NJIT's software extracts measurements of primitive emotional states, such as disgust, fear, and surprise. More Insights. Business Intelligence Software: Where It's Headed - Datamation. Business Intelligence (BI) software has had a bit of a struggle as of late. Although the concept has been around for decades, it's been overshadowed by the shiny new thing, Big Data, which has its roots in BI but adds on much more. Part of the problem centers around the fact many people don't even know the difference between BI software and Big Data tools, and if you don't know what they are, you don't know what they do.

IT consultant Eric D. Brown summed it up nicelyby stating "Business Intelligence helps find answers to questions you know. By that logic, BI software will always have a place and won't be supplanted by Big Data because they are both working toward two very different ends. Gartner notes that the analytics market, the overarching umbrella that cover both BI and Big Data, is splitting into two groups: the traditional business intelligence market and the new data discovery market, which is primarily Big Data. TransUnion Survey: Big Data Management, New Privacy Laws Could Define Future of Private Investigation Industry.

CHICAGO, IL--(Marketwired - Dec 1, 2014) - A new survey from TransUnion TLOxp® found that privacy regulations and big data management are top priorities for the private investigation industry. The survey -- which included more than 1,600 private investigators across the country -- found that nearly six in 10 private investigators agree or strongly agree that the volume of data available today is unmanageable without advanced data aggregation tools. Although private investigators find big data unmanageable without the proper tools, 65% of respondents believe the increased use of big data will have a positive or very positive impact on the industry over the next five years. Private investigators sort through massive amounts of data -- such as current and past addresses, liens, judgments & bankruptcies, phone numbers, assets, and more -- to conduct deep investigations.

In addition to big data management, survey respondents ranked skip tracing tools as highly important. Witter / ? Big data finds 70,000 'hidden' companies in the UK’s Information Economy industries. Big data finds 70,000 'hidden' companies in the UK’s Information Economy industries EMBARGOED until 00.01 Thursday 27 November 2014 The UK's Information Economy industries could be 42% larger than current estimates, with at least 70,000 extra ICT-producing companies in operation and hotspots around the country. This is according to new research published by Dr Max Nathan and Dr Anna Rosso at NIESR, alongside Francois Bouet at Growth Intelligence and funded by Nesta. Using 'big data' the report sets out alternative counts of firms in the Government's 'Information Economy' industries, and compares these to estimates using conventional industry codes.[1] The authors argue that industries and products typically evolve faster than much conventional data can match.

This creates problems for policymakers who want to understand growing fields like the Information Economy. NIESR worked with data developed by Growth Intelligence to plug some of the gaps in current policy knowledge. They find: Notes: How analytics make doctors more productive | Medical Practice Insider. LAS VEGAS — Westmed Medical Group has expanded fifteen-fold in less than 20 years. The Westchester County, NY practice attributes that extraordinarily impressive growth to a care transformation project driven by analytics. Indeed, the group practice grew from 16 physicians at the start in 1996, to 250 physicians caring for more than 250,000 patients today with $285 million in annual revenue. “The fundamental nature of our management strategy is that we do not tell doctors what to do — we show them what they are doing,” Westmed CEO Simeon Schwartz, MD, told attendees at MGMA’s 2014 annual conference on Monday. The group operates five large ambulatory care sites (staffed by both primary care and specialist physicians) supported by centralized back-office services such as a call center, referral management, billing, IT and regulatory compliance.

[See also: 10 easy tactics for improving patient satisfaction.] Dashboards reveal strengths and weaknesses in clinical staff performance. World Economic Forum sur Twitter : "Why #opendata on its own isn't good enough @WorldBank #wef #bigdata. Why we're failing to get the most out of open data. An unprecedented number of individuals and organizations are finding ways to explore, interpret and use Open Data. Public agencies are hosting Open Data events such as meetups, hackathons and data dives. The potential of these initiatives is great, including support for economic development (McKinsey, 2013), anti-corruption (European Public Sector Information Platform, 2014) and accountability (Open Government Partnership, 2012).

But is Open Data’s full potential being realized? A news item from Computer Weekly casts doubt. A recent report notes that, in the United Kingdom, poor data quality is hindering the government’s Open Data program. The report goes on to explain that – in an effort to make the public sector more transparent and accountable – UK public bodies have been publishing spending records every month since November 2010.

Far from being a one-off problem, research suggests that this issue is ubiquitous and endemic. So, what’s the solution? Author: Dr. Announces Strategic Hires for Ontotext USA - Ontotext. Ontotext Announces Strategic Hires for Ontotext USA Northern Virginia, USA and Sofia, Bulgaria, November 17th, 2014— Ontotext, a leading provider of core semantic technology and text mining solutions, has announced the expansion of sales, marketing and alliances efforts in North America. This effort began with the hiring of Tony Agresta as Senior VP of Worldwide Sales & Marketing earlier this year.

Over the summer, Brad Bogle was hired as Director of Marketing for Ontotext worldwide and more recently, Tom Endyke joined Ontotext USA as the Director of Solutions Architecture. “We are very pleased to have Tony, Tom and Brad representing Ontotext in the USA,” said Atanas Kiryakov, Executive Director and CEO of Ontotext. “Ontotext has great products that have stood the test of time. Mr. Ontotext is very pleased to also add Tom Endyke as Director of Solutions Architecture and Brad Bogle as Director of Marketing to the team. About Ontotext. Blogs - Internet blog - Opening up the BBC's Linked Data with /things.

Using graphs to uncover insider trading schemes - Linkurious. See Graph Databases Easily. When there is power and money at stakes, individuals will resort to cheating to beat the competition. Professional sports have doping and financial markets have insider trading. To understand the role data analysis play in fraud investigation, look no further than the case of former SAC Manager Mathew Martoma convicted in what may be the biggest case of insider trading. The ultimate edge Mathew Martoma was a Portfolio Manager at S.A.C. In September 2014, Mathew Martoma was found guilty of taking part in the biggest insider trading transaction in history which netted a profit of $276 million. Insider trading is “the trading of a public company’s stock or other securities (such as bonds or stock options) by individuals with access to non-public information about the company.

Mathew Martoma speculated on the stocks of 2 companies : Elan and Wyeth. It is normal for investors to seek out information on the companies they trade. Finding such a connection is a difficult problem. When S.A.C. Linked Data meets Data Science. As a long-term member of the Linked Data community, which has evolved from W3C's Semantic Web, the latest developments around Data Science have become more and more attractive to me due to its complementary perspectives on similar challenges. Both disciplines work on questions like these: How to extract meaningful information from large amounts of data? How to connect pieces of information to other pieces in order to generate 'bigger pictures' of sometimes complex problems?

How to visualize complex information structures in a way that decision-makers benefit from it? Two complementary approaches When taking a closer look to the approaches taken by those two 'schools of advanced data management' one aspect becomes obvious: Both try to develop models in order to be able to 'codify and to calculate the data soup'.

Graph databases are key to success In contrast to this supposed contradiction, correlations and complementarities between those two disciplines prevail. GATE and Firefox plugins for S4 - Ontotext. Introduction The Self-Service Semantic Suite (S4) by Ontotext provides a set of capabilities for on-demand, as-a-service semantic data management. The S4 capabilities are accessible via simple RESTful APIs, including APIs for text analytics and Linked Data access. In the near future, S4 will also provide a fully managed RDF database-as-a-service running in the cloud and accessible via RESTful services. Even though working with RESTful APIs is easy and straightforward, the S4 team has put extra effort into making things even simpler for developers by providing a Java API as well as various code samples for using S4 services from Java, C#, Python, NodeJS, Groovy and PHP.

In the last week, the S4 team delivered two more plugins which will make developing S4 applications even easier: a brand new GATE plugin and a Firefox add-on. Using S4 Text Analytics with GATE The documentation for the GATE plugin provides details on installing and configuring the plugin via the GATE plugin manager. What Is Big Data? - datascience@berkeley. “Big data.” It seems like the phrase is everywhere. The term was added to the Oxford English Dictionary in 2013 and appeared in Merriam-Webster’s Collegiate Dictionary in 2014 . Now, Gartner’s just-released 2014 Hype Cycle shows “big data” passing the “peak of inflated expectations” and moving on its way down into the “trough of disillusionment.”

Big data is all the rage. A commonly repeated definition cites the three Vs: volume, velocity, and variety. Top recurring themes in our thought leaders’ definitions (word cloud via Wordle To settle the question once and for all, we asked more than 40 thought leaders in publishing, fashion, food, automobiles, medicine, marketing, and every industry in between how exactly they would define the phrase “big data.” John Akred Founder and CTO, Silicon Valley Data Science Back to top — Philip Ashlock Chief Architect, Data.gov Twitter: @philipashlock Jon Bruner Editor-at-Large, O’Reilly Media Twitter: @JonBruner Reid Bryant Data Scientist, Brooks Bell Mike Cavaretta. Mining data. Data mining: key to surveillance – and modern science… Big ocean = big data: about a dozen observing systems supplied the data needed to make this never-before visualization of ocean currents.

As master leaker Edward Snowden searches for asylum, revelations of widespread collection of telephone and email records by the National Security Agency have set teeth on edge. The Obama Administration says the data bring security, yet voices on the left and right both have condemned the snooping as an invasion of privacy. Data is not information, but rather the raw material for understanding. But one thing’s for sure: as the NSA spends billions perfecting new means of “mining” information from its mountains of data, it benefits from the plummeting price of computer storage and processing. Data mining is a broad term for mechanisms, frequently called algorithms, that are usually enacted through software, that aim to extract information from huge sets of data.

Is Big Data watching you? Democratizing Machine Learning In Anomaly Detection. Anomaly detection company Prelert has released an Elasticsearch Connector to help developers deploy its machine learning-based Anomaly Detective engine on an Elasticsearch ELK (Elasticsearch, Logstash, Kibana) stack. Elasticsearch is an open source, distributed, real-time search and analytics engine for use in distributed environments where there is a need beyond simple full-text search. Earlier this year, Prelert released its Engine API for developers and to use its analytics algorithms in their operations monitoring and security architectures.

By offering an Elasticsearch Connector, the company hopes to democratize the use of machine learning technology, providing tools to identify threats and opportunities hidden within massive datasets. Written in Python, the Prelert Elasticsearch Connector source is available on GitHub. The Elasticsearch Connector is the first connector to be officially released by Prelert. Robots helped inspire deep learning and might become its killer app. The next time you’re watching a robot hand someone a cup of coffee, ask someone a simple question or even drive a car, do yourself a favor and don’t be such a critic. Yes, a lot of what so-called intelligent or learning robots are doing is still fairly simple — some of it borders on mundane — but they’re not exactly working with a human brain. The fact of the matter is that machine learning is really hard; most artificial intelligence is, in fact, very engineered.

Finding the right method of interaction between humans and robots might be even harder. However, deep learning — the approach du jour among artificial intelligence researchers — might be just what the forthcoming robot doctor ordered to cure what ails our robots’ brains. Stefanie Tellex of Brown University (left) and Ross Knepper of MIT (right) present their research on the Ikeabot. One of my favorite talks was about a robot dubbed the “Ikeabot” for its focus on helping to assemble furniture. Ontotex CEO, Atanas Kiryakov Interviewed as Part of "Thought Leaders in Big Data Series" - Ontotext. Ontotex CEO, Atanas Kiryakov Interviewed as Part of “Thought Leaders in Big Data Series” One Million by One Million, a technology blog focusing on leaderships and trends in technology, spoke with Atanas Kiryakov for their “Thought Leaders in Big Data Series.” The multi-part interview covers Ontotext’s early years as well as were semantic technology is going.

Part 1 can be found here. Part 2 can be found here. Part 3 can be found here. Part 4 can be found here. Part 5 can be found here. Ontotext Delivers Semantic Publishing Solutions to the World’s Largest Media & Publishing Companies. A Method for Predicting Fishing Activity Based on Geospatial Motion Behaviors - Summarized from an Analyze Technical Report. Defining Big Data Visualization and Analysis Us. Big Oil Drills Into Big Data - Wall Street Jour. The Age of Predictive Analytics: From Patterns. Triplestores Rise In Popularity | Big Data Tech... Visualizing The Big Data Industrial Complex [Infographic] Search Is Dead... Long Live Semantic Search! | ... NetAppVoice: How The Semantic Web Changes Every... Big Data Revolution to Shake Up Drug Research. DBTA: Unleashing the Power of Hadoop for Big Da...

The Age of Big Data - Predicting Crime After Sh... Predictive Analytics + Enterprise Search = Pred... Who are the Big Data Influencers? | Big Data Te... The Best Database for Hadoop - Optimize Cost, P... Big Data, Analytics And The Future Of Marketing... What's the Scoop on Hadoop? | Big Data Technolo... Gus Hunt on the importance of Network Graphs &a... MarkLogic Done with Bottles | Big Data Technolo... Why Big Data Will Make Semantics Feasible &hell... Betting the Company: How Springer Successfully ... Social Media & Big Data in the Insurance In... State Street's Chief Scientist on How to Tame B... Big Data & Predictive Analytics | SmartData... The New Generation of Database Technology Inclu... Semantic Technologies in MarkLogic - World Clas... Is Data the New Media? | Big Data Technology, A... New Forms of Analytics Incorporate New Forms of... The Journey: From Print to Online | Big Data Te... RDF 101 - Cambridge Semantics | Big Data Techno...

U.S. National Archives Launches Founders Online... MarkLogic SolutionTracks | Big Data Technology,... Updated Database Landscape map – June 201... NSA collecting phone records of millions of Ver... Maps BI | Introducing Our Data Visualization Se... Big Data Analytics Will Help Us to Explore the ... Wearable technology 'will be powerful for big d... The human-safety side of big data | Big Data Te... Before Big Data Comes Big Content. Resources - MarkLogic | Big Data Technology, Applications and Analytics. Where Do You Collect “Now Data”? | Big Data Technology, Applications and Analytics. Data Analytics Deep is the New Big | Big Data Technology, Applications and Analytics. Nate Silver's big-data insights -- FCW | Big Data Technology, Applications and Analytics. The new reality for Business Intelligence and Big Data | Big Data Technology, Applications and Analytics. Use Case: Sophisticated Queries | MarkLogic | Big Data Technology, Applications and Analytics.

Five Things To Know About XML | Big Data Technology, Applications and Analytics. Big Data Analytics and Drug Surveillance | Big Data Technology, Applications and Analytics. 5 Skills Data Scientists Should Cultivate in 2013 | SiliconANGLE | Big Data Technology, Applications and Analytics. MarkLogic Simplifies Development of Enterprise-Ready Applications: Free Developer License for MarkLogic(R) Enterprise Edition Now Available | Big Data Technology, Applications and Analytics. Personalized Learning Is Sweeping College Campuses, Courtesy of Big Data | Big Data Technology, Applications and Analytics. Upcoming Events — Georgetown Law | Big Data Technology, Applications and Analytics. Professional Sports & Big Data - Gaining the Competitive Edge via Analytics and Understanding | Big Data Technology, Applications and Analytics.

Debunking NoSQL Database Myths | Data Informed | Big Data Technology, Applications and Analytics. [INFOGRAPHIC] BIG DATA: What Your IT Team Wants You To Know | Big Data Technology, Applications and Analytics. 5 Big Data Trends For 2013 - Tools Journal | Big Data Technology, Applications and Analytics. BBC Internet Blog: The story of the digital Olympics: streams, browsers, most watched, four screens. Embracing the Future of Underwriting. The Big Data Fallacy And Why We Need To Collect Even Bigger Data.

Whats the Big Deal About Big Data? Big Boom in Big Data Analytics: Are We There Yet? by Leslie Ament. Real-time Big Data. Big Data.