background preloader

Stream Computing

Facebook Twitter

Horovits/rt-analytics. Data Pipes - Open Knowledge Foundation Labs. InfoSphere Streams Quick Start Edition. Real -time analytic processing at your fingertips Stream processing technology gives you the ability to analyze massive data volumes quickly, often in real-time, and turn data into actionable insight.

InfoSphere Streams Quick Start Edition

InfoSphere Streams is an advanced computing platform that can quickly ingest, analyze and correlate information as it arrives from thousands of real-time sources. Because it can handle high throughput rates, InfoSphere Streams can analyze millions of events per second, enabling sub-millisecond response times and instant decision-making. Now you can get your hands on this technology with InfoSphere Streams Quick Start Edition, a free, downloadable, non-production version. InfoSphere Streams Quick Start Edition is always up to date with the most current version of InfoSphere Streams. With InfoSphere Streams Quick Start Edition, there is no data capacity and no time limitation, so you can experiment with large data sets and work with different use cases, on your own timeframe. Resources. Overview. InfoSphere Streams Quick Start Edition. DirectCompute’s unpopularity - Blog - StreamComputing.

In the world of GPGPU we have currently 4 players: Khronos OpenCL, NVIDIA CUDA, Microsoft DirectCompute and PathScal ENZO.

DirectCompute’s unpopularity - Blog - StreamComputing

You probably know CUDA and OpenCL already (or start reading more articles from this blog). ENZO is a 64bit-compiler which serves a small niche-market, and DirectCompute is built on top of CUDA/OpenCL or at least uses the same drivers. Edit 2011-01-03: I was contacted by Pathscale about my conclusions about ENZO. The reason why not much is out there is that they’re still in closed alpha. Expect more to hear from them about ENZO somewhere in the coming 3 months. A while ago there was an article introducing OpenCL by David Kanter who claimed on page 4 that DirectCompute will win from CUDA. Judging by history though, OpenCL and DirectCompute will eventually come to dominate the landscape, just as OpenGL and DirectX became the standards for graphics. I twittered that I totally disagreed with him and in this article I will explain why I think that.

Www.oracle.com/technetwork/middleware/event-driven-architecture/overview/complex-event-processing-whitepaper-130966.pdf. Build your own data-stream mining NSA in the cloud with “FunnelCake” There's more to "big data" than just lots of bits on disks.

Build your own data-stream mining NSA in the cloud with “FunnelCake”

Some things you can't just store in the raw; others you need to analyze and process before they ever hit a disk. That way they can be acted upon in near-real time—like trying to pick specific communications sessions from the data stream of a network tap into an Internet backbone, for example. Stream processing, also known as Complex Event Processing, is the real-time querying, analysis, and conversion of information within torrents of live data. It's part of what deep packet inspection and packet capture systems do with network traffic. These tools apply a set of rules to filter out what to capture within Internet packets, then aggregate and transform what's in them into captured content and metadata about the content of those packets.

But the need for stream processing isn't unique to intelligence organizations like the National Security Agency (NSA). Riders on the Storm A series of funnels This is where FunnelCake comes in.