Home · facebook/scribe Wiki Welcome to Apache Flume — Apache Flume elasticsearch/logstash-forwarder Open sourcing Databus: LinkedIn's low latency change data capture system Co-authors: Sunil Nagaraj, Shirshanka Das, Kapil Surlaker We are pleased to announce the open source release of Databus - a real-time change data capture system. Originally developed in 2005, Databus has been in production in its latest revision at Linkedin since 2011. The Databus source code is available in our github repo for you to get started! What is Databus? LinkedIn has a diverse ecosystem of specialized data storage and serving systems. This leads to a need for reliable, transactionally consistent change capture from primary data sources to derived data systems throughout the ecosystem. As shown above, systems such as Search Index and Read Replicas act as Databus consumers using the client library. How does Databus work? Databus offers the following important features: Source-independent: Databus supports change data capture from multiple sources including Oracle and MySQL. As depicted, the Databus System comprises of relays, bootstrap service and the client library. Try it out
Riemann - A network monitoring system driskell/log-courier spotify/ffwd