Migrating from Microsoft SQL Server to MongoDB - Lessons Learned. Migrating from Microsoft SQL Server to MongoDB - Lessons Learned Your database is one of your most important technical stakeholders and will influence every major decision you make during the lifetime of your product. Once you have made your choice and built on top of it, chances are that you would never consider migrating to a radically different solution. As difficult of a decision as it was, early this year we migrated all our data from Microsoft SQL Server, a traditional relational database, to MongoDB which is a “NoSQL” document-based database. In this article I will share the challenges we faced and the lessons we have learned from this experience. Who are we? Wireclub is a vibrant online community with over 3 million users world-wide. Everyday we serve over a million database-intensive pageviews and service tens of millions of API calls. Who should read this article?
Why did we migrate to MongoDB? Wireclub was born as a hobby and bootstrapped since its inception. Conclusion. Morphia - A type-safe java library for MongoDB. MongoDB Events - Real Time Analytics with MongoDB. Integrating Spring Batch and MongoDB for ETL Over NoSQL. In today's enterprises, I deal with applications which are interactive or which run in batch mode. Interactive applications are like Web applications in that they require user input. By contrast, applications which need to start once and end after completing their required jobs are called batch applications. They do not require frequent manual interventions. Batch applications process huge amounts of data.
They include any ETL tool that extracts, transforms and loads data through batch processes. Through this article, I plan to showcase an ETL framework leveraging the advantages of Spring Batch and MongoDB, which gives us the flavor of batch load over the NoSQL databases. Why Batch Processing? The main advantage of batch applications is that they do not require any manual intervention. Batch processes mainly deal with huge amounts of data where a series of programs runs to meet the required objective. Why Spring Batch? Why MongoDB? Spring Batch – MongoDB Integration FileSplitter.java.
MongoDb Architecture. NOSQL has become a very heated topic for large web-scale deployment where scalability and semi-structured data driven the DB requirement towards NOSQL. There has been many NOSQL products evolving in over last couple years. In my past blogs, I have been covering the underlying distributed system theory of NOSQL, as well as some specific products such as CouchDB and Cassandra/HBase. Last Friday I was very lucky to meet with Jared Rosoff from 10gen in a technical conference and have a discussion about the technical architecture of MongoDb. I found the information is very useful and want to share with more people.
One thing I am very impressed by MongoDb is that it is extremely easy to use and the underlying architecture is also very easy to understand. Here are some simple admin steps to start/stop MongoDb server # Install MongoDB mkdir /data/lib # Start Mongod server ... Here are some basic example. To speed up the query, index can be used. Data modification happens in place. MongoDB Gotchas & How To Avoid Them. A lot of people hate on MongoDB. In my opinion they’re misguided - the main reason so many people think like this is a lack of understanding. Everyone should be able to benefit from MongoDB’s power and simplicity, and so as a follow up to David’s article I have outlined some common and not-so-common things that hackers should know about MongoDB. First though, why should you listen to me? I used to be a consultant specializing in Ops and helping companies (The Guardian, Experian) scale large web applications. 32-bit vs 64-bit Most modern servers are either running 32-bit or 64-bit operating systems.
MongoDB ships with two versions - 32-bit and 64-bit. Tl;dr - Just use 64-bit, or understand the limitations of 32-bit Document size limits Unlike a Relational Database Management System (RDBMS) which stores data in columns and rows, MongoDB stores data in documents. Like most other databases, there are limits to what you can store in a document. Write failure MongoDB does away with this. Locking. Node.js + MongoDB = Love: Guest Post from MongoLab.
NOSQL eXchange 2011: Brendan McAdams on Mong. Migrating from Microsoft SQL Server to MongoDB - Lessons Learned. MongoDB Behind the Scenes | GoodData Developer Network.