Tokyocabinet

Facebook Twitter
Kyoto Cabinet: a straightforward implementation of DBM Copyright (C) 2009-2012 FAL Labs Last Update: Fri, 04 Mar 2011 23:07:26 -0800 Overview Kyoto Cabinet: a straightforward implementation of DBM
Performance comparison: key/value stores for language model counts - Brendan O'Connor's Blog I’m doing word and bigram counts on a corpus of tweets. I want to store and rapidly retrieve them later for language model purposes. So there’s a big table of counts that get incremented many times. The easiest way to get something running is to use an open-source key/value store; but which? Performance comparison: key/value stores for language model counts - Brendan O'Connor's Blog
Shades of Gray: Tokyo Cabinet's Key-Value Database Types Shades of Gray: Tokyo Cabinet's Key-Value Database Types We've taken a good look at Tokyo Cabinet's Hash Database, but there's a lot more to the library than just that. Tokyo Cabinet supports three other kinds of databases. In addition, each database type accepts various tuning parameters that can be used to change its behavior. Each database type and setting involves different tradeoffs so you really have a lot of options for turning Tokyo Cabinet into exactly what you need. Let's look into some of those options now.
Tokyo Cabinet: a modern implementation of DBM Tokyo Cabinet: a modern implementation of DBM Copyright (C) 2006-2011 FAL Labs Last Update: Thu, 05 Aug 2010 15:05:11 +0900 BTW, do you know Kyoto Cabinet? Actually, it is more powerful and convenient library than Tokyo Cabinet.
Tokyo {Cabinet, [Py]Tyrant} Tokyo {Cabinet, [Py]Tyrant} Tokyo Cabinet is a key/value database meant to be the successor of {G,Q}DBM. Tokyo Tyrant is the remote service wrapper for Tokyo Cabinet. PyTyrant is a Python client for Tokyo Tyrant.
By Ilya Grigorik on February 13, 2009 It took Ruby some time to go from an infant research project by Matz to a language we've all come to know so well. Now, another Japanese developer (Mikio Hirabayashi) has all the potential to repeat this cycle with his new database project: Tokyo Cabinet. Developed and sponsored by Mixi Inc. Tokyo Cabinet: Beyond Key-Value Store Tokyo Cabinet: Beyond Key-Value Store
I've had good luck with the Tokyo Cabinet/pytc solution. It's very fast (a bit faster than using the shelve module using anydbm in my implementation), both for reading and writing (though I too do far more reading). The problem for me was the spartan documentation on the python bindings, but there's enough example code around to figure out how to do what you need to do. Additionally, tokyo cabinet is quite easy to install (as are the python bindings), doesn't require a server (as you mention) and seems to be actively supported. You can open files in read-only mode, allowing concurrent access, or read/write mode, preventing other processes from accessing the database. I was looking at various options over the summer, and the advice I got then was this: try out the different options and see what works best for you. Reliable and efficient key--value database for Linux Reliable and efficient key--value database for Linux