background preloader

ArchivesSpace

Facebook Twitter

Building a distributed concurrent queue with Apache ZooKeeper « Cloudera » Apache Hadoop for the Enterprise. In order to be useful, ZooKeeper must be both highly reliable and available as systems will rely upon it as a critical component. For example, if locks cannot be taken, processes cannot make progress and the whole system will grind to a halt. ZooKeeper is built on a suite of reliable distributed systems techniques and protocols, and is typically run on a cluster of machines so that if some should fail, the remaining ones can continue to provide service. Under the hood, ZooKeeper is responsible for ordering calls made by clients so that each request is processed atomically and in a fixed and firm order.

One of my first contributions to the project was a set of bindings to allow programs written in the Python language to act as clients to a ZooKeeper cluster. ZooKeeper was natively written in Java, and there are already C and Perl bindings. To illustrate some of the ZooKeeper API, I’ve written a distributed FIFO queue in Python – the source code is here – which I wanted to share. Hacker News | Out Of the Tar Pit [pdf] FRAD – ISAAR(CPF) – EAC-CPF – Topic Maps Mapping « Cultural Heritage E-Libraries and Archives. HOW TO: Set Up a Q&A Website in Minutes – the Best Options Reviewed & Compared. A recent trend in blogging that’s going to be mainstream very soon is to have your very own Q&A website related to the same topic your blog is about. This comes very handy for webmaster because of recently launched solutions and very convenient for readers because they can ask and answer stuff in a well-known environment, among a community they like.

Before reading the reviews of the solutions we found so far, be sure to check out Inspired Forum to see what I’m talking about. Everyone has questions they need answered. What better place then to ask them within a community that’s focused and geared towards the fundamentals of what you’re asking. Why not ask a question (i.e.) on technology in a place where those who are most knowledgeable on the subject can have but a simple chance, to answer it? Qhub Qhub is an amazing web application that allows anyone without having any technical know-how to build and customize their own Q&A community with simplicity and ease.

StackExchange Shapado. Archivalsoftware / FrontPage. Design Patterns. Community-powered support for CDL Digital Special Collections. Stack Exchange - Free, Community-Powered Q&A. Blog.ecorrado.us » Little Things Matter. Little Things Matter 2010 August 22 Dear Open Source Software developer, Little things matter. If you want me to take your project serious, doing the little things right can make a big difference. Here are just a few things you should try to do, IMHO. I know that some of these are not as fun as coding in your favorite programming language, but if they aren’t done, your project will less likely be chosen for me to use, and possibly contribute back. Include complete install instructions. Not everyone is an expert with Open Source, but you should treat them with respect.

A corollary of this is that developers should not express anger at people who file well-intended but vague bug reports. These are just a few things that I think, if followed, will give a project a much better chance of being successful. Sincerely, Me P.S. ArchivesSpace Google Group | Archivology.