Chunkd - Hail Cloud Computing Wiki chunkd: single-node data storage service Overview chunkd is a low-level, single node, key/value storage service for anonymous data objects. The intended use is as a low-level piece of large-scale distributed data storage infrastructure, for Project Hail. Keys are opaque binary data, from 1 byte to 1024 bytes in size. Values ("the data") may be any size, be it 1 byte, 1 megabyte, 100 gigabytes, anything. Objects are grouped into containers called "tables." Currently the service is TCP-based. From chunkd's simple GET/PUT/DELETE API, you can build cluster-wide redundant storage services, exporting data storage capability from any device supported by your OS, via a single, standard, easy to use, device-agnostic interface. The network protocol consists of TCP-based messages. Given that the protocol is message-based, it should be easy to add support for non-TCP network protocols such as RDMA, SCTP or AMQP. Design goals Current version 1.0 technical design goals include Status Early beta. Resources
Linux NFS faq 2. Introduction The Network File System (NFS) was developed to allow machines to mount a disk partition on a remote machine as if it were a local disk. It allows for fast, seamless sharing of files across a network. It also gives the potential for unwanted people to access your hard drive over the network (and thereby possibly read your email and delete all your files as well as break into your system) if you set it up incorrectly. So please read Section 6, “Security and NFS” of this document carefully if you intend to implement an NFS setup. There are other systems that provide similar functionality to NFS. 2.2. This HOWTO is intended as a complete, step-by-step guide to setting up NFS correctly and effectively. This HOWTO is not a description of the guts and underlying implementation and architecture of NFS. This document is also not intended as a complete reference manual, and does not contain an exhaustive list of the features of Linux NFS. 2.3. 2.4. 2.5.