Introduction To HBase - Todd Lipcon. Installation of HBase in the cluster - A complete step by step tutorial. HBase cluster setup : HBase is an open-source, distributed, versioned, column-oriented store modeled after Google 'Bigtable’.
This tutorial will describe how to setup and run Hbase cluster, with not too much explanation about hbase. There are a number of articles where the Hbase are described in details. We will build hbase cluster using three Ubuntu machine in this tutorial. A distributed HBase depends on a running ZooKeeper cluster. Following are the capacities in which nodes may act in our cluster: 1. 2. 3. In our case, one machine in the cluster is designated as Hbase master and Zookeeper. 2. 192.168.41.53 hbase-master hadoop-namenode #Hbase Master and Hadoop Namenode is configure on same machine 192.168.41.67 hbase-regionserver1 192.168.41.67 hbase-regionserver2 Note: Run the command “ping hbase-master”. 3. 2.1. $ssh-keygen -t rsa $scp .ssh/id_rsa.pub ilab@hbase-regionserver1:~ilab/.ssh/authorized_keys $scp .ssh/id_rsa.pub ilab@hbase-regionserver2:~ilab/.ssh/authorized_keys. Installation of hadoop in the cluster - A complete step by step tutorial.
Hadoop Cluster Setup: Hadoop is a fault-tolerant distributed system for data storage which is highly scalable.Hadoop has two important parts:- 1.
Hadoop Distributed File System(HDFS):-A distributed file system that provides high throughput access to application data. 2. MapReduce:-A software framework for distributed processing of large data sets on compute clusters. In this tutorial, I will describe how to setup and run Hadoop cluster. Following are the capacities in which nodes may act in our cluster:- 1. 2. 3. 4. 5. In our case, one machine in the cluster is designated as namenode, Secondarynamenode and jobTracker.This is the master. Below diagram show, how the Hadoop cluster will look after Installation:- Fig: After Installation, Hadoop cluster will look like. Installation, configuring and running of hadoop cluster is done in three steps: Understanding HBase column-family performance options - Jimbojw.com.
From Jimbojw.com In the comments to Understanding HBase and BigTable, I recieved some insightul questions.
Here I attempt to answer them, in no particular order. Picking the correct HBase performance options is akin to deciding which engine use, or whether to use CHAR vs VARCHAR vs TEXT in a relational database. These decisions can make a big impact on the amount of data stored and the speed with which it is created, updated, read, and deleted. This article assumes the reader is familiar with HBase concepts, particularly its column-oriented nature and the relationship between rows, column families, columns and cells.
For information on the syntax used to create a table using the options mentioned here, see HbaseShell (Hadoop wiki). Are there any performance implications that are implied with column families? Definitely. Block compression Say you have a single column which will contain large blobs of text data, and you only want to keep one version for any given row. Record compression Summary.