HBase Installation On Ubuntu / Lubuntu

Hi Everybody, Today we will learn how to install HBase. HBase can be installed in two modes.

 1. Standalone Mode
2. Distributed Mode

      Distributed Mode can be of two types Pseudo Distributed mode and fully distributed mode. In This Tutorial we will discuss about Pseudo Distributed Mode installation of HBase. I will soon share another post on how to install HBase in fully distributed mode.

 UPDATE: Video for this topic is available here

 Following are the steps for HBase installation.

 1. Before installing HBase you should have installed java and hadoop already. If you have not installed Hadoop, please follow the link here.

 2. Next is to chose HBase version that is completable with your hadoop installation. I am using Hadoop 1.0.3. so i am using HBase installation HBase 0.94.8.

 3. Download HBase from HBase 0.94.8 and extract it in "$HOME/hbase" in my case it is "/home/hduser/hbase".

 4. Edit $HOME/hbase/conf/hbase-env.sh with following command

 On Ubuntu

           gedit $HOME/hbase/conf/hbase-env.sh

 On Lubuntu

            leafpad $HOME/hbase/conf/hbase-env.sh

 and insert following commands

          export JAVA_HOME=/usr/lib/jvm/java-6-jdk-i386

 export HBASE_REGIONSERVERS=/home/hduser/hbase/conf/regionservers
         export HBASE_MANAGES_ZK=true
        
5. Edit /etc/bash.bashrc using following commands

 On Ubuntu
         sudo gedit /etc/bash.bashrc

 On Lubuntu
         sudo leafpad /etc/bash.bashrc

 Insert following in this file.
         export HBASE_HOME=/home/hduser/hbase

         export PATH=$PATH:$HBASE_HOME/bin

 save and close the file.

 6. Close and reopen the terminal. Now edit the hosts file

         sudo leafpad /etc/hosts

 on Ubuntu 
        sudo gedit /etc/hosts

in second line change 127.0.1.1 to 127.0.0.1.

 7. Start HBase using following command.

     /home/hduser/hbase/bin/start-hbase.sh

 8. You can access Hbase through shell with following command.

     hbase shell
I Hope this will be helpful. Stay tuned for more stuff. post your questions and feedback below. :)


Comments

  1. Unknown3 October 2018 at 05:05

    Nice and good article. It is very useful for me to learn and understand easily. Thanks for sharing your valuable information and time. Please keep updating Hadoop administration Online Training

    ReplyDelete

Post a Comment

Popular posts from this blog

Hive UDF Example

UDF(User Defined Function) is a Very important functionality provided by Hive. It is very simple to create a UDF for Hive. In this tutorial we will learn creating UDF and how to use it with hive. There are two possible ways to create UDF. 1. using org.apache.hadoop.hive.ql.exec.UDF 2. using  org.apache.hadoop.hive.ql.udf.generic.GenericUDF        If input and output to your custom function is basic type eg. Text, FloatWritable, DoubleWritable,IntWritable etc the use  org.apache.hadoop.hive.ql.exec.UDF.        If yor input and output can be Map, set, list type of data structure the use  using  org.apache.hadoop.hive.ql.udf.generic.GenericUDF. We will discuss the first type of UDF here. I will write one more post to discuss the second approach. First of all lets assume I want to create a hive function called toUpper which will convert a string to uppercase. Follow the following steps to achieve it. 1. Down...
Read more

Custom UDF in Apache Spark

Image
Apache Spark has become very widely used framework to build Big data application. Spark SQL has made adhoc analysis on structured data very easy, So it is very popular among users who deal with huge amount of structured data. However many times you will realise that some functionality is not available in Spark SQL. For example in Spark 1.3.1 , when you are using sqlContext basic functions like variance , standard deviation and percentile are not available(You can access these using HiveContext). In a similar situation, you may like to do some string operation on an input column but functionality may not be available in sqlContext. In such situations , we can use spark udf to add new constructs in sqlContext. I have found them very handy, specially while processing string type columns. In this post we will discuss how to create UDFs in Spark and  how to use them. Use Case : Let us keep this example very simple. We will create a udf which will take a string as input and it will c...
Read more

Enterprise Kafka and Spark : Kerberos based Integration

In previous posts we have seen how to integrate Kafka with Spark streaming. However in a typical enterprise environment the connection between Kafka and spark should be secure. If you are using cloudera or hortonworks distribution of Hadoop/Spark, then most likely it will be Kerberos enabled connection. In this post we will see what are the configurations we have to make to enable kerberized kafka spark integration.  Before getting into details of integration, i wanted to make it clear that I assume you are using cloudera/hortonworks/MapR provided kafka and spark kerberos enablled installation. we will see that as a developer what additional things has to be performed by you. For this we have to first select security protocol provided by kafka. if you see kafka documentation, security.protocol property is used for this. we can select following values 1. PLAINTEXT 2. SASL_PLAINTEXT 3. SASL_SSL We will select SASL_PLAINTEXT for kerberos.  This property has to be set ...
Read more