Monday 11 April 2016

Hadoop installation using docker

Pull the docker image from the below path:
Github path for hadoop docker installation:
https://hub.docker.com/r/sequenceiq/hadoop-docker/

Here is the image:
sequenceiq/hadoop-docker

Build the image

check whether do you have perticular version is there or not?
docker build -t sequenceiq/hadoop-docker:2.6.0 .

Pull the image

docker pull sequenceiq/hadoop-docker:2.6.0

Start a container

In order to use the Docker image you have just build or pulled use:
Make sure that SELinux is disabled on the host. If you are using boot2docker you don't need to do anything.
docker run -it sequenceiq/hadoop-docker:2.7.0 /etc/bootstrap.sh -bash

Testing

You can run one of the stock examples:
cd $HADOOP_PREFIX
# run the mapreduce
bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.0.jar grep input output 'dfs[a-z.]+'

# check the output
bin/hdfs dfs -cat output/*http://Ipaddress:8088/cluster/apps

No comments:

Post a Comment