Wednesday, April 20, 2016

Updating Docker Version

1. Check your current version,
  #docker -v

Right now we are at version 1.6.2

2. Update package information, and ensure that APT works with the https method
# apt-get update

Tuesday, April 19, 2016

Docker Optional Configurations

Adding user to docker group

1. If you have not configured anything extra, then docker needs root to work. By default, the docker daemon listens on a local Unix socket called 'docker.sock' in /var/run  which is owned by the user root.

If you do 
# ls /run -l

Spark Application in Eclipse

I have prepared a step by step guide to build spark project using scala in eclipse. We will run this application locally through eclipse and also run this in hdfs. You might have already guessed. Yes, you are correct we will work on WordCount as an example. After all we do not want to be an outliers by working on something else.

So, let's get started. I am assuming you already have spark set up and running. If not, you can download cloudera quick start VM from I would recommend this if you do not have anything set up and running, cause this is easy and quick. 

Sunday, April 17, 2016

Installation of Docker

In this guide we will install Docker on Ubuntu Trusty 14.04 (LTS). If you do not have ubuntu, check out my step by step guide to install Ubuntu on Vmware.

1. Open terminal on ubuntu and change it to root user, so we don’t have to enter password again and again.

2. Docker requires your kernel to be 3.10 at minimum.

Sunday, April 10, 2016

Download Ubuntu Desktop in VMWare

  1. Go to and download Ubuntu 14.04.4LTS. You want to download 64 bit version unless you are using something from your grandfather's age. It will take a while to download.