5 minutes Storm installation guide (single-node setup)

The following is a short guide to setup Storm quickly!

Note: this installation does not require sudo, logs and other data maintained by ZooKeeper and Storm are in my home folder

Create a directory for storm and enter it
mkdir storm
cd storm

Create a data directory
mkdir -p datadir/zookeeper

Download ZooKeeper and unzip it
wget http://apache.mirrors.spacedump.net/zookeeper/current/zookeeper-3.4.6.tar.gz (or the appropriate version)
tar -xvf zookeeper-3.4.6.tar.gz

Download Storm and unzip it
wget http://apache.mirrors.spacedump.net/storm/apache-storm-0.9.5/apache-storm-0.9.5.tar.gz (or the appropriate version)
tar -xvf apache-storm-0.9.5.tar.gz

Configure ZooKeeper
Add the following to zookeeper-3.4.6/conf/zoo.cfg
tickTime=2000
dataDir=/home/username/datadir/zookeeper
clientPort=2181

Configure Storm
Uncomment/add the following to apache-storm-0.9.5/conf/storm.yaml
storm.zookeeper.servers:
  - "127.0.0.1"
nimbus.host: "127.0.0.1”
storm.local.dir: "/home/username/storm/datadir/storm"
supervisor.slots.ports:
    - 6700
    - 6701
    - 6702
    - 6703

Start ZooKeeper
zookeeper-3.4.6/bin/zkServer.sh start

Start nimbus
apache-storm-0.9.5/bin/storm nimbus (start in separate shell or in background with &)

Start supervisor
apache-storm-0.9.5/bin/storm supervisor (start in separate shell or in background with &)

Start UI
apache-storm-0.9.5/bin/storm ui (start in separate shell or in background with &)

Try to connect to 127.0.0.1:8080, you see Storm UI? Enjoy!

Notes:

  • I ssh a remote server, so I run  ssh -L 8080:localhost:8080 username@server to be able to locally access port 8080 on the server
  • This setup creates 4 workers, if you want more/less modify supervisor.slots.ports
Tagged with: , ,
Posted in Data Streaming, programming, Storm
2 comments on “5 minutes Storm installation guide (single-node setup)
  1. Deepesh says:

    Hi, Thanks for sharing details.. its really helpful. well i want to know for single node cluster setup do i need to have pre hadoop installed in my system.. or storm can run alone too..and if it require which version of Hadoop support the Storm..i just want to make you clear with my requirement i need to create setup for kAFKA with STORM integration . as demo project setup .. which i am getting stuck due to Admin setup and configuration of the Apache Storm initial setup .. could you please guide me to understand in which way i need to execute my steps ..so that my requirement get filled…

    Many Thanks!!
    Deepesh

    Like

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: