The following is a short guide to setup Storm quickly!
Note: this installation does not require sudo, logs and other data maintained by ZooKeeper and Storm are in my home folder
Create a directory for storm and enter it
mkdir storm
cd storm
Create a data directory
mkdir -p datadir/zookeeper
Download ZooKeeper and unzip it
wget http://apache.mirrors.spacedump.net/zookeeper/current/zookeeper-3.4.6.tar.gz
(or the appropriate version)
tar -xvf zookeeper-3.4.6.tar.gz
Download Storm and unzip it
wget http://apache.mirrors.spacedump.net/storm/apache-storm-0.9.5/apache-storm-0.9.5.tar.gz
(or the appropriate version)
tar -xvf apache-storm-0.9.5.tar.gz
Configure ZooKeeper
Add the following to zookeeper-3.4.6/conf/zoo.cfg
tickTime=2000
dataDir=/home/username/datadir/zookeeper
clientPort=2181
Configure Storm
Uncomment/add the following to apache-storm-0.9.5/conf/storm.yaml
storm.zookeeper.servers:
- "127.0.0.1"
nimbus.host: "127.0.0.1”
storm.local.dir: "/home/username/storm/datadir/storm"
supervisor.slots.ports:
- 6700
- 6701
- 6702
- 6703
Start ZooKeeper
zookeeper-3.4.6/bin/zkServer.sh start
Start nimbus
apache-storm-0.9.5/bin/storm nimbus
(start in separate shell or in background with &)
Start supervisor
apache-storm-0.9.5/bin/storm supervisor
(start in separate shell or in background with &)
Start UI
apache-storm-0.9.5/bin/storm ui
(start in separate shell or in background with &)
Try to connect to 127.0.0.1:8080, you see Storm UI? Enjoy!
Notes:
- I ssh a remote server, so I run
ssh -L 8080:localhost:8080 username@server
to be able to locally access port 8080 on the server - This setup creates 4 workers, if you want more/less modify supervisor.slots.ports
Hi, Thanks for sharing details.. its really helpful. well i want to know for single node cluster setup do i need to have pre hadoop installed in my system.. or storm can run alone too..and if it require which version of Hadoop support the Storm..i just want to make you clear with my requirement i need to create setup for kAFKA with STORM integration . as demo project setup .. which i am getting stuck due to Admin setup and configuration of the Apache Storm initial setup .. could you please guide me to understand in which way i need to execute my steps ..so that my requirement get filled…
Many Thanks!!
Deepesh
LikeLike
Dear Deepesh,
I do not use Storm together with Hadoop, so I would say you do not need to have Hadoop pre-installed in order to use Storm.
LikeLike