5 minutes Storm installation guide (single-node setup)
The following is a short guide to setup Storm quickly!
Note: this installation does not require sudo, logs and other data maintained by ZooKeeper and Storm are in my home folder
Create a directory for storm and enter it
mkdir storm
cd storm
Create a data directory
mkdir -p datadir/zookeeper
Download ZooKeeper and unzip it
wget http://apache.mirrors.spacedump.net/zookeeper/current/zookeeper-3.4.6.tar.gz (or the appropriate version)
tar -xvf zookeeper-3.4.6.tar.gz
Download Storm and unzip it
wget http://apache.mirrors.spacedump.net/storm/apache-storm-0.9.5/apache-storm-0.9.5.tar.gz (or the appropriate version)
tar -xvf apache-storm-0.9.5.tar.gz
Configure ZooKeeper
Add the following to zookeeper-3.4.6/conf/zoo.cfg
tickTime=2000
dataDir=/home/username/datadir/zookeeper
clientPort=2181
Configure Storm
Uncomment/add the following to apache-storm-0.9.5/conf/storm.yaml
storm.zookeeper.servers:
- "127.0.0.1"
nimbus.host: "127.0.0.1”
storm.local.dir: "/home/username/storm/datadir/storm"
supervisor.slots.ports:
- 6700
- 6701
- 6702
- 6703
Start ZooKeeper
zookeeper-3.4.6/bin/zkServer.sh start
Start nimbus
apache-storm-0.9.5/bin/storm nimbus (start in separate shell or in background with &)
Start supervisor
apache-storm-0.9.5/bin/storm supervisor (start in separate shell or in background with &)
Start UI
apache-storm-0.9.5/bin/storm ui (start in separate shell or in background with &)
Try to connect to 127.0.0.1:8080, you see Storm UI? Enjoy!
Notes:
- I ssh a remote server, so I run
ssh -L 8080:localhost:8080 username@serverto be able to locally access port 8080 on the server - This setup creates 4 workers, if you want more/less modify supervisor.slots.ports