- Get Zookeeper
See http://zookeeper.apache.org/doc/trunk/zookeeperStarted.html#sc_InstallingSingleMode
- Download and build mesos
wget http://www.apache.org/dist/mesos/0.17.0/mesos-0.17.0.tar.gz
tar -zxf mesos-0.17.0.tar.gz
# Change working directory.
$ cd mesos-0.17.0
# Configure and build.
$ mkdir build
$ cd build
$ ../configure
$ make
# Run test suite.
$ make check
# Install (***Optional***).
$ make installsee http://mesos.apache.org/gettingstarted/
- Start mesos
# mesos master
mesos-0.17.0/build/bin/mesos-master.sh --zk=zk://localhost:2181/mesos &
# mesos slave
mesos-0.17.0/build/bin/mesos-slave.sh --master=zk://localhost:2181/mesos &You can see the mesos UI in localhost:5050
- Configure
conf/storm.yaml
## Default configuration for standalone mode (every daemons on one node with default settings)
# Path to mesos distribution built properly
# java.library.path: "native:/path/to/mesos-0.17.0/build/.libs"
# hostname:port of the mesos master node
mesos.master.url: "zk://localhost:2181/mesos"
# in cluster ENV, change it to a globally accessible directory (HDFS or NFS etc.)
mesos.executor.uri: "/path/to/storm-mesos-0.9.1-incubating.tgz"
# hostname:port of zookeeper nodes (default port 2181)
storm.zookeeper.servers:
- "localhost"
# hostname of nimbus node
nimbus.host: "localhost"
# full path of storm local working directory
storm.local.dir: "/usr/local/storm-local"- Start storm
bin/storm-mesos nimbus &
bin/storm supervisor &
bin/storm uiYou can see the storm ui on localhost:8080 and you will see storm registered as a mesos framework.
- Download storm-starter and send topologies to the storm cluster
apache-storm-0.9.1-incubating/bin/storm jar storm-starter-0.0.1-SNAPSHOT.jar storm.starter.WordCountTopology count Storm is a distributed realtime computation system. Similar to how Hadoop provides a set of general primitives for doing batch processing, Storm provides a set of general primitives for doing realtime computation. Storm is simple, can be used with any programming language, is used by many companies, and is a lot of fun to use!
The Rationale page on the wiki explains what Storm is and why it was built. This presentation is also a good introduction to the project.
Storm has a website at storm-project.net. Follow @stormprocessor on Twitter for updates on the project.
Documentation and tutorials can be found on the Storm wiki.
NOTE: The google groups account [email protected] is now officially deprecated in favor of the Apache-hosted user/dev mailing lists.
Storm users should send messages and subscribe to [email protected].
You can subscribe to this list by sending an email to [email protected]. Likewise, you can cancel a subscription by sending an email to [email protected].
You can view the archives of the mailing list here.
Storm developers should send messages and subscribe to [email protected].
You can subscribe to this list by sending an email to [email protected]. Likewise, you can cancel a subscription by sending an email to [email protected].
You can view the archives of the mailing list here.
If you are using a pre-built binary distribution of Storm, then chances are you should send questions, comments, storm-related announcements, etc. to [email protected].
If you are building storm from source, developing new features, or otherwise hacking storm source code, then [email protected] is more appropriate.
What will happen with [email protected]?
All existing messages will remain archived there, and can be accessed/searched here.
New messages sent to [email protected] will either be rejected/bounced or replied to with a message to direct the email to the appropriate Apache-hosted group.
You can also come to the #storm-user room on freenode. You can usually find a Storm developer there to help you out.
Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.
- Nathan Marz (@nathanmarz)
- James Xu (@xumingming)
- Jason Jackson (@jason_j)
- Andy Feng (@anfeng)
- Flip Kromer (@mrflip)
- David Lao (@davidlao2k)
- P. Taylor Goetz (@ptgoetz)
- Christopher Bertels (@bakkdoor)
- Michael Montano (@michaelmontano)
- Dennis Zhuang (@killme2008)
- Trevor Smith (@trevorsummerssmith)
- Ben Hughes (@schleyfox)
- Alexey Kachayev (@kachayev)
- Haitao Yao (@haitaoyao)
- Dan Dillinger (@ddillinger)
- Kang Xiao (@xiaokang)
- Gabriel Grant (@gabrielgrant)
- Travis Wellman (@travisfw)
- Kasper Madsen (@KasperMadsen)
- Michael Cetrulo (@git2samus)
- Thomas Jack (@tomo)
- Nicolas Yzet (@nicoo)
- Fabian Neumann (@hellp)
- Soren Macbeth (@sorenmacbeth)
- Ashley Brown (@ashleywbrown)
- Guanpeng Xu (@herberteuler)
- Vinod Chandru (@vinodc)
- Martin Kleppmann (@ept)
- Evan Chan (@velvia)
- Sjoerd Mulder (@sjoerdmulder)
- Yuta Okamoto (@okapies)
- Barry Hart (@barrywhart)
- Sergey Lukjanov (@Frostman)
- Ross Feinstein (@rnfein)
- Junichiro Takagi (@tjun)
- Bryan Peterson (@Lazyshot)
- Sam Ritchie (@sritchie)
- Stuart Anderson (@emblem)
- Robert Evans (@revans2)
- Lorcan Coyle (@lorcan)
- Derek Dagit (@d2r)
- Andrew Olson (@noslowerdna)
- Gavin Li (@lyogavin)
- Tudor Scurtu (@tscurtu)
- Homer Strong (@strongh)
- Sean Melody (@srmelody)
- Jake Donham (@jaked)
- Ankit Toshniwal (@ankitoshniwal)
YourKit is kindly supporting open source projects with its full-featured Java Profiler. YourKit, LLC is the creator of innovative and intelligent tools for profiling Java and .NET applications. Take a look at YourKit's leading software products: YourKit Java Profiler and YourKit .NET Profiler.