Storm學習的HelloWorld
1、下載下傳Storm-start(https://github.com/nathanmarz/storm-starter/archive/master.zip)
2、進入下載下傳目錄,對zip檔案解壓
3、進入解壓後的檔案目錄,修改m2-pom.xml(将twitter4j-core和twitter4j-stream替換為下面的部分)
<dependency>
<groupId>org.twitter4j</groupId>
<artifactId>twitter4j-core</artifactId>
<version>[2.2,)</version>
</dependency>
<dependency>
<artifactId>twitter4j-stream</artifactId>
4、編譯項目。轉到項目根目錄,使用mvn -f m2-pom.xml package 進行編譯
5、複制storm-starter目錄下的m2_pom.xml為pom.xml,放在與m2_pom.xml同一目錄下
6、打jar包mvn jar:jar
如果還需要對工程代碼進行修改可以導入eclipse
使用mvn eclipse:eclipse編譯成eclipse工程
eclipse import project
7、送出運作
拷貝jar包到Storm所在機器上
編譯無誤後,在Storm-starter中target目錄下
将storm-starter-0.0.1-SNAPSHOT-jar-with-dependencies.jar,拷貝到指定的目錄下面
8、執行指令:
./storm jar /usr/soft/stormrun/storm-starter-0.0.1-SNAPSHOT-jar-with-dependencies.jar storm.starter.WordCountTopology test
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 | 5186 [Thread-26] INFO backtype.storm.daemon.executor - Processing received message source : spout:8, stream: default, id : {}, [four score and seven years ago] four score and seven years ago------------------- 5194 [Thread-26] INFO backtype.storm.daemon.task - Emitting: split default [four] 5195 [Thread-26] INFO backtype.storm.daemon.task - Emitting: split default [score] 5196 [Thread-26] INFO backtype.storm.daemon.task - Emitting: split default [and] 5197 [Thread-22] INFO backtype.storm.daemon.executor - Processing received message source : split :6, stream: default, id : {}, [and] 5198 [Thread-22] INFO backtype.storm.daemon.task - Emitting: count default [and, 1] 5198 [Thread-26] INFO backtype.storm.daemon.task - Emitting: split default [seven] 5199 [Thread-20] INFO backtype.storm.daemon.executor - Processing received message source : split :6, stream: default, id : {}, [four] 5200 [Thread-26] INFO backtype.storm.daemon.task - Emitting: split default [years] 5201 [Thread-18] INFO backtype.storm.daemon.executor - Processing received message source : split :6, stream: default, id : {}, [seven] 5201 [Thread-26] INFO backtype.storm.daemon.task - Emitting: split default [ago] 5201 [Thread-18] INFO backtype.storm.daemon.task - Emitting: count default [seven, 1] 5205 [Thread-20] INFO backtype.storm.daemon.task - Emitting: count default [four, 1] 5205 [Thread-20] INFO backtype.storm.daemon.executor - Processing received message source : split :6, stream: default, id : {}, [score] 5205 [Thread-20] INFO backtype.storm.daemon.task - Emitting: count default [score, 1] |