天天看點

Storm記錄06--Storm的HelloWorld

Storm學習的HelloWorld

1、下載下傳Storm-start(https://github.com/nathanmarz/storm-starter/archive/master.zip)

2、進入下載下傳目錄,對zip檔案解壓

3、進入解壓後的檔案目錄,修改m2-pom.xml(将twitter4j-core和twitter4j-stream替換為下面的部分)

 <dependency>

      <groupId>org.twitter4j</groupId>

      <artifactId>twitter4j-core</artifactId>

      <version>[2.2,)</version>

    </dependency>

    <dependency>

      <artifactId>twitter4j-stream</artifactId>

4、編譯項目。轉到項目根目錄,使用mvn -f m2-pom.xml package 進行編譯

5、複制storm-starter目錄下的m2_pom.xml為pom.xml,放在與m2_pom.xml同一目錄下

6、打jar包mvn jar:jar

如果還需要對工程代碼進行修改可以導入eclipse

使用mvn eclipse:eclipse編譯成eclipse工程

eclipse import project

7、送出運作

拷貝jar包到Storm所在機器上

編譯無誤後,在Storm-starter中target目錄下

将storm-starter-0.0.1-SNAPSHOT-jar-with-dependencies.jar,拷貝到指定的目錄下面

8、執行指令:

./storm jar /usr/soft/stormrun/storm-starter-0.0.1-SNAPSHOT-jar-with-dependencies.jar storm.starter.WordCountTopology test

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

5186 [Thread-26] INFO  backtype.storm.daemon.executor  - Processing received message 

source

: spout:8, stream: default, 

id

: {}, [four score and seven years ago]

four score and seven years ago-------------------

5194 [Thread-26] INFO  backtype.storm.daemon.task  - Emitting: 

split

default [four]

5195 [Thread-26] INFO  backtype.storm.daemon.task  - Emitting: 

split

default [score]

5196 [Thread-26] INFO  backtype.storm.daemon.task  - Emitting: 

split

default [and]

5197 [Thread-22] INFO  backtype.storm.daemon.executor  - Processing received message 

source

split

:6, stream: default, 

id

: {}, [and]

5198 [Thread-22] INFO  backtype.storm.daemon.task  - Emitting: count default [and, 1]

5198 [Thread-26] INFO  backtype.storm.daemon.task  - Emitting: 

split

default [seven]

5199 [Thread-20] INFO  backtype.storm.daemon.executor  - Processing received message 

source

split

:6, stream: default, 

id

: {}, [four]

5200 [Thread-26] INFO  backtype.storm.daemon.task  - Emitting: 

split

default [years]

5201 [Thread-18] INFO  backtype.storm.daemon.executor  - Processing received message 

source

split

:6, stream: default, 

id

: {}, [seven]

5201 [Thread-26] INFO  backtype.storm.daemon.task  - Emitting: 

split

default [ago]

5201 [Thread-18] INFO  backtype.storm.daemon.task  - Emitting: count default [seven, 1]

5205 [Thread-20] INFO  backtype.storm.daemon.task  - Emitting: count default [four, 1]

5205 [Thread-20] INFO  backtype.storm.daemon.executor  - Processing received message 

source

split

:6, stream: default, 

id

: {}, [score]

5205 [Thread-20] INFO  backtype.storm.daemon.task  - Emitting: count default [score, 1]