Yarn 叢集模式_3 | 學習筆記

開發者學堂課程【大資料實時計算架構 Spark 快速入門： Yarn 叢集模式_3  】學習筆記，與課程緊密聯系，讓使用者快速學習知識。

課程位址：

https://developer.aliyun.com/learning/course/100/detail/1661

Yarn 叢集模式_3  

内容介紹：

一、cluster 模式

cluster 模式

/bin/spark-submit --class org apache, spark examples. sparkPi --master yarn-cluster --executor-memory--num4

client token:

N/A

diagnostics:

N/A

ApplicationMaster

host:

192.168.80.23

ApplicationMaster RPCport:0

queue:default

Start time:1480412782816

Final status: SUCCEEDED

Tracking URL: http://node24:8088/proxy/application_1480412414584_0002/A

user: root

16/11/29 17:47:09 INFO util.ShutdownHookManager: Shutdownhook called

16/11/29 17:47:09INFO util.ShutdownHookManager: Deleting

directory/tmp/spark-3316c182-8444-4a49-bd67-56c1f055766

c

[root@node21 spark-1.6.0-bin-hadoop2.41#

/bin/spark-submit --class org.apache.spark.examples.SparkPi--master yar

n-cluster /lib/spark-examples-1.6.0-hadoop2.4.0.jar 100