pyspark kafka createDirectStream和createStream 区别

Kafka的进程ID为9300，占用端口为9092

QuorumPeerMain为对应的zookeeper实例，进程ID为6379，在2181端口监听

所以在运行官方例子时候

一个是

./bin/spark-submit --jars ~/spark-streaming-kafka-0-8-assembly_2.11-2.2.0.jar examples/src/main/python/streaming/direct_kafka_wordcount.py localhost:9092 test

另外一个是：

 ./bin/spark-submit --jars ~/spark-streaming-kafka-0-8-assembly_2.11-2.2.0.jar examples/src/main/python/streaming/direct_kafka_wordcount.py localhost:2181 test

参考：

https://spark.apache.org/docs/1.6.1/streaming-kafka-integration.html

http://zhangfengzhe.blog.51cto.com/8855103/1556650

本文转自张昺华-sky博客园博客，原文链接：http://www.cnblogs.com/bonelee/p/7443026.html，如需转载请自行联系原作者