天天看點

SAP Data Intelligence Modeler裡的Kafka Producer和Kafka Consumer

首先本地将kafka的docker容器鏡像下載下傳到本地并運作:

docker search kafka

SAP Data Intelligence Modeler裡的Kafka Producer和Kafka Consumer

docker pull spotify/kafka

SAP Data Intelligence Modeler裡的Kafka Producer和Kafka Consumer

docker run --name kafka3 spotify/kafka

SAP Data Intelligence Modeler裡的Kafka Producer和Kafka Consumer

docker ps指令,檢視tcp端口号:

SAP Data Intelligence Modeler裡的Kafka Producer和Kafka Consumer

建立一個graph,使用典型的生産者-消費者模型:将Data Generator生成的資料交給kafka Producer operator;

而Kafka Consumer從kafka producer裡讀取出data Generator生成的資料,通過ToString converter,輸出到Terminal Operator上。

SAP Data Intelligence Modeler裡的Kafka Producer和Kafka Consumer
SAP Data Intelligence Modeler裡的Kafka Producer和Kafka Consumer

kafka producer和consumer使用的broker和topic必須一緻:

SAP Data Intelligence Modeler裡的Kafka Producer和Kafka Consumer
SAP Data Intelligence Modeler裡的Kafka Producer和Kafka Consumer

運作graph,可以看到

SAP Data Intelligence Modeler裡的Kafka Producer和Kafka Consumer
SAP Data Intelligence Modeler裡的Kafka Producer和Kafka Consumer

要擷取更多Jerry的原創文章,請關注公衆号"汪子熙":

SAP Data Intelligence Modeler裡的Kafka Producer和Kafka Consumer