码迷,mamicode.com
首页 > 编程语言 > 详细

05_Kafka Python_Consumer模拟

时间:2017-12-09 23:53:55      阅读:211      评论:0      收藏:0      [点我收藏+]

标签:相同   rod   iter   serve   images   rom   rate   image   str   

Python客户端:  Kafka-python

安装:  pip install kafka-python

Consumer端模拟代码

"""
Kafka Consumer Test
Client: Kafka-Python
"""
# Consumer
from kafka import KafkaConsumer


def main():

    # A message iterator generated, start reading message from the beginning of the topic
    consumer = KafkaConsumer("ctopic", group_id="cg-1", bootstrap_servers=["192.168.229.100:9092", "192.168.229.101:9092"],
                             auto_offset_reset=earliest)

    for msg in consumer:
        topic = msg.topic
        partiton = msg.partition
        # can explained as msg id, starting from 0
        offset = msg.offset
        key = str(msg.key, encoding=utf-8)
        value = str(msg.value, encoding=utf-8)

        print("Topic: "+ topic + "From Partion: " + str(partiton))
        print("Offset: " + str(offset))
        print("Msg key: " + key + " Msg value: " + value)
        print("*"*20)

    consumer.close()

if __name__ == "__main__":
    main()

 

 启动该Consumer,并多次运行Producer, 由于消息的key相同,会被存入同一个partition, 从Consumer端解析出的partition也可以确认

技术分享图片

 

05_Kafka Python_Consumer模拟

标签:相同   rod   iter   serve   images   rom   rate   image   str   

原文地址:http://www.cnblogs.com/shay-zhangjin/p/8012869.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!