返回到文章

采纳

编辑于 3年前

kafka找不到消费组 Consumer group ... has no active members

kafka

flink1.10.1从kafka拉取数据计算,能正常发送和消费数据,但是找不到消费组member-risk-flink

Properties properties = new Properties();
properties.setProperty("bootstrap.servers", kafkaServers);
properties.setProperty("group.id", "member-risk-flink");
properties.setProperty("key.deserializer", "org.apache.kafka.common.serialization.StringDeserializer");
properties.setProperty("value.deserializer", "org.apache.kafka.common.serialization.StringDeserializer");
properties.setProperty("auto.offset.reset", "earliest");
properties.setProperty("max.poll.records", kafkaOffset);
DataStreamSource<String> dataStream = env.addSource(new FlinkKafkaConsumer011(calculateInputTopic, new SimpleStringSchema(), properties));
MacBook-Pro-3:kafka_2.12-0.11.0.1 zc$ bin/kafka-consumer-groups.sh --bootstrap-server 10.9.253.80:9092 --list
Note: This will only show information about consumers that use the Java consumer API (non-ZooKeeper-based consumers).
MacBook-Pro-3:kafka_2.12-0.11.0.1 zc$ bin/kafka-consumer-groups.sh --bootstrap-server 10.9.253.80:9092 --group member-risk-flink --describe
Note: This will only show information about consumers that use the Java consumer API (non-ZooKeeper-based consumers).

Consumer group 'member-risk-flink' has no active members.

TOPIC                          PARTITION  CURRENT-OFFSET  LOG-END-OFFSET  LAG        CONSUMER-ID                  HOST                           CLIENT-ID
member-risk-abstraction-calculate-input 3          5               5               0          -                    -                              -
member-risk-abstraction-calculate-input 0          4               4               0          -                    -                              -
member-risk-abstraction-calculate-input 2          4               4               0          -                    -                              -
member-risk-abstraction-calculate-input 1          2               2               0          -                    -                              -
MacBook-Pro-3:kafka_2.12-0.11.0.1 zc$ bin/kafka-consumer-groups.sh --bootstrap-server 10.9.253.80:9092 --delete --group member-risk-flink
Option '[delete]' is only valid with '[zookeeper]'. Note that there's no need to delete group metadata for the new consumer as the group is deleted when the last committed offset for that group expires.
MacBook-Pro-3:kafka_2.12-0.11.0.1 zc$ bin/kafka-consumer-groups.sh --zookeeper 10.9.253.80:2181  --delete --group member-risk-flink
Note: This will only show information about consumers that use ZooKeeper (not those using the Java consumer API).

Error: Delete for group 'member-risk-flink' failed because group does not exist.