返回到文章

采纳

编辑于

kafka消费者吞吐量低

kafka

正式服务器上kafka消费者吞吐量很低一般是什么原因造成的?

 bash-4.4# kafka-consumer-perf-test.sh --broker-list  :9092  --topic runtime_log --messages 10000 --fetch-size 1048576 --threads 1
start.time, end.time, data.consumed.in.MB, MB.sec, data.consumed.in.nMsg, nMsg.sec, rebalance.time.ms, fetch.time.ms, fetch.MB.sec, fetch.nMsg.sec
2020-06-03 08:50:49:156, 2020-06-03 08:51:04:382, 7.6468, 0.5022, 10493, 689.1501, 1591174249605, -1591174234379, -0.0000, -0.0000

PS:测试服务器以及本地虚拟机搭建的kafka,吞吐量正常,结果如下:

bash-4.4# kafka-consumer-perf-test.sh --broker-list  47.94.**.***:9092  --topic runtime_log --messages 10000 --fetch-size 1048576 --threads 1
start.time, end.time, data.consumed.in.MB, MB.sec, data.consumed.in.nMsg, nMsg.sec, rebalance.time.ms, fetch.time.ms, fetch.MB.sec, fetch.nMsg.sec
2020-06-03 08:47:55:302, 2020-06-03 08:47:56:972, 8.1897, 4.9040, 10247, 6135.9281, 1591174075910, -1591174074240, -0.0000, -0.0000