In Kafka, how to find the offsets for all partitions between given start and end date (or say timestamp) and replay the msgs

You can reset offsets for consumer group by using kafka-consumer-groups tool – https://docs.cloudera.com/runtime/7.2.1/kafka-managing/topics/kafka-manage-cli-cgroups.html (this is from cloudera, but included in any kafka distribution from v0.11)

You could also run the following: ./kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list <hostname>:<port> --time <epoch> --topic <topic> and get offset by time. Refer to https://cwiki.apache.org/confluence/display/KAFKA/System+Tools#SystemTools-GetOffsetShell

CLICK HERE to find out more related problems solutions.

Leave a Comment

Your email address will not be published.

Scroll to Top