Skip to content

Can we do dynamic rewind in setting offset to earlier point on the fly? #844

@hothero

Description

@hothero

We used to do something like

doRewind(topicAndTime); // reset offset based on the topic and partition
kafkaConsumer.poll(getPollTimeMillis());

however, based on the parallel-consumer's architecture diagram, there is a work state management. We're not sure if we can directly manage that. Could you please advice? Is there any way that we can update the offset on the fly while the consumers are still consuming messages?

Note: our consumer has self-protection mechanism to process "new" data only, so no concern to us to do so in real time.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions