Skip to content
This repository was archived by the owner on Feb 12, 2022. It is now read-only.

unable to receive messages to all consumer groups if they subscribed to same topics #3

Open
himanshuatjudo opened this issue Oct 19, 2015 · 4 comments

Comments

@himanshuatjudo
Copy link

Here are the scenario and steps,

  • I have two topics part34.xxx (2 partitions) and part35.xxx (1 partition)
  • subscribe group4 and group5 for above both topics
  • produce messages on part34.xxx and part35.xxx
    I only receive the messages whichever group was subscribe first which doesn't seems to right behavior.
@ajperrins
Copy link

There is a bug in the re-balancing logic when you have multiple consumers groups consuming from the same topic. The bug is in ZkUtils.GetConsumersPerTopic, which doesn't filter the consumers by the group argument.

I haven't put in a pull request, because we made other changes, like upgrading Zookeeper, which the original author might not want to accept. But I can refer you to my commit where you can make a similar change on ZkUtils.cs, line 436, to filter by the group ID.

Hope this helps.

@initialBoy
Copy link

Here are the scenario,

Consumers with the same partition can not receive messages at the same time.

@initialBoy
Copy link

I don't know how to filter the consumers by the group argument.Because I don't know where to start

@raskolnikoov
Copy link

This is fixed in this #6

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants