Consumer Lag Stuck

[Fosol]

Issue submitter TODO list

• I've looked up my issue in FAQ
• I've searched for an already existing issues here
• I've tried running main-labeled docker image and the issue still persists there
• I'm running a supported version of the application which is listed here

Describe the bug (actual behavior)

The Consumer Lag never changes, it's stuck. I've compared the messages with what has been processed in my logs and I've processed all messages. The consumers are not receiving any new messages.

Is there a way to manually reset the consumer lag, or tell it to recalculate?

This has occurred several times now. The only fix I've found so far is to delete the topic and consumers.

Expected behavior

The consumer lag should display the actual lag. It shouldn't get stuck. There should be a way to fix this.

Your installation details

I'm running v1.2.0 in a Podman container.

version: '3'
services:
  kafka-ui:
    image: ghcr.io/kafbat/kafka-ui:v1.2.0
    profiles:
      - all
    restart: 'always'
    env_file:
      - kafka/kafka-ui/.env
    ports:
      - 8080:8080
    volumes:
      - ./kafka/kafka-ui/config.prod.yaml:/etc/kafkaui/dynamic_config.yaml

Steps to reproduce

I've simply run the container. I have 6 topics. The current topic with the bug has 60 partitions, but the bug has occurred randomly to other topics that only have 3 partitions.

Screenshots

Logs

No response

Additional context

No response

[github-actions]

Hi Fosol! 👋

Welcome, and thank you for opening your first issue in the repo!

Please wait for triaging by our maintainers.

As development is carried out in our spare time, you can support us by sponsoring our activities or even funding the development of specific issues.
Sponsorship link

If you plan to raise a PR for this issue, please take a look at our contributing guide.

[Haarolean]

What makes you think it's a kafka-ui bug, not your consumers reporting these offsets? Can you support this with different numbers in other UI tools or kafka built-in management scripts?

[kapybro]

Further user feedback is requested. Please reply within 7 days or we might close the issue.

[Fosol]

I am simply using the Kafbat UI to test it's viability. This is an issue I noticed. I can't say I have any additional knowledge on the subject. I know I ran into the same issue with the related and no longer supported Kafka UI as well. I've never ran into this type of issue with older versions of Kowl. I'll look around for other tools to compare.

[kapybro]

Thanks for the additional feedback! We'll get back to your issue soon.

[Haarolean]

would be nice to see the output of built-in kafka management stuff:
./kafka-consumer-groups.sh --bootstrap-server host:port --group <consumer-group-name> --describe
we don't do any black magic, so most likely it is what is being reported by your brokers