Skip to content

Conversation

LoadingZhang
Copy link

Changes

In multi-worker instances, metrics between Prometheus clients are calculated independently.
For example:
worker0: metric.counter=1
worker1: metric.counter=2

When requesting /metrics api, what is returned metirc.counter=1 or 2, not 3(1+2)

When the PROMETHEUS_MULTIPROC_DIR environment variable was specified at that time, the prometheus client would store data in the specified directory.
After correct initialization, requesting the /metrics api of any worker could return the full amount of data from disk

Type

🐛 Bug Fix

@CLAassistant
Copy link

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.


sotazhang seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You have signed the CLA already but the status is still pending? Let us recheck it.

Copy link

vercel bot commented Sep 26, 2025

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Preview Comments Updated (UTC)
litellm Ready Ready Preview Comment Sep 26, 2025 0:53am

@krrishdholakia
Copy link
Contributor

please fix the prometheus.py linting errors

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants