Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: cnidarium metrics emission broken #5004

Closed
conorsch opened this issue Jan 24, 2025 · 0 comments · Fixed by penumbra-zone/cnidarium#9 or #5006
Closed

bug: cnidarium metrics emission broken #5004

conorsch opened this issue Jan 24, 2025 · 0 comments · Fixed by penumbra-zone/cnidarium#9 or #5006

Comments

@conorsch
Copy link
Contributor

Describe the bug
pd no longer emits most cnidarium-related metrics.

Expected behavior
cnidarium-related metrics are still exposed by pd for scraping by prometheus.

Screenshots

Image

See the time series above. The drop-off in metrics coincides with the release of v1, in which we started depending on the out-of-tree cnidarium crate.

Additional context
Given the namespacing changes, we'll need to refine how pd access the metrics exposed by the now-external cnidarium crate.

erwanor added a commit to penumbra-zone/cnidarium that referenced this issue Jan 27, 2025
@erwanor erwanor reopened this Jan 27, 2025
conorsch added a commit that referenced this issue Jan 27, 2025
Tacks on a new integration test to catch metrics regressions,
rather than waiting until post-deploy. The test is straightforward: GET
the metrics endpoint, confirm a few matches. More subtle is the
reordering of the smoke test suite: the pd tests come last now, since
the metrics will be empty on pd start, if no work has been performed.

Refs #3780, #5004.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants