Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Probably monitor private memory size too #212

Open
lars-t-hansen opened this issue Nov 21, 2024 · 0 comments
Open

Probably monitor private memory size too #212

lars-t-hansen opened this issue Nov 21, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@lars-t-hansen
Copy link
Collaborator

A new one today (NAICNO/Jobanalyzer#697) - a cluster of processes on a slurm-less system that share a very large memory blob (27GB) throw off our resident-memory readings, because we have no way of dealing with this. This was sort of known at the time - we want PSS (proportional set size) but can't have that without root access, so we settled for RSS, but that fails to handle this case.

Not sure how important this is - we won't know before we start looking. It could look like the process in question is some python thing that presumably uses fork() + shared memory to share a large data blob with concurrent processing, but this is only a guess.

We could minimally record private memory to at least detect this case, or make it possible to do so in postprocessing?

We more or less know how to compute process trees that are of interest and could probably use that somehow.

@lars-t-hansen lars-t-hansen added the enhancement New feature or request label Nov 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant