Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for system metrics #33

Merged
merged 1 commit into from
Jan 2, 2024

Conversation

jgiannuzzi
Copy link
Member

@jgiannuzzi jgiannuzzi commented Dec 22, 2023

This PR enables support for system metrics by reverting some of the code removals we did in #31 (based on #3), adapting them for MLFlow keys (starting with system/ instead of __system__ and covering different aspects), and fixing the key ordering (which was broken in the UI and relied on the server originally).

Fixes G-Research/fasttrackml#536.

@jgiannuzzi jgiannuzzi linked an issue Dec 22, 2023 that may be closed by this pull request
'system/disk_available_megabytes': 'Disk Available (MB)',
'system/disk_usage_megabytes': 'Disk (MB)',
'system/disk_usage_percentage': 'Disk (%)',
'system/gpu_0_memory_usage_megabytes': 'GPU 0 Memory (MB)',

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Couldn't this be built more cleanly with an iterator?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am not an expert in typescript, so I don't know 😞
I wanted to make sure we can ship this!

@@ -146,7 +146,7 @@ function processRunBatchData(
}),
sortKey: `${run.name}${contextName}`,
};
if (run.name.startsWith('__system__')) {
if (run.name.startsWith('system/')) {

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is the third time I'm seeing this magic string in this PR - could we extract a constant somehow?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is based on the existing UI code from Aim at this stage. Extracting a constant would make total sense, but I wanted to keep this as close as possible to the current upstream logic.

'system/disk_available_megabytes': string;
'system/disk_usage_megabytes': string;
'system/disk_usage_percentage': string;
'system/gpu_0_memory_usage_megabytes': string;

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same comment re: tidying this w/an iterator...

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same reply as above: if there is a way to do this cleanly in typescript, I'll take it!

@jgiannuzzi jgiannuzzi merged commit 82e76ee into G-Research:release/v3.17.5 Jan 2, 2024
3 checks passed
@jgiannuzzi jgiannuzzi deleted the system-metrics branch January 2, 2024 12:43
vinayan3 pushed a commit to vinayan3/fasttrackml-ui-aim that referenced this pull request Aug 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support logging of system metrics
3 participants