[ECS] [request]: ETA on ALinux 2023 ECS GPU Optimized AMI

[c200chromebook]

Any sense of an ETA on an Amazon Linux 2023 ECS GPU Optimized AMI?

[danehlim]

Hello, we do not have an ETA on Amazon Linux 2023 ECS GPU Optimized AMI at this time. Moving this to containers-roadmap and tracking as a feature request.

[c200chromebook]

Do you guys publish the current CUDA version anywhere anymore? I know I can add amzn2-nvidia and do yum list but I'd like some kind of warning if, for example, you all were to jump to a 12.x based driver.

[shreeshaprabhu]

Hi, is there is any update on ETA?

[jenmlinaws]

We'll base this on the Amazon Linux 2023 GPU/Neuron AMIs once those are released, this issue should provide updates on their ETA: amazonlinux/amazon-linux-2023#12

[stewartsmith]

AL2023 has built-in support for installing NVIDIA drivers now.

The nvidia-release package, added in the 2023.6.20241031 release will enable an RPM package repository with NVIDIA drivers available for installation.

More documentation is to come, as it's incredibly sparse at the moment. However, this should unblock downstream AMIs who wish to consume packages directly from Amazon Linux.

[s0rthak]

Hey @jenmlinaws , now that the upstream changes are done in AL2023, can we get an updated ETA for this ticket, please? 🙏🏼

[bobziuchkovski]

It's worth noting that there are EKS GPU-optimized AL2023 AMIs that Amazon released in October.

Maybe some of that config is usable for an ECS-optimized AL2023 AMI?

[giantcow]

FYI I've started working on building an AL2023 GPU supported AMI (for my own project work, independently of the AWS roadmap) here: aws/amazon-ecs-ami#362

though I am running into issues with the ECS agent and NVML (aws/amazon-ecs-agent#4466)