Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CC on Blackwell #70

Open
YurkoWasHere opened this issue Sep 11, 2024 · 6 comments
Open

CC on Blackwell #70

YurkoWasHere opened this issue Sep 11, 2024 · 6 comments

Comments

@YurkoWasHere
Copy link

Is there any support for CC on Blackwell GPUs yet?

If there is would it be part of this repo?

@Tan-YiFan
Copy link

CC would be enabled on Blackwell. You can refer to https://www.nvidia.com/en-us/data-center/technologies/blackwell-architecture/

@YurkoWasHere
Copy link
Author

I guess the better question would be would bounce buffer be supported on blackwell,

as i understand it the new pcie v6 spec of encrypting pcie communication wont be ready for some time.

@Tan-YiFan
Copy link

Blackwell would support TEE I/O, allowing the GPU to directly read data from CVM private memory. Bounce buffer on CVM is not used during data transfer.

@YurkoWasHere
Copy link
Author

AFAIK TEE I/O is next gen pcie and probably wont ship for at least a year after Blackwell drops. (I think Intel called it TDX Connect, not sure what the AMD branding is)

If this is incorrect i would love to learn more about possible time lines, otherwise i fear the only way to be early CC on Blackwell is a bounce buffer.

@Tan-YiFan
Copy link

Yes, it is called TDX connect in Intel TDX.

TDX connect (or TEE I/O) is based on PCIE TDISP (a feature in PCIE 5.0). Could you share with me what feature of TEE I/O is in next gen PCIE?

https://www.nvidia.com/en-us/data-center/technologies/blackwell-architecture/ says blackwell supports TDX I/O.

@Tan-YiFan
Copy link

The latest version of nvidia open gpu kernel has some updates on Blackwell CC: https://github.com/NVIDIA/open-gpu-kernel-modules/blob/565.57.01/src/nvidia/src/kernel/gpu/conf_compute/arch/blackwell/conf_compute_gb100.c

@rnertney @steven-bellock Could you provide further information?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants