Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Demo 3DGS #1

Open
qwer1793 opened this issue Dec 3, 2024 · 4 comments
Open

Demo 3DGS #1

qwer1793 opened this issue Dec 3, 2024 · 4 comments

Comments

@qwer1793
Copy link

qwer1793 commented Dec 3, 2024

Excellent work! I met with a problem that using a 3DGS as input cannot get realistic blender file. Using kiri engine I can only get mesh and there's invisible 3DGS. :(
屏幕截图 2024-12-03 200514

@jasongzy
Copy link
Owner

jasongzy commented Dec 3, 2024

Please make sure you have installed the KIRI Engine addon 1.0 (we haven't made the demo compatible with version 2.0+ yet).

Also, after opening the BLEND file, switch to Viewport Shading mode and click Start camera update in the addon menu.

image

@qwer1793
Copy link
Author

qwer1793 commented Dec 4, 2024

The render result in blend is quite unsatisfactory... Is there any way that I can get the 3DGS file for some frames directly?I wanna use the official 3DGS render.py to get the render results.

@zhqy513z
Copy link

效果确实不太好,好像导出的是采样的点云?

@jasongzy
Copy link
Owner

导出的 BLEND 文件中既有高斯对应的点云(默认隐藏),也有真正的 splats(未装 KIRI 插件 1.0 是无法显示的)

如果想要自己渲染 GS,可以考虑从 blender 中导出 per-Gaussian blend weights 和 per-frame joint transformation matrix,然后手动实现一下 LBS 的过程(对 rest pose 的 GS 做 rotation + translation 变换)

如果绑定效果不佳,可以尝试调整一下 Opacity Threshold,或者提前对高斯做一下预处理(去除不在人物身体上的点)。如果点云采样时采到了身体之外的点,会极大影响模型对 shape 的判断

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants