Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added support to read new GS Segmentation ply data #740

Open
wants to merge 3,710 commits into
base: main
Choose a base branch
from

Conversation

Steve-KX-RL
Copy link
Contributor

@Steve-KX-RL Steve-KX-RL commented Jul 1, 2024

  1. Updated training pipeline to incorporate SAGA 3D segmentation data into .ply file.
  2. Updated .ply / splat file parser to be compatible with the new .ply file structure
  3. Added "segmentation mode" besides regular color mode to the splat viewer, triggered by keyboard "J"
  4. Visualized segmentation cluster center points in the splat viewer. Point size corresponds to cluster size (bigger point means there are more splats in this cluster / category), and hovering over the points gives cluster label.
    Example screenshot & video:
GS 3D Segmentation GUI
GS.3D.Segmentation.GUI.mov

Will work with @dangond-ptc to update the training pipeline automation. For now, if you want to try it out, see Teams chat for an example new version of the reality lab splat file.

hobinjk-ptc and others added 30 commits March 26, 2024 16:28
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite) from 5.2.6 to 5.2.7.
- [Release notes](https://github.com/vitejs/vite/releases)
- [Changelog](https://github.com/vitejs/vite/blob/main/packages/vite/CHANGELOG.md)
- [Commits](https://github.com/vitejs/vite/commits/v5.2.7/packages/vite)

---
updated-dependencies:
- dependency-name: vite
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
…rwise theres a gap that never gets cleared when you resize the page
Fix the Spatial Pointer canvas's vertical offset
Refactor all the addToggles out of onLoad and into setupSettingsMenu
move avatar container z index above the fullscreen tool z index
Replace approach of timeline drawing poses from its own list of poses to
draw spaghetti lines on timeline
dangond-ptc and others added 27 commits August 20, 2024 14:13
Table View Coloring and MURI images
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite) from 5.4.1 to 5.4.2.
- [Release notes](https://github.com/vitejs/vite/releases)
- [Changelog](https://github.com/vitejs/vite/blob/main/packages/vite/CHANGELOG.md)
- [Commits](https://github.com/vitejs/vite/commits/v5.4.2/packages/vite)

---
updated-dependencies:
- dependency-name: vite
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Optimize network bandwidth used while in avatar following mode
…entirely in userinterface instead of needing modification to addons
Button to stop sharing your perspective
Bumps [@microsoft/teams-js](https://github.com/OfficeDev/microsoft-teams-library-js/tree/HEAD/packages/teams-js) from 2.26.0 to 2.27.0.
- [Release notes](https://github.com/OfficeDev/microsoft-teams-library-js/releases)
- [Changelog](https://github.com/OfficeDev/microsoft-teams-library-js/blob/main/packages/teams-js/CHANGELOG.md)
- [Commits](https://github.com/OfficeDev/microsoft-teams-library-js/commits/HEAD/packages/teams-js)

---
updated-dependencies:
- dependency-name: "@microsoft/teams-js"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite) from 5.4.2 to 5.4.3.
- [Release notes](https://github.com/vitejs/vite/releases)
- [Changelog](https://github.com/vitejs/vite/blob/main/packages/vite/CHANGELOG.md)
- [Commits](https://github.com/vitejs/vite/commits/v5.4.3/packages/vite)

---
updated-dependencies:
- dependency-name: vite
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Bumps [@microsoft/teams-js](https://github.com/OfficeDev/microsoft-teams-library-js/tree/HEAD/packages/teams-js) from 2.27.0 to 2.28.0.
- [Release notes](https://github.com/OfficeDev/microsoft-teams-library-js/releases)
- [Changelog](https://github.com/OfficeDev/microsoft-teams-library-js/blob/v2.28.0/packages/teams-js/CHANGELOG.md)
- [Commits](https://github.com/OfficeDev/microsoft-teams-library-js/commits/v2.28.0/packages/teams-js)

---
updated-dependencies:
- dependency-name: "@microsoft/teams-js"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
lower the rate of sending avatar position/cursor/beam updates when many clients are connected
…mprovement

1. Added Splat Manager dedicated to loading & managing multiple splat files, changing transforms & boundaries of multiple splat files
2. Started integrating James' segmentation hull demo into splatting.js
3. Added support for selecting & hidding multiple splats
4. Added support for generating region, label, and custom data for every cluster of splats
5. Improved overall performance by not rendering anything out of splat region boundary & behind the camera
6. Changed splat file reading default byte length from 32 to 36, to add additional info to (empty byte, display or hidden, region id, label id)
7. Changed blending mode & depth index sorting from reverse-painters-algorithm to painters-algorithm
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite) from 5.4.3 to 5.4.4.
- [Release notes](https://github.com/vitejs/vite/releases)
- [Changelog](https://github.com/vitejs/vite/blob/v5.4.4/packages/vite/CHANGELOG.md)
- [Commits](https://github.com/vitejs/vite/commits/v5.4.4/packages/vite)

---
updated-dependencies:
- dependency-name: vite
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite) from 5.4.4 to 5.4.5.
- [Release notes](https://github.com/vitejs/vite/releases)
- [Changelog](https://github.com/vitejs/vite/blob/v5.4.5/packages/vite/CHANGELOG.md)
- [Commits](https://github.com/vitejs/vite/commits/v5.4.5/packages/vite)

---
updated-dependencies:
- dependency-name: vite
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Bumps [@vitest/coverage-v8](https://github.com/vitest-dev/vitest/tree/HEAD/packages/coverage-v8) from 2.0.5 to 2.1.0.
- [Release notes](https://github.com/vitest-dev/vitest/releases)
- [Commits](https://github.com/vitest-dev/vitest/commits/v2.1.0/packages/coverage-v8)

---
updated-dependencies:
- dependency-name: "@vitest/coverage-v8"
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Bumps [@vitest/coverage-v8](https://github.com/vitest-dev/vitest/tree/HEAD/packages/coverage-v8) from 2.1.0 to 2.1.1.
- [Release notes](https://github.com/vitest-dev/vitest/releases)
- [Commits](https://github.com/vitest-dev/vitest/commits/v2.1.1/packages/coverage-v8)

---
updated-dependencies:
- dependency-name: "@vitest/coverage-v8"
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite) from 5.4.5 to 5.4.6.
- [Release notes](https://github.com/vitejs/vite/releases)
- [Changelog](https://github.com/vitejs/vite/blob/v5.4.6/packages/vite/CHANGELOG.md)
- [Commits](https://github.com/vitejs/vite/commits/v5.4.6/packages/vite)

---
updated-dependencies:
- dependency-name: vite
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite) from 5.4.6 to 5.4.7.
- [Release notes](https://github.com/vitejs/vite/releases)
- [Changelog](https://github.com/vitejs/vite/blob/v5.4.7/packages/vite/CHANGELOG.md)
- [Commits](https://github.com/vitejs/vite/commits/v5.4.7/packages/vite)

---
updated-dependencies:
- dependency-name: vite
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants