Real-time Hand Tracking and Logging

[jfResearchEng]

🚀 Feature

Hand tracking enables the use of hands as an input method for the Oculus Quest headsets. When using hands as input modality, it delivers a new sense of presence, enhances social engagement, and delivers more natural interactions with fully tracked hands and articulated fingers.

We can use LabGraph to record the data captured from Quest headset and visualize the data (e.g. in Unity). Oculus Hand Tracking API can be found here.

One set of Quest 2 and Link Cable could be provided for a US-based user who has contributed to LabGraph (subject to review/approval).

This project provides an opportunity for a contributor to learn more about Oculus SDK and python programming.

Additional context

1. Existing application can be found [here] (https://developer.oculus.com/documentation/unity/unity-handtracking/)
2. The code should be added at folder is https://github.com/facebookresearch/labgraph/tree/main/devices/quest2
3. Create setup.py and README.md, where example can be found at: https://github.com/facebookresearch/labgraph/tree/main/extensions/labgraph_viz
4. Add github action support, reference: https://github.com/facebookresearch/labgraph/actions/workflows/main.yml
5. Add proper license header.

[dtemir]

Hi @jfResearchEng! Is this still available to apply for?

[jfResearchEng]

Hi @jfResearchEng! Is this still available to apply for?

Yes! I'll follow up with you on more details.