VR/360 Client
Background
Develop a client and server backend for an "avatar" system using a Meta Quest 2/3 headset, a NUC/laptop, and a 360° video camera.
The user should be able to view the 360° video stream from the camera inside the headset and send movement commands (e.g., move left, right, forward, reverse) to the server.
Task
- Develop the Meta Quest client capable of decoding a 360° video stream (with audio).
- Transmit controller input from the headset (e.g., movement commands) to the server.
- As an extension, enable the client to also transmit audio back to the server to support two-way communication.
Epic
This system will build on prior work available in:
The exact epics and sub-tasks will be discussed and refined with the development team, but should generally include:
- Integration of existing server components
- Client development and communication protocols
- Synchronization of video, audio, and control commands
- Testing and optimization
Research Question
To be evaluated for eligibility. Possible directions include:
- Comparison of different transmission technologies
- Defining acceptable delay thresholds for user experience
Legal and Technical Requirements
- All source code must be published under a copyleft license (e.g., GPLv3).
- Emphasis should be on product readiness, stability, and maintainability.
- Code must follow best practices, standardized language conventions, and provided templates.
- Automated checks, tests, and build procedures (via GitLab CI) should be implemented where possible.
- The final deliverable (build package) must be directly installable on the host OS.
Edited by Jonas Karlsson