XR Holodeck

Project description

The Trans Realities Lab is developing an innovative XR-based collaborative environment, allowing distributed teams to interact in a shared virtual space in contextual real-time. Inspired by futuristic "holodeck" concepts, the goal is to create and manipulate 3D objects in real-time using voice and gestural commands within that XR environment. This project builds on the existing XR-IT framework, which already provides the functionality needed to enable multi-user distributed spatial collaboration.

While existing technologies enable voice-to-text, 3D generation, and gestural interaction, integrating these components into a seamless, real-time, and parametric 3D environment remains a complex challenge. This project aims to explore and prototype such an interaction system for professionals and non-professionals to rapidly visualise and prototype ideas within an immersive setting.

Context

Extended Reality Research ( AI Facilitated Co-Creation in Distributed Immersive 3D Environments)

Results

Outcomes:

• Working prototype demonstrating basic functionalities (voice, gestural interaction, object manipulation)
• Research & integration documentation on AI models and APIs used
• Technical feasibility report for cloud-based AI-driven 3D generation
• Demo scenario setup showcasing real-world use cases

Achieved TRL Readiness Level 5:
Components were independently validated in a lab environment, and the Holodeck system was demoed in a live environment