XR Holodeck

Project description

“How can a distributed XR environment integrate voice recognition, gestural input, large language models, and text-to-3D generation technologies to enable real-time collaborative creation and manipulation of parametric 3D objects?”

Context

The goal of this project is to help movie directors, crews, and set designers quickly prototype scenes before they are built or filmed. The project also works as a shared collaboration space, where people from different institutes such as construction and education can work together on creating and adjusting scenes. This makes it easier to communicate ideas, test concepts early, and coordinate work across different fields.

Results

The main outcome of the project is a functional prototype that enables rapid scene prototyping in a shared digital environment.

User feedback indicated that the workflow is intuitive and lowers the barrier for early-stage planning and communication across disciplines. The prototype proved useful for exploring ideas quickly and aligning creative and technical decisions before moving to physical production. Based on the current level of implementation and validation, the project can be positioned at an early to mid TRL level. The core functionality has been demonstrated in a relevant setting, while further development and broader testing would be needed for real-world production use.

About the project group

Our project group consists of students with similar academic backgrounds in Software Engineering. The project was carried out over a period of 18 weeks. We worked in an agile manner, collaboratively, holding regular meetings to plan tasks, discuss progress, and solve problems. Responsibilities were shared based on individual strengths, and we used clear communication and coordination to ensure steady progress throughout the project.

Downloads