Interactive
TiME Lab
A framework for co-located, multiplayer interactive experiences using real-time positional and pose tracking.
Technologies
- Python
- DepthAI
- RGB-D Cameras
- ROS
- Unity
- Unreal Engine
- Real-Time Networking
| Platform | Linux (TiME Lab infrastructure) |
| Year | 2025 |
| Location | Berlin, Germany |
| Developers |
|
Interactive TiME Lab is an ongoing research and development project conducted as part of my work at the Fraunhofer Heinrich Hertz Institute. The project investigates how digital content can be transformed into co-located, multiplayer, interactive experiences through real-time human position and pose tracking.
Using RGB-D camera slider sensors, spatial movement data from multiple users is captured and streamed over the network to Unity or Unreal Engine. This enables real-time interaction with time-lapse sequences and other temporal media formats inside immersive environments.
The resulting pipeline supports the creation of applications in which users can navigate, explore, and interact with temporal visual data in a spatially coherent manner. The framework is designed for use in large-scale immersive setups such as the TiME Lab, where multiple participants can simultaneously engage with shared digital content.
