Motion Tracking & Live Masking for

Breath

Project Type: Interactive Performance / Real-Time Projection Mapping / Motion Tracking

Materials : Depth Camera, Live Video Processing, Projector, Inflatable Structure

Keywords: Real-Time Dynamic Masking, Interactive Choreography, Human-Object Symbiosis

Breath is an interactive performance produced by Plateforme Plattform as part of a French-German-Romanian exchange program. The piece explores the relationship between human movement and natural phenomena, centering around a large, chaotic inflatable structure that dancers attempt to manipulate on stage.

Context: Interactive Technologies for Performing and Media Arts @ Cinetic UNATC

Project Date: 11.2019

As part of the CINETic Interaction Design team, Sebastian developed the real-time visual tracking and projection masking system for the performance. To capture the unpredictable movement of the inflatable object, live video feeds were combined with depth camera data. This allowed the system to accurately generate a dynamic projection mask and measure motion intensity in real time. The resulting data was relayed directly to the visual software, driving responsive light and projection layers that adapted live to the dancers' interactions

The project was developed across collaborative workshops at Hochschule Wismar and Lycée Édouard Branly, featuring choreography by Natacha Paquignon and an inflatable structure created under the supervision of artist Frank Fierke. The performance premiered at the Goethe-Institut Lyon during the Fête des Lumières 2019.

Photo/Video: Quentin Mariotti

Links:

Féte des Lumieres Festival - Performance Showcase

CINETic - Performance Coverage

Project Partners:
Plateforme Plattform
Goethe Institut
Office franco-allemand pour la Jeunesse / Deutsch französisches Jugendwerk
Ville de Lyon
La Métropole Fondation
Hippocrène Région Auvergne-Rhône-Alpes
Consulat Général d’Allemagne

studio@sebastienkoma.com
+40754831722