Held BETWEEN EARTH AND SKY

Embodied Cognition Through Responsive Environments

Category: Embodied Interfaces & Responsive Environments
Year: 2025-Present | Ongoing Series

Immersive projection-mapped yoga experience using real-time body tracking to create responsive dichroic landscapes. Explores how playful, responsive environments can deepen both individual mind-body connection and communal connection during shared embodied practice.

Research Question: Can ambient responsive environments support meditative states while fostering communal connection through playful interaction?

Technical Implementation:

  • NVIDIA Body Tracking (25-point skeleton) for real-time pose detection

  • Proximity-based interactions: movement activates flow emitters, sparkles, chakras

  • Multi-participant tracking: practitioners see each other's movements visualized, creating shared visual landscape

  • Voice-activated scene transitions for teacher control

  • Audio reactivity: FFT analysis mapping sound bath frequencies to visuals

  • Iterative development: breath rate detection via ribcage motion, ongoing heart rate integration

Key Innovation: Environmental co-regulation that's both individual and communal. Each person's movement contributes to shared visual experience, making individual practice visible to the group. Playful visual feedback—sparkles, flowing particles, blooming chakras—transforms solo practice into collective creation.

Communal Connection: Rather than isolated practice, participants witness each other's movements through responsive visuals. When someone reaches arms overhead, the whole group sees celestial effects; when the group moves together, visual synchronicity emerges. Creates nonverbal connection and shared presence without disrupting meditative focus.

Mind-Body Connection Through Play: Responsive feedback makes embodied experience visible. Practitioners discover: "My breath changes the landscape," "My movement creates beauty," "We're creating this together." Play invites curiosity about internal states—what happens if I move differently? How does my energy affect the space or merge with others?

Contribution to RNI Research: Explores how physical spaces can actively support cognitive/emotional states through both individual feedback and communal resonance. Demonstrates continuous monitoring in natural settings that enhances rather than interrupts practice. Foundation for RAI's environmental control component—shows technology can support healing without isolation.

Technologies: TouchDesigner, NVIDIA Body Tracking, 4K projection, FFT audio analysis

Previous
Previous

Generative Meditation: Breaking Anxiety Cycles Through Affective BCI Media Art

Next
Next

Silent Futures: Community-Based Speculative Design Through Body Language