Shanghai
Audio Reactive Sound Bath is an interactive audiovisual experience that explores the relationship between sound, perception, and computational systems.
The project investigates how invisible sensory information can be transformed into a visible and immersive environment through real-time interaction. Rather than treating sound as a passive background element, the work positions audio as an active input that continuously shapes the visual experience.
Through procedural systems and real-time visual generation, the project explores how technology can mediate the relationship between human perception and computational processes, creating an environment where sound becomes a dynamic visual language.
Sound exists as a physical phenomenon that cannot be directly seen, yet it strongly influences human emotion, memory, and perception.
This project explores the question:
How can computational systems translate invisible sensory information into a visual and immersive experience?
By mapping audio characteristics such as frequency, amplitude, and rhythm into visual parameters, the system creates an environment where sound becomes a constantly evolving visual experience.
The work explores the relationship between:
Physical Input → Computational Transformation → Human Perception
and examines how digital systems can transform intangible experiences into meaningful sensory interactions.
The project was developed through iterative experimentation with real-time procedural systems.
Audio input was analyzed and translated into visual behaviors, creating relationships between sound characteristics and generated visual elements. Instead of relying on predefined animation sequences, the system continuously responds and evolves based on incoming audio information.
The system consists of three interconnected layers:
Input
Audio signals are captured and analyzed as the foundation of the interactive experience.
Transformation
Computational processes translate audio data into visual parameters. Through procedural networks, elements such as movement, scale, form, and atmosphere are influenced by changing audio characteristics.
Output
A generative audiovisual environment emerges through the interaction between sound input and visual systems.
.png)
TouchDesigner was used as the primary environment for developing the interactive system.
Through procedural networks and real-time processing, audio information was transformed into dynamic visual behaviors. The project required independent exploration of the platform beyond techniques introduced in class, including experimentation with audio analysis, procedural generation, and parameter mapping.
The development process involved:
• Audio analysis and data extraction
• Procedural visual generation
• Real-time parameter mapping
• System experimentation and refinement
• Iterative visual exploration
Rather than using software as a simple production tool, the project approached TouchDesigner as a system-building environment where relationships between input, processing, and output could be designed.
The experimentation process focused on exploring how different relationships between sound and visual behavior could influence perception.
Rather than creating a direct visualization of audio data, the project explored how abstract transformations could generate atmosphere, rhythm, movement, and emotional response.
The goal was not simply to represent sound visually, but to create an environment where computational processes become part of the audience’s sensory experience.
The final experience creates a continuously evolving environment where visual elements respond dynamically to sound in real time.
The audience does not simply observe a visual representation of audio. Instead, they encounter a system where invisible sensory information becomes an active force that shapes the environment.
The project explores how interactive technologies can create new relationships between:
Human Sensation → Computational Processing → Digital Experience
Audio Reactive Sound Bath became an early exploration of my interest in interactive systems, computational creativity, and human perception.
Through building an audio-responsive environment, I began to view technology not only as a tool for producing visual outcomes, but as a system that creates relationships between human input, machine processing, and sensory experience.
This project established a foundation for my later exploration of generative AI and intelligent systems, where I continue investigating how computational processes influence the ways people interpret, engage with, and construct meaning from digital experiences.
