Module 3 Activity Research

Weekly Activity Template

Zainab Ilyas

Project 3

Module 3

Throughout the final stage of our project, we continually iterated on both design and functionality, learning how even small changes to MIDI or Kinect inputs could drastically shift how intuitive or confusing the interaction felt for performers and audiences. My early TouchDesigner experiments, ranging from particle-based waterfalls to opticalFlow cursor interactions, helped our team move toward a more abstract ink-waterfall visual that remained both expressive and optimized for real-time performance. Early prototyping saved us time by revealing issues with sensors, MIDI devices, backgrounds, and vibrancy before final production. Designing for audience participation also changed our approach, pushing us to emphasize clarity, responsiveness, and accessibility as people “played” with the visuals alongside the performer. In the final build, we created a reactive prototype that connected TouchDesigner visuals to both MIDI instruments and Kinect body movement, forming an interactive digital stage environment centred around the song “A LONG DREAM” by SE SO NEON. Supporting Bre with testing and fine-tuning, and later merging our visual with Mikhael’s drum-kit set, helped shape a cohesive user experience.

Project 2

Project 3 Final Prototype

Together with my group members, Belinda Chen, Bre Velasco, and Mikhael Ledger, our final prototype is designed to enhance live music experiences by transforming sound and movement into an interactive visual dialogue. Using TouchDesigner as our core engine, we combined live reactive visuals with MIDI input from instruments and body-movement data from the Kinect to create a digital stage environment where performers and audiences can shape the visuals in real time. This system makes performance more tangible and participatory, allowing audiences to literally “play” with the music performed onstage. For this concept, we centred our visual design around the song “A LONG DREAM” by Korean indie rock band SE SO NEON, drawing inspiration from its atmosphere, rhythm, and emotional tone. As part of our long-term vision, we planned to install and perform this setup in a full stage setting, ideally the Marquee at Trafalgar Campus, to offer a larger, immersive space where more people, especially students, can listen, interact, and experience the blend of music and visual storytelling.