Sound Sculpt

• Prize
  Honorable Mention in Augmented Reality (AR) / TV / Film / Animation, VR / TV / Film / Animation
• Company
  Deepcake
• Lead
  Yiqi Zhao
• Client
  Bose
• Video
  Link to video

Imagine a world where sound is sculpted by movement, creating a mesmerizing audio-visual landscape. Sound Sculpt is an generative music tool that fuses spatial audio, motion, and visual art. Drawing inspiration from traditional sculpting, it empowers users to become central to their creative process. With Bose AR Frame, head movements are captured and transformed into real-time audio modulation via a MIDI framework to control music and visual. Developed on Unity, Sound Sculpt offers an immersive experience that blurs the lines between creator and creation, redefining artistic exploration.

Yiqi Zhao, Product Design Lead at Meta, specializes in AI-driven spatial computing across Meta Quest products, cross-screen platforms, creation tools and wearables. Her team has delivered human-centric innovations, including the Meta Quest headsets and Horizon Ecosystem. With a research background at Harvard and MIT Media Lab, Yiqi began her 3D journey in brain-computer interfaces (EEG) and wearable AI. Previously, she led Unity’s platform initiatives, including the visionOS partnership for Apple Vision Pro. She also made her mark in the gaming sector by shipping Destiny 2. Additionally, she l