SoundSight Icon

SoundSight

Dynamic soundscapes to navigate the visual world

# Download

Download on the App Store

# About

SoundSight allows you to experience the world through sound by converting depth and color information into real-time soundscapes. Find your way around using sound to guide you, listen to the nuances of color through blended audio, and hear the position and movement of silent objects.

  • Find your way around using sound to guide you
  • Listen to the nuances of color through blended audio
  • Hear the position and movement of silent objects
  • Sonify distances on iPhone with dual cams or the Structure Sensor
  • Choose the sounds you want - tones, instruments, even music!

# Meet the Team

SoundSight has been built by a team of scientists interested in how vision and hearing are linked in the brain and how this can be used to help the visually-impaired. The aim of the project has been to develop an aesthetically pleasing way of presenting important visual information such as depth and color through a rich soundscape for the end user to listen to – these sounds can be anything the user wants, tones, vocals, instruments, rainfall, and even musical tracks! From this, users can use these sounds to understand the location, shape, color, and movement of objects around them.

Previous research has shown that this kind of technology can enable access to a wide range of life-enhancing experiences for persons with visual impairments. However, previous technology is often criticized for being impractical, unresponsive, and unpleasant to listen to. Here, the SoundSight project seeks to address these concerns through designing the device from the ground-up to provide practical information like distance through high-quality sounds that react to changes in the environment in real-time.

The team consists of Professor Jamie Ward (Project Leader, Professor of Cognitive Neuroscience, University of Sussex, UK) and Dr Giles Hamilton-Fletcher (Designer, Postdoctoral Researcher, Langone Health, New York University, USA) who provided the scientific rationale and design to ensure these goals could be met, with Dr James Alvarez (Developer, Senior Web Developer, University of Sussex, UK) developing the app for iOS.

# Support

If you encounter any issues with the app or have any questions, please reach out to me at james@jamesalvarez.co.uk. I'm happy to help and appreciate suggestions and feedback.

# Privacy Policy

Online privacy is important to me. The SoundSight app does not collect any personal data from users. We do not track, store, or share any information about your usage of the app.

If you choose to contact us via email for support or feedback, your email address and any other information you provide will only be used to respond to your inquiry. We will not share your contact details with any third parties.