The vOICe is an Augmented Reality app for Android that helps users ‘see’ with their ears by mapping a live camera feed with a soundscape. This offers an augmented reality for the visually impaired, using sensory substitution and computer vision. Also included is an audio color identifier, talking compass, face detector and GPS.
How It Works
The vOICe uses pitch for height and loudness for brightness in one-second left to right scans of any view: a rising bright line sounds as a rising tone, a bright spot as a beep, a bright filled rectangle as a noise burst, a vertical grid as a rhythm. Best used with stereo headphones for the most immersive experience and most detailed auditory resolution.