“Walk on the Sun”: an interactive image sonification exhibit [Book Review]

AI and Society 27 (2):303-305 (2012)
Abstract
“Walk on the Sun” is an interactive experience of image as music. As explorers move across images that are data projected onto the floor, their movements are visually tracked and used to select pixels in the images which they immediately hear as musical pitches played by various instruments. The sonification design maps color to one of 9 instruments, brightness to one of 50 pitches, and location in the image to panning position, creating 57,600 differentiable musical events. This high resolution and interactive auditory presentation of pixel data enables the blind to explore images of the Sun from the STEREO space mission, nebula and galactic images from Hubble, as well as art masterpieces. Specifically, the blind can hear when hot spots cross the center of the Sun or the solar winds and corona are changing by sonifying virtual geometric structures, such as lines and circles, to create chords of music reflecting the changing content of the selected pixels within that structure as images are played as movies. Originally funded by a NASA/STSCI Ideas grant, the exhibit has toured to more than 12 cities in the US, visiting blind and science centers in the process and receiving enthusiastic response throughout. Plans for additional work furthering NASA wide image sonification standards are in process
Keywords Image sonification  Movement sonification  NASA  STEREO  Interaction design  Blind
Categories (categorize this paper)
DOI 10.1007/s00146-011-0355-1
Options
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

Our Archive


Upload a copy of this paper     Check publisher's policy     Papers currently archived: 35,445
Through your library

References found in this work BETA

No references found.

Add more references

Citations of this work BETA

No citations found.

Add more citations

Similar books and articles

Image Content.Mohan Matthen - 2014 - In Berit Brogaard (ed.), Does Perception Have Content? Oxford University Press. pp. 265-290.
Flashforward: The Future is Now.Patricia Pisters - 2011 - Deleuze and Guatarri Studies 5 (Suppl):98-115.
Sellarsian Synopsis: Integrating the Images.Jay L. Garfield - 2012 - Humana.Mente - Journal of Philosophical Studies 21.
Aesthetic Strategies in Sonification.Florian Grond & Thomas Hermann - 2012 - AI and Society 27 (2):213-222.
Identifying and Reconciling Two Images of “Man”.David Hodgson - 2012 - Humana.Mente - Journal of Philosophical Studies 21.

Analytics

Added to PP index
2011-09-16

Total downloads
59 ( #108,411 of 2,285,003 )

Recent downloads (6 months)
3 ( #163,003 of 2,285,003 )

How can I increase my downloads?

Monthly downloads

My notes

Sign in to use this feature