“Walk on the Sun”: an interactive image sonification exhibit [Book Review]

AI and Society 27 (2):303-305 (2012)
Abstract
“Walk on the Sun” is an interactive experience of image as music. As explorers move across images that are data projected onto the floor, their movements are visually tracked and used to select pixels in the images which they immediately hear as musical pitches played by various instruments. The sonification design maps color to one of 9 instruments, brightness to one of 50 pitches, and location in the image to panning position, creating 57,600 differentiable musical events. This high resolution and interactive auditory presentation of pixel data enables the blind to explore images of the Sun from the STEREO space mission, nebula and galactic images from Hubble, as well as art masterpieces. Specifically, the blind can hear when hot spots cross the center of the Sun or the solar winds and corona are changing by sonifying virtual geometric structures, such as lines and circles, to create chords of music reflecting the changing content of the selected pixels within that structure as images are played as movies. Originally funded by a NASA/STSCI Ideas grant, the exhibit has toured to more than 12 cities in the US, visiting blind and science centers in the process and receiving enthusiastic response throughout. Plans for additional work furthering NASA wide image sonification standards are in process
Keywords Image sonification  Movement sonification  NASA  STEREO  Interaction design  Blind
Categories (categorize this paper)
DOI 10.1007/s00146-011-0355-1
Options
 Save to my reading list
Follow the author(s)
Edit this record
My bibliography
Export citation
Find it on Scholar
Mark as duplicate
Request removal from index
Revision history
Download options
Our Archive


Upload a copy of this paper     Check publisher's policy     Papers currently archived: 30,813
Through your library
References found in this work BETA

No references found.

Add more references

Citations of this work BETA

No citations found.

Add more citations

Similar books and articles
Image Content.Mohan Matthen - 2014 - In Berit Brogaard (ed.), Does Perception Have Content? Oxford University Press. pp. 265-290.
Flashforward: The Future is Now.Patricia Pisters - 2011 - Deleuze Studies 5 (Suppl):98-115.
Sellarsian Synopsis: Integrating the Images.Jay L. Garfield - 2012 - Humana.Mente - Journal of Philosophical Studies 21.
Aesthetic Strategies in Sonification.Florian Grond & Thomas Hermann - 2012 - AI and Society 27 (2):213-222.
Identifying and Reconciling Two Images of “Man”.David Hodgson - 2012 - Humana.Mente - Journal of Philosophical Studies 21.
Added to PP index
2011-09-16

Total downloads
25 ( #210,314 of 2,202,700 )

Recent downloads (6 months)
1 ( #301,722 of 2,202,700 )

How can I increase my downloads?

Monthly downloads
My notes
Sign in to use this feature