“Walk on the Sun”: an interactive image sonification exhibit [Book Review]

AI and Society 27 (2):303-305 (2012)
Abstract
“Walk on the Sun” is an interactive experience of image as music. As explorers move across images that are data projected onto the floor, their movements are visually tracked and used to select pixels in the images which they immediately hear as musical pitches played by various instruments. The sonification design maps color to one of 9 instruments, brightness to one of 50 pitches, and location in the image to panning position, creating 57,600 differentiable musical events. This high resolution and interactive auditory presentation of pixel data enables the blind to explore images of the Sun from the STEREO space mission, nebula and galactic images from Hubble, as well as art masterpieces. Specifically, the blind can hear when hot spots cross the center of the Sun or the solar winds and corona are changing by sonifying virtual geometric structures, such as lines and circles, to create chords of music reflecting the changing content of the selected pixels within that structure as images are played as movies. Originally funded by a NASA/STSCI Ideas grant, the exhibit has toured to more than 12 cities in the US, visiting blind and science centers in the process and receiving enthusiastic response throughout. Plans for additional work furthering NASA wide image sonification standards are in process
Keywords Image sonification  Movement sonification  NASA  STEREO  Interaction design  Blind
Categories (categorize this paper)
Options
 Save to my reading list
Follow the author(s)
My bibliography
Export citation
Find it on Scholar
Edit this record
Mark as duplicate
Revision history Request removal from index
 
Download options
PhilPapers Archive


Upload a copy of this paper     Check publisher's policy on self-archival     Papers currently archived: 9,351
External links
  • Through your library Configure
    References found in this work BETA

    No references found.

    Citations of this work BETA

    No citations found.

    Similar books and articles
    Mohan Matthen (forthcoming). Image Content. In Berit Brogaard (ed.), Does Perception Have Content? Oxford University Press.
    Patricia Pisters (2011). Flashforward: The Future is Now. Deleuze Studies 5 (supplement):98-115.
    Jay L. Garfield (2012). Sellarsian Synopsis: Integrating the Images. Humana.Mente - Journal of Philosophical Studies 21.
    David Hodgson (2012). Identifying and Reconciling Two Images of “Man”. Humana.Mente - Journal of Philosophical Studies 21.
    Analytics

    Monthly downloads

    Added to index

    2011-09-16

    Total downloads

    6 ( #162,690 of 1,088,371 )

    Recent downloads (6 months)

    0

    How can I increase my downloads?

    My notes
    Sign in to use this feature


    Discussion
    Start a new thread
    Order:
    There  are no threads in this forum
    Nothing in this forum yet.