Graduate studies at Western
AI and Society 27 (2):303-305 (2012)
|Abstract||“Walk on the Sun” is an interactive experience of image as music. As explorers move across images that are data projected onto the floor, their movements are visually tracked and used to select pixels in the images which they immediately hear as musical pitches played by various instruments. The sonification design maps color to one of 9 instruments, brightness to one of 50 pitches, and location in the image to panning position, creating 57,600 differentiable musical events. This high resolution and interactive auditory presentation of pixel data enables the blind to explore images of the Sun from the STEREO space mission, nebula and galactic images from Hubble, as well as art masterpieces. Specifically, the blind can hear when hot spots cross the center of the Sun or the solar winds and corona are changing by sonifying virtual geometric structures, such as lines and circles, to create chords of music reflecting the changing content of the selected pixels within that structure as images are played as movies. Originally funded by a NASA/STSCI Ideas grant, the exhibit has toured to more than 12 cities in the US, visiting blind and science centers in the process and receiving enthusiastic response throughout. Plans for additional work furthering NASA wide image sonification standards are in process|
|Keywords||Image sonification Movement sonification NASA STEREO Interaction design Blind|
|Categories||categorize this paper)|
|Through your library||Configure|
Similar books and articles
Peter Gena (2012). Apropos Sonification: A Broad View of Data as Music and Sound. [REVIEW] AI and Society 27 (2):197-205.
Bogdan Nita (2012). Intentional Image and Transcendental Image in the Work of Art. Image 2 (2321):231.
Mohan Matthen (forthcoming). Image Content. In Berit Brogaard (ed.), Does Perception Have Content? Oxford University Press.
Patricia Pisters (2011). Flashforward: The Future is Now. Deleuze Studies 5 (supplement):98-115.
Anthony Uhlmann (2006). Samuel Beckett and the Philosophical Image. Cambridge University Press.
Jay L. Garfield (2012). Sellarsian Synopsis: Integrating the Images. Humana.Mente - Journal of Philosophical Studies 21.
Gunnar Karlsson (1996). The Experience of Spatiality for Congenitally Blind People: A Phenomenological-Psychological Study. [REVIEW] Human Studies 19 (3):303 - 330.
Florian Grond & Thomas Hermann (2012). Aesthetic Strategies in Sonification. AI and Society 27 (2):213-222.
Jennifer Gosetti-Ferencei (2012). The World and Image of Poetic Language: Heidegger and Blanchot. [REVIEW] Continental Philosophy Review 45 (2):189-212.
David Hodgson (2012). Identifying and Reconciling Two Images of “Man”. Humana.Mente - Journal of Philosophical Studies 21.
Scot Gresham-Lancaster (2012). Relationships of Sonification to Music and Sound Art. AI and Society 27 (2):207-212.
Adrian Ratkic (2013). Images of Reflection: On the Meanings of the Word Reflection in Different Learning Contexts. [REVIEW] AI and Society 28 (3):339-349.
Added to index2011-09-16
Total downloads6 ( #154,860 of 739,345 )
Recent downloads (6 months)0
How can I increase my downloads?