Abstract
Sound can be listened to in various ways and with different intentions. Multiple factors influence how and what we perceive when listening to sound. Sonification, the acoustic representation of data, is in essence just sound. It functions as sonification only if we make sure to listen attentively in order to access the abstract information it contains. This is difficult to accomplish since sound always calls the listener’s attention to concrete—whether natural or musical—points of references. Important aspects determining how we listen to sonification are discussed in this paper: elicited sounds, repeated sounds, conceptual sounds, technologically mediated sounds, melodic sounds, familiar sounds, multimodal sounds and vocal sounds. We discuss how these aspects help the listener engage with the sound, but also how they can become points of reference in and of themselves. The various sonic qualities employed in sonification can potentially open but also risk closing doors to the accessibility and perceptibility of the sonified data.
Similar content being viewed by others
Notes
Translation from Grond and Schubert-Minski (2009): I would also like to consult the ear on this, though in such a way that the intellect articulates what the ear would naturally have to say.
Translation by the author: the telephone is an instrument of exquisite sensitivity. This fact led me to compare it with the nerve, which was considered to be the most sensitive reactant for electricity since the famous experiments of Galvani.
Translation by the author The recently demonstrated capacity of the telephone, to indicate the negative oscillations of the muscle current, motivated me to verify if the telephone could possibly serve to indicate the galvanic response of the excited nerve.
Indexicality in sonification has also been discussed by Vickers and Hogg (2006).
References
Baier G, Hermann T (2008) Temporal perspective from auditory perception. In: Vrobel S, Rössler OE, Marks-Tarlow T (eds) Simultaneity: temporal structures and observer perspectives, Chap. 21. World Scientific, Singapore, pp 348–363
Beller H (2011) Between the poles of mickey mousing and counterpoint. In: Daniels D, Naumann S (eds) Audiovisuology 2 essays. pp 102–119 Walther König, Köln
Bonner F, Devleschoward A (1995) AAEM minimonograph #45: the early development of electromyography. Muscle Nerve 18:825–833
Bovermann T (2009) Tangible auditory interfaces: combining auditory displays and tangible interfaces. PhD thesis, Faculty of Technology, Bielefeld University
Cassidy RJ, Berger J, Lee K, Maggioni M, Coifman RR (2004) Auditory display of hyperspectral colon tissue images using vocal synthesis models. In: Barrass S, Vickers P (eds) Proceedings of the 10th international conference on auditory display (ICAD2004), Sydney, Australia, http://www.icad.org/Proceedings/2004/CassidyBerger2004.pdf
Chion M (2008) Le phrase audio visuelle/die audiovisuelle phrasierung. In: Meyer PM (eds) Acoustic turn. Wilhelm Fink Verlag, München
d’Arsonval JA (1878) Telephone employe comme galvanoscope. Comptes rendus hebdomadaires des seances de l’Academie des sciences 86, Paris, pp 832–833
de Campo A (2007) Toward a data sonification design space map. In: Scavone GP (ed) Proceedings of the 13th international conference on auditory display, Schulich School of Music, McGill University, Schulich School of Music, McGill University, Montreal, Canada, pp 342–347, http://www.icad.org/Proceedings/2007/deCampo2007.pdf
Dolar M (2006) A voice and nothing more. MIT Press, Cambridge, MA
Dombois F (2002) Auditory seismology on free oscillations, focal mechanisms, explosions and synthetic seismograms. In: Nakatsu R, Kawahara H (eds) proceedings of the 8th international conference on auditory display, advanced telecommunications research institute (ATR), Kyoto, Japan, ICAD, Kyoto, Japan, http://www.icad.org/Proceedings/2002/Dombois2002.pdf
Dombois F (2008) Sonification, ein plädoyer, dem naturwissenschaftlichen verfahren eine kulturhistorische einschätzung zukommen zu lassen. In: Meyer PM (eds) Acoustic turn. Wilhelm Fink Verlag, München
Drake S (1980) Galileo. Oxford University Press, New York
Flückiger B (2001) Sound design die virtuelle Klangwelt des films. Schüren, Marburg
Garcia-Ruiz M, Gutierrez-Pulido J (2006) An overview of auditory display to assist comprehension of molecular information. Interact Comput 18(4):853–868
Gena P, Strom C (1995) Musical synthesis of DNA sequences. In: XI Colloquio di Informatica Musicale, Univeristà di Bologna, pp 203–204
Grond F, Schubert-Minski T (2009) Sonification, scientific method and artistic practice. In: Daniels D, Naumann S (eds) Audiovisuology compendium, Verlag der Buchhandlung Walter König, Köln, vol 1, pp 285–295, http://beta.see-this-sound.at/kompendium/abstract/70
Guttman S, Gilroy LA, Blake R (2005) Hearing what the eyes see. Psychol Sci 16(3):228–235
Hermann T (2002) Sonification for exploratory data analysis. PhD thesis, Bielefeld University, Bielefeld, Germany
Hermann T, Hunt A (2005) An introduction to interactive sonification (guest editors’ introduction). IEEE MultiMed 12(2):20–24
Hermann T, Ritter H (2004) Sound and meaning in auditory data display. Proceedings of the IEEE (special issue on engineering and music–supervisory control and auditory communication) 92(4):730–741
Hermann T, Baier G, Stephani U, Ritter H (2006) Vocal sonification of pathologic EEG features. In: Stockman T (ed) Proceedings of the 12th international conference on auditory display. International Community for Auditory Display (ICAD), Department of Computer Science, Queen Mary, University of London UK, London, UK, pp 158–163
Hofstadter DR (1980) Gödel, escher, bach, an eternal golden braid. Vintage Books, New York
Kepler J (1967) Weltharmonik. Max Caspar, Munich
Kramer G (1994) An introduction to auditory display. In: Kramer G (eds) In auditory display. pp 1–79 Addison-Wesley, Boston, MA
Licht A (2007) Sound art, beyond music, between categories. Rizzoli International Publications, Inc., New York, NY
McGurk H, MacDonald J (1976) Hearing lips and seeing voices. Nat Biotechnol 264:746–748
Rilke RM (1919) Ur-Geräusch, soglio, am Tage Mariae Himmelfahrt 1919
Vickers P (2005) Ars informatica-ars electronica: improving sonification aesthetics. In: HCI2005: workshop on understanding & designing for aesthetic experience
Vickers P, Hogg B (2006) Sonification abstraite/sonification concrète: an ‘æsthetic perspective space’ for classifying auditory displays in the ars musica domain. In: Proceedings of the 12th international conference on auditory display, London, UK, 20–23 June 2006
Walker BN, Nance A, Lindsay J (2006) Spearcons: speech-based earcons improve navigation performance in auditory menus. In: Proceedings of the international conference on auditory display (ICAD 2006), London, pp 63–68
Walton J (1952) The electromyogram in myopathy: analysis with the audio-frequency spectrometer. J Neurol Neurosurg Psychiatry 15:219–226
Wedenskii N (1883) Die telephonischen Wirkungen des erregten Nerven. Centralblatt für die medicinischen Wissenschaften 26:465–468
Williamson J, Smith RM, Hughes S (2007) Shoogle: excitatory multimodal interaction on mobile devices. In: CHI 2007 Proceedings. Shake, Rattle & Roll: New Forms of Input & Output, San Jose, CA, USA
Worrall D (2009) Sonification and information-concepts, instruments and techniques. PhD thesis, University of Canberra
Acknowledgements
Some historic aspects mentioned in this article have been published by the first author together with Theresa Schubert-Minski in the book see this sound Grond and Schubert-Minski (2009). The authors want to acknowledge further fruitful discussions with the participants of the Science by Ear symposium February 2010 in Graz. Finally, these thoughts were evaluated and compiled after integrating the important feedback from the sonification symposium March 2010 in Aix-en-Provence.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Grond, F., Hermann, T. Aesthetic strategies in sonification. AI & Soc 27, 213–222 (2012). https://doi.org/10.1007/s00146-011-0341-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00146-011-0341-7