Anna Esposito Antonietta M. Esposito Alessandro Vinciarelli Rüdiger Hoffmann Vincent C. Müller (Eds.) Cognitive Behavioural Systems COST 2102 International Training School Dresden, Germany, February 21-26, 2011 Revised Selected Papers 13 http://www.sophia.de Volume Editors Anna Esposito Seconda Università degli Studi di Napoli IIASS, Napoli, Italy E-mail: iiass.annaesp@tin.it Antonietta M. Esposito Istituto Nazionale di Geofisica e Vulcanologia Sezione di Napoli Osservatorio Vesuviano, Napoli, Italy E-mail: aesposito@ov.ingv.it Alessandro Vinciarelli University of Glasgow, School of Computing Science, Glasgow, UK E-mail: alessandro.vinciarelli@glasgow.ac.uk Rüdiger Hoffmann Technische Universität Dresden Institut für Akustik und Sprachkommunikation, Dresden, Germany E-mail: ruediger.hoffmann@ias.et.tu-dresden.de Vincent C. Müller Anatolia College/ACT Department of Humanities and Social Sciences, Pylaia, Greece E-mail: vmueller@act.edu ISSN 0302-9743 e-ISSN 1611-3349 ISBN 978-3-642-34583-8 e-ISBN 978-3-642-34584-5 DOI 10.1007/978-3-642-34584-5 Springer Heidelberg Dordrecht London New York Library of Congress Control Number: 2012950318 CR Subject Classification (1998): H.1.2, H.5.5, I.2.7, I.2.9-10, H.5.1-3, H.3.1, H.3.4, I.4.8, I.5.4, G.3, J.4, J.5 LNCS Sublibrary: SL 3 – Information Systems and Application, incl. Internet/Web and HCI © Springer-Verlag Berlin Heidelberg 2012 This work is subject to copyright. All rights are reserved, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, re-use of illustrations, recitation, broadcasting, reproduction on microfilms or in any other way, and storage in data banks. Duplication of this publication or parts thereof is permitted only under the provisions of the German Copyright Law of September 9, 1965, in its current version, and permission for use must always be obtained from Springer. Violations are liable to prosecution under the German Copyright Law. The use of general descriptive names, registered names, trademarks, etc. in this publication does not imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use. Typesetting: Camera-ready by author, data conversion by Scientific Publishing Services, Chennai, India Printed on acid-free paper Springer is part of Springer Science+Business Media (www.springer.com) This book is dedicated to endings and to what is left behind Preface This volume brings together the advanced research results obtained by the European COST Action 2102 "Cross Modal Analysis of Verbal and Nonverbal Communication", primarily discussed at the EUCogII-SSPNet-COST2102 International Training School on "Cognitive Behavioural Systems", held in Dresden, Germany, February 21–26 2011 (www.ias.et.tu-dresden.de/ias/cost-2102/). The school was jointly sponsored by the European Cooperation in Science and Technology (COST, www.cost.eu) in the domain of Information and Communication Technologies (ICT) for disseminating the advances of the research activities developed within the COST Action 2102: "Cross-Modal Analysis of Verbal and Nonverbal Communication" (cost2102.cs.stir.ac.uk); by the European Network of Excellence on Social Signal Processing (SSPNet, www.sspnet.eu) and by the 2nd European Network for the Advancement of Artificial Cognitive Systems, Interaction and Robotics (EUCogII, www.eucognition.org/). The main focus of the school was on Cognitive Behavioural Systems. In previous meetings, EUCogII-SSPNet-COST2102 focused on the importance of data processing for gaining enactive knowledge, as well as on the discovery of new processing possibilities that account for new data analysis approaches, coordination of the data flow through synchronization and temporal organization and optimization of the extracted features. The next step will be to discover more natural and intuitive approaches for modelling and uncovering the wealth of information conveyed by humans during interaction for developing realistic and socially believable agents. This moves the research focus to cognitive systems and models of cognitive processes. It has been shown that cognitive processes – such as inference, categorization and memory – are not independent of their physical instantiations. Individual choices, perception and actions emerge and are dynamically a!ected/enhanced by the interaction between sensory-motor systems and the inhabited environment (including the organizational, cultural and physical context). This interplay carries up instantiations of cognitive behavioural systems. How can these aspects be modelled in order to bring machine intelligence close to human expectations? Are existing paradigms su"cient or is more research needed on signals and data? How trustful, credible and satisfactory will emotionally-coloured multimodal systems appear to the end user? How will their physical instantiation and appearance a!ect the human-machine interplay? The papers accepted in this volume were peer reviewed and include original contributions from early stage researchers. The volume presents new and original research results in the field of human-machine interaction inspired by cognitive behavioural human-human interaction features. The themes covered are cognitive and computational social information processing, emotional and socially believable Human-Computer Interaction (HCI) systems, behavioural and VIII Preface contextual analysis of interactions, embodiment, perception, linguistics, semantics and sentiment analysis in dialogues and interactions, and algorithmic and computational issues for the automatic recognition and synthesis of emotional states. The contents have been divided into two scientific sections according to a rough thematic classification. The first section, "Computational Issues in Cognitive Systems", deals with models, algorithms, and heuristic strategies for the recognition and synthesis of behavioural data. The second section, "Behavioural Issues in Cognitive Systems", presents original studies that provide theoretical and behavioural analyses on linguistic and paralinguistic expressions, actions, body movements and activities in human interaction. The papers included in this book benefited from the lively interactions between the many participants of the successful meeting in Dresden. Over 100 senior and junior researchers gathered for the event. The editors would like to thank the Management Board of the SSPNet and the ESF COSTICT Programme for their support in the realization of the school and the publication of this volume. Acknowledgements go in particular to the COST Science O"cers, Giseppe Lugano, Matteo Razzanelli, and Aranzazu Sanchez, and the COST 2102 rapporteur, Guntar Balodis, for their constant help, guidance and encouragement. The event owes its success to more individuals than can be named, but notably the members of the Dresden Local Steering Committee, who actively operated for the success of the event. Special appreciation goes to the President of the International Institute for Advanced Scientific Studies (IIASS), and to the Dean and the Director of the Faculty and the Department of Psychology at the Second University of Naples for making available people and resources for editing this volume. The editors are deeply indebted to the contributors for making this book a scientifically stimulating compilation of new and original ideas and to the members of the COST 2102 International Scientific Committee for their rigorous and invaluable scientific revisions, dedication, and priceless selection process. July 2012 Anna Esposito Antonietta M. Esposito Alessandro Vinciarelli Rüdiger Ho!mann Vincent C. Müller Organization International Steering Committee Anna Esposito Second University of Naples and IIASS, Italy Marcos Faundez-Zanuy University of Mataro, Barcelona, Spain Rüdiger Ho!mann Technische Universtät Dresden (TUD), Germany Amir Hussain University of Stirling, UK Vincent Müller Anatolia College, Pylaia, Greece Alessandro Vinciarelli University of Glasgow, UK Local Steering Committee Lutz-Michael Alisch TUD, Theory of Educational Sciences and Research Methods Rainer Groh TUD, Media Design Rüdiger Ho!mann TUD, System Theory and Speech Technology Klaus Kabitzsch TUD, Technical Information Management Systems Klaus Meissner TUD, Multimedia Technology Boris Velichovsky TUD, Engineering Psychology and Cognitive Ergonomics Gerhard Weber TUD, Human-Computer Interaction COST 2102 International Scientific Committee Alberto Abad INESC-ID Lisboa, Portugal Samer Al Moubayed Royal Institute of Technology, Sweden Uwe Altmann Friedrich-Schiller-University Jena, Germany Sigrún Maŕıa Ammendrup School of Computer Science, Reykjavik, Iceland Hicham Atassi Brno University of Technology, Czech Republic Nikos Avouris University of Patras, Greece Martin Bachwerk Trinity College, Dublin, Ireland Ivana Baldasarre Second University of Naples, Italy Sandra Baldassarri Zaragoza University, Spain Ruth Bahr University of South Florida, USA Gérard Bailly GIPSA-lab, Grenoble, France Marena Balinova University of Applied Sciences, Vienna, Austria Marian Bartlett University of California, San Diego, USA X Organization Dominik Bauer RWTH Aachen University, Germany Sieghard Beller Universität Freiburg, Germany Štefan Beňuš Constantine the Philosopher University, Nitra, Slovak Republic Niels Ole Bernsen University of Southern Denmark, Denmark Jonas Beskow Royal Institute of Technology, Sweden Peter Birkholz RWTH Aachen University, Germany Horst Bishof Technical University Graz, Austria Jean-Francois Bonastre Université d'Avignon, France Marek Boháč Technical University of Liberec, Czech Republic Elif Bozkurt Koç University, Istanbul, Turkey Nikolaos Bourbakis ITRI, Wright State University, Dayton, USA Maja Bratanić University of Zagreb, Croatia Antonio Calabrese Istituto di Cibernetica – CNR, Naples, Italy Erik Cambria University of Stirling, UK Paola Campadelli Università di Milano, Italy Nick Campbell University of Dublin, Ireland Valentın Cardeñoso Payo Universidad de Valladolid, Spain Nicoletta Caramelli Università di Bologna, Italy Antonio Castro-Fonseca Universidade de Coimbra, Portugal Aleksandra Cerekovic Faculty of Electrical Engineering , Croatia Peter Cerva Technical University of Liberec, Czech Republic Josef Chaloupka Technical University of Liberec, Czech Republic Mohamed Chetouani Université Pierre et Marie Curie, France Gérard Chollet CNRS URA-820, ENST, France Simone Cifani Università Politecnica delle Marche, Italy Muzeyyen Ciyiltepe Gulhane Askeri Tip Academisi, Ankara, Turkey Anton Cizmar Technical University of Košice, Slovakia David Cohen Université Pierre et Marie Curie, Paris, France Nicholas Costen Manchester Metropolitan University, UK Francesca D'Olimpio Second University of Naples, Italy Vlado Delić University of Novi Sad, Serbia Céline De Looze Trinity College, Dublin 2, Ireland Francesca D'Errico Università di Roma 3, Italy Angiola Di Conza Second University of Naples, Italy Giuseppe Di Maio Second University of Naples, Italy Marion Dohen ICP, Grenoble, France Thierry Dutoit Faculté Polytechnique de Mons, Belgium Laila Dybkjaer University of Southern Denmark, Denmark Jens Edlund Royal Institute of Technology, Sweden Matthias Eichner Technische Universität Dresden, Germany Organization XI Aly El-Bahrawy Ain Shams University, Cairo, Egypt Ciğdem Eroğlu Erdem Bahçeşehir University, Istanbul, Turkey Engin Erzin Koç University, Istanbul, Turkey Anna Esposito Second University of Naples, Italy Antonietta M. Esposito Osservatorio Vesuviano Napoli, Italy Joan Fàbregas Peinado Escola Universitaria de Mataro, Spain Sascha Fagel Technische Universität Berlin, Germany Nikos Fakotakis University of Patras, Greece Manuela Farinosi University of Udine, Italy Marcos Faúndez-Zanuy Universidad Politécnica de Cataluña, Spain Tibor Fegyó Budapest University of Technology and Economics, Hungary Fabrizio Ferrara University of Naples "Federico II", Italy Dilek Fidan Ankara University, Turkey Leopoldina Fortunati Università di Udine, Italy Todor Ganchev University of Patras, Greece Carmen Garćıa-Mateo University of Vigo, Spain Vittorio Girotto Università IUAV di Venezia, Italy Augusto Gnisci Second University of Naples, Italy Milan Gnjatović University of Novi Sad, Serbia Bjorn Granstrom Royal Institute of Technology, Sweden Marco Grassi Università Politecnica delle Marche, Italy Maurice Grinberg New Bulgarian University, Bulgaria Jorge Gurlekian LIS CONICET, Buenos Aires, Argentina Mohand-Said Hacid Université Claude Bernard Lyon 1, France Jaakko Hakulinen University of Tampere, Finland Ioannis Hatzilygeroudis University of Patras, Greece Immaculada Hernaez University of the Basque Country, Spain Javier Hernando Technical University of Catalonia, Spain Wolfgang Hess Universität Bonn, Germany Dirk Heylen University of Twente, The Netherlands Daniel Hládek Technical University of Košice, Slovak Republic Rüdiger Ho!mann Technische Universität Dresden, Germany Hendri Hondorp University of Twente, The Netherlands David House Royal Institute of Technology, Sweden Evgenia Hristova New Bulgarian University, Sofia, Bulgaria Stephan Hübler Dresden University of Technology, Gremany Isabelle Hupont Aragon Institute of Technology, Zaragoza, Spain Amir Hussain University of Stirling, UK Viktor Imre Budapest University of Technology and Economics, Hungary XII Organization Ewa Jarmolowicz Adam Mickiewicz University, Poznan, Poland Kristiina Jokinen University of Helsinki, Finland Jozef Juhár Technical University Košice, Slovak Republic Zdravko Kacic University of Maribor, Slovenia Bridget Kane Trinity College Dublin, Ireland Jim Kannampuzha RWTH Aachen University, Germany Maciej Karpinski Adam Mickiewicz University, Poznan, Poland Eric Keller Université de Lausanne, Switzerland Adam Kendon University of Pennsylvania, USA Stefan Kopp University of Bielefeld, Germany Jacques Koreman University of Science and Technology, Norway Theodoros Kostoulas University of Patras, Greece Maria Koutsombogera Inst. for Language and Speech Processing, Greece Robert Krauss Columbia University, New York, USA Bernd Kröger RWTH Aachen University, Germany Gernot Kubin Graz University of Technology, Austria Olga Kulyk University of Twente, The Netherlands Alida Labella Second University of Naples, Italy Emilian Lalev New Bulgarian University, Bulgaria Yiannis Laouris Cyprus Neuroscience and Technology Institute, Cyprus Anne-Maria Laukkanen University of Tampere, Finland Amélie Lelong GIPSA-lab, Grenoble, France Borge Lindberg Aalborg University, Denmark Saturnino Luz Trinity College Dublin, Ireland Wojciech Majewski Wroclaw University of Technology, Poland Pantelis Makris Neuroscience and Technology Institute, Cyprus Kenneth Manktelow University of Wolverhampton, UK Ra!aele Martone Second University of Naples, Italy Rytis Maskeliunas Kaunas University of Technology, Lithuania Dominic Massaro University of California, Santa Cruz, USA Olimpia Matarazzo Second University of Naples, Italy Christoph Mayer Technische Universität München, Germany David McNeill University of Chicago, USA Jǐŕı Mekyska Brno University of Technology, Czech Republic Nicola Melone Second University of Naples, Italy Katya Mihaylova University of National and World Economy, Sofia, Bulgaria Péter Mihajlik Budapest University of Technology and Economics, Hungary Michal Mirilovič Technical University of Košice, Slovak Republic Organization XIII Izidor Mlakar Roboti c.s. d.o.o, Maribor, Slovenia Helena Moniz INESC-ID, Lisboa, Portugal, Tamás Mozsolics Budapest University of Technology and Economics, Hungary Vincent C. Müller Anatolia College/ACT, Pylaia, Greece Peter Murphy University of Limerick, Limerick, Ireland Antonio Natale University of Salerno and IIASS, Italy Costanza Navarretta University of Copenhagen, Denmark Eva Navas Escuela Superior de Ingenieros, Bilbao, Spain Delroy Nelson University College London, UK Géza Németh University of Technology and Economics, Budapest, Hungary Friedrich Neubarth Austrian Research Inst. Artificial Intelligence, Austria Christiane Neuschaefer-Rube RWTH Aachen University, Germany Giovanna Nigro Second University of Naples, Italy Anton Nijholt Universiteit Twente, The Netherlands Jan Nouza Technical University of Liberec, Czech Republic Michele Nucci Università Politecnica delle Marche, Italy Catharine Oertel Trinity College Dublin, Ireland Stanislav Ondáš Technical University of Košice, Slovak Republic Rieks Op den Akker University of Twente , The Netherlands Karel Paleček Technical University of Liberec, Czech Republic Igor Pandzic Faculty of Electrical Engineering, Croatia Harris Papageorgiou Institute for Language and Speech Processing, Greece Kinga Papay University of Debrecen, Hungary Paolo Parmeggiani Università degli Studi di Udine, Italy Ana Pavia Spoken Language Systems Laboratory, Lisbon, Portugal Paolo Pedone Second University of Naples, Italy Tomislav Pejsa University of Zagreb, Croatia Catherine Pelachaud CNRS, Télécom ParisTech, France Bojan Petek University of Ljubljana, Slovenia Harmut R. Pfitzinger University of Munich, Germany Francesco Piazza Università degli Studi di Ancona, Italy Neda Pintaric University of Zagreb, Croatia Matúš Pleva Technical University of Košice, Slovak Republic Isabella Poggi Università di Roma 3, Italy Guy Politzer Université de Paris VIII, France Jan Prazak Technical University of Liberec, Czech Republic Ken Prepin Télécom ParisTech, France Jǐŕı Přibil Academy of Sciences, Czech Republic Anna Přibilová Slovak University of Technology, Slovak Republic XIV Organization Emanuele Principi Università Politecnica delle Marche, Italy Michael Pucher Telecommunications Research Center Vienna, Austria Jurate Puniene Kaunas University of Technology, Lithuania Ana Cristina Quelhas Instituto Superior de Psicologia Aplicada, Lisbon, Portugal Kari-Jouko Räihä University of Tampere, Finland Roxanne Raine University of Twente, The Netherlands Giuliana Ramella Istituto di Cibernetica – CNR, Naples, Italy Fabian Ramseyer University Hospital of Psychiatry, Bern, Switzerland José Rebelo Universidade de Coimbra, Portugal Peter Reichl FTW Telecommunications Research Center, Austria Luigi Maria Ricciardi Università di Napoli "Federico II", Italy Maria Teresa Riviello Second University of Naples and IIASS, Italy Matej Rojc University of Maribor, Slovenia Nicla Rossini Università del Piemonte Orientale, Italy Rudi Rotili Università Politecnica delle Marche, Italy Algimantas Rudzionis Kaunas University of Technology, Lithuania Vytautas Rudzionis Kaunas University of Technology, Lithuania Hugo L. Rufiner Universidad Nacional de Entre Rıos, Argentina Milan Rusko Slovak Academy of Sciences, Slovak Republic Zsófia Ruttkay Pazmany Peter Catholic University, Hungary Yoshinori Sagisaka Waseda University, Tokyo, Japan Bartolomeo Sapio Fondazione Ugo Bordoni, Rome, Italy Mauro Sarrica University of Padua, Italy Gellért Sárosi Budapest University of Technology and Economics, Hungary Gaetano Scarpetta University of Salerno and IIASS, Italy Silvia Scarpetta Salerno University, Italy Stefan Scherer Ulm University, Germany Ralph Schnitker Aachen University, Germany Jean Schoentgen Université Libre de Bruxelles, Belgium Björn Schuller Technische Universität München, Germany Milan Sečujski University of Novi Sad, Serbia Stefanie Shattuck-Hufnagel MIT, Research Laboratory of Electronics, USA Marcin Skowron Austrian Research Inst. for Art. Intelligence, Austria Jan Silovsky Technical University of Liberec, Czech Republic Zdenĕk Smékal Brno University of Technology, Czech Republic Stefano Squartini Università Politecnica delle Marche, Italy Piotr Staroniewicz Wroclaw University of Technology, Poland Ján Staš Technical University of Košice, Slovakia Vojtěch Stejskal Brno University of Technology, Czech Republic Organization XV Marian Stewart-Bartlett University of California, San Diego, USA Xiaofan Sun University of Twente, The Netherlands Jing Su Trinity College Dublin, Ireland Dávid Sztahó Budapest University of Technology and Economics, Hungary Jianhua Tao Chinese Academy of Sciences, P. R. China Balázs Tarján Budapest University of Technology and Economics, Hungary Jure F. Tasič University of Ljubljana, Slovenia Murat Tekalp Koc University, Istanbul, Turkey Kristinn Thórisson Reykjavık University, Iceland Isabel Trancoso Spoken Language Systems Laboratory, Portugal Luigi Trojano Second University of Naples, Italy Wolfgang Tschacher University of Bern, Switzerland Markku Turunen University of Tampere, Finland Henk Van den Heuvel Radboud University Nijmegen, The Netherlands Betsy van Dijk University of Twente, The Netherlands Giovanni Vecchiato Università "La Sapienza", Roma, Italy Leticia Vicente-Rasoamalala Alchi Prefectural Univesity, Japan Robert Vich Academy of Sciences, Czech Republic Klára Vicsi Budapest University, Hungary Hannes Högni Vilhjálmsson Reykjavık University, Iceland Jane Vincent University of Surrey, Guilford, UK Alessandro Vinciarelli University of Glasgow, UK Laura Vincze Università di Roma 3, Italy Carl Vogel Trinity College, Dublin, Ireland Jan Voĺın Charles University, Czech Republic Rosa Volpe Université de Perpignan, France Martin Vondra Academy of Sciences, Czech Republic Pascal Wagner-Egger Fribourg University, Switzerland Yorick Wilks University of She"eld, UK Matthias Wimmer Institute for Informatics, Munich, Germany Matthias Wolf Technische Universität Dresden, Germany Bencie Woll University College London, UK Bayya Yegnanarayana International Institute of Information Technology, India Vanda Lucia Zammuner University of Padua, Italy Jerneja Žganec Gros Alpineon, Development and Research, Slovenia Goranka Zoric Faculty of Electrical Engineering, Croatia XVI Organization Sponsors The following organizations sponsored and supported the International Conference ! European COST Action 2102 "Cross-Modal Analysis of Verbal and Nonverbal Communication" (cost2102.cs.stir.ac.uk) ESF Provide the COST O"ce through and EC contract COST is supported by the EU RTD Framework programme COSTthe acronym for European Cooperation in Science and Technologyis the oldest and widest European intergovernmental network for cooperation in research. Established by the Ministerial Conference in November 1971, COST is presently used by the scientific communities of 36 European countries to cooperate in common research projects supported by national funds. The funds provided by COST less than 1% of the total value of the projects support the COST cooperation networks (COST Actions) through which, with EUR 30 million per year, more than 30 000 European scientists are involved in research having a total value which exceeds EUR 2 billion per year. This is the financial worth of the European added value which COST achieves. A "bottom up approach" (the initiative of launching a COST Action comes from the European scientists themselves), "à la carte participation" (only countries interested in the Action participate), "equality of access" (participation is open also to the scientific communities of countries not belonging to the European Union) and "flexible structure" (easy implementation and light management of the research initiatives) are the main characteristics of COST. As precursor of advanced multidisciplinary research COST has a very important role for the realisation of the European Research Area (ERA) anticipating and complementing the activities of the Framework Programmes, constituting a "bridge" towards the scientific communities of emerging countries, increasing the mobility of researchers across Europe and fostering the establishment of "Networks of Excellence" in many key scientific domains such as: Biomedicine and Molecular Biosciences; Food and Agriculture; Forests, their Products and Services; Materials, Physical and Nanosciences; Chemistry and Molecular Sciences and Technologies; Earth System Science Organization XVII and Environmental Management; Information and Communication Technologies; Transport and Urban Development; Individuals, Societies Cultures and Health. It covers basic and more applied research and also addresses issues of pre-normative nature or of societal importance. Web: http://www.cost.eu ! SSPnet: European Network on Social Signal Processing, http://sspnet.eu/ The ability to understand and manage social signals of a person we are communicating with is the core of social intelligence. Social intelligence is a facet of human intelligence that has been argued to be indispensable and perhaps the most important for success in life. Although each one of us understands the importance of social signals in everyday life situations, and in spite of recent advances in machine analysis and synthesis of relevant behavioral cues like blinks, smiles, crossed arms, head nods, laughter, etc., the research e!orts in machine analysis and synthesis of human social signals like empathy, politeness, and (dis)agreement, are few and tentative. The main reasons for this are the absence of a research agenda and the lack of suitable resources for experimentation. The mission of the SSPNet is to create a su"cient momentum by integrating an existing large amount of knowledge and available resources in Social Signal Processing (SSP) research domains including cognitive modeling, machine understanding, and synthesizing social behavior, and so: • Enable the creation of the European and world research agenda in SSP; • Provide e"cient and e!ective access to SSP-relevant tools and data repositories to the research community within and beyond the SSPNet, and • Further develop complementary and multidisciplinary expertise necessary for pushing forward the cutting edge of the research in SSP. The collective SSPNet research e!ort is directed towards integration of existing SSP theories and technologies, and towards identification and exploration of potentials and limitations in SSP. More specifically, the framework of the SSPNet will revolve around two research foci selected for their primacy and significance: Human-Human Interaction (HHI) and Human-Computer Interaction (HCI). A particular scientific challenge that binds the SSPNet partners is the synergetic combination of human-human interaction models, and automated tools for human behavior sensing and synthesis, within socially-adept multimodal interfaces. XVIII Organization ! EUCogII: 2nd European Network for the Advancement of Artificial Cognitive Systems, Interaction and Robotics (http://www.eucognition.org/ ! School of Computing Science, University of Glaskow, Scotland, UK ! Department of Psychology, Second University of Naples, Caserta, Italy ! Technische Universität Dresden, Institut für Akustik und Sprachkommunikation, Dresden, Germany ! International Institute for Advanced Scientific Studies "E.R. Caianiello" IIASS, www.iiassvietri.it/ ! Società Italiana Reti Neuroniche, SIREN, www.associazionesiren.org/ ! Regione Campania and Provincia di Salerno, Italy Table of Contents Computational Issues in Cognitive Systems An Approach to Intelligent Signal Processing . . . . . . . . . . . . . . . . . . . . . . . . 1 Matthias Wol! and Rüdiger Ho!mann The Analysis of Eye Movements in the Context of Cognitive Technical Systems: Three Critical Issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 Sebastian Pannasch, Jens R. Helmert, Romy Müller, and Boris M. Velichkovsky Ten Recent Trends in Computational Paralinguistics . . . . . . . . . . . . . . . . . 35 Björn Schuller and Felix Weninger Conversational Speech Recognition in Non-stationary Reverberated Environments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50 Rudy Rotili, Emanuele Principi, Martin Wöllmer, Stefano Squartini, and Björn Schuller From Nonverbal Cues to Perception: Personality and Social Attractiveness . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 Alessandro Vinciarelli, Hugues Salamin, Anna Polychroniou, Gelareh Mohammadi, and Antonio Origlia Measuring Synchrony in Dialog Transcripts . . . . . . . . . . . . . . . . . . . . . . . . . 73 Carl Vogel and Lydia Behan A Companion Technology for Cognitive Technical Systems . . . . . . . . . . . . 89 Andreas Wendemuth and Susanne Biundo Semantic Dialogue Modeling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104 Günther Wirsching, Markus Huber, Christian Kölbl, Robert Lorenz, and Ronald Römer Furhat: A Back-Projected Human-Like Robot Head for Multiparty Human-Machine Interaction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114 Samer Al Moubayed, Jonas Beskow, Gabriel Skantze, and Björn Granström VISION as a Support to Cognitive Behavioural Systems . . . . . . . . . . . . . . 131 Luca Berardinelli, Dajana Cassioli, Antinisca Di Marco, Anna Esposito, Maria Teresa Riviello, and Catia Trubiani XX Table of Contents The Hourglass of Emotions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 144 Erik Cambria, Andrew Livingstone, and Amir Hussain A Naturalistic Database of Thermal Emotional Facial Expressions and E!ects of Induced Emotions on Memory . . . . . . . . . . . . . . . . . . . . . . . . . . . . 158 Anna Esposito, Vincenzo Capuano, Jiri Mekyska, and Marcos Faundez-Zanuy Prosody Modelling for TTS Systems Using Statistical Methods . . . . . . . . 174 Zdeněk Chaloupka and Petr Horák Modeling the E!ect of Motion at Encoding and Retrieval for Same and Other Race Face Recognition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 184 Hui Fang, Nicholas Costen, Natalie Butcher, and Karen Lander An Audiovisual Feedback System for Pronunciation Tutoring – Mandarin Chinese Learners of German . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 191 Hongwei Ding, Oliver Jokisch, and Rüdiger Ho!mann Si.Co.D.: A Computer Manual for Coding Questions . . . . . . . . . . . . . . . . . . 198 Augusto Gnisci, Enza Graziano, and Angiola Di Conza Rule-Based Morphological Tagger for an Inflectional Language . . . . . . . . . 208 Daniel Hládek, Ján Staš, and Jozef Juhár Czech Emotional Prosody in the Mirror of Speech Synthesis . . . . . . . . . . . 216 Jana Vlčková-Mejvaldová and Petr Horák Pre-attention Cues for Person Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225 Karel Paleček, David Gerónimo, and Frédéric Lerasle Comparison of Complementary Spectral Features of Emotional Speech for German, Czech, and Slovak . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 236 Jǐŕı Přibil and Anna Přibilová Form-Oriented Annotation for Building a Functionally Independent Dictionary of Synthetic Movement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 251 Izidor Mlakar, Zdravko Kačič, and Matej Rojc A Cortical Approach Based on Cascaded Bidirectional Hidden Markov Models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 266 Ronald Römer Modeling Users' Mood State to Improve Human-Machine-Interaction . . . 273 Ingo Siegert, R. Böck, and Andreas Wendemuth Pitch Synchronous Transform Warping in Voice Conversion . . . . . . . . . . . 280 Robert Vıch and Martin Vondra Table of Contents XXI ATMap: Annotated Tactile Maps for the Visually Impaired . . . . . . . . . . . 290 Limin Zeng and Gerhard Weber Behavioural Issues in Cognitive Systems From Embodied and Extended Mind to No Mind . . . . . . . . . . . . . . . . . . . . 299 Vincent C. Müller E!ects of Experience, Training and Expertise on Multisensory Perception: Investigating the Link between Brain and Behavior . . . . . . . . 304 Scott A. Love, Frank E. Pollick, and Karin Petrini Nonverbal Communication – Signals, Conventions and Incommensurable Explanations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 321 Lutz-Michael Alisch A Conversation Analytical Study on Multimodal Turn-Giving Cues: End-of-Turn Prediction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 335 Ágnes Abuczki Conversational Involvement and Synchronous Nonverbal Behaviour . . . . . 343 Uwe Altmann, Catharine Oertel, and Nick Campbell First Impression in Mark Evaluation: Predictive Ability of the SC-IAT . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 353 Angiola Di Conza and Augusto Gnisci Motivated Learning in Computational Models of Consciousness . . . . . . . . 365 James Graham and Daniel Jachyra Are Pointing Gestures Induced by Communicative Intention? . . . . . . . . . . 377 Ewa Jarmolowicz-Nowikow TV Interview Participant Profiles from a Multimodal Perspective . . . . . . 390 Maria Koutsombogera and Harris Papageorgiou The Neurophonetic Model of Speech Processing ACT: Structure, Knowledge Acquisition, and Function Modes . . . . . . . . . . . . . . . . . . . . . . . . 398 Bernd J. Kröger, Jim Kannampuzha, Cornelia Eckers, Stefan Heim, Emily Kaufmann, and Christiane Neuschaefer-Rube Coding Hand Gestures: A Reliable Taxonomy and a Multi-media Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 405 Fridanna Maricchiolo, Augusto Gnisci, and Marino Bonaiuto Individuality in Communicative Bodily Behaviours . . . . . . . . . . . . . . . . . . . 417 Costanza Navarretta XXII Table of Contents A Cross-Cultural Study on the Perception of Emotions: How Hungarian Subjects Evaluate American and Italian Emotional Expressions . . . . . . . . 424 Maria Teresa Riviello, Anna Esposito, and Klara Vicsi A!ective Computing: A Reverence for a Century of Research . . . . . . . . . . 434 Egon L. van den Broek Author Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .