Skip to content
Licensed Unlicensed Requires Authentication Published by De Gruyter Mouton July 5, 2017

Eye gaze and viewpoint in multimodal interaction management

  • Geert Brône EMAIL logo , Bert Oben , Annelies Jehoul , Jelena Vranjes and Kurt Feyaerts
From the journal Cognitive Linguistics

Abstract

In this paper, we present an embodiment perspective on viewpoint by exploring the role of eye gaze in face-to-face conversation, in relation to and interaction with other expressive modalities. More specifically, we look into gaze patterns, as well as gaze synchronization with speech, as instruments in the negotiation of participant roles in interaction. In order to obtain fine-grained information on the different modalities under scrutiny, we used the InSight Interaction Corpus (Brône, Geert & Bert Oben. 2015. Insight Interaction: A multimodal and multifocal dialogue corpus. Language Resources and Evaluation 49, 195–214.). This multimodal video corpus consists of two- and three-party interactions (in Dutch), with head-mounted scene cameras and eye-trackers tracking all participants’ visual behavior, providing a unique ‘speaker-internal’ perspective on the conversation. The analysis of interactional sequences from the corpus (dyads and triads) reveals specific patterns of gaze distribution related to the temporal organization of viewpoint in dialogue. Different dialogue acts typically display specific gaze events at crucial points in time, as, e.g., in the case of brief gaze aversion associated with turn-holding, and shared gaze between interlocutors at the critical point of turn-taking. In addition, the data show a strong correlation and temporal synchronization between eye gaze and speech in the realization of specific dialogue acts, as shown by means of a series of cross-recurrence analyses for specific turn-holding mechanisms (e.g., verbal fillers co-occurring with brief moments of gaze aversion).

Acknowledgments

The authors would like to thank the two anonymous reviewers for their valuable comments, and especially also Lieven Vandelanotte for his numerous suggestions and corrections that greatly helped to improve the manuscript. Parts of this work were presented at various conferences and workshops over the last three years, and we are grateful for the many discussions that have helped to shape the argumentation in this paper.

Appendix A

A cross-recurrence analysis is a type of correlation analysis that looks for a time lag at which the overlap between two time-series is maximal. Consider the following fictive example of a 10 second interaction between two speakers (S1 and S2). The interaction between them is sampled at 1 Hz, i.e., there is one value per second. Say, in this fictive example we are looking at blinking. Red indicates a speaker has blinked during that second, green indicates there was no blink during the sample second. In the example below there is one moment of overlap: at second seven both speakers are blinking at the same time (indicated by the blue rectangle in Figure 4). At this point in time they are perfectly synchronizing their blinking.

Figure 4: Fictive example of two time-series for blinking.
Figure 4:

Fictive example of two time-series for blinking.

To study the temporal relation between the blinking of S1 and S2, it is not only interesting to measure when both speakers are blinking at the same time, it is also relevant to check whether there is a systematic time lag between the blinking of S1 and that of S2. This is exactly what a cross-recurrence analysis does. When shifting the time-series of S2 one second down (see Figure 5), we see there is a lot more overlap between the two time-series (cf. the four blue rectangles in Figure 5). What this means is that, for this tiny example, typically S2 blinks first and S1 blinks one second later. In other words, the correlation between the two time-series is maximal at a time lag of 1 second.

Figure 5: Fictive example of two time-series for blinking in which the time-series for S2 is lagged by one second to that of S1.
Figure 5:

Fictive example of two time-series for blinking in which the time-series for S2 is lagged by one second to that of S1.

It is of course possible to calculate the correlation between two time series for any time lag: by shifting the time-series for S2 another second down (and another and another, etc.) and by also shifting the time-series of S1 down (or that of S2 up, which is the same). In Figure 6 we see a plot in which this calculation has been done for the fictive example above. In the middle of the plot the value on the X-axis is zero (t0). This data point indicates the amount of correlation between the actual time-series, i.e., without any lagging (cf. the visual representation in Figure 4). For the value 1 on the X-axis, there is a clear peak: when lagging the time-series of S2 with one second, there is a lot more overlap (cf. the visual representation in Figure 5). When, switching speaker direction, lagging the time-series of S1 with one second (this corresponds to the value ‒1 on the X-axis), we do not see an increase in overlap. Basically two things can be read from this type of plot. First, the peak in the plot indicates at what time lag the correlation or overlap between two time-series is maximal. Second, the position of the peak relative to t0 indicates who follows whom: to the right of t0 we measure the correlation or overlap for S1 following S2 (as in Figure 5); to the left we see S2 following S1. For the fictive example here we can read from the plot in Figure 6 that S1 typically follows S2 (and not the other way around) at a time lag of one second. In other words, typically one second after a blink by S2, S1 also blinks.

Figure 6: Simplified cross-recurrence plot for the fictive example in Figures 1 and 2.
Figure 6:

Simplified cross-recurrence plot for the fictive example in Figures 1 and 2.

References

Allwood, Jens, Loredana Cerrato, Kristiina Jokinen, Costanza Navarretta & Patrizia Paggio. 2007. The MUMIN coding scheme for the annotation of feedback, turn management, and sequencing phenomena. International Journal of Language Resources and Evaluation 41. 273–287.10.1007/s10579-007-9061-5Search in Google Scholar

Argyle, Michael & Mark Cook. 1976. Gaze and mutual gaze. London: Cambridge University Press.Search in Google Scholar

Bailly, Gérard, Stephan Raidt & Frédéric Elisei. 2010. Gaze, conversational agents and face-to-face communication. Speech Communication 52(6). 598–612.10.1016/j.specom.2010.02.015Search in Google Scholar

Baker, Charlotte. 1977. Regulators and turn-taking in American Sign Language discourse. In L. A. Friedman (ed.), On the other hand: New perspectives on American Sign Language, 215–236. New York: Academic Press.Search in Google Scholar

Bates, Douglas, Martin Maechler, Ben Bolker & Steven Walker. 2014. lme4: Linear mixed-effects models using Eigen and S4. R package version 1.0-6. http://CRAN.R-project.org/package=lme4.Search in Google Scholar

Bavelas, Janet B., Linda Coates & Trudy Johnson. 2002. Listener responses as a collaborative process: The role of gaze. Journal of Communication 52. 566–580.10.1111/j.1460-2466.2002.tb02562.xSearch in Google Scholar

Beattie, Geoff W. 1983. Talk: An analysis of speech and non-verbal behaviour in conversation. Milton Keynes: Open University Press.Search in Google Scholar

Brennan, Susan, Xin Chen, Christopher Dickinson, Mark Neider & Gregory Zelinsky. 2008. Coordinating cognition: The costs and benefits of shared gaze during collaborative search. Cognition 106. 1465–1477.10.1016/j.cognition.2007.05.012Search in Google Scholar

Brennan, Susan E. 2005. How conversation is shaped by visual and spoken evidence. In John C. Trueswell & Michael Tanenhaus (eds.), Approaches to studying world-situated language use: Bridging the language-as-product and language-action traditions, 95–129. Cambridge, MA: MIT Press.Search in Google Scholar

Brône, Geert & Bert Oben. 2015. Insight Interaction: A multimodal and multifocal dialogue corpus. Language Resources and Evaluation 49. 195–214.10.1007/s10579-014-9283-2Search in Google Scholar

Brugman, Hennie & Albert Russel. 2004. Annotating multimedia/multi-modal resources with ELAN. In Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC), 2065–2068. Paris: European Language Resources Association.Search in Google Scholar

Chafe, Wallace. 1994. Discourse, consciousness, and time: The flow and displacement of conscious experience in speaking and writing. Chicago: University of Chicago Press.Search in Google Scholar

Cienki, Alan & Cornelia Müller (eds.) 2008. Metaphor and gesture. Amsterdam & Philadelphia: John Benjamins.10.1075/gs.3Search in Google Scholar

Clark, Herbert H. 1996. Using language. Cambridge: Cambridge University Press.10.1017/CBO9780511620539Search in Google Scholar

Clark, Herbert H. & Jean E. Fox Tree. 2002. Using uh and um in spontaneous speaking. Cognition 84. 73–111.10.1016/S0010-0277(02)00017-3Search in Google Scholar

Coco, Moreno I. & Rick Dale. 2014. Cross-recurrence quantification analysis of categorical and continuous time series: An R package. Frontiers in Quantitative Psychology and Measurement 5. 1–14.10.3389/fpsyg.2014.00510Search in Google Scholar

Coco, Moreno I., Rick Dale, James Dixon & John Nash. 2015. crqa: Cross-Recurrence Quantification Analysis for categorical and continuous time-series. R-package version 1.0.6. https://CRAN.R-project.org/package=crqa10.3389/fpsyg.2014.00510Search in Google Scholar

Dale, Rick, Anne Warlaumont & Daniel Richardson. 2011. Nominal cross recurrence as a generalized lag sequential analysis for behavioral streams. International Journal of Bifurcation and Chaos 21. 1153–1161.10.1142/S0218127411028970Search in Google Scholar

Dancygier, Barbara & Eve Sweetser (eds.) 2012. Viewpoint in language: A multimodal perspective. Cambridge: Cambridge University Press.10.1017/CBO9781139084727Search in Google Scholar

De Jaegher, Hanne, Ezequiel Di Paolo & Shaun Gallagher. 2010. Can social interaction constitute social cognition? Trends in Cognitive Sciences 14(10). 441–447.10.1016/j.tics.2010.06.009Search in Google Scholar

De Ruiter, Jan Peter. 2005. The role of eye-gaze in visual dialogue tasks. Paper presented at the AMLaP, Ghent, Belgium.Search in Google Scholar

Debras, Camille. 2015. Stance-taking functions of multimodal constructed dialogue during spoken interaction. Proceedings of GESPIN4 (Gesture and Speech in Interaction). University of Nantes, September 2–4, 2015.Search in Google Scholar

Deppermann, Arnulf. 2013a. Introduction: Multimodal interaction from a conversation analytic perspective. Journal of Pragmatics 46(1). 1–7.10.1016/j.pragma.2012.11.014Search in Google Scholar

Deppermann, Arnulf. 2013b. Turn-design at turn-beginnings: Multimodal resources to deal with tasks of turn-construction in German. Journal of Pragmatics 46(1). 91–121.10.1016/j.pragma.2012.07.010Search in Google Scholar

Drew, Paul & John Heritage (eds.) 2006. Conversation analysis. London: Sage.10.4135/9781446261156Search in Google Scholar

Duncan, Susan. 1975. Interaction units during speaking turns in dyadic, face-to-face conversations. In Adam Kendon, Richard M. Harris & Mary R. Key (eds.), Organization of behavior in face-to-face interaction, 199–212. The Hague: Mouton.10.1515/9783110907643.199Search in Google Scholar

Emmorey, Karen, Robin Thompson & Rachael Colvin. 2009. Eye gaze during comprehension of American Sign Language by native and beginning signers. Journal of Deaf Studies and Deaf Education 14(2). 237–243.10.1093/deafed/enn037Search in Google Scholar

Feyaerts, Kurt, Geert Brône & Bert Oben. 2017. Multimodality in interaction. In Barbara Dancygier (ed.), The Cambridge handbook of cognitive linguistics, 135–156. Cambridge: Cambridge University Press.10.1017/9781316339732.010Search in Google Scholar

Fusaroli, Riccardo, Ivana Konvalinka & Sebastian Wallot. 2014. Analyzing social interactions: The promises and challenges of cross recurrence quantification analysis. In N. Marwan, M. Riley, A. Giuliani & C. Webber Jr. (eds.), Translational recurrences: From mathematical theory to real-world applications (Springer Proceedings in Mathematics & Statistics, Vol. 103), 137–155. Cham: Springer.10.1007/978-3-319-09531-8_9Search in Google Scholar

Goldberg, Adele E. 1995. Constructions: A construction grammar approach to argument structure. Chicago: University of Chicago Press.Search in Google Scholar

Goldberg, Adele E. 2006. Constructions at work. The nature of generalization in language. Oxford: Oxford University Press.10.1093/acprof:oso/9780199268511.001.0001Search in Google Scholar

Goodwin, Charles. 1980. Restarts, pauses, and the achievement of a state of mutual gaze. Sociological Inquiry 50 (3–4). 272–302.10.1111/j.1475-682X.1980.tb00023.xSearch in Google Scholar

Goodwin, Charles. 1981. Conversational organization. Interaction between speakers and hearers. New York, London: Academic Press.Search in Google Scholar

Goodwin, Marjorie H. & Charles Goodwin. 1986. Gesture and co-participation in the activity of searching for a word. Semiotica 62(1/2). 51–75.10.1515/semi.1986.62.1-2.51Search in Google Scholar

Gries, Stefan. 2013. Data in construction grammar. In Thomas Hoffmann & Graeme Trousdale (eds.), The Oxford handbook of construction grammar. Oxford: Oxford University Press.10.1093/oxfordhb/9780195396683.013.0006Search in Google Scholar

Gullberg, Marianne & Kenneth Holmqvist. 2006. What speakers do and what addresses look at: Visual attention to gestures in human interaction live and on video. Pragmatics and Cognition 14(1). 53–82.10.1075/pc.14.1.05gulSearch in Google Scholar

Gullberg, Marianne & Sotaro Kita. 2009. Attention to speech-accompanying gestures: Eye movements and information uptake. Journal of Nonverbal Behaviour 33. 251–277.10.1007/s10919-009-0073-2Search in Google Scholar

Hanna, Joy & Susan Brennan. 2007. Speakers’ eye gaze disambiguates referring expressions early during face-to-face conversation. Journal of Memory and Language 57. 596–615.10.1016/j.jml.2007.01.008Search in Google Scholar

Hirvenkari, Lotta, Johanna Ruusuvuori, Veli-Matti Saarinen, Maari Kivioja, Anssi Peräkylä & Riitta Hari. 2013. Influence of turn-taking in a two-person conversation on the gaze of a viewer. PLoS ONE 8(8). e71569.10.1371/journal.pone.0071569Search in Google Scholar

Hobson, Peter R. 2005. What puts the jointness in joint attention? In Naomi Eilan, Christoph Hoerl, Teresa McCormack & Johannes Roessler (eds.), Joint attention: Communication and other minds, 185–204. Oxford: Oxford University Press.10.1093/acprof:oso/9780199245635.003.0009Search in Google Scholar

Hoffmann, Thomas & Graeme Trousdale (eds.) 2013. The Oxford handbook of construction grammar. Oxford: Oxford University Press.10.1093/oxfordhb/9780195396683.001.0001Search in Google Scholar

Holler, Judith, Janet Bavelas. 2017. Multi-modal communication on common ground. A review of social functions. In Accepted for R. Breckinridge Church, Martha W. Alibali & Spencer Kelly (eds.) Why gesture? How the hands function in speaking, thinking, and communicating, 213–240. Amsterdam & Philadelphia: John Benjamins.10.1075/gs.7.11holSearch in Google Scholar

Holler, Judith & Kobin Kendrick. 2015. Unaddressed participants’ gaze in multi-person interaction: Optimizing recipiency. Frontiers in Psychology 6. 98.10.3389/fpsyg.2015.00098Search in Google Scholar

Jefferson, Gail. 1972. Side sequences. In David N. Sudnow (ed.), Studies in social interaction, 294–333. New York: Free Press.Search in Google Scholar

Jokinen, Kristiina. 2010. Non-verbal signals for turn-taking and feedback. Proceedings of 7th International Conference on Language Resources and Evaluation (LREC’10), Valetta, Malta, May 19–21, 2961–2967.Search in Google Scholar

Jokinen, Kristiina, Masafumi Nishida & Seiichi Yamamoto. 2009. Eye gaze experiments for conversation monitoring. In IUCS ‘09 Proceedings of the 3rd International Universal Communication Symposium, December 3–4, Tokyo, Japan, 303–308.10.1145/1667780.1667843Search in Google Scholar

Kawase, Satoshi. 2014a. Assignment of leadership role changes performers’ gaze during piano duo performances. Ecological Psychology 26(3). 198–215.10.1080/10407413.2014.929477Search in Google Scholar

Kawase, Satoshi. 2014b. Gazing behavior and coordination during piano duo performance. Attention, Perception, and Psychophysics 76. 527–540.10.3758/s13414-013-0568-0Search in Google Scholar

Kendon, Adam. 1967. Some functions of gaze-direction in social interaction. Acta Psychologica 26. 22–63.10.1016/0001-6918(67)90005-4Search in Google Scholar

Kendon, Adam. 2004. Gesture: Visible action as utterance. Cambridge: Cambridge University Press.10.1017/CBO9780511807572Search in Google Scholar

King, Elaine & Jane Ginsborg. 2011. Gestures and glances: Interactions in ensemble rehearsal. In Anthony Gritten & Elaine King (eds.), New Perspectives of Music and Gesture, 177–202. Surrey: Ashgate.Search in Google Scholar

Langacker, Ronald W. 1987. Foundations of cognitive grammar. Theoretical prerequisites. Stanford: Stanford University Press.Search in Google Scholar

Langacker, Ronald W. 2001. Discourse in cognitive grammar. Cognitive Linguistics 12(2). 143–188.10.1515/cogl.12.2.143Search in Google Scholar

Langacker, Ronald. W. 2008. Cognitive grammar. A basic introduction. Oxford: Oxford University Press.10.1093/acprof:oso/9780195331967.001.0001Search in Google Scholar

Lausberg, Hedda & Han Sloetjes. 2009. Coding gestural behavior with the NEUROGES-ELAN system. Behavior Research Methods, Instruments, and Computers 41. 841–849.10.3758/BRM.41.3.841Search in Google Scholar

Linell, Per. 2009. Rethinking language, mind, and world dialogically. Charlotte, NC: Information Age Publishing.Search in Google Scholar

Louwerse, Max, Rick Dale, Ellen G. Bard & Patrick Jeuniaux. 2012. Behavior matching in multimodal communication is synchronized. Cognitive Science 36(8). 1404–1426.10.1111/j.1551-6709.2012.01269.xSearch in Google Scholar

McNeill, David. 2005. Gesture and thought. Chicago: University of Chicago Press.10.7208/chicago/9780226514642.001.0001Search in Google Scholar

McNeill, David. 2006. Gesture, gaze, and ground. In Steve Renals & Samy Bengio (eds.), Proceedings of Machine learning for multimodal interaction: Second international workshop 2005, 1–14. Berlin & Heidelberg: Springer Verlag.10.1007/11677482_1Search in Google Scholar

Mondada, Lorenza. 2007. Multimodal resources for turn-taking: Pointing and emergence of next speakers. Discourse Studies 9(2). 194–225.10.1177/1461445607075346Search in Google Scholar

Mondada, Lorenza. 2008. Using video for a sequential and multimodal analysis of social interaction: Videotaping institutional telephone calls. Forum Qualitative Sozialforschung /Forum: Qualitative Social Research 9(3). 39.Search in Google Scholar

Mondada, Lorenza. 2013. Embodied and spatial resources for turn-taking in institutional multi-party interactions: Participatory democracy debates. Journal of Pragmatics 46(1). 39–68.10.1016/j.pragma.2012.03.010Search in Google Scholar

Müller, Cornelia, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill & Jana Bressem (eds.) 2014. Body – language – communication: An international handbook on multimodality in human interaction (Handbooks of Linguistics and Communication Science 38.2.). Berlin & Boston: Mouton De Gruyter.Search in Google Scholar

Oben, Bert. 2015. Modelling interactive alignment: A multimodal and temporal account. Leuven, Belgium: University of Leuven unpublished dissertation.Search in Google Scholar

Oben, Bert & Brône Geert. 2015. What you see is what you do. On the relationship between gaze and gesture in multimodal alignment. Language and Cognition 7. 546–562.10.1017/langcog.2015.22Search in Google Scholar

Pickering, Martin & Simon Garrod. 2004. Toward a mechanistic psychology of dialogue. Behavioral and Brain Sciences 27. 169–226.10.1017/S0140525X04000056Search in Google Scholar

Pinar Sanz Maria Jesus (ed.) 2013. Multimodality and cognitive linguistics. Amsterdam & Philadelphia: John Benjamins.10.1075/rcl.11.2Search in Google Scholar

Richardson, Daniel & Rick Dale. 2005. Looking to understand: The coupling between speakers’ and listeners’ eye movements and its relationship to discourse comprehension. Cognitive Science 29. 1045–1060.10.1207/s15516709cog0000_29Search in Google Scholar

Richardson, Daniel, Rick Dale & Michael Spivey. 2007. Eye movements in language and cognition. A brief introduction. In Monica Gonzalez-Marquez, Irene Mittelberg, Seana Coulson & Michael Spivey (eds.), Methods in cognitive linguistics, 323–344. Amsterdam& Philadelphia: John Benjamins.10.1075/hcp.18.21ricSearch in Google Scholar

Richardson, Daniel, Rick Dale & John Tomlinson. 2009. Conversation, gaze coordination and beliefs about context. Cognitive Science 33. 1468–1482.10.1111/j.1551-6709.2009.01057.xSearch in Google Scholar

Rossano, Frederico. 2010. Questioning and responding in Italian. Journal of Pragmatics 42(10). 2756–2771.10.1016/j.pragma.2010.04.010Search in Google Scholar

Rossano, Frederico. 2012a. Gaze in conversation. In Jack Sidnell & Tanya Stivers (eds.), The handbook of conversation analysis, 308–329. Chichester: Wiley-Blackwell.10.1002/9781118325001.ch15Search in Google Scholar

Rossano, Frederico. 2012b. Gaze behavior in face-to-face interaction. Nijmegen, The Netherlands: Max Planck Institute for Psycholinguistics unpublished dissertation.Search in Google Scholar

Sacks, Harvey, Emanuel A. Schegloff & Gail Jefferson. 1974. A simplest systematics for the organisation of turn-taking for conversation. Language 50. 696–735.10.1353/lan.1974.0010Search in Google Scholar

Schegloff, Emanuel A. 1982. Discourse as an interactional achievement: Some uses of “uh huh” and other things that come between sentences. In Deborah Tannen (ed.), Analyzing discourse: Text and talk (Georgetown University Roundtable on Languages and Linguistics 32, 1981), 71–93. Washington, DC: Georgetown University Press.Search in Google Scholar

Schegloff, Emanuel A. 2007. Sequence organization in interaction. Cambridge: Cambridge University Press.10.1017/CBO9780511791208Search in Google Scholar

Schmitt, Reinhold. 2005. Zur multimodalen Struktur von turn-taking. Gesprächsforschung 6. 17–61.Search in Google Scholar

Schoonjans, Steven. 2014. Modalpartikeln als multimodale Konstruktionen. Eine korpusbasierte Kookkurrenzanalyse von Modalpartikeln und Gestik im Deutschen. Leuven, Belgium: University of Leuven unpublished dissertation.Search in Google Scholar

Schoonjans, Steven, Geert Brône & Kurt Feyaerts. 2015. Multimodalität in der Konstruktionsgrammatik: Eine kritische Betrachtung illustriert anhand einer Gestikanalyse der Partikel einfach. In Jörg Bücker, Susanne Günthner & Wolfgang Imo (eds.), Konstruktionsgrammatik V. Konstruktionen im Spannungsfeld von sequenziellen Mustern, kommunikativen Gattungen und Textsorten, 291–308. Tübingen: Stauffenburg.Search in Google Scholar

Selting, Margret. 2000. The construction of units in conversational talk. Language in Society 29. 477–517.10.1017/S0047404500004012Search in Google Scholar

Selting, Margret, Peter Auer, Birgit Barden, Jörg Bergmann, Elizabeth Couper-Kuhlen, Susanne Günther, Christoph Meier, Uta Quasthoff, Peter Schlobinski & Susanne Uhmann. 1998. Gesprächsanalytisches Transkriptionssystem (GAT). Linguistische Berichte 173. 91–122.Search in Google Scholar

Sidnell, Jack & Tanya Stivers (eds.) 2013. The handbook of conversation analysis. London: Wiley-Blackwell.10.1002/9781118325001Search in Google Scholar

Skanze, Gabriel, Anna Hjalmarsson & Catharine Oertel. 2014. Turn-taking, feedback and joint attention in situated human–robot interaction. Speech Communication 65. 50–66.10.1016/j.specom.2014.05.005Search in Google Scholar

Staudte, Maria & Matthew Crocker. 2011. Investigating joint attention mechanisms through spoken human-robot interaction. Cognition 120. 268–291.10.1016/j.cognition.2011.05.005Search in Google Scholar

Streeck, Jürgen. 2009. Gesturecraft - The manufacture of meaning. Amsterdam & Philadelphia: John Benjamins.10.1075/gs.2Search in Google Scholar

Sweetser, Eve. 2007. Looking at space to study mental spaces. Co-speech gesture as a crucial data source in cognitive linguistics. In Maria Gonzalez-Marquez, Irene Mittelberg, Seana Coulson & Michael Spivey (eds.), Methods in cognitive linguistics, 201–224. Amsterdam & Philadelphia: John Benjamins.10.1075/hcp.18.15sweSearch in Google Scholar

Sweetser, Eve. 2012. Introduction: Viewpoint and perspective in language and gesture, from the ground up. In Barbara Dancygier & Eve Sweetser (eds.), Viewpoint in language: A multimodal perspective, 1–24. Cambridge: Cambridge University Press.10.1017/CBO9781139084727Search in Google Scholar

Sweetser, Eve & Kashmiri Stec. 2016. Maintaining multiple viewpoints with gaze. In Barbara Dancygier, Lu Wei-Lun & Arie Verhagen (eds.), Viewpoint and the fabric of meaning, 237–258. Berlin & Boston: Mouton de Gruyter.10.1515/9783110365467-011Search in Google Scholar

Traugott, Elizabeth Closs & Graeme Trousdale. 2013. Constructionalization and constructional changes. Oxford: Oxford University Press.10.1093/acprof:oso/9780199679898.001.0001Search in Google Scholar

Verhagen, Arie. 2005. Constructions of intersubjectivity. Oxford: Oxford University Press.Search in Google Scholar

Verhagen, Arie. 2008. Intersubjectivity and the architecture of the language system. In Jordan Zlatev, Timothy P. Racine, Chris Sinha & Esa Itkonen (eds.), The shared mind: Perspectives on intersubjectivity, 307–331. Amsterdam & Philadelphia: John Benjamins.10.1075/celcr.12.17verSearch in Google Scholar

Vertegaal, Roel. 1999. The GAZE Groupware system: Mediating joint attention in multiparty communication and collaboration. In Marian G. Williams & Mark W. Altom (eds.), Proceedings of CHI’99, 294–301. Pittsburgh: ACM Press.10.1145/302979.303065Search in Google Scholar

Vertegaal, Roel, Robert Slagter, Gerrit Van Der Veer & Anton Nijholt. 2001. Eye gaze patterns in conversations: There is more to conversational agents than meets the eyes. In CHI ‘01 Proceedings of the Conference on Human Factors in Computing Systems, 301–308. New York: ACM.10.1145/365024.365119Search in Google Scholar

Zima, Elisabeth. 2014. Gibt es multimodale Konstruktionen? Eine Studie zu [V(motion) in circles] und [all the way from X PREP Y]. Gesprächsforschung - Online-Zeitschrift zur verbalen Interaktion 15. 1–48.Search in Google Scholar

Zima, Elisabeth & Brône Geert. 2015. Cognitive Linguistics and interactional discourse. Time to enter into dialogue. Language and Cognition 7(4). 485–498.10.1017/langcog.2015.19Search in Google Scholar

Received: 2016-10-10
Revised: 2017-3-13
Accepted: 2017-4-4
Published Online: 2017-7-5
Published in Print: 2017-8-28

© 2017 Walter de Gruyter GmbH, Berlin/Boston

Downloaded on 4.5.2024 from https://www.degruyter.com/document/doi/10.1515/cog-2016-0119/html
Scroll to top button