The temporal structure of behavior contains a rich source of information about its dynamic organization, origins, and development. Today, advances in sensing and data storage allow researchers to collect multiple dimensions of behavioral data at a fine temporal scale both in and out of the laboratory, leading to the curation of massive multimodal corpora of behavior. However, along with these new opportunities come new challenges. Theories are often underspecified as to the exact nature of these unfolding interactions, and psychologists have (...) limited ready-to-use methods and training for quantifying structures and patterns in behavioral time series. In this paper, we will introduce four techniques to interpret and analyze high-density multi-modal behavior data, namely, to: (1) visualize the raw time series, (2) describe the overall distributional structure of temporal events (Burstiness calculation), (3) characterize the nonlinear dynamics over multiple timescales with Chromatic and Anisotropic Cross-Recurrence Quantification Analysis (CRQA), (4) and quantify the directional relations among a set of interdependent multimodal behavioral variables with Granger Causality. Each technique is introduced in a module with conceptual background, sample data drawn from empirical studies and ready-to-use Matlab scripts. The code modules showcase each technique’s application with detailed documentation to allow more advanced users to adapt them to their own datasets. Additionally, to make our modules more accessible to beginner programmers, we provide a “Programming Basics” module that introduces common functions for working with behavioral timeseries data in Matlab. Together, the materials provide a practical introduction to a range of analyses that psychologists can use to discover temporal structure in high-density behavioral data. (shrink)

Dance provides natural conditions for studying relationships between coordination patterns and human experience. von Zimmermann and colleagues investigate whether relatively simple or more complex forms of movement coordination are related to pro‐social experiences during group dance. They find that pro‐social experience depends on the degree to which movement patterns are distributed and diversified, but not the degree to which movement patterns are simply unitary.

Despite the challenges associated with virtually mediated communication, remote collaboration is a defining characteristic of online multiplayer gaming communities. Inspired by the teamwork exhibited by players in first-person shooter games, this study investigated the verbal and behavioral coordination of four-player teams playing a cooperative online video game. The game, Desert Herding, involved teams consisting of three ground players and one drone operator tasked to locate, corral, and contain evasive robot agents scattered across a large desert environment. Ground players could move (...) throughout the environment, while the drone operator’s role was akin to that of a “spectator” with a bird’s-eye view, with access to veridical information of the locations of teammates and the to-be-corralled agents. Categorical recurrence quantification analysis was used to measure the communication dynamics of teams as they completed the task. Demands on coordination were manipulated by varying the ground players’ ability to observe the environment with the use of game “fog.” Results show that catRQA was sensitive to changes to task visibility, with reductions in task visibility reorganizing how participants conversed during the game to maintain team situation awareness. The results are discussed in the context of future work that can address how team coordination can be augmented with the inclusion of artificial agents, as synthetic teammates. (shrink)

The present paper describes a joint action paradigm in which individuals or pairs utilized two computer keys to keep a dot stimulus moving inside a larger rectangle. Members of a pair could neither see nor hear each other. This paradigm allowed us to combine the discrete-trial type dependent variables commonly utilized by representational theorists, with the continuous, temporal dependence variables utilized by dynamical theorists. Analysis revealed that individuals kept the dot in the rectangle longer than dyads and did so by (...) moving it back and forth within the rectangle. Dyads, however, pressed their individual buttons as quickly as possible in order to keep the dot near the middle of the rectangle. These findings indicate that joint action constitutes a multi-scale phenomena that is best investigated via multiple, complementary methodologies versus single-measure, competing theories. (shrink)

The Random Number Generation task has a long history in neuropsychology as an assessment procedure for executive functioning. In recent years, understanding of human behavior has gradually changed from reflecting a static to a dynamic process and this shift in thinking about behavior gives a new angle to interpret test results. However, this shift also asks for different methods to process random number sequences. The RNG task is suited for applying non-linear methods needed to uncover the underlying dynamics of random (...) number generation. In the current article we present RandseqR: an R-package that combines the calculation of classic randomization measures and Recurrence Quantification Analysis. RandseqR is an easy to use, flexible and fast way to process random number sequences and readies the RNG task for current scientific and clinical use. (shrink)

Language is highly dynamic: It unfolds over time, and we can use it to achieve a wide variety of communicative goals, from telling a story to trying to persuade another person. One aspect of language that has gained increasing popularity among researchers in the last several decades is the individual language style (LS) represented by an individual’s use of function words (e.g., pronouns, articles). Previous approaches to LS mostly focus on LS of one individual in isolation, paying less attention to (...) the fact that language emerges from interaction with others. The aim of this paper is twofold: First, we integrate LS into a dynamical theoretical framework and present an innovative methodological approach. Second, this paper aims to address how interactive conversation—as an aspect of the communicative setting—changes an individual’s LS. We use recurrence quantification analysis to look at structure in patterns of LS in monologs and conversations of 118 participants. Our results showed that LS significantly differs from monolog to conversation, and post hoc analyses further revealed that the change in LS is greater for conflict than for friendly conversations. The difference between monologs and conversations is reflected more strongly in the dynamics (i.e., structure and complexity) of LS than the proportion of function words used. Theoretical implications and directions for future studies are discussed. (shrink)

In online lectures, unlike in face-to-face lectures, teachers lack access to (nonverbal) cues to check if their students are still “with them” and comprehend the lecture. The increasing availability of low-cost eye-trackers provides a promising solution. These devices measure unobtrusively where students look and can visualize these data to teachers. These visualizations might inform teachers about students’ level of “with-me-ness” (i.e., do students look at the information that the teacher is currently talking about) and comprehension of the lecture, provided that (...) (1) gaze measures of “with-me-ness” are related to comprehension, (2) people not trained in eye-tracking can predict students’ comprehension from gaze visualizations, (3) we understand how different visualization techniques impact this prediction. We addressed these issues in two studies. In Study 1, 36 students watched a video lecture while being eye-tracked. The extent to which students looked at relevant information and the extent to which they looked at the same location as the teacher both correlated with students’ comprehension (score on an open question) of the lecture. In Study 2, 50 participants watched visualizations of students’ gaze (from Study 1), using six visualization techniques (dynamic and static versions of scanpaths, heatmaps, and focus maps) and were asked to predict students’ posttest performance and to rate their ease of prediction. We found that people can use gaze visualizations to predict learners’ comprehension above chance level, with minor differences between visualization techniques. Further research should investigate if teachers can act on the information provided by gaze visualizations and thereby improve students’ learning. (shrink)

An emerging perspective on human cognition and performance sees it as a kind of self-organizing phenomenon involving dynamic coordination across the body, brain and environment. Measuring this coordination faces a major challenge. Time series obtained from such cognitive, behavioral, and physiological coordination are often complicated in terms of non-stationarity and non-linearity, and in terms of continuous vs. categorical scales. Researchers have proposed several analytical tools and frameworks. One method designed to overcome these complexities is recurrence quantification analysis, developed in the (...) study of non-linear dynamics. It has been applied in various domains, including linguistic data or motion data. However, most previous studies have applied recurrence methods individually to categorical or continuous data. To understand how complex coordination works, an integration of these types of behavior is needed. We aimed to integrate these methods to investigate the relationship between language and motion directly. To do so, we added temporal information to categorical data, and applied joint recurrence analysis methods to visualize and quantify speech-motion coordination coupling during a rap performance. We illustrate how new dynamic methods may capture this coordination in a small case-study design on this expert rap performance. We describe a case study suggesting this kind of dynamic analysis holds promise, and end by discussing the theoretical implications of studying complex performances of this kind as a dynamic, coordinated phenomenon. (shrink)

A central hypothesis to account for the ubiquity of rituals across cultures is their supposed anxiolytic effects: rituals being maintained because they reduce existential anxiety and uncertainty. We aimed to test the anxiolytic effects of rituals by investigating two possible underlying mechanisms for it: cognitive load and repetitive movement. In our pre-registered experiment, 180 undergraduates took part in either a stress or a control condition and were subsequently assigned to either control, cognitive load, undirected movement, a combination of undirected movement (...) and cognitive load, or a ritualistic intervention. Using both repeated self-report measures and continuous physiological indicators of anxiety, we failed to find direct support for a cognitive suppression effect of anxiety through ritualistic behavior. Nevertheless, we found that induced stress increased participants’ subsequent repetitive behavior, which in turn reduced physiological arousal. This study provides novel evidence for plausible underlying effects of the proposed anxiolytic effect of rituals: repetitive behavior but not cognitive load may decrease physiological stress responses during ritual. (shrink)

Adult-infant early dyadic interactions have been extensively explored by developmental psychologists. Around the age of 2 months, infants already demonstrate complex, delicate and very sensitive behaviors that seem to express their ability to interact and share emotions with their caregivers. This paper presents 3 pilot studies of parent-infant dyadic interaction in various set-ups. The first two present longitudinal data collected on two infants aged between 1 and 6 months and their mothers. We analyzed the development of coordination between them, at (...) the motor and at the vocal level. The 3rd pilot study aims to explore interpersonal coordination in both vocal behavior and motor activity for one infant and his mother at 2, 4 and 6 months. These pilot studies however leave a number of questions open concerning developmental changes and infants’ progressive mastery of interaction. We identify areas worth examining and try to tease out specific issues that may help develop new methodological pathways for the study of early naturalistic social interaction. We assume that a continuous, rather than discrete, approach would better capture the changes taking place in the various communicative modalities, while also displaying each dyad’s specificity and the narrative dimension of social engagement between infants and caregivers. (shrink)

Cognitive Science, Volume 45, Issue 11, November 2021.

In team-based tasks, successful communication and mutual understanding are essential to facilitate team coordination and performance. It is well-established that an important component of human conversation is the maintenance of common ground. Maintaining common ground has a number of associated processes in which conversational participants engage. Many of these processes are lacking in current synthetic teammates, and it is unknown to what extent this lack of capabilities affects their ability to contribute during team-based tasks. We focused our research on how (...) teams package information within a conversation, by which we mean specifically whether information is explicitly mentioned or implied, and how multiple pieces of information are ordered both within single communications and across multiple communications. We re-analyzed data collected from a simulated remotely-piloted aerial system task in which team members had to specify speed, altitude, and radius restrictions. The data came from three experiments: the “speech” experiment, the “text” experiment, and the “evaluation” experiment. We asked first whether teams settled on a specific routine for communicating the speed, altitude, and radius restrictions, and whether this process was different if the teams communicated in speech compared to text. We then asked how receiving special communication instructions in the evaluation experiment impacted the way the human teammates package information. We found that teams communicating in either speech or text tended to use a particular order for mentioning the speed, altitude, and radius. Different teams also chose different orders from one another. The teams in the evaluation experiment, however, showed unnaturally little variability in their information ordering and were also more likely to explicitly mention all restrictions even when they did not apply. Teams in the speech and text experiments were more likely to leave unnecessary restrictions unmentioned, and were also more likely to convey the restrictions across multiple communications. The option to converge on different packaging routines may have contributed to improved performance in the text experiment compared some of the conditions in the evaluation experiment. (shrink)

Long‐range correlation is a general class of coordination pattern found to be common to the intrinsic dynamics of complex systems, including human behavior. Balasubramaniam, Hove, and Médé investigate intrinsic dynamics in repeated finger movements, and they find that different measures of movement dynamics yield different long‐range correlations. Results shed light on the way that coordination patterns are expressed as a function of measurement context.

We hypothesize that effective collaboration is facilitated when individuals and environmental components form a synergy where they work together and regulate one another to produce stable patterns of behavior, or regularity, as well as adaptively reorganize to form new behaviors, or irregularity. We tested this hypothesis in a study with 32 triads who collaboratively solved a challenging visual computer programming task for 20 min following an introductory warm‐up phase. Multidimensional recurrence quantification analysis was used to examine fine‐grained (i.e., every 10 (...) s) collective patterns of regularity across team members' speech rate, body movement, and team interaction with the shared user interface. We found that teams exhibited significant patterns of regularity as compared to shuffled baselines, but there were no systematic trends in regularity across time. We also found that periods of regularity were associated with a reduction in overall behavior. Notably, the production of irregular behavior predicted expert‐coded metrics of collaborative activity, such as teams' ability to construct shared knowledge and effectively negotiate and coordinate execution of solutions, net of overall behavioral production and behavioral self‐similarity. Our findings support the theory that groups can interact to form interpersonal synergies and indicate that information about system‐level dynamics is a viable way to understand and predict effective collaborative processes. (shrink)