Psychogenic non epileptic seizures (PNES) are clinical events of psychological nature. Video-electroencephalography monitoring (V-EEGM) is a valuable method for the diagnosis of PNES and may be combined with provocative tests to induce seizures. The use of placebo in provocative tests for the diagnosis of PNES is controversial because of associated deception, and contrasts with the use of truly decreasing epileptogenic threshold techniques such as hyperventilation and photo stimulation. We present a clinical case of a pregnant woman with (...) a past history of refractory epilepsy, admitted in the obstetric department due to unremitting seizures. In this clinical context, non-deceiving provocative tests such as hyperventilation and photo stimulation could be potentially harmful, nevertheless, the use of intravenous saline injection presented as a safer alternative to diagnose PNES and hence obviate an urgent caesarean. This case illustrates a disproportionate risk of causing harm when telling the truth, in comparison with the benefit of avoiding such risk, although deceiving the patient. This is a clinical example of how considerations concerning the use of placebo must be evaluated in an individual basis. (shrink)

One hypothesis concerning the human dorsal anterior cingulate cortex (ACC) is that it functions, in part, to signal the occurrence of conflicts in information processing, thereby triggering compensatory adjustments in cognitive control. Since this idea was first proposed, a great deal of relevant empirical evidence has accrued. This evidence has largely corroborated the conflict-monitoring hypothesis, and some very recent work has provided striking new support for the theory. At the same time, other findings have posed specific challenges, especially concerning (...) the way the theory addresses the processing of errors. Recent research has also begun to shed light on the larger function of the ACC, suggesting some new possibilities concerning how conflict monitoring might fit into the cingulate's overall role in cognition and action. (shrink)

In this paper, we analyze and calculate the crowd density in a tourist area utilizing video surveillance dynamic information analysis and divide the crowd counting and density estimation task into three stages. In this paper, novel scale perception module and inverse scale perception module are designed to further facilitate the mining of multiscale information by the counting model; the main function of the third stage is to generate the population distribution density map, which mainly consists of three columns of (...) void convolution with different void rates and generates the final population distribution density map using the feature maps of different branch regressions. Also, the algorithm uses jump connections between the top convolution and the bottom void convolution layers to reduce the risk of network gradient disappearance and gradient explosion and optimizes the network parameters using an intermediate supervision strategy. The hierarchical density estimator uses a hierarchical strategy to mine semantic features and multiscale information in a coarse-to-fine manner, and this is used to solve the problem of scale variation and perspective distortion. Also, considering that the background noise affects the quality of the generated density map, the soft attention mechanism is integrated into the model to stretch the distance between the foreground and background to further improve the quality of the density map. Also, inspired by multitask learning, this paper embeds an auxiliary count classifier in the count model to perform the count classification auxiliary task and to increase the model’s ability to express semantic information. Numerous experimental results demonstrate the effectiveness and feasibility of the proposed algorithm in solving the problems of scale variation and perspective distortion. (shrink)

Meditation is an umbrella term for a number of mental training practices designed to improve the monitoring and regulation of attention and emotion. Some forms of meditation are now being used for clinical intervention. To accompany the increased clinical interest in meditation, research investigating the neural basis of these practices is needed. A central hypothesis of contemplative neuroscience is that meditative states, which are unique on a phenomenological level, differ on a neurophysiological level. To identify the electrophysiological correlates of (...) meditation practice, the electrical brain activity of highly skilled meditators engaging in one of six meditation styles was recorded. A mind-wandering task served as a control. Lempel–Ziv complexity showed differences in nonlinear brain dynamics during meditation compared with mind wandering, suggesting that meditation, regardless of practice, affects neural complexity. In contrast, there were no differences in power spectra at six different frequency bands, likely due to the fact that participants engaged in different meditation practices. Finally, exploratory analyses suggest neurological differences among meditation practices. These findings highlight the importance of studying the electroencephalography correlates of different meditative practices. (shrink)

Arts, Real-Time Video and Interactivity for Sustainability is an ongoing collaborative research project investigating how real-time video, DIY surveillance technologies and sensor data can be used as a tool for environmental awareness, activism and artistic explorations. The project consists of a series of digital contexts for aesthetic contemplation of nature and civic engagement, aiming to foster awareness and empowerment of local populations through DIY surveillance. At the core of the ARTIVIS efforts are a series of interactive installations, that (...) make use of surveillance technologies and real-time video as raw material to promote environmental awareness through the emotion generated by real-time connections with nature. Throughout the project development, the surveillance concept has been shifting from the use of surveillance technology in a centralized platform, to the idea of veillance with distributed peer-to-peer networks that can be used for science and environmental monitoring. In this paper we present the history of the ARTiVIS project, related and inspiring work, describe ongoing research work and explore the present and future challenges of appropriating surveillance technology for artistic, educational and civic engagement purposes. (shrink)

In some young children brought by their parents for diagnosis of acute life-threatening events investigations suggested imposed apnoea as the cause rather than spontaneous occurrence. Covert video surveillance of the cot in which the baby was monitored allowed confirmation or rebuttal of this diagnosis. That parents were not informed of the video recording was essential for diagnosis and we assert ethically justifiable as the child was the patient to whom a predominant duty of care was owed. The procedure (...) also avoids the risk of separation of child from parent on inadequate information. (shrink)

In this paper, we study the face recognition and emotion recognition algorithms to monitor the emotions of preschool children. For previous emotion recognition focusing on faces, we propose to obtain more comprehensive information from faces, gestures, and contexts. Using the deep learning approach, we design a more lightweight network structure to reduce the number of parameters and save computational resources. There are not only innovations in applications, but also algorithmic enhancements. And face annotation is performed on the dataset, while a (...) hierarchical sampling method is designed to alleviate the data imbalance phenomenon that exists in the dataset. A new feature descriptor, called “oriented gradient histogram from three orthogonal planes,” is proposed to characterize facial appearance variations. A new efficient geometric feature is also proposed to capture facial contour variations, and the role of audio methods in emotion recognition is explored. Multifeature fusion can be used to optimally combine different features. The experimental results show that the method is very effective compared to other recent methods in dealing with facial expression recognition problems about videos in both laboratory-controlled environments and outdoor environments. The method performed experiments on expression detection in a facial expression database. The experimental results are compared with data from previous studies and demonstrate the effectiveness of the proposed new method. (shrink)

Car sickness is a major concern for car passengers, and with the development of autonomous vehicles, increasing numbers of car occupants are likely to be affected. Previous laboratory studies have used EEG measurements to better understand the cerebral changes linked to symptoms. However, the dynamics of motion in labs/simulators differ from those of a real car. This study sought to identify specific cerebral changes associated with the level of car sickness experienced in real driving conditions. Nine healthy volunteers participated as (...) front passengers in a slalom session inducing lateral movements at very low frequency. They were continuously monitored via EEG recordings and subjectively rated their level of symptoms after each slalom, using a 5-point likert scale. Car-sickness symptoms evolved concomitantly with changes in theta and alpha power in the occipital and parietal areas. These changes may reflect altered sensory integration, as well as a possible influence of sleepiness mitigating symptoms. (shrink)

Video surveillance is an omnipresent phenomenon in today’s metropolitan life. Mainly intended to solve crimes, to prevent them by realtime-monitoring or simply as a deterrent, video surveillance has also become interesting in economical contexts; e.g. to create customer profiles and analyse patterns of their shopping behaviour. The extensive use of video surveillance is challenged by legal claims and societal norms like not putting everybody under generalised suspicion or not recording people without their consent. In this work (...) we propose a technological solution to balance the positive and negative effects of video surveillance. With automatic image recognition algorithms on the rise, we suggest to use that technology to not just automatically identify people but blacken their images. This blackening is done with a cryptographic procedure allowing to revoke it with an appropriate key. Many of the legal and ethical objections to video surveillance could thereby be accommodated. In commercial scenarios, the operator of a customer profiling program could offer enticements for voluntarily renouncing one’s anonymity. Customers could e.g. wear a small infrared LED to signal their agreement to being tracked. After explaining the implementation details, this work outlines a multidisciplinary discussion incorporating an economic, ethical and legal viewpoint. (shrink)

In the research of motion video, the existing target detection methods are susceptible to changes in the motion video scene and cannot accurately detect the motion state of the target. Moving target detection technology is an important branch of computer vision technology. Its function is to implement real-time monitoring, real-time video capture, and detection of objects in the target area and store information that users are interested in as an important basis for exercise. This article focuses (...) on how to efficiently perform motion detection on real-time video. By introducing the mathematical model of image processing, the traditional motion detection algorithm is improved and the improved motion detection algorithm is implemented in the system. This article combines the advantages of the widely used frame difference method, target detection algorithm, and background difference method and introduces the moving object detection method combining these two algorithms. When using Gaussian mixture model for modeling, improve the parts with differences, and keep the unmatched Gaussian distribution so that the modeling effect is similar to the actual background; the binary image is obtained through the difference between frames and the threshold, and the motion change domain is extracted through mathematical morphological filtering, and finally, the moving target is detected. The experiment proved the following: when there are more motion states, the recall rate is slightly better than that of the VIBE algorithm. It decreased about 0.05 or so, but the relative accuracy rate increased by about 0.12, and the increase ratio is significantly higher than the decrease ratio. Departments need to adopt effective target extraction methods. In order to improve the accuracy of moving target detection, this paper studies the method of background model establishment and target extraction and proposes its own improvement. (shrink)

It is a matter of fact that Europe is facing more and more crucial challenges regarding health and social care due to the demographic change and the current economic context. The recent COVID-19 pandemic has stressed this situation even further, thus highlighting the need for taking action. Active and Assisted Living technologies come as a viable approach to help facing these challenges, thanks to the high potential they have in enabling remote care and support. Broadly speaking, AAL can be referred (...) to as the use of innovative and advanced Information and Communication Technologies to create supportive, inclusive and empowering applications and environments that enable older, impaired or frail people to live independently and stay active longer in society. AAL capitalizes on the growing pervasiveness and effectiveness of sensing and computing facilities to supply the persons in need with smart assistance, by responding to their necessities of autonomy, independence, comfort, security and safety. The application scenarios addressed by AAL are complex, due to the inherent heterogeneity of the end-user population, their living arrangements, and their physical conditions or impairment. Despite aiming at diverse goals, AAL systems should share some common characteristics. They are designed to provide support in daily life in an invisible, unobtrusive and user-friendly manner. Moreover, they are conceived to be intelligent, to be able to learn and adapt to the requirements and requests of the assisted people, and to synchronise with their specific needs. Nevertheless, to ensure the uptake of AAL in society, potential users must be willing to use AAL applications and to integrate them in their daily environments and lives. In this respect, video- and audio-based AAL applications have several advantages, in terms of unobtrusiveness and information richness. Indeed, cameras and microphones are far less obtrusive with respect to the hindrance other wearable sensors may cause to one’s activities. In addition, a single camera placed in a room can record most of the activities performed in the room, thus replacing many other non-visual sensors. Currently, video-based applications are effective in recognising and monitoring the activities, the movements, and the overall conditions of the assisted individuals as well as to assess their vital parameters. Similarly, audio sensors have the potential to become one of the most important modalities for interaction with AAL systems, as they can have a large range of sensing, do not require physical presence at a particular location and are physically intangible. Moreover, relevant information about individuals’ activities and health status can derive from processing audio signals. Nevertheless, as the other side of the coin, cameras and microphones are often perceived as the most intrusive technologies from the viewpoint of the privacy of the monitored individuals. This is due to the richness of the information these technologies convey and the intimate setting where they may be deployed. Solutions able to ensure privacy preservation by context and by design, as well as to ensure high legal and ethical standards are in high demand. After the review of the current state of play and the discussion in GoodBrother, we may claim that the first solutions in this direction are starting to appear in the literature. A multidisciplinary debate among experts and stakeholders is paving the way towards AAL ensuring ergonomics, usability, acceptance and privacy preservation. The DIANA, PAAL, and VisuAAL projects are examples of this fresh approach. This report provides the reader with a review of the most recent advances in audio- and video-based monitoring technologies for AAL. It has been drafted as a collective effort of WG3 to supply an introduction to AAL, its evolution over time and its main functional and technological underpinnings. In this respect, the report contributes to the field with the outline of a new generation of ethical-aware AAL technologies and a proposal for a novel comprehensive taxonomy of AAL systems and applications. Moreover, the report allows non-technical readers to gather an overview of the main components of an AAL system and how these function and interact with the end-users. The report illustrates the state of the art of the most successful AAL applications and functions based on audio and video data, namely lifelogging and self-monitoring, remote monitoring of vital signs, emotional state recognition, food intake monitoring, activity and behaviour recognition, activity and personal assistance, gesture recognition, fall detection and prevention, mobility assessment and frailty recognition, and cognitive and motor rehabilitation. For these application scenarios, the report illustrates the state of play in terms of scientific advances, available products and research project. The open challenges are also highlighted. The report ends with an overview of the challenges, the hindrances and the opportunities posed by the uptake in real world settings of AAL technologies. In this respect, the report illustrates the current procedural and technological approaches to cope with acceptability, usability and trust in the AAL technology, by surveying strategies and approaches to co-design, to privacy preservation in video and audio data, to transparency and explainability in data processing, and to data transmission and communication. User acceptance and ethical considerations are also debated. Finally, the potentials coming from the silver economy are overviewed. (shrink)

One million cases of child maltreatment and twelve hundred child deaths due to abuse and neglect occur per year. But since many cases of abuse and neglect remain either unreported or unsubstantiated due to insufficient evidence, the number of children who are abused, neglected, and killed at the hands of family caregivers is probably higher. One approach to combat child abuse in the U.K. has been the employment of hospital-based covert video surveillance (CVS) to monitor parents suspected of Munchausen (...) Syndrome by Proxy (MSBP). The use of CVS, however, raises concerns about voluntary informed consent, research on human subjects, privacy, and the appropriateness of healthcare providers to conduct CVS. More broadly, the use of CVS raises concerns about the ethical life of healthcare institutions and their moral obligations to the families and communities they serve. The U.K. protocol for CVS is examined in light of these concerns. Three alternative CVS protocols and two procedures for selecting a protocol are then proposed for use in the U.S. The paper concludes that any CVS protocol selected for use by hospitals ought to be selected by means of open and democratic processes that permit community input and, subsequently, the possibility of a consensus on the moral status and scope of CVS. (shrink)

This study compares cognitive and emotional responses to 360-degree vs. static (2D) videos in terms of visual attention, brand recognition, engagement of the prefrontal cortex, and emotions. Hypotheses are proposed based on the interactivity literature, cognitive overload, advertising response model and motivation, opportunity, and ability theoretical frameworks, and tested using neurophysiological tools: electroencephalography, eye-tracking, electrodermal activity, and facial coding. The results revealed that gaze view depends on ad content, visual attention paid being lower in 360-degree FMCG ads than in (...) 2D ads. Brand logo recognition is lower in 360-degree ads than in 2D video ads. Overall, 360-degree ads for durable products increase positive emotions, which carries the risk of non-exposure to some of the ad content. In testing four ads for durable goods and fast-moving consumer goods (FMCG) this research explains the mechanism through which 360-degree video ads outperform standard versions. (shrink)

The ability of two Panepinto micro pigs and two Yorkshire pigs (Sus scrofa) to acquire a joystick-operated video-game task was investigated. Subjects were trained to manipulate a joystick that controlled movement of a cursor displayed on a computer monitor. The pigs were required to move the cursor to make contact with three-, two-, or one-walled targets randomly allocated for position on the monitor, and a reward was provided if the cursor collided with a target. The video-task acquisition required (...) conceptual understanding of the task, as well as skilled motor performance. Terminal performance revealed that all pigs were significantly above chance on first attempts to contact one-walled targets (p< 0.05). These results indicate that despite dexterity and visual constraints, pigs have the capacity to acquire a joystick-operated video-game task. Limitations in the joystick methodology suggest that future studies of the cognitive capacities of pigs and other domestic species may benefit from the use of touchscreens or other advanced computer-interfaced technology. (shrink)

Visiting a museum and seeing an original artwork can be a special experience. We use a survey and a set of hypothetical questions to explore how such experience would be affected by changes in how the artwork is seen. In a first study, participants imagined that they had travelled to see a painting that they particularly like. They discover that it is impossible to directly see the original painting. Three alternatives are offered: seeing an optical reflection (using a mirror), seeing (...) a video screening (a closed-circuit camera) or seeing a reproduction. In all cases it is made clear that the size, brightness, and resolution will match that of the original. In addition, these options could be within the same room as the original, in the room next door, or in a different building. Results show that physical distance did not affect significantly the responses. However, there was an overall preference for seeing a reproduction as opposed to an optical or digital image. Contrary to the idea that the original is always superior to a copy, many people felt that a direct view of a copy is a preferable experience than an indirect view. The second study was focused directly on the comparison between a mirror and a monitor. Here we highlighted the fact that for the mirror light coming from the mirror originated from the painting. Data were collected in Britain and in China. In both cases there was a clear preference for the mirror over the monitor. (shrink)

Grey parrots do not acquire referential English labels when tutored with videotapes displayed on CRT screens if socially isolated, reward for attempted labels is possible, trainers direct birds’ attention to the monitor, live video feed avoids habituation or one trainer repeats labels produced on video and rewards label attempts. Because birds learned referential labels from live tutor pairs in concurrent sessions, we concluded that video failed because input lacked live social interaction and modeling. Recent studies, however, suggest (...) that standard CRT monitor flickering could instead have prevented learning. Using an LCD monitor, we found that eliminating flickering did not enable birds to learn from video under conditions of limited social interaction. Results emphasize the role of social interaction in referential label learning and may generalize to other systems. (shrink)

Grey parrots do not acquire referential English labels when tutored with videotapes displayed on CRT screens if socially isolated, reward for attempted labels is possible, trainers direct birds’ attention to the monitor, live video feed avoids habituation or one trainer repeats labels produced on video and rewards label attempts. Because birds learned referential labels from live tutor pairs in concurrent sessions, we concluded that video failed because input lacked live social interaction and modeling. Recent studies, however, suggest (...) that standard CRT monitor flickering could instead have prevented learning. Using an LCD monitor, we found that eliminating flickering did not enable birds to learn from video under conditions of limited social interaction. Results emphasize the role of social interaction in referential label learning and may generalize to other systems. (shrink)

This article addresses how health professionals should monitor and safeguard their patients’ ability to participate in making clinical decisions and making subsequent decisions regarding the implementation of their treatment plan. Patient participation in clinical decision-making is essential, e.g. in self-care, where patients are responsible for most ongoing care. We argue that one common, fact-oriented patient education strategy may in practice easily tend to take a destructive form that we call error trawling. Illustrating with empirical findings from a video study (...) of consultations between clinicians and adolescent patients with diabetes, we argue on independent grounds that this strategy not only risks to overlook significant weaknesses in patient decision competence, but also to undermine patient capacity for decision-making and implementing care. In effect, this strategy for clinically monitoring and addressing the problem of fragile decision-making capacity brings hazards in need of address. We clo... (shrink)

Passive Brain-Computer interfaces (pBCIs) are a human-computer communication tool where the computer can detect from neurophysiological signals the current mental or emotional state of the user. The system can then adjust itself to guide the user towards a desired state. One challenge facing developers of pBCIs is that the system's parameters are generally set at the onset of the interaction and remain stable throughout, not adapting to potential changes over time such as fatigue. The goal of this paper is to (...) investigate the improvement of pBCIs with settings adjusted according to the information provided by a second neurophysiological signal. With the use of a second signal, making the system a hybrid pBCI, those parameters can be continuously adjusted with dynamic thresholding to respond to variations such as fatigue or learning. In this experiment, we hypothesize that the adaptive system with dynamic thresholding will improve perceived game experience and objective game performance compared to two other conditions: an adaptive system with single primary signal biocybernetic loop and a control non-adaptive game. A within-subject experiment was conducted with 16 participants using three versions of the game Tetris. Each participant plays 15 minutes of Tetris under three experimental conditions. The control condition is the traditional game of Tetris with a progressive increase in speed. The second condition is a cognitive load only biocybernetic loop with the parameters presented in Ewing et al. (2016). The third condition is our proposed biocybernetic loop using dynamic threshold selection. Electroencephalography was used as the primary signal and automatic facial expression analysis as the secondary signal. Our results show that, contrary to our expectations, the adaptive systems did not improve the participants' experience as participants had more negative affect from the BCI conditions than in the control condition. We endeavored to develop a system that improved upon the authentic version of the Tetris game, however, our proposed adaptive system neither improved players’ perceived experience, nor their objective performance. Nevertheless, this experience can inform developers of hybrid passive BCIs on a novel way to employ various neurophysiological features simultaneously. (shrink)

As guidelines for neonatal resuscitation evolve from a growing evidence base, clinicians must ensure that practice is closely aligned with the available evidence, based on methodologically sound and ethically conducted research. This paper reviews ethical, legal and risk-management issues arising during the design of a quality-assurance project to make video recordings of neonatal resuscitations after high-risk deliveries. The issues, which affect patients, researchers, staff and the hospital at large, include the following: 1) Informed consent for research involving emergency procedures (...) is often not possible, for lack of time to provide sufficient information. The mental capacity of the subject or parent may be compromised by the impending emergency, and freedom of choice is threatened by the time pressure to consent. 2) Video recording of the inevitable medical errors raises issues of whether participating staff may be identifiable and accountable, affecting their willingness to participate in such research. The approach to staff participation and identification is reviewed. 3) The use of video data for education threatens the privacy of research subjects. The ethics of maintaining privacy is balanced with the ethics of using the data to improve practice of resuscitation. 4) The research subjects (patients, or the staff whose performance is being monitored) must be defined. 5) There are legal and ethical aspects of management and ownership of data. 6) The role of the Human Research Ethics Committee in protecting the research subject and possibly the medicolegal interests of the hospital is discussed. This paper reviews the literature and discusses the issues. (shrink)

Exercise may influence components of executive functioning, specifically cognitive control and action monitoring. We aimed to determine whether high level exercise improves the efficacy of cognitive control in response to differing levels of conflict. Fitter individuals were expected to demonstrate enhanced action monitoring and optimal levels of cognitive control in response to changing task demands. Participants were divided into the highly active or low-active group based on self-reported activity using the International Physical Activity Questionnaire. A modified flanker task (...) was then performed, in which the level of conflict was modulated by distance of distractors from the target and congruency of arrows. Electroencephalography was collected during 800 trials; trials were 80% congruent, 20% incongruent, 50% close, and 50% far. The error-related negativity and error positivity were extracted from the difference wave of correct and incorrect response locked epochs, the N2 from the difference wave of congruent and incongruent stimulus locked epochs and the P3 from stimulus locked epochs. The HA group showed a larger Pe amplitude compared to the low-active group. Close trials elicited a larger N2 amplitude than far trials in the HA group, but not the low-active group, the HA group also made fewer errors on far trials than on close trials. Finally, the P3 was smaller in the lowest conflict condition in the HA, but not the low-active group. These findings suggest that habitual, high levels of exercise may influence the endogenous processing involved in pre-response conflict detection and the post-error response. (shrink)

Ambient assisted living technologies are increasingly presented and sold as essential smart additions to daily life and home environments that will radically transform the healthcare and wellness markets of the future. An ethical approach and a thorough understanding of all ethics in surveillance/monitoring architectures are therefore pressing. AAL poses many ethical challenges raising questions that will affect immediate acceptance and long-term usage. Furthermore, ethical issues emerge from social inequalities and their potential exacerbation by AAL, accentuating the existing access gap (...) between high-income countries and low and middle-income countries. Legal aspects mainly refer to the adherence to existing legal frameworks and cover issues related to product safety, data protection, cybersecurity, intellectual property, and access to data by public, private, and government bodies. Successful privacy-friendly AAL applications are needed, as the pressure to bring Internet of Things devices and ones equipped with artificial intelligence quickly to market cannot overlook the fact that the environments in which AAL will operate are mostly private. The social issues focus on the impact of AAL technologies before and after their adoption. Future AAL technologies need to consider all aspects of equality such as gender, race, age and social disadvantages and avoid increasing loneliness and isolation among, e.g. older and frail people. Finally, the current power asymmetries between the target and general populations should not be underestimated nor should the discrepant needs and motivations of the target group and those developing and deploying AAL systems. Whilst AAL technologies provide promising solutions for the health and social care challenges, they are not exempt from ethical, legal and social issues. A set of ELSI guidelines is needed to integrate these factors at the research and development stage. (shrink)

Media is the principal source of public information, and people's trust in news has been a critical mechanism in social cohesion. In recent years, the vast growth of new media has brought huge change to the way information is conveyed, cannibalizing much of the space of traditional media. This has led to renewed attention on media credibility. The study aims to explore the impact of media channel on trust in news and examine the role of news type. Twenty-six participants were (...) asked to make trust–distrust decisions after reading a variety of news headlines from different media channels while undergoing electroencephalography monitoring. The electrophysiological results showed that, for hard news, the new media condition elicited smaller N100 and larger P200 amplitudes than the traditional media condition. However, for soft news, there was no significant difference. The study suggests that the fitness of media channel and news type may influence the evaluation of news, impacting participants' affective arousal and attention allocation in the early stage and influencing trust in news. These results provide neurocognitive evidence of individuals' trust toward hard and soft news consumed via different media channels, yielding new insights into trust in media and contributing to media trust theory. (shrink)

Epilepsy surgery is the most effective therapeutic approach for children with drug resistant epilepsy. Recent advances in neurosurgery, such as the Laser Interstitial Thermal Therapy, improved the safety and non-invasiveness of this method. Electric and magnetic source imaging plays critical role in the delineation of the epileptogenic focus during the presurgical evaluation of children with DRE. Yet, they are currently underutilized even in tertiary epilepsy centers. Here, we present a case of an adolescent who suffered from DRE for 16 years (...) and underwent surgery at Cook Children's Medical Center. The patient was previously evaluated in a level 4 epilepsy center and treated with multiple antiseizure medications for several years. Presurgical evaluation at CCMC included long-term video electroencephalography, magnetoencephalography with simultaneous conventional EEG and high-density EEG in two consecutive sessions, MRI, and fluorodeoxyglucose - positron emission tomography. Video long-term EEG captured nine focal-onset clinical seizures with a maximal evolution over the right frontal/frontal midline areas. MRI was initially interpreted as non-lesional. FDG-PET revealed a small region of hypometabolism at the anterior right superior temporal gyrus. ESI and MSI performed with dipole clustering showed a tight cluster of dipoles in the right anterior insula. The patient underwent intracranial EEG which indicated the right anterior insular as seizure onset zone. Eventually LITT rendered the patient seizure free. Retrospective analysis of ESI and MSI clustered dipoles found a mean distance of dipoles from the ablated volume ranging from 10 to 25 mm. Our findings highlight the importance of recent technological advances in the presurgical evaluation and surgical treatment of children with DRE, and the underutilization of epilepsy surgery in children with DRE. (shrink)

Brain monitoring combined with automatic analysis of EEGs provides a clinical decision support tool that can reduce time to diagnosis and assist clinicians in real-time monitoring applications (e.g., neurological intensive care units). Clinicians have indicated that a sensitivity of 95% with specificity below 5% was the minimum requirement for clinical acceptance. In this study, a high-performance automated EEG analysis system based on principles of machine learning and big data is proposed. This hybrid architecture integrates hidden Markov models (HMMs) (...) for sequential decoding of EEG events with deep learning-based postprocessing that incorporates temporal and spatial context. These algorithms are trained and evaluated using the Temple University Hospital EEG, which is the largest publicly available corpus of clinical EEG recordings in the world. This system automatically processes EEG records and classifies three patterns of clinical interest in brain activity that might be useful in diagnosing brain disorders: (1) spike and/or sharp waves, (2) generalized periodic epileptiform discharges, (3) periodic lateralized epileptiform discharges. It also classifies three patterns used to model the background EEG activity: (1) eye movement, (2) artifacts and (3) background. Our approach delivers a sensitivity above 90% while maintaining a specificity below 5%. We also demonstrate that this system delivers a low false alarm rate, which is critical for any spike detection application. (shrink)

While often presented as promising assistive technologies for motor-impaired users, electroencephalography (EEG)-based Brain-Computer Interfaces (BCIs) remain barely used outside laboratories due to low reliability in real-life conditions. There is thus a need to design long-term reliable BCIs that can be used outside-of-the-lab by end-users, e.g., severely motor-impaired ones. Therefore, we propose and evaluate the design of a multi-class Mental Task (MT)-based BCI for longitudinal training (20 sessions over 3 months) of a tetraplegic user for the CYBATHLON BCI series 2019. (...) In this BCI championship, tetraplegic pilots are mentally driving a virtual car in a racing video game. We aimed at combining a progressive user MT-BCI training with a newly designed machine learning pipeline based on adaptive Riemannian classifiers shown to be promising for real-life applications. We followed a two step training process: the first 11 sessions served to train the user to control a 2-class MT-BCI by performing either two cognitive tasks (REST and MENTAL SUBTRACTION) or two motor-imagery tasks (LEFT-HAND and RIGHT-HAND). The second training step (9 remaining sessions) applied an adaptive, session-independent Riemannian classifier that combined all 4 MT classes used before. Moreover, as our Riemannian classifier was incrementally updated in an unsupervised way it would capture both within and between-session non-stationarity. Experimental evidences confirm the effectiveness of this approach. Namely, the classification accuracy improved by about 30% at the end of the training compared to initial sessions. We also studied the neural correlates of this performance improvement. Using a newly proposed BCI user learning metric, we could show our user learned to improve his BCI control by producing EEG signals matching increasingly more the BCI classifier training data distribution, rather than by improving his EEG class discrimination. However, the resulting improvement was effective only on synchronous (cue-based) BCI and it did not translate into improved CYBATHLON BCI game performances. For the sake of overcoming this in the future, we unveil possible reasons for these limited gaming performances and identify a number of promising future research directions. Importantly, we also report on the evolution of the user's neurophysiological patterns and user experience throughout the BCI training and competition. (shrink)

Two stages of the creative writing process were characterized through mobile scalp electroencephalography in a 16-week creative writing workshop. Portable dry EEG systems with synchronized head acceleration, video recordings, and journal entries, recorded mobile brain-body activity of Spanish heritage students. Each student's brain-body activity was recorded as they experienced spaces in Houston, Texas, and while they worked on their creative texts. We used Generalized Partial Directed Coherence to compare the functional connectivity among both stages. There was a trend (...) of higher gPDC in the Preparation stage from right temporo-parietal to left anterior-frontal brain scalp areas within 1–50 Hz, not reaching statistical significance. The opposite directionality was found for the Generation stage, with statistical significant differences restricted to the delta band. There was statistically higher gPDC observed for the inter-hemispheric connections AF07–AF08 in the delta and theta bands, and AF08 to TP09 in the alpha and beta bands. The left anterior-frontal recordings showed higher power localized to the gamma band for the Generation stage. An ancillary analysis of Sample Entropy did not show significant difference. The information transfer from anterior-frontal to temporal-parietal areas of the scalp may reflect multisensory interpretation during the Preparation stage, while brain signals originating at temporal-parietal toward frontal locations during the Generation stage may reflect the final decision making process to translate the multisensory experience into a creative text. (shrink)

Brain states, which correlate with specific motor, cognitive, and emotional states, may be monitored with noninvasive techniques such as electroencephalography and magnetoencephalography that measure macroscopic cortical activity manifested as oscillatory network dynamics. These rhythmic cortical signatures provide insight into the neuronal activity used to identify pathological cortical function in numerous neurological and psychiatric conditions. Sensory and transcranial stimulation, entraining the brain with specific brain rhythms, can effectively induce desired brain states correlated with such cortical rhythms. Because brain states have (...) distinct neural correlates, it may be possible to induce a desired brain state by replicating these neural correlates through stimulation. To do so, we propose recording brain waves from a “donor” in a particular brain state using EEG/MEG to extract cortical signatures of the brain state. These cortical signatures would then be inverted and used to entrain the brain of a “recipient” via sensory or transcranial stimulation. We propose that brain states may thus be transferred between people by acquiring an associated cortical signature from a donor, which, following processing, may be applied to a recipient through sensory or transcranial stimulation. This technique may provide a novel and effective neuromodulation approach to the noninvasive, non-pharmacological treatment of a variety of psychiatric and neurological disorders for which current treatments are mostly limited to pharmacotherapeutic interventions. (shrink)

Live streaming shopping, the streaming of real-time videos promoting products that consumers can purchase online, has recently been a booming area of e-commerce, especially during the COVID-19 pandemic. The success of live streaming e-commerce largely relies on the extent to which the broadcaster can get consumers engaged by the live stream. Thus, it is important to discover the antecedents of consumer engagement in such a context. Drawing on consumer engagement and neuroscience literature, this study used electroencephalography inter-subject correlation to (...) explore how broadcasters' entrepreneurial passion during live streaming videos influenced consumers' neural engagement as they watched the live streaming videos. We used the framework of displayed passion and preparedness from the entrepreneurial passion literature to predict consumer engagement. We found significant ISC for strong displayed passion, while preparedness had partially significant effects on the first, second, and summed components of ISC. The interaction effects of these two factors on the first and summed components of ISC were partially significant. Strong displayed passion and preparedness activated the left and right prefrontal regions of the consumers' brains. These findings indicate that broadcasters' displayed passion and preparedness can influence consumer engagement in live streaming e-commerce settings. Our findings suggest that a scientific approach could be used to improve a broadcaster's performance by testing ISC during rehearsals before live streaming. (shrink)

Despite technological and interpretative advances, the non-invasive modalities used for pre-surgical evaluation of patients with drug-resistant epilepsy, fail to generate a concordant anatomo-electroclinical hypothesis for the location of the seizure onset zone in many patients. This requires chronic monitoring with intracranial electroencephalography, which facilitates better localization of the seizure onset zone, and allows evaluation of the functional significance of cortical regions-of-interest by electrical stimulation mapping. There are two principal modalities for intracranial EEG, namely subdural electrodes and stereotactic depth (...) electrodes. Although ESM is considered the gold standard for functional mapping with subdural electrodes, there have been concerns about its utility with stereo-EEG. This is mainly because subdural electrodes allow contiguous sampling of the dorsolateral convexity of cerebral hemispheres, and permit delineation of the extent of eloquent functional areas on the cortical surface. Stereo-EEG, while having relatively sparse sampling on the cortical surface, offers the ability to access the depth of sulci, mesial and basal surfaces of cerebral hemispheres, and deep structures such as the insula, which are largely inaccessible to subdural electrodes. As stereo-EEG is increasingly the preferred modality for intracranial monitoring, we find it opportune to summarize the literature for ESM with stereo-EEG in this narrative review. Emerging evidence shows that ESM for defining functional neuroanatomy is feasible with stereo-EEG, but probably requires a different approach for interpretation and clinical decision making compared to ESM with subdural electrodes. We have also compared ESM with stereo-EEG and subdural electrodes, for current thresholds required to evoke desired functional responses vs. unwanted after-discharges. In this regard, there is preliminary evidence that ESM with stereo-EEG may be safer than ESM with subdural grids. Finally, we have highlighted important unanswered clinical and scientific questions for ESM with stereo-EEG in the hope to encourage future research and collaborative efforts. (shrink)

More than 200 million children under the age of 5 years are affected by malnutrition worldwide according to the World Health Organization. The Barbados Nutrition Study (BNS) is a 55-year longitudinal study on a Barbadian cohort with histories of moderate to severe protein-energy malnutrition (PEM) limited to the first year of life and a healthy comparison group. Using quantitative electroencephalography (EEG), differences in brain function duringchildhood(lower alpha1 activity and higher theta, alpha2 and beta activity) have previously been highlighted between (...) participants who suffered from early PEM and controls. In order to determine whether similar differences persisted intoadulthood, our current study used recordings obtained during a Go-No-Go task in a subsample of the original BNS cohort [population size (N) = 53] at ages 45–51 years. We found that previously malnourished adults [sample size (n) = 24] had a higher rate of omission errors on the task relative to controls (n= 29). Evoked-Related Potentials (ERP) were significantly different in participants with histories of early PEM, who presented with lower N2 amplitudes. These findings are typically associated with impaired conflict monitoring and/or attention deficits and may therefore be linked to the attentional and executive function deficits that have been previously reported in this cohort in childhood and again in middle adulthood. (shrink)

The Malnutrition-Inflammation Score was initially proposed to evaluate malnutrition-inflammation complex syndrome in end-stage renal disease patients. Although MICS should be routinely evaluated to reduce the hospitalization and mortality rate of ESRD patients, the inconvenience of the MIS might limit its use. Cerebral complications in ESRD, possibly induced by MICS, were previously assessed by using spectral electroencephalography via the delta/theta ratio and microstate analysis. Correspondingly, EEG could be used to directly assess MICS in ESRD patients, but the relationships among MICS (...) and these EEG features remain inconclusive. Thus, we aimed to investigate the delta/theta ratio and microstates in ESRD patients with high and low risks of MICS. We also attempted to identify the correlation among the MIS, delta/theta ratio, and microstate parameters, which might clarify their relationships. To achieve these objectives, a total of forty-six ESRD subjects were willingly recruited. We collected their blood samples, MIS, and EEGs after receiving written informed consent. Sixteen women and seven men were allocated to low risk group. Additionally, high risk group contains 15 women and 8 men. Here, we discovered that delta/theta ratio and most microstate parameters were significantly different between subject groups. We also found that the delta/theta ratio was not correlated with MIS but was strongly with the average microstate duration ; hence, we suggested that the average microstate duration might serve as an alternative encephalopathy biomarker. Coincidentally, we noticed positive correlations for most parameters of microstates A and B and stronger negative correlations for all microstate C parameters. These findings unveiled a novel EEG biomarker, the MIC index, that could efficiently distinguish ESRD patients at high and low risk of MICS when utilized as a feature in a binary logistic regression model. We expected that the average microstate duration and MIC index might potentially contribute to monitor ESRD patients in the future. (shrink)

In a Mental Imagery Brain-Computer Interface the user has to perform a specific mental task that generates electroencephalography components, which can be translated in commands to control a BCI system. The development of a high-performance MI-BCI requires a long training, lasting several weeks or months, in order to improve the ability of the user to manage his/her mental tasks. This works aims to present the design of a MI-BCI combining mental imaginary and cognitive tasks for a severely motor impaired (...) user, involved in the BCI race of the Cybathlon event, a competition of people with severe motor disability. In the BCI-race, the user becomes a pilot in a virtual race game against up to three other pilots, in which each pilot has to control his/her virtual car by his/her mental tasks. We present all the procedures followed to realize an effective MI-BCI, from the user's first contact with a BCI technology to actually controlling a video-game through her EEG. We defined a multi-stage user-centered training protocol in order to successfully control a BCI, even in a stressful situation, such as that of a competition. We put a specific focus on the human aspects that influenced the long training phase of the system and the participation to the competition. (shrink)

Adaptive behavior critically depends on performance monitoring, the ability to monitor action outcomes and the need to adapt behavior. PM-related brain activity has been linked to guiding decisions about whether action adaptation is warranted. The present study examined whether PM-related brain activity in a flanker task, as measured by electroencephalography, was associated with adaptive behavior in daily life. Specifically, we were interested in the employment of self-control, operationalized as self-control failures, and measured using ecological momentary assessment. Analyses were (...) conducted using an adaptive elastic net regression to predict SCFs from EEG in a sample of 131 participants. The model was fit using within-subject averaged response-locked EEG activity at each electrode and time point within an epoch surrounding the response. We found that higher amplitudes of the error-related negativity were related to fewer SCFs. This suggests that lower error-related activity may relate to lower recruitment of interventive self-control in daily life. Altered cognitive control processes, like PM, have been proposed as underlying mechanisms for various mental disorders. Understanding how alterations in PM relate to regulatory control might therefore aid in delineating how these alterations contribute to different psychopathologies. (shrink)

Micro-expressions can reflect an individual’s subjective emotions and true mental state, and they are widely used in the fields of mental health, justice, law enforcement, intelligence, and security. However, one of the major challenges of working with MEs is that their neural mechanism is not entirely understood. To the best of our knowledge, the present study is the first to use electroencephalography to investigate the reorganizations of functional brain networks involved in MEs. We aimed to reveal the underlying neural (...) mechanisms that can provide electrophysiological indicators for ME recognition. A real-time supervision and emotional expression suppression experimental paradigm was designed to collect video and EEG data of MEs and no expressions of 70 participants expressing positive emotions. Based on the graph theory, we analyzed the efficiency of functional brain network at the scalp level on both macro and micro scales. The results revealed that in the presence of MEs compared with NEs, the participants exhibited higher global efficiency and nodal efficiency in the frontal, occipital, and temporal regions. Additionally, using the random forest algorithm to select a subset of functional connectivity features as input, the support vector machine classifier achieved a classification accuracy for MEs and NEs of 0.81, with an area under the curve of 0.85. This finding demonstrates the possibility of using EEG to recognize MEs, with a wide range of application scenarios, such as persons wearing face masks or patients with expression disorders. (shrink)

The Principles of Fair Information Practice are almost three decades old and need to be broadened to take account of new technologies for collecting personal information such as drug testing, video cameras, electronic location monitoring and the internet. I argue that the ethics of surveillance activity must be judged according to the means, the context and conditions of data collection and the uses/goals and suggest 29 questions related to this. The more one can answer these questions in a (...) way that affirms the underlying principle the more ethical the use of a tactic is likely to be. Four conditions are identified which, when breached, are likely to violate an individual's reasonable expectation of privacy. Respect for the dignity of the person is a central factor and emphasis is put on the avoidance of harm, validity, trust, notice and permission when crossing personal borders. (shrink)

Although the brain enables us to perceive the external world and our body, it remains unknown whether brain processes themselves can be perceived. Brain tissue does not have receptors for its own activity. However, the ability of humans to acquire self-control of brain processes indicates that the perception of these processes may also be achieved by learning. In this study patients learned to control low-frequency components of their EEG: the so-called slow cortical potentials (SCPs). In particular ''probe'' sessions, the patients (...) estimated the quality of the SCP shift they had produced in the preceding trial. The correspondence between the recorded SCP amplitudes and the subjective estimates increased with training. The ability to perceive the SCPs was related to the ability to control them; this perception was not mediated by peripheral variables such as changes in muscle tonus and cannot be reduced to simple vigilance monitoring. These data provide evidence that humans can learn to perceive the neural activity of their brain. Alternative interpretations are discussed. (shrink)

The coupled growth of population aging and international migration warrants attention on the methods and solutions available to adult children living overseas to provide distance caregiving for their aging parents. Despite living apart from their parents, the transnational informal care literature has indicated that first-generation immigrants remain committed to carry out their filial caregiving obligations in extensive and creative ways. With functions to remotely access health information enabled by emergency, wearable, motion, and video sensors, remote monitoring technologies (RMTs) (...) may thus also allow these international migrants to be alerted in sudden changes and remain informed of their parent’s state of health. As technological solutions for caregiving, RMTs could allow independent living for older persons while any unusual deviations from normal health patterns are detected and appropriately supported. With a vignette of a distance care arrangement, we engage with concepts such as filial piety, in-absentia caregiving distress, and the social exchange theory, as well as the upholding of shifting cultural ideals to illustrate the complex dynamic of the satisfaction and quality of the informal caregiving relationship. This paper extends the traditional ethical issues in technology-aided caregiving, such as autonomy, privacy, and justice, to be considered within the context of distance care. We also posit newer ethical considerations such as consent in power imbalances, harm to caregivers, and stigma. These known and new ethical issues aim to encourage further ethically conscious design and use of RMTs to support distance care for older persons. (shrink)

Smart-home technologies, comprising environmental sensors, wearables and video are attracting interest in home healthcare delivery. Development of such technology is usually justified on the basis of the technology’s potential to increase the autonomy of people living with long-term conditions. Studies of the ethics of smart-homes raise concerns about privacy, consent, social isolation and equity of access. Few studies have investigated the ethical perspectives of smart-home engineers themselves. By exploring the views of engineering researchers in a large smart-home project, we (...) sought to contribute to dialogue between ethics and the engineering community. Either face-to-face or using Skype, we conducted in-depth qualitative interviews with 20 early- and mid-career smart-home researchers from a multi-centre smart-home project, who were asked to describe their own experience and to reflect more broadly about ethical considerations that relate to smart-home design. With participants’ consent, interviews were audio-recorded, transcribed and analysed using a thematic approach. Two overarching themes emerged: in ‘Privacy’, researchers indicated that they paid close attention to negative consequences of potential unauthorised information sharing in their current work. However, when discussing broader issues in smart-home design beyond the confines of their immediate project, researchers considered physical privacy to a lesser extent, even though physical privacy may manifest in emotive concerns about being watched or monitored. In ‘Choice’, researchers indicated they often saw provision of choice to end-users as a solution to ethical dilemmas. While researchers indicated that choices of end-users may need to be restricted for technological reasons, ethical standpoints that restrict choice were usually assumed and embedded in design. The tractability of informational privacy may explain the greater attention that is paid to it. However, concerns about physical privacy may reduce acceptability of smart-home technologies to future end-users. While attention to choice suggests links with privacy, this may misidentify the sources of privacy and risk unjustly burdening end-users with problems that they cannot resolve. Separating considerations of choice and privacy may result in more satisfactory treatment of both. Finally, through our engagement with researchers as participants this study demonstrates the relevance of ethics as a critical partner to smart-home engineering. (shrink)

In the present study, we tested the effectiveness of color coding on the programming learning of students who were learning from video lectures. Effectiveness was measured using multimodal physiological measures, combining eye tracking and electroencephalography. Using a between-subjects design, 42 university students were randomly assigned to two video lecture conditions. The participants’ eye tracking and EEG signals were recorded while watching the assigned video, and their learning performance was subsequently assessed. The results showed that the color-coded (...) design was more beneficial than the grayscale design, as indicated by smaller pupil diameter, shorter fixation duration, higher EEG theta and alpha band power, lower EEG cognitive load, and better learning performance. The present findings have practical implications for designing slide-based programming learning video lectures; slides should highlight the format of the program code using color coding. (shrink)

In the automatic detection of epileptic seizures, the monitoring of critically ill patients with time varying EEG signals is an essential procedure in intensive care units. There is an increasing interest in using EEG analysis to detect seizure, and in this study we aim to get a better understanding of how to visualize the information in the EEG time-frequency feature, and design and train a novel random forest algorithm for EEG decoding, especially for multiple-levels of illness. Here, we propose (...) an automatic detection framework for epileptic seizure based on multiple time-frequency analysis approaches; it involves a novel random forest model combined with grid search optimization. The short-time Fourier transformation visualizes seizure features after normalization. The dimensionality of features is reduced through principal component analysis before feeding them into the classification model. The training parameters are optimized using grid search optimization to improve detection performance and diagnostic accuracy by in the recognition of three different levels epileptic of conditions (healthy subjects, seizure-free intervals, seizure activity). Our proposed model was used to classify 500 samples of raw EEG data, and multiple cross-validations were adopted to boost the modeling accuracy. Experimental results were evaluated by an accuracy, a confusion matrix, a receiver operating characteristic curve and an area under the curve. The evaluations indicated that our model achieved the more effective classification than some previous typical methods. Such a scheme for computer-assisted clinical diagnosis of seizures has a potential guiding significance, which not only relieves the suffering of patient with epilepsy to improve quality of life, but also helps neurologists reduce their workload. (shrink)

Eye gaze plays an important role in communication but understanding of its actual function or functions and the methods used to elucidate this have varied considerably. This systematized review was undertaken to summarize both the proposed functions of eye gaze in conversations of healthy adults and the methodological approaches employed. The eligibility criteria were restricted to a healthy adult population and excluded studies that manipulated eye gaze behavior. A total of 29 articles—quantitative, qualitative and mixed methods were returned, with a (...) wide range of methodological designs. The main areas of variability related to number of conversants, their familiarity and status, conversation topic, data collection tools—video and eye tracking—and definitions of eye gaze. The findings confirm that eye gaze facilitates turn yielding, plays a role in speech monitoring, prevents and repairs conversation breakdowns and facilitates intentional and unintentional speech interruptions. These findings were remarkably consistent given the variability in methods across the 29 articles. However, in relation to turn initiation, the results were less consistent, requiring further investigation. This review provides a starting point for future studies to make informed decisions about study methods for examining eye gaze and selecting variables of interest. (shrink)

In times of national crisis, citizens are often asked to trade liberty and privacy for security. And why not, it is argued, if we can obtain a fair amount of security for just a little privacy? The surveillance that enhances security need not be overly intrusive or life altering. It is not as if government agents need to physically search each and every suspect or those connected to a suspect. Advances in digital technology have made such surveillance relatively unobtrusive. (...) class='Hi'>Video monitoring, global positioning systems, airport body scanners, and biometric technologies, along with data surveillance, provide law enforcement officials with monitoring tools, without also unduly burdening those being watched. Against this view are those who maintain that we should be worried about trading privacy for security. Criminals and terrorists, it is argued, are nowhere near as dangerous as governments. There are too many examples for us to deny Lord Acton’s dictum that “power tends to corrupt, and absolute power corrupts absolutely.” If information control yields power and total information awareness radically expands that power, then we have good reason to pause before trading privacy for security. (shrink)

This article presents a study of how co-present individuals work out the nature of embodied engagement and disengagement displays by individuals with dementia in a Danish public care facility. Research has found that moderate to severe dementia may result, for example, in a lack of social engagement, apathy and problems in maintaining conversations. Research has, however, also found that co-present individuals indicate their right to unavailability for social interaction. This is accomplished through details of embodied and multimodal conduct such as (...) gaze behavior, which includes practices of glancing and gazing at co-present individuals or practices of gazing into space. These practices may coincide with indications of ‘lack of social engagement’ and ‘apathy’. This study falls within the framework of ethnomethodology and employs multimodal conversation analytic methods to show how co-present individuals monitor residents’ displays of engagement and disengagement, primarily gaze behavior and how they respond to them. The study is based on 20 hours of video-recordings. (shrink)