Researchers in the fields of sign language and gesture studies frequently present their participants with video stimuli showing actors performing linguistic signs or co-speech gestures. Up to now, such video stimuli have been mostly controlled only for some of the technical aspects of the video material, leaving open the possibility that systematic differences in video stimulus materials may be concealed in the actual motion properties of the actor’s movements. Computer vision methods such as OpenPose enable the fitting of body-pose (...) models to the consecutive frames of a video clip and thereby make it possible to recover the movements performed by the actor in a particular video clip without the use of a point-based or markerless motion-tracking system during recording. The OpenPoseR package provides a straightforward and reproducible way of working with these body-pose model data extracted from video clips using OpenPose, allowing researchers in the fields of sign language and gesture studies to quantify the amount of motion pertaining only to the movements performed by the actor in a video clip. These quantitative measures can be used for controlling differences in the movements of an actor in stimulus video clips or, for example, between different conditions of an experiment. In addition, the package also provides a set of functions for generating plots for data visualization, as well as an easy-to-use way of automatically extracting metadata from large sets of video files. (shrink)

With the rapid development of sports science, human motion recognition technology, as a new biometric recognition technology, has many advantages, such as noncontact target, long recognition distance, secret recognition process, and so on. Traditional human motion recognition technology is affected by environmental factors such as motion background, which is prone to rough edges of the recognized objects and loss of motion tracking information, thus further reducing the recognition accuracy. In this paper, the traditional snake model (...) will be improved and optimized to improve the defect of human motion model contour extraction, so as to realize the accurate repair of image contour; in terms of algorithm running time, this paper innovatively improves the construction process of the snake model, further improves the running time of model evaluation, and solves the concave contour problem of corresponding moving objects in the snake model. In order to solve the problem of accurate convergence, this paper improves the snake model of the average moving algorithm and sets the corresponding weight coefficient to distinguish the corresponding moving target background, so as to achieve the convergence of the differential concave contour. In order to verify the superiority of the improved optimized snake model, experiments are carried out in the corresponding database. The experimental results show that the contour of the moving object extracted by the improved snake model algorithm is complete and the segmentation effect is obvious. At the same time, the running speed of the whole algorithm has been significantly improved. (shrink)

In this paper, we track the motion of multiple targets in sports videos by a machine learning algorithm and study its tracking technique in depth. In terms of moving target detection, the traditional detection algorithms are analysed theoretically as well as implemented algorithmically, based on which a fusion algorithm of four interframe difference method and background averaging method is proposed for the shortcomings of interframe difference method and background difference method. The fusion algorithm uses the learning rate to (...) update the background in real time and combines morphological processing to correct the foreground, which can effectively cope with the slow change of the background. According to the requirements of real time, accuracy, and occupying less video memory space in intelligent video surveillance systems, this paper improves the streamlined version of the algorithm. The experimental results show that the improved multitarget tracking algorithm effectively improves the Kalman filter-based algorithm to meet the real-time and accuracy requirements in intelligent video surveillance scenarios. (shrink)

This study is to explore the gesture recognition and behavior tracking in swimming motion images under computer machine vision and to expand the application of moving target detection and tracking algorithms based on computer machine vision in this field. The objectives are realized by moving target detection and tracking, Gaussian mixture model, optimized correlation filtering algorithm, and Camshift tracking algorithm. Firstly, the Gaussian algorithm is introduced into target tracking and detection to reduce the filtering (...) loss and make the acquired motion posture more accurate. Secondly, an improved kernel-related filter tracking algorithm is proposed by training multiple filters, which can clearly and accurately obtain the motion trajectory of the monitored target object. Finally, it is proposed to combine the Kalman algorithm with the Camshift algorithm for optimization, which can complete the tracking and recognition of moving targets. The experimental results show that the target tracking and detection method can obtain the movement form of the template object relatively completely, and the kernel-related filter tracking algorithm can also obtain the movement speed of the target object finely. In addition, the accuracy of Camshift tracking algorithm can reach 86.02%. Results of this study can provide reliable data support and reference for expanding the application of moving target detection and tracking methods. (shrink)

In this paper, we use motion tracking technology to document the birth of a brand new language: Nicaraguan Sign Language. Languages are dynamic entities that undergo change and growth through use, transmission, and learning, but the earliest stages of this process are generally difficult to observe as most languages have been used and passed down for many generations. Here, we observe a rare case of language emergence: the earliest stages of the new sign language in Nicaragua. By comparing (...) the signing of the oldest and youngest signers of Nicaraguan Sign Language, we can track how the language itself is changing. Using motion tracking technology, we document a decrease in the size of articulatory space of Nicaraguan Sign Language signers over time. The reduction in articulatory space in Nicaraguan Sign appears to be the joint product of several decades of use and repeated transmission of this new language. (shrink)

In three experiments, subjects attempted to track multiple items as they moved independently and unpredictably about a display. Performance was not impaired when the items were briefly (but completely) occluded at various times during their motion, suggesting that occlusion is taken into account when computing enduring perceptual objecthood. Unimpaired performance required the presence of accretion and deletion cues along fixed contours at the occluding boundaries. Performance was impaired when items were present on the visual field at the same times (...) and to the same degrees as in the occlusion conditions, but disappeared and reappeared in ways which did not implicate the presence of occluding surfaces (e.g. by imploding and exploding into and out of existence, instead of accreting and deleting along a fixed contour). Unimpaired performance did not require visible occluders (i.e. Michotte’s tunnel effect) or globally consistent occluder positions. We discuss implications of these results for theories of objecthood in visual attention. (shrink)

At present, the motion control algorithms of lower limb exoskeleton robots have errors in tracking the desired trajectory of human hip and knee joints, which leads to poor follow-up performance of the human-machine system. Therefore, an iterative learning control algorithm is proposed to track the desired trajectory of human hip and knee joints. In this paper, the experimental platform of lower limb exoskeleton rehabilitation robot is built, and the control system software and hardware design and robot prototype function (...) test are carried out. On this basis, a series of experiments are carried out to verify the rationality of the robot structure and the feasibility of the control method. Firstly, the dynamic model of the lower limb exoskeleton robot is established based on the structure analysis of the human lower limb; secondly, the servo control model of the lower limb exoskeleton robot is established based on the iterative learning control algorithm; finally, the exponential gain closed-loop system is designed by using MATLAB software. The relationship between convergence speed and spectral radius is analyzed, and the expected trajectory of hip joint and knee joint is obtained. The simulation results show that the algorithm can effectively improve the gait tracking accuracy of the lower limb exoskeleton robot and improve the follow-up performance of the human-machine system. (shrink)

Motion pose capture technology can effectively solve the problem of difficulty in defining character motion in the process of 3D animation production and greatly reduce the workload of character motion control, thereby improving the efficiency of animation development and the fidelity of character motion. Motion gesture capture technology is widely used in virtual reality systems, virtual training grounds, and real-time tracking of the motion trajectories of general objects. This paper proposes an attitude estimation (...) algorithm adapted to be embedded. The previous centralized Kalman filter is divided into two-step Kalman filtering. According to the different characteristics of the sensors, they are processed separately to isolate the cross-influence between sensors. An adaptive adjustment method based on fuzzy logic is proposed. The acceleration, angular velocity, and geomagnetic field strength of the environment are used as the input of fuzzy logic to judge the motion state of the carrier and then adjust the covariance matrix of the filter. The adaptive adjustment of the sensor is converted to the recognition of the motion state. For the study of human motion posture capture, this paper designs a verification experiment based on the existing robotic arm in the laboratory. The experiment shows that the studied motion posture capture method has better performance. The human body motion gesture is designed for capturing experiments, and the capture results show that the obtained pose angle information can better restore the human body motion. A visual model of human motion posture capture was established, and after comparing and analyzing with the real situation, it was found that the simulation approach reproduced the motion process of human motion well. For the research of human motion recognition, this paper designs a two-classification model and human daily behaviors for experiments. Experiments show that the accuracy of the two-category human motion gesture capture and recognition has achieved good results. The experimental effect of SVC on the recognition of two classifications is excellent. In the case of using all optimization algorithms, the accuracy rate is higher than 90%, and the final recognition accuracy rate is also higher than 90%. In terms of recognition time, the time required for human motion gesture capture and recognition is less than 2 s. (shrink)

Many events that humans and other species experience contain regularities in which certain elements within an event predict certain others. While some of these regularities involve tracking the co‐occurrences between temporally adjacent stimuli, others involve tracking the co‐occurrences between temporally distant stimuli (i.e., nonadjacent dependencies, NADs). Prior research shows robust learning of adjacent dependencies in humans and other species, whereas learning NADs is more difficult, and often requires support from properties of the stimulus to help learners notice the (...) NADs. Here, we report on seven experiments that examined NAD learning from various types of visual stimuli, exploring the effects of dynamic motion on adults' NAD learning from visual sequences involving human and nonhuman agents. We tested adults' NAD learning from visual sequences of human actions, object transformations, static images of human postures, and static images of an object in different postures. We found that dynamic motion aids the acquisition of NADs. We also found that learning NADs in sequences involving human agents is more robust compared to sequences involving nonhuman objects. We propose that dynamic motion and human agents both independently result in richer representations that provide a stronger signal for NAD learning. (shrink)

A classic problem in general relativity, long studied by both physicists and philosophers of physics, concerns whether the geodesic principle may be derived from other principles of the theory, or must be posited independently. In a recent paper [Geroch & Weatherall, "The Motion of Small Bodies in Space-Time", Comm. Math. Phys. ], Bob Geroch and I have introduced a new approach to this problem, based on a notion we call "tracking". In the present paper, I situate the main (...) results of that paper with respect to two other, related approaches, and then make some preliminary remarks on the interpretational significance of the new approach. My main suggestion is that "tracking" provides the resources for eliminating "point particles"---a problematic notion in general relativity---from the geodesic principle altogether. (shrink)

In this paper, we simulate the estimation of motion through an interframe difference detection function model and investigate the spatial-temporal context information correlation filtering target tracking algorithm, which is complex and computationally intensive. The basic theory of spatiotemporal context information and correlation filtering is studied to construct a fast target tracking method. The different computational schemes are designed for the flow of multiframe target detection from background removal to noise reduction, to single-frame detection, and finally to multiframe (...) detection, respectively. This enables the ground-based telescope to effectively detect spatial targets in dense stellar backgrounds in both modes. The method is validated by simulations and experiments and can meet the requirements of real projects. The interframe bit attitude estimation is optimized by using the beam-parity method to reduce the interframe estimation noise; a global optimization strategy based on the bit attitude map is used in the back end to reduce the system computation amount and make the global bit attitude estimation more accurate; a loop detection based on the word pocket model is added to the system to reduce the cumulative error. (shrink)

Our ability to select relevant information from the environment is limited by the resolution of attention – i.e., the minimum size of the region that can be selected. Neural mechanisms that underlie this limit and its development are not yet understood. Functional MRI was performed during an object tracking task in 7- and 11-year-old children, and in young adults. Object tracking activated canonical fronto-parietal attention systems and motion-sensitive area MT in children as young as 7 years. Object (...) tracking performance improved with age, together with stronger recruitment of parietal attention areas and a shift from low-level to higher-level visual areas. Increasing the required resolution of spatial attention – which was implemented by varying the distance between target and distractors in the object tracking task – led to activation increases in fronto-insular cortex, medial frontal cortex including anterior cingulate cortex (ACC) and supplementary motor area, superior colliculi, and thalamus. This core circuitry for attentional precision was recruited by all age groups, but ACC showed an age-related activation reduction. Our results suggest that age-related improvements in selective visual attention and in the resolution of attention are characterized by an increased use of more functionally specialized brain regions during the course of development. (shrink)

Dynamic vision sensor is a kind of bioinspired sensor. It has the characteristics of fast response, large dynamic range, and asynchronous output event stream. These characteristics make it have advantages that traditional image sensors do not have in the field of tracking. The output form of the dynamic vision sensor is asynchronous event stream, and the object information needs to be provided by the relevant event cluster. This article proposes a method based on the event correlation index to obtain (...) the object’s position, contour, and other information and is compatible with traditional tracking methods. Experiments show that this method can obtain the position information of the moving object and its continuous motion trajectory and analyze the influence of the parameters on the tracking effect. This method will have broad application prospects in security, transportation, etc. (shrink)

In the intelligent transportation system, the license information can be automatically recognized by the computer and the vehicle can be tracked. Red light running, illegal change of lanes, vehicle retrograde, and other illegal driving events are reasonably recorded. This is undoubtedly an effective help for the traffic police to relieve the huge work pressure. However, in China, a considerable number of vehicle tracking methods have certain limitations in resisting complex external environmental influences. The external environmental factors include but not (...) limited to variable factors such as camera movement, jitter, and severe rain and snow. These factors cannot be controlled well, so the tracking accuracy is greatly reduced. In regard to this, this paper proposes an optimization method for moving vehicle tracking based on SPF. First, according to the size of the overlapping area of the motion area between the two images, the researcher can construct and simplify the vertex adjacency matrix that reflects the characteristics of the undirected bipartite graph. Then according to the corresponding relationship between the vertex adjacency matrix and the regional behavior and vehicle behavior, the researcher completes the regional behavior analysis and vehicle behavior analysis. On this basis, a particle filter vehicle tracking algorithm based on segmentation compensation is introduced, and the vector sum of the tracked segmentation area is used as the final position of the target vehicle. In this way, as many scattered particles fall on the target area as possible, which will greatly improve the efficiency of particle utilization, enhance tracking accuracy, and avoid the problem of tracking failure caused by too fast vehicle movement. Through experimental simulation, it can be seen that the method proposed in this paper can greatly enhance the vehicle tracking ability when tracking vehicles in “complex environments.”. (shrink)

This paper develops an adaptive fixed-time trajectory tracking controller of an underactuated hovercraft with a prescribed performance in the presence of model uncertainties and unknown time-varying environment disturbances. It is the first time that the proposed method is applied to the motion control of the hovercraft. To begin with, based on the hovercraft's four degrees of freedom model, the virtual control laws are designed using an error transforming function and the fixed-time stability theory to guarantee that the position (...) tracking errors are constrained within the prescribed convergence rates and minimum overshoot. In addition, by combining the Lyapunov direct method and the adaptive radial basis function neural network, the actual control laws are designed to ensure that the velocity tracking errors converge to a small region containing zero while handling model uncertainties and external disturbances effectively. Finally, all tracking errors of the closed-loop system are uniformly ultimately bounded and fixed-time convergent. Results from a comparative simulation study verify the effectiveness and advantage of the proposed method. (shrink)

The increasing number of newborns has stimulated the infant market. In particular, the baby stroller, serving as an important life partner for both babies and parents, has attracted more attention from society. Stroller design and functionality are of vital importance to babies' physiological and psychological health as well as brain development. Therefore, in this paper, we propose a modularization design method for the novel four-wheeled baby stroller based on the KANO model to ensure the mechanical safety and involve more functionalities. (...) Manual control of the baby stroller requires the rapid response of human motor systems in a completely controlled manner, which could be a potential risk. To enhance the safety and stability of the stroller motion, especially in situations where manual control is hard to achieve (e.g., sharp turns), we propose an autonomous motion control scheme based on model predictive control. Both the modularization design and the motion controller are verified in the MATLAB simulation environment through path tracking tasks. The feasibility is validated by the satisfactory experimental results with lateral position error in a reasonable range and good trajectory smoothness. (shrink)

Introduction -- The application of functional linguistics to film -- Cohesion in film -- Analysing action patterns in film -- Conclusion.

In this paper, we study the estimation of motion direction prediction for fast motion and propose a threshold-based human target detection algorithm using motion vectors and other data as human target feature information. The motion vectors are partitioned into regions by normalization to form a motion vector field, which is then preprocessed, and then the human body target is detected through its motion vector region block-temporal correlation to detect the human body motion target. (...) The experimental results show that the algorithm is effective in detecting human motion targets in videos with the camera relatively stationary. The algorithm predicts the human body position in the reference frame of the current frame in the video by forward mapping the motion vector of the current frame, then uses the motion vector direction angle histogram as a matching feature, and combines it with a region matching strategy to track the human body target in the predicted region, thus realizing the human body target tracking effect. The algorithm is experimentally proven to effectively track human motion targets in videos with relatively static backgrounds. To address the problem of sample diversity and lack of quantity in a multitarget tracking environment, a generative model based on the conditional variational self-encoder conditional generation of adversarial networks is proposed, and the performance of the generative model is verified using pedestrian reidentification and other datasets, and the experimental results show that the method can take advantage of the advantages of both models to improve the quality of the generated results. (shrink)

An eye-tracking while listening study based on the blank screen paradigm was conducted to investigate the processing of literal and metaphorical verbs of motion. The study was based on two assumpti...

This paper presents an approach for monitoring exercises of hand rehabilitation for post stroke patients. The developed solution uses a leap motion controller as hand-tracking device and embeds a supervised machine learning. The K-nearest neighbor methodology is adopted for automatically characterizing the physiotherapist or helper hand movement resulting a unique movement pattern that constitutes the basis of the rehabilitation process. In the second stage, an evaluation of the patients rehabilitation exercises results is compared to the movement pattern of (...) the patient and results are presented, saved and statistically analyzed. Physicians and physiotherapists monitor and assess patients’ rehabilitation improvements through a web application, furthermore, offer medical assisted rehabilitation processes through low cost technology, which can be easily exploited at home. Recorded tracked motion data and results can be used for further medical study and evaluating rehabilitation trends according to patient’s rehabilitation practice and improvement. (shrink)

This paper addresses the simultaneous attitude and position tracking of a target spacecraft in the presence of general unknown bounded disturbances in the framework of dual quaternions, which provides a concise and integrated description of the coupled rotational and translational motions. By virtue of the newly introduced dual direction cosine matrix, the dimension of the dual quaternion-based relative motion dynamics written in vector/matrix form can be lowered to six. Treating the disturbances as unknown parameters, a modular adaptive pose (...) tracking control scheme composed of two separately designed parts is then derived. One part is the adaptive disturbance estimator designed based on the immersion and invariance theory. Driven by the disturbance estimation errors, it can realize exponential convergence of the estimations and has the nice “parameter lock” property, which can hardly be expected in the conventional certainty equivalent adaptive controllers. The other part is a proportional-derivative-like pose tracking controller where the estimated disturbances are directly used. The closed-loop stability of the relative motion system under different kinds of disturbances is proven by Lyapunov stability analysis. Simulations and comparisons with two previous dual quaternion-based controllers demonstrate the novel features and performance improvements of the proposed control scheme. (shrink)

This paper presents an approach for monitoring exercises of hand rehabilitation for post stroke patients. The developed solution uses a leap motion controller as hand-tracking device and embeds a supervised machine learning. The K-nearest neighbor methodology is adopted for automatically characterizing the physiotherapist or helper hand movement resulting a unique movement pattern that constitutes the basis of the rehabilitation process. In the second stage, an evaluation of the patients rehabilitation exercises results is compared to the movement pattern of (...) the patient and results are presented, saved and statistically analyzed. Physicians and physiotherapists monitor and assess patients’ rehabilitation improvements through a web application, furthermore, offer medical assisted rehabilitation processes through low cost technology, which can be easily exploited at home. Recorded tracked motion data and results can be used for further medical study and evaluating rehabilitation trends according to patient’s rehabilitation practice and improvement. (shrink)

The moving frame of a tracking or crane shot, or of a camera tilt or pan, can affect the way we engage with a film narrative. In this paper, I argue that certain uses of the moving frame in narrative fiction film prescribe us to imagine ourselves moving through the world of the film. The existence of such an imaginative prescription ultimately threatens the necessity of the cinematic narrator. In light of the standard indeterminacy of our means of access (...) to fictions, the prescription to imagine moving is not accompanied by a prescription to imagine a narrator providing us with a moving view. (shrink)

Increasing interest has been paid to applications of fluorescence measurements to analyze physiological mechanisms in living cells. However, few studies have taken advantage of DNA quantification by fluorometry for dynamic assessment of chromatin organization as well as cell motion during the cell cycle. This approach involves both optimal conditions for DNA staining and cell tracking methods. In this context, this report describes a stoichiometric method for nuclear DNA specific staining, using the bisbenzimidazole dye Hoechst 33342 associated with verapamil, (...) a calcium membrane channel blocker. This method makes it possible to correlate variations of nuclear DNA content with cell motion in cells that are maintained alive. Motion measurement is the second goal of this paper and it explains the snake-spline method, and the associated cell following method. (shrink)

Eukaryotic genome DNA is wrapped around core histones and forms a nucleosome structure. Together with associated proteins and RNAs, these nucleosomes are organized three‐dimensionally in the cell as chromatin. Emerging evidence demonstrates that chromatin consists of rather irregular and variable nucleosome arrangements without the regular fiber structure and that its dynamic behavior plays a critical role in regulating various genome functions. Single‐nucleosome imaging is a promising method to investigate chromatin behavior in living cells. It reveals local chromatin motion, which (...) reflects chromatin organization not observed in chemically fixed cells. The motion data is like a gold mine. Data analyses from many aspects bring us more and more information that contributes to better understanding of genome functions. In this review article, we describe imaging of single‐nucleosomes and their tracked behavior through oblique illumination microscopy. We also discuss applications of this technique, especially in elucidating nucleolar organization in living cells. (shrink)

We investigated the key anatomical structures mediating interhemispheric integration during the perception of apparent motion across the retinal midline. Previous studies of commissurotomized patients suggest that subcortical structures mediate interhemispheric transmission but the specific regions involved remain unclear. Here, we exploit interindividual variations in the propensity of normal subjects to perceive horizontal motion, in relation to vertical motion. We characterize these differences psychophysically using a Dynamic Dot Quartet (an ambiguous stimulus that induces illusory motion). We then (...) tested for correlations between a tendency to perceive horizontal motion and fractional anisotropy (FA) (from structural diffusion tensor imaging), over subjects. FA is an indirect measure of the orientation and integrity of white matter tracts. Subjects who found it easy to perceive horizontal motion showed significantly higher FA values in the pulvinar. Furthermore, fiber tracking from an independently identified (subject-specific) visual motion area converged on the pulvinar nucleus. These results suggest that the pulvinar is an anatomical hub and may play a central role in interhemispheric integration. (shrink)

Since cinema has entered the digital era, its very nature has come under renewed scrutiny. Countering the "death of cinema" debate, Film History as Media Archaeology​ presents a robust argument for cinema's current status as a new epistemological object of interest to philosophers, while also examining the presence of moving images in museum and art spaces as a challenge for art history. The study is the fruit of twenty years of research and writing at the interface of film history, media (...) theory, and media archaeology by one of the acknowledged pioneers of new film history and media archaeology. It joins the efforts of other media scholars to locate cinema's historical emergence and subsequent transformations within the broader field of media change and interaction as we experience them today. (shrink)

In conversation, individuals work together to achieve communicative goals, complementing and aligning language and body with each other. An important emerging question is whether interlocutors entrain with one another equally across linguistic levels (e.g., lexical, syntactic, and semantic) and modalities (i.e., speech and gesture), or whether there are complementary patterns of behaviors, with some levels or modalities diverging and others converging in coordinated fashions. This study assesses how kinematic and linguistic entrainment interact with one another across levels of measurement, and (...) according to communicative context. We analyzed data from two matched corpora of dyadic interaction between—respectively—Danish and Norwegian native speakers engaged in affiliative conversations and task‐oriented conversations. We assessed linguistic entrainment at the lexical, syntactic, and semantic level, and kinetic alignment of the head and hands using video‐based motion tracking and dynamic time warping. We tested whether—across the two languages—linguistic alignment correlates with kinetic alignment, and whether these kinetic‐linguistic associations are modulated either by the type of conversation or by the language spoken. We found that kinetic entrainment was positively associated with low‐level linguistic (i.e., lexical) entrainment, while negatively associated with high‐level linguistic (i.e., semantic) entrainment, in a cross‐linguistically robust way. Our findings suggest that conversation makes use of a dynamic coordination of similarity and complementarity both between individuals as well as between different communicative modalities, and provides evidence for a multimodal, interpersonal synergy account of interaction. (shrink)

Immersive virtual reality (VR) emerges as a promising research and clinical tool. However, several studies suggest that VR induced adverse symptoms and effects (VRISE) may undermine the health and safety standards, and the reliability of the scientific results. In the current literature review, the technical reasons for the adverse symptomatology are investigated to provide suggestions and technological knowledge for the implementation of VR head-mounted display (HMD) systems in cognitive neuroscience. The technological systematic literature indicated features pertinent to display, sound, (...) class='Hi'>motion tracking, navigation, ergonomic interactions, user experience, and computer’s hardware that should be considered by the researchers. Subsequently, a meta-analysis of 44 neuroscientific or neuropsychological studies involving VR HMD systems was performed. The meta-analysis of the VR studies demonstrated that the new generation HMDs induced significantly fewer dropouts and VRISE. Importantly, the commercial versions of the new generation HMDs with ergonomic interactions had zero incidents of adverse symptomatology and dropouts. Solely, HMDs equivalent to or greater than the commercial versions of contemporary HMDs accompanied with ergonomic interactions are suitable for implementation in cognitive neuroscience. In conclusion, researchers’ technological competency, along with meticulous methods and reports pertinent to software, hardware, and VRISE, are paramount to ensure the health and safety standards and the reliability of neuroscientific results. (shrink)

In this paper, we focus on the human upper limb rehabilitation scheme that utilizes the concept ofteleoperation. Teleoperation can help the therapist demonstrate different rehab exercises to a different group of people at the same time remotely. Different groups of people from a different place connected to the same network can get therapy from the same therapist at the same time using the telerehabilitation scheme. Here, we presented a humanoid robot NAO that can be operated remotely by a therapist to (...) demonstrate the exercise to a patient. To mimic the movement demonstrated by the therapist, Kinect V2 sensor which is a markerless vision-based motion-tracking device, was used. Modified Denavit-Hartenberg (DH) convention was used for the kinematic modeling of the human upper arm. From the Kinect data, a geometric solution was developed to find a unique inverse kinematic solution of human upper-extremity. Experimental results revealed that NAO could be teleoperated successfully to instruct and demonstrate patients to perform different arm movement exercises in real-time. (shrink)

The processes underlying motor decision-making have recently caught considerable amount of scientific attention, focusing on the integration of empirical evidence from sensorimotor control research with psychological theories and computational models on decision-making. Empirical studies on motor decision-making suggest that the kinematics of goal-directed reaching movements are sensitive to the level of target uncertainty during movement planning. However, the source of uncertainty as a relevant factor influencing the process of motor decision-making has not been sufficiently considered, yet. In this study, we (...) test the assumption that the source of target uncertainty has an effect on motor decision-making, which can be proven by analyzing movement variability during the time course of movement execution. Ten healthy young adults performed three blocks with 66 trials of goal-directed reaching movements in each block, across which the source and level of reach target uncertainty at movement onset were manipulated (“no uncertainty”, “extrinsic uncertainty”, “intrinsic uncertainty”). Fingertip position of the right index finger was recorded using an optical motion tracking system. Standard kinematic measures (i.e. path length and movement duration) as well as variability of fingertip position across the time course of movement execution and at movement end were analyzed. In line with previous studies, we found that a high level of extrinsic target uncertainty leads to increased overall movement duration, which could be attributed to increased path length in this condition, as compared to intrinsic and no target uncertainty (all p <.001). Movement duration and path length did not show any differences between the latter two conditions. However, the time course analysis of movement variability revealed significant differences between these two conditions, with increased variability of fingertip position in the presence of intrinsic target uncertainty (Condition × Sampling point: p =.01), though considerably less than under high extrinsic target uncertainty (p ≤.001). These findings suggest that both the level and source of uncertainty have a significant effect on the processing of potential action plans during motor decision-making, which can be revealed through the analysis of the time course of movement variability at the end-effector level. (shrink)

Postural instability marks a prevalent symptom of Parkinson’s disease. It often manifests in increased body sway, which is commonly assessed by tracking the Center of Pressure. Yet, in terms of postural control, the body’s Center of Mass, and not CoP is what is regulated in a gravitational field. The aim of this study was to explore the effect of early- to mid-stage PD on these measures of postural control in response to unpredictable visual perturbations. We investigated three cohorts: 18 (...) patients with early to mid-stage PD [Hoehn & Yahr stage ; 1.94 ± 0.70]; a group of 15 age-matched controls ; and a group of 12 young healthy adults. Participants stood on a force plate to track their CoP, while the movement of their entire body was recorded with a video-based motion tracking system to monitor their CoM. A moving room paradigm was applied through a head-mounted virtual reality headset. The stimulus consisted of a virtual tunnel that stretched in the anterior-posterior direction which either remained static or moved back and forth in an unpredictable fashion.We found differences in mean sway amplitude and mean velocities of CoP and CoM between the groups under both conditions, with higher MSA of CoP and CoM for PD and higher mean velocities of both variables for PD and ECT when compared with YCT. Visual perturbation increased mean CoP velocity in all groups but did not have effects on mean CoM velocity or MSA. While being significantly lower for the young adults, the net effect of visual perturbation on mean CoP velocity was similar between patients with PD and age-matched controls. There was no effect of the visual perturbation on mean CoM velocity for any of the groups.Our simultaneous assessment of CoP and CoM revealed that postural control is reflected differently in CoM and CoP. As the motion of CoM remained mostly unaffected, all groups successfully counteracted the perturbation and maintained their balance. Higher CoP velocity for PD and ECT revealed increased corrective motion needed to achieve this, which however was similar in both groups. Thus, our results suggest increased effort, expressed in CoP velocity, to be an effect of age rather than disease in earlier stages of PD. (shrink)

Mouse tracking, a new action‐based measure of behavior, has advanced theories of decision making with the notion that cognitive and social decision making is fundamentally dynamic. Implicit in this theory is that people's decision strategies, such as discounting delayed rewards, are stable over task design and that mouse trajectory features correspond to specific segments of decision making. By applying the hierarchical drift diffusion model and the Bayesian delay discounting model, we tested these assumptions. Specifically, we investigated the extent to (...) which the “mouse‐tracking” design of decision‐making tasks (delay discounting task, DDT and stop‐signal task, SST) deviate from the standard “keypress” design of decision making tasks. We found remarkable agreement in delay discounting rates (intertemporal impatience) obtained in the keypress and mouse‐tracking versions of DDT (ρ = 0.90) even though these tasks were given about 1 week apart. Rates of evidence accumulation converged well in the two versions (DDT, ρ =.86; SST, ρ =.55). Omission/commission error in SST showed high agreement (ρ =.42, ρ =.53). Mouse‐motion features such as maximum velocity and AUC (area under the curve) correlated well with nondecision time (ρ = −.42) and boundary separation (ρ =.44)—the amount of information needed to accumulate prior to making a response. These results indicate that the response time (RT) and motion‐based decision tasks converge well at a fundamental level, and that mouse‐tracking features such as AUC and maximum velocity do indicate the degree of decision conflict and impulsivity. (shrink)

This paper aims at tracking down, by looking at late medieval and early modern discussions over the ontological status of artifacts, the main steps of the process through which nature became theorized on a mechanistic model in the early 17th century. The adopted methodology consists in examining how inventions such as mechanical clocks and automata forced philosophers to modify traditional criteria based on an intrinsic principle of motion and rest for defining natural beings. The paper studies different strategies (...) designed in the transitional period 1300–1600 for making these inventions compatible with classical definitions of nature and artifacts. In the first part of the paper, it is shown that, even if virtually all medieval philosophers acknowledged an ontological distinction between artifacts and natural beings, these different strategies demonstrate a growing concern about the consistency of the art/nature distinction. The next part of the paper studies how mechanical clocks, even before the Scientific Revolution, served as theoretical models for applying mechanistic views to different objects (be they cosmological, physical or biological). The epistemological function of clocks appears to stem from different factors (like the specific manufacturing of late medieval clocks as well as the evolution of 16th-century mechanics) that are listed in this second part of the paper. These factors, combined with the definitional issues raised by automata, explain that clocks became the symbol of a new approach to natural philosophy, characterized by the collapse of the art/nature distinction and the “mechanization of nature”. (shrink)

3 In live performances seated audiences have restricted opportunities for response. Some 4 responses are obvious, such as applause and cheering, but there are also many apparently 5 incidental movements including posture shifts, fixing hair, scratching and adjusting glasses. 6 Do these movements provide clues to people’s level of engagement with a performance? Our 7 basic hypothesis is that audience responses are part of a bi-directional system of audience- 8 performer communication. This communication is part of what distinguishes live from (...) recorded 9 performance and underpins live performers’ moment-to-moment sense of how well a performance 10 is going. Here we investigate the range of visible real-time movements of audiences in four live 11 contemporary dance performances. Video recordings of performers and audiences were analysed 12 using computer vision techniques for extracting face, hand and body movement data. The 13 meaning of audience movements were analysed by comparing clips of the audience at moments 14 of maximum and minimum movement to expert and novice judges. The results show that audience 15 clips with the lowest overall movement are judged as displaying the highest engagement. In 16 addition, we found that while there is no systematic relationship between audience and dancers 17 movement, hands seem to play an especially significant role since they move significantly more 18 compared to the rest of the body. We draw on these findings to argue that collective stillness is 19 an especially salient signal of audience engagement. (shrink)

Subject relative clauses (SRCs) are typically processed more easily than object relative clauses (ORCs), but this difference is diminished by an inanimate head‐noun in semantically non‐reversible ORCs (“The book that the boy is reading”). In two eye‐tracking experiments, we investigated the influence of animacy on online processing of semantically reversible SRCs and ORCs using lexically inanimate items that were perceptually animate due to motion (e.g., “Where is the tractor that the cow is chasing”). In Experiment 1, 48 children (...) (aged 4;5–6;4) and 32 adults listened to sentences that varied in the lexical animacy of the NP1 head‐noun (Animate/Inanimate) and relative clause (RC) type (SRC/ORC) with an animate NP2 while viewing two images depicting opposite actions. As expected, inanimate head‐nouns facilitated the correct interpretation of ORCs in children; however, online data revealed children were more likely to anticipate an SRC as the RC unfolded when an inanimate head‐noun was used, suggesting processing was sensitive to perceptual animacy. In Experiment 2, we repeated our design with inanimate (rather than animate) NP2s (e.g., “where is the tractor that the car is following”) to investigate whether our online findings were due to increased visual surprisal at an inanimate as agent, or to similarity‐based interference. We again found greater anticipation for an SRC in the inanimate condition, supporting our surprisal hypothesis. Across the experiments, offline measures show that lexical animacy influenced children's interpretation of ORCs, whereas online measures reveal that as RCs unfolded, children were sensitive to the perceptual animacy of lexically inanimate NPs, which was not reflected in the offline data. Overall measures of syntactic comprehension, inhibitory control, and verbal short‐term memory and working memory were not predictive of children's accuracy in RC interpretation, with the exception of a positive correlation with a standardized measure of syntactic comprehension in Experiment 1. (shrink)

What’s presented in our normal waking perceptual visual experiences feels present to us, while what we “see” in pictures and imagine does not. What about dreams? Does what we “see” in a dream feel present? Jennifer Windt has argued for an affirmative answer, for all dreams. But the dreams which flow from the brain’s registration of myoclonic twitches present a challenge to this answer. During these dreams motion-guiding vision is shut off, and, as Mohan Matthen has argued, motion-guiding (...) vision seems to be a key mechanism underlying the feeling of presence. I propose that the feeling of presence in fact involves two components: the feeling of immersion, and the feeling of availability for action. I suggest that only the feeling of availability for action derives from motion-guiding vision, and, hence, hypothesize that body-driven dreams lack this component to the feeling of presence. Finally, the distinction between these two varieties of presence has implications for measures of presence in virtual environments, as these measures can diverge over which of the two varieties they track. (shrink)

Although eye tracking has been used extensively to assess cognitions for static stimuli, recent research suggests that the link between gaze and cognition may be more tenuous for dynamic stimuli such as videos. Part of the difficulty in convincingly linking gaze with cognition is that in dynamic stimuli, gaze position is strongly influenced by exogenous cues such as object motion. However, tests of the gaze‐cognition link in dynamic stimuli have been done on only a limited range of stimuli (...) often characterized by highly organized motion. Also, analyses of cognitive contrasts between participants have been mostly been limited to categorical contrasts among small numbers of participants that may have limited the power to observe more subtle influences. We, therefore, tested for cognitive influences on gaze for screen‐captured instructional videos, the contents of which participants were tested on. Between‐participant scanpath similarity predicted between‐participant similarity in responses on test questions, but with imperfect consistency across videos. We also observed that basic gaze parameters and measures of attention to centers of interest only inconsistently predicted learning, and that correlations between gaze and centers of interest defined by other‐participant gaze and cursor movement did not predict learning. It, therefore, appears that the search for eye movement indices of cognition during dynamic naturalistic stimuli may be fruitful, but we also agree that the tyranny of dynamic stimuli is real, and that links between eye movements and cognition are highly dependent on task and stimulus properties. (shrink)

Biometric technologies are becoming more pervasive in the workplace, augmenting managerial processes such as hiring, monitoring and terminating employees. Until recently, these devices consisted mainly of GPS tools that track location, software that scrutinizes browser activity and keyboard strokes, and heat/motion sensors that monitor workstation presence. Today, however, a new generation of biometric devices has emerged that can sense, read, monitor and evaluate the affective state of a worker. More popularly known by its commercial moniker, Emotional AI, the technology (...) stems from advancements in affective computing. But whereas previous generations of biometric monitoring targeted the exterior physical body of the worker, concurrent with the writings of Foucault and Hardt, we argue that emotion-recognition tools signal a far more invasive disciplinary gaze that exposes and makes vulnerable the inner regions of the worker-self. Our paper explores attitudes towards empathic surveillance by analyzing a survey of 1015 responses of future job-seekers from 48 countries with Bayesian statistics. Our findings reveal affect tools, left unregulated in the workplace, may lead to heightened stress and anxiety among disadvantaged ethnicities, gender and income class. We also discuss a stark cross-cultural discrepancy whereby East Asians, compared to Western subjects, are more likely to profess a trusting attitude toward EAI-enabled automated management. While this emerging technology is driven by neoliberal incentives to optimize the worksite and increase productivity, ultimately, empathic surveillance may create more problems in terms of algorithmic bias, opaque decisionism, and the erosion of employment relations. Thus, this paper nuances and extends emerging literature on emotion-sensing technologies in the workplace, particularly through its highly original cross-cultural study. (shrink)

Analysing film. Distinguishing the filmic contribution to meaning -- Examples of filmic "textual organisation" -- Redrawing boundaries -- Organisation of the book -- Semiotics and documents. Semiotics and its relations to film -- The nature of discourse semantics -- The film as cinematographic document -- A combined view: filmic documents for filmic discourse -- Constructing the semiotic mode of film. Semiotic multimodality -- The internal organisation of semiotic strata -- Composing and combining semiotic modes -- Materiality and "epistemological commitment" -- (...) Christian Metz and the grande syntagmatique of the image track. The original model -- Two examples of analysis with the grande syntagmatique -- Revisions and rebuttals -- Foundations for analysis: filmic units. The basic units of film: preliminaries -- Audiovisual iconic representations -- Perception, perceptual realism and reliable measurement -- Multiplicity: from perception to discourse -- Filmic units revisited: discourse-motivated definitions -- The paradigmatic organisation of film. Beyond Metz: towards a grande paradigmatique -- Capturing discourse dependency structures in film -- The paradigmatic dimensions of projection, taxis and plane -- Two examples of paradigmatic analysis -- Summary and conclusions. (shrink)

The original target tracking algorithm based on a single model has long been unable to meet the complex and changeable characteristics of the target, and then there are problems such as poor tracking accuracy, target loss, and model mismatch. The interactive multimodel algorithm uses multiple motion models to track the target, obtains the degree of adaptation between the actual motion state of the target and each model according to the calculated likelihood function, and then combines the (...) updated weight values of each filter to obtain a weighted sum. Therefore, the interactive multimodel algorithm can achieve better performance. This paper proposes an improved interactive multimodel algorithm that can achieve player tracking and trajectory feature matching. First, this paper proposes an improved Kalman filtering algorithm. This method is developed from the unbiased conversion measurement Kalman filter, which can obtain more accurate target state and covariance estimation. Secondly, using the parallel processing mode of the IMM algorithm to efficiently solve the data association between multiple filters, the IMM-IKF model is proposed. Finally, in order to solve the problem of low computational efficiency and high mismatch rate in image feature point matching, a method of introducing a minimum spanning tree in two-view matching is proposed. Experimental results show that the improved IMM-IKF algorithm can quickly respond to changes in the target state and can find the matching path with the lowest matching cost. In the case of ensuring the matching accuracy, the real-time performance of image matching is ensured. (shrink)

In works of literary fiction, it is a part of the fiction that the words of the text are being recounted by some work-internal 'voice': the literary narrator. One can ask similarly whether the story in movies is told in sights and sounds by a work-internal subjectivity that orchestrates them: a cinematic narrator. George M. Wilson argues that movies do involve a fictional recounting (an audio-visual narration ) in terms of the movie's sound and image track. Viewers are usually prompted (...) to imagine seeing the items and events in the movie's fictional world and to imagine hearing the associated fictional sounds. However, it is much less clear that the cinematic narration must be imagined as the product of some kind of 'narrator' - of a work-internal agent of the narration. Wilson goes on to examine the further question whether viewers imagine seeing the fictional world face-to-face or whether they imagine seeing it through some kind of work-internal mediation . It is a key contention of this book that only the second of these alternatives allows one to give a coherent account of what we do and do not imagine about what we are seeing on the screen. Having provided a partial account of the foundations of film narration, the final chapters explore the ways in which certain complex strategies of cinematic narration are executed in three exemplary films: David Fincher's Fight Club , von Sternberg's The Scarlet Empress , and the Coen brothers' The Man Who Wasn't There. (shrink)