In recent years, a multitude of datasets of human–human conversations has been released for the main purpose of training conversational agents based on data‐hungry artificial neural networks. In this paper, we argue that datasets of this sort represent a useful and underexplored source to validate, complement, and enhance cognitive studies on human behavior and language use. We present a method that leverages the recent development of powerful computational models to obtain the fine‐grained annotation required to apply metrics and techniques from (...) Cognitive Science to large datasets. Previous work in Cognitive Science has investigated the question‐asking strategies of human participants by employing different variants of the so‐called 20‐question‐game setting and proposing several evaluation methods. In our work, we focus on GuessWhat, a task proposed within the Computer Vision and Natural Language Processing communities that is similar in structure to the 20‐question‐game setting. Crucially, the GuessWhat dataset contains tens of thousands of dialogues based on real‐world images, making it a suitable setting to investigate the question‐asking strategies of human players on a large scale and in a natural setting. Our results demonstrate the effectiveness of computational tools to automatically code how the hypothesis space changes throughout the dialogue in complex visual scenes. On the one hand, we confirm findings from previous work on smaller and more controlled settings. On the other hand, our analyses allow us to highlight the presence of “uninformative” questions (in terms of Expected Information Gain) at specific rounds of the dialogue. We hypothesize that these questions fulfill pragmatic constraints that are exploited by human players to solve visual tasks in complex scenes successfully. Our work illustrates a method that brings together efforts and findings from different disciplines to gain a better understanding of human question‐asking strategies on large‐scale datasets, while at the same time posing new questions about the development of conversational systems. (shrink)

The main issue addressed here concerns the central notion of a forward internal model, through which efficient control and planning are linked together and to the related online predictive error processing. The existence of such a model has strong implications in action production and may question Glover's model.

Recent work in "embodied, embedded" cognitive science links mental contents to large-scale distributed effects: dynamic patterns implicating elements of (what are traditionally seen as) sensing, reasoning and acting. Central to this approach is an idea of biological cognition as profoundly "action-oriented" - geared not to the creation of rich, passive inner models of the world, but to the cheap and efficient production of real-world action in real-world context. A case in point is Hurley's (1998) account of the profound role of (...) motor output in fixing the contents of conscious visual awareness - an account that also emphasizes distributed vehicles and long-range dynamical loops. Such stories can seem dramatically opposed to accounts, such as Milner and Goodale (1995), that stress relatively local mechanisms and that posit firm divisions between processes of visual awareness and of visuomotor action. But such accounts, I argue, can be deeply complimentary and together illustrate an important lesson. The lesson is that cognition may be embodied and action-oriented in two distinct - but complimentary - ways. There is a way of being embodied and action-oriented that implies being closely geared to the fine-grained control of low level effectors (hands, arms, legs and so on). And there is a way of being embodied and action-oriented that implies being closely geared to gross motor intentions, current goals, and schematic motor plans. Human cognition, I suggest, is embodied and action-oriented in both these ways. But the neural systems involved, and the size and scope of the key dynamic loops, may be quite different in each case. (shrink)

The ability to rapidly detect facial expressions of anger and threat over other salient expressions has adaptive value across the lifespan. Although studies have demonstrated this threat superiority effect in adults, surprisingly little research has examined the development of this process over the childhood period. In this study, we examined the efficiency of children's facial processing in visual search tasks. In Experiment 1, children (N=49) aged 8 to 11 years were faster and more accurate in detecting angry target (...) faces embedded in neutral backgrounds than vice versa, and they were slower in detecting the absence of a discrepant face among angry than among neutral faces. This search pattern was unaffected by an increase in matrix size. Faster detection of angry than neutral deviants may reflect that angry faces stand out more among neutral faces than vice versa, or that detection of neutral faces is slowed by the presence of surrounding angry distracters. When keeping the background constant in Experiment 2, children (N=35) aged 8 to 11 years were faster and more accurate in detecting angry than sad or happy target faces among neutral background faces. Moreover, children with higher levels of anxiety were quicker to find both angry and sad faces whereas low anxious children showed an advantage for angry faces only. Results suggest a threat superiority effect in processing facial expressions in young children as in adults and that increased sensitivity for negative faces may be characteristic of children with anxiety problems. (shrink)

This study investigated visual statistical learning (VSL) in 24 deaf signers and 24 hearing non‐signers. Previous research with hearing individuals suggests that SL mechanisms support literacy. Our first goal was to assess whether VSL was associated with reading ability in deaf individuals, and whether this relation was sustained by a link between VSL and sign language skill. Our second goal was to test the Auditory Scaffolding Hypothesis, which makes the prediction that deaf people should be impaired in sequential processing (...) tasks. For the VSL task, we adopted a modified version of the triplet learning paradigm, with stimuli presented sequentially across space and time. Results revealed that measures of sign language skill (sentence comprehension/repetition) did not correlate with VSL scores, possibly due to the sequential nature of our VSL task. Reading comprehension scores (PIAT‐R) were a significant predictor of VSL accuracy in hearing but not deaf people. This finding might be due to the sequential nature of the VSL task and to a less salient role of the sequential orthography‐to‐phonology mapping in deaf readers compared to hearing readers. The two groups did not differ in VSL scores. However, when reading ability was taken into account, VSL scores were higher for the deaf group than the hearing group. Overall, this evidence is inconsistent with the Auditory Scaffolding Hypothesis, suggesting that humans can develop efficient sequencing abilities even in the absence of sound. (shrink)

Visual comparison is a key process in everyday learning and reasoning. Recent research has discovered the spatial alignment principle, based on the broader framework of structure‐mapping theory in comparison. According to the spatial alignment principle, visual comparison is more efficient when the figures being compared are arranged in direct placement—that is, juxtaposed with parallel structural axes. In this placement, (1) the intended relational correspondences are readily apparent, and (2) the influence of potential competing correspondences is minimized. There is (...) evidence for the spatial alignment principle in adults’ visual comparison (Matlen et al., 2020). Here, we test whether it holds for children. Six‐ and eight‐year‐old children performed a same‐different task over visual pairs. The results indicated that direct placement led to faster and more accurate comparison, both for concrete same‐different matches (matches of both objects and relations) and for purely relational matches—evidence that the same structural alignment process holds for visual comparison in 6‐ and 8‐year‐olds as in adults. These findings have implications for learning and education. (shrink)

Sensory feedback, which can be presented in different modalities - single and combined, aids task performance in human-robot interaction (HRI). However, combining feedback modalities does not always lead to optimal performance. Indeed, it is not known how feedback modalities affect operator performance under stress. Furthermore, there is limited information on how feedback affects neural processes differently for males and females and under stress. This is a critical gap in the literature, particularly in the domain of surgical robotics, where surgeons are (...) under challenging socio-technical environments that burden them physiologically. In the present study, we posited operator performance as the summation of task performance and neurophysiological cost of maintaining that performance. In a within-subject design, we used functional near-infrared spectroscopy (fNIRS) to assess cerebral activations of 12 participants who underwent a 3D manipulation task within a virtual environment with concurrent feedback (visual and visual + haptic) in the presence and absence of a cognitive stressor. Cognitive stress was induced with the serial-7 subtraction test. We found that while task performance was higher with visual than visual + haptic feedback, it degraded under stress. The two feedback modalities were found to be associated with varying neural activities and neural efficiencies, and these were stress- and gender-dependent. Our findings engender further investigation into effectiveness of feedback modalities on males and females under stressful conditions in HRI. (shrink)

The threat-advantage hypothesis that threatening or negative faces can be discriminated preattentively has often been tested in the visual search paradigm with schematic stimuli. The results have been heterogeneous, suggesting that the choice of particular stimuli have profound effects on search efficiency. Because this conclusion is hampered by differences in experimental procedure, I selected examples from past literature and presented replicas of stimulus pairs (schematic positive and negative faces) in a within-participants design. Although there was a consistent advantage (...) for angry-face targets, search efficiency varied between 8 and 35 ms/item, yielding no clear evidence for the threat-advantage hypothesis. Furthermore, search efficiency for negative- and positive-face targets was highly correlated over stimulus pairs, which implies that whatever complicates the search for the negative face of a pair also complicates the search for the positive face. This results pattern argues against the hypothesised preattentive detector. (shrink)

In a study concerning visual body part recognition, a “self-advantage” effect, whereby self-related body stimuli are processed faster and more accurately than other-related body stimuli, was revealed, and the emergence of this effect is assumed to be tightly linked to implicit motor simulation, which is activated when performing a hand laterality judgment task in which hand ownership is not explicitly required. Here, we ran two visual hand recognition tasks, namely, a hand laterality judgment task and a self-other discrimination (...) task, to investigate whether the self-advantage emerged even if implicit motor imagery was assumed to be working less efficiently and how individual traits [such as autistic traits and the extent of positive self-body image, as assessed via the Autism Spectrum Quotient and the Body Appreciation Scale-2, respectively] modulate performance in these hand recognition tasks. Participants were presented with hand images in two orientations [i.e., upright and upside-down ] and asked to judge whether it was a left or right hand. They were also asked to determine whether it was their own, or another person’s hand. Data collected from men and women were analyzed separately. The self-advantage effect in the hand laterality judgment task was not revealed, suggesting that only two orientation conditions are not enough to trigger this motor simulation. Furthermore, the men’s group showed a significant positive correlation between AQ scores and reaction times in the laterality judgment task, while the women’s group showed a significant negative correlation between AQ scores and differences in RTs and a significant positive correlation between BAS-2 scores and dprime in the self-other discrimination task. These results suggest that men and women differentially adopt specific strategies and/or execution processes for implicit and explicit hand recognition tasks. (shrink)

Evidence from visual-search experiments is discussed that indicates that there is spatially parallel encoding based on three-dimensional (3-D) spatial relations between complex image features. In one paradigm, subjects had to detect an odd part of cube-like figures, formed by grouping of corner junctions. Performance with cube-like figures was unaffected by the number of corner junctions present, though performance was affected when the corners did not configure into a cube. It is suggested from the data that junctions can be grouped (...) to form 3-D shapes in a spatially parallel manner. Further, performance with cube-like figures was more robust to noncollinearity between junctions than was performance when junctions grouped to form two-dimensional planes. In the second paradigm, subjects searched for targets defined by their size. Performance was affected by a size illusion, induced by linear-perspective cues from local background neighbourhoods. Search was made more efficient when the size illusion was consistent with the real size difference between targets and nontargets, and it was made less efficient when the size illusion was inconsistent with the real size difference. This last result occurred even though search was little affected by the display size in a control condition. We suggest that early, parallel visual processes are influenced by 3-D spatial relations between visual elements, that grouping based on 3-D spatial relations is relatively robust to noncollinearity between junctions, and that, at least in some circumstances, 3-D relations dominate those coded in two-dimensions. (shrink)

This paper is motivated by the increasing popularity of efficient designs for stated choice experiments. The objective in efficient designs is to create a stated choice experiment that minimizes the standard errors of the estimated parameters. In order to do so, such designs require specifying prior values for the parameters to be estimated. While there is significant literature demonstrating the efficiency improvements of employing efficient designs, the bulk of the literature tests conditions where the priors used to generate the (...) efficient design are assumed to be accurate. However, there is substantially less literature that compares how different design types perform under varying degree of error of the prior. The literature that does exist assumes small fractions are used, which is in contrast to computer-aided surveys that readily allow for large fractions. Further, the results in the literature are abstract in that there is no reference point to provide clear insight on the magnitude of any issue. Our objective is to analyze the robustness of different designs within a typical stated choice experiment context of a trade-off between price and quality. We use as an example transportation mode choice, where the key parameter to estimate is the value of time. Within this context, we test many designs to examine how robust efficient designs are against a misspecification of the prior parameters. The simple mode choice setting allows for insightful visualizations of the designs themselves and also an interpretable reference point for the range in which each design is robust. Not surprisingly, the D-efficient design is most efficient in the region where the true population VOT is near the prior used to generate the design: the prior is $20/h and the efficient range is $10–$30/h. However, the D-efficient design quickly becomes the most inefficient outside of this range, and the estimation significantly degrades above $50/h. The orthogonal and random designs are robust for a much larger range of VOT. The robustness of Bayesian efficient designs varies depending on the variance that the prior assumes. Implementing two-stage designs that first use a small sample to estimate priors are also not robust relative to uninformative designs. Arguably, the random design performs as well as any design, and it will perform even better if data cleaning is done to remove choice tasks where one alternative dominates the other. (shrink)

Some things look more complex than others. For example, a crenulate and richly organized leaf may seem more complex than a plain stone. What is the nature of this experience—and why do we have it in the first place? Here, we explore how object complexity serves as an efficiently extracted visual signal that the object merits further exploration. We algorithmically generated a library of geometric shapes and determined their complexity by computing the cumulative surprisal of their internal skeletons—essentially quantifying (...) the “amount of information” within each shape—and then used this approach to ask new questions about the perception of complexity. Experiments 1–3 asked what kind of mental process extracts visual complexity: a slow, deliberate, reflective process (as when we decide that an object is expensive or popular) or a fast, effortless, and automatic process (as when we see that an object is big or blue)? We placed simple and complex objects in visual search arrays and discovered that complex objects were easier to find among simple distractors than simple objects are among complex distractors—a classic search asymmetry indicating that complexity is prioritized in visual processing. Next, we explored the function of complexity: Why do we represent object complexity in the first place? Experiments 4–5 asked subjects to study serially presented objects in a self‐paced manner (for a later memory test); subjects dwelled longer on complex objects than simple objects—even when object shape was completely task‐irrelevant—suggesting a connection between visual complexity and exploratory engagement. Finally, Experiment 6 connected these implicit measures of complexity to explicit judgments. Collectively, these findings suggest that visual complexity is extracted efficiently and automatically, and even arouses a kind of “perceptual curiosity” about objects that encourages subsequent attentional engagement. (shrink)

Despite the importance of effective observational analysis in the technical aspects of climbing performance, limited research informs this aspect of climbing coach education. Thus, the purpose of the present research was to explore cognitive-perceptual mechanisms underpinning visual search strategies of expert and novice climbing coaches through the novel combination of eye-tracking technology and retrospective think-aloud methodology. Analysis of gaze data revealed expert climbing coaches to demonstrate fewer fixations of greater duration, and fixate on distinctly different areas of the (...) class='Hi'>visual display, than their novice counterparts. Retrospective think-aloud interviews further demonstrated differences in the cognitive-perceptual mechanisms underpinning these visual search strategies, with expert coaches more cognisant of their visual search strategy. To expand, the gaze behaviour of expert climbing coaches was underpinned by hierarchical and complex knowledge structures relating to principles of climbing movement. This enabled expert coaches to actively focus on the most relevant aspects of a climber’s performance for analysis. Findings demonstrate the utility of combining eye tracking and retrospective think-aloud interviewing as a new, efficient methodology of capturing the cognitive-perceptual processes of climbing coaches to inform coaching education/strategies. (shrink)

Cognitive and neural processes underlying visual creativity have attracted substantial attention. The current research uses a critical time point analysis to examine how spontaneous activity in the primary visual area is related to visual creativity. We acquired the functional magnetic resonance imaging data of 16 participants at the resting state and during performing a visual creative synthesis task. According to the CTPA, we then classified spontaneous activity in the PVA into critical time points, which reflect the (...) most useful and important functional meaning of the entire resting-state condition, and the remaining time points. We constructed functional brain networks based on the brain activity at two different time points and then subsequently based on the brain activity at the task state in a separate manner. We explore the relationship between resting-state and task-fMRI functional brain networks. Our results found that: the pattern of spontaneous activity in the PVA may associate with mental imagery, which plays an important role in visual creativity; in comparison with the RTPs-based brain network, the CTP-network showed an increase in global efficiency and a decrease in local efficiency; the regional integrated properties of the CTP-network could predict the integrated properties of the creative-network while the RTP-network could not. Thus, our findings indicated that spontaneous activity in the PVA at CTPs was associated with a visual creative task-evoked brain response. Our findings may provide an insight into how the visual cortex is related to visual creativity. (shrink)

This paper reviews the severe visual focus problems of health economists–they have developed a one-sided fixation with equity issues, neglecting the efficiency agenda. The problems of meeting need are not just about access–they will vary with cost and supply. Economists in fact developed a more balanced agenda in the 1970s but have failed to follow it up. The paper defines the triple nationalisation of the National Health Service , and presents evidence that pluralism, using the purchaser/provider split, has (...) become more efficient in long term care, home care and services for people with learning difficulties. Health economics has failed to explore options for using the dynamic forces of choice and competition for improving health services. The paper makes the case for a decision rule that “we should seek the process of health care service supply and development which maximises the delivery of high quality, lower cost user relevant services”. (shrink)

Monitoring the environment for visual events while performing a concurrent task requires adjustment of visual processing priorities. By use of Bundesen's (1990) Theory of Visual Attention (TVA), we investigated how monitoring for an object-based brief event affected distinct components of visual attention in a concurrent task. The perceptual salience of the event was varied. Monitoring reduced the processing speed in the concurrent task, and the reduction was stronger when the event was less salient. The monitoring task (...) neither affected the temporal threshold of conscious perception nor the storage capacity of visual short-term memory nor the efficiency of top-down controlled attentional selection. (shrink)

Visual perspective during autobiographical memory (AM) retrieval influences how people remember the emotional aspects of memories. Prior research in emotion regulation has also shown that shifting from an own eyes to an observer-like perspective is an efficient way of regulating the affect elicited by emotional AMs. However, the impact of shifting visual perspective is also dependent on the nature of the emotion associated with the event. The current review synthesizes behavioral and functional neuroimaging findings from the event memory (...) and emotion regulation literature that examine how adopting particular visual perspectives and actively shifting across them during retrieval alters emotional experience, by primarily focusing on emotional intensity. We review current theories explaining why shifts in perspectives may or may not change the emotional characteristics of memories, then propose a new theory, suggesting that the own eyes and observer-like perspectives are two different retrieval orientations supported by differential neural activations that lead episodic details to be reconstructed in specific ways. (shrink)

This chapter presents an overview of several recent developments in vision science, and outlines some of their implications for the management of visual attention in graphic displays. These include ways of sending attention to the right item at the right time, techniques to improve attentional efficiency, and possibilities for offloading some of the processing typically done by attention onto nonattentional mechanisms. In addition it is argued that such techniques not only allow more effective use to be made of (...) visual attention, but also open up new possibilities for human-machine interaction. (shrink)

Advances in artificial intelligence have raised a basic question about human intelligence: Is human reasoning best emulated by applying task‐specific knowledge acquired from a wealth of prior experience, or is it based on the domain‐general manipulation and comparison of mental representations? We address this question for the case of visual analogical reasoning. Using realistic images of familiar three‐dimensional objects (cars and their parts), we systematically manipulated viewpoints, part relations, and entity properties in visual analogy problems. We compared human (...) performance to that of two recent deep learning models (Siamese Network and Relation Network) that were directly trained to solve these problems and to apply their task‐specific knowledge to analogical reasoning. We also developed a new model using part‐based comparison (PCM) by applying a domain‐general mapping procedure to learned representations of cars and their component parts. Across four‐term analogies (Experiment 1) and open‐ended analogies (Experiment 2), the domain‐general PCM model, but not the task‐specific deep learning models, generated performance similar in key aspects to that of human reasoners. These findings provide evidence that human‐like analogical reasoning is unlikely to be achieved by applying deep learning with big data to a specific type of analogy problem. Rather, humans do (and machines might) achieve analogical reasoning by learning representations that encode structural information useful for multiple tasks, coupled with efficient computation of relational similarity. (shrink)

In order to extract the regularities underlying a continuous sensory input, the individual elements constituting the stream have to be encoded and their transitional probabilities (TPs) should be learned. This suggests that variance in statistical learning (SL) performance reflects efficiency in encoding representations as well as efficiency in detecting their statistical properties. These processes have been taken to be independent and temporally modular, where first, elements in the stream are encoded into internal representations, and then the co‐occurrences between (...) them are computed and registered. Here, we entertain a novel hypothesis that one unifying construct—the rate of information in the sensory input—explains learning performance. This theoretical approach merges processes related to encoding of events and those related to learning their regularities into a single computational principle. We present data from two large‐scale experiments with over 800 participants tested in support for this hypothesis, showing that rate of information in a visual stream clearly predicts SL performance, and that similar rate of information values leads to similar SL performance. We discuss the implications for SL theory and its relation to regularity learning. (shrink)

In this paper, an in-depth study of interactive visual communication of network topology through non-line-of-sight congestion control algorithms is conducted to address the real-time routing problem of adapting to dynamic topologies, and a delay-constrained stochastic routing algorithm is proposed to enable packets to reach GB within the delay threshold in the absence of end-to-end delay information while improving network throughput and reducing network resource consumption. The algorithm requires each sending node to select an available relay set based on the (...) location of its neighbor nodes and channel state and computes transfer probabilities for each node in the relay set combining the remaining delay of the packet with the distance from the relay node to GB. Based on the obtained transfer probability and local channel state, the sending node passes the packet to the relay node. The convergence of the algorithm is proved and its performance is verified by simulation. The first part of the algorithm is based on the greedy algorithm to deploy and locate the network flying platform nodes with the goal of efficient coverage of the network flying platform nodes, considering the ground base station services. As the delay on each link varies due to the change of channel state, the source and relay nodes asynchronously update the data generation rate and the pairwise parameters based on the received local information and use the obtained optimal values to pass the packets to GB. (shrink)

This study examined cognitive predictors of susceptibility to orientation illusions: Poggendorff, Ponzo, and Zöllner. It was assumed that lower efficiency of information processing in WM and higher field dependence are conducive to orientation illusions. 61 architects aged M = 29, +/- 1.6, and 49 university students aged M = 23.53, +/- 4.24, were tested with Witkin’s EFT to assess their field dependence; the SWATT method was used as a measure of WM efficiency, and susceptibility to visual illusions (...) was verified with a series of computer tasks. We obtained a small range of the explained variance in the regression models including FDI and WM indicators. On the basis of WM efficiency indicators, we managed to confirm the existence of memory predictors of susceptibility to illusions. Among the architects, lower efficiency of WM processing and higher field dependence are responsible for greater susceptibility to orientation illusions. (shrink)

The neural mechanisms underlying behavioral improvement in the detection or discrimination of visual stimuli following learning are still ill understood. Studies in nonhuman primates have shown relatively small and, across studies, variable effects of fine discrimination learning in primary visual cortex when tested outside the context of the learned task. At later stages, such as extrastriate area V4, extensive practice in fine discrimination produces more consistent effects upon responses and neural tuning. In V1 and V4, the effects of (...) learning were most prominent in those neurons that can contribute the most reliable information about the trained stimuli. I suggest that, depending on the particulars of the task demands, neurons at various stages of stimulus and task processing can change their tuning and responses, so that execution of the task will produce a higher frequency of reward. I speculate that the sort of changes that will occur depend on the task and on stimulus analysis require- ments, and they may vary from changes in bottom-up stimulus processing ⁄ tuning within early visual areas or more efficient readout of early visual areas to top-down driven changes in response proper- ties of these areas. (shrink)

Actions are usually generalized among social group members. Importantly, the efficiency of an action with respect to achieving an external target determines action understanding, and it may have different degrees of social relevance to social groups. Thus, this study explored the role of action efficiency in action generalization. We used computer animations to simulate actions in social groups initiated by visual action cues or category labels, and we measured differences in response times between identifying actions that were (...) and were not consistent with group members, without explicit requirements regarding generalization. It was found that in both visually introduced and explicitly labeled social groups, when the group members acted inefficiently toward the external object, perceivers identified group‐consistent actions faster than group‐inconsistent actions, indicating that the exemplars' common inefficient actions are generalized to the unknown ingroup member, accordingly facilitating the identification of expected consistent inefficient action (Experiment 1). As this effect was not present when removing social group cues, it was determined to be specific to social groups (Experiment 2). Importantly, such generalization was not observed when the identical action was deemed efficient toward the external object (Experiment 3) and was specific to the demonstration of the action being completed by multiple group members rather than being repeated twice by one group member, supporting the group‐based inference and ruling out the possibility of the increased memorability of inefficient actions leading to more generalization relative to efficient actions (Experiment 4). Therefore, the efficiency of an action bounds the generalization of the action across social group members through a process that is spontaneous and implicit. This constrained action generalization may be due to inefficient actions being represented as culture‐specific conventional forms. (shrink)

An important question about eye-movement behavior is when the decision is made to terminate a fixation and program the following saccade. Different approaches have found converging evidence in favor of a mixed-control account, in which there is some overlap between processing information at fixation and planning the following saccade. We examined one interesting instance of mixed control in visual search: lag-2 revisits, during which observers fixate a stimulus, move to a different stimulus, and then revisit the first stimulus on (...) the next fixation. Results show that the probability of lag-2 revisits occurring increased with the number of target-similar stimuli, and revisits were preceded by a brief fixation on the intervening distractor stimulus. We developed the Efficient Visual Sampling computational model to simulate our findings and to provide insight into mixed control of fixations and the perceptual, cognitive, and motor processes that produce lag-2 revisits. (shrink)

Studying the typical development of reading is key to understanding the precise deficits that underlie reading disabilities. An important correlate of efficient reading is the speed of naming arrays of simple stimuli such as letters and pictures. In this cross-sectional study, we examined developmental changes in visual processing that occurs during letter and object naming from childhood to early adulthood in terms of behavioral task efficiency, associated articulation and eye movement parameters, and the coordination between them, as measured (...) by eye-voice span in both the spatial and temporal domains. We used naming speed tasks, in which participants were required to name sets of letters or simple objects as quickly and as accurately as possible. Single stimulus manipulations were made to these tasks to make the stimuli either more visually and/or phonologically similar to one another in order to examine how these manipulations affected task performance and the coordination between speech and eye movements. Across development there was an increased efficiency in speech and eye movement performance and their coordination in both the spatial and temporal domains. Furthermore, manipulations to the phonological and visual similarity of specific letter and object stimuli revealed that orthographic processing played a greater role than phonological processing in performance, with the contribution of phonological processing diminishing across development. This comprehensive typical developmental trajectory provides a benchmark for clinical populations to elucidate the nature of the cognitive dysfunction underlying reading difficulties. (shrink)

This book engages with the question of making sense of seeing in today’s technologically dominated world. It does so by exploring the notion of the ‘hypermodern’, a term which is used to capture the drive in contemporary culture to achieve ever greater speed and efficiency.

Angry faces have been shown to be detected more efficiently in a crowd of distractors compared to happy faces, known as the anger superiority effect (ASE). The present study investigated whether the ASE could be modified by top-down manipulation of working memory (WM), in central and peripheral visual fields. In central vision, participants held a colour in WM for a final memory test while simultaneously performing a visual search task that required them to determine whether a face showed (...) a different expression from other coloured faces. The colour held in WM matched either the colour of the target face (target-matching), the colour of a distractor face (distractor-matching), or neither (non-matching). Results showed that the ASE was observed when the probability of target-matching trials was low. However, when the top-down WM effect was strengthened by raising the probability of target-matching trials, the ASE in the target-matching condition was completely eliminated. Intriguingly, when the visual search task was substituted by a peripheral crowding task, similar results to central vision were found in the target-matching condition. Taken together, our findings indicate that the ASE is subject to the top-down WM effect, regardless of the visual field. (shrink)

The verification of a sentence against a visual display in experimental conditions reveals a procedure that is driven solely by the properties of the linguistic input and not by the properties of the context (the set-up of the visual display) or extra-linguistic cognition (operations executed to obtain the truth value). This procedure, according to the Interface Transparency Thesis (ITT) (Lidz et al. in Nat Lang Semant 19(3):227–256, 2011), represents the meaning of an expression at the interface with the (...) ‘conceptual-intentional’ system (Chomsky in The minimalist program. MIT Press, Cambridge, 1995). My experiments provide support for the ITT by replicating in Polish and in Bulgarian the findings of Lidz et al. (Nat Lang Semant 19(3):227–256, 2011) for the English quantifier most. We also obtain new evidence that participants are prompted to switch between verification procedures by a change in the linguistic input (a different superlative quantifier entailed by most), but not by a change in the visual input. Thus, the motivation for the subconscious switch in procedures is not to maximize efficiency. Participants use the procedure associated with each quantifier, and in effect, the same display is verified differently depending on which information the visual system is instructed to use by the semantic representation of the sentence. (shrink)

In efforts to achieve the Sustainable Development Goals, social entrepreneurship has gained popularity as a vehicle for positive change in developing countries. The multiplicity of stakeholders, diverging sociocultural contexts and the hybrid mission complicate the process of legitimacy construction for social entrepreneurs as a basis for the acquisition of scarce resources. This study investigates how social entrepreneurs operating in Sub-Saharan Africa and Asia tackle this challenge of bridging conflicting directions in discursive interaction with their European funders. We conduct a multimodal (...) discourse analysis to uncover discursive strategies for legitimacy construction by combining linguistic data from interviews with visual data from social media accounts. Legitimacy construction, and thus resource acquisition, centers on three aspects which interlink pragmatic, cognitive and moral legitimacy: developing innovative solutions, mobilizing private-sector efficiency, and contributing to local empowerment. Presenting these aspects as mutually reinforcing overcomes contradictions between social and business logics and provides an expanded space for legitimacy construction of social entrepreneurship. Discursively constructing legitimacy around a ‘glorified version of social entrepreneurship’ mobilizes resources but downplays the risk of being an entrepreneur in the Global South, contributing to increasing corporatization of social purpose organizations. (shrink)

Our visual environment is highly predictable in terms of where and in which locations objects can be found. Based on visual experience, children extract rules about visual scene configurations, allowing them to generate scene knowledge. Similarly, children extract the linguistic rules from relatively predictable linguistic contexts. It has been proposed that the capacity of extracting rules from both domains might share some underlying cognitive mechanisms. In the present study, we investigated the link between language and scene knowledge (...) development. To do so, we assessed whether preschool children with Developmental Language Disorder, who present several difficulties in the linguistic domain, are equally attracted to object-scene inconsistencies in a visual free-viewing task in comparison with age-matched children with Typical Language Development. All children explored visual scenes containing semantic, syntactic, or both inconsistencies. Since scene knowledge interacts with image properties to guide gaze allocation during visual exploration from the early stages of development, we also included the objects’ saliency rank in the analysis. The results showed that children with DLD were less attracted to semantic and syntactic inconsistencies than children with TLD. In addition, saliency modulated syntactic effect only in the group of children with TLD. Our findings indicate that children with DLD do not activate scene knowledge to guide visual attention as efficiently as children with TLD, especially at the syntactic level, suggesting a link between scene knowledge and language development. (shrink)

ABSTRACTIt is proposed that experts are able to integrate prior contextual knowledge with emergent visual information to make complex predictive judgments about the world around them, often under heightened levels of uncertainty and extreme time constraints. However, limited knowledge exists about the impact of anxiety on the use of such contextual priors when forming our decisions. We provide a novel insight into the combined impact of contextual priors and anxiety on anticipation in soccer. Altogether, 12 expert soccer players were (...) required to predict the actions of an oncoming opponent while viewing life-sized video simulations of 2-versus-2 defensive scenarios. Performance effectiveness and processing efficiency were measured under four conditions: no contextual priors about the action tendencies of the opponent and low anxiety ; no CP and high anxiety ; CP and LA; CP and HA. The provision of contextual priors did not affect processing efficiency, but it improved performance effectiveness... (shrink)

Cognitive Science, Volume 46, Issue 5, May 2022.

We present a general cognitive architecture that tightly integrates symbolic, spatial, and visual representations. A key means to achieving this integration is allowing cognition to move freely between these modes, using mental imagery. The specific components and their integration are motivated by results from psychology, as well as the need for developing a functional and efficient implementation. We discuss functional benefits that result from the combination of multiple content-based representations and the specialized processing units associated with them. Instantiating this (...) theory, we then discuss the architectural components and processes, and illustrate the resulting functional advantages in two spatially and visually rich domains. The theory is then compared to other prominent approaches in the area. (shrink)

This article starts with the environmental changes in human cognition, analyzes the virtual as the main feature of visual perception under digital technology, and explores the transition from passive to active human cognitive activities. With the diversified understanding of visual information, human contradiction of memory also began to become prominent. Aiming at the problem that the existing multimodal TV media recognition methods have low recognition rate of unknown application layer protocols, an adaptive clustering method for identifying unknown application (...) layer protocols is proposed. This method clusters application layer protocols based on similarity of the load characteristics of network stream application layer protocol data. The method divides the similarity calculation in the clustering algorithm to improve the clustering efficiency of the algorithm. Experimental results show that the proposed method can efficiently and accurately recognize unknown visual communication. This article proposes that, in the interactive multimodal visual information transmission, human visual perception experience has changed, the diversity of visual information content expression makes the aesthetic subject more personalized and stylized. (shrink)

Spam electronic mails (emails) refer to harmful and unwanted commercial emails sent to corporate bodies or individuals to cause harm. Even though such mails are often used for advertising services and products, they sometimes contain links to malware or phishing hosting websites through which private information can be stolen. This study shows how the adaptive intelligent learning approach, based on the visual anti-spam model for multi-natural language, can be used to detect abnormal situations effectively. The application of this approach (...) is for spam filtering. With adaptive intelligent learning, high performance is achieved alongside a low false detection rate. There are three main phases through which the approach functions intelligently to ascertain if an email is legitimate based on the knowledge that has been gathered previously during the course of training. The proposed approach includes two models to identify the phishing emails. The first model has proposed to identify the type of the language. New trainable model based on Naive Bayes classifier has also been proposed. The proposed model is trained on three types of languages (Arabic, English and Chinese) and the trained model has used to identify the language type and use the label for the next model. The second model has been built by using two classes (phishing and normal email for each language) as a training data. The second trained model (Naive Bayes classifier) has been applied to identify the phishing emails as a final decision for the proposed approach. The proposed strategy is implemented using the Java environments and JADE agent platform. The testing of the performance of the AIA learning model involved the use of a dataset that is made up of 2,000 emails, and the results proved the efficiency of the model in accurately detecting and filtering a wide range of spam emails. The results of our study suggest that the Naive Bayes classifier performed ideally when tested on a database that has the biggest estimate (having a general accuracy of 98.4%, false positive rate of 0.08%, and false negative rate of 2.90%). This indicates that our Naive Bayes classifier algorithm will work viably on the off chance, connected to a real-world database, which is more common but not the largest. (shrink)

Neurofeedback is a complex learning scenario, as the task consists of trying out mental strategies while processing a feedback signal that signifies activation in the brain area to be self-regulated and acts as a potential reward signal. In an attempt to dissect these subcomponents, we obtained whole-brain networks associated with efficient self-regulation in two paradigms: parallel, where the task was performed concurrently, combining feedback with strategy execution; and serial, where the task was performed consecutively, separating feedback processing from strategy execution. (...) Twenty participants attempted to control their anterior midcingulate cortex using functional magnetic resonance imaging NF in 18 sessions over 2 weeks, using cognitive and emotional mental strategies. We analyzed whole-brain fMRI activations in the NF training runs with the largest aMCC activation for the serial and parallel paradigms. The equal length of the strategy execution and the feedback processing periods in the serial paradigm allows a description of the two task subcomponents with equal power. The resulting activation maps were spatially correlated with functionally annotated intrinsic connectivity brain maps. Brain activation in the parallel condition correlates with the basal ganglia network, the cingulo-opercular network, and the frontoparietal control network ; brain activation in the serial strategy execution condition with the default mode network, the FPCN, and the visual processing network; while brain activation in the serial feedback processing condition predominantly with the CON, the DMN, and the FPCN. Additional comparisons indicate that BG activation is characteristic to the parallel paradigm, while supramarginal gyrus and superior temporal gyrus activations are characteristic to the serial paradigm. The multifaceted view of the subcomponents allows describing the cognitive processes associated with strategy execution and feedback processing independently in the serial feedback task and as combined processes in the multitasking scenario of the conventional parallel feedback task. (shrink)