When producing a description of a target referent in a visual context, speakers need to choose a set of properties that distinguish it from its distractors. Computational models of language production/generation usually model this as a search process and predict that the time taken will increase both with the number of distractors in a scene and with the number of properties required to distinguish the target. These predictions are reminiscent of classic findings in visual search; however, unlike models of reference (...) production, visual search models also predict that search can become very efficient under certain conditions, something that reference production models do not consider. This paper investigates the predictions of these models empirically. In two experiments, we show that the time taken to plan a referring expression—as reflected by speech onset latencies—is influenced by distractor set size and by the number of properties required, but this crucially depends on the discriminability of the properties under consideration. We discuss the implications for current models of reference production and recent work on the role of salience in visual search. (shrink)

This article offers a survey of computational research on referring expressions generation (REG). It introduces the REG problem and describes early work in this area, discussing what basic assumptions lie behind it, and showing how its remit has widened in recent years. We discuss computational frameworks underlying REG, and demonstrate a recent trend that seeks to link up REG algorithms with well-established Knowledge Representation traditions. Considerable attention is given to recent efforts at evaluating REG algorithms and the lessons that they (...) allow us to learn. The article concludes with a discussion of the way forward in REG, focussing on references in larger and more realistic settings. (shrink)

In a recent article published in this journal (van Deemter, Gatt, van der Sluis, & Power, 2012), the authors criticize the Incremental Algorithm (a well-known algorithm for the generation of referring expressions due to Dale & Reiter, 1995, also in this journal) because of its strong reliance on a pre-determined, domain-dependent Preference Order. The authors argue that there are potentially many different Preference Orders that could be considered, while often no evidence is available to determine which is a good one. (...) In this brief note, however, we suggest (based on a learning curve experiment) that finding a Preference Order for a new domain may not be so difficult after all, as long as one has access to a handful of human-produced descriptions collected in a semantically transparent way. We argue that this is due to the fact that it is both more important and less difficult to get a good ordering of the head than of the tail of a Preference Order. (shrink)

Psycholinguistic studies often look at the production of referring expressions in interactive settings, but so far few referring expression generation algorithms have been developed that are sensitive to earlier references in an interaction. Rather, such algorithms tend to rely on domain-dependent preferences for both content selection and linguistic realization. We present three experiments showing that humans may opt for dispreferred attributes and dispreferred modifier orderings when these were primed in a preceding interaction (without speakers being consciously aware of this). In (...) addition, we show that speakers are more likely to produce overspecified references, including dispreferred attributes (although minimal descriptions with preferred attributes would suffice), when these were similarly primed. (shrink)

In this paper it is shown how a partial semantics for presuppositions can be given which is empirically more satisfactory than its predecessors, and how this semantics can be integrated with a technically sound, compositional grammar in the Montagovian fashion. Additionally, it is argued that the classical objection to partial accounts of presupposition projection, namely that they lack “flexibility,” is based on a misconception. Partial logics can give rise to flexible predictions without postulating any ad hoc ambiguities. Finally, it is (...) shown how the partial foundation can be combined with a dynamic system of common-ground maintenance to account for accommodation. (shrink)

An attractive way to model the relation between an underspecified syntactic representation and its completions is to let the underspecified representation correspond to a logical description and the completions to the models of that description. This approach, which underlies the Description Theory of Marcus et al. 1983 has been integrated in Vijay-Shanker 1992 with a pure unification approach to Lexicalized Tree-Adjoining Grammars (Joshi et al. 1975, Schabes 1990). We generalize Description Theory by integrating semantic information, that is, we propose to (...) tackle both syntactic and semantic underspecification using descriptions. (shrink)

This study employed a scenario-based approach whereby participants were asked to choose which communication channel they prefer in certain situations. The first aim was to determine the effect of the topic of interactions and social ties on channel choice. The second aim was to examine the underlying mechanisms in the relation between interaction topic and social ties and channel choice. A questionnaire was administered among 238 participants, who were presented five communication scenarios with topics of low and high intimacy and (...) four social ties, ranging from weak to strong. Results revealed that preference for face-to-face communication was highest, followed by audio-only computer-mediated communication and text-based CMC. Preference for FtF communication was higher when people valued feeling co-present and decreased when people valued feeling anonymous. Our results showed that communication channel choice is strategic and the choice for FtF ommunication, audio-only and text-based CMC largely depends on controllability, anonymity and co-presence. (shrink)

In this paper it is shown how a partial semantics for presuppositions can be given which is empirically more satisfactory than its predecessors, and how this semantics can be integrated with a technically sound, compositional grammar in the Montagovian fashion. Additionally, it is argued that the classical objection to partial accounts of presupposition projection, namely that they lack “flexibility,” is based on a misconception. Partial logics can give rise to flexible predictions without postulating any ad hoc ambiguities. Finally, it is (...) shown how the partial foundation can be combined with a dynamic system of common-ground maintenance to account for accommodation. (shrink)

This study investigates to what extent the amount of variation in a visual scene causes speakers to mention the attribute color in their definite target descriptions, focusing on scenes in which this attribute is not needed for identification of the target. The results of our three experiments show that speakers are more likely to redundantly include a color attribute when the scene variation is high as compared with when this variation is low (even if this leads to overspecified descriptions). We (...) argue that these findings are problematic for existing algorithms that aim to automatically generate psychologically realistic target descriptions, such as the Incremental Algorithm, as these algorithms make use of a fixed preference order per domain and do not take visual scene variation into account. (shrink)

We report on two experiments investigating the effect of an increased cognitive load for speakers on the choice of referring expressions. Speakers produced story continuations to addressees, in which they referred to characters that were either salient or non-salient in the discourse. In Experiment 1, referents that were salient for the speaker were non-salient for the addressee, and vice versa. In Experiment 2, all discourse information was shared between speaker and addressee. Cognitive load was manipulated by the presence or absence (...) of a secondary task for the speaker. The results show that speakers under load are more likely to produce pronouns, at least when referring to less salient referents. We take this finding as evidence that speakers under load have more difficulties taking discourse salience into account, resulting in the use of expressions that are more economical for themselves. (shrink)

In two experiments, we investigate to what extent various visual saliency cues in realistic visual scenes cause speakers to overspecify their definite object descriptions with a redundant color attribute. The results of the first experiment demonstrate that speakers are more likely to redundantly mention color when visual clutter is present in a scene as compared to when this is not the case. In the second experiment, we found that distractor type and distractor color affect redundant color use: Speakers are most (...) likely to overspecify if there is at least one distractor object present that has the same type, but a different color than the target referent. Reliable effects of distractor distance were not found. Taken together, our results suggest that certain visual saliency cues guide speakers in determining which objects in a visual scene are relevant distractors, and which not. We argue that this is problematic for algorithms that aim to generate human-like descriptions of objects, since these generally select properties that help to distinguish a target from all objects that are present in a scene. (shrink)

Past research has sought to elucidate how speakers and addressees establish common ground in conversation, yet few studies have focused on how visual cues such as co-speech gestures contribute to this process. Likewise, the effect of cognitive constraints on multimodal grounding remains to be established. This study addresses the relationship between the verbal and gestural modalities during grounding in referential communication. We report data from a collaborative task where repeated references were elicited, and a time constraint was imposed to increase (...) cognitive load. Our results reveal no differential effects of repetition or cognitive load on the semantic-based gesture rate, suggesting that representational gestures and speech are closely coordinated during grounding. However, gestures and speech differed in their execution, especially under time pressure. We argue that speech and gesture are two complementary streams that might be planned in conjunction but that unfold independently in later stages of language production, with speakers emphasizing the form of their gestures, but not of their words, to better meet the goals of the collaborative task. (shrink)

This article introduces the topic ‘‘Production of Referring Expressions: Bridging the Gap between Computational and Empirical Approaches to Reference’’ of the journal Topics in Cognitive Science. We argue that computational and psycholinguistic approaches to reference production can benefit from closer interaction, and that this is likely to result in the construction of algorithms that differ markedly from the ones currently known in the computational literature. We focus particularly on determinism, the feature of existing algorithms that is perhaps most clearly at (...) odds with psycholinguistic results, discussing how future algorithms might include non-determinism, and how new psycholinguistic experiments could inform the development of such algorithms. (shrink)

It has often been observed that color is a highly preferred attribute for use in distinguishing descriptions, that is, referring expressions produced with the purpose of identifying an object within a visual scene. However, most of these observations were based on visual displays containing only colors that were maximally different in hue and for which the language of experimentation possessed basic color terms. The experiments described in this paper investigate whether speakers’ preference for color is reduced if the color of (...) the target referent is similar to that of the distractors. Because colors that look similar are often also harder to distinguish linguistically, we also examine the impact of the codability of color values. As a third factor, we investigate the salience of available alternative attributes and its impact on the use of color. The results of our experiments show that, while speakers are indeed less likely to use color when the colors in a display are similar, this effect is mostly due to the difficulty in naming similar colors. Color use for color with a basic color term is affected only when the colors of target and distractors are very similar. The salience of our alternative attribute size, manipulated by varying the difference in size between target and distractors, had no impact on the use of color. (shrink)

It has often been observed that color is a highly preferred attribute for use in distinguishing descriptions, that is, referring expressions produced with the purpose of identifying an object within a visual scene. However, most of these observations were based on visual displays containing only colors that were maximally different in hue and for which the language of experimentation possessed basic color terms. The experiments described in this paper investigate whether speakers’ preference for color is reduced if the color of (...) the target referent is similar to that of the distractors. Because colors that look similar are often also harder to distinguish linguistically, we also examine the impact of the codability of color values. As a third factor, we investigate the salience of available alternative attributes and its impact on the use of color. The results of our experiments show that, while speakers are indeed less likely to use color when the colors in a display are similar, this effect is mostly due to the difficulty in naming similar colors. Color use for color with a basic color term is affected only when the colors of target and distractors are very similar (yet still distinguishable). The salience of our alternative attribute size, manipulated by varying the difference in size between target and distractors, had no impact on the use of color. (shrink)

We investigate how conventional asset managers account for environmental, social, and governance factors in their investment process. We do so on the basis of an international survey among fund managers. We find that many conventional managers integrate responsible investing in their investment process. Furthermore, we find that ESG information in particular is being used for red flagging and to manage risk. We find that many conventional fund managers have already adopted features of responsible investing in the investment process. Furthermore, we (...) argue and show that ESG investing is highly similar to fundamental investing. We also reveal that there is a substantial difference in the ways in which U.S. and European asset managers view ESG. (shrink)

We investigate how conventional asset managers account for environmental, social, and governance factors in their investment process. We do so on the basis of an international survey among fund managers. We find that many conventional managers integrate responsible investing in their investment process. Furthermore, we find that ESG information in particular is being used for red flagging and to manage risk. We find that many conventional fund managers have already adopted features of responsible investing in the investment process. Furthermore, we (...) argue and show that ESG investing is highly similar to fundamental investing. We also reveal that there is a substantial difference in the ways in which U.S. and European asset managers view ESG. (shrink)

Our think tank tasked by the Dutch Health Council, consisting of Radboud University Nijmegen Honours Academy students with various backgrounds, investigated the implications of Deep Brain Stimulation for psychiatric patients. During this investigation, a number of methodological, ethical and societal difficulties were identified. We consider these difficulties to be a reflection of a still fragmented field of research that can be overcome with improved organization and communication. To this effect, we suggest that it would be useful to found a centralized (...) DBS organization. Such an organization makes it possible to 1) set up and maintain a repository, 2) facilitate DBS studies with a larger sample size, 3) improve communication amongst researchers, clinicians and ethical committees, and 4) improve communication between DBS experts and the public at large. (shrink)

Our think tank tasked by the Dutch Health Council, consisting of Radboud University Nijmegen Honours Academy students with various backgrounds, investigated the implications of Deep Brain Stimulation for psychiatric patients. During this investigation, a number of methodological, ethical and societal difficulties were identified. We consider these difficulties to be a reflection of a still fragmented field of research that can be overcome with improved organization and communication. To this effect, we suggest that it would be useful to found a centralized (...) DBS organization. Such an organization makes it possible to 1) set up and maintain a repository, 2) facilitate DBS studies with a larger sample size, 3) improve communication amongst researchers, clinicians and ethical committees, and 4) improve communication between DBS experts and the public at large. (shrink)

Digitization and datafication of public space have a significant impact on how cities are developed, governed, perceived and used. As technological developments are based upon political decisions, which impact people’s everyday lives, and from which not everyone benefits or suffers equally, we argue that ‘the smart city’ should be part of continuous public debate; that it should be considered and treated as a social problem. Through nine focus groups, we invited respondents to explore and discuss instances and dilemmas of the (...) smart city. We investigated which interpretative repertoires they used to frame the smart city as a social and actionable problem. Following Blumer's and Gamson's theories on the social construction of problems and on collective action frames, we assessed respondents’ discursive interpretations and their subjective construction of their senses of injustice, agency and identity regarding this subject. We find that – in the context of the city of Rotterdam in The Netherlands – citizens do not experience and consider the smart city as a social and actionable problem. Although they do associate the technological development of smart cities with potential threats, this does not change or constrain their sense of ‘actionability’, nor their behaviour, as they consider themselves to be powerless individuals regarding what, in their eyes, is a complex, elusive and inevitable situation they are confronted with. Strikingly, rather than specifically and contextually reflecting on smart city issues, respondents tended to express their concerns in the more general context of digital and data technologies invading everyday life. (shrink)

This response discusses the experiment reported in Krahmer et al.’s Letter to the Editor of Cognitive Science. We observe that their results do not tell us whether the Incremental Algorithm is better or worse than its competitors, and we speculate about implications for reference in complex domains, and for learning from ‘‘normal” (i.e., non-semantically-balanced) corpora.

In decision-theory, the notion of regret enters into the minimax decision-rule and has a determinate usage in this context. However, there are many alternative ways of conceiving of regret. The chapter constructs the einmalist- nicht-keinmal ('once is not never') game, in which a single sampling radically changes the expected value of the game in a way that is quite counterintuitive, as the basis for studying regret after a loss following the choice of an uncertain action. Crucially, the very loss affects (...) the posterior expectation of the game and the posterior credence about the objective chances of a win. Our taxonomy of regret contains regret over the action chosen and regret over the outcome obtained as its main categories, and is mirrored by a taxonomy of joy after a win following the choice of an uncertain action, and is used to critique of Krähmer and Stone's analysis of risk aversion for uncertain actions. (shrink)

This paper discusses some formal properties of trivalent approaches to presupposition projection, and in particular of the middle Kleene system of Peters (1977) and Krahmer (1998). After exploring the relationship between trivalent truth-functional accounts and dynamic accounts in the tradition of Heim (1983), I show how the middle Kleene trivalent account can be formulated in a way which shows that it meets the explanatory challenge of Schlenker (2006, 2008a,b), and provide some results relating to the application of the middle (...) Kleene approach to generalised quantifiers. (shrink)

According to a marginal lemma in the only manuscript that carries the poem , the painting of the world described in a well-known ecphrasis by John of Gaza was situated in the winter baths of Gaza. According to the standard edition of John's poem by P. Friedlaender, these are the baths Choricius of Gaza refers to as in course of construction at Gaza in A.D. 535 or 536. If so, then both the painting and John's poem would have to be (...) later than this. And since the poem does not claim to have been written for the dedication of the baths, it might be considerably later. G. Krahmer even dated it to the seventh century, on the grounds that John misunderstood some details of the picture he was describing. (shrink)