Natural Language Processing

Частным аспектом предлагаемой реформы интернета является метаномические правила референцирования и адресации виртуальных объектов с целью приближения их к естественным языкам, и создания их логической системы. Однако реформа интернета и преобразование его в средство общения и служения обществу требует также других мер. К этим мерам относится передача определённых имён в неотчуждаемое владение, чтобы их собственники безусловно и беспрепятственно могли осуществлять их право публикации, т.е. публичного высказывания и выражения их мыслей, что также важно для документографии. Другой мерой должно стать упразднение всей сложившейся (...) системы управления интернетом, т.е. бюрократии, после чего техническим службам будут делегированы обязанности по обеспечению его функционирования с учётом высказанной критики. (shrink)

This paper attempts to describe and address a specific puzzle related to compositionality in artificial networks such as Deep Neural Networks and machine learning in general. The puzzle identified here touches on a larger debate in Artificial Intelligence related to epistemic opacity but specifically focuses on computational applications of human level linguistic abilities or properties and a special difficulty with relation to these. Thus, the resulting issue is both general and unique. A partial solution is suggested.

Recursion: A Computational Investigation into the Representation and Processing of Language. By Lobina David.

Consciousness is based on the association of notions or a neural network. Similarly, the creation of the next generation Internet (semantic web) is impossible without attributes that allow the semantic association of documents and their integration into an information context. To achieve these goals, the Universal Metadata Standard (UMS) may serve as a basis for documentography and is functionally required for interpretation of documents by automatic operating systems.

Основой сознания является ассоциативная связь понятий, согласованная работа элементов нейрональной сети. Аналогично этому, создание интернета нового поколения (semantic web) невозможно без атрибутов, позволяющих осуществлять семантическую связь документов и интеграцию их в информационный контекст. Для реализации этих целей предлагается ввести Универсальный Стандарт Метаданных (universal metadata standard, ums), который мог бы служить основой документографии (documentography), функционально необходимой для интерпретации документов в автоматических операционных системах.

Slurs possess interesting linguistic properties and so have recently attracted the attention of linguists and philosophers of language. For instance the racial slur "nigger" is explosively derogatory, enough so that just hearing it mentioned can leave one feeling as if they have been made complicit in a morally atrocious act.. Indeed, the very taboo nature of these words makes discussion of them typically prohibited or frowned upon. Although it is true that the utterance of slurs is illegitimate and derogatory in (...) most contexts, sufficient evidence suggests that slurs are not always or exclusively used to derogate. In fact, slurs are frequently picked up and appropriated by the very in-group members that the slur was originally intended to target. This might be done, for instance, as a means for like speakers to strengthen in-group solidarity. So an investigation into the meaning and use of slurs can give us crucial insight into how words can be used with such derogatory impact, and how they can be turned around and appropriated as vehicles of rapport in certain contexts among in-group speakers. In this essay I will argue that slurs are best characterized as being of a mixed descriptive/expressive type. Next, I will review the most influential accounts of slurs offered thus far, explain their shortcomings, then provide a new analysis of slurs and explain in what ways it is superior to others. Finally, I suggest that a family-resemblance conception of category membership can help us achieve a clearer understanding of the various ways in which slurs, for better or worse, are actually put to use in natural language discourse. (shrink)

Since 1950, when Alan Turing proposed what has since come to be called the Turing test, the ability of a machine to pass this test has established itself as the primary hallmark of general AI. To pass the test, a machine would have to be able to engage in dialogue in such a way that a human interrogator could not distinguish its behaviour from that of a human being. AI researchers have attempted to build machines that could meet this requirement, (...) but they have so far failed. To pass the test, a machine would have to meet two conditions: (i) react appropriately to the variance in human dialogue and (ii) display a human-like personality and intentions. We argue, first, that it is for mathematical reasons impossible to program a machine which can master the enormously complex and constantly evolving pattern of variance which human dialogues contain. And second, that we do not know how to make machines that possess personality and intentions of the sort we find in humans. Since a Turing machine cannot master human dialogue behaviour, we conclude that a Turing machine also cannot possess what is called “general” Artificial Intelligence. We do, however, acknowledge the potential of Turing machines to master dialogue behaviour in highly restricted contexts, where what is called “narrow” AI can still be of considerable utility. (shrink)

While representation learning techniques have shown great promise in application to a number of different NLP tasks, they have had little impact on the problem of ontology matching. Unlike past work that has focused on feature engineering, we present a novel representation learning approach that is tailored to the ontology matching task. Our approach is based on embedding ontological terms in a high-dimensional Euclidean space. This embedding is derived on the basis of a novel phrase retrofitting strategy through which semantic (...) similarity information becomes inscribed onto fields of pre-trained word vectors. The resulting framework also incorporates a novel outlier detection mechanism based on a denoising autoencoder that is shown to improve performance. An ontology matching system derived using the proposed framework achieved an F-score of 94% on an alignment scenario involving the Adult Mouse Anatomical Dictionary and the Foundational Model of Anatomy ontology (FMA) as targets. This compares favorably with the best performing systems on the Ontology Alignment Evaluation Initiative anatomy challenge. We performed additional experiments on aligning FMA to NCI Thesaurus and to SNOMED CT based on a reference alignment extracted from the UMLS Metathesaurus. Our system obtained overall F-scores of 93.2% and 89.2% for these experiments, thus achieving state-of-the-art results. (shrink)

The goal of this paper is two-fold: first, to emphasize causality in disease ontology and knowledge representation, presenting a general and cursory discussion of causality and causal chains; and second, to clarify and develop the River Flow Model of Diseases (RFM). The RFM is an ontological account of disease, representing the causal structure of pathology. It applies general knowledge of causality using the concept of causal chains. The river analogy of disease is explained, formal descriptions are offered, and the RFM (...) disease definition is refined by describing causal chains in terms of causal relations. The definition is updated to coincide with the actual RFM classes found in its upper-level ontology, YAMATO, which brings to light some challenges in developing both YAMATO and the RFM. The RFM is also discussed in relation to another ontological account of disease. Strategies are offered toward interoperability between these theories. (shrink)

In the last decades a growing body of literature in Artificial Intelligence (AI) and Cognitive Science (CS) has approached the problem of narrative understanding by means of computational systems. Narrative, in fact, is an ubiquitous element in our everyday activity and the ability to generate and understand stories, and their structures, is a crucial cue of our intelligence. However, despite the fact that - from an historical standpoint - narrative (and narrative structures) have been an important topic of investigation in (...) both these areas, a more comprehensive approach coupling them with narratology, digital humanities and literary studies was still lacking. With the aim of covering this empty space, in the last years, a multidisciplinary effort has been made in order to create an international meeting open to computer scientist, psychologists, digital humanists, linguists, narratologists etc.. This event has been named CMN (for Computational Models of Narrative) and was launched in the 2009 by the MIT scholars Mark A. Finlayson and Patrick H. Winston1. (shrink)

Artificial intelligence (AI) research enjoyed an initial period of enthusiasm in the 1970s and 80s. But this enthusiasm was tempered by a long interlude of frustration when genuinely useful AI applications failed to be forthcoming. Today, we are experiencing once again a period of enthusiasm, fired above all by the successes of the technology of deep neural networks or deep machine learning. In this paper we draw attention to what we take to be serious problems underlying current views of artificial (...) intelligence encouraged by these successes, especially in the domain of language processing. We then show an alternative approach to language-centric AI, in which we identify a role for philosophy. (shrink)

The central hypothesis of the collaboration between Language and Computing (L&C) and the Institute for Formal Ontology and Medical Information Science (IFOMIS) is that the methodology and conceptual rigor of a philosophically inspired formal ontology greatly benefits application ontologies.[1] To this end LinKBase®, L&C’s ontology, which is designed to integrate and reason across various external databases simultaneously, has been submitted to the conceptual demands of IFOMIS’s Basic Formal Ontology (BFO).[2] With this project we aim to move beyond the level of (...) controlled vocabularies to yield an ontology with the ability to support reasoning applications. Our general procedure has been the implementation of a meta-ontological definition space in which the definitions of all the concepts and relations in LinKBase® are standardized in a framework of first-order logic. In this paper we describe how this standardization has already led to an improvement in the LinKBase® structure that allows for a greater degree of internal coherence than ever before possible. We then show the use of this philosophical standardization for the purpose of mapping external databases to one another, using LinKBase® as translation hub, with a greater degree of success than possible hitherto. We demonstrate how this offers a genuine advance over other application ontologies that have not submitted themselves to the demands of philosophical scrutiny. (shrink)

A new layer of complexity, constituted of networks of information token recurrence, has been identified in socio-technical systems such as the Wikipedia online community and the Zooniverse citizen science platform. The identification of this complexity reveals that our current understanding of the actual structure of those systems, and consequently the structure of the entire World Wide Web, is incomplete, which raises novel questions for data science research but also from the perspective of social epistemology. Here we establish the principled foundations (...) and practical advantages of analyzing information diffusion within and across Web systems with Transcendental Information Cascades, and outline resulting directions for future study in the area of socio-technical systems. We also suggest that Transcendental Information Cascades may be applicable to any kind of time-evolving system that can be observed using digital technologies, and that the structures found in such systems comprise properties common to all naturally occurring complex systems. (shrink)

This article is devoted to describing results of conceptualization of the idea of mind at the stage of maturity. Delineated the acquisition by the energy system (mind) of stable morphological characteristics, which associated with such a pivotal formation as the discourse. A qualitative structural and ontological sign of the system transition to this stage is the transformation of the verbal morphology of the mind into a discursive one. The analysis of the poststructuralist understanding of discourse in the context of the (...) dispersion of meanings (Foucault) made it possible to formulate a notion of it as a meaning that is constituted by the relation between the discursive practice and the worldview, regarded as a meta-discourse or a global discursive formation. In consequence of this relationship, a discrete and simultaneous scattering of meanings arises, the procedural side of which is a concrete discourse, and its productive aspect is linked with the creation of a local discursive formation. Based on this view it is proposed a logical formula of discourse, which takes into account the entropy of the language and the entropy of the worldview, as a particular manifestation of the mind entropy. Using this formula and considering the reactive nature of discourse, it was developed a classification, which included such types of discourses as reactive, suggestive, synthetic and creative. In turn, the proposed types of discourses are correlated with the specific characteristics of certain activities, as a psychological category. Also, it was considered the translation of the structure of discourse dissipation from the cognitive plan into the affective sphere because of which it is formed a hierarchy of significances, which performs the sense-forming function. It was analyzed the inverse influence of the hierarchy of significances on the structure of meanings dispersion and for respective account it was introduced a conditional coefficient of the value deviation of the significance of the meanings. This parameter reflects the sense correction of the meaning that occurs in the process of the emergence of discourse from discursive practice. Thus, the discourse is presented as a complex dynamic formation of the mind arising at the maturity stage of the system as a result of the combined effect of entropic dispersion of meanings and the value deviation of their significances. (shrink)

Pickering & Garrod (P&G) claim that the automatic mechanisms that underlie language processing in dialogue are absent in monologue. We disagree with this claim, and argue that dialogue simply provides a different context in which the same basic processes operate.

Pickering & Garrod's (P&G's) call to study language processing in dialogue context is an appealing one. Their interactive alignment model is ambitious, aiming to explain the converging behavior of dialogue partners via both intra- and interpersonal priming. However, they ignore the flexible, partner-specific processing demonstrated by some recent dialogue studies. We discuss implications of these data.

Locality is a key concept not only in linguistic theorizing, but in explaining pattern of acquisition and patterns of recovery in garden path sentences, as well. If syntax relates sound and meaning over an infinite domain, syntactic dependencies and operations must be restricted in such a way to apply over limited, finite domains in order to be detectable at all. The theory of what these finite domains are and how they relate to the fundamentally unbounded nature of syntax is the (...) theory of locality. The papers in this collection all deal with the concept of locality in syntactic theory, and, more specifically, describe and analyze the various contributions Luigi Rizzi has made to this area over the past three and a half decades. The authors are all eminent linguists in generative syntax who have collaborated with Rizzi closely, and in eleven chapters, they explore locality in both pure syntax and psycholinguistics. This collection is essential reading for students and scholars of linguistic theory, generative syntax, and comparative syntax. (shrink)

Although personal relevance is key to sustaining an audience’s interest in any given narrative, it has received little systematic attention in scholarship to date. Across centuries and media, adaptations have been used extensively to bring temporally or geographically distant narratives “closer” to the recipient under the assumption that their impact will increase. In this review article, we review experimental and other empirical evidence on narrative processing in order to unravel which types of personal relevance are more likely to be impactful (...) than others, which types of impact (e.g. aesthetic, therapeutic, persuasive) they have been found to generate, and where their power may become excessive or outright detrimental to reader experience. (shrink)

In the last two decades, WORDNET has evolved as the most comprehensive computational lexicon of general English. In this article, we discuss its potential for supporting the creation of an entirely new kind of information resource for public health, viz. MEDICAL WORDNET. This resource is not to be conceived merely as a lexical extension of the original WORDNET to medical terminology; indeed, there is already a considerable degree of overlap between WORDNET and the vocabulary of medicine. Instead, we propose a (...) new type of repository, consisting of three large collections of (1) medically relevant word forms, structured along the lines of the existing Princeton WORDNET; (2) medically validated propositions, referred to here as medical facts, which will constitute what we shall call MEDICAL FACTNET; and (3) propositions reflecting laypersons’ medical beliefs, which will constitute what we shall call the MEDICAL BELIEFNET. We introduce a methodology for setting up the MEDICAL WORDNET. We then turn to the discussion of research challenges that have to be met in order to build this new type of information resource. (shrink)

Some recent scientific discoveries regarding the signs of language, which impact my own ongoing project as a visual/conceptual artist, also dramatically impact the Saussurian foundation of the prevalent cultural theories which underlie the curatorial priorities of many major art institutions.

Equipped with the ultimate query answering system, computers would finally be in a position to address all our information needs in a natural way. In this paper, we describe how Language and Computing nv (L&C), a developer of ontology-based natural language understanding systems for the healthcare domain, is working towards the ultimate Question Answering (QA) System for healthcare workers. L&C’s company strategy in this area is to design in a step-by-step fashion the essential components of such a system, each component (...) being designed to solve some one part of the total problem and at the same time reflect well-defined needs on the prat of our customers. We compare our strategy with the research roadmap proposed by the Question Answering Committee of the National Institute of Standards and Technology (NIST), paying special attention to the role of ontology. (shrink)

A consumer health information system must be able to comprehend both expert and non-expert medical vocabulary and to map between the two. We describe an ongoing project to create a new lexical database called Medical WordNet (MWN), consisting of medically relevant terms used by and intelligible to non-expert subjects and supplemented by a corpus of natural-language sentences that is designed to provide medically validated contexts for MWN terms. The corpus derives primarily from online health information sources targeted to consumers, and (...) involves two sub-corpora, called Medical FactNet (MFN) and Medical BeliefNet (MBN), respectively. The former consists of statements accredited as true on the basis of a rigorous process of validation, the latter of statements which non-experts believe to be true. We summarize the MWN / MFN / MBN project, and describe some of its applications. (shrink)

Description logics and other formal devices are frequently used as means for preventing or detecting mistakes in ontologies. Some of these devices are also capable of inferring the existence of inter-concept relationships that have not been explicitly entered into an ontology. A prerequisite, however, is that this information can be derived from those formal definitions of concepts and relationships which are included within the ontology. In this paper, we present a novel algorithm that is able to suggest relationships among existing (...) concepts in a formal ontology that are not derivable from such formal definitions. The algorithm exploits cross-lingual information that is implicitly present in the collection of terms used in various languages to denote the concepts and relationships at issue. By using a specific experimental design, we are able to quantify the impact of cross-lingual information in coping with underspecification in formal ontologies. (shrink)

How political opinions are spread on social media has been the subject of many academic researches recently, and rightly so. Social platforms give researchers a unique opportunity to understand how public discourses are perceived, owned and instrumentalized by the general public. This paper is instead focussing on the political discourses themselves, and how a specific machine learning technique - vector space models (VSMs) -, can be used to make systematic and more objective discourse analysis. Political footprints are vector-based representation of (...) a political discourse in which each vector represents a word, they are produced thanks to the training of the English lexicon on large corpora of text. This paper describes a simple implementation of political footprints, some heuristics on how to use them, and their application to four cases: the U.N. Kyoto Protocol and Paris Agreement, the 2008 and 2016 U.S. presidential elections. The reader will be given some reasons to believe that political footprints produce meaningful results, suggestions on how to improve them and validate the results. (shrink)

The central hypothesis of the collaboration between Language and Computing (L&C) and the Institute for Formal Ontology and Medical Information Science (IFOMIS) is that the methodology and conceptual rigor of a philosophically inspired formal ontology greatly benefits application ontologies. To this end r®, L&C’s ontology, which is designed to integrate and reason across various external databases simultaneously, has been submitted to the conceptual demands of IFOMIS’s Basic Formal Ontology (BFO). With this project we aim to move beyond the level of (...) controlled vocabularies to yield an ontology with the ability to support reasoning applications. Our general procedure has been the implementation of a meta-ontological definition space in which the definitions of all the concepts and relations in LinKBase® are standardized in a framework of first-order logic. In this paper we describe how this standardization has already led to an improvement in the LinKBase® structure that allows for a greater degree of internal coherence than ever before possible. We then show the use of this philosophical standardization for the purpose of mapping external databases to one another, using LinKBase® as translation hub, with a greater degree of success than possible hitherto. We demonstrate how this offers a genuine advance over other application ontologies that have not submitted themselves to the demands of philosophical scrutiny. LinKBase® is one of the world’s largest applications-oriented medical domain ontologies, and BFO is one of the world’s first philosophically driven reference ontologies. The collaboration of the two thus initiates a new phase in the quest to solve the so-called “Tower of Babel”. (shrink)

The discipline of ontology has enjoyed a checkered history since 1606, with a significant expansion in recent years. We focus here on those developments in the recent history of philosophy which are most relevant to the understanding of the increased acceptance of ontology, and especially of realist ontology, as a valuable method also outside the discipline of philosophy.

This paper develops the ontology of space objects for theoretical and computational ontology applied to the space (astronautical/astronomical) domain. It follows “An ontological architecture for Orbital Debris Data” (Rovetto, 2015) and “Preliminaries of a Space Situational Awareness Ontology” (Rovetto, Kelso, 2016). Important considerations for developing a space object ontology, or more broadly, a space domain ontology are presented. The main category term ‘Space Object’ is analyzed from a philosophical perspective. The ontological commitments of legal definitions for artificial space objects are (...) also discussed. Space object taxonomies are offered and space object terms are defined. (shrink)

The orbital space environment is home to natural and artificial satellites, debris, and space weather phenomena. As the population of orbital objects grows so do the potential hazards to astronauts, space infrastructure and spaceflight capability. Orbital debris, in particular, is a universal concern. This and other hazards can be minimized by improving global space situational awareness (SSA). By sharing more data and increasing observational coverage of the space environment we stand to achieve that goal, thereby making spaceflight safer and expanding (...) our knowledge of near-Earth space. To facilitate data-sharing interoperability among distinct orbital debris and space object catalogs, and SSA information systems, I proposed ontology in (Rovetto, 2015) and (Rovetto and Kelso, 2016). I continue this effort toward formal representations and models of the overall domain that may serve to improve peaceful SSA and increase our scientific knowledge. This paper explains the project concept introduced in those publications, summarizing efforts to date as well as the research field of ontology development and engineering. I describe concepts for an ontological framework for the orbital space environment, near-Earth space environment and SSA domain. An ontological framework is conceived as a part of a potential international information system. The purpose of such a system is to consolidate, analyze and reason over various sources and types of orbital and SSA data toward the mutually beneficial goals of safer space navigation and scientific research. Recent internationals findings on the limitations of orbital data, in addition to existing publications on collaborative SSA, demonstrate both the overlap with this project and the need for data-sharing and integration. (shrink)

Space situational awareness (SSA) is vital for international safety and security, and for the future of space travel. The sharing of SSA data and information should improve the state of global SSA for planetary defense and spaceflight safety. I take steps toward a Space Situational Awareness (SSA) Ontology, and outline some central objectives, requirements and desiderata in the ontology development process for this domain. The purpose of this ontological system is to explore the potential for the ontology research topic to (...) (i) represent SSA general knowledge, data, and entities/objects, (ii) clearly express the meaning of SSA data, and (iii) foster SSA data-sharing. The overall goal and motivation is to (iv) improve our capacity for planetary defense, e.g., from near- or deep-space objects and phenomena, and (v) facilitate safer and peaceful space access, navigation and travel, by improving global SSA. This research is thereby intended only for peaceful space-domain applications and uses, with particular interests in orbital debris. There is little application of ontology to the space domain as compared with other disciplines and little if any ontological development of SSA and related domains. In this respect, this paper offers novel concepts. (shrink)

A short summary paper of my Orbital Space Domain Ontology project (purl.org/space-ontology), originally conceived in 2011. Since then I've sought (without success) opportunities to realize it (either as a PhD or other degree thesis; or in an employment position) toward my original passion of entering the space sector and gaining further space education. Since then persons in the relevant space disciplines have seen the potential in it, and unfortunately some have taken advantage of my ideas yet excluded me from work. (...) I continue to struggle to fight for my own ideas as I see others professionally and financially benefit at my expense. References and documentation are available upon request to confirm my early ideation and origination on this topic. Please contact me if you have opportunities. Thank you. (shrink)

This paper applies some ontology architectures to the space domain, specifically the orbital and near-earth space environment and the space situational awareness domain. I briefly summarize local, single and hybrid ontology architectures, and offer potential space ontology architectures for each by showing how actual space data sources and space organizations would be involved.

The orbital debris problem presents an opportunity for inter-agency and international cooperation toward the mutually beneficial goals of debris prevention, mitigation, remediation, and improved space situational awareness (SSA). Achieving these goals requires sharing orbital debris and other SSA data. Toward this, I present an ontological architecture for the orbital debris and broader SSA domain, taking steps in the creation of an orbital debris ontology (ODO). The purpose of this ontological system is to (I) represent general orbital debris and SSA domain (...) knowledge, (II) structure, and standardize where needed, orbital data and terminology, and (III) foster semantic interoperability and data-sharing. In doing so I hope to (IV) contribute to solving the orbital debris problem, improving peaceful global SSA, and ensuring safe space travel for future generations. (shrink)