Epistemic Evaluation aims to explore and apply a particular methodology in epistemology. The methodology is to consider the point or purpose of our epistemic evaluations, and to pursue epistemological theory in light of such matters. Call this purposeful epistemology. The idea is that considerations about the point and purpose of epistemic evaluation might fruitfully constrain epistemological theory and yield insights for epistemological reflection. Several contributions to this volume explicitly address this general methodology, or some version of it. Others focus on (...) advancing some application of the methodology rather than on theorizing about it. The papers go on to explore the idea that purposes allow one to understand the conceptual demands on knowing, examine how purposeful epistemology might shed light on the debate between internalist and externalist epistemologies, and further develop the idea of purposeful epistemology. (shrink)

This monograph poses a series of key problems of evidential reasoning and argumentation. It then offers solutions achieved by applying recently developed computational models of argumentation made available in artificial intelligence. Each problem is posed in such a way that the solution is easily understood. The book progresses from confronting these problems and offering solutions to them, building a useful general method for evaluating arguments along the way. It provides a hands-on survey explaining to the reader how to use current (...) argumentation methods and concepts that are increasingly being implemented in more precise ways for the application of software tools in computational argumentation systems. It shows how the use of these tools and methods requires a new approach to the concepts of knowledge and explanation suitable for diverse settings, such as issues of public safety and health, debate, legal argumentation, forensic evidence, science education, and the use of expert opinion evidence in personal and public deliberations. (shrink)

Increasingly, the high throughput technologies used by biomedical researchers are bringing about a situation in which large bodies of data are being described using controlled structured vocabularies—also known as ontologies—in order to support the integration and analysis of this data. Annotation of data by means of ontologies is already contributing in significant ways to the cumulation of scientific knowledge and, prospectively, to the applicability of cross-domain algorithmic reasoning in support of scientific advance. This very success, however, has led to a (...) proliferation of ontologies of varying scope and quality. We define one strategy for achieving quality assurance of ontologies—a plan of action already adopted by a large community of collaborating ontologists—which consists in subjecting ontologies to a process of peer review analogous to that which is applied to scientific journal articles. (shrink)

Section I: Introduction -- Section II: Managing organizational pluralism: how individuals navigate moral contradictions and compromise -- Section III: Looking at organizations critically: rhetoric, justification and criticism-as-practice -- Section IV: Reconsidering valuation and evaluation in organizations -- Section V: Pushing the boundaries of pragmatic sociology's theoretical agenda.

Prof. Dr. Mustafa Demirci's monograph "Black Rage: The Rebellion of Negro Slaves in the Medieval Islamic World (869-883)" on the 'Zanj rebellion' that took place between 869-883 A.D., during the Abbasid period, and was led by the Ali b. Muhammad, is one of the most important studies both in terms of its subject matter and the author's approach and perspective on the subject. The study, which was prepared with a rich academic literature using basic sources and modern research on the (...) subject, deals with issues such as the geography of the event, the causes and spread of the rebellion, the wars and warfare techniques to suppress the rebellion, the short and long-term effects of the damage left behind by the rebellion from an academic perspective in chronological order. The Zanj revolt started in the marshes of Basra in 869 as a result of Ali b. Muhammad (d. 883), who was originally white and claimed to be a descendant of Ali, organizing black slaves working under difficult conditions in the large farms in and around Basra, and the rebellion grew and spread in a short time. Muwaffak Billāh (843-891), the brother of the Abbasid Caliph Mu’temid Alallâh (843-892), who was assigned to suppress the revolt, was victorious against the rebels after tough struggles, and the revolt ended with the killing of the leader of the rebellion, Ali b. Muhammad, in 883. (shrink)

The present study discusses the action of burning the Holy Quran in Malmö, Sweden, by the Danish far-right politician Rasmus Paludan, in more than 300 points in Denmark, Sweden and Norway, especially in terms of evolving into social events that turned into riots and fueled Islamophobic debates. The purpose of the study will be to understand the discussion universe formed by the acceptance of the Swedish State in an Islamophobic and racist act, such as the burning of the holy book (...) by Paludan, with a high incitement and humiliating power. In the present study, which has a qualitative design, books, articles and newspapers on the subject were examined by using the document analysis method. As a result, since the motto of unlimited freedom of expression of the Scandinavian model gives the right to swear at far-right politicians, especially insulting religion, the Muslim society living in Europe has become the target of politicians with a kind of state policy armor, making them increasingly sensitive and vulnerable in the position of hate objects. In this regard, there is a need to redefine where the limits of freedom of thought must end. (shrink)

This book explores the intersection of evaluation studies and care ethics in contemporary Western societies. In all societies and institutions, large and small, we find forces that can strengthen or destroy their fabric. One new regulation, law, or policy can impact the lives of many who find themselves in precarious positions. Think, for example, about health care reform and migrant policies in various Western countries and their effects on the everyday lives of millions of people. Policies, programs, and those who (...) execute them can threaten the daily routines of our lives, and we can respond by withdrawing or freezing, doing nothing and thinking it will pass. Or we can respond with resistance, anger, and sometimes much worse, like the shootings in several American cities. (shrink)

Against those who identify genealogy with reductive genealogical debunking or deny it any evaluative and action-guiding significance, I argue for the following three claims: that although genealogies, true to their Enlightenment origins, tend to trace the higher to the lower, they need not reduce the higher to the lower, but can elucidate the relation between them and put us in a position to think more realistically about both relata; that if we think of genealogy’s normative significance in terms of a (...) triadic model that includes the genealogy’s addressee, we can see that in tracing the higher to the lower, a genealogy can facilitate an evaluation of the higher element, and where the lower element is some important practical need rather than some sinister motive, the genealogy can even be vindicatory; and finally, that vindicatory genealogies can offer positive guidance on how to engineer better concepts. (shrink)

Judges were never bound by law to convict a defendant unless they considered him guilty. Yet, they could be prohibited by law from convicting a person they consider guilty due to the absence of legally prescribed or the presence of legally prohibited evidence.Evaluation of Evidence addresses the question: should the law restrict the freedom of judges in assessing the probative value of evidence in the criminal process? Tracing the treatment of evidence from pre-modern to modern times, Mirjan Damaška argues that (...) there has always been some understanding about rules regarding the use and treatment of evidence, and these rules should not be looked askance as a departure from ideal arrangements. In a time when science and technology have the ability to contribute to factual inquiry, there needs to be acceptance of rules that expand or corroborate evidence produced by our native sensory apparatus. (shrink)

An Archaeology of Educational Evaluation: Epistemological Spaces and Political Paradoxes outlines the epistemology of the theories and models that are currently employed to evaluate educational systems, education policy, educational professionals and students learning. It discusses how those theories and models find their epistemological conditions of possibility in a specific set of conceptual transferences from mathematics and statistics, political economy, biology and the study of language. The book critically engages with the epistemic dimension of contemporary educational evaluation and is of theoretical (...) and methodological interest. It uses Foucauldian archaeology as a problematizing method of inquiry within the wider framework of governmentality studies. It goes beyond a mere critique of the contemporary obsession for evaluation and attempts to replace it with the opening of a free space where the search for a mode of being, acting and thinking in education is not over-determined by the tyranny of improvement. This book will appeal to academics, researchers and post-graduate students in the fields of educational philosophy, education policy and social science. (shrink)

Evaluation of clinical ethics support services (CESS) has attracted considerable interest in recent decades. However, few evaluation studies are explicit about normative presuppositions which underlie the goals and the research design of CESS evaluation. In this paper, we provide an account of normative premises of different approaches to CESS evaluation and argue that normativity should be a focus of considerations when designing and conducting evaluation research of CESS. In a first step, we present three different approaches to CESS evaluation from (...) published literature. Next to a brief sketch of the well-established approaches of ‘descriptive evaluation’ and ‘evaluation of outcomes’, we will give a more detailed description of a third approach to evaluation—‘reconstructing quality norms of CESS’—which is explicit about the normative presuppositions of its research (design). In the subsequent section, we will analyse the normative premises of each of the three approaches to CESS evaluation. We will conclude with a brief argument for more sensitivity towards the normativity of CESS and its evaluation research. (shrink)

This paper critically analyses realist evaluation, focussing on its primary analytical concepts: mechanisms, contexts, and outcomes. Noting that nursing investigators have had difficulty in operationalizing the concepts of mechanism and context, it is argued that their confusion is at least partially the result of ambiguities, inconsistencies, and contradictions in the realist evaluation model. Problematic issues include the adoption of empiricist and idealist positions, oscillation between determinism and voluntarism, subsumption of agency under structure, and categorical confusion between context and mechanism. In (...) relation to outcomes, it is argued that realist evaluation's adoption of the fact/value distinction prevents it from taking into account the concerns of those affected by interventions. The aim of the paper is to use these immanent critiques of realist evaluation to construct an internally consistent realist approach to evaluation that is more amenable to being operationalized by nursing researchers. (shrink)

This book argues that the moral quality of an act comes from the agent's inner states. By arguing for the indispensable relevance of intention in the moral evaluation of acts, the book moves against a mainstream, 'objective' approach in normative ethics. It is commonly held that the intentions, knowledge, and volition of agents are irrelevant to the moral permissibility of their acts. This book stresses that the capacities of agency, rather than simply the label 'agent', must be engaged during an (...) act if its moral evaluation is to be coherent. The author begins with an ontological argument that an act is a motion or a causing of change in something else. He argues that the source of an act's moral meaning is in the agent: specifically, what the agent, if aware of relevant facts around her, aims to accomplish. He then moves to a series of critical chapters that consider arguments for mainstream approaches to act evaluation, including Thomson's dismissal of the agent knowledge and volition requirements, Scanlon's arguments for a derivative relevance of intentions to permissibility, Frowe's "causal roles" of agents in the moral evaluation of acts, and Bennett's explicit defense of the objective approach. The book concludes by offering the author's preferred replacement for the objective approach, an Aristotelian-Thomist view of acts. Acts, Intentions, and Moral Evaluation will be of interest to scholars and advanced students working in ethics, just war theory, the ethics of self-defense, and philosophy of action. (shrink)

Taking a Blue Marble evaluation perspective means viewing the world holistically. It begins with watching for, making sense of, and interpreting the implications of things that are interconnected in the global system. Blue Marble thinkers see the interconnections between the global and local, the macro and the micro, and the relationships between worldwide patterns and area-specific challenges. Part 1 of this book presents and explains four overarching Blue Marble principles. Part 2 examines and elaborates the implications of the overarching principles (...) with 12 operating principles. The Blue Marble perspective is both an approach to evaluation and a way of thinking about all aspects of systems change initiatives and interventions, at all levels at which they occur from local to global. (shrink)

ABSTRACTEvaluative aesthetic discourse communicates that the speaker has had first-hand experience of what is talked about. If you call a book bewitching, it will be assumed that you have read the book. If you say that a building is beautiful, it will be assumed that you have had some visual experience with it. According to an influential view, this is because knowledge is a norm for assertion, and aesthetic knowledge requires first-hand experience. This paper criticizes this view and argues for (...) an alternative view, according to which aesthetic discourse expresses affective states of mind, analogously to how assertions express beliefs. It is because these affective states require first-hand experience that aesthetic discourse communicates that such acquaintance is at hand. The paper furthermore argues that the lack of an experience requirement for aesthetic belief ascriptions constitutes a problem for the kind of expressivist who claims that evaluative belief states are covert non-cognitive states. (shrink)

Research agendas and academic evaluation are inevitably linked. By means of economic incentives, promotion, research funding, and reputation academic evaluation is a powerful influence on the production of knowledge; moreover, it is often conceived as a universal instrument without consideration of the context in which it is applied. Evaluation systems are social constructions in dispute, being the current focus of international debates regarding criteria, indicators, and their associated methods. A universalist type of productivity indicators is gaining centrality in academic evaluation (...) with profound effects on the content of research that is conducted everywhere. Specifically, evaluation systems based on this type of indicators are sending negative signals to scientists willing to conduct research on contextualized agendas, particularly those negotiated with non scientists. On the basis of theoretical and empirical studies documented on the specialized literature and extensive personal engagement with university research policy in Uruguay, we argue that the consolidation of evaluation practices of alleged universal validity deteriorates and discourages a type of research which is undeniably important in developing contexts. (shrink)

Evaluators who are interested in developing or improving a program or policy frequently look to formative evaluation as a guiding framework.This book shows why those hoping to use evaluation to drive change in complex systems, rather than develop or improve one program, policy, or product, need to shift from the oversimplified idea of formative evaluation to a more specified continuous improvement model grounded in improvement science. In doing so, author Kristen L. Rohanna provides guidance to both evaluators and others, such (...) as K-12 educators or hospital administrators, who lead improvement initiatives in their organizations and seek to solve persistent problems of practice. The book includes an extended case study: a networked improvement community of five public middle and high schools. (shrink)

Criteria for the evaluation of most scholars’ work have recently received wider attention due to high-profile cases of scientific misconduct which are perceived to be linked to these criteria. However, in the competition for career advancement and funding opportunities almost all scholars are subjected to the same criteria. Therefore these evaluation criteria act as ‘switchmen’, determining the tracks along which scholarly work is pushed by the dynamic interplay of interests of both scholars and their institutions. Currently one of the most (...) important criteria is the impact of publications. In this research, the extent to which publish or perish, a long standing evaluation criterion, led to scientific misconduct is examined briefly. After this the strive for high impact publications will be examined, firstly by identifying the period in which this became an important evaluation criterion, secondly by looking at variables contributing to the impact of scholarly papers by means of a non-structured literature study, and lastly by combining these data into a quantitative analysis. (shrink)

According to an adequacy-for-purpose view, models should be assessed with respect to their adequacy or fitness for particular purposes. Such a view has been advocated by scientists and philosophers...

This paper presents an impact evaluation of the policies for teacher education programs within the framework of the National Development Plan 2014-2018. The programs were compelled to obtain high-quality accreditation, increase the credits in school practices, and the English level, among other requirements. Relying on multivariable regression, it shows that, for the year 2021, there is no association between high-quality accreditation in most modules of the Saber Pro tests, or it is negative in the global score and quantitative reasoning. In (...) a second step, using Differences–in–Differences, it evidences how the changes made by the programs had positive effects on the performance of students compared to other professional programs. The results show significant improvement in most modules of the Saber Pro test, except for the English module. The effects were homogeneous by characteristics of the students and institutions, but heterogeneous by area of knowledge, indicating that the effect is mainly due to the curricular changes of the programs. (shrink)

The descriptions 'good' and 'bad' are examples of thin concepts, as opposed to 'kind' or 'cruel' which are thick concepts. Simon Kirchin provides one of the first full-length studies of the crucial distinction between 'thin' and 'thick' concepts, which is fundamental to many debates in ethics, aesthetics and epistemology.

What does evaluation mean? This article examines the evaluative process as a practical judgment that links a situation to a set of values in order to decide upon a course of action. It starts by discussing A. Sen’s “relational” and “comparative” account of evaluation, built in critical dialogue with J. Rawls’ deductive theory. Comparison, incompleteness, reality, and deliberation are the key principles of Sen’s approach, which, in some respects, echoes that of J. Dewey. The second part shows the relevance of (...) completing Sen’s approach with Dewey’s pragmatism, since Dewey’s emphasis on practical judgment is a useful counterbalance to Sen’s focus on evaluation as a cognitive process. Dewey introduces a shift from values to valuation and draws a distinction between prizing and appraising, which makes the logic of inquiry and the search for consistency between means and ends in a given situation the fulcrum of evaluation. The third part of this paper addresses the relationship between values and norms in evaluative processes. Neither Sen nor Dewey deals with this question in a systematic way, although norms, which are both similar and different from values, contribute to frame evaluations in different ways: as horizons, resources, or constrains. Bringing norms into the picture means completing the pragmatist account with an institutionalist perspective, as we suggest through the example of the evaluation of work. (shrink)

Evaluation and its siblings audit, quality assurance, inspection, and other kinds of assessments have expanded in all public and private sectors. Scholars write about ‘the audit society’ (Power, 19...

Long neglected as a focus of linguistic research, evaluation in its various guises is now being recognized as a crucial aspect of any study of discourse. In this book, writers coming from different standpoints are brought together, providing a unique profile of the topic from several perspectives. These perspectives include: Systemic Linguistics, Narrative, Corpus Linguistics, and Discourse Analysis.

BackgroundEvaluation of decision-making capacity to consent to medical treatment has proved to be difficult in patients with dementia. Studies showed that physicians are often insufficiently trained in the evaluation of decision-making capacity. In this study, we present findings from a secondary analysis of a qualitative interviews with physicians. These interviews were initially used to assess usability of an instrument for the evaluation of decision-making capacity. By looking at difficult cases of decision-making capacity evaluation in patients with dementia, we provide recommendations (...) for such evaluations in clinical practice.MethodsWe used thematic coding to analyse physicians’ narratives of problematic decision-making capacity evaluations in patients with dementia to uncover challenging issues of decision-making capacity evaluation.ResultsIn this study, decision-making capacity evaluations in patients with dementia were mainly perceived as challenging when they pertained to treatment refusals and treatment unrelated circumstances, such as psychiatric consultation, advance directives, and new living arrangements. Furthermore, the physicians reported training needs regarding situation-independent challenges with decision-making capacity evaluation.ConclusionsUpon further examining self-reported training needs and challenging cases, we have developed recommendations to improve decision-making capacity evaluations in clinical practice. In these recommendations, we argue that being able to evaluate decision-making capacity is an integral part of the informed consent process. (shrink)

Evaluative judgements have both belief-like and desire-like features. While cognitivists think that they can easily explain the belief-like features, and have trouble explaining the desire-like features, non-cognitivists think the reverse. I argue that the belief-like features of evaluative judgement are quite complex, and that these complexities crucially affect the way in which an agent's values explain her actions, and hence the desire-like features. While one form of cognitivism can, it turns out that non-cognitivism cannot, accommodate all of these complexities. The (...) upshot is that that form of cognitivism can explain both features of evaluative judgements, and that non-cognitivism can explain neither. (shrink)

BackgroundMoral case deliberation as a form of clinical ethics support is usually implemented in health care institutions and educational programs. While there is no previous research on the use of clinical ethics support on the level of health care regulation, employees of regulatory bodies are regularly confronted with moral challenges. This pilot study describes and evaluates the use of MCD at the Dutch Health Care Inspectorate.The objective of this pilot study is to investigate: 1) the current way of dealing with (...) moral issues at the IGZ; 2) experience with and evaluation of MCD as clinical ethics support, and 3) future preferences and needs regarding clinical ethics support for dealing with moral questions at the IGZ.MethodsWe performed an explorative pilot study. The research questions were assessed by means of: 1) interviews with MCD participants during four focus groups; and 2) interviews with six key stakeholders at the IGZ. De qualitative data is illustrated by data from questionnaires on MCD outcomes, perspective taking and MCD evaluation.ResultsProfessionals do not always recognize moral issues. Employees report a need for regular and structured moral support in health care regulation. The MCD meetings are evaluated positively. The most important outcomes of MCD are feeling secure and learning from others. Additional support is needed to successfully implement MCD at the Inspectorate.ConclusionWe conclude that the respondents perceive moral case deliberation as a useful form of clinical ethics support for dealing with moral questions and issues in health care regulation. (shrink)

A great need for systematic evaluation of ethics training programs exists. Those tasked with developing an ethics training program may be quick to dismiss the value of training evaluation in continuous process improvement. In the present effort, we use a case study approach to delineate how to leverage formative and summative evaluation measures to create a high-quality ethics education program. With regard to formative evaluation, information bearing on trainee reactions, qualitative data from the comments of trainees, in addition to empirical (...) findings, can ensure that the training program operates smoothly. Regarding summative evaluation, measures examining trainee cognition, behavior, and organization-level results provide information about how much trainees have changed as a result of taking the ethics training. The implications of effective training program evaluation are discussed. (shrink)

The Evaluation of Critical Thinking Programs: Dangers and Dogmas.

Realising the societal gains from publicly funded health and medical research requires a model for a reflexive evaluation precedent for the societal impact of research. This research explores UK Research Excellence Framework evaluators’ values and opinions and assessing societal impact, prior to the assessment taking place. Specifically, we discuss the characteristics of two different impact assessment extremes – the “quality-focused” evaluation and “societal impact-focused” evaluation. We show the wide range of evaluator views about impact, and that these views could be (...) conceptually reflected in a range of different positions along a conceptual evaluation scale. We describe the characteristics of these extremes in detail, and discuss the different beliefs evaluators had which could influence where they positioned themselves along the scale. These decisions, we argue, when considered together, form a dominant definition of societal impact that influences the direction of its evaluation by the panel. (shrink)

Albert Hirschman's possibilism originated from his work on development and democracy; at the same time, it offered tools for evaluating projects that Judith Tendler innovatively utilized in her professional work, where she interweaved theory and practice, methodology and ethics. Starting from observation in the field, comparisons, linkages, inverted sequences and unexpected consequences are really key elements in a type of evaluation that works toward improvement, "for a better world." The enduring vitality of the thinking of these forerunners is what motivates (...) the reconstruction of their intellectual trajectories: from the way of learning from the successes and failures of programs, to how to deal with such themes as complexity, mechanisms, uncertainty, change, that are at the core of current debates. The book aims at showing both the relevance of practical work for the advancement of social theory, and the need for a theoretical attitude - based on a capacity of being surprised - for the strengthening of democratic professionalism and the attainment of sound results. It will constitute a basic reading for social scientists, decision-makers, policy implementers, evaluators and students. (shrink)

Charles Taylor is one of the leading living philosophers. In this book Arto Laitinen studies and develops further Taylor's philosophical views on human agency, personhood, selfhood and identity. He defends Taylor's view that our ethical understandings of values play a central role. The book also develops and defends Taylor's form of value realism as a view on the nature of ethical values, or values in general. The book criticizes Taylor's view that God, Nature or Human Reason are possible constitutive sources (...) of value – Laitinen argues that we should drop the whole notion of a constitutive source. (shrink)

Recent years have seen rapid progress in the development of ontologies as semantic models intended to capture and represent aspects of the real world. There is, however, great variation in the quality of ontologies. If ontologies are to become progressively better in the future, more rigorously developed, and more appropriately compared, then a systematic discipline of ontology evaluation must be created to ensure quality of content and methodology. Systematic methods for ontology evaluation will take into account representation of individual ontologies, (...) performance (in terms of accuracy, domain coverage and the efficiency and quality of automated reasoning using the ontologies) on tasks for which the ontology is designed and used, degree of alignment with other ontologies and their compatibility with automated reasoning. A sound and systematic approach to ontology evaluation is required to transform ontology engineering into a true scientific and engineering discipline. This chapter discusses issues and problems in ontology evaluation, describes some current strategies, and suggests some approaches that might be useful in the future. (shrink)