As AI technologies are increasingly deployed in work, welfare, healthcare, and other domains, there is a growing realization not only of their power but of their problems. AI has the capacity to reinforce historical injustice, to amplify labor precarity, and to cement forms of racial and gendered inequality. An alternate set of values, paradigms, and priorities are urgently needed. How might we design and evaluate AI from an indigenous perspective? This article draws upon the five Tests developed by Māori scholar (...) Sir Hirini Moko Mead. This framework, informed by Māori knowledge and concepts, provides a method for assessing contentious issues and developing a Māori position. This paper takes up these tests, considers how each test might be applied to data-driven systems, and provides a number of concrete examples. This intervention challenges the priorities that currently underpin contemporary AI technologies but also offers a rubric for designing and evaluating AI according to an indigenous knowledge system. (shrink)

This article provides a brief overview of the efforts to develop and refine the Critical thinking Assessment Test and its potential for improving the design of classroom assessments. The CAT instrument was designed to help faculty understand their students’ strengths and weaknesses using a short answer essay format. The instrument assesses a broad collection of critical thinking skills that transcend most disciplines. The questions were deliberately designed around real-world scenarios that did not require specialized knowledge from any particular discipline. Various (...) faculty who collaborated in the national dissemination of the CAT instrument found that it was a helpful model for designing better course assessments to grade student work. Classroom assessments modeled on the CAT emphasize more critical thinking within the discipline and less rote retention of factual information. We describe the ongoing work to help faculty successfully adapt the CAT to applications that can be used in each discipline’s courses to evaluate and encourage students’ critical thinking. (shrink)

Introduction: Globally, vitamin D deficiency is one of the most common deficiencies, affecting nearly half the world's population. The objective of this survey was to assess and compare the knowledge about vitamin D and the perceived state of health in Emirati and international tourist female students in Dubai, UAE. Methods: This is a cross-sectional study that took place in universities in Dubai, UAE. This survey consisted of 17 multiple choice questions. The first part of the survey assessed levels of supplementation, (...) diet and UV exposure. Another section evaluated the participants’ self-assessed state of health regarding vitamin D testing, symptoms related to vitamin D deficiency and general welbeing. The collected data were statistically analyzed using SPSS statistics for windows version 26.0 (SPSS Inc., Chicago, IL). Statistical significance was set at P<0.05. Results: 105 respondents were Emiratis and 65 were international students. The average age was 21, with an average BMI 23.3. Almost one-third of each group reported using Vitamin D supplements once weekly. The majority of both groups reported rarely getting tanned. Almost all participants reported regular consumption of Vitamin-D rich foods. In both groups, more than half reported consuming milk and cheese regularly and up to one-third reported consuming fish in a regular manner. Although more than half of the students rated their health as good; more than two-thirds reported experiencing muscle pain; only half reported having their blood Vitamin D levels measured once; half reported experiencing problems with concentration and more than three-quarters reported experiencing bad mood in the past month. The prevalence of these symptoms was almost similar across different categories of vitamin D supplementation, tanning habits, dietary intake, or nationality. No statistically significant differences were noted between the 2 groups. Conclusion: more Emirati students were aware of the association between vitamin D and osteoporosis than International tourist students (40% vs. 21.9%, respectively; p<0.05). On the other hand, both groups had lower knowledge about the relationship between vitamin D deficiency and depression, Rheumatoid Arthritis and Hypertension, and the optimal vitamin D level; however, no statistically significant differences were noted regarding this knowledge of Emiratis and international students. (shrink)

This research aimed at investigating the assessment procedures for evaluating the prospective teachers' abilities, developed through the new B.Ed. /ADE curriculum in teacher education institutions of Baluchistan, this research study will also highlights the emerging problems in the use of new modern assessment procedures. The research was conducted in seven Teacher Training institutions of Baluchistan. The data was collected through the survey questionnaire, based on a pilot project, from the seven Heads of the institutions and the nine Teacher Educators/school, involved (...) in teaching different courses of B.Ed. /ADE at different semesters. Focus group discussion with head and nine teacher educators/institution was also conducted. The quantitative and qualitative data from two instruments helped in-depth understanding of the assessment procedure and the emerging problems. The results showed that teacher educators are trying to implement the new competency-based curriculum and are engaged in using interactive and innovative teaching pedagogies suggested in the new curriculum of B.Ed. / ADE program. But they feel difficulty to assess the content knowledge and skills developed among the prospective teachers through this new curriculum. Teacher educators feel difficulty in the use of modern assessment procedures. They are still focusing the paper-pencil test. Teachers lack competencies to assess students’ actual strengths and learning needs, they don’t, know how to measure cognitive, affective and psychomotor objectives. Teacher educators also face problems to make judgments on students’ learning through formative assessment. (shrink)

Several versions of the dot probe detection task are frequently used to assess maladaptive attentional processes associated with a broad range of psychopathology and health behavior, including eating behavior and weight. However, there are serious concerns about the reliability of the indices derived from the paradigm as measurement of attentional bias toward or away from salient stimuli. The present paper gives an overview of different attentional bias indices used in psychopathology research and scrutinizes three types of indices calculated from a (...) pictorial version of the dot probe task to assess food-related attentional biases in children and youngsters with and without obesity. Correlational analyses reveal that dynamic scores are dependent on general response speed. Reliability estimates are low for the traditional and probability indices. The higher reliability for the dynamic indices is at least partially explained by general response speed. No significant group differences between youth with and without obesity are found, and correlations with weight are also non-significant. Taken together, results cast doubt on the applicability of this specific task for both experimental and individual differences research on food-related attentional biases in youth. However, researchers are encouraged to make and test adaptations to the procedure or computational algorithm in an effort to increase psychometric quality of the task and to report psychometric characteristics of their version of the task for their specific sample. (shrink)

With a growing number of genetic tests becoming available to the health and consumer markets, genetic health care providers in Canada are faced with the challenge of developing robust decision rules or guidelines to allocate a finite number of public resources. The objective of this study was to gain Canadian genetic health providers' perspectives on factors and criteria that influence and shape resource allocation decisions for publically funded predictive genetic testing in Canada. The authors conducted semi-structured interviews with 16 (...) senior lab directors and clinicians at publically funded Canadian predictive genetic testing facilities. Participants were drawn from British Columbia, Alberta, Manitoba, Ontario, Quebec and Nova Scotia. Given the community sampled was identified as being relatively small and challenging to access, purposive sampling coupled with snowball sampling methodologies were utilized. Surveyed lab directors and clinicians indicated that predictive genetic tests were funded provincially by one of two predominant funding models, but they themselves played a significant role in how these funds were allocated for specific tests and services. They also rated and identified several factors that influenced allocation decisions and patients' decisions regarding testing. Lastly, participants provided recommendations regarding changes to existing allocation models and showed support for a national evaluation process for predictive testing. Our findings suggest that largely local and relatively ad hoc decision making processes are being made in relation to resource allocations for predictive genetic tests and that a more coordinated and, potentially, national approach to allocation decisions in this context may be appropriate. (shrink)

Societal pressures, accreditation organizations, and licensing agencies are emphasizing the importance of ethics in the engineering curriculum. Traditionally, this subject has been taught using dogma, heuristics, and case study approaches. Most recently a number of organizations have sought to increase the utility of these approaches by utilizing the Internet. Resources from these organizations include on-line courses and tests, videos, and DVDs. While these individual approaches provide a foundation on which to base engineering ethics, they may be limited in developing a (...) student’s ability to identify, analyze, and respond to engineering ethics situations outside of the classroom environment. More effective approaches utilize a combination of these types of approaches. This paper describes the design and development of an internet based interactive Simulator for Engineering Ethics Education. The simulator places students in first person perspective scenarios involving different types of ethical situations. Students must gather data, assess the situation, and make decisions. This requires students to develop their own ability to identify and respond to ethical engineering situations. A limited comparison between the internet based interactive simulator and conventional internet web based instruction indicates a statistically significant improvement of 32% in instructional effectiveness. The simulator is currently being used at the University of Houston to help fulfill ABET requirements. (shrink)

This book presents a number of fundamentally challenging perspectives that have been brought to the fore by the national tests on religious education (RE) in Sweden. It particularly focuses on the content under the heading Ethics. It is common knowledge that many teachers find these parts difficult to handle within RE. Further, ethics is a field that addresses a range of moral and existential issues that are not easily treated. Many of these issues may be said to belong to the (...) philosophical context, in which "eternal questions" are gathered and reflected upon. The first chapters highlight the concepts of ethical competence and critical thinking. In the following chapters the concept of ethical competence is analyzed with regard to teachers' objectives and to students' texts, respectively. These chapters pursue a more practice-related approach and highlight specific challenges identified from both teacher and student perspectives. Next, the book raises the issue of global responsibility. What kind of critical issues arise when handling such matters at school? Further, can contemporary moral philosophers contribute to such a discussion? In turn, the book discusses the role of statistical analyses with regard to national tests, while the closing chapters present international perspectives on the book's main themes and concluding remarks. The book's critical yet constructive approach to issues regarding assessment in ethics education makes a valuable contribution to an ongoing debate among researchers as well as to the everyday communication on testing in schools and classrooms. As such, it will appeal to scholars in ethics education and researchers in the field of assessment, as well as educators and teachers interested and engaged in the task of testing ethics in school contexts where curricular demands for valid and authoritative evaluation may provide important guidelines, but may also pose challenges of their own. (shrink)

As the field of clinical bioethics has moved from its pioneers, who turned their attention to ethics problems in clinical medicine and clinical and animal research, to today’s ubiquity of university degrees and fellowships in bioethics, there has been a steady drumbeat to professionalize the field. The problem has been that the necessary next steps—to specify the skills, knowledge, and personal and professional attributes of a clinical bioethicist, and to have a method to train and evaluate mastery of these standards—are (...) lacking.Ordinarily, the path to professionalism in medicine starts with the intellectual pioneers. Then come those who develop early experience in clinical settings. Then comes the specification of the skills, knowledge, and personal and professional attributes needed to perform the activities of the new specialty or subspecialty. And only then, after a method to train and evaluate levels of mastery from novice to advanced practitioner has been developed, comes credible credentialing and certification/licensing.Unfortunately, the field of clinical bioethics has skipped these steps. Rather, a credential, that is, the Healthcare Ethics Consultant (HEC) certification, was created by a small group within the bioethics professional association, the American Society of Bioethics and Humanities (ASBH), without community agreement or necessary input. Further, the testing of processes to train HECs and to evaluate their levels of mastery of competencies was prematurely forwarded as sufficient evidence of competence in clinical ethics. That is, the credential, offered by the ASBH for a fee, upon passing an exam based on how many hours one has been involved in clinical consultation, about which there is no field agreement on how such consultations ought to be conducted and for which only controversial standards have been set, is being touted as evidence of competence in clinical bioethics. In their article, “Competencies and Milestones for Bioethics Trainees,” Sawyer and colleagues identify the central weakness of these claims to professionalization and provide the field the first substantive assessment tool and method to train and evaluate competencies. The tool these authors present is the real next step forward for true professionalization of the field of clinical bioethics. (shrink)

This book is open access, which means that you have free and unlimited access. This book analyses and discusses the recent developments for assessing research quality in the humanities and related fields in the social sciences. Research assessments in the humanities are highly controversial and the evaluation of humanities research is delicate. While citation-based research performance indicators are widely used in the natural and life sciences, quantitative measures for research performance meet strong opposition in the humanities. This volume combines the (...) presentation of state-of-the-art projects on research assessments in the humanities by humanities scholars themselves with a description of the evaluation of humanities research in practice presented by research funders. Bibliometric issues concerning humanities research complete the exhaustive analysis of humanities research assessment. The selection of authors is well-balanced between humanities scholars, research funders, and researchers on higher education. Hence, the edited volume succeeds in painting a comprehensive picture of research evaluation in the humanities. This book is valuable to university and science policy makers, university administrators, research evaluators, bibliometricians as well as humanities scholars who seek expert knowledge in research evaluation in the humanities. (shrink)

Audiologic assessment of infants and young children with suspected hearing loss requires selection of differential diagnostic techniques that are age-appropriate and appropriate to the child’s developmental capabilities. Objective assessment includes electrophysiologic and electroacoustic methods: otoacoustic emissions, auditory brainstem response, auditory steady-state response, tympanometry and acoustic reflex. The use of behavioural methods in audiologic assessment requires a response from the patient. Depending on the child’s age, the following methods can be performed: visual reinforcement audiometry, conditioned play audiometry, pure tone audiometry, and (...) speech audiometry. Audiologic assessment in infants and children provides estimation of auditory sensitivity, evaluation of the integrity of auditory system andidentification of possible intervention options in case of existing hearing loss. Early detection and treatment of hearing loss in childhood is essential to ensure optimal speech and language development in the early years of life and optimal school performance for older children. (shrink)

A script concordance test was developed as an innovative tool for assessing ethical reasoning ability. An SCT of 12 medical ethical vignettes were constructed from the UNESCO Casebook on Human Dignity and Human Rights. The vignettes were reviewed by a panel of 15 medical experts before administration to a panel of 18 clinicians. The clinician’s answers were used to constitute the scoring key. The SCT was then administered to first and final year medical students. Data were analysed using SPSS. Internal (...) consistency was assessed using Cronbach’s alpha. SCT performance was tested for association with sex, year of study and race by comparing the mean SCT scores between categories within each variable. Internal consistency as measured by Cronbach’s alpha values, ranging from 0.597 to 0.902, indicated high intra-vignette reliability for 10 of the vignettes. Inter-vignette reliability was high at 0.797. Mean SCT scores were not significantly different between students of different gender, year of study and ethnicity. However, each vignette was able to distinguish between overall poor and good test performers. The SCT was able to differentiate between students with varying degrees of ethical reasoning ability. (shrink)

The assessment of the fear of being laughed at in Poland: Translation and first evaluation of the Polish GELOPH The main aim of the paper was to translate and, for the first time, evaluate the Polish GELOPH. This is a 15-item questionnaire for the subjective assessment of gelotophobia, the fear of being laughed at. Gelotophobia is seen as an individual differences phenomenon at a sub-clinical level. The psychometric properties of the Polish version were tested in two independently collected samples with (...) a total N of 506 participants. The Polish GELOPH yielded good psychometric properties in terms of high reliability in both samples. The fear of being laughed at existed widely independently from the participants' age, sex, or marital status. The Polish GELOPH can be seen as a reliable instrument for the subjective assessment of gelotophobia for research and practical applications. (shrink)

Cognitive test batteries are widely used in diverse research fields, such as cognitive training, cognitive disorder assessment, or brain mechanism understanding. Although they need flexibility according to their usage objectives, most test batteries are not available as open-source software and are not be tuned by researchers in detail. The present study introduces an open-source cognitive test battery to assess attention and memory, using a javascript library, p5.js. Because of the ubiquitous nature of dynamic attention in our daily lives, it is (...) crucial to have tools for its assessment or training. For that purpose, our test battery includes seven cognitive tasks, common in cognitive science literature. By using the test battery, we conducted an online experiment to collect the benchmark data. Results conducted on 2 separate days showed the high cross-day reliability. Specifically, the task performance did not largely change with the different days. Besides, our test battery captures diverse individual differences and can evaluate them based on the cognitive factors extracted from latent factor analysis. Since we share our source code as open-source software, users can expand and manipulate experimental conditions flexibly. Our test battery is also flexible in terms of the experimental environment, i.e., it is possible to experiment either online or in a laboratory environment. (shrink)

Identification of propositions as the core of attitudes and beliefs (De Houwer, 2014) has resulted in the development of implicit measures targeting personal evaluations of complex sentences (e.g., the IRAP or the RRT). Whereas their utility is uncontested, these paradigms are subject to limitations inherent in their block based design, such as allowing assessment of only a single belief at a time. We introduce the Propositional Evaluation Paradigm (PEP) for assessment of multiple propositional beliefs within a single experimental block. Two (...) experiments provide first evidence for the PEP’s validity. In Experiment 1 endorsement of racist beliefs measured with the PEP was related to criterion variables such as explicit racism assessed via questionnaire and indicators of behavioral tendencies. Experiment 2 indicates that the PEP’s implicit racism scores may predict actual behavior over and above explicit, self-report measures. Finally, Experiment 3 tested the PEP's applicability in the domain of hiring discrimination. Whereas general PEP based gender stereotypes were not related to hiring bias, results suggest a possible role of female stereotypes in hiring discrimination. In the context of these findings, we discuss both the potential and possible challenges in adopting the PEP to different beliefs. In sum, these initial findings suggest that the PEP may offer researchers a reliable and easily administrable option for the indirect assessment of propositional evaluations. (shrink)

The decision to trust encompasses evaluation of multiple information cues that are used by evaluators to make inference about the trustee’s qualities and capabilities. The information about the social status of the trustee firm is one of such cues available to evaluators. Yet the relationship between perceived social status of the trustee and the evaluator’s trust remains underexplored. In two experimental studies, we find a non-linear relationship between a firm’s status and the evaluator’s trust, and test theorized mechanisms that can (...) explain this relationship. The paper reveals that firms having low, middle, and high status are not only trusted differently, but are trusted for different reasons: qualities, such as perceived benevolence and integrity, mediate higher trust for middle-status firms, while trust for high-status firms is mediated by ability and integrity. The findings thus suggest that in the assessment of an organization’s trustworthiness, the relative importance of a particular virtue, such as ability, benevolence, or integrity, varies depending on the status position of that organization. (shrink)

The suggestion that individuals should be considered disadvantaged, and consequently entitled to compensation, only if they consider themselves disadvantaged (Dworkin’s ‘continuity test’) is initially appealing. However, it also faces problems. First, if individuals are routinely mistaken, then we routinely fail to assist the deserving. Second, if individuals assess their circumstances differently then the state will provide different levels of assistance to people in identical situations. Thus, should we instead ignore individuals’ convictions and provide assistance that some, at least, do not (...) feel they need? One set of cases where this dilemma is salient are those in which disabled individuals disagree over whether they are disadvantaged. Focussing on these, I argue that despite objections, individuals should have a voice in determining whether they are disadvantaged. However, I contend that our goal should not be ensuring continuity with individuals’ ethical convictions (concerning the pursuits they deem worthwhile or valuable), but their convictions regarding whether they are relevantly disadvantaged (whether they have what they are entitled to). (shrink)

The expanded use of genetic testing raises key ethical and policy questions about possible benefits and harms for those receiving disease‐risk information. As predictive testing for Huntington’s was initiated in a clinical setting, survey research posing hypothetical test scenarios suggested that the vast majority of at‐risk relatives wanted to know whether they carried a disease‐causing mutation. However, only a small minority ultimately availed themselves of this opportunity. Many at‐risk individuals concluded that a positive test result would be too (...) psychologically overwhelming. A substantial literature suggests that individuals are often more resilient than anticipated in coping with many different health‐related stresses. Much of my own work in the field has been through the Risk Evaluation & Education for Alzheimer’s Disease study (REVEAL), a series of randomized clinical trials assessing the impact of genetic susceptibility testing on asymptomatic individuals at risk for Alzheimer’s disease. Our experience in developing and implementing four successive, multisite trials provides some potentially useful lessons for the field. More people will be asking for their personal genetic information. Better understanding will help us decide when access is appropriate and how best to disclose results in a manner that supports adjustment to test findings and promotes use of genetic information to improve human health. (shrink)

This paper reflects on quality assessment and performance evaluation in higher education, namely by analysing the insufficient link between those two aspects. We start by reviewing the current state of the art regarding different processes and mechanisms of quality assessment and performance evaluation and discuss some of the major issues regarding the implementation of some of them. In particular, we analyse the current limitations regarding data collected, available and publicised on the performance of HEIs and the problems those limitations bring (...) to a fair evaluation of higher education. Through this analysis we intend to contribute to a better understanding of the mechanisms of evaluation in higher education and the way these may lead to the promotion of better quality assessment practices and institutional management. (shrink)

Since the 6thCentury B.C., Philosophy was defined as the love of wisdom in Ancient Greece. And it has always discussed of truth, wisdom and the metaphysics of existence. Nowadays, courses on philosophy have been an integral part of the curriculum since the establishment of faculties of Theology (FoTs). However, the presence, significance and objective of those courses are, they unfortunately are still under discussion despite their almost seventy-year old history.Based on this problem, our study aims to determine whether FoTs students’ (...) attitudes towards philosophy courses differ from their beliefs in the relationship between religion and philosophy. This study`s sample group consists of FoTs students of Kastamonu University, Kyrgyz-Turkish Manas University and Osh University. The study`s sample consisted of 276 students from these universities. The data were collected using a “Philosophy Attitude Scale” (PAS) and a “Scale ofBeliefs in Philosophy–Religion Relationship” (SBPRR) which was developed for this study. T test, one-way analysis of variance and Pearson Correlation were used for the data analysis. Participants’ arithmetic mean scores on some PAS and SBPRRsubscales differed by gender, college, grade level, mother’s education level, number of philosophy courses taken at college but not by father’s education level and religious education and philosophy education before college. Many factors affect the negative attitude of the students toward the philosophical courses and issues; like the methods of teaching it and the contents of the courses and etc. For altering this negative conception towards philosophy, we should focus on two main things; teaching the future-parents and those potentially future teachers philosophy in a right manner. (shrink)

Automated neuropsychiatric batteries have been used in research and clinical practice, including for chronic diseases, such as Systemic Lupus Erythematosus. The Pediatric Automated Neuropsychological Assessment Metrics battery, originally developed for use in American-English speaking individuals, allows tracking of cognitive functions. It can be applied to people over 9 years old. The aim of this study was to translate and present initial validation data from the Ped-ANAM into Brazilian-Portuguese. We translated the battery according to Beaton’s guidelines. Psychometric properties were tested, internal (...) consistency was analyzed by Cronbach’s alpha coefficient, test-retest reliability by the intraclass correlation coefficient. Further, we measured the test execution speed at both times as a temporal stability. Principal component analysis was used for structural validity. Evidence of construct validity was assessed through assessment of the relationships with the Wechsler Intelligence Scales. All participants prior to the start of study related activities signed an informed consent form approved by the local ethics committee. A sample of 230 individuals [mean of age: 23 years; 65% females] was included; a subset of 51 individuals [mean of age: 18 years, 59% female] completed the Ped-ANAM twice to assess test-retest reliability, and another subset of 54 individuals [mean of age: 20.4 years; 67% female] completed the Wechsler Intelligence Scales for Children and Adult for assessment of the Ped-ANAM’s construct validity. Our results suggest that the internal consistency of the Ped-ANAM and its subtest test-retest reliability were excellent. There was no clustering in the Principal Components Analysis, suggestive of non-grouping of the evaluated variables. Construct validity assessment to the Wechsler Scales showed expected ranges of low to strong correlations. We concluded that, based on the results of this study, a cross-culturally validated Brazilian-Portuguese version of the Ped-ANAM has been developed and it is a reliable tool for the screening cognitive function. (shrink)

Millions of Chinese children learn English at increasingly younger ages. Yet when it comes to measuring proficiency, educators, and researchers rely on assessments that have been developed for L1 learners and/or for different cultural contexts, or on non-validated, individually designed tests. We developed the Assessment of Chinese Children’s English Vocabulary test to address the need for a validated, culturally appropriate receptive vocabulary test, designed specifically for young Chinese learners. The items are drawn from current teaching materials used in China, and (...) the depictions of people and objects are culturally appropriate. We evaluated the instrument’s reliability and validity in two field tests with a combined sample size of 1,092 children analyses show that the ACCE-V is sufficiently sensitive to capture different proficiency levels and that it has good psychometric properties. ACCE-V scores were correlated with Peabody Picture Vocabulary Test scores, indicating concurrent validity. We found that children’s age and English learning experience can significantly predict the scores of ACCE-V, but the effect of English learning experience is greater. The ACCE-V thus offers an alternative to existing vocabulary tests. We argue that culturally appropriate assessments like the ACCE-V are fairer to learners and help promote an English learning and teaching environment that is less dominated by Western cultures and native speaker norms. (shrink)

How can we determine the adequacy of a probabilistic coherence measure? A widely accepted approach to this question besides formulating adequacy constraints is to employ paradigmatic test cases consisting of a scenario providing a joint probability distribution over some specified set of propositions coupled with a normative coherence assessment for this set. However, despite the popularity of the test case approach, a systematic evaluation of the proposed test cases is still missing. This paper’s aim is to change this. Using a (...) custom written computer program for the necessary probabilistic calculations a large number of coherence measures in an extensive collection of test cases is examined. The result is a detailed overview of the test case performance of any probabilistic coherence measures proposed so far. It turns out that none of the popular coherence measures such as Shogenji’s, Glass’ and Olsson’s, Fitelson’s or Douven and Meijs’ but two rather unnoticed measures perform best. This, however, does not mean that the other measures can be rejected straightforwardly. Instead, the results presented here are to be understood as a contribution among others to the project of finding adequate probabilistic coherence measures. (shrink)

The increasing digitalization in the field of psychological and educational testing opens up new opportunities to innovate assessments in many respects (e.g., new item formats, flexible test assembly, efficient data handling). In particular, computerized adaptive testing provides the opportunity to make tests more individualized and more efficient. The newly developed continuous calibration strategy (CCS) from Fink, Born, Spoden, and Frey (2018) makes it possible to construct computerized adaptive tests in application areas where separate calibration studies are not feasible. (...) Due to the goal of reporting on a common metric across test cycles, the equating is crucial for the CCS. The quality of the equating depends on the common items selected and the scale transformation method applied. Given the novelty of the CCS, the aim of the study was to evaluate different equating setups in the CCS and to derive practical recommendations. The impact of different equating setups on the precision of item parameter estimates and on the quality of the equating was examined in a Monte Carlo simulation, based on a fully crossed design with the factors common item difficulty distribution (bimodal, normal, uniform), scale transformation method (mean/mean, mean/sigma, Haebara, Stocking-Lord), and sample size per test cycle (50, 100, 300). The quality of the equating was operationalized by three criteria (proportion of feasible equatings, proportion of drifted items, and error of transformation constants). The precision of the item parameter estimates increased with increasing sample size per test cycle, but no substantial difference was found with respect to the common item difficulty distribution and the scale transformation method. With regard to the feasibility of the equatings, no differences were found for the different scale transformation methods. However, when using the moment methods (mean/mean, mean/sigma), quite extrem levels of error for the transformation constants A and B occurred. Among the characteristic curve method the performance of the Stocking-Lord method was slightly better than for the Haebara method. Thus, while no clear recommendation can be made with regard to the common item difficulty distribution, the characteristic curve methods turned out to be the most favorable scale transformation methods within the CCS. (shrink)

This paper presents an experience in developing professional ethics by an approach that integrates knowledge, teaching methodologies and assessment coherently. It has been implemented for students in both the Software Engineering and Computer Engineering degree programs of the Technical University of Madrid, in which professional ethics is studied as a part of a required course. Our contribution of this paper is a model for formative assessment that clarifies the learning goals, enhances the results, simplifies the scoring and can be replicated (...) in other contexts. A quasi-experimental study that involves many of the students of the required course has been developed. To test the effectiveness of the teaching process, the analysis of ethical dilemmas and the use of deontological codes have been integrated, and a scoring rubric has been designed. Currently, this model is also being used to develop skills related to social responsibility and sustainability for undergraduate and postgraduate students of diverse academic context. (shrink)

Earlier in the pages of this journal (p 481), Wendler and Miller offered the "net risks test" as an alternative approach to the ethical analysis of benefits and harms in research. They have been vocal critics of the dominant view of benefit-harm analysis in research ethics, which encompasses core concepts of duty of care, clinical equipoise and component analysis. They had been challenged to come up with a viable alternative to component analysis which meets five criteria. The alternative must (1) (...) protect research subjects; (2) allow clinical research to proceed; (3) explain how physicians may offer trial enrolment to their patients; (4) address the challenges posed by research containing a mixture of interventions and (5) define ethical standards according to which the risks and potential benefits of research may be consistently evaluated. This response argues that the net risks test meets none of these criteria and concludes that it is not a viable alternative to component analysis. (shrink)

Proprioception is a crucial sensory modality involved in the control and regulation of coordinated movements and in motor learning. However, the extent to which proprioceptive acuity is influenced by local muscle fatigue is obscured by methodological differences in proprioceptive and fatiguing protocols. In this study, we used high resolution kinematic measurements provided by a robotic device, as well as both frequency and time domain analysis of signals captured via surface electromyography (sEMG) to examine the effects of local muscle fatigue on (...) wrist proprioceptive acuity in 16 physically and neurologically healthy young adults. To this end, participants performed a flexion/extension ipsilateral joint position matching test (JPM), after which a high-resistive robotic task was used to induce muscle fatigue of the flexor carpi radialis (FCR) muscle. The JPM test was then repeated in order to analyze potential changes in proprioceptive acuity. Results indicated that the fatigue protocol had a significant effect on movements performed in flexion direction, with participants exhibiting a tendency to undershoot the target before the fatigue protocol (-1.218°), but overshooting after the fatigue protocol (0.587°). In contrast, in the extension direction error bias values were similar before and after the fatigue protocol as expected (pre = -1.852°, post = -1.237°) and reflected a tendency to undershoot the target. Moreover, statistical analysis indicated that movement variability was not influenced by the fatigue protocol or movement direction. In sum, results of the present study demonstrate that an individual’s estimation of wrist joint displacement (i.e., error bias), but not precision (i.e., variability), is affected by muscular fatigue in a sample of neurologically and physically healthy adults. (shrink)

BackgroundMental stress and imbalance of its two neural stress systems, the autonomic nervous system and the hypothalamic–pituitary–adrenal axis, are associated with chronic prostatitis/chronic pelvic pain syndrome and erectile dysfunction. However, the comprehensive analyses of psychological stress and stress systems are under-investigated, particularly in CP/CPPS patients complicated by lower urinary tract symptoms and ED.Materials and methodsParticipants were 95 patients in CP/CPPS+ED group, 290 patients in CP/CPPS group, 124 patients in ED group and 52 healthy men in control group. The National Institutes (...) of Health Chronic Prostatitis Symptom Index, the International Index of Erectile Function-5 and the International Prostate Symptom Score were used for assessing the disease severity of CP/CPPS, LUTS and ED. Psychometric self-report questionnaires including the Beck Anxiety Inventory, Perceived Stress Scale, Type A Personality Test and Symptom Checklist 90 were completed for distress from physical symptoms. Twenty-five subjects per group were randomly selected for further investigating the changes of the HPA axis and ANS. Saliva samples were taken on 3 consecutive days at 8 specific times with strict reference to time of morning awakening for evaluation of free cortisol. Heart rate variability as marker of the ANS was measured using 24 h electrocardiography, and time-and frequency-domain variables were analyzed.ResultsThe BAI and SCL-90 scores were significantly higher in the CP/CPPS+ED, CP/CPPS and ED groups compared with the control group. The PSS scores of both groups with ED were significantly higher than the control group. Compared with the CP/CPPS group, the differences of PSS, SCL-90 and TAPT scores were statistically significant in CP/CPPS+ED patients. The IPSS scores were shown to have significantly positive correlations with BAI, PSS and SCL-90 in the CP/CPPS patients. However, in all subjects, the IIEF-5 scores were shown to have significantly negative correlations with BAI, PSS, SCL-90 and quality of life score in NIH-CPSI. Cortisol awakening response parameters and diurnal cortisol levels did not significantly vary between the four groups. Time-dependent parameters of HRV also did not differ significantly across groups. In the frequency domain analysis, low frequency was significantly lower in ED patients when compared with CP/CPPS+ED patients and healthy controls, high frequency power was significantly higher in healthy controls compared to patients with ED, CP/CPPS and CP/CPPS+ED, and the CP/CPPS+ED group had significantly higher LF/HF ratio than the control group.ConclusionCP/CPPS and ED patients score exceedingly high on most psychosocial variables. The symptom scores of LUTS and ED positively correlate with the severity of psychological stress. Our findings also suggest that the ANS sympathovagal imbalance is associated with ED and LUTS in CP/CPPS, whereas HPA axis activity is not. (shrink)

This article addresses somemethodological questions that are at stake inassessing the influence of the ideas of John Dewey onthe renewal of European education in the twentiethcentury, using examples from the history of Dutcheducation. It is argued that in this kind of researchthe focus should not be on the process of influence assuch, but rather on the activity of reception. This,in turn, requires a contextual reconstruction of theinteraction between Deweyan ideas and practices andexisting ones. The case studies presented in thisarticle exemplify (...) the more general methodologicalobservations. They not only provide an insight in therole of Deweyan ideas and practices in the developmentof Dutch education but also make clear for whatreasons, mostly unrelated to the significance ofDewey's work, these ideas and practices did not haveany lasting influence on the development of Dutcheducation, both on the level of early childhoodeducation and primary and secondary schools. (shrink)

Leg rigidity is associated with frequent falls in people with Parkinson’s disease, suggesting a potential role in functional balance and gait impairments. Changes in the neural state due to secondary tasks, e.g., activation maneuvers, can exacerbate rigidity, possibly increasing the risk of falls. However, the subjective interpretation and coarse classification of the standard clinical rigidity scale has prohibited the systematic, objective assessment of resting and activated leg rigidity. The pendulum test is an objective diagnostic method that we hypothesized would be (...) sensitive enough to characterize resting and activated leg rigidity. We recorded kinematic data and electromyographic signals from rectus femoris and biceps femoris during the pendulum test in 15 individuals with PD, spanning a range of leg rigidity severity. From the recorded data of leg swing kinematics, we measured biomechanical outcomes including first swing excursion, first extension peak, number and duration of the oscillations, resting angle, relaxation index, maximum and minimum angular velocity. We examined associations between biomechanical outcomes and clinical leg rigidity score. We evaluated the effect of increasing rigidity through activation maneuvers on biomechanical outcomes. Finally, we assessed whether either biomechanical outcomes or changes in outcomes with activation were associated with a fall history. Our results suggest that the biomechanical assessment of the pendulum test can objectively quantify parkinsonian leg rigidity. We found that the presence of high rigidity during clinical exam significantly impacted biomechanical outcomes, i.e., first extension peak, number of oscillations, relaxation index, and maximum angular velocity. No differences in the effect of activation maneuvers between groups with clinically assessed low rigidity were observed, suggesting that activated rigidity may be independent of resting rigidity and should be scored as independent variables. Moreover, we found that fall history was more common among people whose rigidity was increased with a secondary task, as measured by biomechanical outcomes. We conclude that different mechanisms contributing to resting and activated rigidity may play an important yet unexplored functional role in balance impairments. The pendulum test may contribute to a better understanding of fundamental mechanisms underlying motor symptoms in PD, evaluating the efficacy of treatments, and predicting the risk of falls. (shrink)

Background and aims: Recent investigations have highlighted the value of neuropsychological testing for the assessment and screening of Alcohol-Related Brain Damage. The aim of the present study was to evaluate the suitability of the Addenbrooke’s Cognitive Examination and the Repeatable Battery for the Assessment of Neuropsychological Status for this purpose. Methods: Comparing 28 participants with ARBD and 30 alcohol-dependent participants without ARBD we calculated Area Under the Curve statistics, sensitivity and specificity values, base-rate adjusted predictive values, and likelihood ratios (...) for both tests. Results: High levels of screening accuracy were found for the total scores of both the ACE-III and RBANS at multiple cut-off points. Removing participants with a history of polysubstance from the samples improved the diagnostic capabilities of the RBANS substantially, while only minor improvements to the ACE-III’s accuracy were observed. Conclusions: Overall, both the ACE-III and RBANS are suitable tools for ARBD screening within an alcohol-dependent population, though the RBANS is the superior of the two. Clinicians using these tools for ARBD screening should be cautious of false-positive outcomes and should therefore combine them with other assessment methods and more detailed neuropsychological testing before reaching diagnostic decisions. (shrink)

PurposeThe purpose of this research paper is to examine the early stages of a research project aimed at evaluating the pedagogic effectiveness of a teaching module in computing ethics.Design/methodology/approachScores of students' cognitive capabilities to make moral judgements were measured before and after they had taken the module by means of the “Defining Issues Test”. This is a standard test of students' capability to make moral judgement based on the work of Lawrence Kohlberg. Interviews were then used to help understand the (...) results of the test.FindingsResults revealed low mean scores of post‐conventional thinking skills and wide variation in overall scores of capability for moral judgement. Interviews with the students about the course and the test revealed the importance of understanding students' beliefs about the importance of ethics in interpreting the results.Research limitations/implicationsDifficulties in matching “before and after” results for each subject limited the sample size in what was an early step in the overall research project.Practical implicationsThe results point towards the importance of addressing students' own understanding of the importance of ethics when teaching computing ethics.Originality/valueThe paper reveals some of the limitations of tests of capabilities for moral judgement which rely on strongly individualistic notions of ethics. It enables a new appreciation to be made of the strengths and weaknesses of assessing student moral development in higher education in terms of cognitive factors. (shrink)

Background: The formulation and implementation of national ethical regulations to protect research participants is fundamental to ethical conduct of research. Ethics education and capacity are inadequate in developing African countries. This study was designed to develop a module for online training in research ethics based on the Nigerian National Code of Health Research Ethics and assess its ease of use and reliability among biomedical researchers in Nigeria.MethodologyThis was a three-phased evaluation study. Phase one involved development of an online training module (...) based on the Nigerian Code of Health Research Ethics (NCHRE) and uploading it to the Collaborative Institutional Training Initiative (CITI) website while the second phase entailed the evaluation of the module for comprehensibility, readability and ease of use by 45 Nigerian biomedical researchers. The third phase involved modification and re-evaluation of the module by 30 Nigerian biomedical researchers and determination of test-retest reliability of the module using Cronbach’s alpha. Results: The online module was easily accessible and comprehensible to 95% of study participants. There were significant differences in the pretest and posttest scores of study participants during the evaluation of the online module (p = 0.001) with correlation coefficients of 0.9 and 0.8 for the pretest and posttest scores respectively. The module also demonstrated excellent test-retest reliability and internal consistency as shown by Cronbach’s alpha coefficients of 0.92 and 0.84 for the pretest and posttest respectively. Conclusion: The module based on the Nigerian Code was developed, tested and made available online as a valuable tool for training in cultural and societal relevant ethical principles to orient national and international biomedical researchers working in Nigeria. It would complement other general research ethics and Good Clinical Practice modules. Participants suggested that awareness of the online module should be increased through seminars, advertisement on government websites and portals used by Nigerian biomedical researchers, and incorporation of the Code into the undergraduate medical training curriculum. (shrink)

Universities introduce intermediate assessment because it is understood to have positive effects on student behaviour and achievement. Yet, how intermediate assessment is perceived might be conditional for its success. The current study investigates both teachers’ and students’ perceptions of intermediate assessment. Teachers and students were interviewed and Student Evaluations of Teaching were examined. Results indicate that both teachers and students had generally positive perceptions of intermediate assessment. However, the two groups provided different reasons for their positive perceptions. Teachers and students (...) agreed that intermediate assessment helps students to keep up with their study work. Moreover, teachers mentioned that they could assess various knowledge and skills with intermediate assessment, whereas students preferred intermediate assessments to test the same knowledge and skills as the final exam. This finding suggests that teachers and students in our study had different goals... (shrink)

Singing is a way of musical expression interwoven into the human beings' very essence. Voice, as an intimate instrument invisible to the eye, demands as fuller use as possible, which includes muscular stamina and refined listening to sounds. In the educational system, singing is a part of a structured programme with the goal of developing singing abilities and musical culture of participants in the educational process in general. Feeling self-confident and having an image of oneself as a competent and qualified (...) expert in the singing area is of the utmost importance for quality work in the profession of preschool teachers or teachers. The goal of this study was to examine how students at the Teacher Education faculty perceive themselves and assess their singing abilities according to the singing elements we should nourish in working with children. The study aimed at examining how much the students enjoy singing activities, how they appraise their sense of self-confidence in singing, and to which extent the feeling of competence in singing is related with the time component of learning. It was investigated how teachers assess their satisfaction and self-confidence in singing, and whether the connection between these constructs and the type and year of study exists. The research involving 162 participants was conducted in the academic year 2021/2022. The results have shown that students of teacher education faculty are satisfied with their singing abilities and evaluate them well. On the other hand, they lack self-confidence and are not self-assured during singing activities. The results of the t-test showed a statistically significant difference in the assessment of satisfaction with singing abilities between students of early and preschool education and teacher education. The Kruskal-Wallis test determined the existence of statistically significant differences between students of higher years of study and those at lower year of studying according to their assessment of satisfaction with singing activities, wherein students at higher study years gave higher assessments. (shrink)

The relevance of social cognition assessment has been formally described in the Diagnostic and Statistical Manual of Mental Disorders-5. However, social cognition tools evaluating different socio-cognitive components for Italian-speaking populations are lacking. The Edinburgh Social Cognition Test is a new social cognition measure that uses animations of everyday social interactions to assess cognitive theory of mind, affective theory of mind, interpersonal social norm understanding, and intrapersonal social norm understanding. Previous studies have shown that the ESCoT is a sensitive measure of (...) social cognition in healthy and clinical populations in the United Kingdom. This work aimed to adapt and validate the ESCoT in an Italian population of healthy adults. A translation-back-translation procedure was followed to create and refine the Italian version. Then, 94 healthy adults completed the ESCoT, a battery of conventional social cognition tests and measures of intelligence and executive functions. Reliability, convergent validity, and predictors of performance on the ESCoT were examined. Results demonstrated good reliability of the ESCoT and an association between the ESCoT scores and some traditional social cognition tests. Hierarchical regression results showed that the ESCoT total score was associated with age. Also, the ESCoT subscore was associated with education. These findings support the ESCoT as a valid tool testing social norm understanding, a reliable measure of social cognition for an adult Italian population, and provides further evidence that the ESCoT is sensitive to age- and education-related changes in social cognition, and it is a task not affected by general cognitive functioning. (shrink)

Numerous functions, cognitive skills, and behaviors are associated with intelligence, yet decades of research has yielded little consensus on its definition. Emerging from often conflicting studies is the provocative idea that intelligence evolved as an adaptation humans needed to keep up with - and survive in - challenging new environments. The Handbook of Intelligence addresses a broad range of issues relating to our cognitive and linguistic past. It is the first full-length volume to place intelligence in an evolutionary/cultural framework, tracing (...) the development of the human mind, exploring differences between humans and other primates, and addressing human thinking and reasoning about its own intelligence and its uses. The works of pioneering thinkers - from Plato to Darwin, Binet to Piaget, Luria to Wechsler - are referenced to illustrate major events in the evolution of theories of intelligence, leading to the current era of multiple intelligences and special education programs. In addition, it examines evolutionary concepts in areas as diverse as creativity, culture, neurocognition, emotional intelligence, and assessment. Featured topics include: The evolution of the human brain from matter to mind Social competition and the evolution of fluid intelligence Multiple intelligences in the new age of thinking Intelligence as a malleable construct From traditional IQ to second-generation intelligence tests The evolution of intelligence, including implications for educational programming and policy. The Handbook of Intelligence is an essential resource for researchers, graduate students, clinicians, and professionals in developmental psychology; assessment, testing and evaluation; language philosophy; personality and social psychology; sociology; and developmental biology. (shrink)

The Metacognitive, Affective, Cognitive Experience questionnaire was designed to assess metacognition across sleep and waking . The present research evaluates the psychometric properties of the MACE. Data from two recent studies were used to assess the inter-item consistency, test–retest reliability, and factorial, convergent, and discriminant validity of the MACE. Results show that the MACE is a reliable measure with good construct validity. Exploratory factor analyses revealed one self-regulation and two monitoring factors. One monitoring factor emphasized monitoring internal conditions; the other (...) emphasized monitoring external conditions. This factor structure is consistent with the Metacognitive Model . Tests of convergent and discriminant validity suggest that the MACE is assessing metacognition and is appropriately related to similar constructs such as mindfulness and self-consciousness. The implication of these findings as well as suggestions for research and clinical applications of the MACE are discussed. (shrink)

In many assessment problems—aptitude testing, hiring decisions, appraisals of the risk of recidivism, evaluation of the credibility of testimonial sources, and so on—the fair treatment of different groups of individuals is an important goal. But individuals can be legitimately grouped in many different ways. Using a framework and fairness constraints explored in research on algorithmic fairness, I show that eliminating certain forms of bias across groups for one way of classifying individuals can make it impossible to eliminate such bias (...) across groups for another way of dividing people up. And this point generalizes if we require merely that assessments be approximately bias-free. Moreover, even if the fairness constraints are satisfied for some given partitions of the population, the constraints can fail for the coarsest common refinement, that is, the partition generated by taking intersections of the elements of these coarser partitions. This shows that these prominent fairness constraints admit the possibility of forms of intersectional bias. (shrink)

Biobanks and biospecimen collections are becoming a primary means of delivering personalized diagnostics and tailoring individualized therapeutics. This shift towards precision medicine requires interactions among a variety of stakeholders, including the public, patients, healthcare providers, government, and donors. Very few studies have investigated the role of healthcare students in biobanking and biospecimen donations. The main aims of this study were to evaluate the knowledge of senior healthcare students about biobanks and to assess the students’ willingness to donate biospecimens and the (...) factors influencing their attitudes. A cross-sectional study was conducted among senior healthcare students at King Abdulaziz University, Saudi Arabia. The data were obtained using a self-administered questionnaire in English. In addition to the respondents’ biographical data section, the questionnaire assessed the respondents’ general knowledge about biobanking, the factors influencing their willingness to donate biospecimens to biobanks and their general attitudes towards biomedical research. A total of 597 senior healthcare students were included in the study. The general knowledge score was 3.2 out of 7. Only approximately 44% and 27% of students were aware of the terms “Human Genome Project” and “biobank,” respectively. The majority of the students were willing to donate biospecimens to biobanks. Multiple factors were significantly associated with their willingness to donate, including their perceived general health, past experience with both tissue testing and tissue donation, biobanking knowledge score and biomedical research attitude score. The main reasons for students’ willingness to donate were advancement of medical research and societal benefits, whereas misuse of biospecimens and confidentiality breaches were the main reasons for a reluctance to donate. Despite their strong willingness to donate biospecimens, students exhibited a notable lack of knowledge about biobanking and the HGP. To expedite the transition towards PM, it is highly recommended to enhance healthcare curricula by including more educational and awareness programmes to familiarize students with OMICs technologies in addition to the scope of research and clinical applications. (shrink)

A team of philosophers and scientists at Dartmouth College worked for three years to create, train faculty and pilot test an adequate and exportable class in research methods for graduate students of science and engineering. Developing and testing methods for evaluating students’ progress in learning research ethics were part of the project goals. Failure of methods tried in the first year led to the refinement of methods for the second year. These were used successfully in the pilot course and (...) in one university setting external to Dartmouth. The process of development and justification for the final methods are discussed here. (shrink)

Impaired hand proprioception can lead to difficulties in performing fine motor tasks, thereby affecting activities of daily living. The majority of children with unilateral cerebral palsy experience proprioceptive deficits, but accurately quantifying these deficits is challenging due to the lack of sensitive measurement methods. Robot-assisted assessments provide a promising alternative, however, there is a need for solutions that specifically target children and their needs. We propose two novel robotics-based assessments to sensitively evaluate active and passive position sense of the index (...) finger metacarpophalangeal joint in children. We then investigate test-retest reliability and discriminant validity of these assessments in uCP and typically developing children, and further use the robotic platform to gain first insights into fundamentals of hand proprioception. Both robotic assessments were performed in two sessions with 1-h break in between. In the passive position sense assessment, participant's finger is passively moved by the robot to a randomly selected position, and she/he needs to indicate the perceived finger position on a tablet screen located directly above the hand, so that the vision of the hand is blocked. Active position sense is assessed by asking participants to accurately move their finger to a target position shown on the tablet screen, without visual feedback of the finger position. Ten children with uCP and 10 age-matched TDC were recruited in this study. Test-retest reliability in both populations was good >0.79). Proprioceptive error was larger for children with uCP than TDC, indicating discriminant validity. The active position sense was more accurate than passive, and the scores were not correlated, underlining the need for targeted assessments to comprehensively evaluate proprioception. There was a significant effect of age on passive position sense in TDC but not uCP, possibly linked to disturbed development of proprioceptive acuity in uCP. Overall, the proposed robot-assisted assessments are reliable, valid and a promising alternative to commonly used clinical methods, which could help gain a better understanding of proprioceptive impairments in uCP, facilitating the design of novel therapies. (shrink)

BackgroundSocial cognition and competence are a key part of daily interactions and essential for satisfying relationships and well-being. Pediatric neurological and psychological conditions can affect social cognition and require assessment and remediation of social skills. To adequately approximate the complex and dynamic nature of real-world social interactions, innovative tools are needed. The aim of this study was to document the performance of adolescents on two versions of a serious video game presenting realistic, everyday, socio-moral conflicts, and to explore whether their (...) performance is associated with empathy or sense of presence, factors known to influence social cognition.MethodsParticipants first completed a pre-test measure of socio-moral reasoning based on three dilemmas from a previously validated computer task. Then, they either played an evaluative version or an adaptive version of a video game presenting nine social situations in which they made socio-moral decisions and provided justifications. In the evaluative version, participants’ audio justifications were recorded verbatim and coded manually to obtain a socio-moral reasoning maturity score. In the adaptive version, tailored feedback and social reinforcements were provided based on participant responses. An automatic coding algorithm developed using artificial intelligence was used to determine socio-moral maturity level in real-time and to provide a basis for the feedback and reinforcements in the game. All participants then completed a three-dilemma post-test assessment.ResultsThose who played the adaptive version showed improved SMR across the pre-test, in-game and post-test moral maturity scores, F = 9.81, pHF < 0.001, ϵ2 = 0.21, but those who played the Evaluative version did not. Socio-moral reasoning scores from both versions combined did not correlate with empathy or sense of presence during the game, though results neared significance. The study findings support preliminary validation of the game as a promising method for assessing and remediating social skills during adolescence. (shrink)

This book makes the case for a revival in interest in the viva. As an oral assessment of a treatise or dissertation or of a student's performance in art or dance the viva has a long history dating back to the time of the Greeks. It can be found today in the form of professional, vocational and academic vivas, where a judgment of oral performance is required to gain entry into a profession or community of scholars. In a time when (...) there are scandals about students selling essays to other students, the viva provides a fertile ground for probing the student to see whether they are in fact the authors of the work being assessed and know its content and how to think cognitively or otherwise. Given that we actually know so little about the viva, the book theorises the viva based on a unique sample of vivas that have been filmed or in which the author himself has been participant, and discusses why its format is so different in Anglo-Saxon languages and Latin and other languages. The book offers educational policy-makers and examiners a trade-off between arguments in support of the viva and the demand for other, ever more cost-effective forms of assessment as the numbers of both undergraduate and postgraduate students threaten to increase. It also argues that with demand in the labour market for qualified graduates who are better equipped with transferable skills, such as the ability to communicate complex ideas verbally in a competent, well-argued fashion and not merely through the use of rhetoric, what appear to be cost-effective forms of assessment in the short run (e.g. written exams with standardised questions or multiple choice) may actually in the long run be of less value if we are investing in a future workforce with so-called 21st century communication skills. If the viva were abandoned, the student would be robbed of the opportunity to stage a defence. (shrink)

Dynamic Assessment (DA) has been shown to have more predictive value than conventional tests for academic performance. However, in relation to reading difficulties, further research is needed to determine the predictive validity of DA for specific aspects of the different processes involved in reading and the differential validity of DA for different subgroups of students with an academic disadvantage. This paper analyzes the implementation of a DA device that evaluates processes involved in reading (EDPL) among 60 students with reading comprehension (...) difficulties between 9 and 16 years of age, of whom 20 have intellectual disabilities, 24 have reading-related learning disabilities, and 16 have socio-cultural disadvantages. We specifically analyze the predictive validity of the EDPL device over attitude towards reading, and the use of dialogue/participation strategies in reading activities in the classroom during the implementation stage. We also analyze if the EDPL device provides additional information to that obtained with a conventionally applied personal-social adjustment scale (APSL). Results showed that dynamic scores, obtained from the implementation of the EDPL device, significantly predict the studied variables. Moreover, dynamic scores showed a significant incremental validity in relation to predictions based on an APSL scale. In relation to differential validity, the results indicated the superior predictive validity for DA for students with intellectual disabilities and reading disabilities than for students with socio-cultural disadvantages. Furthermore, the role of metacognition and its relation to the processes of personal-social adjustment in explaining the results is discussed. (shrink)

Validity is a central principle of assessment relating to the appropriateness of the uses and interpretations of test results. Usually, one of the inferences that we wish to make is that the score reflects the extent of a student?s learning in a given domain. Thus, it is important to establish that the assessment tasks elicit performances that reflect the intended constructs. This research explored the use of three methods for evaluating whether there are threats to validity in relation to the (...) constructs elicited in international A level geography examinations: (a) Rasch analysis; (b) analysis of processes expected and apparent when students answer questions; and (c) qualitative analysis of responses to items identified as potentially problematic. The results provided strong evidence to support validity with regard to the elicitation of constructs although one question part was identified as a threat to validity. Strengths and weaknesses of the methods can be identified. (shrink)

The growth of high-stakes testing in state accountability systems necessitates further examination of their impact on stakeholders. Prompted by broader state-level reform in Kentucky, this evaluation aims to provide insight into a new accountability system's effect on social studies teachers. Using a goal-free evaluation model and case study design, the researchers examined the content and instructional decisions made by a group of U.S. history teachers in response to a new end-of-course exam designed by ACT-QualityCore. The evaluation incorporated a content (...) analysis of teacher materials, observation of a professional learning community meeting, and teacher interviews. The results of this evaluation indicate that teachers generally support the changes in the new assessment system but find specific elements frustrating and hesitate to completely revamp their instructional practices. Considering these assessment system changes occurred to advance Kentucky's goal of college and career readiness for all, this evaluation provides insight into what is actually happening in classrooms and should assist teachers and administrators as they assess the impact of these reforms on classroom practice. (shrink)