This brief commentary treats Polanyi’s newly found lecture, “Rules of Rightness,” as an occasion to revisit some earlier claims I made about the use of rating scales in social science research. It serves as something of an interim report on an ongoing inquiry into what an effective response to social science would look like from a Polanyian perspective.

Measuring psychological attributes, such as motivation, typically involves rating scales, assuming that an attribute can be ordered, and that ratings represent this order. Previously, only the first assumption had been tested, albeit limited. First, we checked the ordinal structure of motivation, looking at whether people can establish transitive relations between motivation levels in pairwise comparisons; and we found different ordering patterns: strict transitive, weak transitive, changing order, and intransitivity. The rate of intransitivity was similar to that found previously and (...) was somewhat higher than we obtained when we asked participants to compare definitely quantitative attributes. Second, we checked if specific ordering patterns were related to individual interpretations of the statements that deviated from expected motivation types. Indeed, about a third of participants miscategorized statements, and these deviant interpretations were related to intransitivity as well as weak transitivity. Third, we checked whether Likert ratings represent the order of motives obtained from pairwise comparisons. We found rather homomorphic representation: ratings correlated with the order, but they did not differentiate between different ordering patterns and hierarchies of motives. We conclude that the Likert rating scale provides less information about respondents than pairwise ordering. The findings question the mainstream practice of using rating scales without testing underlying assumptions. (shrink)

Developing self-report Likert scales is an essential part of modern psychology. However, it is hard for psychologists to remain apprised of best practices as methodological developments accumulate. To address this, this current paper offers a selective review of advances in Likert scale development that have occurred over the past 25 years. We reviewed six major measurement journals between the years 1995–2019 and identified key advances, ultimately including 40 papers and offering written summaries of each. We supplemented this (...) review with an in-depth discussion of five particular advances: conceptions of construct validity, creating better construct definitions, readability tests for generating items, alternative measures of precision [e.g., coefficient omega and item response theory information], and ant colony optimization for creating short forms. The Supplementary Material provides further technical details on these advances and offers guidance on software implementation. This paper is intended to be a resource for psychological researchers to be informed about more recent psychometric progress in Likert scale creation. (shrink)

Likert scales are useful for collecting data on attitudes and perceptions from large samples of people. In particular, they have become a well-established tool in soundscape studies for conducting in situ surveys to determine how people experience urban public spaces. However, it is still unclear whether the metrics of the scales are consistently interpreted during a typical assessment task. The current work aims at identifying some general trends in the interpretation of Likert scale metrics and introducing (...) a procedure for the derivation of metric corrections by analyzing a case study dataset of 984 soundscape assessments across 11 urban locations in London. According to ISO/TS 12913-2:2018, soundscapes can be assessed through the scaling of 8 dimensions: pleasant, annoying, vibrant, monotonous, eventful, uneventful, calm, and chaotic. The hypothesis underlying this study is that a link exists between correlations across the percentage of assessments falling in each Likert scale category and a dilation/compression factor affecting the interpretation of the scales metric. The outcome of this metric correction value derivation is introduced for soundscape, and a new projection of the London soundscapes according to the corrected circumplex space is compared with the initial ISO circumplex space. The overall results show a general non-equidistant interpretation of the scales, particularly on the vibrant-monotonous direction. The implications of this correction have been demonstrated through a Linear Ridge Classifier task for predicting the London soundscape responses using objective acoustic parameters, which shows significant improvement when applied to the corrected data. The results suggest that the corrected values account for the non-equidistant interpretation of the Likert metrics, thereby allowing mathematical operations to be viable when applied to the data. (shrink)

ABSTRACT In this paper we report the development of a scale measuring Christian ethical beliefs. Three studies refined the Christian Ethical Beliefs Scale from 63 expert-generated potential items. Studies 1 and 3 sampled undergraduate students at private, Christian colleges, and Study 2 utilized a diverse, online sample. Participants responded to an electronic survey of Likert scale items and demographic questions. Following careful assessment of reliability and validity, we present a 20-item scale divided across five factors: Divine Moral Authority, Privacy (...) of Faith, Moral Individualism, Cognition Essential to Personhood, and Value of all Human Beings. This brief scale offers a new way to measure ethical beliefs in religious or nonreligious populations. (shrink)

Turkey has passed the import substitution economic model to a new model of the economy called open out since 1980. Along with the neoliberal policies implemented, the process of integration with the global economy has begun. The incomes of the religious people who cannot be excluded from the effects of this articulation also increased and their consumption behaviors has changed. On the other hand, some transport elements, especially the media, have enabled consumption codes to reach different segments. The new values (...) emerged in this process also caused transformations in individual consumption trends. In this study, the "Scale of Consumption Dynamics" (SCD) was developed in order to identify the trends of consumption of devotees and to find out how they changed. Quantitative research approach was adopted in the study and the datas were collected by face-to-face survey technique. The individuals included in our sample were selected by quota sampling. In this study, an expression pool was created as a result of literature review, expert opinion consultation, brainstorming with academicians and observations. The validity and reliability analysis of the scale was made using different statistics through the SPSS program. As a result of these steps, the dimensions of the scale consisting of 16 items and 3 dimensions are called "showy consumption", "wasteful consumption" and "religious priority consumption". Summary: The first studies on consumption history and sociology belong to Marx, Weber, Veblen and Simmel. In these studies consumption is examined as a part of production process and consumption forms were investigated as a social class aspect. Consumption phenomenon was later studied under critical approach (Frankfurt School) with Adorno, Max Horkheimer, Herbert Marcuse and Erich Fromm’s theories. Theorists at Frankfurt School study how social structure steers individuals to consumption. After the 1970’s, the meaning of consumption phenomenon has changed. There are studies by Jean Baudrillard, Mike Featherstone, George Ritzer, and Zygmunt Bauman on changing phenomenon of consumption. It is widely believed that modern consumption phenomenon was originated in the USA after the World War II. After the war Keynesian economic policies and Fordist consumption forms later influenced other Western nations. After 1950’s and 1960’s mass consumption was initiated in the USA and except very poor sections of the nations, other social classes, it started to spread out in Europe, the USA, and other countries. In 1970’s and 1980’s, it has merged with individuals’ identity definitions. After 1980’s in Turkey a new economic policy instead of import substitution was adopted. In application along with neo liberal policies, Turkey started to integrate to the rest of the World. Religious people as well influenced these changes and their incomes have increased along with their consumption habits. In addition to media, some other forms of communication channels have carried new consumption habits to other sections of the society. With the increased effects of mass communication media, new social sections have emerged and their cultural characteristics have become the norms of the whole society. A new values created in this process also transformed the consumption habits. In this article, in order to assess consumption habits of religious people as it is now and to understand which direction these habits evolve, Consumption Dynamics Scale (CDS) has been developed. Scales are widely used when a researcher tries to identify and measure respondents’ feelings and ideas on a subject matter. There are different scales used in social sciences such as Thurstone, Likert, Guttman, and Bogardus that are among the most widely used ones. A Likert Type scale has been used in this study. In the first phase of the study and pilot study 5 point Likert scale and in the second phase of the study 10 point Likert scales was used to collect the data. We could not come across with any study in the literature on investigating consumption characteristics Dynamics of individuals with a formal religious education. In the study, quantitative research method has been adopted and the research data has been collected with face to face administration of the survey instrument. The scale development phase lasted about 6 months from August, 2016. Based on 3% error rate, we determined to sufficient sample size as 516, yet we reached 600 individuals and end up with 563 usable responses. Sample has been determined with quota sampling methodology. We formed a pool of statements based on literature review, expert opinion, brain storming with academicians. 49 questions have been selected from the question pool where 93 questions were found, then they are merged, some questions are changed or totally eliminated and final 30 questioned questionnaires made ready for pilot study. Two pilot studies have been carried out. In the first pilot study, 47 people are reached and 30 questions with Likert scales have been administered. In the second phase of the study, 10 point Likert scales with 57 questions has been given to 54 individuals. After pilot studies, data was analyzed with SPSS 20 version and 32 questioned final survey instrument has been formed. In order to check sufficiency of data set for Factor Analysis Kaisser-Meyer-Olkin (KMO) test and the relationships among variables Bartlett test were used. Sample composed of 563 responses revealed significant results (3358,808, p=0,000) and KMO test revealed (KMO=0,812) value. After expletory factor analysis, factor loading less than 0,40 were deleted from the scale. Hence the final structure is composed of 29 questions with 8 different factors. The reliability of scales were calculated with Cronbach Alfa analysis separately for each dimension. After reliability analysis, items with 0,60 and less reliability score were taken out from the scales. Finally 16 items were made up 3 dimensions namely “ostentatious consumption”, “wasteful consumption”, and “religious priority consumption”. The items in Factor 1 are related with luxury, fashion and statue, in Factor 2 desire to make more shopping, purchase without need, advertisement and showcase, and factor 3 religious sensitive reference focus and religion first purchasing are decided as appropriate names. Based on the analysis, measurement was decided valid and sound. Therefore, this study is believed to contribute significantly to the existing literature. (shrink)

This study aimed to develop the Three-Dimensional Filial Piety Scale and explore its psychometric properties. Based on Wang’s Three-Dimensional Filial Piety Model, our study employed a review of the current literature, in-depth interviews, and feedback from experts and the target group. An initial 36-item scale using a bipolar Likert 6-point rating scale was developed. Then item analysis and exploratory factor analysis were conducted with sample 1 (n = 617) to explore the dimensions and final items, and a 15-item scale (...) with three factors was obtained. After that, confirmatory factor analysis was conducted to validate the 3-factor structure obtained through exploratory factor analysis with sample 2 (n = 585). Next, we tested criterion-related validity with sample 3 (n = 248) and test-retest reliability with sample 4 (n = 67). The results supported the model on which this scale was based and showed three dimensions of filial piety, namely the balance of interests, good affections, and family role norms. As a valid, reliable scale, the Three-Dimensional Filial Piety Scale can therefore be used in the Chinese context to measure filial piety for people of different genders, ages, and cohabitation situations. (shrink)

Many published instruments for assessing adolescent adjustment can be implemented in the school context. However, most of them fail to include a comprehensive and positive theoretical perspective of adolescent development and, even when they do, priority is often given to the clinical perspective, or problems with ecological validity and cost-effectiveness emerge. The Magallanes Adaptation Scale is a 90-item Likert-instrument designed for Spanish-speaking adolescents in order to screen several adjustment areas from a holistic and positive perspective of development. Although some (...) evidence of its psychometric robustness has been tested, no confirmatory analysis of its structure has been published. This paper analyzes the items and the factor structure (exploratory factor analysis and confirmatory factor analysis, using the split-half method) of the scales. Participants were 948 Spanish adolescents (49.84% girls) aged between 11 and 17 and stratified sampled. Thirty-six items were removed from the item analysis. The results of the exploratory factor analysis revealed five factors, excluding mother’s adaptation. Several models were tested during the confirmatory factor analyses, with a 24-item second-order four-factor solution being found to have the best adjustment indicators. The short version proposed in this paper can constitute a helpful tool with screening purposes to help school teachers to assess students’ overall development beyond mere academic performance, although further validity research is needed. (shrink)

Soundscapes affect people’s health and wellbeing and contribute to the perception of environments as restorative. This paper continues the validation process of a previously developed Perceived Restorativeness Soundscape Scale (PRSS). The study takes a novel methodological approach to explore the PRSS face and construct validity by examining the qualitative reasons for participants’ numerical responses to the PRSS items. The structure and framing of items are first examined, to produce 44 items which are assessed on a seven-point Likert agreement scale, (...) followed by a free format justification. Ten English speaking participants completed the PRSS interpretation questionnaire in two cafes in Montréal, Canada. Interpretation of participant free format responses led to six themes, which related to either the individual (personal attributes, personal outcomes), the environment (physical environment attributes, soundscape design) or an interaction of the two (behaviour setting, normality and typicality). The themes are discussed in relation to each Attention Restoration Theory (ART) component, namely Fascination, Being-Away, Compatibility, and Extent. The paper concludes by discussing the face and construct validity of the PRSS, as well as the wider methodological and theoretical implications for soundscape and attention restoration research, including the terminology importance in items measuring ART components and the value of all four components in assessing perceived restorativeness. (shrink)

Validated self-report measures of post-stroke fatigue are lacking. The Dutch Multifactor Fatigue Scale (DMFS) was translated into Danish, and response process evidence of validity was evaluated. DMFS consists of 38 Likert-rated items distributed on five subscales: Impact of fatigue (11 items), Signs and direct consequences of fatigue (9), Mental fatigue (7), Physical fatigue (6), and Coping with fatigue (5). Response processes to DMFS were investigated using a Three-Step Test-Interview (TSTI) protocol, and data were analyzed using Framework Analysis. Response processes (...) were indexed on the following categories: (i) “congruent,” response processes were related to the subscale construct; (ii) “incongruent,” response processes were not related to the subscale construct; (iii) “ambiguous,” response processes were both congruent and incongruent or insufficient to evaluate congruency; and (iv) “confused,” participants did not understand the item. Nine adults were recruited consecutively 10–34 months post-stroke (median = 26.5) at an outpatient brain injury rehabilitation center in 2019 [five females, mean age = 55 years (SD= 6.3)]. Problematic items were defined as <50% of response processes being congruent with the intended construct. Of the 38 items, five problematic items were identified, including four items of Physical fatigue and one of Mental fatigue. In addition, seven items posed various response difficulties to some participants due to syntactic complexity, vague terms, a presupposition, and a double-barrelled statement. In conclusion, findings elucidate the interpretative processes involved in responding to DMFS post-stroke, strengthen the evidence base of validity, and guide revisions to mitigate potential problems in item performance. (shrink)

The purpose of this study was to develop a scale for measuring prospective science teachers’ awareness of waste recycling. The study was conducted with the participation of 382 prospective teachers attending a university located in northern Turkey. The five-point Likert type scale that was developed contained 82 items relating to prospective science teachers’ awareness of waste recycling. The factor analysis conducted showed that five items had factor loadings below 0.30, and five were cross loading items. Factor analysis was repeated (...) after removing these items. A further 24 items were removed from the list at the end of the factor analysis, and the remaining 48 items were grouped under ten dimensions. The reliability coefficient for the factors extracted varied between 0.717 and 0.805, and the internal reliability coefficient for the whole scale was 0.905. (shrink)

There is a need for an extensive study on undergraduate students' attitudes towards the kalām course and its teaching process in the faculties of theology and Islamic studies, which are higher religious education institutions. In order to meet this need, a 30-item survey was prepared in a 5-point Likert structure that measures the attitude towards the kalām course. This questionnaire was applied to 1007 randomly selected undergraduate students studying in faculties of theology and Islamic studies in Turkey in the (...) 2021-2022 academic year. In this sample, 69.9% (N=704) of the participants were women, and 30.1% (N=303) were men. In the analyses made with the data obtained, it was seen that the questionnaire had a high incidence of internal consistency; and its suitability for factor extraction was calculated with the Bartlett Sphericity Test and the Kaiser-Meyer-Olkin (KMO) sample adequacy test. The KMO value was 0.934, and the Chi-square value [X2= 8083,719 p. (shrink)

Our families are our first and most important ethical training grounds. But what is the family? And what are our ethical commitments to our family members and to the broader moral community? After a brief introductory chapter on basic ethical concepts and theories, the essays in this volume provide readers with ethical analyses of issues ranging from same-sex marriage to a controversial proposal to "license" parents. The chapters cover love, sex, marriage, parents and children, the relationship between the family and (...) the larger moral community, and the influence of emerging technologies on the ethical issues inherent in family life. The volume is intended to open up this exciting territory in applied ethics to those interested in philosophy, family studies, social work, and to anyone who wants a deeper understanding of the ethical forces at work in this most basic social institution. (shrink)

Humanity needs a way to pool scientific community opinion quickly and efficiently on a given statement of interest. This should be on a very large scale, such that one can have confidence that the result reflects international scientific opinion. For this pilot project (2022-23), we developed tailored architecture in the form of a novel polling platform, to survey a network of scientists at 30 academic institutions around the world. Personal, one-to-one emails were sent to all relevant scientists at those institutions, (...) asking them for their position on our pilot statement, "Science has put it beyond reasonable doubt that COVID-19 is caused by a virus." Scientists answered by clicking a URL embedded in the email, and confirming their response on a 5-point Likert scale. Voting was anonymous, with the token linking the scientist to their vote being destroyed upon voting, and their response logged against the demographics of scientific field of expertise (broadly construed) and institution for subsequent data analysis. (shrink)

Choice experiment (CE) is a questionnaire based method that the accuracy of research questionnaire determines the validity of the research outcomes. Attribute selection has a prime importance in every CE studies. If respondents do not understand or do not have preference for a certain attribute, the attribute non-attendance problem might happen that biases overall results of the research. Qualitative approaches such as literature review, focus group discussion, and in depth discussion commonly applied in CE researches. However, especially in the developing (...) countries context where ethnical and cultural diversity is a challenge in conducting survey based questionnaires, qualitative methods are not sufficient in selecting attributes. Present study investigates the application of relative importance index (RII) in respondents¡¯ preference for attributes in a modal shift study in Klang Valley, Malaysia. The 5 point Likert scale questions were employed to enhance respondents¡¯ preferences for initial 24 selected attributes. The results of this study showed that from 24 pre-selected attributes, only 18 of them had RII>0.5 and could be included in the final CE design. The results of this study could help researchers to control for unobserved problems in selecting the attributes which could not be discovered through qualitative approaches. -/- . (shrink)

Irecently admitted a 93-year-old Spanish-speaking woman with bilateral flank pain. A thorough history revealed her pain was due to constipation and intense straining with each bowel movement, but a language barrier, a mild troponin elevation, and "new atrial fibrillation" on her EKG triggered the Emergency Department physician to admit her for observation. When I went to see her, she mentioned her pain was worse since she was told we would need to monitor her heart overnight. She asked, "Is everything ok (...) with my heart?"To assess that question, I prepared to perform a bedside ultrasound, also known as point-of-care ultrasound. We moved from a hallway in the ED to a room for more privacy, and the patient... (shrink)

Critical discussion of Quine's concepts of purely referential occurrence/position. It is argued from the perspective of a Russellian view of truth that existential generalization and substitutivity of identity are non-equivalent tests for referential occurrence/position, and that the former rather than the latter is the appropriate test.

Critical discussion of Quine's concepts of purely referential occurrence/position. It is argued from the perspective of a Russellian view of truth that existential generalization and substitutivity of identity are non-equivalent tests for referential occurrence/position, and that the former rather than the latter is the appropriate test.

Human–Human and Human–Robot Interaction are known to be influenced by a variety of modalities and parameters. Nevertheless, it remains a challenge to anticipate how a given mobile robot’s navigation and appearance will impact how it is perceived by humans. Drawing a parallel with vocal prosody, we introduce the notion of movement prosody, which encompasses spatio-temporal and appearance dimensions which are involved in a person’s perceptual experience of interacting with a mobile robot. We design a novel robot motion corpus, encompassing variables (...) related to the kinematics, gaze, and appearance of the robot, which we hypothesize are involved in movement prosody. Initial results of three perception experiments suggest that these variables have significant influences on participants’ perceptions of robot socio-affects and physical attributes. (shrink)

Likert-scale surveys are frequently used in cross-cultural studies on leadership. Recent publications using digital text algorithms raise doubt about the source of variation in statistics from such studies to the extent that they are semantically driven. The Semantic Theory of Survey Response (STSR) predicts that in the case of semantically determined answers, the response patterns may also be predictable across languages. The Multifactor Leadership Questionnaire (MLQ) was applied to 11 different ethnic samples in English, Norwegian, German, Urdu and Chinese. (...) Semantic algorithms predicted responses significantly across all conditions, although to varying degree. Comparisons of Norwegian, German, Urdu and Chinese samples in native versus English language versions suggest that observed differences are not culturally dependent but caused by different translations and understanding. The maximum variance attributable to culture was a 5% unique overlap of variation in the two Chinese samples. These findings question the capability of traditional surveys to detect cultural differences. It also indicates that cross-cultural leadership research may risk lack of practical relevance. (shrink)