It is commonly assumed that when we assign different credences to a proposition, a perfect compromise between our opinions simply ‘splits the difference’ between our credences. I introduce and defend an alternative account, namely that a perfect compromise maximizes the average of the expected epistemic values that we each assign to alternative credences in the disputed proposition. I compare the compromise strategy I introduce with the traditional strategy of compromising by splitting the difference, and I argue that my strategy is (...) a reasonable characterization of epistemic compromise. (shrink)

De Finetti introduced the concept of coherent previsions and conditional previsions through a gambling argument and through a parallel argument based on a quadratic scoring rule. He shows that the two arguments lead to the same concept of coherence. When dealing with events only, there is a rich class of scoring rules which might be used in place of the quadratic scoring rule. We give conditions under which a general strictly proper scoring rule (...) can replace the quadratic scoring rule while preserving the equivalence of de Finetti’s two arguments. In proving our results, we present a strengthening of the usual minimax theorem. We also present generalizations of de Finetti’s fundamental theorem of prevision to deal with conditional previsions. (shrink)

In a three-candidate election, a scoring rule s (s in [0,1]) assigns 1, s, and 0 points (respectively) to each first, second and third place in the individual preference rankings. The Condorcet efficiency of a scoring rule is defined as the conditional probability that this rule selects the winner in accordance with Condorcet criteria (three Condorcet criteria are considered in the paper). We are interested in the following question: What rule s has the greatest (...) Condorcet efficiency? After recalling the known answer to this question, we investigate the impact of social homogeneity on the optimal value of ?. One of the most salient results we obtain is that the optimality of the Borda rule (s=1/2) holds only if the voters act in an independent way. (shrink)

Scoring rules measure the deviation between a forecast, which assigns degrees of confidence to various events, and reality. Strictly proper scoring rules have the property that for any forecast, the mathematical expectation of the score of a forecast p by the lights of p is strictly better than the mathematical expectation of any other forecast q by the lights of p. Forecasts need not satisfy the axioms of the probability calculus, but Predd et al. [9] have shown that (...) given a finite sample space and any strictly proper additive and continuous scoring rule, the score for any forecast that does not satisfy the axioms of probability is strictly dominated by the score for some probabilistically consistent forecast. Recently, this result has been extended to non-additive continuous scoring rules. In this paper, a condition weaker than continuity is given that suffices for the result, and the condition is proved to be optimal. (shrink)

In practice, scoring rules elicit good probability estimates from individuals, while betting markets elicit good consensus estimates from groups. Market scoring rules combine these features, eliciting estimates from individuals or groups, with groups costing no more than individuals. Regarding a bet on one event given another event, only logarithmic versions preserve the probability of the given event. Logarithmic versions also preserve the conditional probabilities of other events, and so preserve conditional independence relations. Given logarithmic rules that elicit relative (...) probabilities of base event pairs, it costs no more to elicit estimates on all combinations of these base events. (shrink)

In a three-candidate election, a scoring rule λ, λ∈[0,1], assigns 1,λ and 0 points (respectively) to each first, second and third place in the individual preference rankings. The Condorcet efficiency of a scoring rule is defined as the conditional probability that this rule selects the winner in accordance with Condorcet criteria (three Condorcet criteria are considered in the paper). We are interested in the following question: What rule λ has the greatest Condorcet efficiency? After (...) recalling the known answer to this question, we investigate the impact of social homogeneity on the optimal value of λ. One of the most salient results we obtain is that the optimality of the Borda rule (λ=1/2) holds only if the voters act in an independent way. (shrink)

Consider an election in which each of the n voters casts a vote consisting of a strict preference ranking of the three candidates A, B, and C. In the limit as n→∞, which scoring rule maximizes, under the assumption of Impartial Anonymous Culture (uniform probability distribution over profiles), the probability that the Condorcet candidate wins the election, given that a Condorcet candidate exists? We produce an analytic solution, which is not the Borda Count. Our result agrees with recent (...) numerical results from two independent studies, and contradicts a published result of Van Newenhizen (Economic Theory 2, 69–83. (1992)). (shrink)

We provide self-contained proof of a theorem relating probabilistic coherence of forecasts to their non-domination by rival forecasts with respect to any proper scoring rule. The theorem recapitulates insights achieved by other investigators, and clarifi es the connection of coherence and proper scoring rules to Bregman divergence.

Levinstein recently presented a challenge to accuracy-first epistemology. He claims that there is no strictly proper, truth-directed, additive, and differentiable scoring rule that recognises the contingency of varying importance, i.e., the fact that an agent might value the inaccuracy of her credences differently at different possible worlds. In my response, I will argue that accuracy-first epistemology can capture the contingency of varying importance while maintaining its commitment to additivity, propriety, truth-directedness, and differentiability. I will construct a scoring (...) rule — a weighted scoring rule — and a global inaccuracy measure that has all four required properties and recognises the contingency of varying importance. I will show that Levinstein’s and my results coexist without contradicting each other. (shrink)

Epistemic decision theory aims to defend a variety of epistemic norms in terms of their facilitation of epistemic ends. One of the most important components of EpDT is known as a scoring rule. This thesis addresses some problems about scoring rules in EpDT. I consider scoring rules both for precise credences and for imprecise credences. For scoring rules in the context of precise credences, I examine the rationale for requiring a scoring rule to (...) be strictly proper, and argue that no satisfactory justification has been given. I then investigate one possible response to my argument and show the problems with this response. The conclusion is that there is a further need for justifying the requirement that a scoring rule should be strictly proper for precise credences. For scoring rules in the context of imprecise credences, an impossibility result has been established in the literature purporting to show that no strictly proper, continuous and real-valued scoring rule exists. However, a precise statement of the impossibility result requires precise definitions both of strict propriety and of continuity in the context of imprecise credences. Moreover, the result implies that we need to drop one of the three properties - strict propriety, continuity or being real-valued - to have a scoring rule for applying EpDT to imprecise credences. So, firstly, I offer definitions of strict propriety and of continuity and clarify the impossibility result. Then, I investigate what will happen if we drop one of the three properties. I argue that we should drop the property of being real-valued and I offer the general forms of two kinds of strictly proper, continuous and lexicographic scoring rules for imprecise credences. (shrink)

In many voting systems, voters’ preferences on a set of candidates are represented by linear orderings. In this context, scoring rules are well-known procedures to aggregate the preferences of the voters. Under these rules, each candidate obtains a fixed number of points, sk\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$s_k$$\end{document}, each time he/she is ranked k\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$k$$\end{document}th by one voter and the candidates are ordered according to the total number (...) of points they receive. In order to identify the best scoring rule to use in each situation, we need to know which properties are met by each of these procedures. Although some properties have been analyzed extensively, there are other properties that have not been studied for all scoring rules. In this paper, we consider two desirable social choice properties, the Pareto-optimality and the immunity to the absolute loser paradox, and establish characterizations of the scoring rules that satisfy each of these specific axioms. Moreover, we also provide a proof of a result given by Saari and Barney, where the scoring rules meeting reversal symmetry are characterized. From the results of characterization, we establish some relationships among these properties. Finally, we give a characterization of the scoring rules satisfying the three properties. (shrink)

As the ongoing literature on the paradoxes of the Lottery and the Preface reminds us, the nature of the relation between probability and rational acceptability remains far from settled. This article provides a novel perspective on the matter by exploiting a recently noted structural parallel with the problem of judgment aggregation. After offering a number of general desiderata on the relation between finite probability models and sets of accepted sentences in a Boolean sentential language, it is noted that a number (...) of these constraints will be satisfied if and only if acceptable sentences are true under all valuations in a distinguished non-empty set W. Drawing inspiration from distance-based aggregation procedures, various scoring rule based membership conditions for W are discussed and a possible point of contact with ranking theory is considered. The paper closes with various suggestions for further research. (shrink)

ABSTRACTSuppose that beliefs come in degrees. How should we then measure the accuracy of these degrees of belief? Scoring rules are usually thought to be the mathematical tool appropriate for this job. But there are many scoring rules, which lead to different ordinal accuracy rankings. Recently, Fallis and Lewis [2016] have given an argument that, if sound, rules out many popular scoring rules, including the Brier score, as genuine measures of accuracy. I respond to this argument, in (...) part by noting that the argument fails to account for verisimilitude—that certain false hypotheses might be closer to the truth than other false hypotheses are. Oddie [forthcoming], however, has argued that no member of a very wide class of scoring rules can appropriately handle verisimilitude. I explain how to respond to Oddie's argument, and I recommend a class of weighted scoring rules that, I argue, genuinely measure accuracy while escaping the arguments of Fallis and Lewis as well as Oddie. (shrink)

We argue that there is a tension between two monistic claims that are the core of recent work in epistemic consequentialism. The first is a form of monism about epistemic value, commonly known as veritism: accuracy is the sole final objective to be promoted in the epistemic domain. The other is a form of monism about a class of epistemic scoring rules: that is, strictly proper scoring rules are the only legitimate measures of inaccuracy. These two monisms, we (...) argue, are in tension with each other. If only accuracy has final epistemic value, then there are legitimate alternatives to strictly proper scoring rules. Our argument relies on the way scoring rules are used in contexts where accuracy is rewarded, such as education. (shrink)

In practice, scoring rules elicit good probability estimates from individuals, while betting markets elicit good consensus estimates from groups. Market scoring rules combine these features, eliciting estimates from individuals or groups, with groups costing no more than individuals. Regarding a bet on one event given another event, only logarithmic versions preserve the probability of the given event. Logarithmic versions also preserve the conditional probabilities of other events, and so preserve conditional independence relations. Given logarithmic rules that elicit relative (...) probabilities of base event pairs, it costs no more to elicit estimates on all combinations of these base events. (shrink)

Can there be good reasons for judging one set of probabilistic assertions more reliable than a second? There are many candidates for measuring "goodness" of probabilistic forecasts. Here, I focus on one such aspirant: calibration. Calibration requires an alignment of announced probabilities and observed relative frequency, e.g., 50 percent of forecasts made with the announced probability of.5 occur, 70 percent of forecasts made with probability.7 occur, etc. To summarize the conclusions: (i) Surveys designed to display calibration curves, from which a (...) recalibration is to be calculated, are useless without due consideration for the interconnections between questions (forecasts) in the survey. (ii) Subject to feedback, calibration in the long run is otiose. It gives no ground for validating one coherent opinion over another as each coherent forecaster is (almost) sure of his own long-run calibration. (iii) Calibration in the short run is an inducement to hedge forecasts. A calibration score, in the short run, is improper. It gives the forecaster reason to feign violation of total evidence by enticing him to use the more predictable frequencies in a larger finite reference class than that directly relevant. (shrink)

This paper studies a ranking rule of the following type axiomatically: each voter places k candidates into n categories with ranks from n to 1 attached to these categories, the candidate(s) with the highest aggregate score is (are) the winner(s). We show that it is characterized by a monotonicity condition and a multi-stage cancellation property.

Epistemic scoring rules are the en vogue tool for justifications of the probability norm and further norms of rational belief formation. They are different in kind and application from statistical scoring rules from which they arose. In the first part of the paper I argue that statistical scoring rules, properly understood, are in principle better suited to justify the probability norm than their epistemic brethren. Furthermore, I give a justification of the probability norm applying statistical scoring (...) rules. In the second part of the paper I give a variety of justifications of norms for rational belief formation employing statistical scoring rules. Furthermore, general properties of statistical scoring rules are investigated. Epistemic scoring rules feature as a useful technical tool for constructing statistical scoring rules. (shrink)

• Coherence1 for previsions of random variables with generalized betting; • Coherence2 for probability forecasts of events with Brier score penalty; • Coherence3 probability forecasts of events with various proper scoring rules.

Dutch Book Arguments. B is susceptibility to sure monetary loss (in a certain betting set-up), and F is the formal role played by non-Pr b’s in the DBT and the Converse DBT. Representation Theorem Arguments. B is having preferences that violate some of Savage’s axioms (and/or being unrepresentable as an expected utility maximizer), and F is the formal role played by non-Pr b’s in the RT.

- In decision theory, an agent is deciding how to value a gamble that results in different outcomes in different states. Each outcome gets a utility value for the agent.

This explains how to smoothly integrate booked orders with a combinatorial market maker, all for the general case of bets on E[x|A] for arbitrary random variables x and sets A.

Strictly proper scoring rules have been studied widely in statistical decision theory and recently in experimental economics because of their ability to encourage assessors to honestly provide their true subjective probabilities. In this article, we study the spherical scoring rule by analytically examining some of its properties and providing some new geometric interpretations for this rule. Moreover, we state a theorem which provides an axiomatic characterization for the spherical scoring rule. The objective of this (...) analysis is to provide a better understanding of one of the most commonly available scoring rules, which could aid decision makers in the selection of an appropriate tool for evaluating and assessing probabilistic forecasts. (shrink)

When choosing a voting rule to make subsequent decisions, the members of a committee may wish this rule to be self-selected when it is the object of a choice among a menu of different possible voting rules. Such concepts have recently been explored in Social Choice theory, and a menu of voting rule is said to be stable if it contains at least one self-selective voting rule at each profile of preferences on voting rules. We consider (...) in this article the menu constituted by the three well-known scoring rules {Borda, Plurality, and Antiplurality}. Under the Impartial Culture assumption, which proposes an a priori model to estimate the likelihood of the profiles, we will derive a probability for the stability of this triplet of voting rules. (shrink)

I show how scoring rules, interpreted as measuring the inaccuracy of a set of degrees of belief, may be exploited to construct confirmation measures as used in Bayesian confirmation theory. I construct two confirmation measures from two particular standard scoring rules. One of these measures is genuinely new, the second is trivially ordinally equivalent to the difference measure. These two measures are tested against three well-known measures of confirmation in a simple but illuminating case that contains in a (...) natural way the problem of irrelevant conjunction. The genuinely new measure emerges, arguably, as the best. (shrink)

Scoring rules constitute a particularly popular technique for aggregating a set of rankings. However, setting the weights associated with rank positions is a crucial task, as different instantiations of the weights can often lead to different winners. In this work we adopt minimax regret as a robust criterion for determining the winner in the presence of uncertainty over the weights. Focusing on two general settings we provide a characterization of the minimax regret rule in terms of cumulative ranks, (...) allowing a quick computation of the winner. We then analyze the properties of using minimax regret as a social choice function. Finally we provide some test cases of rank aggregation using the proposed method. (shrink)

Local proper scoring rules provide convenient tools for measuring subjective probabilities. Savage, 783–801, 1971) has shown that the only local proper scoring rule for more than two exclusive events is the logarithmic family. We generalize Savage by relaxing the properness and the domain, and provide simpler proof.

We give necessary and sufficient conditions for a scoring rule to be proper for a quantile if utility is linear, and the distribution is unrestricted. We also give results when the set of distributions is limited, for example, to distributions that have first moments.

In Knowledge in a Social World, Alvin Goldman presents a framework to quantify the epistemic effects that various policies, procedures, and behaviors can have on a group of agents. In this essay, I show that the framework requires some modifications when applied to agents with credences. The required modifications carry with them an interesting consequence, namely, that any group whose members disagree can become more accurate by forming a consensus through averaging their credences. I sketch a way that this result (...) can be used to show that individual norms of rationality and group norms of rationality can dictate conflicting behaviors for the members of some groups. I conclude by discussing how some of the assumptions used to generate the consensus result might be loosened.Send article to KindleTo send this article to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle. Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply. Find out more about the Kindle Personal Document Service.WE OUGHT TO AGREE: A CONSEQUENCE OF REPAIRING GOLDMAN'S GROUP SCORING RULEVolume 9, Issue 2Matthew KopecDOI: https://doi.org/10.1017/epi.2012.3Your Kindle email address Please provide your Kindle [email protected]@kindle.com Available formats PDF Please select a format to send. By using this service, you agree that you will only keep articles for personal use, and will not openly distribute them via Dropbox, Google Drive or other file sharing services. Please confirm that you accept the terms of use. Cancel Send ×Send article to Dropbox To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about sending content to Dropbox. WE OUGHT TO AGREE: A CONSEQUENCE OF REPAIRING GOLDMAN'S GROUP SCORING RULEVolume 9, Issue 2Matthew KopecDOI: https://doi.org/10.1017/epi.2012.3Available formats PDF Please select a format to send. By using this service, you agree that you will only keep articles for personal use, and will not openly distribute them via Dropbox, Google Drive or other file sharing services. Please confirm that you accept the terms of use. Cancel Send ×Send article to Google Drive To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about sending content to Google Drive. WE OUGHT TO AGREE: A CONSEQUENCE OF REPAIRING GOLDMAN'S GROUP SCORING RULEVolume 9, Issue 2Matthew KopecDOI: https://doi.org/10.1017/epi.2012.3Available formats PDF Please select a format to send. By using this service, you agree that you will only keep articles for personal use, and will not openly distribute them via Dropbox, Google Drive or other file sharing services. Please confirm that you accept the terms of use. Cancel Send ×Export citation Request permission. (shrink)

Jim Joyce argues for two amendments to probabilism. The first is the doctrine that credences are rational, or not, in virtue of their accuracy or “closeness to the truth” (1998). The second is a shift from a numerically precise model of belief to an imprecise model represented by a set of probability functions (2010). We argue that both amendments cannot be satisfied simultaneously. To do so, we employ a (slightly-generalized) impossibility theorem of Seidenfeld, Schervish, and Kadane (2012), who show that (...) there is no strictly proper scoring rule for imprecise probabilities. -/- The question then is what should give way. Joyce, who is well aware of this no-go result, thinks that a quantifiability constraint on epistemic accuracy should be relaxed to accommodate imprecision. We argue instead that another Joycean assumption — called strict immodesty— should be rejected, and we prove a representation theorem that characterizes all “mildly” immodest measures of inaccuracy. (shrink)

Shuford, Albert and Massengill proved, a half century ago, that the logarithmic scoring rule is the only proper measure of inaccuracy determined by a differentiable function of probability assigned the actual cell of a scored partition. In spite of this, the log rule has gained less traction in applied disciplines and among formal epistemologists that one might expect. In this paper we show that the differentiability criterion in the Shuford et. al. result is unnecessary and use the (...) resulting simplified characterization of the logarithmic rule to give novel arguments in favor of it. (shrink)

A number of authors have recently put forward arguments pro or contra various rules for scoring probability estimates. In doing so, they have skipped over a potentially important consideration in making such assessments, to wit, that the hypotheses whose probabilities are estimated can approximate the truth to different degrees. Once this is recognized, it becomes apparent that the question of how to assess probability estimates depends heavily on context.

There is an ongoing debate about which rule we ought to use for scoring probability estimates. Much of this debate has been premised on scoring-rule monism, according to which there is exactly one best scoring rule. In previous work, I have argued against this position. The argument given there was based on purely a priori considerations, notably the intuition that scoring rules should be sensitive to truthlikeness relations if, and only if, such relations (...) are present among whichever hypotheses are at issue. The present paper offers a new, quasi-empirical argument against scoring-rule monism. This argument uses computational simulations to show that different scoring rules can have different economical consequences, depending on the context of use. (shrink)

Are morphological patterns learned in the form of rules? Some models deny this, attributing all morphology to analogical mechanisms. The dual mechanism model (Pinker, S., & Prince, A. (1998). On language and connectionism: analysis of a parallel distributed processing model of language acquisition. Cognition, 28, 73-193) posits that speakers do internalize rules, but that these rules are few and cover only regular processes; the remaining patterns are attributed to analogy. This article advocates a third approach, which uses multiple stochastic rules (...) and no analogy. We propose a model that employs inductive learning to discover multiple rules, and assigns them confidence scores based on their performance in the lexicon. Our model is supported over the two alternatives by new "wug test" data on English past tenses, which show that participant ratings of novel pasts depend on the phonological shape of the stem, both for irregulars and, surprisingly, also for regulars. The latter observation cannot be explained under the dual mechanism approach, which derives all regulars with a single rule. To evaluate the alternative hypothesis that all morphology is analogical, we implemented a purely analogical model, which evaluates novel pasts based solely on their similarity to existing verbs. Tested against experimental data, this analogical model also failed in key respects: it could not locate patterns that require abstract structural characterizations, and it favored implausible responses based on single, highly similar exemplars. We conclude that speakers extend morphological patterns based on abstract structural properties, of a kind appropriately described with rules. (shrink)

The level of enjoyment in participating in sports activities is one component that causes young athletes to decide to stop or become more motivated to pursue sports activities. Practicing and participating in competitions are the main activities in sports coaching interactions towards optimal performance. This study aims to determine the effect of modifying the match rules implemented in youth soccer competitions on the level of enjoyment of players. Using an experimental method with 20 soccer schools participating in a competition with (...) modified game rules. Players registered by his team amounted to an average of 13.8 players aged 9-12 years. The number of players who are willing to fill out the pleasure level questionnaire is 238 players. Each player was asked to fill out a questionnaire before and after the competition, the questionnaire was analyzed using the mean and percentage test technique. The results of data analysis showed the average score before participating in the competition was 4.10 while after participating in the competition it was 4.47, which means an increase of 8.88%. The results showed that the level of enjoyment of the players increased after participating in the competition. Modification of the rule of the game in competition affects the level of enjoyment of players in the interaction of youth soccer coaching. Coaches, administrators, and match organizers are expected to have a positive paradigm of thinking and policy making towards the organization of competitions for young soccer players. (shrink)

In a voting context, when the preferences of voters are described by linear orderings over a finite set of alternatives, the Maximin rule orders the alternatives according to their minimal rank in the voters’ preferences. It is equivalent to the Fallback bargaining process described by Brams and Kilgour (Group Decision and Negotiation 10:287–316, 2001). This article proposes a characterization of the Maximin rule as a social welfare function (SWF) based upon five conditions: Neutrality, Duplication, Unanimity, Top Invariance, and (...) Weak Separability. In a similar way, we obtain a characterization for the Maximax SWF by using Bottom Invariance instead of Top Invariance. Then, these results are compared to the axiomatic characterizations of two famous scoring rules, the Plurality rule and the Antiplurality rule. (shrink)

We show that, when the number of participating agents n tends to infinity, all classical social choice rules are asymptotically strategy -proof with the proportion of manipulable profiles being of order O.

Researchers encounter challenges that require making complex professional decisions. Strategies such as seeking help and anticipating consequences support decision-making in these situations. Existing evidence on a measure of professional decision-making in research that assesses the use of decision-making strategies revealed that NIH-funded researchers born outside of the U.S. tended to score below their U.S. counterparts. To examine potential explanations for this association, this study recruited 101 researchers born in the United States and 102 born internationally to complete the PDR and (...) measures of basic personal values, values in scientific work, discrimination between the seriousness of rules in research, exposure to unprofessional research practices, and acculturation to American culture. Several variables were associated with PDR scores—discrimination between types of rules in research, exposure to unprofessional research practices, acculturation, and the basic personal values of power, security, and benevolence. However, only security, benevolence, acculturation, and rule discrimination were also associated with nation of origin. In multivariate models, the variance explained by these variables in accounting for the association of nation of origin and PDR scores was somewhat overlapping, thus, only security and benevolence remained as unique, statistically significant predictors. Thus, this study identified some important variables in the association of nation of origin and PDR, but more research is needed. In a secondary analysis to examine the “clinical significance” of scores on the PDR, this study examined aggregated PDR score data from the present sample and past samples of investigators. This analysis identified scores that may suggest a concern versus those scores that may be interpreted as excellent, proficient, or marginal. Implications for training and mentoring, along with considerations for future research are discussed. (shrink)

In this paper, we use an experimental design to compare the performance of elicitation rules for subjective beliefs. Contrary to previous works in which elicited beliefs are compared to an objective benchmark, we consider a purely subjective belief framework. The performance of different elicitation rules is assessed according to the accuracy of stated beliefs in predicting success. We measure this accuracy using two main factors: calibration and discrimination. For each of them, we propose two statistical indexes and we compare the (...) rules’ performances for each measurement. The matching probability method provides more accurate beliefs in terms of discrimination, while the quadratic scoring rule reduces overconfidence and the free rule, a simple rule with no incentives, which succeeds in eliciting accurate beliefs. Nevertheless, the matching probability appears to be the best mechanism for eliciting beliefs due to its performances in terms of calibration and discrimination, but also its ability to elicit consistent beliefs across measures and across tasks, as well as its empirical and theoretical properties. (shrink)

One prominent feature of contemporary virtue ethics is its insistence on the normative priority of the virtuous person. Another is its scepticism about the place of rules or principles in moral decision-making. But the Stoics seem paradoxical on this score. On the one hand, they are great proponents of the authority and privileged position of the sage; on the other, they see moral life as structured by an elaborate system of principles and rules. In this paper, I suggest a resolution (...) to this apparent paradox through an examination of Seneca's discussion of the place of rules in moral life. I also explain how this Stoic position avoids some of the problems normally attributed to virtue ethics because of its insistence on the normative priority of the virtuous person. (shrink)

We describe the case of a 46-year-old male who could perform certain rule-induction tasks without awareness of the operative rules after surviving nonaccidental carbon monoxide poisoning. We tested the performance of SC on a series of rule-induction tasks at three stages in his recovery: when he was unable to solve a picture discrimination task, when he could succeed on rules that were based on physical features of the task stimuli , but not on rules that were more abstract (...) in nature, and when he managed to solve both kinds of rules and could verbalize them. The focus of this paper is the differential pattern of performance in the latter two stages. Near-perfect scoring on control tasks suggested that this pattern could not be attributed to either verbal or memory deficits. We offer an explanation in terms of a dissociation between conscious and unconscious modes of information-processing. (shrink)

Some of the most interesting recent work in formal epistemology has focused on developing accuracy-based approaches to justifying Bayesian norms. These approaches are interesting not only because they offer new ways to justify these norms, but because they potentially offer a way to justify all of these norms by appeal to a single, attractive epistemic goal: having accurate beliefs. Recently, Easwaran & Fitelson (2012) have raised worries regarding whether such “all-accuracy” or “purely alethic” approaches can accommodate and justify evidential Bayesian (...) norms. In response, proponents of purely alethic approaches, such as Pettigrew (2013b) and Joyce (2016), have argued that scoring rule arguments provide us with compatible and purely alethic justifications for the traditional Bayesian norms, including evidential norms. In this paper I raise several challenges to this claim. First, I argue that many of the justifications these scoring rule arguments provide are not compatible. Second, I raise worries for the claim that these scoring rule arguments provide purely alethic justifications. Third, I turn to assess the more general question of whether purely alethic justifications for evidential norms are even possible, and argue that, without making some contentious assumptions, they are not. Fourth, I raise some further worries for the possibility of providing purely alethic justifications for content-sensitive evidential norms, like the Principal Principle. (shrink)

Court rulings are among the most important documents in all legal systems. This article describes a study in which natural language processing is used for the automatic characterization of Spanish judgments that deal with the physical custody (joint or individual) of minors. The model was trained to identify a set of elements: the type of custody requested by the plaintiff, the type of custody decided on by the court, and eight of the most commonly used arguments in this type of (...) judgment. Two jurists independently annotated more than 3000 judgments, which were used to train a model based on transformers. The main difficulties encountered in this task were the complexity of the judicial language and the need to work with appellate court rulings that have a more complicated structure than decisions at first instance. For the complete court rulings, the F1 score of the inter-annotator agreement ranged from 0.60 to 0.86 and the Kappa index from 0.33 to 0.73. The F1 score of the agreement between the model and the annotators ranged from 0.66 to 0.93 and the Kappa index from 0.57 to 0.80. These results in which the model performance exceeds even the inter-annotator agreement show the high ability of transformers to identify abstract entities in legal texts. (shrink)