For the past half-century, critical pedagogy has represented perhaps the most influential response to traditional ‘banking’ models of education and the political obedience and social conformity they are purported to engender. Precisely because of its lasting impact, however, it has tended to overshadow other possible visions of the critical political potential of education. In this article, I trace the origins and development of a distinctive yet under-discussed concept in Michel Foucault’s late ethical work – psychagogy – to pursue an alternative (...) depiction of education as a critical political practice. Attending to the origins and meaning of psychagogy in Foucault’s work is valuable, I argue, for two reasons. On the one hand, the concept offers a vision of political education that avoids reproducing problematic juridical binaries – truth and ideology, rationality and irrationality, absolved and condemned – that Foucault believed inhered in Enlightenment-era conceptions of emancipation. On the other hand, it demonstrates how political problems of our present might be rendered workable not only through recourse to the authoritative discourses of experts or collective demands of revolutionaries, but also through exercises in subjectivity formation that are rather more quotidian, experiential, and conditional in nature. (shrink)

Historically, American political science has rarely engaged popular culture as a central topic of study, despite the domain’s outsized influence in American community life. This article argues that this marginalization is, in part, the by-product of long-standing disciplinary debates over the inadequate political development of the American public. To develop this argument, the article first surveys the work of early political scientists, such as John Burgess and Woodrow Wilson, to show that their reformist ambitions largely precluded discussion of mundane activities (...) of social life such as popular culture. It then turns to Harold Lasswell, who produced some of the first investigations of popular culture in American political science. Ironically, however, his work – and the work of those who adapted similar ways of speaking about popular culture after him – only reinforced skepticisms concerning the American public. It has thus helped keep the topic on the margins of disciplinary discourse. (shrink)

We begin by showing that every theory of the value of uncertain prospects must have one of three unpalatable properties. _Reckless_ theories recommend giving up a sure thing, no matter how good, for an arbitrarily tiny chance of enormous gain; _timid_ theories permit passing up an arbitrarily large potential gain to prevent a tiny increase in risk; _non-transitive_ theories deny the principle that, if A is better than B and B is better than C, then A must be better than (...) C. Having set up this trilemma, we study its horns. Non-transitivity has been much discussed; we focus on drawing out the costs and benefits of recklessness and timidity when it comes to axiology, decision theory, and normative uncertainty. (shrink)

Positions on the ethics of human enhancement technologies can be (crudely) characterized as ranging from transhumanism to bioconservatism. Transhumanists believe that human enhancement technologies should be made widely available, that individuals should have broad discretion over which of these technologies to apply to themselves, and that parents should normally have the right to choose enhancements for their children-to-be. Bioconservatives (whose ranks include such diverse writers as Leon Kass, Francis Fukuyama, George Annas, Wesley Smith, Jeremy Rifkin, and Bill McKibben) are generally (...) opposed to the use of technology to modify human nature. A central idea in bioconservativism is that human enhancement technologies will undermine our human dignity. To forestall a slide down the slippery slope towards an ultimately debased ‘posthuman’ state, bioconservatives often argue for broad bans on otherwise promising human enhancements. This paper distinguishes two common fears about the posthuman and argues for the importance of a concept of dignity that is inclusive enough to also apply to many possible posthuman beings. Recognizing the possibility of posthuman dignity undercuts an important objection against human enhancement and removes a distortive double standard from our field of moral vision. (shrink)

Suppose that we develop a medically safe and affordable means of enhancing human intelligence. For concreteness, we shall assume that the technology is genetic engineering (either somatic or germ line), although the argument we will present does not depend on the technological implementation. For simplicity, we shall speak of enhancing “intelligence” or “cognitive capacity,” but we do not presuppose that intelligence is best conceived of as a unitary attribute. Our considerations could be applied to specific cognitive abilities such as verbal (...) fluency, memory, abstract reasoning, social intelligence, spatial cognition, numerical ability, or musical talent. It will emerge that the form of argument that we use can be applied much more generally to help assess other kinds of enhancement technologies as well as other kinds of reform. However, to give a detailed illustration of how the argument form works, we will focus on the prospect of cognitive enhancement. (shrink)

Transhumanism is a loosely defined movement that has developed gradually over the past two decades. It promotes an interdisciplinary approach to understanding and evaluating the opportunities for enhancing the human condition and the human organism opened up by the advancement of technology. Attention is given to both present technologies, like genetic engineering and information technology, and anticipated future ones, such as molecular nanotechnology and artificial intelligence.

The term “posthuman” has been used in very different senses by different authors.2 I am sympathetic to the view that the word often causes more confusion than clarity, and that we might be better off replacing it with some alternative vocabulary.

The ethical issues related to the possible future creation of machines with general intellectual capabilities far outstripping those of humans are quite distinct from any ethical problems arising in current automation and information systems. Such superintelligence would not be just another technological development; it would be the most important invention ever made, and would lead to explosive progress in all scientific and technological fields, as the superintelligence would conduct research with superhuman efficiency. To the extent that ethics is a cognitive (...) pursuit, a superintelligence could also easily surpass humans in the quality of its moral thinking. However, it would be up to the designers of the superintelligence to specify its original motivations. Since the superintelligence may become unstoppably powerful because of its intellectual superiority and the technologies it could develop, it is crucial that it be provided with human-friendly motivations. This paper surveys some of the unique ethical issues in creating superintelligence, and discusses what motivations we ought to give a superintelligence, and introduces some cost-benefit considerations relating to whether the development of superintelligent machines ought to be accelerated or retarded. (shrink)

This paper details the ways that gender structures our senses of agency on an enactive framework. While it is common to discuss how gender influences higher, narrative levels of cognition, as with the formulation of goals and in considerations about our identities, it is less clear how gender structures our more immediate, embodied processes, such as the minimal sense of agency. While enactivists often acknowledge that gender and other aspects of our socio-cultural situatedness shape our cognitive processes, there is little (...) work on how this shaping takes place. In order to provide such an account, I will first look at the minimal and narrative senses of agency (Gallagher 2012), a distinction that draws from work on minimal and narrative selves (Zahavi 2010). Next I will explain the influence of the narrative sense of agency on the minimal sense of agency through work on intention-formation (Pacherie 2007). After a discussion of the role of gender in the narrative sense of agency, I’ll expand on work by Haslanger (2012) and Young (1980) to offer three ways in which gender influences the minimal sense of agency, showing the effect that gender has on how we perceive our possibilities for interaction in a phenomenologically immediate, pre-reflective manner. (shrink)

The Sleeping Beauty problem is test stone for theories about self-locating belief, i.e. theories about how we should reasons when data or theories contain indexical information. Opinion on this problem is split between two camps, those who defend the "1/2 view" and those who advocate the "1/3 view". I argue that both these positions are mistaken. Instead, I propose a new "hybrid" model, which avoids the faults of the standard views while retaining their attractive properties. This model _appears_ to violate (...) Bayesian conditionalization, but I argue that this is not the case. By paying close attention to the details of conditionalization in contexts where indexical information is relevant, we discover that the hybrid model is in fact consistent with Bayesian kinematics. If the proposed model is correct, there are important lessons for the study of self-location, observation selection theory, and anthropic reasoning. (shrink)

Cognitive enhancement may be defined as the amplification or extension of core capacities of the mind through improvement or augmentation of internal or external information processing systems. Cognition refers to the processes an organism uses to organize information. These include acquiring information (perception), selecting (attention), representing (understanding) and retaining (memory) information, and using it to guide behavior (reasoning and coordination of motor outputs). Interventions to improve cognitive function may be directed at any of these core faculties.

The study of active matter systems demonstrates how interactions might co-constitute agential dynamics. Active matter systems are comprised of self-propelled independent entities which, en masse, take part in complex and interesting collective group behaviors at a far-from-equilibrium state (Menon, 2010 ; Takatori & Brady, 2015 ). These systems are modelled using very simple rules (Vicsek at al. 1995), which reveal the interactive nature of the collective behaviors seen from humble to highly complex entities. Here I show how the study of (...) active matter systems supports two related proposals regarding interaction and agency. First, I argue that the study of interactive dynamics in these systems evidences the utility of treating interaction as an ontological category (Longino, 2021 ) and challenges methodological individualism as the received explanatory primitive in the study of agency. Second, the methods used to research active matter systems demonstrate how a minimal approach to agency can scale up in studying interactive agential dynamics in more complex systems. The examples of coordination dynamics (Kelso, 2001 ) and participatory sense-making (De Jaegher & Di Paolo, 2007 ) are provided to show how understanding agency requires us to look beyond the individuals to the interactive agential dynamics that can guide, scaffold, or constrain their activity. (shrink)

The Doomsday argument purports to show that the risk of the human species going extinct soon has been systematically underestimated. This argument has something in common with controversial forms of reasoning in other areas, including: game theoretic problems with imperfect recall, the methodology of cosmology, the epistemology of indexical belief, and the debate over so-called fine-tuning arguments for the design hypothesis. The common denominator is a certain premiss: the Self-Sampling Assumption. We present two strands of argument in favor of this (...) assumption. Through a series of thought experiments we then investigate some bizarre prima facie consequences – backward causation, psychic powers, and an apparent conflict with the Principal Principle. (shrink)

The standard topological representation of a Boolean algebra via the clopen sets of a Stone space requires a nonconstructive choice principle, equivalent to the Boolean Prime Ideal Theorem. In this article, we describe a choice-free topological representation of Boolean algebras. This representation uses a subclass of the spectral spaces that Stone used in his representation of distributive lattices via compact open sets. It also takes advantage of Tarski’s observation that the regular open sets of any topological space form a Boolean (...) algebra. We prove without choice principles that any Boolean algebra arises from a special spectral space X via the compact regular open sets of X; these sets may also be described as those that are both compact open in X and regular open in the upset topology of the specialization order of X, allowing one to apply to an arbitrary Boolean algebra simple reasoning about regular opens of a separative poset. Our representation is therefore a mix of Stone and Tarski, with the two connected by Vietoris: the relevant spectral spaces also arise as the hyperspace of nonempty closed sets of a Stone space endowed with the upper Vietoris topology. This connection makes clear the relation between our point-set topological approach to choice-free Stone duality, which may be called the hyperspace approach, and a point-free approach to choice-free Stone duality using Stone locales. Unlike Stone’s representation of Boolean algebras via Stone spaces, our choice-free topological representation of Boolean algebras does not show that every Boolean algebra can be represented as a field of sets; but like Stone’s representation, it provides the benefit of a topological perspective on Boolean algebras, only now without choice. In addition to representation, we establish a choice-free dual equivalence between the category of Boolean algebras with Boolean homomorphisms and a subcategory of the category of spectral spaces with spectral maps. We show how this duality can be used to prove some basic facts about Boolean algebras. (shrink)

This article provides an algebraic study of the propositional system $\mathtt {InqB}$ of inquisitive logic. We also investigate the wider class of $\mathtt {DNA}$ -logics, which are negative variants of intermediate logics, and the corresponding algebraic structures, $\mathtt {DNA}$ -varieties. We prove that the lattice of $\mathtt {DNA}$ -logics is dually isomorphic to the lattice of $\mathtt {DNA}$ -varieties. We characterise maximal and minimal intermediate logics with the same negative variant, and we prove a suitable version of Birkhoff’s classic variety (...) theorems. We also introduce locally finite $\mathtt {DNA}$ -varieties and show that these varieties are axiomatised by the analogues of Jankov formulas. Finally, we prove that the lattice of extensions of $\mathtt {InqB}$ is dually isomorphic to the ordinal $\omega +1$ and give an axiomatisation of these logics via Jankov $\mathtt {DNA}$ -formulas. This shows that these extensions coincide with the so-called inquisitive hierarchy of [9].1. (shrink)

The purpose of this investigation is to develop a ranking of academic business ethics journals. For this, a revealed preference approach, also known as a citation impact method, was employed. The citation data were generated by using Google Scholar; h-index, g-index and hc-index were utilised to obtain a ranking. It was observed that the scores of these three indices correlated almost perfectly. This study also demonstrates that business ethics is a well-established discipline that should have its own set of recognised (...) academic outlets. (shrink)

In some situations a number of agents each have the ability to undertake an initiative that would have significant effects on the others. Suppose that each of these agents is purely motivated by an altruistic concern for the common good. We show that if each agent acts on her own personal judgment as to whether the initiative should be undertaken, then the initiative will be undertaken more often than is optimal. We suggest that this phenomenon, which we call the unilateralist’s (...) curse, arises in many contexts, including some that are important for public policy. To lift the curse, we propose a principle of conformity, which would discourage unilateralist action. We consider three different models for how this principle could be implemented, and respond to an objection that could be raised against it. (shrink)

Active materials are self-propelled non-living entities which, in some circumstances, exhibit a number of cognitively interesting behaviors such as gradient-following, avoiding obstacles, signaling and group coordination. This has led to scientific and philosophical discussion of whether this may make them useful as minimal models of cognition (Hanczyc, 2014; McGivern, 2019). Batterman and Rice (2014) have argued that what makes a minimal model explanatory is that the model is ultimately in the same universality class as the target system, which underpins why (...) it exhibits the same macrobehavior. We appeal to recent research in basal cognition (Lyon et al., 2021) to establish appropriate target systems and essential features of cognition as a target of modeling. Looking at self-propelled oil droplets, a type of active material, we do not find that organization alone indicates that these systems exhibit the essential features of cognition. We then examine the specific behaviors of oil droplets but also fail to find that these demonstrate the essential features of cognition. Without a universality class, Batterman & Rice’s account of the explanatory power of minimal models simply does not apply to cognition. However, we also want to stress that it is not intended to; cognition is not the same type of behavioral phenomena as those found in physics. We then look to the minimal cognition methodology of Beer (1996, 2020a, b) to show how active materials can be explanatorily valuable regardless of their cognitive status because they engage in specific behaviors that have traditionally been expected to involve internal representational dynamics, revealing misconceptions about the cognitive underpinnings of certain, specific behaviors in target systems where such behaviors are cognitive. Further, Beer’s models can also be genuinely explanatory by providing dynamical explanations. (shrink)

In 1995 Visser, van Benthem, de Jongh, and Renardel de Lavalette introduced NNIL-formulas, showing that these are exactly the formulas preserved under taking submodels of Kripke models. In this article we show that NNIL-formulas are up to frame equivalence the formulas preserved under taking subframes of frames, that NNIL-formulas are subframe formulas, and that subframe logics can be axiomatized by NNIL-formulas. We also define a new syntactic class of ONNILLI-formulas. We show that these are the formulas preserved in monotonic images (...) of frames and that ONNILLI-formulas are stable formulas as introduced by Bezhanishvili and Bezhanishvili in 2013. Thus, ONNILLI is a syntactically defined set of formulas axiomatizing all stable logics. This resolves a problem left open in 2013. (shrink)

Technological revolutions are among the most important things that happen to humanity. Ethical assessment in the incipient stages of a potential technological revolution faces several difficulties, including the unpredictability of their long‐term impacts, the problematic role of human agency in bringing them about, and the fact that technological revolutions rewrite not only the material conditions of our existence but also reshape culture and even – perhaps – human nature. This essay explores some of these difficulties and the challenges they pose (...) for a rational assessment of the ethical and policy issues associated with anticipated technological revolutions. (shrink)

Feminist philosophers of science have long discussed the importance of taking situatedness into account in scientific practices to avoid erasing important aspects of lived experience. Through the example of Gillian Einstein’s [2012] situated neuroscience, I will add support to Gallagher’s [2019] claims that intertheoretic reduction is problematic and provide reason to think pluralistic methodologies are explanatorily and ethically preferable.

This paper attempts to provide, through a reading of Derrida's Rogues, an account of the political phenomenon where regimes of sovereignty are resisted in the name of the very values — freedom, democracy and human rights, for example — they purport to stand for. To Derrida, sovereignty must simultaneously conform to a logic of both self-identity and of unconditionality. However, the unconditionality that makes sovereignty possible will always threaten and exceed it, something that other accounts like Agamben's try implicitly to (...) deny. In the end, for Derrida, our present political challenge is to recognize, and even affirm, the way the unconditionality of sovereignty is turned against itself. Sovereignty, then, is most effectively dealt with not by imagining a world in which it will no longer occur, nor by simple opposition, but by committing to the very logic of sovereignty itself. (shrink)

Cognitive enhancement takes many and diverse forms. Various methods of cognitive enhancement have implications for the near future. At the same time, these technologies raise a range of ethical issues. For example, they interact with notions of authenticity, the good life, and the role of medicine in our lives. Present and anticipated methods for cognitive enhancement also create challenges for public policy and regulation.

In a recent paper in this journal, Ken Olum attempts to refute the Doomsday argument by appealing to the self-indication assumption, the idea that your very existence gives you reason to think that there are many observers. In contrast to earlier refutation attempts that use this strategy, Olum confronts and try to counter some of the objections that have been made against SIA. We argue that his defense of SIA is unsuccessful. This does not, however, mean that one has to (...) accept the Doomsday argument. A developed theory of observation selection effects shows why the Doomsday argument is inconclusive and how one can consistently reject both it and SIA. (shrink)

A deductive system is said to be structurally complete if its admissible rules are derivable. In addition, it is called hereditarily structurally complete if all its extensions are structurally complete. Citkin (1978) proved that an intermediate logic is hereditarily structurally complete if and only if the variety of Heyting algebras associated with it omits five finite algebras. Despite its importance in the theory of admissible rules, a direct proof of Citkin’s theorem is not widely accessible. In this paper we offer (...) a self-contained proof of Citkin’s theorem, based on Esakia duality and the method of subframe formulas. As a corollary, we obtain a short proof of Citkin’s 2019 characterization of hereditarily structurally complete positive logics. (shrink)

In this paper we define the notion of frame based formulas. We show that the well-known examples of formulas arising from a finite frame, such as the Jankov-de Jongh formulas, subframe formulas and cofinal subframe formulas, are all particular cases of the frame based formulas. We give a criterion for an intermediate logic to be axiomatizable by frame based formulas and use this criterion to obtain a simple proof that every locally tabular intermediate logic is axiomatizable by Jankov-de Jongh formulas. (...) We also show that not every intermediate logic is axiomatizable by frame based formulas. (shrink)

No topic has caused more discussion in recent philosophy and political theory than sovereignty. From late Foucault to Agamben, and from Guantanamo Bay to the 'war on terror,' the issue of the extent and the nature of the sovereign has given theoretical debates their currency and urgency. New thinking on sovereignty has always imagined the styles of human selfhood that each regime involves. Each denomination of sovereignty requires a specific mode of subjectivity to explain its meaning and facilitate its operation. (...) The aim of this book is to help outline Jacques Derrida's thinking on sovereignty - a theme which increasingly attracted Derrida towards the end of his career - in its relationship to subjectivity. It investigates the late work Rogues: Two Essays on Reason, as not only Derrida's fullest statement of his thinking on sovereignty, but also as the destination of his career-long interest in questions of politics and self-identity. The book argues that in Derrida's thinking of the relationship between sovereignty and subjectivity - and the related themes of unconditionality and ipseity - we can detect the outline of Bataille's adaptation of Freud. Freud completed his 'metapsychology,' by defining the 'economic' nature of subjectivity. In Bataille's hands, this economic theory became a key to the nature of inter-relationship in general, specifically the complex and shifting relationship between subjectivity and power. In playing with Bataille's legacy, Derrida connects not only with the irrepressibly outrageous thinking of philosophy's most self-consciously transgressive thinker, but with the early twentieth century scientific revolution through which 'energy' became ontology. As with so many of the forebears who influenced him, Derrida echoes and adapts Bataille's thinking while radically de-literalising it. The results are crucial for understanding Derrida's views on power, subjectivity and representation, as well as all of the other key themes in late Derrida: hospitality, justice, otherness and the gift. (shrink)

(2009). “Twenty Paragraphs of Written Instructions”. Angelaki: Vol. 14, shadows of cruelty sadism, masochism and the philosophical muse – part one, pp. 59-68.

There are two boxes in front of you and you are asked to choose between taking only box B or taking both box A and box B. Box A contains $ 1,000. Box B will contain either nothing or $ 1,000,000. What B will contain is (or will be) determined by Predictor, who has an excellent track record of predicting your choices. There are two possibilities. Either Predictor has already made his move by predicting your choice and putting a million (...) dollars in B iff he predicted that you will take only B (like in the standard Newcomb problem); or else Predictor has not yet made his move but will wait and observe what box you choose and then put a million dollars in B iff you take only B. In cases like this, Predictor makes his move before the subject roughly half of the time. However, there is a Metapredictor, who has an excellent track record of predicting Predictor’s choices as well as your own. You know all this. Metapredictor informs you of the following truth functional: Either you choose A and B, and Predictor will make his move after you make your choice; or else you choose only B, and Predictor has already made his choice. Now, what do you choose? (shrink)

We show that every proper normal extension of the bi-modal system S5 2 has the poly-size model property. In fact, to every proper normal extension L of S5 2 corresponds a natural number b(L) - the bound of L. For every L, there exists a polynomial P(·) of degree b(L) + 1 such that every L-consistent formula is satisfiable on an L-frame whose universe is bounded by P(||), where || denotes the number of subformulas of . It is shown that (...) this bound is optimal. (shrink)

We establish the dichotomy property for stable canonical multi-conclusion rules for IPC, K4, and S4. This yields an alternative proof of existence of explicit bases of admissible rules for these logics.

Future of Humanity Institute, James Martin 21st Century School, University of Oxford, Littlegate House, 16/17 St Ebbe's Street, Oxford OX1 1PT, UK; www.nickbostrom.com..

This article explores several challenges African-American political thinkers pose to the continental tradition of European political philosophy as represented by two eminent theorists, Jacques Rancière and Axel Honneth. It focuses on the three sharpest points of disagreement between them—over the nature of the political subject and her motivations for becoming political; the need for normative grounds as a basis of political critique; the quality of political temporality—and shows how a range of African-American political thinkers have developed rigorous accounts of all (...) three of these matters. These accounts not only expose the limitations of Rancière's and Honneth's views but also provide a capacious theoretical framework able to hold their disagreements in productive tension with each other. (shrink)

This article seeks to identify, theoretically,some broad ethical issues about the type ofspace which the Internet is becoming, issueswhich are closely linked to developing newagendas for empirical research into Internetuse. It seeks to move away from the concept of''digital divide'' which has dominated debate inthis area while presuming a rather staticnotion of the space which the Internet is, orcould become. Instead, it draws on deliberativedemocracy theory in general and John Dryzek''sconcept of ''discursive design'' in particular toformulate six types of issue (...) (Convergence, WhoConverges?, Deliberation, Public Action,Relations to the State, and Long-term Patternsof Practice) around which both empiricalresearch and ethical debate can focus, andwhich taken together will help answer whetherthe Internet is, or can be, in part a''discursive design'' which contributes to theconditions of democratic public life. (shrink)

We give alternative characterizations of exact, extendible and projective formulas in intuitionistic propositional calculus IPC in terms of n-universal models. From these characterizations we derive a new syntactic description of all extendible formulas of IPC in two variables. For the formulas in two variables we also give an alternative proof of Ghilardi’s theorem that every extendible formula is projective.

1. How big is the smallest fish in the pond? You take your wide-meshed fishing net and catch one hundred fishes, every one of which is greater than six inches long. Does this evidence support the hypothesis that no fish in the pond is much less than six inches long? Not if your wide-meshed net can’t actually catch smaller fish...

Recently, two apparently quite different duality-based approaches to automata minimisation have appeared. One is based on ideas that originated from the controllability-observability duality from systems theory, and the other is based on ideas derived from Stone-type dualities specifically linking coalgebras with algebraic structures derived from modal logics. In the present paper, we develop a more abstract view and unify the two approaches. We show that dualities, or more generally dual adjunctions, between categories can be lifted to dual adjunctions between categories (...) of coalgebras and algebras, and from there to automata with initial as well as final states. As in the Stone-duality approach, algebras are essentially logics for reasoning about the automata. By exploiting the ability to pass between these categories, we show that one can minimize the corresponding automata. We give an abstract minimisation algorithm that has several instances, including the celebrated Brzozowski minimisation algorithm. We further develop three examples that have been treated in previous works: deterministic Kripke frames based on a Stone-type duality, weighted automata based on the self-duality of semimodules, and topological automata based on Gelfand duality. As a new example, we develop alternating automata based on the discrete duality between sets and complete atomic Boolean algebras. (shrink)

Contemporary work-related education and training policy represents occupational competence as the outcome of individual performance at work. This paper presents a critique of this neo-liberal assumption, arguing that in many cases competence should be regarded as an attribute of groups, teams and communities. It proposes a theory of collective competence in terms of (1) making collective sense of events in the workplace, (2) developing and using a collective knowledge base and (3) developing a sense of interdependency. It suggests that the (...) language of competence would become a more effective tool for understanding performance at work if the collectivistic sense of the term 'competence' were used in conjunction with the more established individualistic sense. (shrink)

This chapter develops the issue of external world skepticism in a stunning new direction, suggesting that virtual reality science fiction thought experiments depict science fact. The author has authored an influential argument that we are, in fact, in a computer simulation. He observes that assuming that a civilization survives long enough to be technologically sophisticated, it would likely be very interested in running simulations of entire worlds. The core of the simulation argument shows that we should accept as true at (...) least one of the following three propositions: the chances that a species at our current level of development can avoid going extinct before becoming technologically mature is negligibly small; almost no technologically mature civilisations are interested in running computer simulations of minds like ours; and a person is almost certainly in a simulation. (shrink)

Because of accelerating technological progress, humankind may be rapidly approaching a critical phase in its career. In addition to well-known threats such as nuclear holocaust, the prospects of radically transforming technologies like nanotech systems and machine intelligence present us with unprecedented opportunities and risks. Our future, and whether we will have a future at all, may well be determined by how we deal with these challenges. In the case of radically transforming technologies, a better understanding of the transition dynamics from (...) a human to a “posthuman” society is needed. Of particular importance is to know where the pitfalls are: the ways in which things could go terminally wrong. While we have had long exposure to various personal, local, and endurable global hazards, this paper analyzes a recently emerging category: that of existential risks. These are threats that could cause our extinction or destroy the potential of Earth-originating intelligent life. Some of these threats are relatively well known while others, including some of the gravest, have gone almost unrecognized. Existential risks have a cluster of features that make ordinary risk management ineffective. A final section of this paper discusses several ethical and policy implications. A clearer understanding of the threat picture will enable us to formulate better strategies. (shrink)

Human beings are a marvel of evolved complexity. When we try to enhance poorly-understood complex evolved systems, our interventions often fail or backfire. It can appear as if there is a “wisdom of nature” which we ignore at our peril. A recognition of this reality can manifest as a vaguely normative intuition, to the effect that it is “hubristic” to try to improve on nature, or that biomedical therapy is ok while enhancement is morally suspect. We suggest that one root (...) of these moral intuitions may be fundamentally prudential rather than ethical. More importantly, we develop a practical heuristic, the “evolutionary optimality challenge”, for evaluating the plausibility that specific candidate biomedical interventions would be safe and effective. This heuristic recognizes the grain of truth contained in “nature knows best” attitudes while providing criteria for identifying the special cases where it may be feasible, with present or near-future technology, to enhance human nature. (shrink)

This chapter analyzes the control problem, the unique principal‐agent problem that arises with the creation of an artificial superintelligent agent. It distinguishes two broad classes of potential methods for addressing this problem, capability control and motivation selection, and examines several specific techniques within each class. It also alludes to the esoteric possibility of “anthropic capture”. Capability control methods seek to prevent undesirable outcomes by limiting what the superintelligence can do. This might involve boxing methods or incentive methods, stunting method. In (...) addition, capability control methods might involve tripwires method. Motivation selection can involve explicitly formulating a goal or set of rules to be followed (direct specification) or setting up the system so that it can discover an appropriate set of values for itself by reference to some implicitly or indirectly formulated criterion (indirect normativity). (shrink)