Skip to content
Licensed Unlicensed Requires Authentication Published by De Gruyter March 14, 2022

Unexpected Uncertainty in Adaptive Learning

A Wittgensteinian Study Case

  • Adrian Razvan Sandru EMAIL logo
From the journal Wittgenstein-Studien

Abstract

Wittgenstein talks in his Philosophical Investigations of a pupil engaging in a repetitive series continuation who suddenly begins to apply a different rule than the one instructed to him. This hypothetical example has been interpreted by a number of philosophers to indicate either a skeptical attitude towards rules and their application (Kripke 1982; Wright 1980), an implicit need of knowledge and understanding of a rule accessible to those engaged in a given practice (McDowell 2002), or a certain normativity that guides our actions but is not cognitive, but processual in nature (Ginsborg 2020). I wish to support and extend Ginsborg’s account of primitive normativity from a novel perspective in a twofold manner: 1) by describing the mechanism of primitive normativity via Kant’s concept of aesthetical and epistemic pleasure and displeasure; 2) by applying the conceptual pair of expected and unexpected uncertainty from adaptive learning theories, which describe the fluctuation of learning rates under uncertain circumstances.[1]

Bibliography

Bari, Andrea & David Theobald, Daniele Caprioli, Adam Mar, Alex Aidoo-Micah, Jeffrey Dalley, Trevor Robbins: Serotonin modulates sensitivity to reward and negative feedback in a probabilistic reversal learning task in rats, in: Neuropsychopharmacology 35 (2010), 1290 – 1301.10.1038/npp.2009.233Search in Google Scholar

Bertsekas, Dimitri & John Tsitsiklis, John: Neuro-dynamic programming, Belmont, MA 1996.Search in Google Scholar

Boulougouris, Vasileios & Trevor Robbins: Enhancement of spatial reversal learning by 5-HT2C receptor antagonism is neuroanatomically specific, in: J Neurosci 30 (2010), 930 – 938.10.1523/JNEUROSCI.4312-09.2010Search in Google Scholar

Brigman, Jonathan & Poonam Mathur, Judith Harvey-White, Alicia Izquierdo, Lisa Saksida, Timothy Bussey, Stephanie Fox, Evan Deneris, Dennis Murphy, Andrew Holmes: Pharmacological or genetic inactivation of the serotonin transporter improves reversal learning in mice, in: Cereb Cortex 20 (2010), 1955 – 1963.10.1093/cercor/bhp266Search in Google Scholar

Clarke, Hannah & Jeffrey Dalley, Harriet Crofts, Trevor Robbins, Angela Roberts: Cognitive inflexibility after prefrontal serotonin depletion, in: Science 304 (2004), 878 – 880.10.1126/science.1094987Search in Google Scholar

Diederen, Kelly & Wolfram Schultz: Scaling prediction errors to reward variability benefits error- driven learning in humans, in: J. Neurophysiol 114 (2015), 1628 – 1640.10.1152/jn.00483.2015Search in Google Scholar

Faraji, Mohammadjavad & Kerstin Preuschoff, Wulfram Gerstner: Balancing new against old information: the role of puzzlement surprise in learning, in: Neural Comput 30 (2018), 34 – 83.10.1162/neco_a_01025Search in Google Scholar

Ginsborg, Hannah: Thinking the Particular as Contained under the Universal, in: Rebecca Kukla (Ed.), Aesthetics and Cognition in Kant's Critical Philosophy, Cambridge 2006, 35 – 60.10.1017/CBO9780511498220.002Search in Google Scholar

Ginsborg, Hannah: Wittgenstein on Going On, in: Canadian Journal of Philosophy 50 (2020), 1 – 17.10.1017/can.2019.48Search in Google Scholar

Gomez-Marin, Alex & Juan Arnau: When the Part Mirrors the Whole: Interactions Beyond “Simple Location”. Frontiers in Psychology, 11 (2021).10.3389/fpsyg.2020.523885Search in Google Scholar

Grossman, Cooper & Andrea Bari, Jeremiah Cohen: Serotonin neurons modulate learning rate through uncertainty, in: Biorxiv 2020 preprint.10.1101/2020.10.24.353508Search in Google Scholar

Kant, Immanuel: Kants Werke. Akademie-Textausgabe (AA). Studienausg., Nachdr. der Ausg. 1968; Unveränd. photomechan. Abdr. des Textes der von der Preußischen Akad. der Wiss. 1902 begonnenen Ausg. von Kants gesammelten Schriften, Berlin 2003.Search in Google Scholar

 

[Anthr.]

Anthropologie in pragmatischer Hinsicht

AA 4

 

[EE]

Erste Einleitung in die Kritik der Urteilskraft

AA 20

 

[KrV]

Kritik der reinen Vernunft

AA 3/4

 

[KU]

Kritik der Urteilskraft

AA 5

 

[Logik]

Logik

AA 9

 

[MAdN]

Metaphysische Anfangsgründe der Naturwissenschaft

AA 4

Kripke, Saul: Wittgenstein on Rules and Private Language’, Cambridge, MA 1982.Search in Google Scholar

Ligaya, Kiyohito & Madalena Fonseca, Masayoshi Murakami, Zachary Mainen, Peter Dayan: An effect of serotonergic stimulation on learning rates for rewards apparent after long intertrial intervals, in: Nat Commun 9 (2018), 2477.10.1038/s41467-018-04840-2Search in Google Scholar

Longuenesse, Beatrice: Kant and the capacity to judge: Sensibility and discursivity in the transcendental analytic of the Critique of pure reason, Princeton, NJ 2000.Search in Google Scholar

Matias, Sara & Eran Lottem, Guillaume Dugue, Zachary Mainen: Activity patterns of serotonin neurons underlying cognitive flexibility, in: eLife 6 (2017).10.7554/eLife.20552Search in Google Scholar

McDowell, John Henry: Mind, value, and reality, Cambridge, MA 2002.Search in Google Scholar

McGinn, Marie: Wittgenstein and the Philosophical Investigations, Abingdon, Oxon 2002.Search in Google Scholar

O’Reilly, Jill: Making predictions in a changing world inference, uncertainty, and learning, in: Front. Neurosci. 7 (2013), 105.10.3389/fnins.2013.00105Search in Google Scholar

Payzan-LeNestour, Elise & Peter Bossaerts: Risk, unexpected uncertainty, and estimation uncertainty: Bayesian learning in unstable settings, in: PLOS Comput. Biol. 7 (2011), e1001048.10.1371/journal.pcbi.1001048Search in Google Scholar

Payzan-LeNestour, Elise & Simon Dunne, Peter Bossaerts, John O’Dohert: The neural representation of unexpected uncertainty during value-based decision making, in: Neuron 79 (2013), 191 – 201.10.1016/j.neuron.2013.04.037Search in Google Scholar

Preuschoff, Kerstin & Peter Bossaerts: Adding prediction risk to the theory of reward learning, in: Ann. NY Acad. Sci. 1104 (2007), 135 – 146.10.1196/annals.1390.005Search in Google Scholar

Soltani, Alireza & Alicia Izquierdo: Adaptive learning under expected and unexpected uncertainty, in: Nature Reviews Neuroscience, 20.10 (2019), 635 – 644.10.1038/s41583-019-0180-ySearch in Google Scholar

Sutton, Richard & Andrew Barto: Reinforcement learning: an introduction. Cambridge, MA 1998.10.1109/TNN.1998.712192Search in Google Scholar

Wright, Crispin: Wittgenstein on the Foundations of Mathematics, London 1980.Search in Google Scholar

Yu, Angela & Peter Dayan: Uncertainty, neuromodulation, and attention, in: Neuron 46 (2005), 681 – 692.10.1016/j.neuron.2005.04.026Search in Google Scholar

Zuckert, Rachel: Kant on Beauty and Biology: an Interpretation of the “Critique of Judgment”, Cambridge 2007.10.1017/CBO9780511487323Search in Google Scholar

Published Online: 2022-03-14
Published in Print: 2022-03-14

© 2022 Walter de Gruyter GmbH, Berlin/Boston

Downloaded on 25.4.2024 from https://www.degruyter.com/document/doi/10.1515/witt-2022-0010/html
Scroll to top button