Abstract
Studies investigating the relationship between artificial intelligence (AI) and science tend to adopt a partial view. There is no broad and holistic view that synthesizes the channels through which this interaction occurs. Our goal is to systematically map the influence of the latest AI techniques (machine learning, ML and its sub-category, deep learning, DL) on science. We draw on the work of Nathan Rosenberg to develop a taxonomy of the effects of technology on science. The proposed framework comprises four categories of technology effects on science: intellectual, economic, experimental and instrumental. The application of the framework in the relationship between ML/DL and science allowed the identification of multiple triggers activated by the new techniques in the scientific field. Visualizing these different channels of influence allows us to identify two pressing, emerging issues. The first is the concentration of experimental effects in a few companies, which indicates a reinforcement effect between more data on the phenomenon (experimental effects) and more capacity to commercialize the technique (economic effects). The second is the diffusion of new techniques lacking in explanation (intellectual effect) throughout the fabric of science (instrumental effects). The value of this article is twofold. First, it provides a simple framework to assess the relations between technology and science. Second, it provides this broad and holistic view of the influence of new AI techniques on science. More specifically, the article details the channels through which this relationship occurs, the nature of these channels and the loci in which the potential effects on science unfolds.
Similar content being viewed by others
Notes
Even though we agree with Flexner (1939) that curiosity is as much an essential driver of scientific inquiry as to the prospect of use.
Price probably wanted to allude to a technological innovation that escapes the dominant technological paradigm when he mentions unexpected technological innovation. He could not mobilize this concept because Giovanni Dosi (1984) would still spread it in the years to come.
“Base of observations” and “instrumentation” refer to the initial trigger that emerges in the technological sphere and that will influence science: new data from the body of empirical knowledge or new technological artifacts for instrumentation; on the other hand, “influencing the agenda” refers to the result, already in the scientific sphere, of changes that have taken place in the technological sphere. There is some confusion between cause and effect.
Also referred as an 'economy of research tools.' (Cockburn et al., 2018).
"Opening up the set of problems that can be feasibly addressed, and radically altering scientific and technical communities' conceptual approaches and framing of problems." (Cockburn et al., 2018).
According to Brooks (1994), “the more radical the invention, the more likely it is to stimulate wholly new areas of basic research or to rejuvenate older areas of research that were losing the interest of the most innovative scientists.”.
“The re-construction problem is serious, because even with complete information about the operations of a system, an ex-post analysis of a specific decision may not be able to establish a linear causal connection which is easily comprehensible for human minds.” (Wischmeyer, 2020, p. 81).
(TITLE-ABS-KEY("xAI" OR "XAI" OR "explainable artificial intelligence" OR "explainable AI" OR "explainable machine learning" OR "explainable deep learning" OR "explainable algorithms" OR "interpretable artificial intelligence" OR "interpretable AI" OR "interpretable machine learning" OR "interpretable deep learning" OR "interpretable algorithms" OR "opaque artificial intelligence" OR "opaque AI" OR "opaque machine learning" OR "opaque deep learning" OR "opaque algorithms" OR "responsible artificial intelligence" OR "responsible AI" OR "responsible machine learning" OR "responsible deep learning" OR "responsible algorithms" OR "transparent artificial intelligence" OR "transparent AI" OR "transparent machine learning" OR "transparent deep learning" OR "transparent algorithms") AND ( LIMIT-TO ( DOCTYPE,"cp") OR LIMIT-TO ( DOCTYPE,"ar") OR LIMIT-TO ( DOCTYPE,"re"))).
“People can’t explain how they work, for most of the things they do. When you hire somebody, the decision is based on all sorts of things you can quantify, and then all sorts of gut feelings. People have no idea how they do that. If you ask them to explain their decision, you are forcing them to make up a story. Neural nets have a similar problem […] You should regulate them based on how they perform” Geoffrey Hinton interview in (Simonite, 2018).
We understand AI science as Gazis (1979, p. 252) understands computer science/software science: “the search for knowledge, or the development of a methodology, that goes beyond satisfying the needs of a single application, but forms the basis for new applications."
According to Russell and Norvig (2020) “Shared benchmark problem sets became the norm for demonstrating progress, including the UC Irvine repository for machine learning data sets, the International Planning Competition for planning algorithms, the LibriSpeech corpus for speech recognition, the MNIST data set for handwritten digit recognition, ImageNet and COCO for image object recognition, SQUAD for natural language question answering, the WMT competition for machine translation, and the International SAT Competitions for Boolean satisfiability solvers.”
“Deep learning relies heavily on powerful hardware. Whereas a standard computer CPU can do 109 or 1010 operations per second. a deep learning algorithm running on specialized hardware (e.g., GPU, TPU, or FPGA) might consume between 1014 and 1017 operations per second, mostly in the form of a highly parallelized matrix and vector operations.” (Russell & Norvig, 2020).
“Von Neumann architecture is seen by its critics as a major obstacle to good programming in general. In one area, however, the shortcomings of the conventional approach have a particular importance. This is the area of artificial intelligence.” (Peláez, 1990, p. 68).
The development of NetWare (hardware for neural networks) was high on the agenda in the 1980s (van Raan & Tijssen, 1993). However, as already mentioned, all things related to neural networks were marginalized and would only return to the spotlight after AlexNet’s breakthrough in 2012.
Intel researchers have released Loihi, the company's fifth generation of chips inspired by neuromorphic technologies (Davies et al., 2018).
See Google’s Cloud TPU: https://cloud.google.com/tpu?hl=pt-br
References
Ahmed N, Wahed M (2020) The de-democratization of AI: deep learning and the compute divide in artificial intelligence research
Albuquerque E (2017) Nathan Rosenberg: historiador das revoluções tecnológicas e de suas inquietações econômicas. Revista Brasileira De Inovação 16(1):9–34
Anderson J, Baltes J, Cheng CT (2011) Robotics competitions as benchmarks for AI research. Knowl Eng Rev 26(1):11–17. https://doi.org/10.1017/S0269888910000354
Bianchini S, Moritz M, Pelletier P (2020) Deep learning in science
Brooks H (1994) The relationship between science and technology. Res Policy 23:477–486
Burrell J (2016) How the machine ‘thinks’: understanding opacity in machine learning algorithms. Big Data Soc 3(1):1–12. https://doi.org/10.1177/2053951715622512
Carabantes M (2020) Black-box artificial intelligence: an epistemological and critical analysis. AI Soc 35(2):309–317. https://doi.org/10.1007/s00146-019-00888-w
Carnot S, Thomson S (1897) Reflections on the motive power of heat. Accompanied by an account of Carnot’s theory. Chapman and Hall, London
Chen Y, Li H, Wu C, Song C, Li S, Min C, Cheng HP, Wen W, Liu X (2018) Neuromorphic computing’s yesterday, today, and tomorrow—an evolutional view. Integration 61(2017):49–61. https://doi.org/10.1016/j.vlsi.2017.11.001
Chubb J, Cowling P, Reed D (2021) Speeding up to keep up: exploring the use of AI in the research process. AI Soc. https://doi.org/10.1007/s00146-021-01259-0
Coccia M (2020) Deep learning technology for improving cancer care in society: new directions in cancer imaging driven by artificial intelligence. Technol Soc 60(July 2019):101198. https://doi.org/10.1016/j.techsoc.2019.101198
Cockburn IM, Henderson R, Stern S (2018) The Impact of Artificial Intelligence on Innovation (NBER Working Paper No. 24449). http://www.nber.org/papers/w24449.ack
Davies M, Srinivasa N, Lin TH, Chinya G, Cao Y, Choday SH, Dimou G, Joshi P, Imam N, Jain S, Liao Y, Lin CK, Lines A, Liu R, Mathaikutty D, McCoy S, Paul A, Tse J, Venkataramanan G et al (2018) Loihi: a neuromorphic manycore processor with on-chip learning. IEEE Micro 38(1):82–99. https://doi.org/10.1109/MM.2018.112130359
de Laat PB (2018) Algorithmic decision-making based on machine learning from big data: can transparency restore accountability? Philos Technol 31(4):525–541. https://doi.org/10.1007/s13347-017-0293-z
Dhar P (2020). AlphaFold proves that ai can crack fundamental scientific problems. IEEE Spectr
Dosi G (1984) Technical change and industrial transformation—the theory and an application to the semiconductor industry. MacMillan
Engström E, Strimling P (2020) Deep learning diffusion by infusion into preexisting technologies—implications for users and society at large. Technol Soc. https://doi.org/10.1016/j.techsoc.2020.101396
Ernst D (2020) Competing in artificial intelligence chips: China’s challenge amid technology war. March, pp 1–60
Finlayson SG, Bowers JD, Ito J, Zittrain JL, Beam AL, Kohane IS (2019) Adversarial attacks on medical machine learning. Science 363(6433):1287–1289. https://doi.org/10.1126/science.aaw4399
Fleck L (n.d.). Genesis and development of a scientific fact. The University of Chicago
Flexner A (1939) The usefulness of useless knowledge. Harpers. https://doi.org/10.18601/01245996.v22n42.03
Gazis DC (1979) Influence of technology on science: a comment on some experiences at IBM research. Res Policy 8(3):244–259. https://doi.org/10.1016/0048-7333(79)90036-2
Gershgorn D (2017) The data that transformed AI research—and possibly the world. Quartz
Gill KS (2020) Prediction paradigm: the human price of instrumentalism. AI Soc 35(3):509–517. https://doi.org/10.1007/s00146-020-01035-6
Goodfellow IJ, Erhan D, Luc Carrier P, Courville A, Mirza M, Hamner B, Cukierski W, Tang Y, Thaler D, Lee DH, Zhou Y, Ramaiah C, Feng F, Li R, Wang X, Athanasakis D, Shawe-Taylor J, Milakov M, Park J et al (2015) Challenges in representation learning: a report on three machine learning contests. Neural Netw 64:59–63. https://doi.org/10.1016/j.neunet.2014.09.005
Hagendorff T, Wezel K (2020) 15 challenges for AI: or what AI (currently) can’t do. AI Soc 35(2):355–365. https://doi.org/10.1007/s00146-019-00886-y
Hager G, Bryant R, Horvitz E, Mataric M (2017) Advances in artificial intelligence require progress across all of computer science (Issue February, pp. 1–7)
Hodgson GM (2019) Taxonomic definitions in social science, with firms, markets and institutions as case studies. J Inst Econ 15(2):207–233. https://doi.org/10.1017/S1744137418000334
Innerarity D (2021) Making the black box society transparent. AI Soc 36(3):975–981. https://doi.org/10.1007/s00146-020-01130-8
Jumper J et al (2021) Highly accurate protein structure prediction with AlphaFold. Nature. https://doi.org/10.1038/s41586-021-03819-2
Kim ES (2020) Deep learning and principal–agent problems of algorithmic governance: the new materialism perspective. Technol Soc 63(December 2019):101378. https://doi.org/10.1016/j.techsoc.2020.101378
Kline SJ, Rosenberg N (1986) An overview of innovation. Eur J Innov Manag 38:275–305. https://doi.org/10.1108/14601069810368485
Kraus JL (2020) Can artificial intelligency revolutionize drug discovery? AI Soc 35(2):501–504. https://doi.org/10.1007/s00146-019-00892-0
Kulkov I (2021) The role of artificial intelligence in business transformation: a case of pharmaceutical companies. Technol Soc 66(August 2020):101629. https://doi.org/10.1016/j.techsoc.2021.101629
Kuwajima H, Yasuoka H, Nakae T (2020) Engineering problems in machine learning systems. Mach Learn 109(5):1103–1126. https://doi.org/10.1007/s10994-020-05872-w
Lecun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444. https://doi.org/10.1038/nature14539
Lee K-F (2018) AI superpowers: China, Silicon Valley, and the new world order. Houghton Mifflin Harcourt, Boston
Mokyr J (2018) The past and the future of innovation: Some lessons from economic history. Explor Econ Hist 69(March):13–26. https://doi.org/10.1016/j.eeh.2018.03.003
Mowery DC, Rosenberg N (1998) Paths of innovation: technological change in 20th century america. Cambridge University Press
Mowery DC, Nelson RR, Steinmueller WE (1994) Introduction. In honour of Nathan Rosenberg. Res Policy 23:iii–v
Mowery D, Malerba F, Dosi G, Teece D (2019) Introduction: Nathan rosenberg as a founding father of the economics of innovation. Ind Corp Chang 28(2):283–288. https://doi.org/10.1093/icc/dtz012
Orlikowski W (2007) Sociomaterial practices: exploring technology at work. Organ Stud 28(9):1435–1448. https://doi.org/10.1177/0170840607081138
Pasquinelli M, Joler V (2020) The Nooscope manifested: AI as instrument of knowledge extractivism. AI Soc. https://doi.org/10.1007/s00146-020-01097-6
Peláez E (1990) Parallelism and the crisis of von Neumann computing. Technol Soc 12(1):65–77. https://doi.org/10.1016/0160-791X(90)90029-C
Pinch T, Bijker W (1984) The social construction of facts and artefacts: or how the sociology of science and the sociology of technology might benefit each Other. Soc Stud Sci 14(3):399–441
Price D (1984) The science/technology relationship, the craft of experimental science, and policy for the improvement of high technology innovation. Res Policy 13(1):3–20. https://doi.org/10.1016/0048-7333(84)90003-9
Richter F (2021) Amazon leads $150-billion cloud market. Statista.
Rikap C, Lundvall B-Å (2020) Big tech, knowledge predation and the implications for development. Innov Dev. https://doi.org/10.1080/2157930x.2020.1855825
Robbins S (2020) AI and the path to envelopment: knowledge as a first step towards the responsible regulation and use of AI-powered machines. AI Soc 35(2):391–400. https://doi.org/10.1007/s00146-019-00891-1
Rosenberg N (1976) Perspectives on technology. Cambridge University Press
Rosenberg N (1982) Inside the black box: technology and economics. Cambridge University Press
Rosenberg N (1991) Critical issues in science policy research. Sci Public Policy 18(6):335–346. https://doi.org/10.1093/spp/18.6.335
Rosenberg N (1992) Scientific instrumentation and university research. Res Policy 21(4):381–390. https://doi.org/10.1016/0048-7333(92)90035-3
Rosenberg N (1996) Science, technology and society. Rivista Internazionale Di Scienze Sociali 4(4):479–496
Rosenberg N, Trajtenberg M (2004) A general-purpose technology at work: the Corliss steam engine in the late-nineteenth-century United States. J Econ Hist 64(1):61–99
Rosenberg N, Steinmueller WE (2013) Engineering knowledge. Ind Corp Chang 22(5):1129–1158. https://doi.org/10.1093/icc/dts053
Russell S, Norvig P (2020) Artificial intelligence: a modern approach (Fourth). Pearson, London
Savage N (2020) The race to the top among the world’s leaders in artificial intelligence. Nature 588:S102–S104. https://doi.org/10.1038/d41586-020-03409-8
Schmidhuber J (2015) Deep learning in neural networks : an overview. Neural Netw 61:85–117. https://doi.org/10.1016/j.neunet.2014.09.003
Sculley D, Holt G, Golovin D, Davydov E, Phillips T, Ebner D, Chaudhary V, Young M, Crespo JF, Dennison D (2015) Hidden technical debt in machine learning systems. Adv Neural Inf Process Syst 2015(January):2503–2511
Simonite T (2018) Google’s AI guru wants computers to think more like brains. Wired
Stephan P (2010) The Economics of Science. In: Hall B, Rosenberg N (eds) Handbook of the economics of innovation (volume 1). Elsevier, pp 217–273
van Raan AFJ, Tijssen RJW (1993) The neural net of neural network research—an exercise in bibliometric mapping. Scientometrics 26(1):169–192. https://doi.org/10.1007/BF02016799
Vasilescu DC, Filzmoser M (2021) Machine invention systems: a (r)evolution of the invention process? AI Soc 36(3):829–837. https://doi.org/10.1007/s00146-020-01080-1
Venkatasubramanian V (2019) The promise of artificial intelligence in chemical engineering: is it here, finally? AIChE J 65(2):466–478. https://doi.org/10.1002/aic.16489
Viles H (2016) Technology and geomorphology: are improvements in data collection techniques transforming geomorphic science? Geomorphology 270:121–133. https://doi.org/10.1016/j.geomorph.2016.07.011
WIPO (2019) WIPO technology trends 2019: artificial intelligence. World Intellectual Property Organization, Geneva
Wischmeyer T (2020) Regulating artificial intelligence. Regul Artif Intell. https://doi.org/10.1007/978-3-030-32361-5
Yu Z, Liang Z, Wu P (2021) How data shape actor relations in artificial intelligence innovation systems: an empirical observation from China. Ind Corp Chang. https://doi.org/10.1093/icc/dtaa063
Yuan S, Shao Z, Wei X, Tang J, Hall W, Wang Y, Wang Y, Wang Y (2020) Science behind AI: the evolution of trend, mobility, and collaboration. Scientometrics 124(2):993–1013. https://doi.org/10.1007/s11192-020-03423-7
Zittrain J (2019) The hidden costs of automated thinking. The New Yorker
Acknowledgements
Preliminary versions of this article were presented at the 2021 SPRU PhD Forum and the XVIII International Schumpeter Society Conference. The authors are grateful for the excellent comments, criticisms and suggestions that were made on these occasions, especially from Professor Paul Nightingale (SPRU - University of Sussex), Dr. Simone Vannuccini (SPRU - University of Sussex) and Stephano Bianchini (BETA - Université de Strasbourg, France). We are also grateful for the careful reading of the document by Professor Altair Oliveira (Federal Institute of São Paulo) and Professor Koen Frenken (Copernicus Institute of Sustainable Development - Utrecht University). Any possible inaccuracies that may have persisted in the article are the sole responsibility of the authors.
Funding
The authors have no relevant non-financial interests to disclose. This article was funded by Coordenação de Aperfeiçoamento de Pessoal de Nível Superior, 88882.329792/2019-01, Victo Silva.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix 1
Appendix 1
The corpus consists of 32 documents distributed over 50 years of the author's scientific production (1963–2013). The criterion for defining the corpus was to include the principal works by Rosenberg (Albuquerque 2017; Mowery et al. 1994). In addition to these works, we included documents (preferring, when possible, peer-reviewed articles) dealing with the relationship between SandT, seeking to balance works from different phases of the author's scientific production. Our fundamental unit of analysis is the historical examples regarding the influence of technology on science, regardless of the nature of this influence at first. We consider as a codifiable unit of analysis specific historical examples that mention any effect of technology on science. An example is "the agricultural experiment stations conducted research aimed at improving the productivity of all types of agriculture enterprise and attempting to solve problems of plant and animal disease” (Rosenberg and Steinmueller 2013). Generic mentions of these same effects are not considered units of analysis; therefore, they were not codified. An example of generic mention is “The problems encountered by sophisticated industrial technologies and the anomalous observations or unexpected difficulties they produced as powerful stimuli to scientific research in the academic community” (Mowery and Rosenberg 1998). A unit of analysis can receive more than one code; however, we sought to minimize this multiple encoding. We searched and mapped units of analysis in the corpus until reaching a point of apparent saturation. Table
4 sums up the encoding results.
Starting from the initial analysis (Rosenberg 1982) and following terminological guidelines (Hodgson 2019), whenever possible we adopted the terms and definitions already proposed by Rosenberg. We propose new categories and sub-categories when we find units (historical cases) that do not fit into any sufficiently defined ex-ante category; one that stands out is the intellectual effect, absent from the corpus in the meaning we adopt here.
Rights and permissions
About this article
Cite this article
Silva, V.J., Bonacelli, M.B.M. & Pacheco, C.A. Framing the effects of machine learning on science. AI & Soc 39, 749–765 (2024). https://doi.org/10.1007/s00146-022-01515-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00146-022-01515-x