In Fabio Bonsignorio, John Hallam, Elena Messina & Angel P. Del Pobil (eds.), Metrics of sensory motor coordination and integration in robots and animals. Berlin: Springer. pp. 169-179 (2019)
Authors |
|
Abstract |
While it is often said that robotics should aspire to reproducible and measurable results that allow benchmarking, I argue that a focus on benchmarking can be a hindrance for progress in robotics. The reason is what I call the ‘measure-target confusion’, the confusion between a measure of progress and the target of progress. Progress on a benchmark (the measure) is not identical to scientific or technological progress (the target). In the past, several academic disciplines have been led into pursuing only reproducible and measurable ‘scientific’ results – robotics should be careful to follow that line because results that can be benchmarked must be specific and context-dependent, but robotics targets whole complex systems for a broad variety of contexts. While it is extremely valuable to improve benchmarks to reduce the distance be- tween measure and target, the general problem to measure progress towards more intelligent machines (the target) will not be solved by benchmarks alone; we need a balanced approach with sophisticated benchmarks, plus real-life testing, plus qualitative judgment.
|
Keywords | artificial intelligence benchmark Campbell's law intelligence test measure-target confusion robotics science |
Categories |
No categories specified (categorize this paper) |
Buy the book |
Find it on Amazon.com
|
Options |
![]() ![]() ![]() ![]() |
Download options
References found in this work BETA
Future Progress in Artificial Intelligence: A Survey of Expert Opinion.Vincent C. Müller & Nick Bostrom - 2016 - In Vincent Müller (ed.), Fundamental Issues of Artificial Intelligence. Springer. pp. 553-571.
Autonomous Cognitive Systems in Real-World Environments: Less Control, More Flexibility and Better Interaction.Vincent C. Müller - 2012 - Cognitive Computation 4 (3):212-215.
View all 6 references / Add more references
Citations of this work BETA
No citations found.
Similar books and articles
Art and Robotics: Sixty Years of Situated Machines. [REVIEW]Simon Penny - 2013 - AI and Society 28 (2):147-156.
Transparent, Explainable, and Accountable AI for Robotics.Sandra Wachter, Brent Mittelstadt & Luciano Floridi - 2017 - Science (Robotics) 2 (6):eaan6080.
Martial Bliss: War and Peace in Popular Science Robotics. [REVIEW]Robert M. Geraci - 2011 - Philosophy and Technology 24 (3):339-354.
The Construction of 'Reality' in the Robot: Constructivist Perspectives on Situated Artificial Intelligence and Adaptive Robotics. [REVIEW]Tom Ziemke - 2001 - Foundations of Science 6 (1-3):163-233.
Sensitivity of Different Measures of the Visibility of Masked Primes: Influences of Prime–Response and Prime–Target Relations.Shah Khalid, Peter König & Ulrich Ansorge - 2011 - Consciousness and Cognition 20 (4):1473-1488.
From Responsible Robotics Towards a Human Rights Regime Oriented to the Challenges of Robotics and Artificial Intelligence.Hin-Yan Liu & Karolina Zawieska - 2020 - Ethics and Information Technology 22 (4):321-333.
The HeartMath Coherence Model: Implications and Challenges for Artificial Intelligence and Robotics.Stephen D. Edwards - 2019 - AI and Society 34 (4):899-905.
AI Armageddon and the Three Laws of Robotics.Lee McCauley - 2007 - Ethics and Information Technology 9 (2):153-164.
Sustainability of Artificial Intelligence: Reconciling Human Rights with Legal Rights of Robots.Ammar Younas & Rehan Younas - forthcoming - In Zhyldyzbek Zhakshylykov & Aizhan Baibolot (eds.), Quality Time 18. Bishkek: International Alatoo University Kyrgyzstan. pp. 25-28.
Mental Robotics.Domenico Parisi - 2007 - In Antonio Chella & Riccardo Manzotti (eds.), Artificial Consciousness. Imprint Academic. pp. 191-211.
Applying the Benchmarking Procedure: A Decision Criterion of Choice Under Risk. [REVIEW]Francesca Beccacece & Alessandra Cillo - 2006 - Theory and Decision 61 (1):75-91.
Representation of Unattended Material in Memory.Yaakov Hoffman & Joseph Tzelgov - 2012 - Consciousness and Cognition 21 (3):1504-1508.
Institutional Robotics.Porfirio Silva & Pedro U. Lima - 2007 - In F. Almeida e Costa et al (ed.), Advances in Artificial Life. ECAL 2007. Springer Verlag.
Building Simple Mechanical Minds: Using Lego Robots for Research and Teaching in Philosophy.John P. Sullins - 2002 - In James Moor & Terrell Ward Bynum (eds.), Metaphilosophy. Blackwell. pp. 110-122.
Analytics
Added to PP index
2018-06-09
Total views
331 ( #30,783 of 2,498,320 )
Recent downloads (6 months)
22 ( #39,112 of 2,498,320 )
2018-06-09
Total views
331 ( #30,783 of 2,498,320 )
Recent downloads (6 months)
22 ( #39,112 of 2,498,320 )
How can I increase my downloads?
Downloads