Simple Threshold Rules Solve Explore/Exploit Trade‐offs in a Resource Accumulation Search Task

Cognitive Science 44 (2):e12817 (2020)
  Copy   BIBTEX


How, and how well, do people switch between exploration and exploitation to search for and accumulate resources? We study the decision processes underlying such exploration/exploitation trade‐offs using a novel card selection task that captures the common situation of searching among multiple resources (e.g., jobs) that can be exploited without depleting. With experience, participants learn to switch appropriately between exploration and exploitation and approach optimal performance. We model participants' behavior on this task with random, threshold, and sampling strategies, and find that a linear decreasing threshold rule best fits participants' results. Further evidence that participants use decreasing threshold‐based strategies comes from reaction time differences between exploration and exploitation; however, participants themselves report non‐decreasing thresholds. Decreasing threshold strategies that “front‐load” exploration and switch quickly to exploitation are particularly effective in resource accumulation tasks, in contrast to optimal stopping problems like the Secretary Problem requiring longer exploration.



    Upload a copy of this work     Papers currently archived: 92,261

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Semantic Search in the Remote Associates Test.Eddy J. Davelaar - 2015 - Topics in Cognitive Science 7 (3):494-512.
A Solution to Knowledge’s Threshold Problem.Michael Hannon - 2017 - Philosophical Studies 174 (3):607-629.
Optimal Publishing Strategies.Kevin J. S. Zollman - 2009 - Episteme 6 (2):185-199.


Added to PP

13 (#1,041,239)

6 months
9 (#317,143)

Historical graph of downloads
How can I increase my downloads?