Some philosophers have criticized experimental philosophy for being superfluous. Jackson implies that experimental philosophy studies are unnecessary. More recently, Dunaway, Edmunds, and Manley empirically demonstrate that experimental studies do not deliver surprising results, which is a pro tanto reason for foregoing conducting such studies. This paper gives theoretical and empirical considerations against the superfluity criticism. The questions concerning the surprisingness of experimental philosophy studies have not been properly disambiguated, and their metaphilosophical significance have not been properly assessed. Once the most relevant question is identified, a re-analysis of Dunaway and colleagues’ data actually undermines the superfluity criticism.