Exploratory statistics represents the transformation of a realist theory of statistics held by early nineteenth-century astronomers into an empiricist theory of statistics held by biometricians at the turn of the twentieth century. This paper discusses four key ideas in empiricist thought that influenced the form exploratory statistics took: (1) Baconianism, (2) associationism, (3) the search for cognitive calculi, and (4) phenomenalism. Some limitations of and alternatives to exploratory statistics as a hypothesis-generating methodology are discussed.