In this paper we discuss visualizations in mathematics from a historical and didactical perspective. We consider historical debates from the 17th and 19th centuries regarding the role of intuition and visualizations in mathematics. We also consider the problem of what a visualization in mathematical learning can achieve. In an empirical study we investigate what mathematical conclusions university students made on the basis of a visualization. We emphasize that a visualization in mathematics should always be considered in its proper context.