Information may be beautiful, but our decisions about the data we choose to represent and how we represent it are never neutral. This insightful history traces how data visualization accompanied modern technologies of war, colonialism and the management of social issues of poverty, health and crime. The discussion is based around examples of visualization, from the ancient Andean information technology of the quipu to contemporary projects that show the fate of our rubbish and take a participatory approach to visualizing cities. This analysis places visualization in its theoretical and cultural contexts, and provides a critical framework for understanding the history of information design with new directions for contemporary practice.