The question of how the senses relate to ideas of space goes back at least to the beginnings of Western thought. A brief dip into its history traces the ideas that have left an imprint and how they changed with new approaches and evidence. It may also serve as a reminder of how the meanings of words that have come into psychology from ordinary language become extended with new technologies that provide useful, fresh, but sometimes confusing, analogies. The chapter is intended as an overview of the changes in how the question has been viewed over time, and why it continues to be an important issue in current cognitive neuroscience.