How Do We Know What the Milky Way Really Looks Like?