You don't observe the past directly, even when you think about the creation account. We can't observe God creating, we can't observe Adam and Eve: we admit that. We're willing to admit our beliefs about the past. But see, what you observe in the present is very different. Even some public school textbooks sort of acknowledge the difference between historical and observational science.