take something like the holocaust. we know it happened but do we have absolute knowledge of every aspect of it? No, because that would be impossible. Instead we have the accounts of thousands of individuals that we filter to get to a reasonable approximation of what happened.
This is what we are accepting as fact and there is nothing wrong with it because its the best that can be done. Contemporary total informational awareness efforts notwithstanding.