Some time ago, I watched this fascinating episode of Numberphile about Godel Incompleteness Theorem: https://www.youtube.com/watch?v=O4ndIDcDSGc&t=4s In the video, Professor du Sautoy explains the theorem (with big simplifications) and he also mentions that if we could prove that the Riemann hypothesis is one of those propositions that can't be proved, then it means that the theorem is true, since if it was false we would have been able to find a contradiction. So we would be able to disprove it.
In the first Extra footage video https://www.youtube.com/watch?v=mccoBBf0VDM Professor du Sautoy mention that one of the conclusions from this theorem is that the proposition mathematics \ arithmetic is consistent is one of those propositions that we can't prove. I don't understand why that doesn't also imply that the statement holds, since if it wouldn't have hold we could have proved it by finding a contradiction.