But on the other hand, all of that stuff could be insured against.
Thats exactly what PMI (Private mortgage insurance) covers. However if the insurance company doesn't think you're a good risk, then you might not be able to get that either. I have never looked at what criteria they use to grant or deny PMI. I've also never known anyone personally denied PMI.
Canada passed this law in 2022 addressing that:
Underused Housing Tax