That's typically the argument regarding being apprehensive about the government knowing your medical & family history; there's historical precedent of governments making very not good laws based on those.
Before WW2, the nazis basically outlawed being Jewish or Roma. A more recent example would be outlawing being gay or trans in some countries
I do agree with you on that. I think it's worth considering but it's not inherently decisive