Okay, I got it. I'm using BitWarden and I was putting in the exact secret key into the OTP field, not the full URI. After doing the full URI, it works. Hope this helps anyone else.
I didn't know I could do that until checking the BitWarden page: https://bitwarden.com/help/authenticator-keys/