Let's hope MLS solves some of this, but there is a certain amount of necessary complexity with syncing encryption keys for groups as people come and go.
I'm very annoyed by issues decrypting messages in private conversations. Nothing is changing, so it should just work after the first message, but no. Random messages can't be decrypted unless I refresh. Very frustrating.