I’ve heard as much but personally haven’t found the variation to be that large personally, things usually sound about how I remember them, and how I want. Which I’m pretty thankful for. My ears aren’t really that great though so that probably plays a part, as well as the poor audio memory of humans— maybe it does happen, but I more or less remember it always sounding like this, so I never notice. I have tried to be conscious of this but it’s never worked.
My purchase methodology works around this anyway, though inadvertently. I tend to A/B over multiple days. Much harder if you’re not near any audio stores though