I mean, he's not wrong. 90% of the time I hear someone wax poetic about how amazing math is, they haven't the faintest clue what they're talking about.
Scientists and mathematicians appreciate the beauty of the universe, too, but it's more in the "we are tiny bits of matter trying to understand the vastness of the cosmos" sense (at least in my experience as a chemist who loves talking about this shit with my microbiologist and mathematician friends)