Oh, lots of physicists think the same way! Even Einstein did, nearly a century ago he said "God does not play dice with the universe", because the popular Copenhagen Interpretation posits that the stochastic quantum wavefunctions are reality, that there is nothing more. Both Pilot Wave Theory and the insane Many Worlds interpretation are attempts at describing quantum mechanics without the inherent randomness, and there are even more less mainstream theories.

Yet even today the Copenhagen Interpretation with it's wavefunction collapse is still the most widely accepted interpretation among physicists. As of now, there isn't any evidence for any interpretation, and just the barest logical evidence against some interpretations. We cannot tell even the general direction in which a better theory might be in. So far we can only describe the probability of things happening, and there's nothing to say we need anything more than that.

Perhaps one day we'll have discovered that the universe is deterministic and causality makes sense at every scale, but that's definitely not our current understanding.