This is precisely it: Tomatoes can be sweet enough to be a fruit, they can be acidic enough to be a fruit, but they're definitely too umami to be fruit.

Next thing people are going to insist on, wilfully ignoring the differences in taxonomy, is that peppercorns are fruit. A stone fruit, just like cherries or peaches.