Or are there just that many posts not properly labeling their language?
It's this. Most posts don't set a language. The UI to do so is either missing or defaults to undefined and people don't set it. The language filters won't be useful until apps and the web-ui do something useful like allowing a default language to be set in a user-account and/or community.