I like the idea - if the lemmy devs do implement public voting I'd definitely move over. Not only does it maintain the (current) state of voter visibility, but it also protects from the frequently cited admin and kbin/mbin exploits. Trusting one admin is far easier than trusting every admin.
I was actually having similar thoughts after reading the post (forking lemmy) but idk if I have the time to run an instance.
Votes already are presented to the end user in an aggregated fashion, as opposed to how it is on kbin/mbin. In any case, even in the current implementation manipulation is relatively easy, as an admin can just spin up extra accounts. The fediverse relies on trust.