I don't think it's a good idea to disable them. I don't want to live in an echo chamber or silence critics. Facing criticism will strengthen worthwhile ideas.
And it would rob the actual users of the instance of the ability to downvote content we don't approve of legitimately.
But I do like that you've been making the voting and vote bombing transparent.
Is there a script or another way to make the voting parties visible to all users rather than just the admin? Or make it so a flood coming from external sources would be visible or filtered in some way?