On Ubuntu I was missing a cursor on one monitor, and my cursor was misplaced on another (as in it would display in a different location than where it would click). Both of those monitors would get around 3 frames per second.
My solution has been to never boot into Linux again. Maybe I'll order the proper combination of cables so that I don't need the adapter. Can you use all four ports of an Nvidia card? I seem to remember they'd only allow three ports despite supporting up to four monitors.
This was all born out of my rant on Riot's kernel level anti-cheat, and how it really is less risky than plenty of other games. Small publisher games on Steam, like Lethal Company, are more risky despite having less access. You don't need kernel level access to upload a user's documents directory or to install ransomware.
If you really care about being safe, you need your games and less trusted software on a completely isolated drive and OS.