I wouldn't say Yu-Gi-Oh is toxic. There are a handful of decks or cards that could be considered toxic, but most aren't. The main difference between setting up a strong endboard or just using toxic cards like continuous floodgates is that you can break through the first one with your own strategies, while the second requires you drawing specific cards that, if aren't in your deck, you instantly lose.
In most most card games, the fun is slowly strategically gaining power while keeping your opponent in check over many turns, but in Yu-Gi-Oh that is condensed into 2-3 turns. The fun then is more in trying to set up a board of interruptions that stop your opponent, or trying to break down your opponent's board for a lethal strike; which is basically the same as other card games, just more streamlined.
As for turns taking too long, just know that most players are probably watching YouTube videos or doing some other task while you're playing your turn, don't worry.