The point of the war was whether states have the right to secede from the union. The confederacy wanted to leave, and the union disagreed.
The union won, so the south couldn't secede, so they were still americans, so you're wrong.
But also you should count all deaths in war. The reaper doesn't care about citizenship or nations.