WARNING - After I did this, everything worked fine. However when I woke up the next day all the HomePods were showing “No Response”. Rebooting them and rebooting my Unifi UDR did nothing, they just refused to reconnect.
I was also messing around with Wifi to get some other older HomeKit devices to reconnect including deleting the saved WiFi network from my phone so they may have lost access because of that? However just a warning.
I was able to get them all readded but it required a full factory reset from the HomePods themselves because they couldn’t be controlled from the home app. Easy to do but annoying.