Wasn't the VMU, from the start, already a portable handheld console? Sure it was just minigames, but thats the V in VMU. I remember playing the Skies of Arcadia minigame.
Dreamcast did have Memory Units that didn't have the screen so they wouldn't have been VMUs, but were still MUs. I appreciate the hack of a Pi Zero and a full color screen though. :)