There's always a remainder day, and it's not precisely 24 hours. That's why we have leap years and sometimes leap seconds. You could get rid of that by cramming all of the time into one day of varying length. This year, maybe it's 29.75 hours. Maybe next year it's 31. Astronomers and physicists could fight it out and see how closely they can match the previous year.