In the RetroPi config, there's an option to Autosave when exiting a game, and another to Autoload on start. Combined, they help keep high scores around.
Just remember that if a game autosaves into a crashed state, you can recover by loading an old save, or by doing a reset in the RetroPi menu.