I may be missing something here, but wouldn’t you still need to solder those connectors?
If you want to limit soldering as much as possible, I’d grab a BlackPill or similar that comes with pin connections that you could just plug into the pcb, and it would have enough pins that depending on how many switches you wanted you could probably get away without needing a matrix, so two less solder points per switch for each resistor. You could also probably benefit from hotswaps. While no reduction in solder points (still two per switch), it can be just a big lump of molten solder on each side - it doesn’t need to be quite so carefully done.