The oldest areas on the east coast were settled before gas lines were a thing and electricity existed. So they use oil unless it’s a big city that paid to have gas lines installed.

This is why cities that grew a lot after gas was industrialized primarily have natural gas.

Remote areas will use oil, propane, or wood because they can be delivered by truck and heat pumps are a pretty new technology that hasn’t worked well in cold areas until recently.

The south has minimal heat requirements so they can get by with electric which is cheap to install but not efficient enough to provide primary heat in cold areas.

Also, southern homes generally have air conditioning so adding a reversing valve or set of heater coils is pretty easy.

One reason is bad laws. I would love to replace my natural gas boiler and steam radiators with an electric heat pump system. It would be more efficient, cheaper to run, be able use solar power, and keep my house more comfortable.

But state law requires that buildings meet a specific efficiency requirement, which my house does not meet because it is 170 years old. I understand why they have that requirement for new construction, but it is stupid to not have an exception for old buildings.

Age of the city and sufficient infrastructure. Once the building is built to use [oil or gas or whatever] it’s never refit to use something else. Something something quarterly profits.

Climate. You're not going to need gas heating in Florida when it's cold for only a short time of the year.

Market supply and demand I assume.

Age of home probably plays a factor as well.