I have mixed feelings about heat pumps. Where we live winters aren't too harsh - our coldest night would be around -18C and for the most part January/February hovers around -10C at night. Our main heating is oil-based hot water baseboard radiator which I think is THE BEST type of heating solution from comfort standpoint. But few years ago we installed two mini-split heat-pumps which work great and save us a ton of money - BUT they don't heat the house evenly and you must leave all indoor doors open for effective heating. There is an option to convert the main heating to a geothermal heat-pump heating up the water but that is quite an expensive solution right now. For now I am never giving up oil in the foreseeable future.
FWIW you can also get heat pumps that feed into regular central heating. The split units are nice because you can heat different rooms to your liking but if you prefer a central approach, that’s also possible, just like it is with a furnace.