In Europe, most buildings are relatively well insulated and use materials with a high thermal mass. So the building itself can soak up a lot of heat during the day and radiate it out during the night. In North America you see a lot cheaper construction out of lumber and drywall instead of brick and cement, and with modest insulation.
In North America, a brief heat wave is immediately noticed and requires a lot of work by the A/C system. In Europe, you can tolerate a heat wave lasting up to a couple days. But weeks on end? Your buildings will heat-soak and at that point it starts to work against you. Your air conditioning will run all day and all night because now the insulation and thermal mass is acting like an oven, keeping the interior warmer than the outside.
Thermodynamics has not changed in recent years. There has not been any change to the fundamentals about A/C generally taking a lot of energy to run. It is just slightly complicated because of the need to factor in the building and neighborhood in which the A/C is operating.

























Heat pumps are a lot closer to theoretical efficiency limits than cars. Most of the gain for cars has to do with aerodynamics and energy storage / regenerative braking. The engine itself, only modest gains. Even the most efficient ICE engines are like 45% or something, or looked another way, 55% effective at producing heat.
Variable speed and 2 stage systems do provide gain. However those are still expensive and complicated. I’m skeptical that someone using A/C for max 2 months per year will break even versus a conventional system. Could be true for common residential buildings, not so much for detached homes.
Regardless of theoretical efficiency, the problem is more “supply side”, how much heat is getting into your building. The most effective way to save energy is to reduce the heat you have to reject in the first place. Reflective roof tiles, low emissivity windows, a dang tree. Each of those could be measured in terms of heat reduction but don’t have an efficiency rating directly comparable to a heat pump because they operate passively. The social-political question is whether to move in a one-way direction toward A/C dependence or if these other options can be used instead in more temperate countries.