Yes, but the average temperature in vast majority of the areas is higher than the avg temperature of say Europe. When we say Africa is warmer, it is a simplification simply by the virtue that its centroid closer to equator than Europe. Thus, we can say that it's warmer.
Side note: don't use rhetorical questions to respond to someone. It's demeaning. Rephrase "Why? Africa is a huge continent with all kinds of weather."
It's not demeaning, it actually adds color to the answer and makes it more engaging. I don't know what's up with HN's fetishizing of impassionate, humorless and snarkless style. Not everything has to be written like the IEE 754 specification.
Those temperatures are normalized to sea-level. If you go to say La Paz or Macchu Pichu expecting scorching weather based on that graphic you are going to have a bad time.