The simplest explanation is that during the last ice average global temperatures were just 4C cooler.
This resulted in glaciers 10's of metres thick across many continents.
A 4C warmer world would be a very different planet and even 2C would cause a lot of problems.
In a 2C warmer world your hottest summer days would be in the 40's that would make a difference.
