The concern is not about the absolute change in temperature or CO2 levels its the rate of change - the idea is that over thousands to millions of years plants and animals can adapt to changing temperatures via natural selection or moving their territory. However over hundreds of years, particularly with habitats fragmented by human development this is much more difficult and therefore it presents higher chances of extinction for species that are not very mobile or have limited ranges.
