You forget gravity. Small planets, asteroids, etc, don't have an atmosphere because their gravity is not strong enough to acquire or retain an atmosphere. Mars has lost most it's atmosphere, the moon has none, and so on....
