If you are trying to find the average height of humans by sampling 100 humans, then no single sample will have a significant impact. Randomness is extremistan allows for far major optimistic or pessimistic scenarios than one can imagine, especially when the worst-case outcome is more consequential than the forecast itself. A Gray Swan is about modelable extremes while a Black Swan is about unknown unknowns.