The Central Limit Theorem explains why normal distributions appear everywhere in statistics.
Suppose \(X_1,X_2,\dots,X_n\) are independent and identically distributed (i.i.d.) with finite mean \(\mu\) and finite variance \(\sigma^2\).
Define the sample mean:
\[
\bar X=\frac{1}{n}\sum_{i=1}^{n}X_i.
\]
Then, as \(n\) becomes large, the distribution of \(\bar X\) becomes approximately normal — even when the parent distribution is skewed or otherwise non-normal.
A standard CLT statement is:
\[
\frac{\bar X-\mu}{\sigma/\sqrt{n}} \;\Rightarrow\; N(0,1)\quad \text{as } n\to\infty,
\]
In words: the standardized mean converges in distribution to the standard normal.