The Law of averages reference article from the English Wikipedia on 24-Apr-2004
(provided by Fixed Reference: snapshots of Wikipedia from wikipedia.org)

Law of averages

The law of averages is a lay term used to express the view that eventually, everything "evens out." For example: Two people who drive cars over a long period of time will have roughly the same number of accidents. The more children you have, the more likely you will have an equal division of boys and girls. The longer you flip a coin, the more likely the number of heads and tails will equalise.

While the general belief in the law of averages is why people gamble in Las Vegas on the belief that they will "sooner or later break even", the law of large numbers is why casinos in Las Vegas make billions of dollars.

The law of large numbers states that a large sample of a particular probabilistic event will tend to reflect the underlying probabilities. For example, after tossing a "fair coin" 1000 times, we would expect the result to be approximately 500 heads results, because this would reflect the underlying .5 chance of a heads result for any given flip.

However, it is important that while the average will move closer to the underlying probability, in absolute terms deviation from the expected value will increase. For example, after 1000 coin flips, we might see 520 heads. After 10,000 flips, we might then see 5096 heads. The average has now moved closer to the underlying .5, from .52 to .5096. However, the absolute deviation from the expected number of heads has gone up from 20 to 96.

There are two common ways to misunderstand and misapply the law of large numbers: