Intro to Probability & Statistics

1. Introduction

Every day you are surrounded by data — test scores, temperatures, the number of goals scored in a game, how many minutes you wait for a bus. Data on its own is just a pile of numbers. The branch of math called statistics gives us tools to organize that pile, find the "typical" value, and describe how spread out the numbers are. Its close cousin, probability, lets us measure how likely something is to happen before it actually happens — like the chance of rain tomorrow or the chance of drawing an ace from a deck of cards.

These two ideas work together in powerful ways. Probability helps us make predictions about the future ("there is a $70\%$ chance of rain"), and statistics helps us make sense of the past and present ("the average rainfall last month was $3$ inches"). Weather forecasters, sports analysts, doctors, and game designers all rely on these tools every day. By the end of this article you will be able to summarize a data set with a single representative number, decide which summary is fairest to use, and calculate the chance of simple events with confidence.

We will build everything from scratch using small, concrete examples — a handful of quiz scores, a bag of colored marbles, a rolled die. There is no formula here you cannot understand by counting carefully and thinking clearly. Along the way you will also learn to spot misleading averages, read probabilities as fractions or percents, and use the complement rule when "not" appears in a problem.

Statistics is not about memorizing long lists of numbers; it is about asking the right question. Do you want the typical value? The most common value? How spread out are the scores? Is an event likely or unlikely? Each question has its own tool, and choosing wisely is half the battle.

You will also develop number sense around chance. A probability of $\tfrac{1}{100}$ is very unlikely; a probability of $\tfrac{9}{10}$ is very likely. Being able to judge whether an answer "makes sense" on the $0$-to-$1$ scale is as important as computing the fraction correctly. Together, statistics and probability give you a toolkit for making sense of uncertainty — one of the most valuable skills in modern life.

2. Core Concepts

What is data?

A data set is a collection of values, usually numbers, that we have measured or counted. For example, the scores five students earned on a $10$-point quiz might be

$7, \quad 9, \quad 6, \quad 7, \quad 4.$

Each individual number is called a data point or value, and the number of data points is called the count (here the count is $5$). Throughout statistics we constantly ask: "How many values are there, and what are they?" Data can also come from categories — favorite colors, shoe sizes, or survey answers — but in this article we focus on numerical data.

Organizing data before you analyze it

Before finding a mean or median, it often helps to organize the data. You can list values in order from smallest to largest, or group identical values together. For the quiz scores above, sorted order is $4, 6, 7, 7, 9$. Organization does not change the data, but it makes patterns visible: you can see at a glance that $7$ appears twice and that $4$ is the lowest score. Sorting is required for the median and strongly recommended whenever you compare measures of center.

Measures of center: the "typical" value

When someone asks "How did the class do?", they do not want all $30$ scores read aloud — they want one number that represents the whole group. A number that describes the middle or typical value of a data set is called a measure of center. The three most important ones are the mean, the median, and the mode.

The mean (average). The mean is what most people call "the average." You find it by adding up every value and dividing by how many values there are. Intuitively, the mean is the value you would get if you took all the data, poured it into one big pile, and shared it out equally among the data points. If three friends have $2$, $5$, and $8$, the mean is $5$ — the amount each would have if they pooled their money and split it evenly.

The median (the middle). The median is the value sitting exactly in the middle when the data are lined up in order from smallest to largest. Half the values are below it and half are above. The median answers "what is the value of the typical person in the middle of the line?" It is unaffected by a few unusually large or small numbers, which makes it powerful when outliers are present.

The mode (the most common). The mode is simply the value that appears most often. If a shoe store wants to know which size to stock the most of, it cares about the mode — the size most customers actually buy. A data set can have one mode, more than one mode (called bimodal), or no mode at all if every value appears the same number of times.

Range and spread

The range measures how spread out a data set is:

$\text{range} = \text{maximum} - \text{minimum}.$

For the quiz scores $4, 6, 7, 7, 9$, the range is $9 - 4 = 5$. Range is not a measure of center — it tells you how far apart the extremes are, not what a typical value looks like. Still, range is useful: a range of $5$ on a $10$-point quiz means scores are fairly clustered, while a range of $9$ would mean someone scored very low and someone scored very high.

Why we sometimes need more than the mean

Imagine five workers earn these yearly salaries (in thousands of dollars):

$30, \quad 32, \quad 35, \quad 33, \quad 870.$

The mean is about $200{,}000$ — but that single number is misleading! Four of the five people earn around $30{,}000$, and one boss earns $870{,}000$. The mean got "pulled up" by that one extreme value, called an outlier. The median here is $33{,}000$, which describes a typical worker far more honestly. This is the central reason we learn several measures of center: different tools tell the truth in different situations.

What is probability?

Probability is a number that measures how likely an event is to happen. We put it on a scale from $0$ to $1$:

• A probability of $0$ means the event is impossible (rolling a $7$ on a normal six-sided die).
• A probability of $1$ means the event is certain (the sun rising tomorrow).
• A probability of $\tfrac{1}{2}$ means the event is as likely to happen as not (a fair coin landing heads).

An outcome is a single possible result of an experiment (rolling a $3$). An event is a collection of one or more outcomes we care about (rolling an even number, which is the outcomes $2$, $4$, or $6$). When every outcome is equally likely, probability becomes a counting game: we count the outcomes we want and divide by the total number of possible outcomes.

The sample space and equally likely outcomes

The sample space is the complete list of all possible outcomes. When you roll a fair die, the sample space is $\{1, 2, 3, 4, 5, 6\}$ — six outcomes, each with probability $\tfrac{1}{6}$. The simple formula $P(E) = \dfrac{\text{favorable}}{\text{total}}$ only works when outcomes are equally likely. If one marble is sticky and harder to draw, you cannot just count marbles — the formula would give a wrong answer.

Reading probability as a fraction, decimal, or percent

The same probability can be written three ways, and you should be comfortable switching between them. The chance of drawing a red marble from a bag with $3$ red and $5$ blue marbles is

$\frac{3}{8} = 0.375 = 37.5\%.$

All three say exactly the same thing. To turn a fraction into a percent, divide and multiply by $100$. To turn a percent into a decimal, divide by $100$ (so $70\% = 0.70$). To turn a decimal into a fraction, think about place value ($0.25 = \tfrac{25}{100} = \tfrac{1}{4}$).

The complement of an event

The complement of an event is everything in the sample space except that event. If $E$ is "it rains," then "it does not rain" is the complement, often written as "not $E$." Because something either happens or it does not, the probabilities always add to $1$:

$P(\text{not } E) = 1 - P(E).$

This is one of the most useful facts in introductory probability. Finding "at least one" or "not" is often easier by computing the opposite and subtracting from $1$.