Normal distribution: recap and probability calculations
The normal distribution models a continuous quantity that varies around a central value, with deviations becoming less common farther from the center. It is described by its mean and standard deviation ; its variance is . A standard normal variable has mean and standard deviation . Standardizing converts a value of to the number of standard deviations it lies from the mean:
The standard normal table or a distribution template can then provide cumulative probabilities, tail probabilities and inverse percentiles. For an interval, subtract cumulative probabilities: . For a top-tail cutoff, use the upper-tail probability directly or use symmetry.
Ramesh's pawn-shop counts
Let be the daily number of people bringing goods to pawn brokers. The mean is , and the bottom of days have at most visitors: . The corresponding standard-normal quantile is approximately .
Thus . For the chance of between and visitors, standardize each endpoint:
Using the table values and :
For the busiest of days, the upper-tail cutoff is :
About or more visitors therefore marks the busiest of days, using the rounded values in the calculation.
Suresh's bottle fill
Let be the fill amount in ounces, with adjustable mean and fixed standard deviation . To have at least of bottles contain at least ounces, set . The standard-normal value with right-tail area is :
At this mean, the probability of at least ounces is
So the probability is approximately .
Key takeaways
- Standardize with ; reverse with .
- Use cumulative-probability differences for intervals and inverse quantiles for cutoffs.
- Upper-tail cutoffs use positive values; lower-tail cutoffs use negative values by symmetry.
- Track whether a table reports a cumulative area or a tail area.
3.5 Linear Combinations of Normal Random Variables
A weighted sum represents combined uncertainty: revenue from several products, total demand over several weeks, or the difference between two measurements. If the inputs are jointly normal, any linear combination remains normal. Its mean follows the weights directly; its variance depends on both the squared weights and dependence between inputs.
For ,
If the are independent,
Without independence, covariance terms must be included:
For jointly normal inputs, is normal even when the inputs are dependent; dependence changes its variance. Independence is the condition that lets the covariance terms vanish.
Transforming one normal variable
If and , then
Choosing and gives , the standard normal transformation.
Sums and averages of independent, identically distributed normals
For independent , the sum has mean and variance ; its standard deviation is , not . The average has mean and variance , so its standard deviation is . Larger samples reduce the variability of the average.
Piston and cylinder fit
Let be piston radius and cylinder inside radius. The given independent normal measurements are with mean mm and standard deviation mm, and with mean mm and standard deviation mm. Define the clearance . Then
Thus . A non-fitting piston corresponds to ; the stated normal-template result is . If optimal performance requires a clearance from to mm, the stated result is
The worked probabilities use the rounded standard deviation mm.
Average cotton-plant height
Each of plant heights is modeled as independent and identically distributed normal with mean cm and standard deviation cm. For their average :
The reported 95th percentile is cm. The reported lower-tail statement says the average is above cm of the time (the 5th percentile). A central interval is reported as to cm. The reduced spread of the sample average ( cm versus cm for one plant) illustrates the standard-error effect.
Comparing two stock returns
Company A returns are normal with mean and standard deviation percentage points. Company B returns are normal with mean and standard deviation percentage points. Assume independence. An A return from through is called moderate; the stated template probability is . A B return of at least is excellent; the stated upper-tail probability is .
To compare their returns, define . Independence gives
Therefore . The reported probabilities are
The latter is the chance that B exceeds A by at least two percentage points.
Key takeaways
- Linear combinations of jointly normal variables are normal.
- Multiply means by coefficients; multiply variances by squared coefficients.
- Add covariance terms unless independence is given.
- Summing increases spread by ; averaging reduces standard deviation by .
- For a difference, define the order explicitly (for example, cylinder minus piston) before interpreting the sign.
Examples with sums of normal variables
The same rules solve portfolio totals and cumulative demand. In each case, first define the aggregate random variable; then combine means and variances; then standardize the requested threshold.
Nilesh's nine investments
Nine independent investments each have normal returns with mean and standard deviation . If , then
The question asks for the value below which total return falls just of the time. The lower-tail standard-normal quantile is approximately :
Using the transcript's less-rounded calculation, the reported figure is ; with exactly as stated, the arithmetic gives (about thousand). For the interval to :
Using table values and ,
Naman's three-week inventory
Weekly demand is independent and normal: means tons and standard deviations tons. For total demand :
With tons in stock, a stockout occurs when :
So stockout risk is about (roughly chance of no stockout). For a service probability, use , for which :
or plan for about tons.
Key takeaways
- Add independent normal returns or demands by summing their means and variances.
- Standard deviation is the square root of the combined variance.
- For a lower percentile use a negative quantile; for a high service-level stock target use a positive quantile.
- State and question independence assumptions: correlated investments or demands require covariance terms.
3.6 Chi-square distribution
Squaring a standard-normal observation removes its sign and makes large deviations contribute strongly. The sum of squared independent standard normals produces a chi-square distribution. Its degrees of freedom count how many squared standard normals are summed.
The distribution is supported on positive values, has one parameter , mean and variance . As grows it becomes less skewed and more bell-shaped, approaching a normal shape. Applications named in the material include goodness-of-fit and other nonparametric hypothesis tests, feature selection/classification, and testing independence in logistic-regression contexts.
Critical values and table reading
The upper-tail critical value is defined by
Thus of observations lie at or below the critical value when . The chi-square table is indexed by degrees of freedom and upper-tail probability. If a requested degree of freedom or tail area is absent, the table permits an approximation by interpolation; a distribution template can calculate the quantity directly. The main-module template examples give these right-tail cutoffs (columns correspond to ):
| Degrees of freedom | ||||
|---|---|---|---|---|
| 5 | 7.3 | 9.2 | 11.1 | 15.1 |
| 10 | 13.4 | 16.0 | 18.3 | 23.2 |
| 15 | 19.3 | 22.3 | 25 | 37.6 |
| 20 | 25 | 28.4 | 31.4 | 37.6 |
The values generally rise with degrees of freedom, while skewness falls. The separate table exercises illustrate how to read exact upper-tail entries:
- : row , column gives . Hence and .
- : row , column gives ; the lower cumulative probability is .
- : row , column gives .
- : row , column gives .
- : row , column gives .
For the last three, the unusual large upper-tail areas are read as stated: the critical value is low because most probability lies to its right.
Key takeaways
- A chi-square variable is a sum of squared independent standard normals; counts the terms.
- Its support is positive, mean is , and variance is .
- Chi-square critical-value notation here uses right-tail area; read the correct row and column.
- Table gaps call for an approximation; do not confuse the upper tail with the CDF.
3.7 Student's distribution
The Student's distribution is a symmetric, zero-centered distribution with heavier tails than the standard normal at finite degrees of freedom. It arises from dividing an independent standard normal by the square root of an independent chi-square variable per degree of freedom:
It is used for hypothesis tests about population means, especially with small samples, for comparing means, and in linear-regression hypothesis testing and diagnostics. Its mean is for (the lecture states two or more); its variance is for . As grows, it approaches the standard normal. William Sealy Gosset, a statistician at Guinness studying barley and hops, published under the pseudonym “Student” in 1908 because the brewery restricted employee publication.
Critical values and central areas
The t table rows give degrees of freedom and the columns give right-tail areas. Symmetry means a right-tail area at equals the left-tail area at . For central area :
The main-module template reports upper-tail critical values for :
| 5 | 1.48 | 2.02 | 2.57 | 4.03 |
| 10 | 1.37 | 1.81 | 2.23 | 3.17 |
| 15 | 1.34 | 1.75 | 2.13 | 2.95 |
| 20 | 1.33 | 1.73 | 2.09 | 2.85 |
With degrees of freedom, table lookups and symmetry give:
- .
- .
- .
- .
- .
- .
If a value such as is beyond the table entry in the same row, its right-tail probability is less than ; if the value is smaller, such as , its right-tail probability is greater than . A table may bound but not give the exact probability.
For inverse lookups:
- , upper tail : .
- , lower tail : symmetry gives .
- , upper tail : .
- Central with : each tail is , so the interval is .
- Central with : each tail is , so the interval is .
Key takeaways
- The t distribution is symmetric and has heavier tails than the standard normal for finite .
- Degrees of freedom matter: critical values shrink toward standard-normal values as increases.
- For central intervals, split the excluded probability equally between the two tails.
- A lower-tail quantile is negative when the corresponding table gives the positive right-tail value.
3.8 distribution
The distribution (Fisher distribution, named for Ronald Fisher) compares two independent chi-square quantities after scaling each by its degrees of freedom:
is the numerator degrees of freedom and the denominator degrees of freedom. Swapping them generally changes the distribution. The variable is positive, unimodal, right-skewed and has a long right tail. The stated mean is for (the transcript says , but at the mean is undefined). Its standard deviation decreases as increases; as both degrees of freedom grow the density concentrates near . Uses include analysis of variance, feature selection and testing overall multiple-regression fit.
Upper-tail critical values
The critical value satisfies . In the F tables, denominator degrees of freedom index rows, numerator degrees of freedom index columns, and each table is for a particular upper-tail area. Preserve numerator/denominator order. The main-module template values below use columns :
| (5, 5) | 2.23 | 3.45 | 5.05 | 10.97 |
| (5, 10) | 1.80 | 2.52 | 3.33 | 5.64 |
| (10, 5) | 2.19 | 3.30 | 4.74 | 10.05 |
| (20, 20) | 1.47 | 1.79 | 2.21 | 2.94 |
Three table lookups demonstrate the row/column convention:
- , upper tail : use denominator row , numerator column , giving .
- , upper tail : the corresponding table entry is .
- , upper tail : the corresponding table entry is .
For the first lookup, , or ; percent notation matters. Where a needed tail area or degree of freedom is absent, approximate by interpolation or use a distribution template.
Key takeaways
- An F variable is a ratio of scaled independent chi-square variables and is positive/right-skewed.
- Always keep numerator and denominator in the right positions.
- Its critical values depend on both degrees of freedom and the right-tail area.
- Larger degrees of freedom generally concentrate the distribution closer to .
Connecting the distributions
The normal family and its related distributions form a useful ladder: standardize a normal observation; square standard normals and add them to obtain chi-square; combine a standard normal with an independent scaled chi-square to obtain ; and take a ratio of two independently scaled chi-squares to obtain . These distributions support later inference about means, fit, independence, variance comparisons and model significance. Their density formulas can be complicated; the central practical tasks are identifying the right distribution, its degrees of freedom, the requested tail, and the correct critical value.
Key takeaways
- Normal linear combinations make probability calculations for sums, averages and differences tractable.
- Chi-square, and distributions are related through standard-normal and chi-square variables.
- Table conventions differ: check symmetry for , and carefully track right-tail area and degrees of freedom for all three.
- Critical-value tables may require interpolation when they do not list the requested combination.
Test yourself on this module
Questions from these notes, one at a time, with feedback. Your weak topics are saved.