You are reading the 2026 curriculum (exams up to November 2026). Sitting in February 2027 or later? Go to the 2027 Quantitative Methods guide.
The ANOVA table and the standard error of estimate
Analysis of variance (ANOVA) splits the total variation in Y, the sum of squares total (SST), into the part the regression explains, the sum of squares regression (SSR), and the part it does not, the sum of squares error (SSE). Dividing each by its degrees of freedom gives mean squares. F = MSR ÷ MSE (mean square regression over mean square error) tests the model, and the standard error of estimate, SEE = √MSE, is the typical size of a residual.
Before this: Goodness of fit and testing the regression coefficients
On the exam
- Describe the use of analysis of variance (ANOVA) in regression analysis, interpret ANOVA results, and calculate and interpret the standard error of estimate in a simple linear regression
Describe ANOVA in regression, interpret an ANOVA table, and calculate the standard error of estimate. Expect a table with blanks to fill from any three of SSR, SSE, SST and n. Wrong options divide SSE by n instead of n − 2, forget the square root, or use sums of squares in F.
How deeply to learn each part
- Know the idea
- Understand it in general. It frames other topics, but you will not calculate with it.
- Use it
- Understand it well enough to solve a question with it. Recognize when it applies.
- Memorize
- Learn it by heart. The exam will not give it to you.
You know this one. The full lesson is folded away. The takeaways, formulas and checkpoint below are your quick refresher, and the checkpoint is a fair test of whether you still do.
You tested strong here. The full lesson is folded away. The takeaways, formulas and checkpoint below are your quick refresher, and the checkpoint is a fair test of whether you still know it.
What does ANOVA do in a regression?
Analysis of variance (ANOVA) splits the variation in Y into the part the regression explains and the part it does not, then compares them. The regression output tabulates the pieces.
Start with the three sums of squares. The sum of squares total (SST) measures how far the Y values are from their mean. The sum of squares regression (SSR) measures how far the fitted values are from that mean (the explained part). The sum of squares error (SSE) measures how far the actual values are from the fitted line (the unexplained part).
What does the table look like?
For the six retailers from the previous lessons:
| Source | Sum of squares | df | Mean square | F |
|---|---|---|---|---|
| Regression | SSR = 62.727 | 1 | MSR = 62.727 | 90.47 |
| Error | SSE = 2.773 | n − 2 = 4 | MSE = 0.693 | |
| Total | SST = 65.500 | n − 1 = 5 |
Each mean square is a sum of squares divided by its degrees of freedom. The error degrees of freedom are because two coefficients (intercept and slope) were estimated from the data. The regression has 1 degree of freedom because there is one slope.
The mean square error is the average squared miss. Its square root is the typical size of a miss, the standard error of estimate (SEE).
For the retailers, percentage points: a typical miss of about 0.8 points of revenue growth. SEE is in the units of Y. has no units.
A simple regression on 6 observations has SSE = 2.7733. The standard error of estimate is closest to:
√(2.7733 ÷ 4) = 0.8327
Standard error of estimate, SEE0.8327
- 2.7733÷(6−2)=√x
√x square root
- 2.7733ENTER6ENTER2−÷g√x
ENTER enter (on the HP, puts the number on the stack) · g blue shift key · √x square root
How is F built from the table?
The F-statistic is the ratio of the two mean squares. It uses mean squares, never the raw sums.
- Explained by the line: SSR Memorize df = 1 in simple regression
- MSR = SSR ÷ 1 the numerator of F
- R² = SSR ÷ SST share explained
-
- Left unexplained: SSE Memorize df = n − 2
- MSE = SSE ÷ (n − 2) the denominator of F
- SEE = √MSE typical size of a residual, in the units of Y
-
Try this 0 of 3
- Fill in MSE, F, R² and SEE for the worked example
- Solve a new puzzle with every cell right (no revealing)
- Solve a puzzle that gives R² or SEE instead of a second sum of squares
Worked example: six retailers (n = 6). Fill in MSE, F, R² and SEE.
| Source | SS | df | MS |
|---|---|---|---|
| Regression | 62.727 | 1 | 62.727 |
| Error | 2.773 | 4 | |
| Total | 65.5 | 5 |
Type a value in any blank cell to check it. Each answer shows the relation it comes from.
Show working
n = 6. Degrees of freedom: regression 1, error n − 2 = 4, total n − 1 = 5.
SST = SSR + SSE: 62.727 + 2.773 = 65.5 (given)
SSR = SST − SSE: 65.5 − 2.773 = 62.727 (given)
SSE: 2.773 (given)
MSR = SSR ÷ 1: 62.727 ÷ 1 = 62.727 (given)
MSE = SSE ÷ (n − 2): 2.773 ÷ 4 = 0.693
F = MSR ÷ MSE: 62.727 ÷ 0.693 = 90.47
R² = SSR ÷ SST: 62.727 ÷ 65.5 = 0.9577
SEE = √MSE: √0.693 = 0.833
SEE = 0.833 is the typical size of a residual, in Y's units. R² = 0.958 is the share of SST the regression explains, with no units.
- 2.7733÷4=STO1MSE = 0.6933
- 62.7267÷RCL1=F = 90.47
- RCL1√xSEE = 0.8327
- 62.7267÷65.5=R² = 0.9577
STO store · RCL recall a stored number · √x square root
- 2.7733ENTER4÷STO1MSE = 0.6933
- 62.7267RCL1÷F = 90.47
- RCL1g√xSEE = 0.8327
- 62.7267ENTER65.5÷R² = 0.9577
ENTER enter (on the HP, puts the number on the stack) · STO store · RCL recall a stored number · g blue shift key · √x square root
Display: MSE 0.6933, F 90.47, SEE 0.8327, R² 0.9577
MSE divides by n − 2, never n. SEE needs the square root. F uses mean squares, not sums of squares.
How do you complete a table with blanks?
The exam gives you any three of SSR, SSE, SST and , and you fill in the rest. Use to get the missing sum of squares, the degrees of freedom , and , then divide.
A simple regression on 6 observations has SSR = 62.727 and SSE = 2.7733. The F-statistic is closest to:
62.727 ÷ (2.7733 ÷ 4) = 90.4727
F-statistic90.4727
- 62.727÷(2.7733÷(6−2))=
- 62.727ENTER2.7733ENTER6ENTER2−÷÷
ENTER enter (on the HP, puts the number on the stack)
Exam tip Check your table with the degrees of freedom: regression plus error must equal total (1 + 20 = 21). A mismatch means you used n instead of n − 2.
Go deeper Why the error degrees of freedom are n − 2
The residuals are computed from a line whose two coefficients were chosen using the same data. Those two choices tie down two of the residuals (they sum to zero, and they are uncorrelated with X), so only are free to vary. Dividing SSE by , not , corrects for that and gives an unbiased estimate of the error variance.
Go deeper SEE versus the standard deviation of Y
The standard deviation of Y is the spread around its mean, . The SEE is the spread around the regression line, . When X explains a lot, SEE is much smaller than the standard deviation of Y. For the retailers, the standard deviation of Y is 3.62 and the SEE is 0.83.
Memorize this
MemorizeThe ANOVA table
| Source | Sum of squares | df | Mean square | F |
|---|---|---|---|---|
| Regression | SSR | |||
| Error | SSE | |||
| Total | SST = SSR + SSE |
Memory hook Degrees of freedom add up: 1 + (n − 2) = n − 1. Sums of squares add up too. Mean squares do not.
Know it cold (root of SSE ÷ (n − 2)); ; . Three numbers and n unlock the whole table.
- Explained by the line: SSR Memorize df = 1 in simple regression
- MSR = SSR ÷ 1 the numerator of F
- R² = SSR ÷ SST share explained
-
- Left unexplained: SSE Memorize df = n − 2
- MSE = SSE ÷ (n − 2) the denominator of F
- SEE = √MSE typical size of a residual, in the units of Y
-
Quick example
SSR = 36 and SSE = 50 give SST = 86. Degrees of freedom split the same way: n − 1 = 1 + (n − 2).
Quick example
n = 27 and SSE = 50. MSE = 50 ÷ 25 = 2.00.
- 50÷(27−2)= 2
- 50ENTER27ENTER2−÷ 2
ENTER enter (on the HP, puts the number on the stack)
Quick example
MSE = 2.00, so SEE = √2.00 = 1.41, in the units of Y.
- 50÷(27−2)=√x 1.4142
√x square root
- 50ENTER27ENTER2−÷g√x 1.4142
ENTER enter (on the HP, puts the number on the stack) · g blue shift key · √x square root
Quick example
SSR = 36, SSE = 50, n = 27. MSR = 36, MSE = 2.00, so F = 36 ÷ 2.00 = 18.0.
- 36÷(50÷25)= 18
- 36ENTER50ENTER25÷÷ 18
ENTER enter (on the HP, puts the number on the stack)
How it is asked
-
SEE from sums of squares
n = 32, SSR = 48, SSE = 72. Standard error of estimate?
MSE = 72 ÷ 30 = 2.40, SEE = √2.40 = 1.55. Traps: √(72 ÷ 32) = 1.50; MSE itself = 2.40.
-
F from the table
Same regression: F?
F = MSR ÷ MSE = 48 ÷ 2.40 = 20.0. Trap: SSR ÷ SSE = 0.67.
-
Complete the table
Given n = 27, SSR = 36, SSE = 50, fill in the blanks.
SST 86; df 1, 25, 26; MSE 2.00; F 18.0; SEE 1.41; R² 0.42.
-
Degrees of freedom
n = 52. Degrees of freedom for SSE and SST?
50 and 51 (n − 2 and n − 1).
Exam traps
- Dividing SSE by n (or n − 1) instead of n − 2 to get MSE.
- Reporting MSE as the standard error of estimate: SEE = √MSE, so take the root.
- Computing F from sums of squares (SSR ÷ SSE) instead of mean squares.
- Treating a small SEE alone as a good fit: SEE is in the units of Y, so compare it with the spread of Y or use R².
Checkpoint
4 exam-style questions. About 90 seconds each.
1A regression on 32 observations has SSR = 48 and SSE = 72. The standard error of estimate is closest to:
2For the same regression (n = 32, SSR = 48, SSE = 72), the F-statistic is closest to:
3For the same regression, R² is closest to:
4A simple linear regression uses 52 observations. The degrees of freedom for the sum of squares error and the total sum of squares are, respectively:
Key takeaways
- SST = SSR + SSE; the degrees of freedom are 1, n − 2 and n − 1.
- MSE = SSE ÷ (n − 2); SEE = √MSE.
- F = MSR ÷ MSE; R² = SSR ÷ SST.
Quick example
SSR = 36 and SSE = 50 give SST = 86. Degrees of freedom split the same way: n − 1 = 1 + (n − 2).
Quick example
n = 27 and SSE = 50. MSE = 50 ÷ 25 = 2.00.
- 50÷(27−2)= 2
- 50ENTER27ENTER2−÷ 2
ENTER enter (on the HP, puts the number on the stack)
Quick example
MSE = 2.00, so SEE = √2.00 = 1.41, in the units of Y.
- 50÷(27−2)=√x 1.4142
√x square root
- 50ENTER27ENTER2−÷g√x 1.4142
ENTER enter (on the HP, puts the number on the stack) · g blue shift key · √x square root
Quick example
SSR = 36, SSE = 50, n = 27. MSR = 36, MSE = 2.00, so F = 36 ÷ 2.00 = 18.0.
- 36÷(50÷25)= 18
- 36ENTER50ENTER25÷÷ 18
ENTER enter (on the HP, puts the number on the stack)
Questions about this lesson?
Where this comes back
- Predicting Y and building a prediction interval Simple Linear Regression
- Simple Linear Regression Quantitative Methods
Questions candidates ask
How do you read an ANOVA table in regression?
The Regression row holds the explained variation (SSR, 1 degree of freedom), the Error row the unexplained (SSE, n − 2) and the Total row their sum (SST, n − 1). Divide each sum of squares by its degrees of freedom for the mean squares, then F = MSR ÷ MSE.
What is the standard error of estimate?
It is the square root of the mean square error, √(SSE ÷ (n − 2)). It measures the typical distance between actual and fitted Y, in the units of Y. A smaller value means the points sit closer to the line.
How do you calculate the F-statistic from an ANOVA table?
Divide the mean square regression by the mean square error: F = MSR ÷ MSE. In simple regression MSR equals SSR because it has one degree of freedom, and MSE is SSE divided by n − 2. A large F means the model explains much more than chance.
Spotted an error? Tell us and we will fix it.