R² is the most quoted number in a regression table and the most misread. It says how much of the variation in y the regressors account for. It does not say the model is right, the coefficients are unbiased, or that adding another variable was a good idea. This lesson shows exactly what R² measures, why it can only go up as variables are added, how adjusted R² corrects that, and when two R² values may be compared at all.
The Ashanagar survey is invented. The statistics modules used one district of 60 households. Econometrics needs more households and more variables, so this is a new, larger survey of 600 households in the same imaginary district: income, spending, household size, whether the household is in the town or a village, the head’s schooling and earnings.
Because we wrote the data-generating process, we know the true answers, and every lab can show whether a regression recovers them. Household spending, in thousands of rupees a month, was generated as 1 + 0.45 × income + 0.9 × household size + 1.5 × town + an error with standard deviation 2.5. A real survey never tells you its true coefficients. This one does, so you can see how close an estimate comes.
It also holds a variable, the head’s ability, that a real survey could not observe. It is kept so that the lessons on omitted variables can show what happens when it is left out. Every figure here is illustrative, not official statistics.
Every household’s spending differs from the average, ȳ. Some of that gap is accounted for by the regression, the part ŷ − ȳ, and some is left over, the residual e. Square and add over all households and the two parts do not interfere, because the residuals are orthogonal to the fitted values (lesson 1):
For the survey regression of spending on income, household size and town, SST = 12,313.3, SSR = 8,395 and SSE = 3,918.2, so R² = 8,395 ÷ 12,313.3 = 0.682. The three regressors account for about 68% of the variation in spending. The leftover share, 1 − R² = 0.318, is sometimes called the coefficient of non-determination.
Four facts to carry into the exam:
Add any variable to a regression, however useless, and R² cannot go down. The reason is simple: least squares chooses the coefficients that make SSE as small as possible. With a new regressor it can always set the new coefficient to zero and recover the old fit, so its best SSE is at most the old one. And a new variable that is only noise usually fits some of the sample’s random wobble, so R² rises.
Here is the proof by experiment. y really depends on one variable. Add columns of pure noise, one at a time, and watch both R² and adjusted R².
Horizontal: the number of pure-noise regressors added. Vertical: R² and adjusted R².
With 0 junk regressors added, R² is 0.094, up from 0.094 for x alone, although nothing real was added. Slide to 22 (the most this sample allows) and R² nears 1: with enough columns, least squares can explain any data. Adjusted R² is 0.054. It does not climb with the junk. Step through one at a time: it goes up exactly when the last regressor’s |t| is above 1, and down when it is below. R² cannot tell junk from signal. Adjusted R² charges for every column it uses, so it rises only when a column earns its place.
Push the slider all the way. With n − 3 junk columns plus x and the intercept, the regression has n − 1 parameters, and R² approaches 1: with enough regressors, least squares can match any sample exactly. A high R² built from many regressors on few observations is evidence of nothing.
Adjusted R² charges a price for every parameter. It replaces the two sums of squares by estimates of variance, each divided by its degrees of freedom:
Four properties, each of which has been asked:
With k coefficients (the intercept counts), adjusted R² compares the estimated error variance with the variance of y:
SST and n do not change when a regressor is added. So adjusted R² rises exactly when SSE ÷ (n − k) falls.
Let the old model have sum of squared residuals SSE and k coefficients, and the new one SSE′ and k + 1. Adjusted R² rises when
Multiply out and rearrange: SSE ÷ (n − k) > SSE′ ÷ (n − k − 1) is the same as (SSE − SSE′) > SSE′ ÷ (n − k − 1), that is
The left side is exactly the F statistic for adding one regressor.
By the previous lesson’s result, that F equals the square of the new regressor’s t. So the condition is t² > 1, that is |t| > 1. Check it on the survey: adding the head’s schooling to the spending regression gives it a t of 0.086, so |t| is below 1, and adjusted R² goes from 0.68019 to 0.67965, which is a fall, as the rule says. The same number from the formula: 1 − (1 − 0.68179) × 599 ÷ 595 = 0.67965.
Four survey regressions of spending, each adding one variable to the last:
| Regressors | Parameters, k + 1 | R² | Adjusted R² | SSE |
|---|---|---|---|---|
| Income | 2 | 0.6059 | 0.6053 | 4,852.3 |
| Income and size | 3 | 0.665 | 0.6639 | 4,124.5 |
| Income, size and town | 4 | 0.6818 | 0.6802 | 3,918.2 |
| Income, size, town and schooling | 5 | 0.6818 | 0.6797 | 3,918.2 |
R² climbs at every step, and it must. Adjusted R² climbs from the first to the third model, where the added variables earn their place (size and town), and the fourth step, schooling, adds almost nothing: its t is 0.09, so adjusted R² moves from 0.6802 to 0.6797.
Rules for comparing R². Two models’ R² (or adjusted R²) can be compared only if they have:
Beyond adjusted R², economists use information criteria (Akaike and Schwarz, often written AIC and BIC), which add a penalty for each parameter to a measure of lack of fit and are smaller for better models. The Schwarz penalty is heavier, so it picks smaller models. You need to know that they exist and what they do, but the exams in the bank ask only for the adjusted R².
A high R² is neither necessary nor sufficient for a good regression. Three reasons it misleads:
R² measures fit, not validity. State what it is (the share of the variation in y that the regressors explain), what it ignores (bias, causality, the right functional form), and that adjusted R² adds only a penalty for the number of regressors.
Definitions and one-step calculations: a t statistic, an R², which assumption is which. Most CUET and JNU questions sit here.
Restricted against unrestricted regressions, reading output, and statement questions, up to GATE and IIT JAM level.
This topic’s hardest questions, from the DSE entrance, are worked through in Lesson 18: Tests and goodness of fit from a regression table.
These are questions from the TestStop bank. A free account answers 10 a day, each with its worked solution; All-Access opens every set with no daily limit.
The Delhi School’s questions on this material (an adjusted R² from a home-sales table, an explained sum of squares from a dummy regression) are in the hard-problems lesson at the end of the module. The squared correlation and the simple-regression case are in the regression primer.