STAT 411 · Reference Session

The Plot Reading Clinic

Your lecture notes show a plot and then jump straight to the conclusion — the reasoning in between is missing. This session fills that gap: what each diagnostic plot is actually measuring, why the patterns mean what they mean, and how to turn a picture into a decision. Then you practice on eight plots.

Companion to the "Reading the Plots" quick-reference

In this session
  1. A plot is a signal-vs-noise question
  2. The ACF — and what the blue bands really are
  3. The PACF — what "partial" means
  4. WHY AR cuts off & MA tails off
  5. Reading a real AR(1) and MA(1)
  6. Non-stationary vs AR(1) — the trap
  7. The decomposition "random" panel
  8. Residual diagnostics & the forecast fan
  9. Practice: diagnose 8 plots
  10. The conclusions map

1 · Every diagnostic plot asks one question

Strip away the jargon and every chart in this course is asking: "Is there a pattern here, or is it just noise?" A pattern you can see is structure you can model; pure noise is the finish line (nothing left to extract). So before you read any specific plot, hold two reference pictures in your head:

STRUCTURE (model this)
NOISE (nothing left)
Why this matters
The entire Box–Jenkins workflow is a loop of "find a pattern → remove it → is what's left noise yet?" You are always comparing the plot in front of you to those two pictures.

2 · The ACF — and what those blue dashed lines actually are

The autocorrelation function plots, at each lag k, the correlation between the series and a copy of itself shifted k steps: rₖ = corr(yₜ, yₜ₋ₖ). Lag 0 is always 1 (a series is perfectly correlated with itself), so we read from lag 1 on.

The bands are a coin-flip baseline — this is the piece the notes omit

The two dashed blue lines sit at ±1.96/√n. Here's what that number is: if the series were truly white noise, each sample autocorrelation would scatter around 0 with standard deviation ≈ 1/√n, and 95% of them would fall within ±1.96/√n. So the band is the range you'd expect by pure chance even when there's no real correlation.

The caveat nobody tells you
You're eyeballing many bars at once. At 95% confidence, about 1 in 20 lags will poke out by chance. That's exactly why Worksheet 2's white-noise series had one stray spike at lag 12 and the answer was still "white noise." One borderline crossing out of a dozen lags is expected — don't over-react to it. (This is why the Ljung–Box test exists: it pools all the lags into one honest verdict instead of letting you cherry-pick a spike.)

3 · The PACF — what "partial" really means

The ordinary ACF at lag 3 is "contaminated": yₜ correlates with yₜ₋₃ partly through yₜ₋₁ and yₜ₋₂. The partial autocorrelation strips that out: it's the correlation between yₜ and yₜ₋ₖ after removing the influence of all the lags in between.

The intuition that makes it click
Think of a regression yₜ = φ₁yₜ₋₁ + φ₂yₜ₋₂ + … + φₖyₜ₋ₖ. The PACF at lag k is essentially the coefficient on yₜ₋ₖ — the direct effect of lag k once the closer lags are already accounted for. ACF = total relationship; PACF = direct-only relationship.

4 · WHY AR cuts off and MA tails off (the missing explanation)

The lectures give you the table — AR(p): PACF cuts off at p; MA(q): ACF cuts off at q — but never say why. Here's the why, and once you see it you'll never memorize it again.

AR(p): the PACF cuts off at p

An AR(p) model literally is a regression on the last p values: yₜ = c + φ₁yₜ₋₁ + … + φₖyₜ₋ₖ + εₜ. There is direct dependence on exactly p lags and no more. Since the PACF measures direct dependence, it is non-zero up to lag p and exactly zero after — it cuts off. Meanwhile each value keeps echoing into the future indirectly, so the total correlation (ACF) fades out gradually — it tails off (for AR(1), rₖ = φⁿ, a clean geometric decay).

MA(q): the ACF cuts off at q

An MA(q) value is a weighted sum of the last q+1 random shocks: yₜ = μ + εₜ + θ₁εₜ₋₁ + … + θₔεₜ₋ₔ. Two observations can only be correlated if they share a shock. Observations more than q steps apart share none → their correlation is exactly 0. So the ACF is non-zero up to lag q and cuts off after. The PACF, by contrast, tails off (often alternating in sign).

The one-line memory hook
The letter that CUTS names the order you read: PACF cuts → AR(p). ACF cuts → MA(q). And if neither cuts (both tail off) → it's a mixed ARMA, so stop reading orders off the plot and compare candidates by AIC.

5 · Reading a real AR(1) and MA(1)

AR(1), φ = 0.7

ACF — tails off (geometric)
PACF — one spike, then cuts off

Read it: ACF decays smoothly (0.7, 0.49, 0.34…); PACF has a single bar at lag 1 and nothing after. → PACF cuts off at 1 → AR(1). Next move: fit arima(y, order=c(1,d,0)).

MA(1), θ = 0.7

ACF — one spike, then cuts off
PACF — tails off (alternating)

Read it: ACF has one significant bar at lag 1 then drops inside the band; PACF decays with alternating signs. → ACF cuts off at 1 → MA(1). Next move: fit arima(y, order=c(0,d,1)).

6 · The trap: non-stationary vs AR(1)

This is the mistake that costs the most points. A non-stationary (trending) series also has a single big PACF spike at lag 1 — so people call it AR(1). The tell is in the ACF:

AR(1): ACF DECAYS (stationary)
Non-stationary: ACF barely falls
The rule
If the ACF decays slowly and stays outside the band for many lags, the series is non-stationary — you must diff() it before reading any orders. Reading p and q off a non-stationary ACF/PACF is meaningless. Stationarity first, always.

7 · The decomposition "random" panel is the judge

plot(decompose(y)) gives four stacked panels. Students study all four; the verdict lives in the bottom (random/irregular) panel. It answers "did I pick the right model, additive or multiplicative?"

GOOD: flat, patternless noise
BAD: a "megaphone" / leftover wave
Flat random → model fits
Constant spread, no repeating shape (centered at 0 for additive, 1 for multiplicative). This is Worksheet 2's ausbeer: "no systematic pattern in the random component → additive is reasonable."
Wave or megaphone → wrong model
If the spread grows toward the ends (small in the middle) or a seasonal wave remains, the fixed seasonal factor couldn't keep up — switch additive ↔ multiplicative (or log first). This is Homework 2's JohnsonJohnson: additive leaves a systematic pattern in random; multiplicative removes it.

8 · Residual diagnostics & the forecast fan

checkresiduals() — the "am I done?" plot

After any model, checkresiduals() shows residuals-over-time, their ACF, a histogram, and a Ljung–Box test. You want all four to say "white noise":

This is just Module 2's white-noise test re-used on the residuals. If it fails, your model missed structure → change p, q, P, or Q.

The forecast fan

The dashed line is the point forecast; the shaded bands (80% inner, 95% outer) widen with the horizon because uncertainty compounds. Sanity-check the shape: a seasonal model should keep the seasonal cycle; a pure stationary ARMA reverts to the mean after a few steps (it has no trend to project). Always report the interval, not just the point.

9 · Practice — diagnose these 8 plots

For each ACF/PACF pair: decide the process (AR? MA? ARMA? non-stationary? white noise?) and your next move. Then reveal.

10 · The conclusions map

You seeConclusionNext move
ACF decays slowly, stays outside bandNon-stationary (trend)diff(), then re-read
Tall ACF spikes at 12, 24… decaying slowlySeasonal non-stationaritydiff(y,12) (D=1)
PACF cuts off at p · ACF tails offAR(p)arima(…, c(p,d,0))
ACF cuts off at q · PACF tails offMA(q)arima(…, c(0,d,q))
Both tail offARMA(p,q)Try candidates, lowest AIC
Both inside band (residuals)White noise → adequateForecast with intervals
Random panel: flat noiseDecomposition model fitsKeep additive/multiplicative choice
Random panel: wave / megaphoneWrong modelSwitch add ↔ mult, or log
Ljung–Box p > 0.05No autocorrelation leftDone; p < 0.05 → revise orders

STAT 411 · Plot Reading Clinic · built to fill the interpretation gap in the lecture notes, using standard Box–Jenkins / forecasting reasoning (Hyndman, FPP). Schematics are illustrative.