Derivation of the Variance for a Stationary AR(1) Process

Exploring the cinematic intuition of Derivation of the Variance for a Stationary AR(1) Process.

Visualizing...

Our institutional research engineers are currently mapping the formal proof for Derivation of the Variance for a Stationary AR(1) Process.

Apply for Institutional Early Access →

The Formal Theorem

Consider a stationary Autoregressive process of order 1 (AR(1)) defined by Xt=c+ϕXt1+ϵt X_t = c + \phi X_{t-1} + \epsilon_t , where Xt X_t is the process at time t t , c c is a constant, ϕ \phi is the autoregressive parameter, and ϵt \epsilon_t is a white noise error term with E[ϵt]=0 E[\epsilon_t] = 0 and Var(ϵt)=σϵ2 Var(\epsilon_t) = \sigma^2_\epsilon . For the process to be strictly stationary, the condition ϕ<1 |\phi| < 1 must hold. Under these conditions, assuming Cov(Xt1,ϵt)=0 Cov(X_{t-1}, \epsilon_t) = 0 , the variance of the process Xt X_t is given by:
Var(Xt)=σϵ21ϕ2 Var(X_t) = \frac{\sigma^2_\epsilon}{1 - \phi^2}

Analytical Intuition.

Imagine a vibrant, bustling city, where each day's energy level Xt X_t is a direct consequence of yesterday's Xt1 X_{t-1} , modulated by a societal rhythm ϕ \phi , plus a sudden, unpredictable spark ϵt \epsilon_t – perhaps a viral trend or a new technological breakthrough. For the city to remain stable and not descend into chaos or stagnation, the societal rhythm ϕ \phi must be controlled (i.e., ϕ<1 |\phi| < 1 ). The city's overall 'flicker' or variability, its variance Var(Xt) Var(X_t) , isn't just due to the daily sparks ϵt \epsilon_t . Instead, it's a profound interplay. If ϕ \phi is near zero, the city quickly forgets its past, and its daily variability Var(Xt) Var(X_t) largely mirrors the raw variability of the sparks σϵ2 \sigma^2_\epsilon . But as ϕ \phi approaches 1, yesterday's energy profoundly echoes into today, amplifying even small sparks into wide, persistent fluctuations, causing the city's overall variability to surge dramatically as the denominator 1ϕ2 1 - \phi^2 shrinks.
CAUTION

Institutional Warning.

Students frequently overlook the critical stationarity condition ϕ<1 |\phi| < 1 , which permits the assumption Var(Xt)=Var(Xt1) Var(X_t) = Var(X_{t-1}) . They might also forget that the covariance Cov(Xt1,ϵt)=0 Cov(X_{t-1}, \epsilon_t) = 0 is a crucial assumption, or that the constant c c vanishes during variance calculation.

Academic Inquiries.

01

Why is the stationarity condition ϕ<1 |\phi| < 1 crucial for this derivation?

Without ϕ<1 |\phi| < 1 , the AR(1) process is not stationary. This means its statistical properties, including variance, would change over time. The fundamental step Var(Xt)=Var(Xt1) Var(X_t) = Var(X_{t-1}) relies directly on stationarity. If ϕ1 |\phi| \ge 1 , the variance would either be infinite or non-constant, and the derived formula would be invalid.

02

How does the constant term c c disappear from the variance formula?

The variance of a random variable is defined as Var(Y)=E[(YE[Y])2] Var(Y) = E[(Y - E[Y])^2] . When we add a constant to a random variable, it shifts its mean but does not affect its spread or variability. Mathematically, Var(Y+c)=Var(Y) Var(Y + c) = Var(Y) . Thus, in Xt=c+ϕXt1+ϵt X_t = c + \phi X_{t-1} + \epsilon_t , the constant c c does not contribute to Var(Xt) Var(X_t) .

03

What is the implication of a large ϕ |\phi| (close to 1) for Var(Xt) Var(X_t) ?

As ϕ |\phi| approaches 1 (from below), the denominator 1ϕ2 1 - \phi^2 approaches 0. This causes Var(Xt) Var(X_t) to become very large, tending towards infinity as ϕ±1 \phi \to \pm 1 . A large ϕ |\phi| indicates strong persistence and 'memory' in the process, meaning past shocks have a long-lasting impact, leading to amplified fluctuations and high volatility.

04

Why is the assumption Cov(Xt1,ϵt)=0 Cov(X_{t-1}, \epsilon_t) = 0 valid?

This is a standard assumption in AR models. ϵt \epsilon_t represents a white noise process, meaning it is uncorrelated with its own past values and, crucially, with past values of the process Xt X_t . ϵt \epsilon_t captures the 'new' unpredictable information at time t t and thus should not be correlated with the state of the process from the previous time step, Xt1 X_{t-1} .

Standardized References.

  • Definitive Institutional SourceBox, G. E. P., Jenkins, G. M., Reinsel, G. C., & Ljung, G. M. Time Series Analysis: Forecasting and Control. 5th Edition.

Institutional Citation

Reference this proof in your academic research or publications.

NICEFA Visual Mathematics. (2026). Derivation of the Variance for a Stationary AR(1) Process: Visual Proof & Intuition. Retrieved from https://nicefa.org/library/time-series-analysis/derivation-of-the-variance-for-a-stationary-ar-1--process

Dominate the Logic.

"Abstract theory is just a movement we haven't seen yet."