perm_income.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "<a id='perm-income'></a>\n",
    "<div id=\"qe-notebook-header\" align=\"right\" style=\"text-align:right;\">\n",
    "        <a href=\"https://quantecon.org/\" title=\"quantecon.org\">\n",
    "                <img style=\"width:250px;display:inline;\" width=\"250px\" src=\"https://assets.quantecon.org/img/qe-menubar-logo.svg\" alt=\"QuantEcon\">\n",
    "        </a>\n",
    "</div>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Optimal Savings I: The Permanent Income Model\n",
    "\n",
    "\n",
    "<a id='index-1'></a>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Contents\n",
    "\n",
    "- [Optimal Savings I: The Permanent Income Model](#Optimal-Savings-I:-The-Permanent-Income-Model)  \n",
    "  - [Overview](#Overview)  \n",
    "  - [The Savings Problem](#The-Savings-Problem)  \n",
    "  - [Alternative Representations](#Alternative-Representations)  \n",
    "  - [Two Classic Examples](#Two-Classic-Examples)  \n",
    "  - [Further Reading](#Further-Reading)  \n",
    "  - [Appendix: The Euler Equation](#Appendix:-The-Euler-Equation)  "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In addition to what’s in Anaconda, this lecture will need the following libraries:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "hide-output": true
   },
   "outputs": [],
   "source": [
    "!pip install --upgrade quantecon"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Overview\n",
    "\n",
    "This lecture describes a rational expectations version of the famous permanent income model of Milton Friedman [[Fri56]](https://python.quantecon.org/zreferences.html#friedman1956).\n",
    "\n",
    "Robert Hall cast Friedman’s model within a linear-quadratic setting [[Hal78]](https://python.quantecon.org/zreferences.html#hall1978).\n",
    "\n",
    "Like Hall, we formulate an infinite-horizon linear-quadratic savings problem.\n",
    "\n",
    "We use the model as a vehicle for illustrating\n",
    "\n",
    "- alternative formulations of the *state* of a dynamic system  \n",
    "- the idea of *cointegration*  \n",
    "- impulse response functions  \n",
    "- the idea that changes in consumption are useful as predictors of movements in income  \n",
    "\n",
    "\n",
    "Background readings on the linear-quadratic-Gaussian permanent income model are Hall’s  [[Hal78]](https://python.quantecon.org/zreferences.html#hall1978)  and chapter 2 of  [[LS18]](https://python.quantecon.org/zreferences.html#ljungqvist2012).\n",
    "\n",
    "Let’s start with some imports"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "hide-output": false
   },
   "outputs": [],
   "source": [
    "import matplotlib.pyplot as plt\n",
    "%matplotlib inline\n",
    "import numpy as np\n",
    "import random\n",
    "from numba import njit"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## The Savings Problem\n",
    "\n",
    "\n",
    "<a id='index-2'></a>\n",
    "In this section, we state and solve the savings and consumption problem faced\n",
    "by the consumer."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Preliminaries\n",
    "\n",
    "We use a class of stochastic processes called\n",
    "[martingales](https://en.wikipedia.org/wiki/Martingale_%28probability_theory%29).\n",
    "\n",
    "A discrete-time martingale is a stochastic process (i.e., a  sequence of random variables)\n",
    "$ \\{X_t\\} $ with finite mean at each $ t $ and satisfying\n",
    "\n",
    "$$\n",
    "\\mathbb{E}_t [X_{t+1} ] = X_t, \\qquad t = 0, 1, 2, \\ldots\n",
    "$$\n",
    "\n",
    "Here $ \\mathbb{E}_t := \\mathbb{E}[ \\cdot \\,|\\, \\mathcal{F}_t] $ is a conditional mathematical  expectation conditional on the time $ t $\n",
    "*information set* $ \\mathcal{F}_t $.\n",
    "\n",
    "The latter is just a collection of random variables that the modeler declares\n",
    "to be visible at $ t $.\n",
    "\n",
    "- When not explicitly defined, it is usually understood that $ \\mathcal{F}_t = \\{X_t, X_{t-1}, \\ldots, X_0\\} $.  \n",
    "\n",
    "\n",
    "Martingales have the feature that the history of past outcomes provides no predictive power for changes between current and future outcomes.\n",
    "\n",
    "For example, the current wealth of a gambler engaged in a “fair game” has this\n",
    "property.\n",
    "\n",
    "One common class of martingales is the family of *random walks*.\n",
    "\n",
    "A **random walk** is  a stochastic process $ \\{X_t\\} $ that satisfies\n",
    "\n",
    "$$\n",
    "X_{t+1} = X_t + w_{t+1}\n",
    "$$\n",
    "\n",
    "for some IID zero mean *innovation* sequence $ \\{w_t\\} $.\n",
    "\n",
    "Evidently, $ X_t $ can also be expressed as\n",
    "\n",
    "$$\n",
    "X_t = \\sum_{j=1}^t w_j + X_0\n",
    "$$\n",
    "\n",
    "Not every martingale arises as a random walk (see, for example, [Wald’s martingale](https://en.wikipedia.org/wiki/Wald%27s_martingale))."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### The Decision Problem\n",
    "\n",
    "A consumer has preferences over consumption streams that are ordered by the utility functional\n",
    "\n",
    "\n",
    "<a id='equation-sprob1'></a>\n",
    "$$\n",
    "\\mathbb{E}_0 \\left[ \\sum_{t=0}^\\infty \\beta^t u(c_t) \\right] \\tag{1}\n",
    "$$\n",
    "\n",
    "where\n",
    "\n",
    "- $ \\mathbb{E}_t $ is the mathematical expectation conditioned on the consumer’s time $ t $ information  \n",
    "- $ c_t $ is time $ t $ consumption  \n",
    "- $ u $ is a strictly concave one-period utility function  \n",
    "- $ \\beta \\in (0,1) $ is a discount factor  \n",
    "\n",
    "\n",
    "The consumer maximizes [(1)](#equation-sprob1) by choosing a consumption, borrowing plan $ \\{c_t, b_{t+1}\\}_{t=0}^\\infty $ subject to the sequence of budget constraints\n",
    "\n",
    "\n",
    "<a id='equation-sprob2'></a>\n",
    "$$\n",
    "c_t + b_t = \\frac{1}{1 + r} b_{t+1} +  y_t   \\quad t \\geq 0 \\tag{2}\n",
    "$$\n",
    "\n",
    "Here\n",
    "\n",
    "- $ y_t $ is an exogenous endowment process.  \n",
    "- $ r > 0 $ is a time-invariant risk-free net interest rate.  \n",
    "- $ b_t $ is one-period risk-free debt maturing at $ t $.  \n",
    "\n",
    "\n",
    "The consumer also faces initial conditions $ b_0 $ and $ y_0 $, which can be fixed or random."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Assumptions\n",
    "\n",
    "For the remainder of this lecture, we follow Friedman and Hall in assuming that $ (1 + r)^{-1} = \\beta $.\n",
    "\n",
    "Regarding the endowment process, we assume it has the [state-space representation](https://python.quantecon.org/linear_models.html)\n",
    "\n",
    "\n",
    "<a id='equation-sprob15ab'></a>\n",
    "$$\n",
    "\\begin{aligned}\n",
    "    z_{t+1} & = A z_t + C w_{t+1}\n",
    "    \\\\\n",
    "    y_t & = U  z_t\n",
    "\\end{aligned} \\tag{3}\n",
    "$$\n",
    "\n",
    "where\n",
    "\n",
    "- $ \\{w_t\\} $ is an IID vector process with $ \\mathbb{E} w_t = 0 $ and $ \\mathbb{E} w_t w_t' = I $.  \n",
    "- The [spectral radius](https://python.quantecon.org/linear_algebra.html#la-neumann-remarks) of $ A $ satisfies $ \\rho(A) < \\sqrt{1/\\beta} $.  \n",
    "- $ U $ is a selection vector that pins down $ y_t $ as a particular linear combination of components of $ z_t $.  \n",
    "\n",
    "\n",
    "The restriction on $ \\rho(A) $ prevents income from growing so fast that discounted geometric sums of some quadratic forms to be described below become infinite.\n",
    "\n",
    "Regarding preferences, we assume the quadratic utility function\n",
    "\n",
    "$$\n",
    "u(c_t) =  - (c_t - \\gamma)^2\n",
    "$$\n",
    "\n",
    "where $ \\gamma $ is a bliss level of consumption\n",
    "\n",
    ">**Note**\n",
    ">\n",
    ">Along with this quadratic utility specification, we allow consumption to be negative.  However, by choosing parameters appropriately, we can make the probability that the model generates negative consumption paths over finite time horizons as low as desired.\n",
    "\n",
    "Finally, we impose the *no Ponzi scheme* condition\n",
    "\n",
    "\n",
    "<a id='equation-sprob3'></a>\n",
    "$$\n",
    "\\mathbb{E}_0 \\left[ \\sum_{t=0}^\\infty \\beta^t b_t^2 \\right] < \\infty \\tag{4}\n",
    "$$\n",
    "\n",
    "This condition rules out an always-borrow scheme that would allow the consumer to enjoy bliss consumption forever."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### First-Order Conditions\n",
    "\n",
    "First-order conditions for maximizing [(1)](#equation-sprob1) subject to [(2)](#equation-sprob2) are\n",
    "\n",
    "\n",
    "<a id='equation-sprob4'></a>\n",
    "$$\n",
    "\\mathbb{E}_t [u'(c_{t+1})] = u'(c_t) , \\qquad t = 0, 1, \\ldots \\tag{5}\n",
    "$$\n",
    "\n",
    "These optimality conditions are also known as  *Euler equations*.\n",
    "\n",
    "If you’re not sure where they come from, you can find a proof sketch in the\n",
    "[appendix](#perm-income-appendix).\n",
    "\n",
    "With our quadratic preference specification, [(5)](#equation-sprob4) has the striking implication that consumption follows a martingale:\n",
    "\n",
    "\n",
    "<a id='equation-sprob5'></a>\n",
    "$$\n",
    "\\mathbb{E}_t [c_{t+1}] = c_t \\tag{6}\n",
    "$$\n",
    "\n",
    "(In fact, quadratic preferences are *necessary* for this conclusion <sup><a href=#f2 id=f2-link>[1]</a></sup>)\n",
    "\n",
    "One way to interpret [(6)](#equation-sprob5) is that consumption will change only when\n",
    "“new information” about permanent income is revealed.\n",
    "\n",
    "These ideas will be clarified below.\n",
    "\n",
    "\n",
    "<a id='odr-pi'></a>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### The Optimal Decision Rule\n",
    "\n",
    "Now let’s deduce the optimal decision rule <sup><a href=#fod id=fod-link>[2]</a></sup>\n",
    "\n",
    ">**Note**\n",
    ">\n",
    ">One way to solve the consumer’s problem is to apply *dynamic programming*\n",
    "as in [this lecture](https://python.quantecon.org/lqcontrol.html).  We do this later. But first we use\n",
    "an alternative approach that is revealing and shows the work that dynamic\n",
    "programming does for us behind the scenes.\n",
    "\n",
    "In doing so, we need to combine\n",
    "\n",
    "1. the optimality condition [(6)](#equation-sprob5)  \n",
    "1. the period-by-period budget constraint [(2)](#equation-sprob2), and  \n",
    "1. the boundary condition [(4)](#equation-sprob3)  \n",
    "\n",
    "\n",
    "To accomplish this, observe first that [(4)](#equation-sprob3) implies $ \\lim_{t \\to \\infty} \\beta^{\\frac{t}{2}} b_{t+1}= 0 $.\n",
    "\n",
    "Using this restriction on the debt path and solving [(2)](#equation-sprob2) forward yields\n",
    "\n",
    "\n",
    "<a id='equation-sprob6'></a>\n",
    "$$\n",
    "b_t = \\sum_{j=0}^\\infty \\beta^j (y_{t+j} - c_{t+j}) \\tag{7}\n",
    "$$\n",
    "\n",
    "Take conditional expectations on both sides of [(7)](#equation-sprob6) and use the martingale property of consumption and the *law of iterated expectations* to deduce\n",
    "\n",
    "\n",
    "<a id='equation-sprob7'></a>\n",
    "$$\n",
    "b_t = \\sum_{j=0}^\\infty \\beta^j \\mathbb{E}_t [y_{t+j}] - \\frac{c_t}{1-\\beta} \\tag{8}\n",
    "$$\n",
    "\n",
    "Expressed in terms of $ c_t $ we get\n",
    "\n",
    "\n",
    "<a id='equation-sprob8'></a>\n",
    "$$\n",
    "c_t\n",
    " = (1-\\beta) \\left[ \\sum_{j=0}^\\infty \\beta^j \\mathbb{E}_t [y_{t+j}] - b_t\\right]\n",
    " = {r \\over 1+r} \\left[ \\sum_{j=0}^\\infty \\beta^j \\mathbb{E}_t [y_{t+j}] - b_t\\right] \\tag{9}\n",
    "$$\n",
    "\n",
    "where the last equality uses $ (1 + r) \\beta = 1 $.\n",
    "\n",
    "These last two equations assert that consumption equals *economic income*\n",
    "\n",
    "- **financial wealth** equals $ -b_t $  \n",
    "- **non-financial wealth** equals $ \\sum_{j=0}^\\infty \\beta^j \\mathbb{E}_t [y_{t+j}] $  \n",
    "- **total wealth** equals the sum of financial and non-financial wealth  \n",
    "- a **marginal propensity to consume out of total wealth** equals the  interest factor $ \\frac{r}{1+r} $  \n",
    "- **economic income** equals  \n",
    "  - a constant marginal propensity to consume  times the sum of non-financial wealth and financial wealth  \n",
    "  - the amount the consumer can consume while leaving its wealth intact  "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Responding to the State\n",
    "\n",
    "The *state* vector confronting the consumer at $ t $ is $ \\begin{bmatrix} b_t & z_t \\end{bmatrix} $.\n",
    "\n",
    "Here\n",
    "\n",
    "- $ z_t $ is an *exogenous* component, unaffected by consumer behavior.  \n",
    "- $ b_t $ is an *endogenous* component (since it depends on the decision rule).  \n",
    "\n",
    "\n",
    "Note that $ z_t $ contains all variables useful for forecasting the consumer’s future endowment.\n",
    "\n",
    "It is plausible that current decisions $ c_t $ and $ b_{t+1} $ should\n",
    "be expressible as functions of $ z_t $ and $ b_t $.\n",
    "\n",
    "This is indeed the case.\n",
    "\n",
    "In fact, from [this discussion](https://python.quantecon.org/linear_models.html#lm-fgs), we see that\n",
    "\n",
    "$$\n",
    "\\sum_{j=0}^\\infty \\beta^j \\mathbb{E}_t [y_{t+j}]\n",
    "= \\mathbb{E}_t \\left[ \\sum_{j=0}^\\infty \\beta^j y_{t+j} \\right]\n",
    "= U(I - \\beta A)^{-1} z_t\n",
    "$$\n",
    "\n",
    "Combining this with [(9)](#equation-sprob8) gives\n",
    "\n",
    "\n",
    "<a id='equation-pi-cpa'></a>\n",
    "$$\n",
    "c_t\n",
    " = {r \\over 1+r}\n",
    "     \\left[\n",
    "         U(I - \\beta A)^{-1} z_t - b_t\n",
    "     \\right] \\tag{10}\n",
    "$$\n",
    "\n",
    "Using this equality to eliminate $ c_t $ in the budget constraint [(2)](#equation-sprob2) gives\n",
    "\n",
    "$$\n",
    "\\begin{aligned}\n",
    "    b_{t+1}\n",
    "    & = (1 + r) (b_t + c_t - y_t)\n",
    "    \\\\\n",
    "    & = (1 + r) b_t + r [ U(I - \\beta A)^{-1} z_t - b_t]  - (1+r) U z_t\n",
    "    \\\\\n",
    "    & = b_t +  U [ r(I - \\beta A)^{-1}  - (1+r) I ]  z_t\n",
    "    \\\\\n",
    "    & = b_t +  U (I - \\beta A)^{-1} (A - I)   z_t\n",
    "\\end{aligned}\n",
    "$$\n",
    "\n",
    "To get from the second last to the last expression in this chain of equalities is not trivial.\n",
    "\n",
    "A key is to use the fact that $ (1 + r) \\beta = 1 $ and $ (I - \\beta A)^{-1} = \\sum_{j=0}^{\\infty} \\beta^j A^j $.\n",
    "\n",
    "We’ve now successfully written $ c_t $ and $ b_{t+1} $ as functions of $ b_t $ and $ z_t $."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### A State-Space Representation\n",
    "\n",
    "We can summarize our dynamics in the form of a linear state-space system governing consumption, debt and income:\n",
    "\n",
    "\n",
    "<a id='equation-pi-ssr'></a>\n",
    "$$\n",
    "\\begin{aligned}\n",
    "  z_{t+1} & = A z_t + C w_{t+1} \\\\\n",
    "  b_{t+1} & = b_t + U [ (I -\\beta A)^{-1} (A - I) ] z_t \\\\\n",
    "      y_t & = U z_t \\\\\n",
    "      c_t & = (1-\\beta) [ U(I-\\beta A)^{-1} z_t - b_t ]\n",
    "\\end{aligned} \\tag{11}\n",
    "$$\n",
    "\n",
    "To write this more succinctly, let\n",
    "\n",
    "$$\n",
    "x_t =\n",
    "\\begin{bmatrix}\n",
    "    z_t\\\\\n",
    "    b_t\n",
    "\\end{bmatrix},\n",
    "\\quad\n",
    "\\tilde A =\n",
    "\\begin{bmatrix}\n",
    "    A & 0 \\\\\n",
    "    U(I-\\beta A)^{-1}(A-I) & 1\n",
    " \\end{bmatrix},\n",
    " \\quad\n",
    "\\tilde C =\n",
    "\\begin{bmatrix}\n",
    "    C\\\\\n",
    "    0\n",
    "\\end{bmatrix}\n",
    "$$\n",
    "\n",
    "and\n",
    "\n",
    "$$\n",
    "\\tilde U =\n",
    "\\begin{bmatrix}\n",
    "    U & 0 \\\\\n",
    "    (1-\\beta) U (I - \\beta A)^{-1} & -(1-\\beta)\n",
    "\\end{bmatrix}, \\quad\n",
    "\\tilde y_t =\n",
    "\\begin{bmatrix}\n",
    "      y_t\\\\\n",
    "      c_t\n",
    "  \\end{bmatrix}\n",
    "$$\n",
    "\n",
    "Then we can express equation  [(11)](#equation-pi-ssr) as\n",
    "\n",
    "\n",
    "<a id='equation-pi-stsp'></a>\n",
    "$$\n",
    "\\begin{aligned}\n",
    "  x_{t+1} & = \\tilde A x_t + \\tilde C w_{t+1} \\\\\n",
    "  \\tilde y_t & = \\tilde U x_t\n",
    "\\end{aligned} \\tag{12}\n",
    "$$\n",
    "\n",
    "We can use the following formulas from [linear state space models](https://python.quantecon.org/linear_models.html) to compute population mean $ \\mu_t = \\mathbb{E}    x_t $ and covariance $ \\Sigma_t := \\mathbb{E} [ (x_t - \\mu_t) (x_t - \\mu_t)'] $\n",
    "\n",
    "\n",
    "<a id='equation-lss-mut-perm-income'></a>\n",
    "$$\n",
    "\\mu_{t+1} = \\tilde A \\mu_t\n",
    "\\quad \\text{with} \\quad \\mu_0 \\text{ given} \\tag{13}\n",
    "$$\n",
    "\n",
    "\n",
    "<a id='equation-eqsigmalaw'></a>\n",
    "$$\n",
    "\\Sigma_{t+1}  = \\tilde A  \\Sigma_t \\tilde A' + \\tilde C \\tilde C'\n",
    "\\quad \\text{with} \\quad \\Sigma_0 \\text{ given} \\tag{14}\n",
    "$$\n",
    "\n",
    "We can then compute the mean and covariance of $ \\tilde y_t $ from\n",
    "\n",
    "\n",
    "<a id='equation-eqymoments'></a>\n",
    "$$\n",
    "\\begin{aligned}\n",
    "\\mu_{y,t} = \\tilde U \\mu_t \\\\\n",
    "\\Sigma_{y,t} = \\tilde U \\Sigma_t \\tilde U'\n",
    "\\end{aligned} \\tag{15}\n",
    "$$"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### A Simple Example with IID Income\n",
    "\n",
    "To gain some preliminary intuition on the implications of [(11)](#equation-pi-ssr), let’s look at a highly stylized example where income is just IID.\n",
    "\n",
    "(Later examples will investigate more realistic income streams)\n",
    "\n",
    "In particular, let $ \\{w_t\\}_{t = 1}^{\\infty} $ be IID and scalar standard normal, and let\n",
    "\n",
    "$$\n",
    "z_t =\n",
    "\\begin{bmatrix}\n",
    "    z^1_t \\\\\n",
    "    1\n",
    "\\end{bmatrix},\n",
    "\\quad\n",
    "A =\n",
    "\\begin{bmatrix}\n",
    "    0 & 0 \\\\\n",
    "    0 & 1\n",
    "\\end{bmatrix},\n",
    "\\quad\n",
    "U =\n",
    "\\begin{bmatrix}\n",
    "    1 & \\mu\n",
    "\\end{bmatrix},\n",
    "\\quad\n",
    "C =\n",
    "\\begin{bmatrix}\n",
    "    \\sigma \\\\\n",
    "    0\n",
    "\\end{bmatrix}\n",
    "$$\n",
    "\n",
    "Finally, let $ b_0 = z^1_0 = 0 $.\n",
    "\n",
    "Under these assumptions, we have $ y_t = \\mu + \\sigma w_t \\sim N(\\mu, \\sigma^2) $.\n",
    "\n",
    "Further, if you work through the state space representation, you will see that\n",
    "\n",
    "$$\n",
    "\\begin{aligned}\n",
    "    b_t & = - \\sigma \\sum_{j=1}^{t-1} w_j\n",
    "    \\\\\n",
    "    c_t & = \\mu + (1 - \\beta) \\sigma \\sum_{j=1}^t w_j\n",
    "\\end{aligned}\n",
    "$$\n",
    "\n",
    "Thus income is IID and debt and consumption are both Gaussian random walks.\n",
    "\n",
    "Defining assets as $ -b_t $, we see that assets are just the cumulative sum of unanticipated incomes prior to the present date.\n",
    "\n",
    "The next figure shows a typical realization with $ r = 0.05 $, $ \\mu = 1 $, and $ \\sigma = 0.15 $"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "hide-output": false
   },
   "outputs": [],
   "source": [
    "r = 0.05\n",
    "β = 1 / (1 + r)\n",
    "σ = 0.15\n",
    "μ = 1\n",
    "T = 60\n",
    "\n",
    "@njit\n",
    "def time_path(T):\n",
    "    w = np.random.randn(T+1)  # w_0, w_1, ..., w_T\n",
    "    w[0] = 0\n",
    "    b = np.zeros(T+1)\n",
    "    for t in range(1, T+1):\n",
    "        b[t] = w[1:t].sum()\n",
    "    b = -σ * b\n",
    "    c = μ + (1 - β) * (σ * w - b)\n",
    "    return w, b, c\n",
    "\n",
    "w, b, c = time_path(T)\n",
    "\n",
    "fig, ax = plt.subplots(figsize=(10, 6))\n",
    "\n",
    "ax.plot(μ + σ * w, 'g-', label=\"Non-financial income\")\n",
    "ax.plot(c, 'k-', label=\"Consumption\")\n",
    "ax.plot( b, 'b-', label=\"Debt\")\n",
    "ax.legend(ncol=3, mode='expand', bbox_to_anchor=(0., 1.02, 1., .102))\n",
    "ax.grid()\n",
    "ax.set_xlabel('Time')\n",
    "\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Observe that consumption is considerably smoother than income.\n",
    "\n",
    "The figure below shows the consumption paths of 250 consumers with independent income streams"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "hide-output": false
   },
   "outputs": [],
   "source": [
    "fig, ax = plt.subplots(figsize=(10, 6))\n",
    "\n",
    "b_sum = np.zeros(T+1)\n",
    "for i in range(250):\n",
    "    w, b, c = time_path(T)  # Generate new time path\n",
    "    rcolor = random.choice(('c', 'g', 'b', 'k'))\n",
    "    ax.plot(c, color=rcolor, lw=0.8, alpha=0.7)\n",
    "\n",
    "ax.grid()\n",
    "ax.set(xlabel='Time', ylabel='Consumption')\n",
    "\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Alternative Representations\n",
    "\n",
    "In this section, we shed more light on the evolution of savings, debt and\n",
    "consumption by representing their dynamics in several different ways."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Hall’s Representation\n",
    "\n",
    "\n",
    "<a id='index-3'></a>\n",
    "Hall [[Hal78]](https://python.quantecon.org/zreferences.html#hall1978) suggested an insightful way to summarize the implications of LQ permanent income theory.\n",
    "\n",
    "First, to represent the solution for $ b_t $, shift [(9)](#equation-sprob8) forward one period and eliminate $ b_{t+1} $ by using [(2)](#equation-sprob2) to obtain\n",
    "\n",
    "$$\n",
    "c_{t+1} = (1-\\beta)\\sum_{j=0}^\\infty \\beta^j  \\mathbb{E}_{t+1} [y_{t+j+1}] -\n",
    "(1-\\beta) \\left[ \\beta^{-1} (c_t + b_t - y_t) \\right]\n",
    "$$\n",
    "\n",
    "If we add and subtract $ \\beta^{-1} (1-\\beta) \\sum_{j=0}^\\infty \\beta^j \\mathbb{E}_t y_{t+j} $ from the right side of the preceding equation and rearrange, we obtain\n",
    "\n",
    "\n",
    "<a id='equation-sprob11'></a>\n",
    "$$\n",
    "c_{t+1} - c_t = (1-\\beta) \\sum_{j=0}^\\infty \\beta^j\n",
    "    \\left\\{ \\mathbb{E}_{t+1} [y_{t+j+1}] - \\mathbb{E}_t [y_{t+j+1}] \\right\\} \\tag{16}\n",
    "$$\n",
    "\n",
    "The right side is the time $ t+1 $ *innovation to the expected present value* of the endowment process $ \\{y_t\\} $.\n",
    "\n",
    "We can represent the optimal decision rule for $ (c_t, b_{t+1}) $ in the form of [(16)](#equation-sprob11) and [(8)](#equation-sprob7), which we repeat:\n",
    "\n",
    "\n",
    "<a id='equation-sprob7aa'></a>\n",
    "$$\n",
    "b_t = \\sum_{j=0}^\\infty \\beta^j \\mathbb{E}_t [y_{t+j}] - {1 \\over 1-\\beta} c_t \\tag{17}\n",
    "$$\n",
    "\n",
    "Equation [(17)](#equation-sprob7aa) asserts that the consumer’s debt due at $ t $ equals the expected present value of its endowment minus the expected present value of its consumption stream.\n",
    "\n",
    "A high debt thus indicates a large expected present value of surpluses $ y_t - c_t $.\n",
    "\n",
    "Recalling again our discussion on [forecasting geometric sums](https://python.quantecon.org/linear_models.html#lm-fgs), we have\n",
    "\n",
    "$$\n",
    "\\begin{aligned}\n",
    "    \\mathbb{E}_t \\sum_{j=0}^\\infty \\beta^j y_{t+j} &= U (I-\\beta A)^{-1} z_t \\\\\n",
    "    \\mathbb{E}_{t+1} \\sum_{j=0}^\\infty \\beta^j y_{t+j+1} & = U (I -\\beta A)^{-1} z_{t+1} \\\\\n",
    "    \\mathbb{E}_t \\sum_{j=0}^\\infty \\beta^j y_{t+j+1} & = U (I - \\beta A)^{-1} A z_t\n",
    "\\end{aligned}\n",
    "$$\n",
    "\n",
    "Using  these formulas together with [(3)](#equation-sprob15ab) and substituting  into [(16)](#equation-sprob11) and [(17)](#equation-sprob7aa)  gives the following representation for the consumer’s optimum decision rule:\n",
    "\n",
    "\n",
    "<a id='equation-sprob16abcd'></a>\n",
    "$$\n",
    "\\begin{aligned}\n",
    "    c_{t+1} & = c_t + (1-\\beta) U  (I-\\beta A)^{-1} C w_{t+1} \\\\\n",
    "    b_t & = U (I-\\beta A)^{-1} z_t - {1 \\over 1-\\beta} c_t \\\\\n",
    "    y_t & = U z_t \\\\\n",
    "    z_{t+1} & = A z_t + C w_{t+1}\n",
    "\\end{aligned} \\tag{18}\n",
    "$$\n",
    "\n",
    "Representation [(18)](#equation-sprob16abcd) makes clear that\n",
    "\n",
    "- The state can be taken as $ (c_t, z_t) $.  \n",
    "  \n",
    "  - The endogenous part is $ c_t $ and the exogenous part is $ z_t $.  \n",
    "  - Debt $ b_t $ has disappeared as a component of the state because it is encoded in $ c_t $.  \n",
    "  \n",
    "- Consumption is a random walk with innovation $ (1-\\beta) U  (I-\\beta A)^{-1} C w_{t+1} $.  \n",
    "  \n",
    "  - This is a more explicit representation of the martingale result in [(6)](#equation-sprob5).  \n",
    "  \n",
    "\n",
    "\n",
    "\n",
    "<a id='coint-pi'></a>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Cointegration\n",
    "\n",
    "Representation [(18)](#equation-sprob16abcd) reveals that the joint process $ \\{c_t, b_t\\} $ possesses the property that Engle and Granger [[EG87]](https://python.quantecon.org/zreferences.html#englegranger1987) called [cointegration](https://en.wikipedia.org/wiki/Cointegration).\n",
    "\n",
    "Cointegration is a tool that allows us to apply powerful results from the theory of stationary stochastic processes to (certain transformations of) nonstationary models.\n",
    "\n",
    "To apply cointegration in the present context, suppose that $ z_t $ is asymptotically stationary <sup><a href=#fn-as id=fn-as-link>[4]</a></sup>.\n",
    "\n",
    "Despite this, both $ c_t $ and $ b_t $ will be non-stationary because they have unit roots (see [(11)](#equation-pi-ssr) for $ b_t $).\n",
    "\n",
    "Nevertheless, there is a linear combination of $ c_t, b_t $ that *is* asymptotically stationary.\n",
    "\n",
    "In particular, from the second equality in [(18)](#equation-sprob16abcd) we have\n",
    "\n",
    "\n",
    "<a id='equation-pi-spr'></a>\n",
    "$$\n",
    "(1-\\beta) b_t + c_t = (1 - \\beta) U (I-\\beta A)^{-1} z_t \\tag{19}\n",
    "$$\n",
    "\n",
    "Hence the linear combination $ (1-\\beta) b_t + c_t $ is asymptotically stationary.\n",
    "\n",
    "Accordingly, Granger and Engle would call $ \\begin{bmatrix} (1-\\beta) & 1 \\end{bmatrix} $ a **cointegrating vector** for the state.\n",
    "\n",
    "When applied to the nonstationary vector process $ \\begin{bmatrix} b_t  & c_t \\end{bmatrix}' $, it yields a process that is asymptotically stationary.\n",
    "\n",
    "Equation [(19)](#equation-pi-spr) can be rearranged to take the form\n",
    "\n",
    "\n",
    "<a id='equation-sprob77'></a>\n",
    "$$\n",
    "(1-\\beta) b_t + c_t = (1-\\beta) \\mathbb{E}_t \\sum_{j=0}^\\infty \\beta^j y_{t+j} \\tag{20}\n",
    "$$\n",
    "\n",
    "Equation [(20)](#equation-sprob77)  asserts that the *cointegrating residual*  on the left side equals the conditional expectation of the geometric sum of future incomes on the right <sup><a href=#f8 id=f8-link>[6]</a></sup>."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Cross-Sectional Implications\n",
    "\n",
    "Consider again [(18)](#equation-sprob16abcd), this time in light of our discussion of\n",
    "distribution dynamics in the [lecture on linear systems](https://python.quantecon.org/linear_models.html).\n",
    "\n",
    "The dynamics of $ c_t $ are given by\n",
    "\n",
    "\n",
    "<a id='equation-pi-crw'></a>\n",
    "$$\n",
    "c_{t+1} = c_t + (1-\\beta) U  (I-\\beta A)^{-1} C w_{t+1} \\tag{21}\n",
    "$$\n",
    "\n",
    "or\n",
    "\n",
    "$$\n",
    "c_t = c_0 + \\sum_{j=1}^t \\hat w_j\n",
    "\\quad \\text{for} \\quad\n",
    "\\hat w_{t+1} := (1-\\beta) U  (I-\\beta A)^{-1} C w_{t+1}\n",
    "$$\n",
    "\n",
    "The unit root affecting $ c_t $ causes the time $ t $ variance of $ c_t $ to grow linearly with $ t $.\n",
    "\n",
    "In particular, since $ \\{ \\hat w_t \\} $ is IID, we have\n",
    "\n",
    "\n",
    "<a id='equation-pi-vt'></a>\n",
    "$$\n",
    "\\mathrm{Var}[c_t] = \\mathrm{Var}[c_0] + t \\, \\hat \\sigma^2 \\tag{22}\n",
    "$$\n",
    "\n",
    "where\n",
    "\n",
    "$$\n",
    "\\hat \\sigma^2 := (1-\\beta)^2 U  (I-\\beta A)^{-1} CC' (I-\\beta A')^{-1} U'\n",
    "$$\n",
    "\n",
    "When $ \\hat \\sigma > 0 $, $ \\{c_t\\} $ has no asymptotic distribution.\n",
    "\n",
    "Let’s consider what this means for a cross-section of ex-ante identical consumers born at time $ 0 $.\n",
    "\n",
    "Let the distribution of $ c_0 $ represent the cross-section of initial consumption values.\n",
    "\n",
    "Equation [(22)](#equation-pi-vt) tells us that the variance of $ c_t $ increases over time at a rate proportional to $ t $.\n",
    "\n",
    "A number of different studies have investigated this prediction and found some support for it\n",
    "(see, e.g., [[DP94]](https://python.quantecon.org/zreferences.html#deatonpaxton1994), [[STY04]](https://python.quantecon.org/zreferences.html#sty2004))."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Impulse Response Functions\n",
    "\n",
    "Impulse response functions measure responses  to various  impulses (i.e., temporary shocks).\n",
    "\n",
    "The impulse response function of $ \\{c_t\\} $ to the innovation $ \\{w_t\\} $ is a box.\n",
    "\n",
    "In particular, the response of $ c_{t+j} $ to a unit increase in the innovation $ w_{t+1} $ is $ (1-\\beta) U (I -\\beta A)^{-1} C $ for all $ j \\geq 1 $."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Moving Average Representation\n",
    "\n",
    "It’s useful to express the innovation to the expected present value of the endowment process in terms of a moving average representation for income $ y_t $.\n",
    "\n",
    "The endowment process defined by [(3)](#equation-sprob15ab) has the moving average representation\n",
    "\n",
    "\n",
    "<a id='equation-sprob12'></a>\n",
    "$$\n",
    "y_{t+1} = d(L) w_{t+1} \\tag{23}\n",
    "$$\n",
    "\n",
    "where\n",
    "\n",
    "- $ d(L) = \\sum_{j=0}^\\infty d_j L^j $ for some sequence $ d_j $, where $ L $ is the lag operator <sup><a href=#f4 id=f4-link>[3]</a></sup>  \n",
    "- at time $ t $, the consumer has an information set <sup><a href=#f5 id=f5-link>[5]</a></sup> $ w^t = [w_t, w_{t-1}, \\ldots ] $  \n",
    "\n",
    "\n",
    "Notice that\n",
    "\n",
    "$$\n",
    "y_{t+j} - \\mathbb{E}_t [y_{t+j}] = d_0 w_{t+j} + d_1 w_{t+j-1} + \\cdots + d_{j-1} w_{t+1}\n",
    "$$\n",
    "\n",
    "It follows that\n",
    "\n",
    "\n",
    "<a id='equation-sprob120'></a>\n",
    "$$\n",
    "\\mathbb{E}_{t+1} [y_{t+j}] - \\mathbb{E}_t [y_{t+j}] = d_{j-1} w_{t+1} \\tag{24}\n",
    "$$\n",
    "\n",
    "Using [(24)](#equation-sprob120) in [(16)](#equation-sprob11) gives\n",
    "\n",
    "\n",
    "<a id='equation-sprob13'></a>\n",
    "$$\n",
    "c_{t+1} - c_t = (1-\\beta) d(\\beta) w_{t+1} \\tag{25}\n",
    "$$\n",
    "\n",
    "The object $ d(\\beta) $ is the **present value of the moving average coefficients** in the representation for the endowment process $ y_t $.\n",
    "\n",
    "\n",
    "<a id='sub-classic-consumption'></a>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Two Classic Examples\n",
    "\n",
    "We illustrate some of the preceding ideas with two examples.\n",
    "\n",
    "In both examples, the endowment follows the process $ y_t = z_{1t} + z_{2t} $ where\n",
    "\n",
    "$$\n",
    "\\begin{bmatrix}\n",
    "  z_{1 t+1} \\\\\n",
    "  z_{2t+1}\n",
    "\\end{bmatrix} =\n",
    "\\begin{bmatrix}\n",
    "  1 & 0 \\\\\n",
    "  0 & 0\n",
    "\\end{bmatrix}\n",
    "\\begin{bmatrix}\n",
    "  z_{1t} \\\\\n",
    "  z_{2t}\n",
    "\\end{bmatrix} + \\begin{bmatrix}\n",
    "      \\sigma_1 & 0 \\\\\n",
    "      0 & \\sigma_2\n",
    "  \\end{bmatrix}\n",
    "  \\begin{bmatrix}\n",
    "      w_{1t+1} \\\\\n",
    "      w_{2t+1}\n",
    "  \\end{bmatrix}\n",
    "$$\n",
    "\n",
    "Here\n",
    "\n",
    "- $ w_{t+1} $ is an IID $ 2 \\times 1 $ process distributed as $ N(0,I) $.  \n",
    "- $ z_{1t} $ is a permanent component of $ y_t $.  \n",
    "- $ z_{2t} $ is a purely transitory component of $ y_t $.  "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Example 1\n",
    "\n",
    "Assume as before that the consumer observes the state $ z_t $ at time $ t $.\n",
    "\n",
    "In view of [(18)](#equation-sprob16abcd) we have\n",
    "\n",
    "\n",
    "<a id='equation-consexample1'></a>\n",
    "$$\n",
    "c_{t+1} - c_t = \\sigma_1 w_{1t+1} + (1-\\beta) \\sigma_2 w_{2t+1} \\tag{26}\n",
    "$$\n",
    "\n",
    "Formula [(26)](#equation-consexample1) shows how an increment $ \\sigma_1 w_{1t+1} $ to the permanent component of income $ z_{1t+1} $ leads to\n",
    "\n",
    "- a permanent one-for-one increase in consumption and  \n",
    "- no increase in savings $ -b_{t+1} $  \n",
    "\n",
    "\n",
    "But the purely transitory component of income $ \\sigma_2 w_{2t+1} $ leads to a permanent increment in consumption by a fraction $ 1-\\beta $ of transitory income.\n",
    "\n",
    "The remaining fraction $ \\beta $ is saved, leading to a permanent increment in $ -b_{t+1} $.\n",
    "\n",
    "Application of the formula for debt in [(11)](#equation-pi-ssr) to this example shows that\n",
    "\n",
    "\n",
    "<a id='equation-consexample1a'></a>\n",
    "$$\n",
    "b_{t+1} - b_t = - z_{2t} = - \\sigma_2 w_{2t} \\tag{27}\n",
    "$$\n",
    "\n",
    "This confirms that none of $ \\sigma_1 w_{1t} $ is saved, while all of $ \\sigma_2 w_{2t} $ is saved.\n",
    "\n",
    "The next figure illustrates these very different reactions to transitory and\n",
    "permanent income shocks using impulse-response functions"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "hide-output": false
   },
   "outputs": [],
   "source": [
    "r = 0.05\n",
    "β = 1 / (1 + r)\n",
    "S = 5   # Impulse date\n",
    "σ1 = σ2 = 0.15\n",
    "\n",
    "@njit\n",
    "def time_path(T, permanent=False):\n",
    "    \"Time path of consumption and debt given shock sequence\"\n",
    "    w1 = np.zeros(T+1)\n",
    "    w2 = np.zeros(T+1)\n",
    "    b = np.zeros(T+1)\n",
    "    c = np.zeros(T+1)\n",
    "    if permanent:\n",
    "        w1[S+1] = 1.0\n",
    "    else:\n",
    "        w2[S+1] = 1.0\n",
    "    for t in range(1, T):\n",
    "        b[t+1] = b[t] - σ2 * w2[t]\n",
    "        c[t+1] = c[t] + σ1 * w1[t+1] + (1 - β) * σ2 * w2[t+1]\n",
    "    return b, c\n",
    "\n",
    "\n",
    "fig, axes = plt.subplots(2, 1, figsize=(10, 8))\n",
    "titles = ['transitory', 'permanent']\n",
    "\n",
    "L = 0.175\n",
    "\n",
    "for ax, truefalse, title in zip(axes, (True, False), titles):\n",
    "    b, c = time_path(T=20, permanent=truefalse)\n",
    "    ax.set_title(f'Impulse reponse: {title} income shock')\n",
    "    ax.plot(c, 'g-', label=\"consumption\")\n",
    "    ax.plot(b, 'b-', label=\"debt\")\n",
    "    ax.plot((S, S), (-L, L), 'k-', lw=0.5)\n",
    "    ax.grid(alpha=0.5)\n",
    "    ax.set(xlabel=r'Time', ylim=(-L, L))\n",
    "\n",
    "axes[0].legend(loc='lower right')\n",
    "\n",
    "plt.tight_layout()\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Example 2\n",
    "\n",
    "Assume now that at time $ t $ the consumer observes $ y_t $, and its history up to $ t $, but not $ z_t $.\n",
    "\n",
    "Under this assumption, it is appropriate to use an *innovation representation* to form $ A, C, U $ in [(18)](#equation-sprob16abcd).\n",
    "\n",
    "The discussion in sections 2.9.1 and 2.11.3 of [[LS18]](https://python.quantecon.org/zreferences.html#ljungqvist2012) shows that the pertinent state space representation for $ y_t $ is\n",
    "\n",
    "$$\n",
    "\\begin{aligned}\n",
    "  \\begin{bmatrix}\n",
    "    y_{t+1} \\\\\n",
    "    a_{t+1}\n",
    "  \\end{bmatrix}\n",
    "    & =\n",
    "    \\begin{bmatrix}\n",
    "        1 & -(1 - K) \\\\\n",
    "        0 & 0\n",
    "    \\end{bmatrix}\n",
    "    \\begin{bmatrix}\n",
    "        y_t \\\\\n",
    "        a_t\n",
    "    \\end{bmatrix} +\n",
    "    \\begin{bmatrix}\n",
    "        1 \\\\\n",
    "        1\n",
    "    \\end{bmatrix}\n",
    "    a_{t+1}\n",
    "    \\\\\n",
    "    y_t\n",
    "    & =\n",
    "    \\begin{bmatrix}\n",
    "        1 & 0\n",
    "    \\end{bmatrix}\n",
    "    \\begin{bmatrix}\n",
    "        y_t \\\\\n",
    "        a_t\n",
    "    \\end{bmatrix}\n",
    "\\end{aligned}\n",
    "$$\n",
    "\n",
    "where\n",
    "\n",
    "- $ K := $ the stationary Kalman gain  \n",
    "- $ a_t := y_t - E [ y_t \\,|\\, y_{t-1}, \\ldots, y_0] $  \n",
    "\n",
    "\n",
    "In the same discussion in [[LS18]](https://python.quantecon.org/zreferences.html#ljungqvist2012) it is shown that $ K \\in [0,1] $ and that $ K $ increases as $ \\sigma_1/\\sigma_2 $ does.\n",
    "\n",
    "In other words, $ K $ increases as the ratio of the standard deviation of the permanent shock to that of the transitory shock increases.\n",
    "\n",
    "Please see  [first look at the Kalman filter](https://python.quantecon.org/kalman.html).\n",
    "\n",
    "Applying formulas [(18)](#equation-sprob16abcd) implies\n",
    "\n",
    "\n",
    "<a id='equation-consexample2'></a>\n",
    "$$\n",
    "c_{t+1} - c_t = [1-\\beta(1-K) ] a_{t+1} \\tag{28}\n",
    "$$\n",
    "\n",
    "where the endowment process can now be represented in terms of the univariate innovation to $ y_t $ as\n",
    "\n",
    "\n",
    "<a id='equation-incomemaar'></a>\n",
    "$$\n",
    "y_{t+1} - y_t = a_{t+1} - (1-K) a_t \\tag{29}\n",
    "$$\n",
    "\n",
    "Equation [(29)](#equation-incomemaar) indicates that the consumer regards\n",
    "\n",
    "- fraction $ K $ of an innovation $ a_{t+1} $ to $ y_{t+1} $ as *permanent*  \n",
    "- fraction $ 1-K $ as purely transitory  \n",
    "\n",
    "\n",
    "The consumer permanently increases his consumption by the full amount of his estimate of the permanent part of $ a_{t+1} $, but by only $ (1-\\beta) $ times his estimate of the purely transitory part of $ a_{t+1} $.\n",
    "\n",
    "Therefore, in total, he permanently increments his consumption by a fraction $ K + (1-\\beta) (1-K) = 1 - \\beta (1-K) $ of $ a_{t+1} $.\n",
    "\n",
    "He saves the remaining fraction $ \\beta (1-K) $.\n",
    "\n",
    "According to equation [(29)](#equation-incomemaar), the first difference of income is a first-order moving average.\n",
    "\n",
    "Equation  [(28)](#equation-consexample2) asserts that the first difference of consumption is IID.\n",
    "\n",
    "Application of formula to this example shows that\n",
    "\n",
    "\n",
    "<a id='equation-consexample1b'></a>\n",
    "$$\n",
    "b_{t+1} - b_t = (K-1) a_t \\tag{30}\n",
    "$$\n",
    "\n",
    "This indicates how the fraction $ K $ of the innovation to $ y_t $ that is regarded as permanent influences the fraction of the innovation that is saved."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Further Reading\n",
    "\n",
    "The model described above significantly changed how economists think about\n",
    "consumption.\n",
    "\n",
    "While Hall’s model does a remarkably good job as a first approximation to consumption data, it’s widely believed that it doesn’t capture important aspects of some consumption/savings data.\n",
    "\n",
    "For example, liquidity constraints and precautionary savings appear to be present sometimes.\n",
    "\n",
    "Further discussion can be found in, e.g., [[HM82]](https://python.quantecon.org/zreferences.html#hallmishkin1982), [[Par99]](https://python.quantecon.org/zreferences.html#parker1999), [[Dea91]](https://python.quantecon.org/zreferences.html#deaton1991), [[Car01]](https://python.quantecon.org/zreferences.html#carroll2001).\n",
    "\n",
    "\n",
    "<a id='perm-income-appendix'></a>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Appendix: The Euler Equation\n",
    "\n",
    "Where does the first-order condition [(5)](#equation-sprob4) come from?\n",
    "\n",
    "Here we’ll give a proof for the two-period case, which is representative of\n",
    "the general argument.\n",
    "\n",
    "The finite horizon equivalent of the no-Ponzi condition is that the agent\n",
    "cannot end her life in debt, so $ b_2 = 0 $.\n",
    "\n",
    "From the budget constraint [(2)](#equation-sprob2) we then have\n",
    "\n",
    "$$\n",
    "c_0 = \\frac{b_1}{1 + r} - b_0 + y_0\n",
    "\\quad \\text{and} \\quad\n",
    "c_1 = y_1 - b_1\n",
    "$$\n",
    "\n",
    "Here $ b_0 $ and $ y_0 $ are given constants.\n",
    "\n",
    "Substituting these constraints into our two-period objective $ u(c_0) + \\beta \\mathbb{E}_0 [u(c_1)] $ gives\n",
    "\n",
    "$$\n",
    "\\max_{b_1}\n",
    " \\left\\{\n",
    "     u \\left(\\frac{b_1}{R} - b_0 + y_0 \\right) +\n",
    "     \\beta \\, \\mathbb{E}_0 [ u (y_1 - b_1) ]\n",
    "\\right\\}\n",
    "$$\n",
    "\n",
    "You will be able to verify that the first-order condition is\n",
    "\n",
    "$$\n",
    "u'(c_0) = \\beta R  \\,\\mathbb{E}_0 [u'(c_1)]\n",
    "$$\n",
    "\n",
    "Using $ \\beta R = 1 $ gives [(5)](#equation-sprob4) in the two-period case.\n",
    "\n",
    "The proof for the general case is similar"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Footnotes**\n",
    "\n",
    "<p><a id=f2 href=#f2-link><strong>[1]</strong></a> A linear marginal utility is essential for deriving [(6)](#equation-sprob5) from [(5)](#equation-sprob4).  Suppose instead that we had imposed the following more standard assumptions on the utility function: $ u'(c) >0, u''(c)<0, u'''(c) > 0 $ and required that $ c \\geq 0 $.  The Euler equation remains [(5)](#equation-sprob4). But the fact that $ u''' <0 $ implies via Jensen’s inequality that $ \\mathbb{E}_t [u'(c_{t+1})] >  u'(\\mathbb{E}_t [c_{t+1}]) $.  This inequality together with [(5)](#equation-sprob4) implies that $ \\mathbb{E}_t [c_{t+1}] > c_t $ (consumption is said to be a ‘submartingale’), so that consumption stochastically diverges to $ +\\infty $.  The consumer’s savings also diverge to $ +\\infty $.\n",
    "\n",
    "<p><a id=fod href=#fod-link><strong>[2]</strong></a> An optimal decision rule is a map from the current state into current actions—in this case, consumption.\n",
    "\n",
    "<p><a id=f4 href=#f4-link><strong>[3]</strong></a> Representation [(3)](#equation-sprob15ab) implies that $ d(L) = U (I - A L)^{-1} C $.\n",
    "\n",
    "<p><a id=fn-as href=#fn-as-link><strong>[4]</strong></a> This would be the case if, for example, the [spectral radius](https://python.quantecon.org/linear_algebra.html#la-neumann-remarks) of $ A $ is strictly less than one.\n",
    "\n",
    "<p><a id=f5 href=#f5-link><strong>[5]</strong></a> A moving average representation for a process $ y_t $ is said to be **fundamental** if the linear space spanned by $ y^t $ is equal to the linear space spanned by $ w^t $.  A time-invariant innovations representation, attained via the Kalman filter, is by construction fundamental.\n",
    "\n",
    "<p><a id=f8 href=#f8-link><strong>[6]</strong></a> See [[JYC88]](https://python.quantecon.org/zreferences.html#campbellshiller88), [[LL01]](https://python.quantecon.org/zreferences.html#lettlud2001), [[LL04]](https://python.quantecon.org/zreferences.html#lettlud2004) for interesting applications of related ideas."
   ]
  }
 ],
 "metadata": {
  "date": 1584334751.9199235,
  "filename": "perm_income.rst",
  "kernelspec": {
   "display_name": "Python",
   "language": "python3",
   "name": "python3"
  },
  "title": "Optimal Savings I: The Permanent Income Model"
 },
 "nbformat": 4,
 "nbformat_minor": 2
}