Setting Up Stochastic Integration

The Riemann-Stieltjes integral generalizes the Riemann integral, allowing us to integrate functions (an integrand) with respect to other functions (the integrator). In stochastic integration, we’d like to consider a random integrator. We can imagine this as integrating a function weighted randomly, rather than by interval width (Riemann) or a deterministic function (Riemann-Stieltjes). Is this possible? There are a couple of bumps in the road…

in progress.

divider

Variations

We are motivated by Riemann-Stieltjes integration, which usually assumes an integrator with finite or bounded variation. We want to model randomness, so how can we understand the variation of Brownian motion?

Def: Define the total variation, TV,TV, and quadratic variation, QV,QV, of a function f(t)f(t) on t[a,b]t\in [a,b] as:

TV(f;[a,b])=supkϕsupti=0kf(ti+1)f(ti)TV(f; [a,b]) = \sup_{k \geq \phi} \sup_{t} \sum_{i=0}^k |f(t_{i+1}) - f(t_i)|

and

QV(f;[a,b])=supkϕsupti=0k(f(ti+1)f(ti))2,QV(f; [a,b]) = \sup_{k\geq \phi} \sup_t \sum_{i=0}^k (f(t_{i+1}) - f(t_i))^2,

where the second sup\sup ranging over tt is for a=t0<t1<...<tn=b.a = t_0 < t_1 < ... < t_n = b.

For BtB_t Brownian motion,

TV({Bt}[a,b];[a,b])= a.s. for any a<bTV(\{B_t\}_{[a,b]} ; [a,b]) = \infty \text{ a.s. for any } a<b

and

QV({Bt}[a,b];[a,b])=ba in probability and L2.QV(\{B_t\}_{[a,b]} ; [a,b]) = b-a \text{ in probability and } \mathcal{L}^2.

Pf.

Let k[a,b]\prod_k[a,b] be the set of all partitions on the interval [a,b][a,b] with k+1k+1 pieces: a=t0<t1<...<tk<tk+1=b.a = t_0 < t_1 < ... < t_k < t_{k+1} = b.

Let [a,b]=kk[a,b]\prod[a,b] = \bigcup_k \prod_k[a,b] be the set of all partitions.

We need to find a sequence of partitions πn[a,b]\pi_n \in \prod_{[a,b]} such that

tiπnBti+1Bti a.s.\sum_{t_i \in \pi_n} |B_{t_{i+1} - B_{t_i}}| \rightarrow \infty \text{ a.s.}

Consider for any π[a,b]\pi \in \prod_{[a,b]}:

E[tiπ(Bti+1Bti)2]=tiπ(ti+1ti)=ba.\E \left[ \sum_{t_i \in \pi} (B_{t_{i+1}} - B_{t_i})^2 \right] = \sum_{t_i \in \pi} (t_{i+1}- t_i) = b-a.

Let Zi=(Bti+1Bti)2(ti+1ti).Z_i = (B_{t_{i+1}} - B_{t_i})^2 - (t_{i+1}- t_i). The ZiZ_i are independent with law (ζ21)(ti+1ti),(\zeta^2 - 1)(t_{i+1} - t_i), with ζN(0,1).\zeta \sim N(0, 1).

This implies that

E[(ti(Bti+1Bti)2(ba))2]=E[tiZi2]=E[(ζ21)2](ti+1ti)2.\begin{align*} &\E \left[ \left( \sum_{t_i} (B_{t_{i+1}} - B_{t_i})^2 - (b-a)\right)^2 \right] \\ &= \E \left[ \sum_{t_i} Z_i^2 \right] \\ &= \E \left[(\zeta^2 - 1)^2 \right] \cdot \sum(t_{i+1} - t_i)^2. \end{align*}

Choose {πn}[a,b]\{ \pi_n\} \subset \prod_{[a,b]} such that suptiπnti+1ti0.\sup_{t_i \in \pi_n} |t_{i+1} - t_i| \rightarrow 0. Then the above is

E((ζ21)2)suptiπti+1ti(ti+1ti).\leq \E((\zeta^2 -1)^2) \cdot \sup_{t_i \in \pi} |t_{i+1}-t_i| \cdot \sum(t_{i+1}-t_i).

The first term is <,< \infty, the second 0\rightarrow 0 as n,n \rightarrow \infty, and the final term equals bab-a. So

(Bti+1Bti)2(ba) in L2.\sum(B_{t_{i+1}} - B_{t_i})^2 \rightarrow (b-a) \text { in } \mathcal{L}^2.

and therefore ba\rightarrow b-a in probability (by Chebyshev). Then there must exist a subsequence mnm_n \uparrow \infty such that

timnBti+1Bti2ba a.s.,\sum_{t_i \in m_n} |B_{t_{i+1}} - B_{t_i}|^2 \rightarrow b-a \text{ a.s.},

so almost surely,

ba=limn(Bti+1Bti)2limn[maxtiπnBti+1BtiBti+1Bti]\begin{align*} b-a &= \lim_n \sum (B_{t_{i+1}} - B_{t_i})^2 \\ &\leq \lim_n \left[ \max_{t_i \in \pi_n} |B_{t_{i+1}} - B_{t_i}| \cdot \sum |B_{t_{i+1}} - B_{t_i}| \right] \end{align*}

But the first term in the limit is 00 by continuity of sample paths, so the second term must grow to infinity. Then TV({Bt};[a,b])=TV(\{B_t\}; [a,b]) = \infty almost surely. \blacksquare

Corollary: Along any sequence of partitions {πn}\{\pi_n\} \in \prod s.t. πn<,\sum | \pi_n | < \infty, we have QV({B};[a,b])=baQV(\{B\}; [a,b]) = b-a a.s.

This isn’t great–this means that we can’t just stick BtB_t into a Riemann-Stieltjes integral and expect a result. Let’s think about the problems that infinite total variation TV(B)=TV(B) = \infty might pose.

Riemann Stieltjes

Suppose we’d like to compute

0tf(s)dBs,\int_0^t f(s) dB_s,

the Wiener integral (which we don’t yet know exists…). Bs(w)B_s(w) is almost surely continuous, but we of course cannot apply the Riemann-Stieltjes treatment.

Consider a nonrandom continuous function ff and gg to be characterized as follows:

0tf(s)dg(s)=limntinf(si)(g(ti+1)g(ti))\int_0^t f(s) dg(s) = \lim_{\prod_n} \sum_{t_i \in \prod_n} f(s_i) (g(t_{i+1}) - g(t_i))

for each si[ti,ti+1]s_i \in [t_i, t_{i+1}] and taking the limit of finer meshes n0|\prod_n| \rightarrow 0. Intuitively, the limit should exist independently of our choice of partition and choice of sis_i, where ff is evaluated. Let’s confirm this:

Let m\prod_m be a coarser partition than n\prod_n. Then

tinf(si)(g(ti+1)g(ti))t~jmf(s~j)(g(t~j+1)g(t~j))=tin(f(si)f(s~i))(g(ti+1)g(ti)),\begin{align} \sum_{t_i \in \prod_n} f(s_i) (g(t_{i+1}) - g(t_i)) - \sum_{\tilde t_j \in \prod_m} f(\tilde s_j)(g(\tilde t_{j+1}) - g(\tilde t_j)) \\ = \sum_{t_i \in \prod_n} (f(s_i) - f(\tilde s_i^*))(g(t_{i+1}) - g(t_i)), \end{align}

where s~i\tilde s^*_i is chosen the obvious way.

    (2)f(si)f(s~i)g(ti+1)g(ti)TV(g)maxif(si)f(s~i).\begin{align*} \implies (2) &\leq \sum |f(s_i) - f(\tilde s^*_i) | |g(t_{i+1}) - g(t_i) | \\ &\leq TV(g) * \max_i |f(s_i) - f(\tilde s^*_i)|. \end{align*}

If ff is continuous and TV(g)<,TV(g) < \infty, then the sequence of sums is Cauchy.

Then the limit would exist independent of our choice of partition. \blacksquare

We know we encounter problems with the Riemann Stieltjes integral with infinite variation. The contrapositive gives:

Contrapositive: if the Riemann Stieltjes integral exists for all continuous ff, then TV(g)<.TV(g) < \infty.

Pf:…

Lemma: Assume TV(g;[a,b])<,fnf0,TV(g; [a,b]) < \infty, ||f_n - f||_\infty \rightarrow 0, and fnf_n are simple. Then limn0tfndg\lim_{n} \int_0^t f_n dg exists independently of choice of the approximating sequence.

Pf:

Denote limn0tfndg\lim_{n} \int_0^t f_n dg as I(fn)I(f_n).

I(fn)I(fm)=i(fn(ti)fm(ti))(g(ti+1)g(ti))I(f_n) - I(f_m) = \sum_i (f_n(t_i) - f_m(t_i))(g(t_{i+1}) - g(t_i))

for some common refinement of tt’s. Hence I(fn)I(fm)fnfmTV(g).|I(f_n) - I(f_m)| \leq ||f_n - f_m|| TV(g). Since

fnfmfnf+ffm0,||f_n - f_m|| \leq ||f_n - f|| + ||f - f_m|| \rightarrow 0,

we have I(fn)I(f_n) Cauchy sequence and the limit exists.

Let (hn)(h_n) be another sequence of simple functions such that hnf0||h_n -f|| \rightarrow 0. Note

hnfmhnf+ffm0||h_n - f_m|| \leq ||h_n - f|| + ||f - f_m|| \rightarrow 0

as both n,mn,m approach .\infty. For a common refinement,

I(hn)I(fm)=i(hn(ti)fm(ti))(g(ti+1)g(ti)),I(h_n) - I(f_m) = \sum_i (h_n(t_i) - f_m(t_i))(g(t_{i+1}) - g(t_i)),

which is again Cauchy. Therefore, the integrals must approach the same limit, regardless of approximating sequence. \blacksquare

Lemma: If TV(g;[0,1])=TV(g; [0,1]) = \infty, there exist simple functions fnf0||f_n - f||_\infty \rightarrow 0 such that I(fn).I(f_n) \uparrow \infty.

Pf:

WLOG assume f=0f=0.

Let TV(g)=TV(g) = \infty. Then there exists a sequence of partitions (n)(\prod_n) such that

ting(ti+1)g(ti).\sum_{t_i \in \prod_n} |g(t_{i+1}) - g(t_i)| \rightarrow \infty.

Define hn(ti)=sgn(g(ti+1g(ti))).h_n(t_i) = \text{sgn}(g(t_{i+1} - g(t_i))). Then I(hn)I(h_n) \uparrow \infty but hnh_n does not converge to 00 uniformly.

Let fn=hnI(hn).f_n = \frac{h_n}{\sqrt{I(h_n)}}. Then I(fn)=I(hn)I(f_n) = \sqrt{I(h_n)} \uparrow \infty and suptfn(t)0=1I(hn)0\sup_t |f_n(t) - 0 | = \frac{1}{\sqrt{I(h_n)}} \rightarrow 0.

When TV(g)=TV(g) = \infty the Riemann-Stieltjes limit depends on choice of approximating sequence. \blacksquare

Brownian Motion as Integrator

Let’s try to make sense of the integral

01f(t,w)dBt(w)\int_0^1 f(t,w) dB_t(w)

where (Bt)(B_t) is Brownian motion and ff is simple:

fn(t,w)=jcj(w)1[j/2n,(j+1)/2n](t).f_n(t,w) = \sum_j c_j(w) \mathbb{1}_{[j/2^n, (j+1)/2^n]}^{(t)}.

Note this means fnf_n is random piecewise constant. Then we have

01fn(t,w)dBt(w)=cj(w)(B((j+1)/2n)(w)Bj/2n(w)).\int_0^1 f_n(t,w) dB_t(w) = \sum c_j(w) (B_{((j+1)/2^n)}(w) - B_{j / 2^n}(w)).

As a toy example, suppose we’re trying to integrate Brownian motion itself. Then for cjc_j, we might consider two natural choices for possible values:

What happens when we pick either of these?

E[01fn(t,w)dBt(w)]\E[\int_0^1 f_n(t,w) dB_t(w)]

is either 00 (scenario a) or 11 (scenario b). Both seem like they should be good approximations for f(t,w)=Bt(w),f(t,w) = B_t(w), but evaluate to different results!

As we construct the stochastic integral, we’ll see that generally we take one of two choices:

f(ti,w)1[t0,ti+1]\sum f(t_i^*, w) \mathbb{1}_{[t_0, t_{i+1}]}

for ti=tit^*_i = t_i, the Ito choice, or ti=ti+ti+12t^*_i = \frac{t_i + t_{i+1}}{2}, the Stratonovich choice.

What else should we expect? Certainly f(t,w)f(t,w) needs to be Ft\mathcal{F}_t measurable, with Ft\mathcal{F}_t the natural filtration for BB, i.e., Ft=σ(Bs:st).\mathcal{F_t} = \sigma(B_s : s\leq t).

Def: Let {Ft}\{\mathcal{F}_t\} be the natural filtration on Ω\Omega. A process g(t,w):[0,)×ΩRg(t,w): [0, \infty) \times \Omega \rightarrow \R is Ft\mathcal{F}_t adapted if for all t0t \geq 0 the function wg(t,w)w \mapsto g(t,w) is Ft\mathcal{F}_t measurable.

For example, h1(t,w)=Bt/2(w)h_1(t,w) = B_{t/2}(w) is adapted, but h2(t,w)=B2t(w)h_2(t,w) = B_{2t}(w) is not adapted.

Also, as per the variation discussion above, we’ll want QV(Bt)<,QV(B_t) < \infty, so the Wiener integral will be defined in the L2\mathcal{L}^2 limit instead of L1\mathcal{L}^1.