−c, by (2.5.14), I1 (x) = M (h1 ; 1)x−1 Z ρ+i∞ 2.5.41 1 + x−z Γ(1 − z) M (h1 ; z) dz, 2πi ρ−i∞ for any ρ satisfying 1 < ρ < 2. Similarly, since M (h2 ; z) can be continued analytically to a meromorphic function (when κ = 0) or to an entire function (when κ 6= 0), we can choose ρ so that M (h2 ; z) has no poles in 1 <
2.5.42
1 x−z Γ(1 − z) M (h2 ; z) dz. 2πi ρ−i∞ On substituting (2.5.41) and (2.5.42) into (2.5.38), we obtain +
res −ζ z−1 Γ(1 − z) M (h2 ; z)
<β0 ≤
+
X
res −ζ z−1 Γ(1 − z) M (h; z)
1<
1 + 2πi
∞ X
bn n=0 ∞ X +
Γ(1 − βn )ζ βn −1
(−ζ)n M (h; n + 1), n! n=0
ζ l−δ−i∞
z−1
Γ(1 − z) M (h; z) dz,
ζ → 0+.
Example ∞
e−ζt dt, <ζ > 0. 1+t 0 With h(t) = 1/(1 + t), we have M (h; z) = π csc(πz) for 0 <
L (h; ζ) =
Z
z=k
2.5.46
ζ k−1 , (k − 1)! where ψ(z) = Γ0 (z)/ Γ(z). From (2.5.28) res −ζ z−1 Γ(1 − z) M (h2 ; z) = (− ln ζ + ψ(k))
2.5.47
z=1
= (− ln ζ − γ) − M (h1 ; 1), where γ is Euler’s constant (§5.2(ii)). Insertion of these results into (2.5.43) yields 2.5.48
L (h; ζ) ∼ (− ln ζ)
∞ X ζk k=0
k!
+
∞ X
ψ(k + 1)
k=0
ζk , ζ → 0+. k!
To verify (2.5.48) we may use L (h; ζ) = eζ E1 (ζ); compare (6.2.2) and (6.6.3). For examples in which the integral defining the Mellin transform M (h; z) does not exist for any value of z, see Wong (1989, Chapter 3), Bleistein and Handelsman (1975, Chapter 4), and Handelsman and Lew (1970). 2.5.49
2.6 Distributional Methods 2.6(i) Divergent Integrals
2.5.43
L (h; ζ) = M (h1 ; 1) X +
where l (≥ 2) is an arbitrary integer and δ is an arbitrary small positive constant. The last term is clearly O ζ l−δ−1 as ζ → 0+. If κ = 0 in (2.5.18) and c > −1 in (2.5.20), and if none of the exponents in (2.5.18) are positive integers, then the expansion (2.5.43) gives the following useful result:
Consider the integral Z ∞ 2.6.1 S(x) = 0
1 (1 +
t)1/3 (x
+ t)
dt,
where x > 0. For t > 1, 2.6.2
(1 + t)−1/3 =
∞ 1 X − 3
s=0
s
t−s−(1/3) .
52
Asymptotic Approximations
Motivated by Watson’s lemma (§2.3(ii)), we substitute (2.6.2) in (2.6.1), and integrate term by term. This leads to integrals of the form Z ∞ −s−(1/3) t 2.6.3 dt, s = 1, 2, 3, . . . . x+t 0 Although divergent, these integrals may be interpreted in a generalized sense. For instance, we have
To derive an asymptotic expansion of S (f ; z) for large values of |z|, with | ph z| < π, we assume that f (t) possesses an asymptotic expansion of the form
2.6.4
2.6.10
∞
tα−1 Γ(α) Γ(β) 1 dt = , <α > 0, <β > 0. α+β (x + t) Γ(α + β) xβ 0 But the right-hand side is meaningful for all values of α and β, other than nonpositive integers. We may therefore define the integral on the left-hand side of (2.6.4) by the value on the right-hand side, except when α, β = 0, −1, −2, . . . . With this interpretation Z ∞ −s−(1/3) 2π (−1)s t 2.6.5 dt = √ s+(1/3) , s = 0, 1, 2, . . . . x+t 3x 0 Z
Inserting (2.6.2) into (2.6.1) and integrating formally term-by-term, we obtain 1 ∞ − 3 −s−(1/3) 2π X 2.6.6 (−1)s S(x) ∼ √ x , x → ∞. s 3 s=0 However this result is incorrect. The correct result is given by 1 ∞ 2π X s −3 √ (−1) x−s−(1/3) S(x) ∼ s 3 s=0 2.6.7
−
∞ X s=1
3s (s − 1)! x−s ; 2 · 5 · · · (3s − 1)
see §2.6(ii). The fact that expansion (2.6.6) misses all the terms in the second series in (2.6.7) raises the question: what went wrong with our process of reaching (2.6.6)? In the following subsections, we use some elementary facts of distribution theory (§1.16) to study the proper use of divergent integrals. An important asset of the distribution method is that it gives explicit expressions for the remainder terms associated with the resulting asymptotic expansions. For an introduction to distribution theory, see Wong (1989, Chapter 5). For more advanced discussions, see Gel’fand and Shilov (1964) and Rudin (1973).
f (t) ∼
2.6.9
∞ X
as t−s−α ,
t → +∞,
s=0
with 0 < α ≤ 1. For each n = 1, 2, 3, . . . , set f (t) =
n−1 X
as t−s−α + fn (t).
s=0
To each function in this equation, we shall assign a tempered distribution (i.e., a continuous linear functional) on the space T of rapidly decreasing functions on R. Since f (t) is locally integrable on [0, ∞), it defines a distribution by Z ∞ 2.6.11 hf, φi = f (t)φ(t) dt, φ∈T. 0
In particular, 2.6.12
t−α , φ =
Z
∞
t−α φ(t) dt,
φ∈T,
0
when 0 < α < 1. Since the functions t−s−α , s = 1, 2, . . . , are not locally integrable on [0, ∞), we cannot assign distributions to them in a similar manner. However, they are multiples of the derivatives of t−α . Motivated by the definition of distributional derivatives, we can assign them the distributions defined by Z ∞
−s−α 1 t−α φ(s) (t) dt, φ ∈ T , 2.6.13 t ,φ = (α)s 0 where (α)s = α(α + 1) · · · (α + s − 1). Similarly, in the case α = 1, we define Z
−s−1 1 ∞ (ln t)φ(s+1) (t) dt, φ ∈ T . 2.6.14 t ,φ = − s! 0 To assign a distribution to the function fn (t), we first let fn,n (t) denote the nth repeated integral (§1.4(v)) of fn : Z ∞ (−1)n (τ − t)n−1 fn (τ ) dτ. 2.6.15 fn,n (t) = (n − 1)! t For 0 < α < 1, it is easily seen that fn,n (t) is bounded on [0, R] for any positive constant R, and is O(t−α ) as t → ∞. For α = 1, we have fn,n (t) = O t−1 as t → ∞ and fn,n (t) = O(ln t) as t → 0+. In either case, we define the distribution associated with fn (t) by Z ∞ 2.6.16 hfn , φi = (−1)n fn,n (t)φ(n) (t) dt, φ ∈ T , 0
2.6(ii) Stieltjes Transform Let f (t) be locally integrable on [0, ∞). The Stieltjes transform of f (t) is defined by Z ∞ f (t) 2.6.8 dt. S (f ; z) = t+z 0
since the nth derivative of fn,n is fn . We have now assigned a distribution to each function in (2.6.10). A natural question is: what is the exact relation between these distributions? The answer is provided by the identities (2.6.17) and (2.6.20) given below.
2.6
53
Distributional Methods
if α ∈ (0, 1) in (2.6.9), or
For 0 < α < 1 and n ≥ 1, we have 2.6.17
hf, φi =
n−1 X
as
n D E X t−s−α , φ − cs δ (s−1) , φ + hfn , φi
s=0
(−1)s M (f ; s), (s − 1)! M (f ; z) being the Mellin transform of f (t) or its analytic continuation (§2.5(ii)). The Dirac delta distribution in (2.6.17) is given by D E 2.6.19 δ (s) , φ = (−1)s φ(s) (0), s = 0, 1, 2, . . . ; compare §1.16(iii). For α = 1 2.6.20 n−1 X
n D E
X as t−s−1 , φ − ds δ (s−1) , φ + hfn , φi
s=0
(−1)s+1 ds+1
s 1 as X 1 + lim M (f ; z) = s! k s! z→s+1 k=1 as , + z−s−1
φε (t) =
e−εt , t+z
t ∈ (0, ∞).
From (2.6.13) and (2.6.14)
2.6.23 lim t−s−α , φε = 2.6.24
π (−1)s , ε →0 sin(πα) z s+α s
(−1)s+1 X 1 (−1)s lim t−s−1 , φε = + s+1 ln z, s+1 ε →0 z k z k=1
with s = 0, 1, 2, . . . . From (2.6.11) and (2.6.16), we also have lim hf, φε i = S (f ; z), Z ∞ fn,n (t) dt. 2.6.26 lim hfn , φε i = n! ε →0 (t + z)n+1 0 On substituting (2.6.15) into (2.6.26) and interchanging the order of integration, the right-hand side of (2.6.26) becomes Z (−1)n ∞ τ n fn (τ ) dτ. zn τ +z 0 To summarize, 2.6.25
2.6.27
as
ε →0
n−1 X π as S (f ; z) = (−1)s s+α sin(πα) s=0 z
−
n X s=1
(s − 1)!
cs + Rn (z), zs
+
z s+1
n−1 X
(−1)s
s=0
des z s+1
+ Rn (z),
if α = 1 in (2.6.9). Here cs is given by (2.6.18), as 2.6.29 , des = lim M (f ; z) + z→s+1 z−s−1 and 2.6.30
Rn (z) =
(−1)n zn
Z
∞
0
τ n fn (τ ) dτ. τ +z
The expansion (2.6.7) follows immediately from (2.6.27) with z = x and f (t) = (1 + t)−(1/3) ; its region of validity is | ph x| ≤ π − δ (< π). The distribution method outlined here can be extended readily to functions f (t) having an asymptotic expansion of the form 2.6.31
for s = 0, 1, 2, . . . . To apply the results (2.6.17) and (2.6.20) to the Stieltjes transform (2.6.8), we take a specific function φ ∈ T . Let ε be a positive number, and 2.6.22
(−1)s
s=1
for any φ ∈ T , where
2.6.21
n−1 X s=0
cs =
hf, φi =
S (f ; z) = ln z
s=1
for any φ ∈ T , where 2.6.18
2.6.28
f (t) ∼ eict
∞ X
as t−s−α ,
t → +∞,
s=0
where c (6= 0) is real, and 0 < α ≤ 1. For a more detailed discussion of the derivation of asymptotic expansions of Stieltjes transforms by the distribution method, see McClure and Wong (1978) and Wong (1989, Chapter 6). Corresponding results for the generalized Stieltjes transform Z ∞ f (t) 2.6.32 dt, ρ > 0, (t + z)ρ 0 can be found in Wong (1979). An application has been given by L´opez (2000) to derive asymptotic expansions of standard symmetric elliptic integrals, complete with error bounds; see §19.27(vi).
2.6(iii) Fractional Integrals The Riemann–Liouville fractional integral of order µ is defined by Z x 1 2.6.33 (x − t)µ−1 f (t) dt, µ > 0; I µ f (x) = Γ(µ) 0 see §1.15(vi). We again assume f (t) is locally integrable on [0, ∞) and satisfies (2.6.9). We now derive an asymptotic expansion of I µ f (x) for large positive values of x. In terms of the convolution product Z x 2.6.34 f (x − t)g(t) dt (f ∗ g)(x) = 0
of two locally integrable functions on [0, ∞), (2.6.33) can be written 2.6.35
I µ f (x) =
1 (tµ−1 ∗ f )(x). Γ(µ)
54
Asymptotic Approximations
The replacement of f (t) by its asymptotic expansion (2.6.9), followed by term-by-term integration leads to convolution integrals of the form Z x µ−1 −s−α (x − t)µ−1 t−s−α dt, (t ∗t )(x) = 2.6.36
0
Substituting into (2.6.35) and using (2.6.38)–(2.6.40), we obtain tµ−1 ∗ f =
F ∗ G = Dn+m (f ∗ g).
2.6.37
It is easily seen that K + forms a commutative, associative linear algebra. Furthermore, K + contains the distributions H, δ, and tλ , t > 0, for any real (or complex) number λ, where H is the distribution associated with the Heaviside function H(t) (§1.16(iv)), and tλ is the distribution defined by (2.6.12)–(2.6.14), depending on the value of λ. Since δ = D H, it follows that for µ 6= 1, 2, . . . , tµ−1 ∗ δ (s−1) =
2.6.38
Γ(µ) tµ−s , Γ(µ + 1 − s)
t > 0.
Using (5.12.1), we can also show that when µ 6= 1, 2, . . . and µ − α is not a nonnegative integer, 2.6.39
t
µ−1
∗t
−s−α
Γ(µ) Γ(1 − s − α) µ−s−α t , t > 0, = Γ(µ + 1 − s − α)
s=1
t
tµ−1 ∗ f =
f=
n−1 X
as t−s−α −
n X
s=0
s=1
n−1 X
n X
cs δ (s−1) + fn ,
and 2.6.42
f=
s=0
as t−s−1 −
s=1
ds δ (s−1) + fn .
Γ(µ) tµ−s + tµ−1 ∗ fn Γ(µ − s + 1)
(−1)s as s+1 µ D (t (ln t − γ − ψ(µ + 1))) µ · s!
s=0
−
n X
ds
s=1
Γ(µ) tµ−s + tµ−1 ∗ fn Γ(µ − s + 1)
when α = 1. These equations again hold only in the sense of distributions. Since the function tµ (ln t − γ − ψ(µ + 1)) and all its derivatives are locally absolutely continuous in (0, ∞), the distributional derivatives in the first sum in (2.6.44) can be replaced by the corresponding ordinary derivatives. Furthermore, (n) since fn,n (t) = fn (t), it follows from (2.6.37) that the remainder terms tµ−1 ∗fn in the last two equations can be associated with a locally integrable function in (0, ∞). On replacing the distributions by their corresponding functions, (2.6.43) and (2.6.44) give I µ f (x) =
n−1 X
as
s=0
2.6.45
−
n X s=1
Γ(1 − s − α) xµ−s−α Γ(µ + 1 − s − α) 1 cs xµ−s + n δn (x), Γ(µ + 1 − s) x
when 0 < α < 1, or 2.6.46
I µ f (x) n−1 X
s
where γ is Euler’s constant (§5.2(ii)). To derive the asymptotic expansion of I µ f (x), we recall equations (2.6.17) and (2.6.20). In the sense of distributions, they can be written 2.6.41
n−1 X
s=0
∗t
cs
2.6.44
2.6.40
(−1) s+1 µ D (t (ln t − γ − ψ(µ + 1))) , = µ · s! t > 0,
Γ(µ) Γ(1 − s − α) µ−s−α t Γ(µ + 1 − s − α)
when 0 < α < 1, or
= −s−1
n X
−
and µ−1
as
s=0
2.6.43
s = 0, 1, 2, . . . . Of course, except when s = 0 and 0 < α < 1, none of these integrals exists in the usual sense. However, the left-hand side can be considered as the convolution of the two distributions associated with the functions tµ−1 and t−s−α , given by (2.6.12) and (2.6.13). To define convolutions of distributions, we first introduce the space K + of all distributions of the form Dn f , where n is a nonnegative integer, f is a locally integrable function on R which vanishes on (−∞, 0], and Dn f denotes the nth derivative of the distribution associated with f . For F = Dn f and G = Dm g in K + , we define
n−1 X
−
(−1)s as ds+1 (xµ (ln x−γ −ψ(µ + 1))) s! Γ(µ + 1) dxs+1
n X s=1
1 ds xµ−s + n δn (x), Γ(µ − s + 1) x
when α = 1, where 2.6.47
δn (x) =
n X Γ(µ + 1) µ n−j n I t fn,j (x), j Γ(µ + 1 − j) j=0
fn,j (t) being the jth repeated integral of fn ; compare (2.6.15). Example
Let f (t) = t1−α /(1 + t), 0 < α < 1. Then Z x 1 µ 2.6.48 I f (x) = (x − t)µ−1 t1−α (1 + t)−1 dt, Γ(µ) 0
2.7
55
Differential Equations
where µ > 0. For 0 < t < ∞ 2.6.49
f (t) =
n−1 X
(−1)s t−s−α + (−1)n
s=0
t1−n−α . 1+t
fn (t) = (−1)n
t
2.6.57
f (t)h(xt) =
In the notation of (2.6.10), as = (−1)s and 2.6.50
where 0 < β ≤ 1, and hn (t) = O t−n−β as t → ∞. Multiplication of these expansions leads to n−1 X X n−1 j=0 k=0
1−n−α
1+t
.
+
n−1 X
aj tj+α−1 hn (xt)
j=0
Since M (f ; s) = (−1)s π/ sin(πα),
2.6.51
+
I µ f (x) =
n−1 X
(−1)s
s=0
Γ(1 − s − α) xµ−s−α Γ(µ + 1 − s − α) n
2.6.52
−
X 1 xµ−s π sin(πα) s=1 Γ(µ + 1 − s) (s − 1)!
+
1 δn (x). xn
Moreover, |δn (x)| ≤
n−1 X
bk x−k−β t−k−β fn (t) + fn (t)hn (xt).
k=0
from (2.6.45) it follows that
2.6.53
aj bk tj+α−1−k−β x−k−β
Γ(µ + 1) Γ(1 − α) Γ(µ + 1 − α) Γ(n + α) n X n Γ(n + α − j) µ−α x × j |Γ(µ + 1 − j)| j=0
for x > 0. It may be noted that the integral (2.6.48) can be expressed in terms of the hypergeometric function 2 F1 (1, 2 − α; 2 − α + µ; −x); see §15.2(i). For proofs and other examples, see McClure and Wong (1979) and Wong (1989, Chapter 6). If both f and g in (2.6.34) have asymptotic expansions of the form (2.6.9), then the distribution method can also be used to derive an asymptotic expansion of the convolution f ∗ g; see Li and Wong (1994).
On inserting this identity into (2.6.54), we immediately encounter divergent integrals of the form Z ∞ 2.6.58 tλ dt, λ ∈ R. 0
However, in the theory of generalized functions (distributions), there is a method, known as “regularization”, by which these integrals can be interpreted in a meaningful manner. In this sense Z ∞ 2.6.59 tλ dt = 0, λ ∈ C. 0
From (2.6.55) and (2.6.59) M (f ; z) = M (fn ; z),
2.6.60
where M (f ; z) is the Mellin transform of f or its analytic continuation. Also, when α 6= β, 2.6.61
M (hx ; j + α) = x−j−α M (h; j + α),
where hx (t) = h(xt). Inserting (2.6.57) into (2.6.54), we obtain from (2.6.59)–(2.6.61) I(x) = 2.6.62
n−1 X
aj M (h; j + α)x−j−α
j=0
+
n−1 X
bk M (f ; 1 − k − β)x−k−β + δn (x)
k=0
when α 6= β, where
2.6(iv) Regularization
Z δn (x) =
The method of distributions can be further extended to derive asymptotic expansions for convolution integrals: Z ∞ 2.6.54 I(x) = f (t)h(xt) dt. 0
∞
fn (t)hn (xt) dt. 0
There is a similar expansion, involving logarithmic terms, when α = β. For rigorous derivations of these results and also order estimates for δn (x), see Wong (1979) and Wong (1989, Chapter 6).
We assume that for each n = 1, 2, 3, . . . , 2.6.55
f (t) =
n−1 X
2.7 Differential Equations as ts+α−1 + fn (t),
s=0 n+α−1
where 0 < α ≤ 1 and fn (t) = O t Also, n−1 X 2.6.56 h(t) = bs t−s−β + hn (t), s=0
as t → 0+.
2.7(i) Regular Singularities: Fuchs–Frobenius Theory An ordinary point of the differential equation 2.7.1
dw d2 w + f (z) + g(z)w = 0 dz dz 2
56
Asymptotic Approximations
is one at which the coefficients f (z) and g(z) are analytic. All solutions are analytic at an ordinary point, and their Taylor-series expansions are found by equating coefficients. Other points z0 are singularities of the differential equation. If both (z −z0 )f (z) and (z −z0 )2 g(z) are analytic at z0 , then z0 is a regular singularity (or singularity of the first kind ). All other singularities are classified as irregular. In a punctured neighborhood N of a regular singularity z0
integer such that (z −z0 )` f (z) and (z −z0 )2` g(z) are analytic at z0 . Thus a regular singularity has rank 0. The most common type of irregular singularity for special functions has rank 1 and is located at infinity. Then ∞ ∞ X X gs fs , g(z) = , 2.7.7 f (z) = s zs z s=0
2.7.2
2.7.8
f (z) =
∞ X
fs (z − z0 )s−1 ,
g(z) =
s=0
∞ X
gs (z − z0 )s−2 ,
Q(α) ≡ α(α − 1) + f0 α + g0 = 0. Provided that α1 −α2 is not zero or an integer, equation (2.7.1) has independent solutions wj (z), j = 1, 2, such that ∞ X αj 2.7.4 wj (z) = (z − z0 ) as,j (z − z0 )s , z ∈ N, 2.7.3
s=0
with a0,j = 1, and Q(αj + s)as,j = −
s−1 X
((αj + r)fs−r + gs−r ) ar,j ,
r=0
when s = 1, 2, 3, . . . . If α1 − α2 = 0, 1, 2, . . . , then (2.7.4) applies only in the case j = 1. But there is an independent solution w2 (z) = (z − z0 )α2 2.7.6
eλj z z µj
∞ X as,j , zs s =0
j = 1, 2,
where λ1 , λ2 are the roots of the characteristic equation
s=0
with at least one of the coefficients f0 , g0 , g1 nonzero. Let α1 , α2 denote the indices or exponents, that is, the roots of the indicial equation
2.7.5
s=0
these series converging in an annulus |z| > a, with at least one of f0 , g0 , g1 nonzero. Formal solutions are
∞ X
λ2 + f0 λ + g0 = 0,
2.7.9
µj = −(f1 λj + g1 )/(f0 + 2λj ), = 1, and
2.7.10
a0,j
2.7.11
r=1
− (s − r − µj )fr ) as−r,j , when s = 1, 2, . . . . The construction fails iff λ1 = λ2 , that is, when f02 = 4g0 : this case is treated below. For large s, Λ1 as,1 ∼ (λ1 − λ2 )s ∞ 2.7.12 X aj,2 (λ1 − λ2 )j Γ(s + µ2 − µ1 − j), × j=0
as,2 ∼
bs (z − z0 )s
s=0 s6=α1 −α2
+ cw1 (z) ln(z − z0 ), z ∈ N. The coefficients bs and constant c are again determined by equating coefficients in the differential equation, beginning with c = 1 when α1 − α2 = 0, or with b0 = 1 when α1 − α2 = 1, 2, 3, . . . . The radii of convergence of the series (2.7.4), (2.7.6) are not less than the distance of the next nearest singularity of the differential equation from z0 . To include the point at infinity in the foregoing classification scheme, we transform it into the origin by replacing z in (2.7.1) with 1/z; see Olver (1997b, pp. 153– 154). For corresponding definitions, together with examples, for linear differential equations of arbitrary order see §§16.8(i)–16.8(ii).
2.7(ii) Irregular Singularities of Rank 1 If the singularities of f (z) and g(z) at z0 are no worse than poles, then z0 has rank ` − 1, where ` is the least
(f0 + 2λj )sas,j = (s − µj )(s − 1 − µj )as−1,j s X + (λj fr+1 + gr+1
2.7.13
Λ2 (λ2 − λ1 )s ∞ X aj,1 (λ2 − λ1 )j Γ(s + µ1 − µ2 − j), × j=0
where Λ1 and Λ2 are constants, and the Jth remainder terms in the sums are O(Γ(s + µ2 − µ1 − J)) and O(Γ(s + µ1 − µ2 − J)), respectively (Olver (1994a)). Hence unless the series (2.7.8) terminate (in which case the corresponding Λj is zero) they diverge. However, there are unique and linearly independent solutions wj (z), j = 1, 2, such that 2.7.14
wj (z) ∼ eλj z ((λ2 − λ1 )z)µj
∞ X as,j s=0
zs
as z → ∞ in the sectors 2.7.15
− 23 π + δ ≤ ph((λ2 − λ1 )z) ≤ 32 π − δ,
j = 1,
j = 2, − 21 π + δ ≤ ph((λ2 − λ1 )z) ≤ 52 π − δ, δ being an arbitrary small positive constant. Although the expansions (2.7.14) apply only in the sectors (2.7.15) and (2.7.16), each solution wj (z) can 2.7.16
2.7
57
Differential Equations
be continued analytically into any other sector. Typical connection formulas are w1 (z) = e2πiµ1 w1 (ze−2πi ) + C1 w2 (z), w2 (z) = e−2πiµ2 w2 (ze2πi ) + C2 w1 (z), in which C1 , C2 are constants, the so-called Stokes multipliers. In combination with (2.7.14) these formulas yield asymptotic expansions for w1 (z) in 21 π + δ ≤ ph((λ2 − λ1 )z) ≤ 25 π − δ, and w2 (z) in − 32 π + δ ≤ ph((λ2 − λ1 )z) ≤ 12 π − δ. Furthermore,
2.7.17
Λ1 = −ie(µ2 −µ1 )πi C1 /(2π), Λ2 = iC2 /(2π). Note that the coefficients in the expansions (2.7.12), (2.7.13) for the “late” coefficients, that is, as,1 , as,2 with s large, are the “early” coefficients aj,2 , aj,1 with j small. This phenomenon is an example of resurgence, a classi´ fication due to Ecalle (1981a,b). See §2.11(v) for other examples. The exceptional case f02 = 4g0 is handled by Fabry’s transformation: 2.7.18
w = e−f0 z/2 W, t = z 1/2 . The transformed differential equation either has a regular singularity at t = ∞, or its characteristic equation has unequal roots. For error bounds for (2.7.14) see Olver (1997b, Chapter 7). For the calculation of Stokes multipliers see Olde Daalhuis and Olver (1995b). For extensions to singularities of higher rank see Olver and Stenger (1965). For extensions to higher-order differential equations see Stenger (1966a,b), Olver (1997a, 1999), and Olde Daalhuis and Olver (1998). 2.7.19
2.7(iii) Liouville–Green (WKBJ) Approximation For irregular singularities of nonclassifiable rank, a powerful tool for finding the asymptotic behavior of solutions, complete with error bounds, is as follows: In a finite or infinite interval (a1 , a2 ) let f (x) be real, positive, and twice-continuously differentiable, and g(x) be continuous. Then in (a1 , a2 ) the differential equation d2 w = (f (x) + g(x))w dx2 has twice-continuously differentiable solutions 2.7.20
2.7.21
w1 (x) = f −1/4 (x) exp
f 1/2 (x) dx
2.7.25
Z Vaj ,x (F ) =
aj
2.7.26
Z f 1/2 (x) dx , x → a1 +, w1 (x) ∼ f −1/4 (x) exp 2.7.27
Z 1/2 w2 (x) ∼ f (x) exp − f (x) dx , x → a2 −. R Suppose in addition | f 1/2 (x) dx| is unbounded as x → a1 + and x → a2 −. Then there are solutions w3 (x), w4 (x), such that −1/4
2.7.28
Z f 1/2 (x) dx , x → a2 −, w3 (x) ∼ f −1/4 (x) exp 2.7.29
w4 (x) ∼ f
such that 2.7.23
Z 1/2 (x) exp − f (x) dx , x → a1 +.
w1 (x)/w4 (x) → 0, x → a1 +, w1 (x) is a recessive (or subdominant) solution as x → a1 +, and w4 (x) is a dominant solution as x → a1 +. Similarly for w2 (x) and w3 (x) as x → a2 −. 2.7.30
Example
d2 w = (x + ln x)w, 0 < x < ∞. dx2 R −1/2 We cannot take f = x and g = ln x because gf dx would diverge as x → +∞. Instead set f = x + ln x, g = 0. By approximating 1/2 2.7.32 f = x1/2 + 21 x−1/2 ln x + O x−3/2 (ln x)2 , we arrive at
2.7.34
≤ exp
−1/4
The solutions with the properties (2.7.26), (2.7.27) are unique, but not those with the properties (2.7.28), (2.7.29). In fact, since
(1 + 1 (x)) ,
Z −1/4 1/2 w2 (x) = f (x) exp − f (x) dx (1 + 2 (x)) ,
1 −1/2 (x)|0j (x)| 2f
1 d2 1 g(t) f 1/4 (t) dt2 f 1/4 (t) − f 1/2 (t) dt .
Assuming also Va1 ,a2 (F ) < ∞, we have
2.7.33
2.7.22
|j (x)|,
x
2.7.31
Liouville–Green Approximation Theorem
Z
provided that Vaj ,x (F ) < ∞. Here F (x) is the errorcontrol function Z 1 g 1 d2 − dx, 2.7.24 F (x) = f 1/4 dx2 f 1/4 f 1/2 and V denotes the variational operator (§2.3(i)). Thus
1 2
Vaj ,x (F ) − 1, j = 1, 2,
√ x
exp 2x1/2 − 32 x3/2 , √ w3 (x) ∼ x−(1/4)+ x exp 23 x3/2 − 2x1/2 ,
w2 (x) ∼ x−(1/4)−
as x → +∞, w2 (x) being recessive and w3 (x) dominant. For other examples, and also the corresponding results when f (x) is negative, see Olver (1997b, Chapter 6), Olver (1980a), Taylor (1978, 1982), and Smith (1986). The first of these references includes extensions to complex variables and reversions for zeros.
58
Asymptotic Approximations
2.7(iv) Numerically Satisfactory Solutions One pair of independent solutions of the equation 2.7.35 d2 w dz 2 = w is w1 (z) = ez , w2 (z) = e−z . Another is w3 (z) = cosh z, w4 (z) = sinh z. In theory either pair may be used to construct any other solution 2.7.36
The same approach is used in all three cases. First we apply the Liouville transformation (§1.13(iv)) to (2.8.1). This introduces new variables W and ξ, related by W = z˙ −1/2 w,
2.8.2
dots denoting differentiations with respect to ξ. Then
w(z) = Aw1 (z) + Bw2 (z),
or w(z) = Cw3 (z) + Dw4 (z), where A, B, C, D are constants. From the numerical standpoint, however, the pair w3 (z) and w4 (z) has the drawback that severe numerical cancellation can occur with certain combinations of C and D, for example if C and D are equal, or nearly equal, and z, or
d2 W 2 2 2 = u z˙ f (z) + ψ(ξ) W, dξ
2.8.3
2.7.37
2.8 Differential Equations with a Parameter 2.8(i) Classification of Cases Many special functions satisfy an equation of the form 2.8.1 d2 w dz 2 = u2 f (z) + g(z) w, in which u is a real or complex parameter, and asymptotic solutions are needed for large |u| that are uniform with respect to z in a point set D in R or C. For example, u can be the order of a Bessel function or degree of an orthogonal polynomial. The form of the asymptotic expansion depends on the nature of the transition points in D, that is, points at which f (z) has a zero or singularity. Zeros of f (z) are also called turning points. There are three main cases. In Case I there are no transition points in D and g(z) is analytic. In Case II f (z) has a simple zero at z0 and g(z) is analytic at z0 . In Case III f (z) has a simple pole at z0 and (z −z0 )2 g(z) is analytic at z0 .
where ψ(ξ) = z˙ 2 g(z) + z˙ 1/2
2.8.4
d2 −1/2 (z˙ ). dξ 2
The transformation is now specialized in such a way that: (a) ξ and z are analytic functions of each other at the transition point (if any); (b) the approximating differential equation obtained by neglecting ψ(ξ) (or part of ψ(ξ)) has solutions that are functions of a single variable. The actual choices are as follows: Z 2.8.5 z˙ 2 f (z) = 1, ξ = f 1/2 (z) dz, for Case I, 2.8.6
2
z˙ f (z) = ξ,
2 3/2 3ξ
z
Z
f 1/2 (t) dt,
= z0
for Case II, 2.8.7
z˙ 2 f (z) = 1/ξ,
2ξ 1/2 =
Z
z
f 1/2 (t) dt,
z0
for Case III. The transformed equation has the form 2.8.8
d2 W dξ 2 = u2 ξ m + ψ(ξ) W,
with m = 0 (Case I), m = 1 (Case II), m = −1 (Case III). In Cases I and II the asymptotic solutions are in terms of the functions that satisfy (2.8.8) with ψ(ξ) = 0. These are elementary functions in Case I, and Airy functions (§9.2) in Case II. In Case III the approximating equation is 2.8.9
d2 W = dξ 2
u2 ρ + 2 ξ ξ
W,
where ρ = lim(ξ 2 ψ(ξ)) as ξ → 0. Solutions are Bessel functions, or modified Bessel functions, of order ±(1 + 4ρ)1/2 (§§10.2, 10.25). For another approach to these problems based on convergent inverse factorial series expansions see Dunster et al. (1993) and Dunster (2001a, 2004).
2.8
2.8(ii) Case I: No Transition Points The transformed differential equation is 2.8.10 d2 W dξ 2 = (u2 + ψ(ξ))W, in which ξ ranges over a bounded or unbounded interval or domain ∆, and ψ(ξ) is C ∞ or analytic on ∆. The parameter u is assumed to be real and positive. Corresponding to each positive integer n there are solutions Wn,j (u, ξ), j = 1, 2, that depend on arbitrarily chosen reference points αj , are C ∞ or analytic on ∆, and as u→∞ 2.8.11 uξ
Wn,1 (u, ξ) = e
n−1 X s=0
! 1 As (ξ) +O n , ξ ∈ ∆1 (α1 ), s u u
2.8.12
Wn,2 (u, ξ) = e−uξ
! 1 A (ξ) s , (−1)s s + O n u u s=0
n−1 X
ξ ∈ ∆2 (α2 ), with A0 (ξ) = 1 and 2.8.13
As+1 (ξ) = − 21 A0s (ξ) + 21
2.8.15
2.8.16
and 2.8.18
Z ψ(ξ)As (ξ) dξ, s = 0, 1, 2, . . . ,
2.8(iii) Case II: Simple Turning Point The transformed differential equation is 2.8.14 d2 W dξ 2 = (u2 ξ + ψ(ξ))W, and for simplicity ξ is assumed to range over a finite or infinite interval (α1 , α2 ) with α1 < 0, α2 > 0. Again, u > 0 and ψ(ξ) is C ∞ on (α1 , α2 ). Corresponding to each positive integer n there are solutions Wn,j (u, ξ), j = 1, 2, that are C ∞ on (α1 , α2 ), and as u → ∞
Z ξ dv 1 (ψ(v)As (v) − A00s (v)) 1/2 , 1/2 2ξ v 0 Z Bs (ξ) = 0 1 dv (ψ(v)As (v) − A00s (v)) , 1/2 2(−ξ) (−v)1/2 ξ Z 1 1 0 As+1 (ξ) = − 2 Bs (ξ) + 2 ψ(ξ)Bs (ξ) dξ,
when s = 0, 1, 2, . . . . For Ai and Bi see §9.2. The expansions (2.8.15) and (2.8.16) are both uniform and differentiable with respect to ξ. These results are valid when Vα1 ,α2 |ξ|1/2 B0 and Vα1 ,α2 |ξ|1/2 Bn−1 are finite. An alternative way of representing the error terms in (2.8.15) and (2.8.16) is as follows. Let c = −0.36604... be the real root of the equation 2.8.19
(the constants of integration being arbitrary). The expansions (2.8.11) and (2.8.12) are both uniform and differentiable with respect to ξ. The regions of validity ∆j (αj ) comprise those points ξ that can be joined to αj in ∆ by a path Qj along which
! ! n−2 n−1 X Bs (ξ) X As (ξ) 1 1 0 + O 2n−1 + Ai u2/3 ξ , + O 2n−1 Wn,1 (u, ξ) = Ai u2/3 ξ u2s u u u2s+(4/3) s=0 s=0 ! ! n−1 n−2 X As (ξ) X Bs (ξ) 1 1 0 2/3 2/3 + O 2n−1 Wn,2 (u, ξ) = Bi u ξ + O 2n−1 + Bi u ξ . u2s u u u2s+(4/3) s=0 s=0
Here A0 (ξ) = 1, 2.8.17
59
Differential Equations with a Parameter
Ai(x) = Bi(x)
of smallest absolute value, and define the envelopes of
ξ > 0, ξ < 0,
Ai(x) and Bi(x) by 2.8.20
2.8.21
1/2 env Ai(x) = env Bi(x) = Ai2 (x) + Bi2 (x) , −∞ < x ≤ c, √ √ env Ai(x) = 2 Ai(x), env Bi(x) = 2 Bi(x), c ≤ x < ∞.
These envelopes are continuous functions of x, and as u→∞
60
Asymptotic Approximations
see Olver (1997b, Chapters 11, 13), Olver (1964b), Reid (1974a,b), Boyd (1987), and Baldwin (1991). For other examples of uniform asymptotic approximations and expansions of special functions in terms of Airy functions see especially §10.20 and §§12.10(vii), 12.10(viii); also §§12.14(ix), 13.20(v), 13.21(iii), 13.21(iv), 15.12(iii), 18.15(iv), 30.9(i), 30.9(ii), 32.11(ii), 32.11(iii), 33.12(i), 33.12(ii), 33.20(iv), 36.12(ii), 36.13.
n−1 X As (ξ) Wn,1 (u, ξ) = Ai u2/3 ξ u2s s=0 n−2 X Bs (ξ) + Ai0 u2/3 ξ u2s+(4/3) s=0 1 + env Ai u2/3 ξ O 2n−1 , u
2.8.22
n−1 X As (ξ) Wn,2 (u, ξ) = Bi u2/3 ξ u2s s=0
2.8(iv) Case III: Simple Pole
n−2 X Bs (ξ) 0 2/3 + Bi u ξ u2s+(4/3) s=0 1 + env Bi u2/3 ξ O 2n−1 , u
2.8.23
uniformly with respect to ξ ∈ (α1 , α2 ). For error bounds, more delicate error estimates, extensions to complex ξ and u, zeros, connection formulas, extensions to inhomogeneous equations, and examples,
2.8.25
2.8.26
The transformed equation (2.8.8) is renormalized as 2 u ν 2 − 1 ψ(ξ) d2 W = + + W. 2.8.24 4ξ 4ξ 2 ξ dξ 2 We again assume ξ ∈ (α1 , α2 ) with −∞ ≤ α1 < 0, 0 < α2 ≤ ∞. Also, √ ψ(ξ) is C ∞ on (α1 , α2 ), and u > 0. The constant ν (= 1 + 4ρ) is real and nonnegative. There are two cases: ξ ∈ (0, α2 ) and ξ ∈ (α1 , 0). In the former, corresponding to any positive integer n there are solutions Wn,j (u, ξ), j = 1, 2, that are C ∞ on (0, α2 ), and as u → ∞
n−2 1 n−1 X Bs (ξ) X As (ξ) 1/2 1/2 1/2 + ξ Iν+1 uξ + ξ Iν uξ O 2n−1 , Wn,1 (u, ξ) = ξ Iν uξ u2s u2s+1 u s=0 s=0 n−1 n−2 1 X As (ξ) X Bs (ξ) 1/2 1/2 1/2 Wn,2 (u, ξ) = ξ 1/2 Kν uξ 1/2 − ξ K + ξ K uξ uξ O 2n−1 . ν+1 ν u2s u2s+1 u s=0 s=0 1/2
1/2
Here A0 (ξ) = 1, 2.8.27 2.8.28
Z
ξ
dv ψ(v)As (v) − ν + 12 A0s (v) 1/2 , v 0 Z As+1 (ξ) = νBs (ξ) − ξBs0 (ξ) + ψ(ξ)Bs (ξ) dξ,
Bs (ξ) =
−A0s (ξ)
+
1
ξ 1/2
s = 0, 1, 2, . . . . For Iν and Kν see §10.25(ii). The expansions (2.8.25) and (2.8.26) are both uniform and differentiable with respect to ξ. These results are valid when V0,α2 ξ 1/2 B0 and V0,α2 ξ 1/2 Bn−1 are finite. If ξ ∈ (α1 , 0), then there are solutions Wn,j (u, ξ), j = 3, 4, that are C ∞ on (α1 , 0), and as u → ∞ ! ! n−2 n−1 X Bs (ξ) X As (ξ) 1 1 1/2 1/2 1/2 + O 2n−1 + O 2n−2 − |ξ| Jν+1 u|ξ| , 2.8.29 Wn,3 (u, ξ) = |ξ| Jν u|ξ| u2s u u2s+1 u s=0 s=0 ! ! n−1 n−2 X As (ξ) X Bs (ξ) 1 1 1/2 1/2 1/2 2.8.30 Wn,4 (u, ξ) = |ξ| Yν u|ξ| + O 2n−1 + O 2n−2 − |ξ| Yν+1 u|ξ| . u2s u u2s+1 u s=0 s=0 Here A0 (ξ) = 1,
Z 0 dv 1 ψ(v)As (v) − ν + 21 A0s (v) , 1/2 |ξ| |v|1/2 ξ s = 0, 1, 2, . . . , and (2.8.28) again applies. For Jν and Yν see §10.2(ii). The expansions (2.8.29) and (2.8.30) are both uniform and differentiable with respect to ξ. These results are valid when Vα1 ,0 |ξ|1/2 B0 and Vα1 ,0 |ξ|1/2 Bn−1 are finite. Again, an alternative way of representing the error terms in (2.8.29) and (2.8.30) is by means of envelope functions. Let x = Xν be the smallest positive root of the equation 2.8.31
2.8.32
Bs (ξ) = −A0s (ξ) +
Jν (x) + Yν (x) = 0.
2.9
61
Difference Equations
Define env Jν (x) =
2.8.33
√
2 Jν (x),
env Yν (x) =
√ 2 |Yν (x)|,
0 < x ≤ Xν ,
1/2 , env Jν (x) = env Yν (x) = Jν2 (x) + Yν2 (x)
2.8.34
Xν ≤ x < ∞.
Then as u → ∞ 2.8.35
2.8.36
n−1 n−2 1 X As (ξ) X Bs (ξ) 1/2 1/2 1/2 Wn,3 (u, ξ) = |ξ| Jν u|ξ| − |ξ| Jν+1 u|ξ| + |ξ| env Jν u|ξ| O 2n−1 , u2s u2s+1 u s=0 s=0 n−2 1 n−1 X Bs (ξ) X As (ξ) 1/2 1/2 1/2 − |ξ| Y + |ξ| env Y u|ξ| u|ξ| O 2n−1 , Wn,4 (u, ξ) = |ξ|1/2 Yν u|ξ|1/2 ν+1 ν u2s u2s+1 u s=0 s=0 1/2
1/2
uniformly with respect to ξ ∈ (α1 , 0). For error bounds, more delicate error estimates, extensions to complex ξ, ν, and u, zeros, and examples see Olver (1997b, Chapter 12), Boyd (1990a), and Dunster (1990a). For other examples of uniform asymptotic approximations and expansions of special functions in terms of Bessel functions or modified Bessel functions of fixed order see §§13.8(iii), 13.21(i), 13.21(iv), 14.15(i), 14.15(iii), 14.20(vii), 15.12(iii), 18.15(i), 18.15(iv), 18.24, 33.20(iv).
2.8(v) Multiple and Fractional Turning Points The approach used in preceding subsections for equation (2.8.1) also succeeds when z0 is a multiple or fractional turning point. For the former f (z) has a zero of multiplicity λ = 2, 3, 4, . . . and g(z) is analytic. For the latter (z − z0 )−λ f (z) and g(z) are both analytic at z0 , λ (> −2) being a real constant. In both cases uniform asymptotic approximations are obtained in terms of Bessel functions of order 1/(λ + 2). More generally, g(z) can have a simple or double pole at z0 . (In the case of the double pole the order of the approximating Bessel functions is fixed but no longer 1/(λ + 2).) However, in all cases with λ > −2 and λ 6= 0 or ±1, only uniform asymptotic approximations are available, not uniform asymptotic expansions. For results, including error bounds, see Olver (1977c). For connection formulas for Liouville–Green approximations across these transition points see Olver (1977b,a, 1978).
approximants are parabolic cylinder functions. (For envelope functions for parabolic cylinder functions see §14.15(v)). For a coalescing turning point and double pole see Boyd and Dunster (1986) and Dunster (1990b); in this case the uniform approximants are Bessel functions of variable order. For a coalescing turning point and simple pole see Nestor (1984) and Dunster (1994b); in this case the uniform approximants are Whittaker functions (§13.14(i)) with a fixed value of the second parameter. For further examples of uniform asymptotic approximations in terms of parabolic cylinder functions see §§13.20(iii), 13.20(iv), 14.15(v), 15.12(iii), 18.24. For further examples of uniform asymptotic approximations in terms of Bessel functions or modified Bessel functions of variable order see §§13.21(ii), 14.15(ii), 14.15(iv), 14.20(viii), 30.9(i), 30.9(ii). For examples of uniform asymptotic approximations in terms of Whittaker functions with fixed second parameter see §18.15(i) and §28.8(iv). Lastly, for an example of a fourth-order differential equation, see Wong and Zhang (2007).
2.9 Difference Equations 2.9(i) Distinct Characteristic Values Many special functions that depend on parameters satisfy a three-term linear recurrence relation 2.9.1
2.8(vi) Coalescing Transition Points Corresponding to the problems for integrals outlined in §§2.3(v), 2.4(v), and 2.4(vi), there are analogous problems for differential equations. For two coalescing turning points see Olver (1975a, 1976) and Dunster (1996a); in this case the uniform
w(n + 2) + f (n)w(n + 1) + g(n)w(n) = 0, n = 0, 1, 2, . . . ,
or equivalently the second-order homogeneous linear difference equation 2.9.2
∆2 w(n) + (2 + f (n)) ∆w(n) + (1 + f (n) + g(n))w(n) = 0,
n = 0, 1, 2, . . . ,
in which ∆ is the forward difference operator (§3.6(i)).
62
Asymptotic Approximations
Often f (n) and g(n) can be expanded in series
2.9.3
f (n) ∼
∞ X s=0
fs , ns
g(n) ∼
∞ X s=0
gs , ns
2.9.7
ρj (f0 + 2ρj )sas,j =
ρ2j 2r+1
n → ∞,
wj (n) ∼ ρnj nαj
s=0
ns
n → ∞.
If |ρ2 | > |ρ1 |, or if |ρ2 | = |ρ1 | and <α2 > <α1 , then w1 (n) is recessive and w2 (n) is dominant as n → ∞. As in the case of differential equations (§§2.7(iii), 2.7(iv)) recessive solutions are unique and dominant solutions are not; furthermore, one member of a numerically satisfactory pair has to be recessive. When |ρ2 | = |ρ1 | and <α2 = <α1 neither solution is dominant and both are unique. For proofs see Wong and Li (1992a). For error bounds see Zhang et al. (1996). See also Olver (1967b). For asymptotic expansions in inverse factorial series see Olde Daalhuis (2004a).
2.9(ii) Coincident Characteristic Values When the roots of (2.9.5) are equal we denote them both by ρ. Assume first 2g1 6= f0 f1 . Then (2.9.1) has independent solutions wj (n), j = 1, 2, such that 2.9.9
∞ √ X cs (−1)js s/2 , wj (n) ∼ ρn exp (−1)j κ n nα n s=0
where p √ g0 κ = 2f0 f1 − 4g1 , 4g0 α = g0 + 2g1 , c0 = 1, and higher coefficients are determined by formal substitution. Alternatively, suppose that 2g1 = f0 f1 . Then the indices α1 , α2 are the roots of 2.9.10
2.9.11
2.9.5
ρ2 + f0 ρ + g0 = 0,
2.9.6
αj = (f1 ρj + g1 )/(f0 ρj + 2g0 ),
a0,j = 1, and
Provided that α2 − α1 is not zero or an integer, (2.9.1) has independent solutions wj (n), j = 1, 2, of the form 2.9.12
wj (n) ∼ ρn nαj
∞ X as,j s=0
,
j = 1, 2,
! r+1 X αj + r − s αj + r − s + ρj fq + gr+1 as−r,j , r+1 r+1−q q=0
s = 1, 2, 3, . . . . The construction fails iff ρ1 = ρ2 , that is, when f02 = 4g0 . When f02 6= 4g0 , there are linearly independent solutions wj (n), j = 1, 2, such that 2.9.8
∞ X as,j , ns s =0
where ρ1 , ρ2 are the roots of the characteristic equation
r=1
∞ X as,j
ρnj nαj
2.9.4
with g0 6= 0. (For the case g0 = 0 see the final paragraph of §2.9(ii) with Q negative.) This situation is analogous to second-order homogeneous linear differential equations with an irregular singularity of rank 1 at
s X
infinity (§2.7(ii)). Formal solutions are
2g0 α2 − (f0 f1 + 2g0 )α + 2g2 − f0 f2 = 0.
ns
,
n → ∞,
with a0,j = 1 and higher coefficients given by (2.9.7) (in the present case the coefficients of as,j and as−1,j are zero). If α2 − α1 = 0, 1, 2, . . . , then (2.9.12) applies only in the case j = 1. But there is an independent solution 2.9.13
w2 (n) ∼ ρn nα2
∞ X s=0 s6=α2 −α1
bs + cw1 (n) ln n, n → ∞. ns
The coefficients bs and constant c are again determined by formal substitution, beginning with c = 1 when α2 − α1 = 0, or with b0 = 1 when α2 − α1 = 1, 2, 3, . . . . (Compare (2.7.6).) For proofs and examples, see Wong and Li (1992a). For error bounds see Zhang et al. (1996). For analogous results for difference equations of the form 2.9.14
w(n + 2) + nP f (n)w(n + 1) + nQ g(n)w(n) = 0,
in which P and Q are any integers see Wong and Li (1992b).
2.9(iii) Other Approximations For asymptotic approximations to solutions of secondorder difference equations analogous to the Liouville– Green (WKBJ) approximation for differential equations (§2.7(iii)) see Spigler and Vianello (1992, 1997) and Spigler et al. (1999). Error bounds and applications are included.
2.10
63
Sums and Sequences
For discussions of turning points, transition points, and uniform asymptotic expansions for solutions of linear difference equations of the second order see Wang and Wong (2003, 2005). For an introduction to, and references for, the general asymptotic theory of linear difference equations of arbitrary order, see Wimp (1984, Appendix B).
2.10 Sums and Sequences 2.10(i) Euler–Maclaurin Formula As in §24.2, let Bn and Bn (x) denote the nth Bernoulli en (x) the number and polynomial, respectively, and B nth Bernoulli periodic function Bn (x − bxc). Assume that a, m, and n are integers such that n > a, m > 0, and f (2m) (x) is absolutely integrable over [a, n]. Then 2.10.1 n X
n
Z
f (x) dx + 12 f (a) + 21 f (n)
f (j) = a
j=a
m−1 X
+
s=1 n
Z +
a
Example
e2m (x) B2m − B f (2m) (x) dx. (2m)!
This is the Euler–Maclaurin formula. Another version is the Abel–Plana formula:
n X
j ln j
j=1
for large n. From (2.10.1) 2.10.4 1 ln n + C S(n) = 21 n2 ln n − 14 n2 + 12 n ln n + 12 m−1 X 1 (− B2s ) + Rm (n), + 2s−2 2s(2s − 1)(2s − 2) n s=2
where m (≥ 2) is arbitrary, C is a constant, and Z ∞ e B2m (x) − B2m 2.10.5 Rm (n) = dx. 2m(2m − 1)x2m−1 n e2m (x)−B2m is From §24.12(i), (24.2.2), and (24.4.27), B of constant sign (−1)m . Thus Rm (n) and Rm+1 (n) are of opposite signs, and since their difference is the term corresponding to s = m in (2.10.4), Rm (n) is bounded in absolute value by this term and has the same sign. Formula (2.10.2) is useful for evaluating the constant term in expansions obtained from (2.10.1). In the present example it leads to 1 γ + ln(2π) ζ 0 (2) − = − ζ 0 (−1), 12 2π 2 12 where γ is Euler’s constant (§5.2(ii)) and ζ 0 is the derivative of the Riemann zeta function (§25.2(i)). eC is sometimes called Glaisher’s constant. For further information on C see §5.17. Other examples that can be verified in a similar way are: 2.10.6
B2s (2s−1) f (n) − f (2s−1) (a) (2s)!
S(n) =
2.10.3
C=
2.10.7 2.10.2 n X j=a
Z f (j) = a
∞ nα+1 X α + 1 Bs , n → ∞, j ∼ ζ(−α) + s α + 1 s=0 ns j=1
n−1 X
n
f (x) dx + 12 f (a) + 21 f (n) Z
−2 0
∞
=(f (a + iy)) dy e2πy − 1
m X B2s (2s−1) f (n) (2s)! s=1 Z (−1)m ∞ y 2m dy +2 =(f (2m) (n + iϑn y)) 2πy , (2m)! 0 e −1
+
ϑn being some number in the interval (0, 1). Sufficient conditions for the validity of this second result are: (a) On the strip a ≤
α
where α (6= −1) is a real constant, and 2.10.8
n−1 X j=1
∞
X B2s 1 1 1 , n → ∞. ∼ ln n + γ − − j 2n s=1 2s n2s
In both expansions the remainder term is bounded in absolute value by the first neglected term in the sum, and has the same sign, provided that in the case of (2.10.7), truncation takes place at s = 2m − 1, where m is any positive integer satisfying m ≥ 12 (α + 1). For extensions of the Euler–Maclaurin formula to functions f (x) with singularities at x = a or x = n (or both) see Sidi (2004). See also Weniger (2007). For an extension to integrals with Cauchy principal values see Elliott (1998).
2.10(ii) Summation by Parts
(b) f (z) is real when a ≤ z ≤ n.
The formula for summation by parts is
(c) The first infinite integral in (2.10.2) converges.
2.10.9
n−1 X j=1
uj vj = Un−1 vn +
n−1 X j=1
Uj (vj − vj+1 ),
64
Asymptotic Approximations
where
Example
2.10.10 Uj = u1 + u2 + · · · + uj . This identity can be used to find asymptotic approximations for large n when the factor vj changes slowly with j, and uj is oscillatory; compare the approximation of Fourier integrals by integration by parts in §2.3(i).
From §§16.2(i)–16.2(ii)
Example
S(α, β, n) =
2.10.11
n−1 X
e
j ,
∞ X xj . (j!)3 j=0
We seek the behavior as x → +∞. From (1.10.8) 2.10.20
ijβ α
0 F2 (−; 1, 1; x) =
2.10.19
j=1
n−1 X
xj 1 = 3 (j!) 2i j =0
Z C
xt cot(πt) dt, (Γ(t + 1))3
where C comprises the two semicircles and two parts of the imaginary axis depicted in Figure 2.10.1.
where α and β are real constants with eiβ 6= 1. As a first estimate for large n 2.10.12
|S(α, β, n)| ≤
n−1 X
j α = O(1), O(ln n), or O nα+1 ,
j=1
according as α < −1, α = −1, or α > −1; see (2.10.7), (2.10.8). With uj = eijβ , vj = j α , 2.10.13
Uj = eiβ (eijβ − 1)/(eiβ − 1),
and eiβ i(n−1)β α e n −1 S(α, β, n) = iβ e −1 2.10.14
+
n−1 X
eijβ (j α − (j + 1)α ) .
Figure 2.10.1: t-plane. Contour C .
j=1
Since j α − (j + 1)α = −αj α−1 + α(α − 1) O j α−2 for any real constant α and the set of all positive integers j, we derive
From the identities
2.10.15
2.10.16
S(α, β, n) =
cot(πt) 1 1 1 1 = − − −2πit = + 2πit , 2i 2 e −1 2 e −1 and Cauchy’s theorem, we have
2.10.21
eiβ i(n−1)β α e n − αS(α − 1, β, n) eiβ − 1 + O nα−1 + O(1) .
From this result and (2.10.12)
n−1 X
xj = (j!)3 j =0
n−(1/2)
Z
−1/2
C1
xt dt (Γ(t + 1))3 e−2πit − 1
C2
xt dt , (Γ(t + 1))3 e2πit − 1
Z
2.10.22
−
S(α, β, n) = O(nα ) + O(1). Then replacing α by α − 1 and resubstituting in (2.10.16), we have 2.10.17
2.10.18
einβ α n + O nα−1 + O(1), n → ∞, iβ e −1 which is a useful approximation when α > 0. For extensions to α ≤ 0, higher terms, and other examples, see Olver (1997b, Chapter 8). S(α, β, n) =
2.10(iii) Asymptotic Expansions of Entire Functions The asymptotic behavior of entire functions defined by Maclaurin series can be approached by converting the sum into a contour integral by use of the residue theorem and applying the methods of §§2.4 and 2.5.
xt dt (Γ(t + 1))3
Z +
where C1 , C2 denote respectively the upper and lower halves of C . (5.11.7) shows that the integrals around the large quarter circles vanish as n → ∞. Hence 2.10.23 ∞
xt dt 3 −1/2 (Γ(t + 1)) Z i∞ xt dt + 2< 3 −2πit −1 −1/2 (Γ(t + 1)) e Z ∞ xt = dt + O(1), (Γ(t + 1))3 0 x → +∞, Z
0 F2 (−; 1, 1; x) =
2.10
65
Sums and Sequences
the last step following from |xt | ≤ 1 when t is on the interval [− 12 , 0], the imaginary axis, or the small semicircle. By application of Laplace’s method (§2.3(iii)) and use again of (5.11.7), we obtain exp 3x1/3 2.10.24 , x → +∞. 0 F2 (−; 1, 1; x) ∼ 2π31/2 x1/3 For generalizations and other examples see Olver (1997b, Chapter 8), Ford (1960), and Berndt and Evans (1984). See also Paris and Kaminski (2001, Chapter 5) and §§16.11(i)–16.11(ii).
2.10(iv) Taylor and Laurent Coefficients: Darboux’s Method Let f (z) be analytic on the annulus 0 < |z| < r, with Laurent expansion f (z) =
2.10.25
∞ X
fn z n ,
0 < |z| < r.
n=−∞
What is the asymptotic behavior of fn as n → ∞ or n → −∞? More specially, what is the behavior of the higher coefficients in a Taylor-series expansion? These problems can be brought within the scope of §2.4 by means of Cauchy’s integral formula Z f (z) 1 dz, 2.10.26 fn = 2πi C z n+1 where C is a simple closed contour in the annulus that encloses z = 0. For examples see Olver (1997b, Chapters 8, 9). However, if r is finite and f (z) has algebraic or logarithmic singularities on |z| = r, then Darboux’s method is usually easier to apply. We need a “comparison function” g(z) with the properties: (a) g(z) is analytic on 0 < |z| < r. (b) f (z) − g(z) is continuous on 0 < |z| ≤ r. (c) The coefficients in the Laurent expansion 2.10.27
g(z) =
∞ X
gn z n ,
0 < |z| < r,
n=−∞
have known asymptotic behavior as n → ±∞. By allowing the contour in Cauchy’s formula to expand, we find that 2.10.28
fn − gn =
1 2πi
Z |z|=r Z 2π
f (z) − g(z) dz z n+1 f reiθ − g reiθ e−niθ dθ.
1 2πrn 0 Hence by the Riemann–Lebesgue lemma (§1.8(i)) 2.10.29 fn = gn + o r−n , n → ±∞. =
This result is refinable in two important ways. First, the conditions can be weakened. It is unnecessary for f (z) − g(z) to be continuous on |z| = r: it suffices that the integrals in (2.10.28) converge uniformly. For example, Condition (b) can be replaced by: (b0) On the circle |z| = r, the function f (z) − g(z) has a finite number of singularities, and at each singularity zj , say, 2.10.30 f (z) − g(z) = O (z − zj )σj −1 , z → zj , where σj is a positive constant. Secondly, when f (z) − g(z) is m times continuously differentiable on |z| = r the result (2.10.29) can be strengthened. In these circumstances the integrals in (2.10.28) are integrable by parts m times, yielding 2.10.31 fn = gn + o r−n |n|−m , n → ±∞. Furthermore, (2.10.31) remains valid with the weaker condition 2.10.32 f (m) (z) − g (m) (z) = O (z − zj )σj −1 , in the neighborhood of each singularity zj , again with σj > 0. Example
Let α be a constant in (0, 2π) and Pn denote the Legendre polynomial of degree n. From §14.7(iv) 1 (1 − 2z cos α + z 2 )1/2 ∞ X = Pn (cos α)z n ,
f (z) ≡ 2.10.33
|z| < 1.
n=0
The singularities of f (z) on the unit circle are branch points at z = e±iα . To match the limiting behavior of f (z) at these points we set −1/2 g(z) = e−πi/4 (2 sin α)−1/2 e−iα − z 2.10.34 −1/2 + eπi/4 (2 sin α)−1/2 eiα − z . −1/2 Here the branch of e−iα − z is continuous in the z-plane cut along the outward-drawn ray through z = e−iα and equals eiα/2 at z = 0. Similarly for −1/2 eiα − z . In Condition (c) we have 2.10.35
1/2 Γ n + 12 2 cos nα + 21 α − 14 π , gn = π sin α n! and in the supplementary conditions we may set m = 1. Then from (2.10.31) and (5.11.7)
2.10.36
1/2 2 Pn (cos α) = cos nα + 12 α − 41 π +o n−1 . πn sin α For higher terms see §18.15(iii).
66
Asymptotic Approximations
For uniform expansions when two singularities coalesce on the circle of convergence see Wong and Zhao (2005). For other examples and extensions see Olver (1997b, Chapter 8), Olver (1970), Wong (1989, Chapter 2), and Wong and Wyman (1974). See also Flajolet and Odlyzko (1990).
2.11 Remainder Terms; Stokes Phenomenon 2.11(i) Numerical Use of Asymptotic Expansions When a rigorous bound or reliable estimate for the remainder term is unavailable, it is unsafe to judge the accuracy of an asymptotic expansion merely from the numerical rate of decrease of the terms at the point of truncation. Even when the series converges this is unwise: the tail needs to be majorized rigorously before the result can be guaranteed. For divergent expansions the situation is even more difficult. First, it is impossible to bound the tail by majorizing its terms. Secondly, the asymptotic series represents an infinite class of functions, and the remainder depends on which member we have in mind. As an example consider Z π cos(mt) dt, 2.11.1 I(m) = t2 + 1 0 with m a large integer. By integration by parts (§2.3(i)) 2.11.2
I(m) ∼ (−1)
m
∞ X qs (π) s=1
m2s
m → ∞,
,
x that is intended to be used. If the results agree within S significant figures, then it is likely—but not certain— that the truncated asymptotic series will yield at least S correct significant figures for larger values of x. For further discussion see Bosley (1996). In C both the modulus and phase of the asymptotic variable z need to be taken into account. Suppose an asymptotic expansion holds as z → ∞ in any closed sector within α < ph z < β, say, but not in α ≤ ph z ≤ β. Then numerical accuracy will disintegrate as the boundary rays ph z = α, ph z = β are approached. In consequence, practical application needs to be confined to a sector α0 ≤ ph z ≤ β 0 well within the sector of validity, and independent evaluations carried out on the boundaries for the smallest value of |z| intended to be used. The choice of α0 and β 0 is facilitated by a knowledge of the relevant Stokes lines; see §2.11(iv) below. However, regardless whether we can bound the remainder, the accuracy achievable by direct numerical summation of a divergent asymptotic series is always limited. The rest of this section is devoted to general methods for increasing this accuracy.
2.11(ii) Connection Formulas From §8.19(i) the generalized exponential integral is given by Z e−z z p−1 ∞ e−zt tp−1 2.11.5 dt Ep (z) = Γ(p) 1+t 0 when 0 and | ph z| < 21 π, and by analytic continuation for other values of p and z. Application of Watson’s lemma (§2.4(i)) yields
with 3
2t 24(t − t) , q2 (t) = 2 , 2 + 1) (t + 1)4 2.11.3 240(3t5 − 10t3 + 3t) . q3 (t) = − (t2 + 1)6 On rounding to 5D, we have q1 (π) = −0.05318, q2 (π) = 0.04791, q3 (π) = −0.08985. Hence q1 (t) = −
(t2
I(10) ∼ −0.00053 18 + 0.00000 48 − 0.00000 01 = −0.00052 71. But this answer is incorrect: to 7D I(10) = −0.00045 58. The error term is, in fact, approximately 700 times the last term obtained in (2.11.4). The explanation is that (2.11.2) is a more accurate expansion for the function I(m) − 21 πe−m than it is for I(m); see Olver (1997b, pp. 76–78). In order to guard against this kind of error remaining undetected, the wanted function may need to be computed by another method (preferably nonasymptotic) for the smallest value of the (large) asymptotic variable
2.11.6
Ep (z) ∼
∞ (p) e−z X (−1)s ss z s=0 z
when p is fixed and z → ∞ in any closed sector within | ph z| < 23 π. As noted in §2.11(i), poor accuracy is yielded by this expansion as ph z approaches 32 π or − 23 π. However, on combining (2.11.6) with the connection formula (8.19.18), with m = 1, we derive
2.11.4
2.11.7
Ep (z) ∼
∞ (p) 2πie−pπi p−1 e−z X z + (−1)s ss , Γ(p) z s=0 z
valid as z → ∞ in any closed sector within 21 π < ph z < 3 7 2 π; compare (8.20.3). Since the ray ph z = 2 π is well away from the new boundaries, the compound expansion (2.11.7) yields much more accurate results when ph z → 23 π. In effect, (2.11.7) “corrects” (2.11.6) by introducing a term that is relatively exponentially small in the neighborhood of ph z = π, is increasingly significant as ph z passes from π to 32 π, and becomes the dominant contribution after ph z passes 23 π. See also §2.11(iv).
2.11
67
Remainder Terms; Stokes Phenomenon
2.11(iii) Exponentially-Improved Expansions The procedure followed in §2.11(ii) enabled Ep (z) to be computed with as much accuracy in the sector π ≤ ph z ≤ 3π as the original expansion (2.11.6) in | ph z| ≤ π. We now increase substantially the accuracy of (2.11.6) in | ph z| ≤ π by re-expanding the remainder term. Optimum truncation in (2.11.6) takes place at s = n − 1, with |p + n − 1| = |z|, approximately. Thus
ph z ≤ 3π − δ with bounded |α|, and achieves uniform exponential improvement throughout 0 ≤ ph z ≤ π: q n −pπi 1 1 Fn+p (z) ∼ (−1) ie 2 erfc 2 ρ c(θ) 2.11.15
∞ eiρ(π−θ) e−ρ−z X h2s (θ, α) −i ρs (2πρ)1/2 s=0
! .
n = ρ − p + α,
Here erfc is the complementary error function (§7.2(i)), and q 2.11.16 c(θ) = 2(1 + eiθ + i(θ − π)),
where z = ρe , and |α| is bounded as n → ∞. From (2.11.5) and the identity
the branch being continuous with c(θ) ∼ π −θ as θ → π. Also,
2.11.8 iθ
2.11.9
n−1 X tn 1 = , (−1)s ts + (−1)n 1+t 1+t s=0
t 6= −1,
we have 2.11.10
Ep (z) =
n−1 (p) 2π p−1 e−z X z Fn+p (z), (−1)s ss + (−1)n z s=0 z Γ(p)
where 2.11.11
Z Γ(n + p) En+p (z) e−z ∞ e−zt tn+p−1 dt = . Fn+p (z) = 2π 0 1+t 2π z n+p−1 With n given by (2.11.8), we have −z
h0 (θ, α) =
∞
tα−1 e dt. exp −ρ teiθ − ln t Fn+p (z) = 2π 0 1+t For large ρ the integrand has a saddle point at t = e−iθ . Following §2.4(iv), we rotate the integration path through an angle −θ, which is valid by analytic continuation when −π < θ < π. Then by application of Laplace’s method (§§2.4(iii) and 2.4(iv)), we have Z
2.11.13 ∞ e−i(ρ+α)θ e−ρ−z X a2s (θ, α) , ρ → ∞, 1 + e−iθ (2πρ)1/2 s=0 ρs
uniformly when θ ∈ [−π + δ, π − δ] (δ > 0) and |α| is bounded. The coefficients are rational functions of α and 1 + eiθ , for example, a0 (θ, α) = 1, and 2.11.14
a2 (θ, α) =
eiα(π−θ) i − . −iθ 1+e c(θ) For the sector −3π + δ ≤ ph z ≤ π − δ the conjugate result applies. Further details for this example are supplied in Olver (1991a, 1994b). See also Paris and Kaminski (2001, Chapter 6), and Dunster (1996b, 1997).
2.11.18
2.11(iv) Stokes Phenomenon
2.11.12
Fn+p (z) ∼
eiα(π−θ) a2s (θ, α) 1 + e−iθ 2.11.17 1 · 3 · 5 · · · (2s − 1) , + (−1)s−1 i (c(θ))2s+1 with a2s (θ, α) as in (2.11.13), (2.11.14). In particular, h2s (θ, α) =
1 α 1 (6α2 − 6α + 1) − + . 12 1 + eiθ (1 + eiθ )2
Owing to the factor e−ρ , that is, e−|z| in (2.11.13), Fn+p (z) is uniformly exponentially small compared with Ep (z). For this reason the expansion of Ep (z) in | ph z| ≤ π − δ supplied by (2.11.8), (2.11.10), and (2.11.13) is said to be exponentially improved. If we permit the use of nonelementary functions as approximants, then even more powerful re-expansions become available. One is uniformly valid for −π + δ ≤
Two different asymptotic expansions in terms of elementary functions, (2.11.6) and (2.11.7), are available for the generalized exponential integral in the sector 1 3 2 π < ph z < 2 π. That the change in their forms is discontinuous, even though the function being approximated is analytic, is an example of the Stokes phenomenon. Where should the change-over take place? Can it be accomplished smoothly? Satisfactory answers to these questions were found by Berry (1989); see also the survey by Paris and Wood (1995). These answers are linked to the terms involving the complementary error function in the more powerful expansions typified by the combination of (2.11.10) and (2.11.15). Thus if 0 ≤ θ ≤ π − δ (< π), then c(θ)q lies in the right half-plane. Hence from §7.12(i)
1 erfc 2 ρ c(θ) is of the same exponentially-small order of magnitude as the contribution from the other terms in (2.11.15) when ρ is large. On the other hand, when π + δ ≤ θ ≤ 3π − δ, c(θ) is in the left half-plane q 1 and erfc 2 ρ c(θ) differs from 2 by an exponentiallysmall qquantity. In the transition through θ = π,
1 erfc changes very rapidly, but smoothly, 2 ρ c(θ) from one form to the other; compare the graph of its modulus in Figure 2.11.1 in the case ρ = 100.
68
Asymptotic Approximations
2.11(v) Exponentially-Improved Expansions (continued)
Figure 2.11.1: Graph of | erfc
√
Expansions similar to (2.11.15) can be constructed for many other special functions. However, to enjoy the resurgence property (§2.7(ii)) we often seek instead expansions in terms of the F -functions introduced in §2.11(iii), leaving the connection of the error-function type behavior as an implicit consequence of this property of the F -functions. In this context the F -functions are called terminants, a name introduced by Dingle (1973). For illustration, we give re-expansions of the remainder terms in the expansions (2.7.8) arising in differential-equation theory. For notational convenience assume that the original differential equation (2.7.1) is normalized so that λ2 − λ1 = 1. (This means that, if necessary, z is replaced by z/(λ2 − λ1 ).) From (2.7.12), (2.7.13) it is then seen that the optimum number of terms, n, in (2.7.14) is approximately |z|. We set
50 c(θ) |.
In particular, on the ray θ = π greatest accuracy is achieved by (a) taking the average of the expansions (2.11.6) and (2.11.7), followed by (b) taking account of the exponentially-small contributions arising from the terms involving h2s (θ, α) in (2.11.15). Rays (or curves) on which one contribution in a compound asymptotic expansion achieves maximum dominance over another are called Stokes lines (θ = π in the present example). As these lines are crossed exponentially-small contributions, such as that in (2.11.7), are “switched on” smoothly, in the manner of the graph in Figure 2.11.1. For higher-order Stokes phenomena see Olde Daalhuis (2004b) and Howls et al. (2004).
2.11.20
2.11.21
2.11.19
wj (z) = eλj z z µj
n−1 X s=0
as,j + Rn(j) (z), zs
j = 1, 2,
and expand
! Fn+µ2 −µ1 −s (z) (1) + Rm,n (z) , = (−1) ie e z C1 (−1) as,2 zs s=0 ! m−1 X Fn+µ1 −µ2 −s (ze−πi ) (2) n (µ2 −µ1 )πi λ1 z µ1 s (2) Rn (z) = (−1) ie e z C2 (−1) as,1 + Rm,n (z) , zs s=0 Rn(1) (z)
n−1
(µ2 −µ1 )πi λ2 z µ2
m−1 X
s
with m = 0, 1, 2, . . . , and C1 , C2 as in (2.7.17). Then as z → ∞, with |n − |z|| bounded and m fixed, ( O e−|z|−z z −m , | ph z| ≤ π, (1) 2.11.22 Rm,n (z) = O(z −m ), π ≤ | ph z| ≤ 25 π − δ, ( O e−|z|+z z −m , 0 ≤ ph z ≤ 2π, (2) 2.11.23 Rm,n (z) = O(z −m ), − 23 π + δ ≤ ph z ≤ 0 and 2π ≤ ph z ≤ 72 π − δ,
uniformly with respect to ph z in each case. The relevant Stokes lines are ph z = ±π for w1 (z), and ph z = 0, 2π for w2 (z). In addition to achieving uniform exponential improvement, particularly in | ph z| ≤ π for w1 (z), and 0 ≤ ph z ≤ 2π for w2 (z), the re-expansions (2.11.20), (2.11.21) are resurgent. For further details see Olde Daalhuis and Olver (1994). For error bounds see Dunster (1996c). For other examples see Boyd (1990b), Paris (1992a,b), and Wong and Zhao (2002b). Often the process of re-expansion can be repeated any number of times. In this way we arrive at hy-
perasymptotic expansions. For integrals, see Berry and Howls (1991), Howls (1992), and Paris and Kaminski (2001, Chapter 6). For second-order differential equations, see Olde Daalhuis and Olver (1995a), Olde Daalhuis (1995, 1996), and Murphy and Wood (1997). For higher-order differential equations, see Olde Daalhuis (1998a,b). The first of these two references also provides an introduction to the powerful Borel transform theory. In this connection see also ByattSmith (2000). For nonlinear differential equations see Olde Daalhuis (2005a,b).
2.11
69
Remainder Terms; Stokes Phenomenon
in which
For another approach see Paris (2001a,b).
2.11(vi) Direct Numerical Transformations The transformations in §3.9 for summing slowly convergent series can also be very effective when applied to divergent asymptotic series. A simple example is provided by Euler’s transformation (§3.9(ii)) applied to the asymptotic expansion for the exponential integral (§6.12(i)): 2.11.24
ex E1 (x) ∼
∞ X
(−1)s
s=0
s! xs+1
,
x → +∞.
2.11.30
an =
e−z/2 µ2 − (κ − 12 )2 µ2 − (κ − 32 )2 n−κ z n! · · · µ2 − (κ − n + 21 )2 .
With z = 1.0, κ = 2.3, µ = 0.5, the values of an to 8D are supplied in the second column of Table 2.11.1. Table 2.11.1: Whittaker functions with Levin’s transformation. n
an
2.11.25
1 −1.81352 667 −1.20699 601 −0.91106 488
5
e E1 (5) = 0.17042 . . . . We now compute the forward differences ∆j , j = 0, 1, 2, . . . , of the moduli of the rounded values of the first 6 neglected terms:
2.11.26
∆0 = 0.00768 , ∆1 = 0.00154 , 2.11.27 ∆2 = 0.00214 , ∆3 = 0.00192 , ∆4 = 0.00280 , ∆5 = 0.00434 . Multiplying these differences by (−1)j 2−j−1 and summing, we obtain 0.00384 − 0.00038 + 0.00027 − 0.00012 2.11.28 + 0.00009 − 0.00007 = 0.00363. Subtraction of this result from the sum of the first 5 terms in (2.11.25) yields 0.17045, which is much closer to the true value. The process just used is equivalent to re-expanding the remainder term of the original asymptotic series (2.11.24) in powers of 1/(x + 5) and truncating the new series optimally. Further improvements in accuracy can be realized by making a second application of the Euler transformation; see Olver (1997b, pp. 540–543). Similar improvements are achievable by Aitken’s ∆2 -process, Wynn’s -algorithm, and other acceleration transformations. For a comprehensive survey see Weniger (1989). The following example, based on Weniger (1996), illustrates their power. For large |z|, with | ph z| ≤ 23 π −δ (< 23 π), the Whittaker function of the second kind has the asymptotic expansion (§13.19) 2.11.29
Wκ,µ (z) ∼
∞ X n=0
an ,
0.60653 066
dn
Taking x = 5 and rounding to 5D, we obtain e5 E1 (5) = 0.20000 − 0.04000 + 0.01600 − 0.00960 + 0.00768 − 0.00768 + 0.00922 − 0.01290 + 0.02064 − 0.03716 + 0.07432 − · · · . The numerically smallest terms are the 5th and 6th. Truncation after 5 terms yields 0.17408, compared with the correct value
0.60653 066
sn
0
0.60653 066
2
0.35363 770 −0.85335 831 −0.82413 405
3
0.02475 464 −0.82860 367 −0.83323 429
4 −0.00736 451 −0.83596 818 −0.83303 750 5
0.00676 062 −0.82920 756 −0.83298 901
6 −0.01125 643 −0.84046 399 −0.83299 429 7
0.02796 418 −0.81249 981 −0.83299 530
8 −0.09364 504 −0.90614 485 −0.83299 504 9
0.39736 710 −0.50877 775 −0.83299 501
10
−2.05001 686 −2.55879 461 −0.83299 503
The next column lists the partial sums sn = a0 +a1 + · · · + an . Optimum truncation occurs just prior to the numerically smallest term, that is, at s4 . Comparison with the true value 2.11.31
W2.3,0.5 (1.0) = −0.83299 50268 27526 · · ·
shows that this direct estimate is correct to almost 3D. The fourth column of Table 2.11.1 gives the results of applying the following variant of Levin’s transformation: Pn n−1 sj j n j=0 (−1) j (j + 1) aj+1 2.11.32 . dn = Pn j n (j + 1)n−1 1 (−1) j=0 aj+1 j By n = 10 we already have 8 correct decimals. Furthermore, on proceeding to higher values of n with higher precision, much more accuracy is achievable. For example, using double precision d20 is found to agree with (2.11.31) to 13D. However, direct numerical transformations need to be used with care. Their extrapolation is based on assumed forms of remainder terms that may not always be appropriate for asymptotic expansions. For example, extrapolated values may converge to an accurate value on one side of a Stokes line (§2.11(iv)), and converge to a quite inaccurate value on the other.
70
Asymptotic Approximations
References General References The main references used in writing this chapter are Olver (1997b) and Wong (1989). For additional bibliographic reading see Bender (1974), Bleistein and Handelsman (1975), Copson (1965), de Bruijn (1961), Dingle (1973), Erd´elyi (1956), Jones (1972, 1997), Lauwerier (1974), Odlyzko (1995), Paris and Kaminski (2001), Slavyanov and Lay (2000), Temme (1995c), and Wasow (1965).
§2.3 Olver (1997b, Chapter 3). For (2.3.9) see Wong (1989, §2.2). For (2.3.12) use termwise integration in an analogous manner to that used to prove Watson’s lemma (Olver (1997b, pp. 71–72). (2.3.18) follows from (1.10.15) and (1.10.17) with f(t) = p(t), g(t) = q(t) p0 (t)(p(t) − p(a))(λ/µ)−1 , using Cauchy’s integral formula for the residue, and integrating by parts. See also Cicuta and Montaldi (1975). §2.4 Olver (1997b, Chapter 4 and pp. 315–320), Wong (1989, p. 31). §2.5 Wong (1989, Chapter 3), Doetsch (1955, §6.5). §2.6 Wong (1989, Chapter 6).
Sources The following list gives the references or other indications of proofs that were used in constructing the various sections of this chapter. These sources supplement the references that are quoted in the text.
§2.7 Olver (1997b, Chapters 5–7), Olver (1994a), Olde Daalhuis and Olver (1994), Olde Daalhuis (1998a). §2.8 Olver (1997b, Chapters 10–12). §2.10 Olver (1997b, Chapter 8).
§2.1 Olver (1997b, Chapter 1). §2.2 Olver (1997b, pp. 11–16), Fabijonas and Olver (1999).
§2.11 Olver (1997b, pp. 76–78 and 540–543), Olver (1991a), Weniger (1996). The computations in the example in §2.11(vi) were carried out at NIST.
Chapter 3
Numerical Methods N. M. Temme1 Areas 3.1 3.2 3.3 3.4 3.5 3.6
72 Arithmetics and Error Measures Linear Algebra . . . . . . . . . . Interpolation . . . . . . . . . . . Differentiation . . . . . . . . . . Quadrature . . . . . . . . . . . Linear Difference Equations . . .
. . . . . .
. . . . . .
. . . . . .
. . . . . .
. . . . . .
3.7 3.8 3.9 3.10 3.11 3.12
72 73 75 77 78 85
Ordinary Differential Equations Nonlinear Equations . . . . . . Acceleration of Convergence . Continued Fractions . . . . . . Approximation Techniques . . Mathematical Constants . . .
References
1 Centrum
. . . . . .
. . . . . .
. . . . . .
. . . . . .
. . . . . .
. . . . . .
88 90 93 94 96 100
100
voor Wiskunde en Informatica, Department MAS, Amsterdam, The Netherlands. Acknowledgments: The author thanks W. Gautschi and C. Brezinski for their valuable contributions, and F. W. J. Olver for assisting with the writing of §§3.6, 3.7, 3.8, and 3.11. c 2009 National Institute of Standards and Technology. All rights reserved. Copyright
71
72
Numerical Methods 1
Areas 3.1 Arithmetics and Error Measures 3.1(i) Floating-Point Arithmetic Computer arithmetic is described for the binary based system with base 2; another frequently used system is the hexadecimal system with base 16. A nonzero normalized binary floating-point machine number x is represented as 3.1.1
s
8
s E
E
x = (−1) · (b0 .b1 b2 . . . bp−1 ) · 2 ,
where s is equal to 1 or 0, each bj , j ≥ 1, is either 0 or 1, b1 is the most significant bit, p (∈ N) is the number of significant bits bj , bp−1 is the least significant bit, E is an integer called the exponent, b0 .b1 b2 . . . bp−1 is the significand, and f = .b1 b2 . . . bp−1 is the fractional part. The set of machine numbers Rfl is the union of 0 and the set p−1 X 3.1.2 bj 2−j , (−1)s 2E j=0
with b0 = 1 and all allowable choices of E, p, s, and bj . Let Emin ≤ E ≤ Emax with Emin < 0 and Emax > 0. For given values of Emin , Emax , and p, the format width in bits N of a computer word is the total number of bits: the sign (one bit), the significant bits b1 , b2 , . . . , bp−1 (p − 1 bits), and the bits allocated to the exponent (the remaining N − p bits). The integers p, Emin , and Emax are characteristics of the machine. The machine epsilon M , that is, the distance between 1 and the next larger machine number with E = 0 is given by M = 2−p+1 . The machine precision is 21 M = 2−p . The lower and upper bounds for the absolute values of the nonzero machine numbers are given by 3.1.3 Nmin ≡ 2Emin ≤ |x| ≤ 2Emax +1 1 − 2−p ≡ Nmax . Underflow (overflow) after computing x 6= 0 occurs when |x| is smaller (larger) than Nmin (Nmax ). IEEE Standard
The current standard is the ANSI/IEEE Standard 754; see IEEE (1985, §§1–4). In the case of normalized binary representation the memory positions for single precision (N = 32, p = 24, Emin = −126, Emax = 127) and double precision (N = 64, p = 53, Emin = −1022, Emax = 1023) are as in Figure 3.1.1. The respective machine precisions are 12 M = 0.596 × 10−7 and 1 −15 . 2 M = 0.111 × 10
N = 32, p = 24
f
1
11
52 bits
s
E
f
N = 64, p = 53
Figure 3.1.1: Floating-point arithmetic. Memory positions in single and double precision, in the case of binary representation. Rounding
Let x be any positive number with 3.1.4
b0 = 1,
23 bits
Nmin 3.1.5
x = (1.b1 b2 . . . bp−1 bp bp+1 . . . ) · 2E , ≤ x ≤ Nmax , and x− = (1.b1 b2 . . . bp−1 ) · 2E , x+ = ((1.b1 b2 . . . bp−1 ) + M ) · 2E .
Then rounding by chopping or rounding down of x gives x− , with maximum relative error M . Symmetric rounding or rounding to nearest of x gives x− or x+