Fisher Information Matrix of General Stable Distributions Close to the Normal Distribution By Muneya MATSUI arxiv:math/5559v1 [math.st] 6 Feb 5 Graduate School of Economics, University of Tokyo, Hongo 7-3-1, Bunkyo-Ku, Tokyo 113-33, Japan Abstract We investigate behavior of the Fisher information matrix of general stable distributions. Du- Mouchel 1975, 1983 proved that the Fisher information I αα of characteristic exponent α diverges to infinity as α approaches. Nagaev and Shkol nik 1988made more detailed analysis of I αα and derived asymptotic behavior of I αα diverging to infinity as α approaches in the symmetric case. Extending their work in this paper we have obtained behavior of the Fisher information matrix of general stable distributions as α approaches by detailed study of behavior of the corresponding density and its score functions. We clarify the limiting values of the 4 4 Fisher Information matrix with respect to the location µ, the scale σ, the characteristic exponent α and the skewness parameter β. Keywords General stable distributions, information matrix, normal distribution, score functions. 1 Notations and preliminary results The family of stable distributions has enjoyed great interest of researchers in many fields e.g., mathematics, physics, cosmology and even economics. These applications are summarized in Uchaikin and Zolotarev 1999. In statistical inference estimation of stable parameters has been of great interest. In recent years, maximum likelihood estimation of stable distributions has become feasible see Brorsen ans Yang 199, Nolan 1 or Matsui and Takemura 4. Even in time series models like GARCH using general stable distributions, maximum likelihood estimation is possible owing to recent development of global algorithm see Liu and Brorsen 1995. Since the Fisher information matrix gives useful criteria for the accuracy of estimation, it is indispensable to analyze that of general stable distributions. Near Gaussian distribution α =, the information of α, I αα diverges to and asymptotic behavior of I αα as α is of great interest. Nagaev and Shkol nik 1988 have solved this problem excellently for symmetric stable distributions. However for general stable distributions Nagaev and Shkol nik 1988 stated We note the problems under study are as yet unresolved for non-symmetric stable distributions. In this paper we investigate and obtain asymptotic behavior of I θθ, θ = µ,σ,α,β, as α under general stable distributions. Let Φt = Φt;µ,σ,α,β = exp σt α{ α 1+iβsgnttan } σt 1 α 1 +iµt mmatsui@grad.e.u-tokyo.ac.jp 1
denote the characteristic function of general stable distribution α 1 with parameters θ = θ 1,θ,θ 3,θ 4 = µ,σ,α,β, µ R, σ >, < α, β 1. For the standard case µ,σ =,1 we simply write the characteristic function as 1.1 Φt;α,β = exp t α{ α } 1+iβsgnttan t 1 α 1. This is Zolotarev s M parameterization see p.11 of Zolotarev 1986. The corresponding density is written as fx;µ,σ,α,β and fx;α,β in the standard case. Then fx;µ,σ,α,β = 1 x µ σ f σ ;α,β. We also write the density of N, as fx; = 1 exp x. 4 For the rest of this paper, without loss of generality we consider the Fisher information only at the standard case µ,σ =,1. The first derivative of fx;α,β with respect to x is denoted by f x;α,β and the partial derivative with respect to θ i, i.e., fx;µ,σ,α,β θ i is denoted by f θi x;α,β. Note that µ,σ=,1 1. f µ x;α,β = f x;α,β, 1.3 f σ x;α,β = fx;α,β xf x;α,β. The components of Fisher information matrix I are defined as follows. Let I ij = I θi θ j = α ζ = βtan f θ i f θ j 1 f dx., = α α arctan βtan From Theorem 1 of Nolan 1997, which is a modified version of the formula..18 of Zolotarev 1986, the density fx;α,β for the case α 1 and x ζ is written as 1.4 fx;α,β = α x ζ 1/α 1 α 1 1. Aϕ;α,βexp x ζ α/α 1 Aϕ;α,β dϕ,
where = sgnx ζ and 1.5 Aϕ;α,β = α 1 α 1 cos cos ϕ α α 1 sin { cos [ {α +α 1ϕ}] αϕ+ } cos ϕ is a positive function. Here we should note the relation fx;α,β = f x;α, β for x ζ <, which will be used many times. As α, ζ and converge to and at α = we obtain an unusual representation of Gaussian distribution N,, 1 exp fx; = x 1/ sin ϕ x / sin ϕ dϕ, x >. The remainder of this paper consists of three sections. In Section we derive behavior of f x;α,β, f µ x;α,β and f σ x;α as α by careful analysis of the formula 1.4. In Section 3 behavior of f α x;α,β and f β x;α,β are obtained by utilizing the inversion formula. The information matrix of general stable distributions is given in Section 4. Density and derivatives of general stable distributions close to the normal distribution In this Section the density and derivatives of general stable distributions as α and x are obtained. In the following we write = α. As we can show.1 fx;α,β = fx;+o uniformly in x by the finiteness of f α x;α,β, which can be easily verified by the formula 3. in the proof of Lemma 3.1. However if we consider the ratio fx;/fx;α,β rather than the difference fx; fx;α,β of the densities as x, fx, is much smaller than fx;α,β and we can not obtain an accurate approximation of fx, α, β without closer investigation of the remainder O. In the case of x we can utilize the asymptotic expansion. fx;α,β = 1+βx ζ 3 +o x 4 from the expansion.5.4 on p.94 of Zolotarev 1986, Bergström 1953 or Section XVII.6 of Feller 1971..5.4 of Zolotarev 1986 is in terms of B representation with characteristic function defined on p.1 of Zolotarev 1986. Hence as x f B x;α,β = 1+β B x 3 +o x 4, where f B and β B means the density or β of B representation. We obtain. by using the relation α 1 α α 1 α fx;α,β = cos f B cos x ζ;α,β B by noting that cos α 1 and β B = β +O as. Then the problem is which of the two approximations.1 and. is dominant for large x. We give an answer to this problem in the following two theorems, which are based on Theorem 1 of Nagaev and Shkol nik 1988. We can also see the precise statement on p.19 of Uchaikin and Zolotarev 3 concerning this problem. 3
Theorem.1 Let β, 1 < β < 1, be fixed and let β = βsgnx ζ. Define F 1 x;α,β = fx ζ;, F x;α,β = 1+β x ζ 3, gx;α,β = F 1 x;α,β +F x;α,β. For an arbitrarily small ǫ > there exist and x such that for all < and x > x, fx;α,β/gx;α,β 1 < ǫ. Furthermore, for an arbitrarily small constant δ >, F 1 x;α,β 1+o δ/ if x ζ δlog1/ 1/, gx;α,β = F x;α,β 1+o δ/ if x ζ +δlog1/ 1/, uniformly in x > x. Theorem. Define F 1 x;α,β = x ζfx ζ;, F x;α,β = 31+β x ζ 4, g x;α,β = F 1x;α,β +F x;α,β. Under the same conditions and notations of Theorem.1, for an arbitrarily small ǫ > there exist and x such that for all < and x > x, f x;α,β/g x;α,β 1 < ǫ. Furthermore, for an arbitrarily small constant δ >, F g 1 x;α,β 1+o δ/ if x ζ δlog1/ 1/, x;α,β = F x;α,β 1+o δ/ if x ζ +δlog1/ 1/, uniformly in x > x. We need the following 4 lemmas concerning behavior of Aϕ;α,β in 1.5 for ϕ. = 1 to prove Theorem.1andTheorem., whichcorrespondtothelemmas oftheorem1ofnagaev andshkol nik 1988. Inthelemmas andtheproofsof Theorems.1and. ǫandǫ denotearbitrarilysmall positive constants becausein the end of the proofs of Theorems.1 and. we let ǫ and ǫ separately. From now on the Fisher information is evaluated at a fixed value of β, β < 1. For notational abbreviation we sometimes write Aϕ;α,β as Aϕ. We also write Lemma.1 As and for λ /ǫ, λ = 1 ϕ, ϕ = 1 1/ ǫ. uniformly in λ. A1 λ = λ/ 1 1 1+β +λ/ 1+β +λ/ 1+o log1/ 4
Lemma. As Aϕ = 1 4 + 16 1 ǫ +o, A ϕ = 8 1/ ǫ 1+β 1/+3ǫ +O. 8 Lemma.3 As and λ such that λ 1/ ǫ, A1 λ = 1 4 + 16 λ +oλ, A 1 λ = 8 λ 1 λ+β 8λ 3 +oλ, A 1 λ = 8 + 8 λ 3 1 λ+β 8 λ 4 3 1 λ+β 4 λ 3 1 1 λ+β λ +oλ. Note that /ǫ 1/ ǫ λ implies = oλ and we have to consider terms like /λ 4 or /λ 3 in Lemma.3. Lemma.4 If is sufficiently small, Aϕ is a monotonically decreasing function on,1. The proofs of the lemmas are given in Appendix. In the following c > is an appropriate positive constant. Proof of Theorem.1 We prove the assertion in the case x ζ > first. As in the proof of Theorem 1 of Nagaev and Shkol nik 1988, let τ,η > be arbitrarily small numbers. We denote z = x ζ α/α 1 and ϕ = ϕ z 1/+τ. Then we divide the integral into six subintegrals, H = 1 Aϕ;α,βexp zaϕ;α,βdϕ H = 6 H k, k=1 where each H k corresponds to the integration of H for the k-th interval of [,1 η, [1 η,ϕ, [ϕ,ϕ, [ϕ,1 /ǫ, [1 /ǫ,1 ǫ and [1 ǫ,1]. First we calculate H i s utilizing Lemmas.1-.4 for fixed ǫ and ǫ. Later we see that H 3 and H 6 dominate the others terms. We also let ǫ and ǫ in the end. Calculation of H 1 : From Lemma., Aϕ > 1 4. By Lemma.4 and 1 η < ϕ, for sufficiently small there exists a constant ρ 1,1 such that ρ 1 A1 η > 1 4. Then for a constant γ > 1 4 we easily find.3 1 η 1 H 1 = z1 ρ 1 Aϕexp{ zρ 1 Aϕ z1 ρ 1 Aϕ}dϕ z1 ρ 1 1 z1 ρ 1 exp zρ 1A1 η = Oexp γz/z. 5
Calculation of H : From Lemma.4 H = ϕ 1 η Aϕ exp zaϕdϕ ηa1 ηexp zaϕ = Oexp zaϕ. Then we can write Aϕ = Aϕ +A ϕ ϕ ϕ + 1 A ξϕ ϕ, where ϕ ξ ϕ. By Lemma. and Lemma.3 we can write where zaϕ = z 4 +R 1,z,ǫ, za ϕ ϕ ϕ = R,z,ǫ, za ξϕ ϕ cz τ, R 1,z,ǫ = Oz 1 ǫ >, R,z,ǫ = O 1/ ǫ z 1/+τ >. Here we use functions R i,z,ǫ, i = 1,, for convenience in comparing H with H 3. Then.4 H = O exp z 4 R 1,z,ǫ R,z,ǫ cz τ. Calculation of H 3 : We show the detailed calculation of H 3 because this is the dominant term in H as and x. We have for ξ [ϕ,ϕ ], H 3 = exp zaϕ ϕ ϕ Aϕexp za ϕ ϕ ϕ z A ξϕ ϕ dϕ. Utilizing Lemmas. and.3, for some constants ρ 1,ρ,1 we obtain Aϕ = 1 4 + 16 λ +oλ, zaϕ = z 4 16 1 ǫ z +o z, za ϕ ϕ ϕ = 8 1/ ǫ + 1 8 1+β 1/+3ǫ ρ 1 z 1/+τ +O z 1/+τ, z A ξϕ ϕ = z 8 ϕ ϕ 8 λ 3 1 λ+β 8 λ 4 3 4 1 β +λ λ 3 1 1 λ+β λ +oλ ρ zτ. 6
Summarizing the main terms, we obtain where Aϕ = 1 4 +Oλ, zaϕ = z 4 R 1,z,ǫ, za ϕ ϕ ϕ = R 3,z,ǫ, z A ξϕ ϕ = z 8 ϕ ϕ +Oλ z τ +O /λ 4 z τ = z 8 ϕ ϕ +Oz 1+4τ +O 4ǫ z τ, < R 3,z,ǫ = O 1/ ǫ z 1/+τ R,z,ǫ. Note ϕ ϕ ϕ 1/ ǫ λ 1/ ǫ +z 1/+τ. Then we obtain H 3 = Rλ,,z,ǫ 1 4 exp z ϕ exp 4 where ϕ z 8 ϕ ϕ dϕ, Rλ,,z,ǫ = 1+Oλ exp R 1,z,ǫ R 3,z,ǫ+Oz 1+4τ +O 4ǫ z τ. Here the inequality gives ϕ ϕ exp z 8 ϕ ϕ dϕ = 1 Then we obtain.5 H 3 = exp x = e y / dy 1 x e x /, x > z z +O exp z 1 8 ϕ exp z1/+τ dϕ 1 exp z z τ z τ. z 8 ϕ dϕ z 4 R 1 1,z,ǫ R 3,z,ǫ z exp Oz 1+4τ +O 4ǫ z τ 1+o1. Written in this form, H 3 can be easily compared with H, i.e., the formula.4. Further we will see later that H 3 will be dominant if z 4 δlog1/ for an arbitrarily small constant δ >. Then we only have to consider the convergence of H 3 for z Olog1/. For z Olog1/, R 1,z,ǫ, R,z,ǫ and R 3,z,ǫ as. Finally we obtain.6 H 3 = 1 z exp z 1+o1 if z Olog1/. 4 Calculation of H 4 : From Lemma.4 H 4 1 /ǫ ϕ Aϕ exp za1 /ǫ dϕ 1/ ǫ Aϕ exp za1 /ǫ. 7
Here λ/ 1/ǫ. Then by Lemma.1 and.4 as where w is a nonnegative function such as Finally we obtain.7 H 4 O A1 /ǫ = ǫ 1 {ǫ 1+β+1} {ǫ 1+β+} = 1 4 1 wǫ, limwt =. t 1/ ǫ exp z 4 1 wǫ. ForthecomparisonofH 4 withh 3 andh 6, whichisneededinlater argument, westatesomeproperties of H 4. For a given small number δ >, there exists ǫ such that δ > wǫ. Then for z 4log1/, δ = exp δ4 4log1/ exp δ4 z. Consequently.8 H 4 O 1/ δ ǫ exp z 4 1+δ wǫ. In this representation H 4 can be easily compared with H 3. For z 4log1/.9 H 4 O exp cz. In this representation H 4 can be easily compared with H 6. Calculation of H 5 : From Lemma.1 for ǫ λ/ 1/ǫ, Aϕ is bounded. Then.1 1 ǫ H 5 = Aϕexp zaϕdϕ 1 /ǫ /ǫ ǫ O exp cz. sup ϕ 1 /ǫ,1 ǫ Aϕ exp zaϕ Calculation of H 6 : From Lemma.1 for λ/ ǫ A1 λ;α,β = λ/ 1/1 1+β 1+Oǫ +O log1/ = λ/ 1/1 1+R 4,ǫ, 1+β where R 4,ǫ = Oǫ + O log1/. Substituting the above results into H 6 and replacing ϕ = 1 λ by λ, we obtain ǫ 1+R4 H 6 = λ/ 1/1 1+R4 exp z λ/ 1/1 dλ. 1+β 1+β 8
Furthermore, replacing by x and defining H 6 is written as 1+β x 1 λ = 1+R 4 z gz = ǫ 1/1 1+R4 z, 1+β H 6 = 1+β1 z gz xexp xx dx {1+R 4 1 1 }. Then the integration of the right side of the equation is evaluated as gz xexp xdx+o = [ xe x e x] gz +O = 1+O ge g +O. Here for arbitrarily small constant ǫ and any, gz as z. Therefore.11 H 6 = 1+βz 1+o1. For fixed ǫ and ǫ the formulas.3,.4,.5,.7,.1 and.11 are proved. Comparing.3,.4,.5,.7,.1 and.11, the order of H i,i = 1,...,6, is summarized as follows: maxh 1,H,H 4,H 5 = omaxh 3,H 6. The relative dominance of H 3.6 and H 6.11 depends on the value of z. For an arbitrarily small δ >, H 6 = oh 3 if z 4 δlog1/, H 3 = oh 6 if z 4+δlog1/. These are easily confirmed if we substitute 4±δlog1/ into z. Now for proving the uniformity in and z we let ǫ,ǫ depending on and z. We first let ǫ. We can take ǫ = log1/ δ 1 for a constant δ,1. Concerning Lemmas.1-.4, we must consider the relations of ǫ /λ in Lemma.3. In the other lemmas the results do not change. Substituting ǫ = log1/ δ 1 into ǫ and taking logarithm of ǫ log ǫ = log1/ δ. Hence = oλ and the conclusion of Lemma.3 is not changed. Concerning the calculations of H i, the order of dominance is not affected by the limiting operation ǫ. For the comparison of H 3 and H 6 we may substitute ǫ = log1/ δ 1 and z = 4±δlog1/ into.5 and.11. The other comparisons are easy. Then we have only to confirm that H 3 satisfies.6 because the calculation of H 6 is not affected by ǫ. If we substitute ǫ = log1/ δ 1 into.5, we obtain.6 since z 1 ǫ, 1/ ǫ z 1/+τ, 4ǫ z τ, for z 4log1/ 9
imply R 1,z,ǫ, R,z,ǫ, R 3,z,ǫ, O 4ǫ z τ, for z 4log1/. Next we consider ǫ depending on. We may consider ǫ = log1/ δ 1 for an arbitrarily small δ,1. Concerning Lemma.1 ǫ must satisfy /ǫ 1/ ǫ. This is easily confirmed. ǫ does not affect the other lemmas. Concerning the calculations H i s, we must consider H 4, H 5 and H 6. The other H i s are not affected by ǫ. From.7 and the definition of wǫ, the calculation of H 4 concerning the order, i.e., formulas.8 and.9 are not changed. We investigate H 5 in detail. If [1 /ǫ,1 ǫ, then ǫ λ/ 1/ǫ and Aϕ of Lemma.1 satisfies Hence 1+o1 1+β ǫ 1/1 Aϕ. H 5 /ǫ ǫ sup ϕ 1 /ǫ,1 ǫ Aϕ exp zaϕ O /ǫ ǫ ǫ 1 1 exp czǫ 1 1 O exp czǫ 1/1. Then for z 4 4δ log1/ and for an arbitrarily small positive constant δ, H 5 O O δ exp z = oh 3. 4 For z 4 4δ log1/ H 5 = O exp cz δ = oh 6. Hence the order and dominant terms of H i s are not changed. For the calculation of H 6, gz must go to as z. Considering z 4+δlog1/, we can easily confirm this condition. Thus we can let ǫ depending on. Therefore convergence of H i,i = 1,...,6, only depends on and z and is faster as and z. Finally, substituting z = x ζ α/α 1 into H 3 and H 6 and multiplying these by α/α 1x ζ 1/α 1, we obtain the result for x ζ >. For x ζ < we utilize the relations fx;α,β = f x;α, β of general stable distributions. Proof of Theorem. From 1.4 the derivative of the density is calculated as follows..1 where f x;α,β = 1 α α 1 x ζ 1 fx;α,β α 1 x ζ/α 1 H, H = 1 A ϕ;α,βexp x ζ α/α 1 Aϕ;α,β dϕ. Since behavior of fx;α,β was obtained in Theorem.1, we evaluate the integration of the second term of.1. As in Theorem.1 we divide integral H into subintegrals, H = 6 H k, k=1 1
where each H k corresponds to the k-th interval of [,1 µ, [1 µ,ϕ, [ϕ,ϕ, [ϕ,1 /ǫ, [1 /ǫ,1 ǫ and [1 ǫ,1]. From Lemmas.1,. and.3, for λ /ǫ.13 A 1 λ = λ/ 1 1+β +λ/ 1+β +λ/ 4 1+O log1/, and for ϕ ϕ 1/ ǫ λ A ϕ = 1 16 + 3 1 ǫ +o, A 1 λ = 1 16 + 3 λ +oλ. Considering A ϕ, term of the integrand, we easily find the following results on H i H i,i = 1,...,5, in the proof of Theorem.1. similar to.14.15.16.17.18 H 1 Oexp γz/z, for γ > 1 4, H O exp z 4 +Oz 1 ǫ +Oz 1/+τ 1/ ǫ cz τ, H 3 1 = 8 z exp z 1+o1, 4 H 4 O 1/ ǫ exp z 4 1 wǫ, H 5 O exp cz. Later we see H 3 and H 6 dominate the others terms as H 3 and H 6 dominate the other H i s in Theorem.1. Since the calculation H 6 is somewhat different, we treat H 6 separately. From.13, for λ/ ǫ A 1 λ;α,β = λ/ 1 1+β 1+R4,ǫ, where R 4,ǫ is defined in the proof of Theorem.1. Substituting the above result into H 6 and replacing ϕ = 1 λ by λ, we obtain H 6 = Furthermore, replacing by x and defining H 6 is written as ǫ 1+R4 λ/ /1 exp z 1+β H 6 = 1+β1 z 3 1+β x 1 λ = 1+R 4 z gz = ǫ 1/1 gz 1+R4 z, 1+β 1+R4 λ/ 1/1 dλ. 1+β x exp xx dx {1+R 4 1 1 }. 11
Then the integration of the right side of the equation is evaluated as gz x exp xdx+o = [ x e x xe x e x] gz +O = +O g e g +O. Here for arbitrarily small constant ǫ and any, gz as z. Therefore.19 H 6 = 1+β z 3 1+o1. Hence for fixed ǫ and ǫ formulas.14-.19 are proved. From.14-.19 maxh 1,H,H 4,H 5 = omaxh 3,H 6. The relative dominance H 3 and H 6 depend on the value of z. For an arbitrarily small δ > H 6 = oh 3 if z 4 δlog1/, H 3 = oh 6 if z 4+δlog1/. These are easily confirmed if we substitute 4±δlog1/ into z. Substituting z = x ζ α/α 1 into H 3 and H 6 and multiplying each of them by α /α 1 x ζ /α 1 we obtain the second integral of the equation.1. Combining this with Theorem.1, we obtain the desired result. For x ζ < we use the relation fx;α,β = f x;α, β. For proving uniformity in and z we need to let ǫ,ǫ. We omit the derivation because it is quite similar to that in the proof of Theorem.1. From Theorem.1, Theorem. and formulas 1., 1.3, we obtain behavior of the score functions as α. These score functions in the corollaries below are needed for obtaining the Fisher information matrix of the general stable distributions. Corollary.1 Under the same conditions and notations of Theorem.1 and., define g µ x;α,β = g x;α,β/gx;α,β. Then for an arbitrarily small ǫ >, there exist and x such that for all < and x > x, Furthermore define f µ x;α,β/g µ x;α,β 1 < ǫ. Fµx;α,β 1 = x ζ, Fµ x;α,β = 3 x ζ. Then g µ x;α,β gx;α,β = F 1 µ x;α,β1 +o δ/ if x ζ δlog1/ 1/ F µ x;α,β1 +o δ/ if x ζ +δlog1/ 1/, 1
uniformly in x > x. For the remaining interval δlog1/ 1/ x +δlog1/ 1/, g µ x;α,β gx;α,β cx uniformly in x > x. Corollary. Under the same conditions and notations of Theorems.1 and., define g σ x;α,β = gx;α,β x ζg x;α,β. Then for an arbitrarily small δ >, there exist and x such that for all < and x > x Furthermore define f σ x;α,β/g σ x;α,β 1 < ǫ. Fσx;α,β 1 = x ζ, Fσ x;α,β =. Then g σ x;α,β gx;α,β = F 1 σx;α,β1+o 1/ if x ζ δlog1/ 1/ F σ x;α,β1+o 1/ if x ζ +δlog1/ 1/. For the remaining interval δlog1/ 1/ x +δlog1/ 1/, g σ x;α,β gx;α,β cx uniformly in x > x. 3 Derivatives of density with respect to the parameters α and β In this section we obtain the derivatives of the density with respect to the parameters α and β by analyzing the inversion formula. The density of general stable distributions can be written as 3.1 fx;α,β = 1 Re e itx Φt;α,βdt, where Φt; α, β is defined in 1.1. Utilizing 3.1, we derive the following two lemmas concerning derivatives with respect to α and β, which are extensions of Lemma 5 of Nagaev and Shkol nik 1988 to non-symmetric case. Lemma 3.1 As = α, there exists x and for all x x, f α x;α,β = 1 y 1+α where y = x ζ and M 1,,M 5 are some constants. { 1+β + M 1 +M log y + M 3 y + M 4 +M 5 log y y α }, 13
Lemma 3. Under the same conditions and notations of Lemma 3.1, f β x;α,β = sgny y 1+α 1+ M 6 + M 7 y + M 8 y α, where M 6, M 7 and M 8 are some constants. Furthermore uniformly x R. f β x;α,β = O, Proof of Lemma 3.1 First we consider the case of y = x ζ >. Differentiating f by α, we get f α x;α,β = 1 Re e ity exp t α α 3. 1 iβtan { α t α logt 1 iβtan +t α t iβ α } / cos dt. Transforming f α x;α,β by t s/y, we obtain f α x;α,β = 1 y Re e is exp { s α y α logs+logy s α y α α 1 iβtan α 1 iβtan Further transforming f α x;α,β by s te iς,ς = we find f α x;α,β = 1 y Re eiς α exp ite iς +it α y α α 1 iβtan { it α y α logt+iς +logy = K 1 +K, α 1 iβtan +s α y α sy 1 iβ α / cos } ds as in Lemma 5 of Nagaev and Shkol nik 1988, it α y α +ty 1 e iς iβ / cos α where K 1 and K are obtained in formulas E. and E.4 of appendix E. Then the lemma is proved for y = x ζ >. For y = x ζ <, we use the relation f α x;α,β = f α x;α, β. } dt Proof of Lemma 3. First we assume y = x ζ >. Differentiating the density 3.1 by β and doing the same transform as in Lemma 3.1, we obtain f β x;α,β = tanα 1 y y αre e iς e iteiς t α dt 1 y Re ie iς e iteiς tdt+ c y α + c y 1+α. The calculation of f β x;α,β is easy by the equations E.1 and E.3 in appendix E. As, tan α = +o. Finally we utilize the relation f β x;α,β = f β x;α, β and the first part of the lemma is proved. The second part of the lemma is obvious from f β x;α,β tan α 14 e tα t α t dt.
Table 1: Limit of information matrix at α = I θθ µ σ α β µ.5 σ. α β 4 Information matrix of general stable distributions The Fisher information matrix of general stable distributions are derived in this section. Table 1 gives limiting values of the information matrix at α =. To the author s knowledge other than the diagonal element and I µσ, these limiting results have not been given in literature. In following theorem we obtain asymptotic behavior of information matrix in more detail for the important diverging cases. Theorem 4.1 As = α, behavior of the Fisher information matrix of general stable distributions at µ =, σ = 1, β ±1, is given as follows..5 + o1 o1 o1 O.+o1 1 loglog1/ o loglog1/ I µµ I µσ I µα I µβ 1+o1 I σσ I σα I σβ I αα I αβ = 1 1 4 log1/ o. log 1/ I ββ 1+o1 41 β log1/ 1+o1 Note that for I µσ and I µα the rates of convergences to are not obtained and only the limiting values are obtained. For I σα, I αα and I αβ the exact rates of convergences are obtained. However for symmetric stable distributions since I µσ = I µα =, the above 3 3 matrix presents exact limiting behavior of the Fisher information matrix as. The idea of the proof is based on the proof of Theorem of Nagaev and Shkol nik 1988. Proof of Theorem 4.1 In our proof we use the following notations. T is a sufficiently large constant such that Theorem.1 and Corollaries.1 and. are applicable. We also denote x 1 = δlog1/ 1/, x = +δlog1/ 1/, x 3 = exp 1/, where δ > is an arbitrarily small constant. Further we use the notation const for some proper constants. We prove I αα in some detail and the proof of the other I θθ are given in Appendix F. Proof of I αα : In our proof we utilize Theorem.1 and Lemma 3.1. We divide integral of Fisher information matrix 15
into two parts, I αα = = I 1 αα +I αα. {f α x+ζ;α,β} dx+ fx+ζ;α,β {f α x ζ;α, β} dx fx ζ;α, β This is obtained by the relation fx;α,β = f x;α, β for x ζ <. Iαα 1 Further we divide integration Iαα 1 into five subintegrals, is calculated first. I 1 αα = 5 I αα k, k=1 whereeach I αα k correspondsto thek-th interval of [,T, [T,x 1, [x 1,x, [x,x 3 and [x 3,. Clearly 4.1 I αα 1 <. For I αα Then 4. I αα = const For I αα 3 Then fx+ζ;α,β = fx;1+o1, f α x+ζ;α,β = const x 3. x1 T x x 6 exp 4 dx const 1 1 δ log1/ 5/. fx+ζ;β,α = {1+β x 3 +fx;}1+o1, f α x+ζ;α,β = const x 3. 4.3 I αα 3 const 1 For I αα 4 Then x x 1 x 3 dx = const δ log1/. fx+ζ;α,β = 1+β x 3 1+o1, f α x+ζ;α,β = 1+βx 3 1+o1. 4.4 I αα 4 = 1+β For I αα 5 x3 x x 3 dx1+o1 = 1+β 8 log1/ 1+o1. fx+ζ;α,β = 1+β x 3 1+o1, f α x+ζ;α,β = 1+β + logxx 3 1+o1. 16
Then 4.5 I αα 5 = const 1 const const 1 x 3 e 1+β/ x 3 x 3 x 3 {max1+β, logx} dx x 3 logx dx+const 1 x 3 dx = Oe / 1/ /, as. e 1+β/ x 3 dx From the formulas 4.1-4.5 we obtain I 1 αα = 1+β 8 log1/ 1+o1. Setting β β in I 1 αα, we obtain I αα. Adding I 1 αα and I αα, we prove the assertion. A Proof of Lemma.1 As, α = arctan βtanα in Aϕ,α,β is expanded as α = α βtan arctan = β β1 β 3 3 +o 4. Since the smaller remainder terms other than β are not needed in the following argument we substitute β into Aϕ,α,β for α in advance. Then for convenience we write Aϕ,α,β of 1.5 as A.1 where Aϕ,α,β = cos {1 ϕ β } cos sin ϕcos β { ϕ β } sin { ϕ β } = Cϕ,,β DϕE,β 1/1, Bϕ,,β Bϕ,,β Bϕ,,β = sin { ϕ β }, Cϕ,,β = cos {1 ϕ β }, Dϕ = cos ϕ, E,β = cos β. 1/1 17
Then substituting 1 λ for ϕ we obtain A. B1 λ,,β = sin +λ λ+β, A.3 C1 λ,,β = sin +λ λ+β, A.4 D1 λ = sin λ, A.5 E,β = cos β. Note that if, then λ since λ /ǫ and ǫ > is an arbitrarily small fixed number or even when ǫ converges to slower than. Expanding in terms of, we have B1 λ,,β = 1+ λ +O λ+β 3, C1 λ,,β = 1+ λ +O λ+β 3, D1 λ = λ +O 3, E,β = 1 1 β +o 3. Substitutingthese expansions to Aϕ,,β of A.1 and utilizing x 1/ 1 = x 1 x 1 logx +o, we prove the desired result. B Proof of Lemma. We prove Aϕ,,β first. When ϕ = ϕ = 1 1/ ǫ, we replace λ by 1/ ǫ in the formulas A.-A.4. Then Bϕ,,β = sin { 1/ ǫ +1+β 3/ ǫ }, Cϕ,,β = sin { 1/ ǫ +1+β 3/ ǫ }, Dϕ = sin 1/ ǫ. Note that E,β is the same as in Proof of Lemma.1 and we omit it. As we have B.1 B. B.3 Bϕ,,β = 1/ ǫ { 1+ 1 1+β 1 +ǫ 6 1 ǫ 1 Cϕ,,β = { 1/ ǫ 1+1+β 1/+ǫ 1 6 4 1 ǫ Dϕ = 1/ ǫ 1 1 6 4 1 ǫ +o 3/. } 4 1+β 3/ ǫ +o 3/, } 8 1+β 3/ ǫ +o 3/, 18
Substituting these expansions into Aϕ,, β of A.1, we obtain the desired result. Next we prove assertion concerning A ϕ,,β. From the equation 1.5, we can write B.4A ϕ,,β = Aϕ,,β { cos { ϕ β } 1 sin { ϕ β } 1 sin {1 ϕ β } cos {1 ϕ β } 1 sin ϕ } 1 cos ϕ = Aϕ,,β { Fϕ,,β 1 Bϕ,,β 1 Gϕ,,β Cϕ,,β 1 } Hϕ, 1 Dϕ where Fϕ,,β = cos { ϕ β }, {1 ϕ β } Gϕ,,β = sin Hϕ = sin ϕ. Then substituting ϕ for ϕ, we obtain Fϕ,,β = cos { 1/ ǫ +1+β 3/ ǫ }, Gϕ,,β = cos { 1/ ǫ +1+β 3/ ǫ }, As, Hϕ = cos 1/ ǫ., B.5 Fϕ,,β = 1+ 1 1 ǫ + 1 1+β 3/ ǫ +o 3/, B.6 Gϕ,,β = 1 8 1 ǫ 4 1+β 3/ ǫ +o 3/, B.7 Hϕ = 1 8 1 ǫ +o 3/. Combining B.1-B.3, B.5-B.7, Aϕ,,β and A ϕ,α,β of B.4, we prove the lemma. C Proof of Lemma.3 We further expand Bϕ,,β, Cϕ,,β and Dϕ, in A.-A.4 with respect to λ. As and λ such that 1/ ǫ λ, C.1 C. C.3 B1 λ,,β { = λ 1 1 6 λ + 1 1 λ4 + 1 λ+β λ C1 λ,,β = { λ 1 1 6 λ 1 4 + 1 λ 1 λ+β + λ D1 λ, = λ { 1 1 6 λ 1 4 + 1 λ +oλ } 5. 19 } λ 1 λ+β+oλ 4, 4 } λ 1 λ+β+oλ 4, 8
Substituting these equations to Aϕ,, β, we obtain the result. Concerning A ϕ,α,β we use formulas F1 λ,,β = cos {λ+1 λ+β }, G1 λ,,β = cos {λ+1 λ+β }, H1 λ = cos λ. As and λ under 1/ ǫ λ, C.4 C.5 C.6 F1 λ,,β = 1+ 1 λ +oλ 3, G1 λ,,β = 1 1 λ +oλ 3, H1 λ = 1 1 λ +oλ 3. Substituting C.1-C.3 and C.4-C.6 to A ϕ,α,β of B.4, we obtain the desired assertion. From the equation 1.5 or A ϕ,α,β of B.4, we can write C.7A ϕ,,β = A ϕ,,β { Fϕ,,β 1 Bϕ,,β 1 Gϕ,,β Cϕ,,β 1 } Hϕ 1 Dϕ { } 3 +Aϕ 41 sin { ϕ β } 1 3 cos {1 ϕ β } 1 cos ϕ } = A ϕ,,β { Fϕ,,β 1 Bϕ,,β 1 Gϕ,,β Cϕ,,β 1 } Hϕ 1 Dϕ { 3 +Aϕ 41 B ϕ,,β 1 3 C ϕ,,β 1 } D. ϕ Combining C.1-C.3, C.4-C.6, A ϕ,α,β of B.4 and A ϕ,α,β of C.7, we obtain the desired assertion. D Proof of Lemma.4 We only need to prove for x ζ >, because for x ζ < fx;α,β = f x;α, β and in 1.5 does not change, namely = sgnx ζ α α βtan arctan = sgn x+ζ α α arctan βtan. We use notation β B 1,1 which corresponds to the parameter β 1,1 for B representation of characteristic functions. The reason is that the proof in terms of B representation is simpler since α = β B see p.74 of Zolotarev 1986 ; the notation in our paper corresponds to θ in Zolotarev and we do not need to expand α with respect to β as in the proof of Lemma.3. Moreover our purpose is only to determine the sign of A ϕ. We divide the integral interval as,1 /ǫ ],
[1 /ǫ,1 and prove the lemma for each interval. Except for the interval, we follow the line of the proof of Lemma 4 of Nagaev and Shkol nik 1988. For 1 /ǫ,1 the proof is obvious from Lemma.1. For,1 /ǫ ] we have to consider the sign of. Note that sgn = sgnβ B. First for ϕ 1 /ǫ /ǫ λ 1+, we get A ϕ = 1 1 AϕA 1ϕ, where A 1 1 λ = cot +λ λ+β B +1 cot +λ λ+β B +cot λ. From the formula 4.3.7 in [4] we have A 1 1 λ = 1+β B λ +λ λ+β B +λ λ+β B + d k γ k λ, k= where d k s are positive numbers and γ k λ = λ k+1[ { +1+β B /λ} 1 {1 +1+β B /λ} ]. Since /λ ǫ for arbitrarily small ǫ >, A 1 ϕ > is easily confirmed. Secondly we investigate the case < ϕ αϕ = γ where γ β B, for β B <. Then A 1 ϕ = cot αϕ+ +1 tan +tan {α +α 1ϕ} = cot γ β B +1 tan γ β B γ γ +tan. As, A 1 ϕ = γ β B +O. We easily find that A 1 ϕ > for sufficiently small. E Calculations of f α For all y y = x ζ, we have exp it α y α α 1 iβtan = 1+c t α y α 1 iβtan α, 1
where c C is some complex constant. Utilizing this expansion in f α x;α,β we obtain K 1 = 1 Re eiς y = = = it α y α logt+iς +logy 1 eiς y1+αre 1 eiς y1+αre + 1 y 1 eiς y1+αre exp ite iς +it α y α 1 iβtan eiς 1+αRe α 1 iβtan α dt α } { e iteiς 1+c t α y α 1 iβtan α it α logt+iς +logy 1 iβtan dt α e iteiς it α logt+iς +logy 1 iβtan dt e iteiς ic t α α logt+iς 1 βtan +logydt e iteiς it α logt+iς +logzdt+ c+clogy y 1+α + c+clogy y 1+α. Note that As, tan α = +o. Then we calculate the integrations in K 1 above. Write λ 1 = cosς and λ = sinς. Here at α =, λ 1 = 1/ and λ = 1/. From the formulas 3.5, 4.4 in part I and 3.7, 4.17 in part II of Oberhettinger 199, we have Re e iς e iteiς it α logtdt = e tλ t logt{λ 1 sintλ 1 λ costλ 1 }dt+ c = 4λ 1 λ arctan λ 1 3 +8λ 1 λ λ λ λ 1 EU + c = + c, E.1 Re ςe iς e iteiς t α dt = = 4ςλ 1 λ + c = + c, e tλ t {λ sintλ 1 +λ 1 costλ 1 }dt+ c Re e iς e iteiς it α dt = e tλ t {λ 1 sintλ 1 λ costλ 1 }dt+ c = λ 4 1 +λ 4 + c = c, where EU means Euler s constant. Substituting these equations into K 1, we obtain E. K 1 = 1 { y 1+α 1+ c+clogy+ c+clogy } y α.
For K we do the similar calculations. K = 1 Re eiς y = = exp ite iς +it α y α α 1 iβtan dt it α y α +ty 1 e iς iβ cos / α β { ycosα eiς e iteiς 1+ct α y α α 1 iβtan Re { β 1 ycosα eiς yαre e iteiς t α dt 1 y Re eiς } t α y α ity 1 e iς dt e iteiς itdt+ c y α + c } y 1+α. Substituting the following two equations into K, we obtain K. The first equation is obtained from formula E.1 in the calculation of K 1. The second equation is obtained from the formulas 3.5 in part I and 3.7 in part II of Oberhettinger 199. Re e iς e iteiς t α dt = + c, E.3 Hence E.4 Re ie iς e iteiς tdt = e tλ t{λ 1 λ costλ 1 +λ λ 1 sintλ 1}dt = λ 1 λ λ λ 1 +λ λ 1 λ 1λ =. K = β { y 1+α 1+ c+ c y α + c }. y F Proof of I θθ other than I αα Here we give proofs for I ββ,i αβ,i σα,i σβ, I µβ and I µα. In the following we assume T > x where x is defined in Theorem.1 and Corollaries.1 and.. Proof of I ββ : Here we utilize Theorem.1 and Lemma 3.. However the proof of I ββ is essentially the same as the proof of I αα because f β x;α,β = 1+β sgnx ζf αx;α,β1 +o1 for sufficiently large x ζ. Therefore we omit the detailed derivation of I ββ. Proof of I αβ : Here we utilize Theorem.1, Lemma 3.1 and Lemma 3.. From the same reason as I ββ we omit the proof. Proof of I σα : We make use of Lemma 3.1 and Corollary.. We divide integration I σα into two subintegrals, I σα = = I 1 σα +I σα. f σ x+ζ;α,βf α x+ζ;α,β dx+ fx+ζ;α,β 3 f σ x ζ;α, βf α x ζ;α, β dx fx ζ;α, β
I 1 σα is calculated first. Further we divide integration I 1 σα into four subintegrals, I 1 σα = 4 I σα k, k=1 where each I σα k corresponds to the integration of I 1 σα for the k-th interval of [,T, [T,x 1, [x 1,x and [x,. For I σα 1 clearly F.1 I σα 1 <. For I σα Then f σ x+ζ,α,β fx+ζ,α,β = x 1+o1, fx+ζ,α,β = 1+βx 3 1+o1. F. For I σα 3 x x 1 I σα = 1+β T dx1+o1 = 1+β loglog1/ 1+o1. 4 f σ x+ζ,α,β fx+ζ,α,β const x, f α x+ζ;α,β = 1+βx 3 1+o1, and It is easy to see F.3 f σ x+ζ;α,βf α x+ζ;α,β fx+ζ;α,β = const x 1 1+o1. I σα 3 = const x x 1 x 1 dx = Oδ. For I σα 4 f σ x+ζ;α,β fx+ζ;α,β 1+o1, f αx+ζ;α,β = 1+βx 3 1+o1. Thus we easily show F.4 I σα 4, as. From F.1, F., F.3 and F.4, we obtain Iσα 1 = 1 4 1+βloglog1/ 1+o1. Setting β β in Iσα, 1 we obtain Iσα. Adding Iσα 1 and Iσα, we prove the assertion. Proof of I σβ : 4
Here we utilize Lemma 3. and Corollary.. From the same reason as I ββ we omit the proof. Note that the result can be expected from behavior of I σα and the asymmetry of f β x;α,β around ζ, which we see in Lemma 3.. Proof of I µβ : Here we utilize Lemma 3. and Corollary.1. We divide integration I µβ into two subintegrals. I µβ = = I 1 µβ +I µβ. f µ x+ζ;α,βf β x+ζ;α,β dx+ fx+ζ;α,β I 1 µβ is calculated first. Further we divide integration I1 µβ Iµβ 1 = I µβ k, k=1 f µ x ζ;α, βf β x ζ;α, β dx fx ζ;α, β into two subintegrals, where each I µβ k corresponds to the integration of Iµβ 1 for the k-th interval of [,T and [T,. For I µβ 1 f β x+ζ;α,β = O, f µ x+ζ;α,β fx+ζ;α,β const. Then I µβ 1 = O. For I µβ it follows that f µ x+ζ;α,β fx+ζ;α,β const x, f βx+ζ;α,β = const x 3, uniformly in x [T,. Thus we find I µβ = O easily. Setting β β in Iµβ 1, we obtain I µβ. Adding Iµβ 1 and I µβ, we obtain the desired result. Proof of I µα : Here we utilize Lemma 3.1 and Corollary.1. We divide integration I σα into two subintegrals, xi µα = = I 1 µα +I µα. f µ x+ζ;α,βf α x+ζ;α,β dx fx+ζ;α,β f µ x ζ;α, βf α x ζ;α, β dx fx ζ;α, β Iµα 1 is calculated first. From Corollary.1 and Lemma 3. we can find an integrable function g 1 x such that for x, and all sufficiently small f µ x+ζ;α,βf α x+ζ;α,β fx;α,β g 1x. Hence we can apply the dominated convergence theorem to I 1 µα. Then lim I1 µα = We apply the same arguments as I 1 µα to I µα and obtain lim I µα = Adding Iµα 1 and I µα, we prove our assertion. f µ x;f α x; dx. fx; f µ x;f α x; dx. fx; 5
References [1] H. Bergström, On some expansions of stable distribution functions, Ark. Mat., 1953, pp. 375 378. [] B. W. Brorsen and S. R. Yang, Maximum likelihood estimates of symmetric stable distribution parameters. Comm. Statist. Simul., 19 199, pp. 1459 1464. [3] W. H. DuMouchel, Stable distributions in statistical inference : Information from stably distributed samples, J. Amer. Statist. Assoc., 7 1975, pp. 386 393. [4] W. H. DuMouchel, Estimating the stable index α in order to measure tail thickness: a critique, Ann. Statist., 11 1983, pp. 119 131. [5] W. Feller, An Introduction to Probability Theory and Its Applications, Vol,, nd ed., Wiley, New York, 1971. [6] S. Liu and B. W. Brorsen, Maximum likelihood estimation of a GARCH-stable model, Journal of Applied Econometrics, 1 1995, pp. 73 85. [7] M. Matsui and A. Takemura, Some improvements in numerical evaluation of symmetric stable density and its derivatives, Discussion Paper CIRJE-F-9, Faculty of Economics, University of Tokyo, 4. Also available at http://arxiv.org/abs/math.st/4831. [8] A. V. Nagaev and S. M. Shkol nik, Some properties of symmetric stable distributions close to the normal distribution, Theory of Probability and its Applications, 33 1988, pp. 139 144. [9] J. P. Nolan, Numerical computation of stable densities and distributions, Comm. Statist. Stochastic models, 13 1997, pp. 759-774. [1] J. P. Nolan, Maximum likelihood estimation and diagnostics for stable distributions. Lévy Processes: Theory and Applications, O. E. Barndorff-Nielsen et al. eds., Birkhauser, Boston, 1, pp. 379 4. [11] F, Oberhettinger, Tables of Fourier Transforms and Fourier Transforms of Distributions, Springer-Verlag, Berlin, 199. [1] V. V. Uchikin and V. M. Zolotarev, Chance and Stability, Stable Distributions and their Applications, Modern Probability and Statistics, Monographs, VSP BV, Utrecht, The Netherland, 1999. [13] V. M. Zolotarev, One-Dimensional Stable Distributions, Transl. of Math. Monographs, 65, Amer. Math. Soc., Providence, RI, 1986. Transl. of the original 1983 Russian 6