Esmaon of mulvarae asymmerc power GARCH models Y. Boubacar Maïnassara a, O. Kadmr a, B. Saussereau a a Unversé Bourgogne Franche-Comé, Laboraore de mahémaques de Besançon, UMR CNRS 6623, 16 roue de Gray, 25030 Besançon, France. arxv:1812.02061v1 mah.st 5 Dec 2018 Absrac I s now wdely acceped ha volaly models have o ncorporae he so-called leverage effec n order o o model he dynamcs of daly fnancal reurns. We sugges a new class of mulvarae power ransformed asymmerc models. I ncludes several funconal forms of mulvarae GARCH models whch are of grea neres n fnancal modelng and me seres leraure. We provde an explc necessary and suffcen condon o esablsh he src saonary of he model. We derve he asympoc properes of he quas-maxmum lkelhood esmaor of he parameers. These properes are esablshed boh when he power of he ransformaon s known or s unknown. The asympoc resuls are llusraed by Mone Carlo expermens. An applcaon o real fnancal daa s also proposed. Key words: Consan condonal correlaon, mulvarae asymmerc power GARCH models, quas-maxmum lkelhood, hreshold models 1. Inroducon The ARCH AuoRegressve Condonal Heeroscedasc model has been nroduced by Engle 1982 n an unvarae conex. Snce hs work a lo of exensons have been proposed. A frs one has been suggesed four years laer, namely he GARCH Generalsed ARCH model by Bollerslev 1986. Ths model had for goal o mprove modelng by consderng he pas condonal varance volaly. Ther concep are based on he pas condonal heeroscedascy whch depends on he pas values of he reurn. A consequence s he volaly has he same magnude for a negave or posve reurn. Fnancal seres have her own characerscs whch are usually dffcul o reproduce arfcally. An mporan characersc s he leverage effec whch consder negave reurns dfferenly han he posve reurns. Ths s n conradcon wh he consrucon of he GARCH model, because canno consder he asymmery. The TGARCH Threshold GARCH model nroduced by Rabemananjara and Zakoïan 1993 mprove modelng because consders he asymmery snce he volaly s deermned by he pas negave observaons and he pas posve observaons wh dfferen weghs. Varous asymmerc GARCH processes are nroduced n he economerc leraure, for nsance he EGARCH Exponenal GARCH and he log GARCH models see Francq e al. 2013 who suded he asympoc properes of an EGARCH1, 1 models. The sandard GARCH model s based on he concep ha he condonal varance s a lnear funcon of he squared pas nnovaons whereas he TGARCH model s based on he concep of condonal sandard devaon also called volaly. In realy, as menoned by Engle 1982, oher formulaons or several funconal forms of he volaly can be more approprae. Movaed by Box- Cox power ransformaons, Hggns and Bera 1992 proposed a general funconal form for he ARCH Emal addresses: malo:yacouba.boubacar_manassara@unv-fcome.fr Y. Boubacar Maïnassara, malo:ohman.kadmr@unv-fcome.fr O. Kadmr, malo:bruno.saussereau@unv-fcome.fr B. Saussereau Preprn submed o Elsever December 6, 2018
model, he so-called PARCH power-ransformed ARCH models n whch he condonal varance s modeled by a power δ see also Dng e al. 1993. Hwang and Km 2004 exend he PARCH models o he class of asymmerc models: he power ransformed asymmerc hreshold ARCH APARCH for shor model. Pan e al. 2008 generalzed he APARCH APGARCH model by addng he pas realzaons of he volaly. Hamadeh and Zakoïan 2011 suded he asympoc properes of he APGARCH models. In pracce, esmae real daase by he APGARCH model gves mporan resuls concernng he power. In fac, as we can see on he Table 1, he power s no necessary equal o 1 or 2 and s dfferen for each seres. Table 1: Esmaon of APGARH1, 1 model for real daase. We consder he seres of he reurns of he daly exchange raes of he Dollar USD, he Yen JPY, he Pounds GBP and he Canadan Dollar CAD wh respec o he Euro. The observaons cover he perod from January 4, 1999 o July 13, 2017 whch correspond o 4746 observaons. The daa were obaned from he web se of he Naonal Bank of Belgum. Exchange raes ˆω ˆα + ˆα ˆβ ˆδ USD 0.00279 0.02618 0.04063 0.96978 1.04728 JPY 0.00740 0.05331 0.08616 0.93580 1.12923 GBP 0.00240 0.06078 0.06337 0.94330 1.41851 CAD 0.00416 0.04054 0.03111 0.96114 1.56085 In he economerc applcaons, he unvarae APGARCH framework s very resrcve. Despe he fac ha he volaly of unvarae seres has been wdely suded n he leraure, modelng he realzaons of several seres s of grea praccal mporance. When several seres dsplayng emporal dependences are avalable, s useful o analyze hem jonly, by vewng hem as he componens of a vecor-valued mulvarae process. Conrarly o he class of Vecor Auo Regressve Movng Average VARMA, here s no naural exenson of GARCH models for vecor seres, and many MGARCH mulvarae GARCH formulaons are presened n he leraure see for nsance Nelson 1991, Engle and Kroner 1995, Engle 2002 and McAleer e al. 2008. See also Bauwens e al. 2006, Slvennonen and Teräsvra 2009 and Bauwens e al. 2012 for recen surveys on MGARCH processes. These exensons enal numerous specfc problems such ha denfably condons, esmaon,.... Among he numerous specfcaons of MGARCH models, he mos popular seem o be he Consan Condonal Correlaons CCC model nroduced by Bollerslev 1990 and exended by Jeanheau 1998 denoed CCC-GARCH, n he sequel. As menoned before, o model he dynamcs of daly fnancal reurns, we need o ncorporae he leverage effec o volaly models. Many asymmerc unvarae GARCH models have been consdered n he leraure o capure he leverage effec, exensons o he mulvarae seng have no been much developed. To our knowledge, noable excepons are McAleer e al. 2009 who exend he GJR model see Glosen e al. 1993 o he CCC Asymmerc GARCH. Anoher exenson s he Generalzed Auoregressve Condonal Correlaon GARCC model proposed by McAleer e al. 2008. Recenly Francq and Zakoïan 2012 proposed an asymmerc CCC-GARCH CCC-AGARCH model ha ncludes he CCC-GARCH nroduced by Bollerslev 1990 and s generalzaon by Jeanheau 1998. The aracveness of he CCC-AGARCH models follows from her racably see Francq and Zakoïan 2012. Sucarra e al. 2016 proposed a general framework for he esmaon and nference n unvarae and mulvarae log GARCH-X models when covaraes or oher condonng varables X are added o he volaly equaon wh Dynamc Condonal Correlaons of unknown form va he VARMA-X represenaon Vecor Auo Regressve Movng Average. 2
The man purpose of hs paper s o nroduce and sudy a mulvarae verson of he APGARCH models. In vew of he resuls summarzed n Table 1, appears o be nadequae o consder an unque power for all he m seres. Hence we propose he CCC power ransformed asymmerc hreshold GARCH denoed CCC-APGARCH or δ 0 CCC-GARCH, where δ 0 s a m vecor of powers and m s he number of seres consdered. Our model ncludes for examples he CCC-AGARCH developed by Francq and Zakoïan 2012 and of course, he mos classcal MGARCH model, he CCC-GARCH nroduced by Bollerslev 1990. An mporan feaure s ha he nerpreaon of he coeffcens and he condonal varance s smpler and explc. We shall gve a necessary and suffcen condon for he exsence of a srcly saonary soluon of he proposed model and we sudy he problem of esmaon of he CCC-APGARCH. For he esmaon of GARCH and MGARCH models, he commonly used esmaon mehod s he quas-maxmum lkelhood esmaon QMLE for shor. The asympoc dsrbuon of he Gaussan QMLE s obaned for a wde class of asymmerc GARCH models wh exogenous covaraes by Francq and Theu 2018. The asympoc heory of MGARCH models are well-known n he leraure. For nsance Jeanheau 1998 gave general condons for he srong conssency of he QMLE for mulvarae GARCH models. Come and Leberman 2003 see also Hafner and Premnger 2009 have proved he conssency and he asympoc normaly of he QMLE for he BEKK formulaon he acronym comes from synheszed work on mulvarae models by Baba, Engle, Kraf and Kroner. Asympoc resuls were esablshed by Lng and McAleer 2003 for he CCC formulaon of an ARMA- GARCH. See also Barde and Wnenberger 2009 who suded he asympoc behavor of he QMLE n a general class of muldmensonal causal processes allowng asymmeres. Recenly, he quasmaxmum lkelhood QML resuls have been esablshed for a MGARCH wh sochasc correlaons by Francq and Zakoïan 2016 under he assumpon ha he sysem s esmable equaon-by-equaon. See also Darolles e al. 2018, who proved he asympoc properes of he QML equaon-by-equaon esmaor of Cholesky GARCH models and me-varyng condonal beas. Francq and Sucarra 2017 prove he conssency and asympoc normaly of a leas squares equaon-by-equaon esmaor of a mulvarae log GARCH-X model wh Dynamc Condonal Correlaons by usng he VARMA-X represenaon. Srong conssency and asympoc normaly of CCC-Perodc-GARCH models are esablshed by Bb 2018. The asympoc normaly of maxmum-lkelhood esmaor of Dynamc Condonal Bea s proved by Engle 2016. In our conex, we use he quas-maxmum lkelhood esmaon. The proofs of our resuls are que echncal. These are adapaons of he argumens used n Francq and Zakoïan 2012 when he power s know, Hamadeh and Zakoïan 2011 and Pan e al. 2008 when he power s unknown. Ths paper s organzed as follows. In Secon 2 we nroduce he CCC-APGARCH model and show ha ncludes some class of MGARCH models. We esablshed he src saonary condon and we gve an denfably condon. Secon 3 s devoed o he asympoc properes of he quasmaxmum lkelhood esmaon when he power δ 0 s known. In Secon 4, we consder he esmaon of δ 0. Wald es s developed n Secon 5 n order o es he classcal MGARCH model agans a class of asymerc MGARCH models. The es can also be used o es he equaly beween he componens of δ 0. Smulaon sudes and an llusrave applcaon on real daa are presened n Secon 6 and we provde a concluson n Secon 7. The proofs of he man resuls are colleced n he Appendx A. 2. Model and src saonary condon In all hs work, we use he followng noaon u d := u d 1 1,..., udm m for u, d R m. 3
2.1. Model presenaon The m-dmensonal process ε = ε 1,,..., ε m, s called a CCC-APGARCHp, q f verfes ε = H 1/2 η, H = D R 0 D, D = dag h 1,,..., h m,, q { h δ 0 /2 = ω 0 + A + 0 ε+ δ 0 /2 + A 0 ε δ /2} 0 + where h = h 1,,..., h m, and wh x + = max0, x and x = mn0, x ε + = {ε + 1, }2,..., {ε + m, }2 ε = { ε 1, }2,..., { ε m, }2, p j=1 B 0j h δ 0 /2 j, 2.1 ω 0 and δ 0 are vecors of sze m 1 wh srcly posve coeffcens, A + 0, A 0 and B 0j are marces of sze m m wh posve coeffcens and R 0 s a correlaon marx. The parameers of he model are he coeffcens of he vecors ω 0, δ 0, he coeffcens of he marces A + 0, A 0, B 0j and he coeffcens n he lower rangular par excludng he dagonal of he marx R 0. The number of unknown parameers s s 0 = 2m + m 2 mm 1 2q + p +. 2 The nnovaon process η s a vecor of sze m 1 and sasfes he assumpon: A0 : η s an ndependen and dencally dsrbued d for shor sequence of varables on R m wh deny covarance marx and Eη = 0. Wh hs assumpon, he marx H s nerpreed as he condonal varance volaly of ε. The represenaon 2.1 ncludes varous MGARCH models. For nsance, f we assume ha A + 0 = A 0, he model 2.1 can be vewed as a mulvarae exenson and generalzaon of he he so-called PARCH power-ransformed ARCH models nroduced by Hggns and Bera 1992 denoed CCC-PGARCH, n he sequel. Moreover, f we also fxed he power vecor δ 0 = 2,..., 2 we oban he CCC- GARCHp, q model proposed by Jeanheau 1998. Now, f we assume ha A + 0 A 0, he model CCC-AGARCHp, q of Francq and Zakoïan 2012 s rereved. If we also fxed m = 1 he unvarae case, we rereve he APGARCH nroduced by Pan e al. 2008. As remarked by Francq and Zakoïan 2012, he neres of he APGARCH model 2.1 s o consder he leverage effec observed for mos of fnancal seres. I s well known ha a negave reurn has more effec on he volaly as a posve reurn. In fac, for he same magnude, he volaly h δ 0 /2 ncreases more f he reurn s negave han f s posve. In general we observe ha A + 0 < A 0 for some > 0 componen by componen. Bollerslev 1990 nroduced he CCC-GARCH model wh he assumpon ha he coeffcens marces A + 0 = A 0 and B 0j are dagonal. Ths assumpon mples ha he condonal varance h k, of he k-h componen of ε depends only on her own pas values and no on he pas values of he oher componens. By conras, n he model 2.1 ncludng he CCC-GARCH he condonal varance h k, of he k-h componen of ε depends no only on s pas values bu also on he pas values of he oher componens. For hs reason, Model 2.1 s referred o as he Exended CCC model by He and Teräsvra 2004. 2.2. Src saonary condon A suffcen condon for src saonary of he CCC-AGARCHp, q s gven by Francq and Zakoïan 2012. For he model 2.1 he src saonary condon s esablshed n he same way. For ha sake we rewre he frs equaon of 2.1 as ε = D η, where η = η 1,,..., η m, = R 1/2 0 η. 2.2 4
Usng he hrd equaon of model 2.1, we may wre ε ± δ 0/2 = Υ ±,δ 0 h δ 0/2, wh Υ ±,δ 0 = dag ± η 1, ± δ 0,1,..., ± η m, ± δ 0,m, 2.3 where δ 0 = δ 0,1,..., δ 0,m. To sudy he src saonary condon, we nroduce he marx expresson for he model 2.1 z = b + C z, where z = and {ε } { + δ0 /2,..., ε q+1 } + δ0 /2 { ε } { δ0 /2,,..., ε q+1 { } b = Υ +,δ 0 ω 0, 0 mq, C = { Υ,δ 0 } δ0 /2 {, h δ 0/2 } ω 0, 0 mq, {ω 0 }, 0 mp Υ +,δ 0 A + 01:q Υ +,δ 0 A 01:q Υ +,δ 0 B 01:p I mq 0 mq mp+q+1 Υ,δ 0 A + 01:q Υ,δ 0 A 01:q Υ,δ 0 B 01:p 0 mq mq I mq 0 mq mp A + 01:q A 01:q B 01:p 0 mp+q+1 mq I mp },..., { h δ 0/2 p+1},. 2.4 We have denoed A + 01:q = A+ 01... A+ 0q, A 01:q = A 01... A 0q and B 01:p = B 01... B 0p hey are m pm marces. The marx C s of sze p + 2qm p + 2qm. Le γc 0 he op Lyapunov exponen of he sequence C 0 = {C, Z}. I s defned by γc 0 := 1 lm + E log C 1 C... C 1 = nf 1 E log C C... C 1. Now we can sae he followng resuls. Ther proofs are he same han he one n Francq and Zakoïan 2012 so hey are omed. Theorem 1. Src saonary A necessary and suffcen condon for he exsence of a srcly saonary and non ancpave soluon process o model 2.1 s γc 0 < 0. When γc 0 < 0, he saonary and non ancpave soluon s unque and ergodc. The wo followng corollares are consequences of he necessary condon for src saonary. Le A a square marx, ρa s he specral radus of A.e. he greaes modulus of s egenvalues. Corollary 1. Le B 0 be he marx polynomal defned by B 0 z = I m zb 01 z p B 0p for z C and defne B B 0 = 01:p. I pm 0 pm 1 Then, f γc 0 < 0 he followng equvalen properes hold: The roos of deb 0 z are ousde he un dsk, ρb 0 < 1. Corollary 2. Suppose γc 0 < 0. Le ε be he srcly saonary and non ancpave soluon of model 2.1. There exss s > 0 such ha E h δ 0/2 s < and E ε δ 0/2 s <. 5
2.3. Idenfably condon In hs par, we are neresed n he denfably condon o ensure he unqueness of he parameers n he CCC-APGARCH represenaon. Ths s a crucal sep before he esmaon. The parameer ν s defned by ν := ω, α 1 +,..., α + q, α 1,..., α q, β 1,..., β p, τ, ρ, where α + and α are defned by α ± = veca ± for = 1,..., q, β j = vecb j for j = 1,..., p, τ = τ 1,..., τ m s he vecor of powers and ρ = ρ 21,... ρ m1, ρ 32,..., ρ m2,..., ρ mm such ha he ρ j s are he componens of he marx R. The parameer ν belongs o he parameer space 0, + m 0, m2 2q+p 0, + m 1, 1 mm/2. The unknown rue parameer value s denoed by ν 0 := ω 0, α + 01,..., α + 0m, α 01,..., α 0m, β01,..., β 0m, δ 0, ρ 0. We adop he followng noaon. For a marx A whch has o be seen as a parameer of he model, we wre A 0 when he coeffcens of he marx are evaluaed n he rue value ν = ν 0. Le A + L = q A+ L, A L = q A L and BL = I m p j=1 B jl j where L s he backshf operaor. By convenon A ± = 0 f q = 0 and BL = I m f p = 0. If he roos of deb 0 L = 0 are ousde he un dsk, we have from B 0 Lh δ 0/2 = ω 0 +A + 0 Lε+ δ 0/2 + A 0 Lε δ 0/2 he compac expresson: h δ 0/2 = B 0 1 ω 0 + B 0 L A + 0 Lε+ δ 0/2 + B 0 L A 0 Lε δ 0/2. 2.5 The parameer ν 0 s sad o be denfable f 2.5 does no hold rue when ν 0 s replaced by ν ν 0 belongng o. The assumpon ha he polynomals A + 0, A+ 0 and B 0 have no common roos s no suffcen o consder ha here s no anoher rple A + 0, A+ 0, B 0 such ha B A + = B 0 A+ 0 and B A = B 0 A 0. 2.6 Ths condon s equvalen as he exsence of an operaor UB such ha A + L = ULA + 0 L, A L = ULA 0 L and BL = ULB 0L. The marx UL s unmodular f deul s a consan no equal o zero. If he common facor o boh polynomals s unmodular, P L = ULP 1 L, QL = ULQ 1 L deul = c, he polynomals P L and QL are lef-coprmes. Bu n he vecoral case, suppose ha A + 0, A 0 and B 0 are lef-coprmes s no suffcen o consder ha 2.6 have no soluon for ν ν 0 see Francq and Zakoïan 2012. To oban a mld condon, for any column of he marx operaors A + 0, A 0 and B 0, we denoe by q + ν, q ν, and p ν her maxmal degrees. We suppose ha he maxmal values of he orders are mposed: ν, = 1,..., m, q + ν q+, q ν q, and p ν p 2.7 where q + q, q q and p p are fxed negers. We denoe a + he column vecor of he coeffcens L q + q+, a he column vecor of he coeffcens q L q n he column of A + 0, respecvely A 0 and b p he column vecor of he coeffcens L p n he column of B 0. 6
Proposon 1. Idenfably condon If he marx polynomals A + 0 L, A 0 L and B 0L are lef-coprme, A + 0 1 + A 0 1 0 and f he marx MA + 0 L, A 0 L, B 0L = a + 1... a + ma 1... a q + 1 q m + q 1 qmmb p1 1... b pm m has full rank m, under he consrans 2.7 wh q + = q + ν 0, q = q ν 0 and p = p ν 0 for any value of, hen { BL A + L = B 0 L A + 0 L BL A L = B 0 L A 0 L A+, A, B = A + 0, A 0, B 0. Proof of Proposon 1 The proof of he denfably condon s dencal as Francq and Zakoïan 2012 n he case of he CCC-AGARCH model. 3. Esmaon when he power s known In hs secon, we assume ha δ 0 s known. We wre δ 0 = δ n order o smplfy he wrngs. For he esmaon of GARCH and MGARCH models, he commonly used esmaon mehod s he QMLE, whch can also be vewed as a nonlnear leas squares esmaon LSE. The QML mehod s parcularly relevan for GARCH models because provdes conssen and asympocally normal esmaors for srcly saonary GARCH processes under mld regulary condons. For example, no momen assumpons on he observed process are requred see for nsance Francq and Zakoïan 2004 or Francq and Zakoïan 2010. As remarked n Secon 2, some parcular cases of Model 2.1 are obaned for δ = 2,..., 2 : he CCC-AGARCH nroduced by Francq and Zakoïan 2012 and he CCC model nroduced by He and Teräsvra 2004 wh A + 0 = A 0. Ths secon provdes asympoc resuls whch can, n parcular, be appled o hose models. 3.1. QML esmaon The procedure of esmaon and he asympoc properes are smlar o hose of he model CCC- AGARCH nroduced by Francq and Zakoïan 2012. The parameers are he coeffcens of he vecor ω 0, he marces A + 0, A 0 and B 0j, and he coeffcens of he lower rangular par whou he dagonal of he correlaon marx R 0. The number of parameers s s 0 = m + m 2 mm 1 p + 2q +. 2 The goal s o esmae he s 0 coeffcens of he model 2.1. In hs secon, we noe he parameer θ := ω, α 1 +,..., α + m, α 1,..., α m, β1,..., β m, ρ, where α + and α are defne by α ± = veca ± for = 1,..., q, β j = vecb j for j = 1,..., p and ρ = ρ 21,... ρ m1, ρ 32,..., ρ m2,..., ρ mm. The parameer θ belongs o he parameer space Θ 0, + m 0, m2 2q+p 1, 1 mm/2. The unknown rue value of he parameer s denoed by θ 0 := ω 0, α + 01,..., α + 0m, α 01,..., α 0m, β01,..., β 0m, ρ 0. 7
The deermnan of a square marx A s denoed by dea or A. Le ε 1,..., ε n be a realzaon of lengh n of he unque non-ancpave srcly saonary soluon ε of Model 2.1. Condonally o nonnegave nal values ε 0,..., ε 1 q, h 0,..., h 1 p, he Gaussan quas-lkelhood wres L n θ = L n θ; ε 1,..., ε n = n =1 1 2π m/2 H exp 1/2 where he H are recursvely defned, for 1, by H = D R D, D = dag h 1,,..., h m, h δ/2 δ/2 q := h θ = ω + A + ε+ δ/2 + A ε δ/2 + 1 2 ε A quas-lkelhood esmaor of θ s defned as any measurable soluon ˆθ n of where L n θ = 1 n ˆθ n = arg max n l, =1 L n θ = arg mn l = l θ = ε H ε, p j=1 B j hδ/2 j. L n θ, 3.1 H ε + log H. 3.2. Asympoc properes To esablsh he srong conssency, we need he followng assumpons: A1 : θ 0 Θ and Θ s compac, A2 : γc 0 < 0 and θ Θ, debz = 0 z > 1, A3 : For = 1,..., m he dsrbuon of η s no concenraed on 2 pons and P η > 0 0, 1. A4 : f p > 0, A + 0 1 + A 0 1 0, A+ 0 z, A 0 z and B 0z are lef-coprme and he marx MA + 0, A 0, B 0 has full rank m. If he space Θ s consraned by 2.7, Assumpon A4 can be replaced by he more general condon A4 : A4 wh MA + 0, A 0, B 0 replaced by A + 0q A 0q B 0p. A5 : R s a posve-defne correlaon marx for all θ Θ. To ensure he srong conssency of he QMLE, a compacness assumpon s requred.e A1. The assumpon A2 makes reference o he condon of src saonary for he model 2.1. Ths assumpon mples ha for he rue parameer θ 0, Model 2.1 adms a srcly saonary soluon bu s less resrcve concernng he oher values θ Θ. The second par of Assumpon A2 mples ha he roos of debz are ousde he un dsk. Assumpons A3 and A4 or A4 are made for denfably reasons. In parcular P η > 0 0, 1 ensures ha he process ε for = 1,..., m akes posve and negave values wh a posve probably f, for nsance, he ε were a.s. posve, he parameers α0j for j = 1,..., q could no be denfed. We are now able o sae he followng srong conssency heorem. Theorem 2. Le ˆθ n be a sequence of QMLE sasfyng 3.1. Then, under A0,..., A5 or A0,..., A4 and A5, we have ˆθ n θ 0, almos surely as n. The proof of hs resul s posponed o Subsecon A.2 n he Appendx A. I wll be useful o approxmae he sequence l by an ergodc and saonary sequence. Under Assumpon A2 here exss a srcly saonary, non ancpave and ergodc soluon h = h θ of h δ/2 := h δ/2 θ = ω + q A + ε+ δ/2 + A ε δ/2 + p j=1 B j h δ/2 j. 3.2 8
We denoe D = D θ = dag h 1,,..., h m, and H = H θ = D θrd θ and we defne L n θ = 1 n n l, =1 l = l θ = ε H ε + log H. To esablsh he asympoc normaly, he followng addonal assumpons are requred: A6 : θ 0 Θ, where Θ s he neror of Θ. A7 : E η η 2 <. Assumpon A6 prevens he suaon where ceran componens of θ 0 are equal o zero more precsely he coeffcens of he marces n our model. The second man resul of hs secon s he followng asympoc normaly heorem. Theorem 3. Under he assumpons of Theorem 2 and A6 A7, when n, we have L nˆθn θ 0 N 0, J IJ, where J s a posve-defne marx and I s a posve sem-defne marx, defned by l θ 0 l θ 0 2 l θ 0 I := Iθ 0 = E θ θ, J := Jθ 0 = E θ θ. The proof of hs resul s posponed o Subsecon A.3 n he Appendx A. Remark 1. In he one dmensonal case when m = 1, we have I = Eη 4 1J wh J = 4 1 h δ 0 /2 θ 0 h δ 0 /2 θ 0 δ 2 E 0 h δ 0 θ 0 θ θ. Ths expresson s n accordance wh he one of Theorem 2.2 n Hamadeh and Zakoïan 2011. 4. Esmaon when he power s unknown In hs secon, s assumed ha δ 0 s unknown. 4.1. QML esmaon Now we consder he case when he power s unknown. Thus parameer s jonly esmaed wh he ohers parameers. In pracce he coeffcens δ 0 s dffcul o denfed, as was remarked n Hamadeh and Zakoïan 2011 for he APGARCH model. For ha sake, we add he followng assumpon: A8 : η has a posve densy on some neghbourhood of zero. To defne he QML esmaor of ν, we replace H by H n he expresson of he creron defned n 3.1 and we oban recursvely H, for 1, H = D R D, D = dag h 1,,..., h m, 2/τ q p h := h ν = ω + A + ε+ τ/2 + A ε τ/2 + B j hτ/2 j. A quas-maxmum lkelhood esmaor of ν s defned as any mesurable soluon ˆν n of where L n ν = 1 n n l, =1 ˆν n = arg mn ν l = l ν = ε 9 j=1 L n ν, 4.1 H ε + log H.
4.2. Asympoc properes To esablsh he conssency and he asympoc normaly, we need some assumpons smlar o hose we assumed when he power s known. We wll assume A1,..., A6 wh he parameer θ whch s replaced by ν and he space parameer Θ s replaced by. Theorem 4. Srong conssency Le ˆν n be a sequence of QMLE sasfyng 3.1. Then, under A0,..., A5 or A0,..., A4 and A5, we have ˆν n ν 0, almos surely when n +. The proof of hs resul s posponed o Subsecon A.4 n he Appendx A. Theorem 5. Asympoc normaly Under he assumpons of Theorem 4, A6, A7 and A8, when n, we have nˆνn ν 0 L N 0, J IJ, where J s posve-defne marx and I s a posve sem-defne marx, defned by l ν 0 l ν 0 2 l ν 0 I := Iν 0 = E ν ν, J := Jν 0 = E ν ν. The proof of hs resul s posponed o Subsecon A.5 n he Appendx A. Remark 2. As n Remark 1, n he one dmensonal case, we have I = Eη 4 1J wh log h 2 J = E ν 0 ν log h 2 ν 0 ν. Ths expresson s agan n accordance wh he one of Theorem 3.1 n Hamadeh and Zakoïan 2011. 5. Lnear ess The asympoc normaly resuls from Theorem 3 and Theorem 5 are used o es lnear consrans on he parameer. We hus consder a null hypohess of he form H 0 : Cν 0 = c, 5.1 where C s a known s s 0 marx of rank s and c s a known vecor of sze s 1. The Wald es s a sandard paramerc es for esng H 0 and s parcularly approprae n he heavy-aled case whch s he conex of fnancal seres. Le Î and Ĵ be weakly conssen esmaors of I and J nvolved n he asympoc normaly of he QMLE. For nsance, I and J can be esmaed by her emprcal or observable counerpars gven by Î = 1 n n =1 l ˆν n l ˆν n ν ν and Ĵ = 1 n n =1 2 l ˆν n ν ν. Under he assumpons of Theorem 5, and he assumpon ha he marx I s nverble, he Wald es sasc s defned as follows W n s = C ˆν n c CĴ ÎĴ C C ˆν n c. We rejec he null hypohess for large values of W n s. If W n s > χ 2 sα here χ 2 sα correspond o he quanle of he Kh 2 dsrbuon of asympoc level α, we could conclude ha he powers of he 10
model 2.1 are equals. Thus we can consder a model wh equal powers and so we are able o reduce he dmenson of he parameer space. We can also es he equaly beween he componens of he power ν. For nsance, n he bvarae case wh he orders fxed a p = q = 1, we ake C = 0 14, 1, 0, 0 and c = τ 2 n 5.1 remnd ha ν 0 = ω, α +, α, β, τ 1, τ 2, ρ. Va hs knd of es, we can also es he asymmerc propery. If we rejec he asymmerc assumpon, we can consder he sandard CCC-PGARCH model and reduce he dmenson of he parameer space. We srengh he fac ha our normaly resuls can no be used n order o deermne he orders p,q of he model 2.1. Indeed, hs can be usually done when one ess he nully of he coeffcens of he marx B p. If hey are all equal o zero, we can consder a smaller order p and smlarly wh he marces A + q and A q wh he order q. Unforunaely, he assumpon A6 excludes he case of vanshng coeffcens so we can no apply our resuls n hs suaon. One refers o Secon 8.2 of Francq and Zakoïan 2010 for a dscusson on hs opc. 6. Numercal llusraons In hs secon, we make some smulaons wh η N 0, I 2 and we compue he QML esmaor o esmae he coeffcens of he model 2.1. The smulaons are made wh he open source sascal sofware R see R Developmen Core Team, 2017 or see hp://cran.r-projec.org/. We use he funcon nlmnb o mnmze he log quas-lkelhood. 6.1. Esmaon when he power s known We fxed he orders of he model 2.1 a q = 1 and p = 0. We compued he esmaor on N = 100 ndependen smulaed rajecores o assess he performance of he QMLE n fne sample. The rajecores are made n dmenson 2 wh a lengh n = 500 and n = 5, 000. The parameer used o smulae he rajecores are gven n frs row of he Table 2 and he space Θ assocaed s chosen o sasfed he assumpons of Theorem 3. As expeced, Table 2 shows ha he bas and he RMSE decrease when he sze of he sample ncreases. Fgures 1 and 2 summarze va box-plo, he dsrbuon of he QMLE for hese smulaons. Of course he precson around he esmaed coeffcens s beer when he sze of he sample ncreases see Fgures 1 and 2. Table 2: Samplng dsrbuon of he QMLE of θ 0 for he CCC-APGARCH0,1 model 2.1 for δ = 2, 2. Lengh n = 500 n = 5, 000 True val. Bas RMSE Bas RMSE ω 0 A + 0 A 0 ρ 0 1 0.25 0.05 0.5 0.5 0.5 1 0.05 0.25 0.5 0.5-0.00498 0.00180 0.00789-0.00525 0.00485-0.00471-0.00090 0.00683-0.02083-0.01505 0.00122 0.10714 0.08290 0.04520 0.12666 0.12379 0.03774 0.12073 0.04308 0.07730 0.12738 0.15095 0.00105-0.00063-0.00024 0.00346-0.00324 0.00010 0.00044-0.00175 0.00188 0.00175 0.00121 0.03526 0.02129 0.01464 0.04219 0.03950 0.01143 0.03745 0.01437 0.02220 0.03883 0.03890 11
δ 0 s known 0.0 0.2 0.4 0.6 0.8 1.0 1.2 θ^1 θ^2 θ^3 θ^4 θ^5 θ^6 θ^7 θ^8 θ^9 θ^10 θ^11 Esmaon errors for n=500 Fgure 1: Box-plo of he QMLE dsrbuon for n = 500 12
δ 0 s known 0.0 0.2 0.4 0.6 0.8 1.0 θ^1 θ^2 θ^3 θ^4 θ^5 θ^6 θ^7 θ^8 θ^9 θ^10 θ^11 Esmaon errors for n=5000 Fgure 2: Box-plo of he QMLE dsrbuon for n = 5, 000 6.2. Esmaon when he power s unknown In hs secon, we also fxed he orders q = 1 and p = 0 of Model 2.1 and we esmae he parameer ν 0. We compue, as he prevous secon, he esmaor on N = 100 ndependen smulaed rajecores n dmenson 2 wh szes n = 500 and n = 5, 000. Table 3 presens he resuls of QMLE of he parameers ncludng he powers δ = δ 1, δ 2. The resuls are sasfacory even for he parameer δ whch s dffcul o denfy n pracce see Secon 4.1 of Hamadeh and Zakoïan 2011 and whch s more dffcul o esmae han he ohers parameers. The conclusons are smlar as n he case where δ s known. The dsperson around he parameer δ s much more precse when he sample sze s n = 5, 000. The bas and he RMSE decrease when he sze of sample ncreases. Fgure 3 shows he dsrbuon of he parameer ˆν n for he sze n = 500. We remark ha he esmaon of he parameer δ has an mporan dsperson as regard o he oher parameers. When he sze of he sample s n = 5, 000 see Fgure 4, he esmaon of he power s more accurae. Table 4 dsplays he relave percenages of rejecon of he Wald es proposed n Secon 5 for esng he null hypohess H 0 : Cν 0 = 1, 1 n he case of bvarae CCC-APGARCH0, 1, where C s a 2 13 marx wh 1 n posons 1, 11 and 2, 12 and 0 elsewhere and ν 0 = 0.2, 0.3, 0.25, 0.05, 0.05, 0.25, 0.5, 0.5, 0.5, 0.5, 1, 1, 0.5. We smulaed N = 100 ndependen rajecores of sze n = 1, 000 and n = 10, 000 of Model 2.1 wh m = 2, q = 1 and p = 0. The nomnal asympoc level of he ess s α = 5%. The values n bold correspond o he null hypohess H 0. We remark ha he relave rejecon frequences of he Wald es are close o he nomnal 5% level under he null, and are close o 100% under he alernave. We draw he concluson ha he proposed es 13
well conrols he error of frs knd. Table 3: Samplng dsrbuon of he QMLE of ν 0 for he CCC-APGARCH0, 1 model 2.1 wh δ unknown. Lengh n = 500 n = 5, 000 True val. Bas RMSE Bas RMSE ω 0 A + 0 A 0 δ 0 ρ 0 1 0.25 0.05 0.5 0.5 2 0.5 1 0.05 0.25 0.5 0.5 2 0.12600-0.03211 0.00370-0.00853-0.00155 0.27015-0.00112 0.11629 0.00937-0.02054 0.04720 0.00177 0.33354 0.45385 0.08449 0.06808 0.14385 0.27142 1.13662 0.03772 0.48839 0.07917 0.09275 0.26265 0.16417 1.14144 0.00921-0.00490 0.00082-0.00526-0.00574 0.00000-0.00013 0.00072-0.00052 0.00183 0.01204 0.00196 0.00000 0.05023 0.02434 0.01783 0.04278 0.07725 0.16761 0.01067 0.04825 0.01935 0.02661 0.08433 0.04402 0.16004 Table 4: Emprcal sze n % of W n s for esng he null hypohess H 0 : Cν 0 = 1, 1 n he case of a CCC- APGARCH0, 1 model 2.1, where C s a 2 13 marx wh 1 n posons 1, 11 and 2, 12 and 0 elsewhere. The number of replcaons s N = 100 and he nomnal asympoc level s α = 5%. τ 1, τ 2 0.5, 0.5 0.5, 1 1, 1 Lengh n 1, 000 10, 000 1, 000 10, 000 1, 000 10, 000 W n 2 100.0 100.0 100.0 100.0 6.0 5.0 τ 1, τ 2 0.5, 1.5 1, 1.5 2, 2 Lengh n 1, 000 10, 000 1, 000 10, 000 1, 000 10, 000 W n 2 100.0 100.0 83.0 100.0 80.0 100.0 14
δ 0 s unknown 0 2 4 6 8 ν^1 ν^2 ν^3 ν^4 ν^5 ν^6 ν^7 ν^8 ν^9 ν^10 ν^11 ν^1 ν^13 Esmaon errors for n=500 Fgure 3: Box-plo of he QMLE dsrbuon for hese smulaons expermens, wh n = 500. 15
δ 0 s unknown 0.0 0.5 1.0 1.5 2.0 2.5 ν^1 ν^2 ν^3 ν^4 ν^5 ν^6 ν^7 ν^8 ν^9 ν^10 ν^11 ν^1 ν^13 Esmaon errors for n=5000 Fgure 4: Box-plo of he QMLE dsrbuon for hese smulaons expermens, wh n = 5, 000. 6.3. Esmaon on a real daase In hs secon, we propose o esmae he bvarae seres reurns of he daly exchange raes beween he Dollar USD and he Yen JPY agans he Euro EUR. The observaons cover he perod from January 4, 1999 o July 13, 2017 whch correspond o 4746 observaons. The daa were obaned from he webse of he Naonal Bank of Belgum hps://www.nbb.be. We dvde he full perod n hree subperods wh equal lengh n = 1581: he frs perod runs from 1999-01-04 o 2005-03-02, he second from 2005-03-03 o 2011-05-05 and he las one from 2011-05-06 o 2017-07-13. Frs, we consder he unvarae case and an APGARCH1, 1 model s esmaed by QML on he full perod and he hree subperods. Tables 5 and 6 show he unvarae analyss of he wo seres when δ 0 s known and esmaed, respecvely and gve an dea of he behavour of he modelng. We observe: 1. a srong leverage effec resp. no leverage effec of he JPY wh respec o s own pas reurn for he full, frs and second perods resp. for he hrd perods confrmed by he Wald es proposed n Secon 5. 2. almos no leverage effec s also confrmed by Wald es n he volaly of he USD for some perods 3. a srong perssence of pas volaly for he USD and JPY 4. dfferen values of he power ˆτ for he USD n he hree subperods. 16
To gve an dea of he relably of he parameer esmaes n he bvarae case obaned from he full perod 4746 observaons, he perod has been dvded no 3 subperods as n he unvarae analyss see Tables 5 and 6. Tables 7 and 8 presen he esmaon of he model 2.1 for he bvarae seres USD, JP Y when δ 0 s known and esmaed, respecvely. The concluson s he same as n Tables 5 and 6. Bu we also remark a srong correlaon beween he wo exchange raes. The power δ 0 s equvalen o he unvarae case and dffers for each subperod. We also noe ha none s equal o he ohers. The perssence marx B 01 has a dagonal form and he perssence of pas volaly s srong as n he unvarae case. The coeffcens correspondng o he negave reurns are generally bgger han hose for he posve reurns and some of hem are equal o zero. Snce we oban null esmaed coeffcens, we hnk ha he assumpon A6 s no sasfed and hus our asympoc normaly heorems do no apply. In fuure works we nen o sudy how he denfcaon orders p and q selecon procedure should be adaped n he CCC-APGARCHp, q framework consdered n he presen paper by exendng Secon 8.2 of Francq and Zakoïan 2010. Table 5: Esmaon of daly exchange raes of he Dollar and Yen agans he Euro wh he APGARCH1, 1 model n dmenson 1. δ 0 Parameers Full Perod Frs Perod Second Perod Thrd Perod USD JPY USD JPY USD JPY USD JPY ˆω 0.00492 0.01107 0.01098 0.01245 0.00245 0.01192 0.00363 0.01115 0.5 ˆα 1 + 0.02573 0.05211 0.02132 0.05832 0.03822 0.03087 0.00984 0.05656 ˆα 1 0.03512 0.06995 0.02919 0.07707 0.04447 0.06687 0.02780 0.06050 ˆβ 1 0.96960 0.93866 0.96626 0.93106 0.96405 0.94787 0.98016 0.94095 ˆω 0.00293 0.00803 0.00803 0.00993 0.00184 0.00826 0.00176 0.00826 1 ˆα 1 + 0.02628 0.05377 0.02205 0.06009 0.04306 0.02422 0.00127 0.06211 ˆα 1 0.04059 0.08504 0.03498 0.09537 0.04933 0.08989 0.03315 0.06808 ˆβ 1 0.96972 0.93620 0.96588 0.92635 0.96180 0.94543 0.98318 0.93977 ˆω 0.00177 0.00597 0.00600 0.00815 0.00149 0.00564 0.00103 0.00637 1.5 ˆα 1 + 0.02447 0.05075 0.02048 0.05620 0.04050 0.01979 0.00205 0.05886 ˆα 1 0.03803 0.08468 0.03274 0.09880 0.04617 0.09510 0.03102 0.06150 ˆβ 1 0.97041 0.93463 0.96675 0.92254 0.96131 0.94293 0.98273 0.94044 ˆω 0.00113 0.00466 0.00456 0.00693 0.00120 0.00396 0.00064 0.00509 2 ˆα 1 + 0.02100 0.04517 0.01672 0.04936 0.03408 0.01669 0.00406 0.05209 ˆα 1 0.03156 0.07586 0.02646 0.08730 0.03970 0.08730 0.02402 0.04845 ˆβ 1 0.97110 0.93242 0.96856 0.94046 0.96131 0.94046 0.98233 0.94082 ˆω 0.00078 0.00378 0.00347 0.00597 0.00096 0.00285 0.00044 0.00425 2.5 ˆα 1 + 0.01652 0.03838 0.01164 0.04137 0.02680 0.01340 0.00386 0.04405 ˆα 1 0.02438 0.06435 0.01945 0.08541 0.03246 0.07338 0.01624 0.03406 ˆβ 1 0.97161 0.92895 0.97126 0.91149 0.96114 0.93840 0.98284 0.94060 17
Table 6: Esmaon of daly exchange raes of he Dollar and Yen agans he Euro wh he APGARCH1, 1 model n dmenson 1. Parameers Full Perod Frs Perod Second Perod Thrd Perod USD JPY USD JPY USD JPY USD JPY ˆω 0.00279 0.00740 0.01070 0.00896 0.00127 0.00810 0.00185 0.00777 ˆα 1 + 0.02618 0.05331 0.02150 0.05864 0.03599 0.02394 0.00161 0.06189 ˆα 1 0.04063 0.08616 0.02992 0.09854 0.04158 0.09056 0.03302 0.06754 ˆβ 1 0.96978 0.93580 0.96620 0.92450 0.96130 0.94531 0.98309 0.93990 ˆτ 1.04728 1.12923 0.53666 1.24883 1.86581 1.02499 0.96029 1.10951 Table 7: Esmaon of daly exchange raes of he Dollar,Yen agans he Euro wh he CCC-APGARCH1, 1 model n dmenson 2 when δ 0 s fxed. δ 0 Parameers Full Perod Frs Perod Second Perod Thrd Perod ˆω 0.00535 0.33950 0.01813 0.06369 0.14680 0.33068 0.08347 0.09406 ˆα 1 + 0.04265 0.01283 0.10252 0.14253 0.00000 0.00000 0.04520 0.00361 0.00484 0.11529 0.06218 0.02385 0.04232 0.03573 0.00000 0.07928 ˆα 1 0.02825 0.00000 0.05721 0.02225 0.00000 0.00000 0.00000 0.00000 2, 1 0.02203 0.03164 0.00000 0.06317 0.11239 0.17432 0.08536 0.04928 ˆβ 1 0.94718 0.37445 0.86761 0.73823 0.04727 0.00000 0.02670 0.00000 0.00000 0.00000 0.00000 0.00000 0.79038 0.63165 0.86991 0.87176 ˆρ 21 0.68316 0.74252 0.66079 0.69230 ˆω 0.00600 0.06562 0.01928 0.04892 0.04538 0.12019 0.01354 0.02421 ˆα 1 + 0.03022 0.02592 0.07476 0.09216 0.00526 0.00000 0.06385 0.00262 0.00000 0.00000 0.02459 0.00734 0.06315 0.04730 0.00443 0.07986 ˆα 1 0.02421 0.02062 0.03516 0.03387 0.00000 0.0000 0.00000 0.00000 2, 2 0.00808 0.00986 0.00000 0.01241 0.14923 0.25040 0.13401 0.05892 ˆβ 1 0.95080 0.82370 0.87099 0.77251 0.00000 0.00000 0.00000 0.00000 0.00000 0.00000 0.00528 0.00000 0.81186 0.65577 0.88146 0.88318 ˆρ 21 0.55335 0.61313 0.52596 0.56145 18
Table 8: Esmaon of daly exchange raes of he Dollar,Yen agans he Euro wh he CCC-APGARCH1, 1 model n dmenson 2. Parameers Full Perod Frs Perod Second Perod Thrd Perod ˆω 0.00136 0.00117 0.02407 0.11245 0.06124 0.15275 0.01453 0.07930 ˆα 1 + 0.03050 0.00719 0.06434 0.04457 0.00000 0.00000 0.06129 0.01818 0.00000 0.05530 0.01975 0.00000 0.05368 0.04459 0.00292 0.05135 ˆα 1 0.02351 0.00000 0.03112 0.02393 0.00000 0.00613 0.00000 0.00000 0.01072 0.00994 0.00000 0.00000 0.12207 0.15270 0.12752 0.01499 ˆβ 1 0.95326 0.41630 0.89072 0.90158 0.03182 0.00000 0.00000 0.00000 0.00000 0.00000 0.00382 0.00410 0.80512 0.70082 0.88657 0.87580 ˆρ 21 0.55106 0.61076 0.52380 0.57556 ˆτ 1 2.01916 3.93035 1.95333 1.53699 ˆτ 2 1.88965 1.72984 1.98917 1.77340 7. Concluson In hs paper we propose a class of mulvarae asymmerc GARCH models whch ncludes numerous funconal forms of MGARCH. We provde an explc necessary and suffcen condon o he src saonary of he proposed model. In addon he asympoc properes of he QMLE are nvesgaed n he wo cases of δ known and unknown We remark ha momen condons are no needed. A Wald es s proposed o es s lnear consrans on he parameer. In Mone Carlo expermens we demonsraed ha he QMLE of he CCC-APGARCH models provde some sasfacory resuls, a leas for he models consdered n our sudy. A. Appendx : Proofs of he man resuls A.1. Prelmnares In he followng echncal proofs we wll use he followng noaons. We wll use he mulplcave norm defned as: A := sup Ax = ρ 1/2 A A, x 1 where A s a marx of sze d 1 d 2 and x s he Eucldan norm of vecor x R d 2 and ρ s he specral radus. We recall ha hs norm sasfes A 2,j a 2,j = T ra A d 2 A 2, A A A 2d 2. Moreover we have he followng relaon T rab d 1 d 2 1/2 A B 19
as long as he marx produc s well defned acually B s a d 2 d 1 marx. We recall some useful dervaon rules for marx valued funcons. If we consder fa a scalar funcon of a marx A, where all he a j are consdered as a funcon of an one real varable x, we have fa x =,j fa a j a j x = T r For a non sngular marx A, we have he followng relaons: A.2. Proof of Theorem 2 fa A A. A.1 x c Ac A = cc A.2 T rca BA A = C AB + B AC A.3 log dea A = A A.4 A x A = A x A A.5 T rca B A = A BCA A.6 T rcab A = BC A.7 We prove he conssency of he QMLE resul when δ 0 known followng he same lnes as n Francq and Zakoïan 2012. We frs rewre Equaon 3.2 n he marx form as follows: H θ = c θ + Bθ H θ, A.8 wh and H θ = h δ/2 θ h δ/2 θ. h δ/2 p+1 θ ω +, c θ = q A + ε+ δ/2 + A ε δ/2 0. 0 B 1 B 2... B p I m 0 Bθ = 0 I m....... 0... I m 0 For smplcy, one wres H nsead of H θ when here s no possble confuson and analogously one wres c and B. We erae he expresson A.8 and we oban H = c + Bc + B 2 c 2 +... + B c 1 + B H 0 = B k c k. k=0 A.9 The proof s decomposed n he four followng pons whch wll be reaed n separae subsecons. 20
Inal values do no nfluence quas-lkelhood: lm n sup L n θ L n θ = 0, almos surely. Idenfably: f here exss Z such ha h δ 0 /2 θ = h δ 0 /2 θ 0 almos surely and R = R 0, hen θ = θ 0 Mnmzaon of he quas-lkelhood on he rue value: E θ0 l θ 0 <, and f θ θ 0, E θ0 l θ > E θ0 l θ 0. v For any θ θ 0 here exss a neghborhood V θ such ha lm nf n nf L n θ > E θ0 l 1 θ 0, a.s. A.10 θ V θ A.2.1. Inal values do no nfluence quas-lkelhood We defne he vecors H by replacng he varables h δ/2, = 0,..., p 1, n H δ/2 by h and we have H = c + Bc +... + B q c q+1 + B q c q +... + B c 1 + B H 0, A.11 where he vecor c s obaned by replacng ε 0,..., ε 1 q n c by he nal values. From he Assumpon A2 and Corollary 1, we have ρb < 1 and we deduce from he compacness of Θ ha we have sup ρb < 1. Usng he wo erave equaons A.8 and A.11, we oban almos surely ha for any : sup H H q = sup B k c k c k + B H 0 H 0 Kρ, k=1 A.12 where K s a random consan ha depends on he pas values of {ε, 0}. We may wre A.12 as sup h δ/2 δ/2 θ h θ Kρ. A.13 Thus, for 1 = 1,..., m, snce mn mples ha h δ 1 /2 sup h 1,θ h 1,θ 2 sup δ 1 and smlarly sup h 1/2 1, 2K δ 1 1/2 θ h 1, θ 1 sup δ 1 1, θ, h δ 1 /2 1, sup K δ 1 sup max h 1 δ 1 /2 1 ω θ ω = nf ω, he mean-value heorem 1 m 1, θ, h 1 δ 1 /2 1, θ sup 1, θ h δ 1 /2 1, θ sup max max h 1 δ 1 /2 1 ω h 1,θ, h 1,θ h δ 1 /2 ρ Kρ, 1, θ, h 1 δ 1 /2 1, θ sup 1, θ h δ 1 /2 θ sup max h 1/2 1, h δ 1 /2 1, A.14 1/2 θ, h 1, θ ρ Kρ. A.15 From A.14 we can deduce ha, almos surely, we have sup H H Kρ,. A.16 21
Snce R s he nverse of he egenvalue of smaller module of R and have sup H D = mn h 1/δ,, we sup D 2 R sup mnω 1/δ R K, A.17 by usng he fac ha R s a posve-defne marx see assumpon A5, he compacness of Θ and he src posvy of he componens of ω. Smlarly, we have One may wres sup L θ L θ 1 n 1 n sup H K. A.18 n sup ε H =1 n sup ε H =1 S 1 + S 2. ε + log H log H H H ε + 1 n n sup log H log H =1 We can rewre he frs erm S 1 n he rgh hand sde of he above nequaly as S 1 = 1 n = 1 n K 1 n K 1 n n sup ε H H H =1 n sup T rh H H =1 n =1 sup n ρ ε ε =1 H H H H ε ε ε H H ε ε where we have used A.16, A.17 and A.18. Usng he Borel-Canell lemma and Corollary 2, we deduce ha ρ ε ε = ρ ε ε goes o zero almos surely. Consequenly, he Cesàro lemma mples ha n n =1 ρ ε ε 0 when n goes o nfny. For he second erm S 2 we use log1 + x x for x > and he nequaly dea ρa m A m and we oban and, by symmery, we have log H log H = log H H = log I m + H H H m log I m + H H m H H H, log H log H m H H H. Usng A.16, A.17 and A.18, we have log H log H m H H H H + H Kρ. Usng he same argumens as for S 1, we conclude ha S 2 goes o 0. We have shown ha sup L θ L θ n 0 almos surely and hus s proved. 22
A.2.2. Idenfably We suppose ha for some θ θ 0 we have So we have ρ = ρ 0. Remnd ha by 2.5 we have h δ/2 h θ = h θ 0, P θ0 p.s., and Rθ = Rθ 0. θ 0 = B0 1ω + B 0 LA+ 0 Lε+ δ/2 + B0 LA 0 Lε δ/2. We have a smlar expresson wh he parameer θ: Consequenly we have and h δ/2 θ = B 1ω + B LA + Lε + δ/2 + B LA Lε δ/2 0 = B 1ω B 0 1ω 0 + B LA + Lε + δ/2 B 0 LA+ 0 Lε+ δ/2 + B LA Lε δ/2 B 0 LA 0 Lε δ/2 B 1ω B 0 1ω 0 = B LA + L B 0 LA+ 0 L ε + δ/2 + B LA L B 0 LA 0 L ε δ/2 = P + Lε + δ/2 + P Lε δ/2, where We remark ha P ± 0 P ± L = B 0 LA± 0 L B LA ± L = =0 P ± L. A.19 = P± 0 = 0 by he denfably condons. Usng 2.2 and 2.3 we can wre P + Lε + δ/2 + P Lε δ/2 = P + 1 ε+ δ/2 + P 1 ε δ/2 + Z 2 = P 1 + Υ+,δ hδ/2 + P 1 Υ,δ hδ/2 + Z 2 a.s., where Z 2 s measurable wh respec o he σ-feld F 2 generaed by {η 2, η 3,...}. Hence we have P 1 + Υ+,δ hδ/2 + P 1 Υ,δ hδ/2 = B 1ω B 0 1ω 0 Z 2 = Z 2 where Z 2 s anoher F 2 -measurable random marx. Snce P + 1 Υ+,δ from Z 2, h and snce h > 0, P 1 + Υ+,δ he marces-υ ±,δ + P1 Υ,δ s ndependen = C for some consan marx C. Snce + P1 Υ,δ are dagonal see 2.3, he elemen, j of he marx C sasfes C, j = P + 1, j η+ j, δ j + P 1, j η j, δ j. If P 1 +, jp 1, j 0, hen η j, akes a mos wo dfferen values, whch s n conradcon wh A3. If P 1 +, j 0 and P 1, j = 0, hen P 1 +, j η+ j, δ j = C, j whch enals C, j = 0, snce P η j, > 0 0, and hen η j, = 0, a.s., whch s also n conradcon wh A3. We hus have P 1 + = P 1 ± = 0. We argue smlarly for P for 2 and by A.19 we oban ha P + L = P L = 0. Therefore, n vew of A.19, we may apply Proposon 1 because we assumed A4 or A4. Thus we have θ = θ 0. We have hus esablshed. The proof of and v s srcly dencal o he one gven n Francq and Zakoïan 2012. Therefore s omed and he proof of Theorem 2 s complee. 23
A.3. Proof of Theorem 3 Here, we prove he asympoc normaly resul when δ s known. The prove s based on he sandard Taylor expanson. We have nˆθn θ 0 = 1 n n 2 l θj 1 n θ j n =1 =1 l θ 0, θ where he parameer θ j s beween ˆθ n and θ 0. To esablsh he asympoc normaly resul when he power s known, we wll decomposed he proof n sx nermedae pons as n Francq and Zakoïan 2012. a Frs dervave of he quas log-lkelhood. b Exsence of momens a any order of he score. c Asympoc normaly of he score vecor: d Convergence o J: 1 n 1 n n =1 n 2 l θj =1 θ j l θ 0 θ L N 0, I. A.20 n J, j n probably. n A.21 e Inverbly of he marx J. f Forgeng of he nal values. We shall need he followng noaons. s 0 = m + p + 2qm 2 + mm 1/2, s 1 = m + p + 2qm 2, s 2 = m + 2qm 2, s 3 = m + qm 2. These noaons wll help us o pon ou he dfferen enres of our parameer θ. A.3.1. Frs dervave of log-lkelhood The am of hs subsecon s o esablsh he expressons of he frs order dervaves of he quas log-lkelhood. We shall use he followng noaons: D 0 = D θ 0, R 0 = Rθ 0, D 0 = D θ 0, R 0 = R θ 0, D,j 0 = 2 D θ j θ 0, R,j 0 = 2 R θ j θ 0, and ε = D 0 η, where η θ = R 1/2 η θ wh η = η θ 0 = R 1/2 0 η. 24
We recall he expresson: l θ l θ 0 l θ = ε H ε + logdeh = ε D RD ε + logded RD = ε D R D ε + logded derded = ε D R D ε + 2 logded + logder. We dfferenae wh respec o θ for = 1,..., s 1 ha s wh respec o ω, α 1 +,..., α + q, α1,..., α q, β 1,..., β p. We have = T r ε ε D R + R D ε ε D D D + 2T r D D A.22 Im = T r R0 η η D 0 D 0 + I m η η R 0 D 0 D 0. A.23 We dfferenae wh respec o θ for = s 1 + 1,..., s 0 ha s wh respec o ρ. We have l θ = T r R D ε θ ε D R R R + T r R A.24 l θ 0 Im = T r R η η R R. A.25 A.3.2. Exsence of momens of any order of he score For = 1,..., s 1, n vew of A.23 we have l θ 0 T Im = r R0 η η D 2m I m R0 η η }{{} consan 0 D 0 D 0 D 0 For = s 1 + 1,..., s 0, n vew of A.25 we have l θ 0 T Im = r R0 η η R m I m R0 η η }{{} consan + I m η η R 0 D 0 D 0 K D. 0 R 0 R0 R 0 } {{ } consan For, j = 1,..., s 1, n vew of A.23 we have E l θ 0 l θ 0 T Im θ j = E r R0 η η D 0 D 0 Im T r R0 η η j D 0 D 0 D D E K 1 0 D j 0 K 2 0 D 0 K E D 0 D 0 2 E D j 0 D 0 2 1/2. by usng he Cauchy-Schwarz nequaly. 0 D 0 K. + I m η η R 0 D 0 D 0 + I m η η R 0 D 0 Dj 0 25
v In vew of A.23 and A.25, we also have for = 1,..., s 1 and j = s 1 + 1,..., s 0, E l θ 0 l θ 0 T Im θ j = E r R0 η η D 0 D 0 + I m η η R 0 D 0 D 0 Im T r R0 η η R 0 Rj 0 D E K 1 K 2 KE D. 0 D 0 v For, j = s 1 + 1,..., s 0,, n vew of A.25 we have, E l θ 0 l θ 0 T Im θ j = E r R0 η η R T r 0 R 0 Im R0 η η R 0 Rj 0 0 D 0 EK1 K 2 K. To have he fneness of he momens of he frs dervave of he log-lkelhood, remans o rea he cases, and v above. Thus, we have o conrol he erm D 0 D 0. Snce D 0 = Dagh 1/2 θ 0 = Dag h δ/2 θ 0 1/δ, we can work componen by componen. We have for 1 = 1,..., m and = 1,..., s 1 D 0 1, 1 = h δ 1 /2 1, 1/δ1 = 1 δ 1 h 1/2 1, 1 Conrol he erm D 0 D 0 s equvalen o conrol 1/hδ 1 /2 prove ha for any r 0 1 E 1 h δ 1 /2 r 0 1, θ 0 <. h δ 1 /2 1, h δ 1 /2 1, 1, h δ 1 /2 1, h δ 1 /2 1, θ 0. A.26 / n θ 0. So s suffcen o A.27 For hs purpose, we shall use he marx expresson A.9. Three knds of compuaons lsed a, b and c below are necessary accordng o he parameer wh respec o whch we dfferenae. a We frs dfferenae wh respec o ω and we oban H = k=0 B k c k, for = 1,..., m, and snce c k j 1 / = 0,..., 1,..., 0 he vecor composed wh 0 and 1 a he j 1 h poson for j 1 = 1,..., m, we have θ H 1 = k=0 j 1 =1 B k 1, j 1 θ c k j 1 B k 1, j 1 c k j 1 = H 1 k=0 j 1 =1 where H 1 s he 1 componen of H. So we have 1 H 1 1. A.28 H 1 θ 26
b We dfferenae wh respec o α 1 +,..., α + q, α1,..., α q. We have wh c k j 1 = H = q k=0 l=1 j 2 =1 B k c k for = m + 1,..., s 2, A ± l j 1, j 2 ±ε ± θ j 2, l δ j 2, for j1 = 1,..., m where A ± l j 1, j 2 / s a null marx or a marx whose enres are all zero excep he one equal o 1 whch s locaed a he same place of θ. Thus H 1 θ = B k c 1, j 1 θ k j 1 B k 1, j 1 c θ k j 1 = H 1, and we have k=0 j 1 =1 k=0 j 1 =1 1 H 1 1. A.29 H 1 θ c We now dfferenae wh respec o β 1,..., β p and we have H k j B = B B k j c k for = s 2 + 1,..., s 1. k=1 j=1 A.30 The marx B/ s a marx whose enres are all 0, apar from a 1 locaed a he same place as θ n B. Thus θ B/ B and usng A.30, for all = s 2 + 1,..., s 1 we oban H k θ B j BB k j c k = kb k c k. k=1 j=1 Reasonng componen by componen, we have H 1 θ k k=1 k=1 B k 1, j 1 c k j 1. j 1 =1 A.31 We use H 1 ω+ m B k 1, j 1 c k j 1, k, wh ω = nf ω and he relaon x/1+x xs j 1 =1 1 m whch s vald for all x 0 and s 0, 1. In vew of A.31, we oban θ H 1 H 1 j 1 =1 k=1 j 1 =1 k=1 K kb k 1, j 1 c k j 1 ω + B k 1, j 1 c k j 1 B k 1, j 1 c k k j 1 ω j 1 =1 k=1 kρ sk/r 0 c s/r 0 k j 1, s/r0 wh he consan ρ whch belongs o he nerval 0, 1. Snce c k θ 0 has momens of any order see Corollary 2 we have proved ha E θ H 1 0 H 1 θ r <. A.32 27
Snce A.28 as well as A.29 and A.32 s an equvalen wrng of A.27 as well as A.29 and A.32, we deduce ha A.27 s rue. By connuy of he funcons ha are nvolved on our esmaons, he above nequales are unform on a neghborhood V θ 0 of θ 0 Θ: for all 1 = 1,..., m and all = 1,..., s 1 we have E sup 1 h δ 1 /2 r 0 1, θ θ V θ 0 <. A.33 h δ 1 /2 1, A.3.3. Asympoc normaly of he score vecor. The proof s he same han he one n Francq and Zakoïan 2012. I follows he followng argumens: he process { l θ 0 / θ} s saonary, l θ 0 /s measurable wh respec o he σ feld generaed by {η u, u < }, l θ 0 E F = 0 hus we have a marngale-dfference sequence, θ l θ 0 l θ 0 Subsecon A.3.2 mples ha he marx I := E θ θ s well defned. Usng he cenral lm heorem from Bllngsley 1995 we oban A.20. A.3.4. Convergence o J Expresson of he second order dervaves of he log-lkelhood We sar from he expresson A.22 and A.24 n order o compue he second order dervaves of he log-lkelhood. Accordng o he ndex of θ, we have hree cases: For all, j = 1,..., s 1 we deduce from A.22 ha wh 2 l θ 0 θ j = T rc 1 + c 2 + c 3 A.34 c 1 = D0 ε ε D0 D 0 D 0 R D0 Dj 0 + D0 ε ε D0 R D0 D 0 D 0 Dj 0 D0 ε ε D0 R D0 D,j 0 + D ε ε D0 R D0 Dj 0 D 0 D 0, c 2 = D0 R D0 D 0 D 0 ε ε D0 Dj 0 + D0 R D0 ε ε D0 D 0 D 0 Dj 0 D0 R D0 ε ε D0 D,j 0 c 3 = 2D0 D 0 D 0 Dj 0 + 2D0 D,j 0. For all, = 1,..., s 1 and j = s 1 + 1,..., s 0 we have wh + D R D0 ε ε D0 Dj 0 D 0 D 0, 2 l θ 0 θ j = T rc 4 + c 5 A.35 c 4 = R D 0 D 0 D 0 ε ε D 0 R R j and c 5 = R D 0 ε ε D 0 D 0 D 0 R R j. 28
Ths comes from he followng compuaons. Sarng from A.22, we use A.1 and A.6 and we oban T r ε θ ε D0 R D0 D 0 D 0 = T r R D0 D 0 D 0 ε ε D0 R R j j θ j T r R D0 ε ε D0 D 0 D 0 2 θ j T r D 0 D 0 = T r R D0 ε ε D0 D 0 D 0 R R j and = 0. For all, j = s 1 + 1,..., s 0 we have from A.24 wh 2 l θ 0 θ j = T rc 6 A.36 c 6 = R R R D 0 ε ε D 0 R R j + R D 0 ε ε D 0 R R R R j R D 0 ε ε D 0 R R,j R R R R j + R R,j. Remark ha, wh our paramerzaon, R,j = 2 R/ θ j = 0. Thanks o he hree above cases, we remark ha o conrol he second order dervaves, s suffcen o conrol he new erm D0 D,j 0. Indeed, all he oher erms n c 1,..., c 6 can be conrolled hanks o he resuls from Subsecon A.3.3. Exsence of he momens of he second order dervaves of he log-lkelhood We ake dervaves n he expresson A.26 and we oban 2 D 1, 1 = 1 h 1/2 θ j δ 1, θ 1 h δ 1 /2 1, 1 h δ /2 1, 1 1 h δ 1 /2 θ j 1 h δ 1 + 1 2 h δ 1 /2 1, /2 δ 1, 1, h δ θ. 1 /2 θ j 1, I only remans o conrol he las erm n he rgh hand sde of he above deny. We wll prove ha E 1 2 h δ /2 1 r 0 1, θ 0 θ j <. A.37 By A.8, we have for 1 = 1,..., m: and we remark ha h δ 1 /2 1, H 1 = 0 = 2 H 1 ω 2 0 = 2 H 1 α ± α± j k=0 j 1 =1 0 = 2 H 1 β 2. B k 1, j 1 c k j 1 = 2 H 1 ω ω j = 2 H 1 ω α ± j and 29