Variable Selection for Regression Models with Missing Data
|
|
- Θεοφύλακτος Αλεβιζόπουλος
- 5 χρόνια πριν
- Προβολές:
Transcript
1 Statistica Sinica (2010): Supplement Variable Selection for Regression Models with Missing Data Ramon I. Garcia, Joseph G. Ibrahim and Hongtu Zhu Department of Biostatistics, University of North Carolina at Chapel Hill, USA Supplementary Material S1. Assumptions for proofs of Theorems 1-2 Even though the model l(η) = n l i(η) = n log f(d o,i η) may be misspecified, White (1994) has shown that the unpenalized ML estimate converges to the value of η which minimizes E [ n l i(η)] = n li (η)g(d o,i )dd o,i where g( ) is the true density. We denote the true value by ηn = arg sup η E[l(η)]. For simplicity, we further assume that E[ ηl i (η)] = 0 for all i and η = η n, for all n. Similarly, we define η Sn = argsup η : β j 0,j SE[Q(η η )] and let η Sn = η S, for all n. The following assumptions are needed to facilitate development of our methods, although they may not be the weakest possible conditions. (C1) η is unique and an interior point of the parameter space Θ, where Θ is compact. (C2) η 0 η in probability. (C3) For all i, l i (η) is three-times continuously differentiable on Θ and l i (η), j l i (η) 2 and j k l l i (η) are dominated by B i (D o,i ) for all j, k, l = 1,, d where j = / η j. We also require that the same smoothness condition also holds for h(d o,i ; η) = E [log f(z m,i D o,i ; η) D o,i ; η]. (C4) For each ɛ > 0, there exists a finite K such that for all n. 1 sup n 1 n [ ] E B i (D o,i )1 [Bi (D o,i )>K] < ɛ
2 (C5) RAMON I. GARCIA, JOSEPH G. IBRAHIM and HONGTU ZHU 1 lim n n 1 lim n n lim n 1 n lim n 1 n ηl 2 i (η ) = A(η ), η l i (η ) η l i (η ) T = B(η ), D 20 Q(ηS η ) = C(ηS η ), D 10 Q(ηS η )D 10 Q(ηS η ) T = D(ηS η ), where A(η ) and C(η S η ) are positive definite and D ij denotes the i-th and j-th derivatives of the first and second component of the Q function respectively. (C6) Define a n = max j { p λ jn ( β j ) : β j 0 }, and b n = max j { p λ jn ( β j ) : β j 0 }. 1. max j {λ jn : β j 0} = o p(1). 2. a n = O p (n 1/2 ). 3. b n = o p (1). (C7) Define d n = min j {λ jn : β j = 0}. 1. For all j such that β j = 0, lim n λ 1 jn lim inf β 0+ p λ jn (β) > 0 in probability. 2. n 1/2 d n p. Proof of Theorem 1a. Given assumptions (C1) - (C6), then it follows from White (1994) that n 1/2 η l i (η ) D N (0, B(η )) (1.2) and n 1/2 ( η 0 η ) D N ( 0, A(η ) 1 B(η )A(η ) 1). (1.3)
3 VARIABLE SELECTION FOR REGRESSION MODELS WITH MISSING DATA To show η λ is a n-consistent maximizer of η, it is enough to show that p P sup u =C l(η + n 1/2 u) n p λjn ( βj + n 1/2 u j ) p l(η ) + n p λjn ( βj ) < 0 converges to 1 for large C, since this implies there exists a local maximizer in the ball {η +n 1/2 u; u C} and thus η λ η = O p (n 1/2 ). Taking a Taylor s series expansion of the penalized likelihood function, we have p p l(η + n 1/2 u) l(η ) n p λjn ( βj + n 1/2 u j ) + n p λjn ( βj ) p 1 l(η + n 1/2 u) l(η ) n p λjn ( βj + n 1/2 u j ) + n p λjn ( βj ) = n 1/2 u T η l(η ) 1 [ 1 ] p 1 ] 2 ut n 2 ηl(η ) u n [p 1/2 λjn ( βj )sgn(βj )u j 1 2 p 1 [ ] p λ jn ( βj )u 2 j + o p (1) n 1/2 u T η l(η ) 1 2 ut A(η )u + p 1 n 1/2 a n u b n u o p (1) n 1/2 u T η l(η ) 1 2 ut A(η )u + p 1 n 1/2 a n u 1 + o p (1), (1.4) where u = (u T 1, ut 2 )T and u 1 is a p 1 1 vector. The second inequality in (1.4) follows because p λjn (0) = 0 and p λjn 0. The third inequality follows from condition (C5) and the fact that p 1 u i p 1 ( p 1 u2 i )1/2. The last inequality follows from (C6). Since the first and third terms in (1.4) are O p (1) by (1.2) and condition (C6) - 2, and u T A(η )u is bounded below by u 2 the smallest eigenvalue of A(η ), then the second term in (1.4) dominates the rest and all the terms can be made negative for large enough C. Proof of Theorem 1b. Suppose that the conditions of Theorem 1a hold, and there exists an, η λ, which is a n-consistent estimator of η. It suffices to show that for large n, the gradient of the penalized log likelihood function evaluated at η λ, such that p 1
4 RAMON I. GARCIA, JOSEPH G. IBRAHIM and HONGTU ZHU η λ η = O p (n 1/2 ) and ˆβ (2)λ = O p (n 1/2 ) = o p (1), is zero. Taking a Taylor s series expansion of the penalized log likelihood function about η, we have p 0 = n 1/2 η l( η λ ) n η p λjn ( β j ) η= ηλ = n 1/2 η l(η ) n 1/2 ( η λ η ) [ T 1 ] n 2 ηl(η ) + O p (n 1 ) p n 1/2 η p λjn ( β j ) = O p (1) n 1/2 η η= ηλ p p λjn ( β jλ ) (1.5) η= ηλ where the last equality follows from n 1/2 η l(η ) = n 1/2 ( η λ η ) T [ 2 ηl(η )/n ] = O p (1). Therefore, for j = p 1 + 1,... p, the gradient with respect to β j of the second term of (1.5), is sgn( ˆβ j )n 1/2 λ jn [λ 1 jn p λ jn ( ˆβ j )]. Since ˆβ (2)λ = o p (1), λ 1 jn p λ jn ( ˆβ j ) is greater than zero for large n, it follows that (1.5) is dominated by the term sgn( ˆβ j )n 1/2 d n. Since n 1/2 d n p, it must be the case that ˆβjλ = 0 for j = p 1 +1,..., p, otherwise the gradient could be made large in absolute value and could not possibly be equal to zero. Proof of Theorem 1c. Given conditions (C1) - (C7), Theorems 1a and 1b apply. Thus, there exists a ˆβ ( ) T ( λ = ˆβT (1)λ, 0 T, and ˆηλ = ˆβT λ, ˆτ λ T, ˆαT λ, ˆξ ) T λ T which is a n local ( ) T ( ) T maximizer of (6). Let β = β(1) T, 0T, γ = β(1) T, τ T, α T, ξ T, γ = ( ) T ( β(1) T, τ T, α T, ξ T, ˆγλ = ˆβT (1)λ, ˆτ λ T, ˆαT λ, ˆξ ) T λ T, and l(γ) = l((β T (1), 0, τ T, α T, ξ T )). Let Ã(γ) be the resulting matrix from removing the p 1 +1 to p rows and columns
5 VARIABLE SELECTION FOR REGRESSION MODELS WITH MISSING DATA from the matrix A((β T (1), 0, τ T, α T, ξ T )) and similiarly define B. Let, ( ) h 1 β(1) = (p λ1 ( β 1 )sgn( β 1 ),..., p λ p1 ( β p1 )sgn( β p1 )) T, ( ) ) G 1 β(1) = diag (p λ 1 ( β 1 ),..., p λ p1 ( β p1 ), ( ) ( ) h(γ ) = h 1 β(1), G(γ ) = G 1 β(1) 0, and Σ(γ ) = ] 1 [Ã(γ ) + G(γ ) B(γ ) ] 1 [Ã(γ ) + G(γ ). Then, using a Taylor s series expansion, we have p 0 = γ l( γλ ) n γ p λj ( β λj ) γ= γλ = γ l(γ ) nh(γ ) n( γ λ γ ) [ T 1 ] n 2 γ l(γ ) + G(γ ) + o p (1) [ ] = n 1/2 γ l(γ ) n 1/2 h(γ ) n 1/2 ( γ λ γ ) T Ã(γ ) + G(γ ) + o p (1), which indicates } 1 n { γ 1/2 λ γ + [Ã(γ ) + G(γ )] [ h(γ D 1 ) = n 1/2 Ã(γ ) + G(γ )] γ l(γ ), and therefore } 1 n { γ 1/2 λ γ + [Ã(γ ) + G(γ )] h(γ D ) N (0, Σ(γ )). For the SCAD penalty with λ jn = λ n, if λ n = o p (1), n 1/2 p λ n and conditions (C1) - (C5) are satisfied, then the oracle properties of Theorem 1 hold. For the ALASSO penalty, with λ jn = λ n ˆβ j 1 where ˆβ j is the unpenalized ML estimate, λ n = O p (n 1/2 p ), nλ n and conditions (C1) - (C5) imply Theorem 1. Therefore, depending on the penalty function and specification of λ jn, the rates of λ jn which characterize the oracle properties, may be different. Under the assumptions of Theorem 1 for the SCAD and ALASSO penalty functions, h(η ) 0, therefore the asymptotic covariance matrix of ˆγ λ is n 1 Σ(γ ). Using Louis s formula (Louis (1982)), an estimate of Σ(γ ) is, Var(ˆγ λ ) n 1 [Â(ˆγ λ) + G(ˆγ λ )] 1 ˆB(ˆγλ ) [A(ˆγ λ ) + G(ˆγ λ )] 1, (1.6)
6 RAMON I. GARCIA, JOSEPH G. IBRAHIM and HONGTU ZHU where Q i (γ γ ) = γ [ ] log f(d c,i ; γ, β (2) = 0)f(z m,i D o,i ; γ, β (2) = 0)dz m,i, γ=γ ˆB(γ ) = n 1 Q i (γ γ ) Q i (γ γ ) T, Q(γ γ ) = γ Q((β (1), 0, τ, α, ξ) γ, β (2) = 0) γ=γ Q(γ γ ) = γq((β 2 (1), 0, τ, α, ξ) γ, β (2) = 0) γ=γ, and Â(γ ) = n 1 Q(γ γ ) + n 1 Q(γ η ) Q(γ γ ) T where v = vv T. Proof of Theorem 2a. n 1 E[( γ log f(d c ; γ, β (2) = 0)) D o ; γ, β (2) = 0] γ=γ To prove Theorem 2, we first show that for η tn p ηt, t = 1, 2, Q(η 1n η 2n ) Q(η 1 η 2 ) = o p (n) E[Q(η 1n η 2n )] E[Q(η 1 η 2 )] = o p (n) Q(η 1n η 2n ) E[Q(η 1 η 2 )] = o p (n). (1.7) First we note that conditions (C3) and (C4) imply [Q(η 1 η 2 ) E[Q(η 1 η 2 )]/n converges in probability to 0 for all η 1, η 2 Θ. Furthermore, because conditions (C3) and (C4) satisfy the W-LIP assumption of Lemma 2 of Andrews (1992), we obtain the uniform continuity and stochastic continuity of E[Q(η 1 η 2 )] and [Q(η 1 η 2 ) E(Q(η 1 η 2 ))]/n respectively. Because the stochastic continuity and pointwise convergence properties satisfy the assumptions of Theorem 3 of Andrews (1992), we have which implies (1.7). 1 sup (η 1,η 2 ) Θ Θ n Q(η p 1 η 2 ) E[Q(η 1 η 2 )] 0, (1.8) We also need to show that the hypothetical estimator η S = argsup η : βj 0,j SQ(η η ) is a n-consistent estimator of ηs. To prove this, it is enough to show that [ ] P sup Q(ηS + n 1/2 u η ) Q(ηS η ) u =C 1 ɛ
7 VARIABLE SELECTION FOR REGRESSION MODELS WITH MISSING DATA for large C, since this implies there exists a local maximizer in the ball {η + n 1/2 u; u C} and thus η S ηs = O p(n 1/2 ). Taking a Taylor s series expansion of the first component of the Q function, we have Q(ηS + n 1/2 u η ) Q(ηS η ) = n 1/2 u T D 10 Q(ηS η ) 1 [ 1 ] 2 ut n D20 Q(ηS η ) u + o p (1) = n 1/2 u T D 10 Q(ηS η ) 1 2 ut C(ηS η )u + o p (1). (1.9) Conditions (C3) and (C5) ensure that n 1/2 D 10 Q(η S η ) D N(0, D(η S η )) = O p (1) and C(η S η ) is positive definite. Therefore, the second term dominates the rest and (1.9) can be made negative for large enough C. p Let η Sλ = argsup Q(η η 0 ). Since η 0 η p and η Sλ η Sλ, we have η: β j =0,j S λ 1 n dic Q(λ, 0) = 1 n (IC Q(λ) IC Q (0)) = 1 n [2Q ( η 0 η 0 ) 2Q ( η λ η 0 ) + ĉ n ( η λ ) ĉ n ( η 0 )] 2 n [Q ( η 0 η 0 ) Q ( η Sλ η 0 )] + o p (1) = 2 n [Q ( η 0 η 0 ) Q ( η Sλ η )] + o p (1) 2 n [Q ( η 0 η 0 ) Q ( η Sλ η )] + o p (1) = 2 n E [Q (η η )] E [ Q ( η S λ η )] + o p (1) 2 n min S S T {E [Q (η η )] E [Q (η S η )]} + o p (1), where the second and fourth inequalities follow because Q ( η λ η 0 ) Q ( η Sλ η 0 ) and Q ( η Sλ η ) Q ( η Sλ η ) for all λ and the third and fifth equalities follow from (1.7). Therefore, we have which yields Theorem 2a. ( ) P r inf λ Ru p IC Q (λ) > IC Q (0) 1,
8 RAMON I. GARCIA, JOSEPH G. IBRAHIM and HONGTU ZHU Proof of Theorem 2b. Under the assumptions of Theorem 2b, we have n 1/2 δ Q (λ 2, λ 1 ) = n 1/2 (IC Q (λ 2 ) IC Q (λ 1 )) = 2n 1/2 (Q( η λ1 η 0 ) 2Q( η λ2 η 0 )) + n 1/2 ( (ĉ( η λ2 ) ĉ( η λ1 )) ) ( ) = 2n 1/2 Q( η λ1 η 0 ) E[Q(ηS λ1 η 0 )] 2n 1/2 Q( η λ2 η 0 ) E[Q(ηS λ2 η 0 )] ( ) +2n 1/2 E[Q(ηS λ2 η 0 )] E[Q(ηS λ1 η 0 )] + n 1/2 δ c (λ 2, λ 1 ) = O p (1) + n 1/2 p δ c21. Thus IC Q (λ 2 ) > IC Q (λ 1 ) in probability, which yields Theorem 2b. Theorem 2c is similar to that of Theorem 2b. Proof of S2. Statistical model for application of SIAS method to linear regression simulations. To implement SIAS, we assume the response model is y i N(u T i β, σ2 ), the covariate distribution is u i N(µ u, Σ u ) for i = 1,..., n and the missing covariates are MAR. For the prior distribution of all the parameters we assume π(β, γ, σ 2, µ u, Σ u ) = p {π(β j γ j )π(γ j )}π(σ 2 )π(µ u Σ u )π(σ u ) where µ u Σ u N 8 (0, δ 1 Σ u ), Σ 1 u Wishart(r, I 8 ), σ 2 Gamma(ν/2, νω/2), β j (1 γ j )N(0, t 2 j ) + γ jn(0, c 2 j t2 j ) and γ j Bernoulli(1/2). The hyperparameters were selected to reflect a lack of prior information on the parameters, i.e. δ = ν = ω =.001, r = 8. For the values of t j and c j, we use those suggested by George and McCulloch (1993) where (σβ 2 j /t 2 j, c2 j ) = (1, 5), (1, 10), (10, 100), (10, 300) and σβ 2 j was estimated using preliminary simulations. We performed 5,000 simulations after a burn-in period of 5000 iterations. The posterior probability of γ was calculated from the posterior simulations and the model with the highest probability was selected as the best model. The results of (σβ 2 j /t 2 j, c2 j ) = (1, 10) are presented since it gives the best model with the highest posterior probability. S3. Simulation results evaluating performance of standard errors of penalized estimates for linear regression simulations
9 VARIABLE SELECTION FOR REGRESSION MODELS WITH MISSING DATA Table 1.1: Standard errors of penalized estimates of linear regression model with covariates missing at random Method ˆβ1 ˆβ2 ˆβ5 SD SD m SD mad SD SD m SD mad SD SD m SD mad SCAD-RE SCAD-IC Q ALASSO-RE ALASSO-IC Q Oracle In order to test the accuracy of the asymptotic error formula (1.6), we estimated the standard errors of the significant coefficients, β 1, β 3, and β 5 for the linear regression model using n = 60, σ = 1 with the covariates missing at random. The median of the absolute deviations ˆβ jλ βj divided by.6745, denoted by SD, of the 100 penalized estimates can be regarded as the true standard error. The median of the estimated standard errors is denoted as SD m. The median absolute deviation error divided by.6745, denoted SD mad, measures the overall performance of the standard error formula. The results, which are presented in Table 1.1, indicate that the standard error estimate does a good job of estimating the true standard error. All of the SD mad values were less than.05. S4. Statistical model for application of SIAS method to Melanoma data Using the definition of y i, z i and x i in the main document, we assume a logistic regression model on y i x i, β with E(y i x i, β) = exp(γ i )/(1 + exp(γ i )), where γ i = (1, z i, x i ) T β, and β = (β 0, β 1,..., β 6 ) T. We assume the covariates are MAR with the following covariate distribution for i = 1,..., n. f(z i x i ; α) = f(z i3 z i1, z i2, x i ; α 3 )f(z i1, z i2 x i ; α 1, α 2 ) Since x i are completely observed, they are conditioned on throughout. We take a (z i1, z i2 x i ) N 2 (µ i, Σ), where µ i = (µ i1, µ i2 ) and µ is = α s0 + 3 α sjx ij for s = 1, 2, i = 1,..., n and Σ is an unstructured 2 2 covariance matrix. We also assume a logistic regression model for x i3 conditional on (z i1, z i2, x i ) with with E(y i x i, β) = exp(ψ i )/(1 + exp(ψ i )), where
10 RAMON I. GARCIA, JOSEPH G. IBRAHIM and HONGTU ZHU ψ i = (1, z i1, z i2, x i ) T ϕ, and ϕ = (ϕ 0, ϕ 1,..., ϕ 5 ) T. Let ν j = (α 1j, α 2j ) T for j = 0,..., 3. For the prior distribution, we assume π(β, ϕ, ν 0,..., ν 3, Σ) = p {π(β j γ j )π(γ j )} 5 π(ϕ l ) l=0 3 π(ν k Σ)π(Σ), where ϕ l N(0, δ 1 ) for l = 0,..., 5, ν k Σ N 2 (0, δ 1 Σ) for k = 0,..., 3, Σ 1 Wishart(r, I 2 ), β j (1 γ j )N(0, t 2 j )+γ jn(0, c 2 j t2 j ) and γ j Bernoulli(1/2) for j = 1,..., 6. The hyperparameters were selected to reflect lack of prior information on the parameters, i.e. δ =.001, r = 2. We set (σβ 2 j /t 2 j, c2 j ) = (1, 10). The posterior probability of γ was calculated from 5000 simulated observations after 5,000 burn-in iterations and the model with the highest probability was selected as the best model. References Andrews, D. W. K. (1992). Generic uniform convergence. Econometric Theory 8, George, E. I. and McCulloch, R. E. (1993). Variable selection via gibbs sampling. Journal of the American Statistical Association 88, Louis, T. A. (1983). Finding the observed information matrix when using the EM algorithm. Journal of Royal Statistical Society, Series B 44, White, H. (1994). Estimation, Inference, and Specification Analysis. Cambridge University Press, New York. k=0
ST5224: Advanced Statistical Theory II
ST5224: Advanced Statistical Theory II 2014/2015: Semester II Tutorial 7 1. Let X be a sample from a population P and consider testing hypotheses H 0 : P = P 0 versus H 1 : P = P 1, where P j is a known
Διαβάστε περισσότεραStatistical Inference I Locally most powerful tests
Statistical Inference I Locally most powerful tests Shirsendu Mukherjee Department of Statistics, Asutosh College, Kolkata, India. shirsendu st@yahoo.co.in So far we have treated the testing of one-sided
Διαβάστε περισσότεραOther Test Constructions: Likelihood Ratio & Bayes Tests
Other Test Constructions: Likelihood Ratio & Bayes Tests Side-Note: So far we have seen a few approaches for creating tests such as Neyman-Pearson Lemma ( most powerful tests of H 0 : θ = θ 0 vs H 1 :
Διαβάστε περισσότεραBayesian statistics. DS GA 1002 Probability and Statistics for Data Science.
Bayesian statistics DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Frequentist vs Bayesian statistics In frequentist
Διαβάστε περισσότεραUniform Convergence of Fourier Series Michael Taylor
Uniform Convergence of Fourier Series Michael Taylor Given f L 1 T 1 ), we consider the partial sums of the Fourier series of f: N 1) S N fθ) = ˆfk)e ikθ. k= N A calculation gives the Dirichlet formula
Διαβάστε περισσότεραExample Sheet 3 Solutions
Example Sheet 3 Solutions. i Regular Sturm-Liouville. ii Singular Sturm-Liouville mixed boundary conditions. iii Not Sturm-Liouville ODE is not in Sturm-Liouville form. iv Regular Sturm-Liouville note
Διαβάστε περισσότερα2 Composition. Invertible Mappings
Arkansas Tech University MATH 4033: Elementary Modern Algebra Dr. Marcel B. Finan Composition. Invertible Mappings In this section we discuss two procedures for creating new mappings from old ones, namely,
Διαβάστε περισσότεραEvery set of first-order formulas is equivalent to an independent set
Every set of first-order formulas is equivalent to an independent set May 6, 2008 Abstract A set of first-order formulas, whatever the cardinality of the set of symbols, is equivalent to an independent
Διαβάστε περισσότεραSolution Series 9. i=1 x i and i=1 x i.
Lecturer: Prof. Dr. Mete SONER Coordinator: Yilin WANG Solution Series 9 Q1. Let α, β >, the p.d.f. of a beta distribution with parameters α and β is { Γ(α+β) Γ(α)Γ(β) f(x α, β) xα 1 (1 x) β 1 for < x
Διαβάστε περισσότεραOrdinal Arithmetic: Addition, Multiplication, Exponentiation and Limit
Ordinal Arithmetic: Addition, Multiplication, Exponentiation and Limit Ting Zhang Stanford May 11, 2001 Stanford, 5/11/2001 1 Outline Ordinal Classification Ordinal Addition Ordinal Multiplication Ordinal
Διαβάστε περισσότερα6.3 Forecasting ARMA processes
122 CHAPTER 6. ARMA MODELS 6.3 Forecasting ARMA processes The purpose of forecasting is to predict future values of a TS based on the data collected to the present. In this section we will discuss a linear
Διαβάστε περισσότεραCHAPTER 25 SOLVING EQUATIONS BY ITERATIVE METHODS
CHAPTER 5 SOLVING EQUATIONS BY ITERATIVE METHODS EXERCISE 104 Page 8 1. Find the positive root of the equation x + 3x 5 = 0, correct to 3 significant figures, using the method of bisection. Let f(x) =
Διαβάστε περισσότεραLecture 21: Properties and robustness of LSE
Lecture 21: Properties and robustness of LSE BLUE: Robustness of LSE against normality We now study properties of l τ β and σ 2 under assumption A2, i.e., without the normality assumption on ε. From Theorem
Διαβάστε περισσότεραC.S. 430 Assignment 6, Sample Solutions
C.S. 430 Assignment 6, Sample Solutions Paul Liu November 15, 2007 Note that these are sample solutions only; in many cases there were many acceptable answers. 1 Reynolds Problem 10.1 1.1 Normal-order
Διαβάστε περισσότεραEE512: Error Control Coding
EE512: Error Control Coding Solution for Assignment on Finite Fields February 16, 2007 1. (a) Addition and Multiplication tables for GF (5) and GF (7) are shown in Tables 1 and 2. + 0 1 2 3 4 0 0 1 2 3
Διαβάστε περισσότεραProblem Set 3: Solutions
CMPSCI 69GG Applied Information Theory Fall 006 Problem Set 3: Solutions. [Cover and Thomas 7.] a Define the following notation, C I p xx; Y max X; Y C I p xx; Ỹ max I X; Ỹ We would like to show that C
Διαβάστε περισσότεραECE598: Information-theoretic methods in high-dimensional statistics Spring 2016
ECE598: Information-theoretic methods in high-dimensional statistics Spring 06 Lecture 7: Information bound Lecturer: Yihong Wu Scribe: Shiyu Liang, Feb 6, 06 [Ed. Mar 9] Recall the Chi-squared divergence
Διαβάστε περισσότεραSCITECH Volume 13, Issue 2 RESEARCH ORGANISATION Published online: March 29, 2018
Journal of rogressive Research in Mathematics(JRM) ISSN: 2395-028 SCITECH Volume 3, Issue 2 RESEARCH ORGANISATION ublished online: March 29, 208 Journal of rogressive Research in Mathematics www.scitecresearch.com/journals
Διαβάστε περισσότεραSolutions to Exercise Sheet 5
Solutions to Eercise Sheet 5 jacques@ucsd.edu. Let X and Y be random variables with joint pdf f(, y) = 3y( + y) where and y. Determine each of the following probabilities. Solutions. a. P (X ). b. P (X
Διαβάστε περισσότεραLecture 34 Bootstrap confidence intervals
Lecture 34 Bootstrap confidence intervals Confidence Intervals θ: an unknown parameter of interest We want to find limits θ and θ such that Gt = P nˆθ θ t If G 1 1 α is known, then P θ θ = P θ θ = 1 α
Διαβάστε περισσότεραHomework 3 Solutions
Homework 3 Solutions Igor Yanovsky (Math 151A TA) Problem 1: Compute the absolute error and relative error in approximations of p by p. (Use calculator!) a) p π, p 22/7; b) p π, p 3.141. Solution: For
Διαβάστε περισσότεραSOLUTIONS TO MATH38181 EXTREME VALUES AND FINANCIAL RISK EXAM
SOLUTIONS TO MATH38181 EXTREME VALUES AND FINANCIAL RISK EXAM Solutions to Question 1 a) The cumulative distribution function of T conditional on N n is Pr (T t N n) Pr (max (X 1,..., X N ) t N n) Pr (max
Διαβάστε περισσότεραConcrete Mathematics Exercises from 30 September 2016
Concrete Mathematics Exercises from 30 September 2016 Silvio Capobianco Exercise 1.7 Let H(n) = J(n + 1) J(n). Equation (1.8) tells us that H(2n) = 2, and H(2n+1) = J(2n+2) J(2n+1) = (2J(n+1) 1) (2J(n)+1)
Διαβάστε περισσότεραHW 3 Solutions 1. a) I use the auto.arima R function to search over models using AIC and decide on an ARMA(3,1)
HW 3 Solutions a) I use the autoarima R function to search over models using AIC and decide on an ARMA3,) b) I compare the ARMA3,) to ARMA,0) ARMA3,) does better in all three criteria c) The plot of the
Διαβάστε περισσότερα4.6 Autoregressive Moving Average Model ARMA(1,1)
84 CHAPTER 4. STATIONARY TS MODELS 4.6 Autoregressive Moving Average Model ARMA(,) This section is an introduction to a wide class of models ARMA(p,q) which we will consider in more detail later in this
Διαβάστε περισσότερα6.1. Dirac Equation. Hamiltonian. Dirac Eq.
6.1. Dirac Equation Ref: M.Kaku, Quantum Field Theory, Oxford Univ Press (1993) η μν = η μν = diag(1, -1, -1, -1) p 0 = p 0 p = p i = -p i p μ p μ = p 0 p 0 + p i p i = E c 2 - p 2 = (m c) 2 H = c p 2
Διαβάστε περισσότερα2. Let H 1 and H 2 be Hilbert spaces and let T : H 1 H 2 be a bounded linear operator. Prove that [T (H 1 )] = N (T ). (6p)
Uppsala Universitet Matematiska Institutionen Andreas Strömbergsson Prov i matematik Funktionalanalys Kurs: F3B, F4Sy, NVP 2005-03-08 Skrivtid: 9 14 Tillåtna hjälpmedel: Manuella skrivdon, Kreyszigs bok
Διαβάστε περισσότεραNumerical Analysis FMN011
Numerical Analysis FMN011 Carmen Arévalo Lund University carmen@maths.lth.se Lecture 12 Periodic data A function g has period P if g(x + P ) = g(x) Model: Trigonometric polynomial of order M T M (x) =
Διαβάστε περισσότερα= λ 1 1 e. = λ 1 =12. has the properties e 1. e 3,V(Y
Stat 50 Homework Solutions Spring 005. (a λ λ λ 44 (b trace( λ + λ + λ 0 (c V (e x e e λ e e λ e (λ e by definition, the eigenvector e has the properties e λ e and e e. (d λ e e + λ e e + λ e e 8 6 4 4
Διαβάστε περισσότερα6. MAXIMUM LIKELIHOOD ESTIMATION
6 MAXIMUM LIKELIHOOD ESIMAION [1] Maximum Likelihood Estimator (1) Cases in which θ (unknown parameter) is scalar Notational Clarification: From now on, we denote the true value of θ as θ o hen, view θ
Διαβάστε περισσότεραFigure A.2: MPC and MPCP Age Profiles (estimating ρ, ρ = 2, φ = 0.03)..
Supplemental Material (not for publication) Persistent vs. Permanent Income Shocks in the Buffer-Stock Model Jeppe Druedahl Thomas H. Jørgensen May, A Additional Figures and Tables Figure A.: Wealth and
Διαβάστε περισσότεραΜηχανική Μάθηση Hypothesis Testing
ΕΛΛΗΝΙΚΗ ΔΗΜΟΚΡΑΤΙΑ ΠΑΝΕΠΙΣΤΗΜΙΟ ΚΡΗΤΗΣ Μηχανική Μάθηση Hypothesis Testing Γιώργος Μπορμπουδάκης Τμήμα Επιστήμης Υπολογιστών Procedure 1. Form the null (H 0 ) and alternative (H 1 ) hypothesis 2. Consider
Διαβάστε περισσότεραA Two-Sided Laplace Inversion Algorithm with Computable Error Bounds and Its Applications in Financial Engineering
Electronic Companion A Two-Sie Laplace Inversion Algorithm with Computable Error Bouns an Its Applications in Financial Engineering Ning Cai, S. G. Kou, Zongjian Liu HKUST an Columbia University Appenix
Διαβάστε περισσότεραSOLUTIONS TO MATH38181 EXTREME VALUES AND FINANCIAL RISK EXAM
SOLUTIONS TO MATH38181 EXTREME VALUES AND FINANCIAL RISK EXAM Solutions to Question 1 a) The cumulative distribution function of T conditional on N n is Pr T t N n) Pr max X 1,..., X N ) t N n) Pr max
Διαβάστε περισσότερα12. Radon-Nikodym Theorem
Tutorial 12: Radon-Nikodym Theorem 1 12. Radon-Nikodym Theorem In the following, (Ω, F) is an arbitrary measurable space. Definition 96 Let μ and ν be two (possibly complex) measures on (Ω, F). We say
Διαβάστε περισσότεραIntroduction to the ML Estimation of ARMA processes
Introduction to the ML Estimation of ARMA processes Eduardo Rossi University of Pavia October 2013 Rossi ARMA Estimation Financial Econometrics - 2013 1 / 1 We consider the AR(p) model: Y t = c + φ 1 Y
Διαβάστε περισσότεραEcon 2110: Fall 2008 Suggested Solutions to Problem Set 8 questions or comments to Dan Fetter 1
Eon : Fall 8 Suggested Solutions to Problem Set 8 Email questions or omments to Dan Fetter Problem. Let X be a salar with density f(x, θ) (θx + θ) [ x ] with θ. (a) Find the most powerful level α test
Διαβάστε περισσότεραTridiagonal matrices. Gérard MEURANT. October, 2008
Tridiagonal matrices Gérard MEURANT October, 2008 1 Similarity 2 Cholesy factorizations 3 Eigenvalues 4 Inverse Similarity Let α 1 ω 1 β 1 α 2 ω 2 T =......... β 2 α 1 ω 1 β 1 α and β i ω i, i = 1,...,
Διαβάστε περισσότεραEstimation for ARMA Processes with Stable Noise. Matt Calder & Richard A. Davis Colorado State University
Estimation for ARMA Processes with Stable Noise Matt Calder & Richard A. Davis Colorado State University rdavis@stat.colostate.edu 1 ARMA processes with stable noise Review of M-estimation Examples of
Διαβάστε περισσότεραReminders: linear functions
Reminders: linear functions Let U and V be vector spaces over the same field F. Definition A function f : U V is linear if for every u 1, u 2 U, f (u 1 + u 2 ) = f (u 1 ) + f (u 2 ), and for every u U
Διαβάστε περισσότεραSection 8.3 Trigonometric Equations
99 Section 8. Trigonometric Equations Objective 1: Solve Equations Involving One Trigonometric Function. In this section and the next, we will exple how to solving equations involving trigonometric functions.
Διαβάστε περισσότεραΑπόκριση σε Μοναδιαία Ωστική Δύναμη (Unit Impulse) Απόκριση σε Δυνάμεις Αυθαίρετα Μεταβαλλόμενες με το Χρόνο. Απόστολος Σ.
Απόκριση σε Δυνάμεις Αυθαίρετα Μεταβαλλόμενες με το Χρόνο The time integral of a force is referred to as impulse, is determined by and is obtained from: Newton s 2 nd Law of motion states that the action
Διαβάστε περισσότεραWeb-based supplementary materials for Bayesian Quantile Regression for Ordinal Longitudinal Data
Web-based supplementary materials for Bayesian Quantile Regression for Ordinal Longitudinal Data Rahim Alhamzawi, Haithem Taha Mohammad Ali Department of Statistics, College of Administration and Economics,
Διαβάστε περισσότεραSupplementary Material For Testing Homogeneity of. High-dimensional Covariance Matrices
Supplementary Material For Testing Homogeneity of High-dimensional Covariance Matrices Shurong Zheng, Ruitao Lin, Jianhua Guo, and Guosheng Yin 3 School of Mathematics & Statistics and KLAS, Northeast
Διαβάστε περισσότεραSOME PROPERTIES OF FUZZY REAL NUMBERS
Sahand Communications in Mathematical Analysis (SCMA) Vol. 3 No. 1 (2016), 21-27 http://scma.maragheh.ac.ir SOME PROPERTIES OF FUZZY REAL NUMBERS BAYAZ DARABY 1 AND JAVAD JAFARI 2 Abstract. In the mathematical
Διαβάστε περισσότεραThe challenges of non-stable predicates
The challenges of non-stable predicates Consider a non-stable predicate Φ encoding, say, a safety property. We want to determine whether Φ holds for our program. The challenges of non-stable predicates
Διαβάστε περισσότεραFourier Series. MATH 211, Calculus II. J. Robert Buchanan. Spring Department of Mathematics
Fourier Series MATH 211, Calculus II J. Robert Buchanan Department of Mathematics Spring 2018 Introduction Not all functions can be represented by Taylor series. f (k) (c) A Taylor series f (x) = (x c)
Διαβάστε περισσότερα: Monte Carlo EM 313, Louis (1982) EM, EM Newton-Raphson, /. EM, 2 Monte Carlo EM Newton-Raphson, Monte Carlo EM, Monte Carlo EM, /. 3, Monte Carlo EM
2008 6 Chinese Journal of Applied Probability and Statistics Vol.24 No.3 Jun. 2008 Monte Carlo EM 1,2 ( 1,, 200241; 2,, 310018) EM, E,,. Monte Carlo EM, EM E Monte Carlo,. EM, Monte Carlo EM,,,,. Newton-Raphson.
Διαβάστε περισσότεραCongruence Classes of Invertible Matrices of Order 3 over F 2
International Journal of Algebra, Vol. 8, 24, no. 5, 239-246 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.2988/ija.24.422 Congruence Classes of Invertible Matrices of Order 3 over F 2 Ligong An and
Διαβάστε περισσότεραLecture 2. Soundness and completeness of propositional logic
Lecture 2 Soundness and completeness of propositional logic February 9, 2004 1 Overview Review of natural deduction. Soundness and completeness. Semantics of propositional formulas. Soundness proof. Completeness
Διαβάστε περισσότεραFractional Colorings and Zykov Products of graphs
Fractional Colorings and Zykov Products of graphs Who? Nichole Schimanski When? July 27, 2011 Graphs A graph, G, consists of a vertex set, V (G), and an edge set, E(G). V (G) is any finite set E(G) is
Διαβάστε περισσότεραStatistics 104: Quantitative Methods for Economics Formula and Theorem Review
Harvard College Statistics 104: Quantitative Methods for Economics Formula and Theorem Review Tommy MacWilliam, 13 tmacwilliam@college.harvard.edu March 10, 2011 Contents 1 Introduction to Data 5 1.1 Sample
Διαβάστε περισσότεραApproximation of distance between locations on earth given by latitude and longitude
Approximation of distance between locations on earth given by latitude and longitude Jan Behrens 2012-12-31 In this paper we shall provide a method to approximate distances between two points on earth
Διαβάστε περισσότεραMath 446 Homework 3 Solutions. (1). (i): Reverse triangle inequality for metrics: Let (X, d) be a metric space and let x, y, z X.
Math 446 Homework 3 Solutions. (1). (i): Reverse triangle inequalit for metrics: Let (X, d) be a metric space and let x,, z X. Prove that d(x, z) d(, z) d(x, ). (ii): Reverse triangle inequalit for norms:
Διαβάστε περισσότερα5. Choice under Uncertainty
5. Choice under Uncertainty Daisuke Oyama Microeconomics I May 23, 2018 Formulations von Neumann-Morgenstern (1944/1947) X: Set of prizes Π: Set of probability distributions on X : Preference relation
Διαβάστε περισσότεραOptimal Parameter in Hermitian and Skew-Hermitian Splitting Method for Certain Two-by-Two Block Matrices
Optimal Parameter in Hermitian and Skew-Hermitian Splitting Method for Certain Two-by-Two Block Matrices Chi-Kwong Li Department of Mathematics The College of William and Mary Williamsburg, Virginia 23187-8795
Διαβάστε περισσότεραORDINAL ARITHMETIC JULIAN J. SCHLÖDER
ORDINAL ARITHMETIC JULIAN J. SCHLÖDER Abstract. We define ordinal arithmetic and show laws of Left- Monotonicity, Associativity, Distributivity, some minor related properties and the Cantor Normal Form.
Διαβάστε περισσότεραMatrices and Determinants
Matrices and Determinants SUBJECTIVE PROBLEMS: Q 1. For what value of k do the following system of equations possess a non-trivial (i.e., not all zero) solution over the set of rationals Q? x + ky + 3z
Διαβάστε περισσότεραOnline Appendix I. 1 1+r ]}, Bψ = {ψ : Y E A S S}, B W = +(1 s)[1 m (1,0) (b, e, a, ψ (0,a ) (e, a, s); q, ψ, W )]}, (29) exp( U(d,a ) (i, x; q)
Online Appendix I Appendix D Additional Existence Proofs Denote B q = {q : A E A S [0, +r ]}, Bψ = {ψ : Y E A S S}, B W = {W : I E A S R}. I slightly abuse the notation by defining B q (L q ) the subset
Διαβάστε περισσότεραAsymptotic distribution of MLE
Asymptotic distribution of MLE Theorem Let {X t } be a causal and invertible ARMA(p,q) process satisfying Φ(B)X = Θ(B)Z, {Z t } IID(0, σ 2 ). Let ( ˆφ, ˆϑ) the values that minimize LL n (φ, ϑ) among those
Διαβάστε περισσότεραderivation of the Laplacian from rectangular to spherical coordinates
derivation of the Laplacian from rectangular to spherical coordinates swapnizzle 03-03- :5:43 We begin by recognizing the familiar conversion from rectangular to spherical coordinates (note that φ is used
Διαβάστε περισσότεραQueensland University of Technology Transport Data Analysis and Modeling Methodologies
Queensland University of Technology Transport Data Analysis and Modeling Methodologies Lab Session #7 Example 5.2 (with 3SLS Extensions) Seemingly Unrelated Regression Estimation and 3SLS A survey of 206
Διαβάστε περισσότεραSecond Order RLC Filters
ECEN 60 Circuits/Electronics Spring 007-0-07 P. Mathys Second Order RLC Filters RLC Lowpass Filter A passive RLC lowpass filter (LPF) circuit is shown in the following schematic. R L C v O (t) Using phasor
Διαβάστε περισσότερα3.4 SUM AND DIFFERENCE FORMULAS. NOTE: cos(α+β) cos α + cos β cos(α-β) cos α -cos β
3.4 SUM AND DIFFERENCE FORMULAS Page Theorem cos(αβ cos α cos β -sin α cos(α-β cos α cos β sin α NOTE: cos(αβ cos α cos β cos(α-β cos α -cos β Proof of cos(α-β cos α cos β sin α Let s use a unit circle
Διαβάστε περισσότεραA Note on Intuitionistic Fuzzy. Equivalence Relation
International Mathematical Forum, 5, 2010, no. 67, 3301-3307 A Note on Intuitionistic Fuzzy Equivalence Relation D. K. Basnet Dept. of Mathematics, Assam University Silchar-788011, Assam, India dkbasnet@rediffmail.com
Διαβάστε περισσότεραLecture 12: Pseudo likelihood approach
Lecture 12: Pseudo likelihood approach Pseudo MLE Let X 1,...,X n be a random sample from a pdf in a family indexed by two parameters θ and π with likelihood l(θ,π). The method of pseudo MLE may be viewed
Διαβάστε περισσότεραLecture 15 - Root System Axiomatics
Lecture 15 - Root System Axiomatics Nov 1, 01 In this lecture we examine root systems from an axiomatic point of view. 1 Reflections If v R n, then it determines a hyperplane, denoted P v, through the
Διαβάστε περισσότεραNowhere-zero flows Let be a digraph, Abelian group. A Γ-circulation in is a mapping : such that, where, and : tail in X, head in
Nowhere-zero flows Let be a digraph, Abelian group. A Γ-circulation in is a mapping : such that, where, and : tail in X, head in : tail in X, head in A nowhere-zero Γ-flow is a Γ-circulation such that
Διαβάστε περισσότεραPhys460.nb Solution for the t-dependent Schrodinger s equation How did we find the solution? (not required)
Phys460.nb 81 ψ n (t) is still the (same) eigenstate of H But for tdependent H. The answer is NO. 5.5.5. Solution for the tdependent Schrodinger s equation If we assume that at time t 0, the electron starts
Διαβάστε περισσότεραChapter 6: Systems of Linear Differential. be continuous functions on the interval
Chapter 6: Systems of Linear Differential Equations Let a (t), a 2 (t),..., a nn (t), b (t), b 2 (t),..., b n (t) be continuous functions on the interval I. The system of n first-order differential equations
Διαβάστε περισσότεραExercises to Statistics of Material Fatigue No. 5
Prof. Dr. Christine Müller Dipl.-Math. Christoph Kustosz Eercises to Statistics of Material Fatigue No. 5 E. 9 (5 a Show, that a Fisher information matri for a two dimensional parameter θ (θ,θ 2 R 2, can
Διαβάστε περισσότεραω ω ω ω ω ω+2 ω ω+2 + ω ω ω ω+2 + ω ω+1 ω ω+2 2 ω ω ω ω ω ω ω ω+1 ω ω2 ω ω2 + ω ω ω2 + ω ω ω ω2 + ω ω+1 ω ω2 + ω ω+1 + ω ω ω ω2 + ω
0 1 2 3 4 5 6 ω ω + 1 ω + 2 ω + 3 ω + 4 ω2 ω2 + 1 ω2 + 2 ω2 + 3 ω3 ω3 + 1 ω3 + 2 ω4 ω4 + 1 ω5 ω 2 ω 2 + 1 ω 2 + 2 ω 2 + ω ω 2 + ω + 1 ω 2 + ω2 ω 2 2 ω 2 2 + 1 ω 2 2 + ω ω 2 3 ω 3 ω 3 + 1 ω 3 + ω ω 3 +
Διαβάστε περισσότεραANSWERSHEET (TOPIC = DIFFERENTIAL CALCULUS) COLLECTION #2. h 0 h h 0 h h 0 ( ) g k = g 0 + g 1 + g g 2009 =?
Teko Classes IITJEE/AIEEE Maths by SUHAAG SIR, Bhopal, Ph (0755) 3 00 000 www.tekoclasses.com ANSWERSHEET (TOPIC DIFFERENTIAL CALCULUS) COLLECTION # Question Type A.Single Correct Type Q. (A) Sol least
Διαβάστε περισσότεραLocal Approximation with Kernels
Local Approximation with Kernels Thomas Hangelbroek University of Hawaii at Manoa 5th International Conference Approximation Theory, 26 work supported by: NSF DMS-43726 A cubic spline example Consider
Διαβάστε περισσότεραHOMEWORK 4 = G. In order to plot the stress versus the stretch we define a normalized stretch:
HOMEWORK 4 Problem a For the fast loading case, we want to derive the relationship between P zz and λ z. We know that the nominal stress is expressed as: P zz = ψ λ z where λ z = λ λ z. Therefore, applying
Διαβάστε περισσότεραw o = R 1 p. (1) R = p =. = 1
Πανεπιστήµιο Κρήτης - Τµήµα Επιστήµης Υπολογιστών ΗΥ-570: Στατιστική Επεξεργασία Σήµατος 205 ιδάσκων : Α. Μουχτάρης Τριτη Σειρά Ασκήσεων Λύσεις Ασκηση 3. 5.2 (a) From the Wiener-Hopf equation we have:
Διαβάστε περισσότεραLecture 2: Dirac notation and a review of linear algebra Read Sakurai chapter 1, Baym chatper 3
Lecture 2: Dirac notation and a review of linear algebra Read Sakurai chapter 1, Baym chatper 3 1 State vector space and the dual space Space of wavefunctions The space of wavefunctions is the set of all
Διαβάστε περισσότεραFinite Field Problems: Solutions
Finite Field Problems: Solutions 1. Let f = x 2 +1 Z 11 [x] and let F = Z 11 [x]/(f), a field. Let Solution: F =11 2 = 121, so F = 121 1 = 120. The possible orders are the divisors of 120. Solution: The
Διαβάστε περισσότεραSupplementary Materials: Proofs
Supplementary Materials: Proofs The following lemmas prepare for the proof of concentration properties on prior density π α (β j /σ for j = 1,..., p n on m n -dimensional vector β j /σ. As introduced earlier,
Διαβάστε περισσότεραTutorial on Multinomial Logistic Regression
Tutorial on Multinomial Logistic Regression Javier R Movellan June 19, 2013 1 1 General Model The inputs are n-dimensional vectors the outputs are c-dimensional vectors The training sample consist of m
Διαβάστε περισσότεραEmpirical best prediction under area-level Poisson mixed models
Noname manuscript No. (will be inserted by the editor Empirical best prediction under area-level Poisson mixed models Miguel Boubeta María José Lombardía Domingo Morales eceived: date / Accepted: date
Διαβάστε περισσότεραInverse trigonometric functions & General Solution of Trigonometric Equations. ------------------ ----------------------------- -----------------
Inverse trigonometric functions & General Solution of Trigonometric Equations. 1. Sin ( ) = a) b) c) d) Ans b. Solution : Method 1. Ans a: 17 > 1 a) is rejected. w.k.t Sin ( sin ) = d is rejected. If sin
Διαβάστε περισσότεραArithmetical applications of lagrangian interpolation. Tanguy Rivoal. Institut Fourier CNRS and Université de Grenoble 1
Arithmetical applications of lagrangian interpolation Tanguy Rivoal Institut Fourier CNRS and Université de Grenoble Conference Diophantine and Analytic Problems in Number Theory, The 00th anniversary
Διαβάστε περισσότεραA Bonus-Malus System as a Markov Set-Chain. Małgorzata Niemiec Warsaw School of Economics Institute of Econometrics
A Bonus-Malus System as a Markov Set-Chain Małgorzata Niemiec Warsaw School of Economics Institute of Econometrics Contents 1. Markov set-chain 2. Model of bonus-malus system 3. Example 4. Conclusions
Διαβάστε περισσότεραSrednicki Chapter 55
Srednicki Chapter 55 QFT Problems & Solutions A. George August 3, 03 Srednicki 55.. Use equations 55.3-55.0 and A i, A j ] = Π i, Π j ] = 0 (at equal times) to verify equations 55.-55.3. This is our third
Διαβάστε περισσότερα5.4 The Poisson Distribution.
The worst thing you can do about a situation is nothing. Sr. O Shea Jackson 5.4 The Poisson Distribution. Description of the Poisson Distribution Discrete probability distribution. The random variable
Διαβάστε περισσότεραAn Introduction to Signal Detection and Estimation - Second Edition Chapter II: Selected Solutions
An Introduction to Signal Detection Estimation - Second Edition Chapter II: Selected Solutions H V Poor Princeton University March 16, 5 Exercise : The likelihood ratio is given by L(y) (y +1), y 1 a With
Διαβάστε περισσότεραMath221: HW# 1 solutions
Math: HW# solutions Andy Royston October, 5 7.5.7, 3 rd Ed. We have a n = b n = a = fxdx = xdx =, x cos nxdx = x sin nx n sin nxdx n = cos nx n = n n, x sin nxdx = x cos nx n + cos nxdx n cos n = + sin
Διαβάστε περισσότεραAppendix S1 1. ( z) α βc. dβ β δ β
Appendix S1 1 Proof of Lemma 1. Taking first and second partial derivatives of the expected profit function, as expressed in Eq. (7), with respect to l: Π Π ( z, λ, l) l θ + s ( s + h ) g ( t) dt λ Ω(
Διαβάστε περισσότεραPractice Exam 2. Conceptual Questions. 1. State a Basic identity and then verify it. (a) Identity: Solution: One identity is csc(θ) = 1
Conceptual Questions. State a Basic identity and then verify it. a) Identity: Solution: One identity is cscθ) = sinθ) Practice Exam b) Verification: Solution: Given the point of intersection x, y) of the
Διαβάστε περισσότερα1 1 1 2 1 2 2 1 43 123 5 122 3 1 312 1 1 122 1 1 1 1 6 1 7 1 6 1 7 1 3 4 2 312 43 4 3 3 1 1 4 1 1 52 122 54 124 8 1 3 1 1 1 1 1 152 1 1 1 1 1 1 152 1 5 1 152 152 1 1 3 9 1 159 9 13 4 5 1 122 1 4 122 5
Διαβάστε περισσότεραHOMEWORK#1. t E(x) = 1 λ = (b) Find the median lifetime of a randomly selected light bulb. Answer:
HOMEWORK# 52258 李亞晟 Eercise 2. The lifetime of light bulbs follows an eponential distribution with a hazard rate of. failures per hour of use (a) Find the mean lifetime of a randomly selected light bulb.
Διαβάστε περισσότεραSecond Order Partial Differential Equations
Chapter 7 Second Order Partial Differential Equations 7.1 Introduction A second order linear PDE in two independent variables (x, y Ω can be written as A(x, y u x + B(x, y u xy + C(x, y u u u + D(x, y
Διαβάστε περισσότεραCHAPTER 101 FOURIER SERIES FOR PERIODIC FUNCTIONS OF PERIOD
CHAPTER FOURIER SERIES FOR PERIODIC FUNCTIONS OF PERIOD EXERCISE 36 Page 66. Determine the Fourier series for the periodic function: f(x), when x +, when x which is periodic outside this rge of period.
Διαβάστε περισσότεραposterior distribution is well defined for any prior π and ν-almost all x X. Moreover,
A Proof of Theorem 2 (i) If the likelihood ratio p(x θ i )/p(x θ ) is an absolutely continuous random variable for any i, then p(x θ ), = 1,..., m, have the same support and the posterior distribution
Διαβάστε περισσότεραHomework for 1/27 Due 2/5
Name: ID: Homework for /7 Due /5. [ 8-3] I Example D of Sectio 8.4, the pdf of the populatio distributio is + αx x f(x α) =, α, otherwise ad the method of momets estimate was foud to be ˆα = 3X (where
Διαβάστε περισσότεραLaplace Expansion. Peter McCullagh. WHOA-PSI, St Louis August, Department of Statistics University of Chicago
Laplace Expansion Peter McCullagh Department of Statistics University of Chicago WHOA-PSI, St Louis August, 2017 Outline Laplace approximation in 1D Laplace expansion in 1D Laplace expansion in R p Formal
Διαβάστε περισσότεραSCHOOL OF MATHEMATICAL SCIENCES G11LMA Linear Mathematics Examination Solutions
SCHOOL OF MATHEMATICAL SCIENCES GLMA Linear Mathematics 00- Examination Solutions. (a) i. ( + 5i)( i) = (6 + 5) + (5 )i = + i. Real part is, imaginary part is. (b) ii. + 5i i ( + 5i)( + i) = ( i)( + i)
Διαβάστε περισσότεραBayesian Analysis in Moment Inequality Models Supplement Material
Bayesian Analysis in Moment Inequality Models Supplement Material Yuan Liao Wenxin Jiang November 4, 2008 Abstract This is a supplement material of Liao and Jiang (2008). We consider the case when the
Διαβάστε περισσότεραThe Simply Typed Lambda Calculus
Type Inference Instead of writing type annotations, can we use an algorithm to infer what the type annotations should be? That depends on the type system. For simple type systems the answer is yes, and
Διαβάστε περισσότερα