Outline. Detection Theory. Background. Background (Cont.)

Σχετικά έγγραφα
Last Lecture. Biostatistics Statistical Inference Lecture 19 Likelihood Ratio Test. Example of Hypothesis Testing.

Homework for 1/27 Due 2/5

Other Test Constructions: Likelihood Ratio & Bayes Tests

Lecture 17: Minimum Variance Unbiased (MVUB) Estimators

Solutions: Homework 3

LAD Estimation for Time Series Models With Finite and Infinite Variance

Parameter Estimation Fitting Probability Distributions Bayesian Approach

SOLUTIONS TO MATH38181 EXTREME VALUES AND FINANCIAL RISK EXAM

SUPERPOSITION, MEASUREMENT, NORMALIZATION, EXPECTATION VALUES. Reading: QM course packet Ch 5 up to 5.6

p n r

Transmitter Channel Receiver. (modulated signal ) s(t) + r(t) (received signal ) n(t) (noise) G n (f)

Ψηφιακή Επεξεργασία Εικόνας

6. MAXIMUM LIKELIHOOD ESTIMATION

The Equivalence Theorem in Optimal Design

1. For each of the following power series, find the interval of convergence and the radius of convergence:

Statistical Inference I Locally most powerful tests

n r f ( n-r ) () x g () r () x (1.1) = Σ g() x = Σ n f < -n+ r> g () r -n + r dx r dx n + ( -n,m) dx -n n+1 1 -n -1 + ( -n,n+1)

Outline. M/M/1 Queue (infinite buffer) M/M/1/N (finite buffer) Networks of M/M/1 Queues M/G/1 Priority Queue

Estimation for ARMA Processes with Stable Noise. Matt Calder & Richard A. Davis Colorado State University

Theorem 8 Let φ be the most powerful size α test of H

HW 3 Solutions 1. a) I use the auto.arima R function to search over models using AIC and decide on an ARMA(3,1)

ST5224: Advanced Statistical Theory II

Biorthogonal Wavelets and Filter Banks via PFFS. Multiresolution Analysis (MRA) subspaces V j, and wavelet subspaces W j. f X n f, τ n φ τ n φ.

EN40: Dynamics and Vibrations

SOLUTIONS TO MATH38181 EXTREME VALUES AND FINANCIAL RISK EXAM

FREE VIBRATION OF A SINGLE-DEGREE-OF-FREEDOM SYSTEM Revision B

Local Approximation with Kernels

EE 570: Location and Navigation

Econ 2110: Fall 2008 Suggested Solutions to Problem Set 8 questions or comments to Dan Fetter 1

An Introduction to Signal Detection and Estimation - Second Edition Chapter II: Selected Solutions

Second Order RLC Filters

ECE 308 SIGNALS AND SYSTEMS FALL 2017 Answers to selected problems on prior years examinations

Introduction to the ML Estimation of ARMA processes

Baseband Transmission

Second Order Partial Differential Equations

HMY 795: Αναγνώριση Προτύπων


Bayesian statistics. DS GA 1002 Probability and Statistics for Data Science.

Three Classical Tests; Wald, LM(Score), and LR tests

α β

Solution Series 9. i=1 x i and i=1 x i.


CS 1675 Introduction to Machine Learning Lecture 7. Density estimation. Milos Hauskrecht 5329 Sennott Square

Advanced Statistics. Chen, L.-A. Distribution of order statistics: Review : Let X 1,..., X k be random variables with joint p.d.f f(x 1,...

IIT JEE (2013) (Trigonomtery 1) Solutions

Space-Time Symmetries

Introduction of Numerical Analysis #03 TAGAMI, Daisuke (IMI, Kyushu University)

Example Sheet 3 Solutions

Statistics 104: Quantitative Methods for Economics Formula and Theorem Review

w o = R 1 p. (1) R = p =. = 1

Approximation of distance between locations on earth given by latitude and longitude

Does anemia contribute to end-organ dysfunction in ICU patients Statistical Analysis

Practice Exam 2. Conceptual Questions. 1. State a Basic identity and then verify it. (a) Identity: Solution: One identity is csc(θ) = 1

DESIGN OF MACHINERY SOLUTION MANUAL h in h 4 0.

Ordinal Arithmetic: Addition, Multiplication, Exponentiation and Limit

Repeated measures Επαναληπτικές μετρήσεις

Spherical Coordinates

Aquinas College. Edexcel Mathematical formulae and statistics tables DO NOT WRITE ON THIS BOOKLET

1. A fully continuous 20-payment years, 30-year term life insurance of 2000 is issued to (35). You are given n A 1

Problem Set 3: Solutions

Phys460.nb Solution for the t-dependent Schrodinger s equation How did we find the solution? (not required)

6.1. Dirac Equation. Hamiltonian. Dirac Eq.

Lifting Entry (continued)

Λύσεις Θεµάτων Εξεταστικής Ιανουαρίου 2009 Mάθηµα: «Ψηφιακές Επικοινωνίες» G F = 0.8 T F = 73 0 K

Exercise 2: The form of the generalized likelihood ratio

Nowhere-zero flows Let be a digraph, Abelian group. A Γ-circulation in is a mapping : such that, where, and : tail in X, head in


Table 1: Military Service: Models. Model 1 Model 2 Model 3 Model 4 Model 5 Model 6 Model 7 Model 8 Model 9 num unemployed mili mili num unemployed

Every set of first-order formulas is equivalent to an independent set

Probability and Random Processes (Part II)

Chapter 6: Systems of Linear Differential. be continuous functions on the interval

Exercises 10. Find a fundamental matrix of the given system of equations. Also find the fundamental matrix Φ(t) satisfying Φ(0) = I. 1.

Homework 8 Model Solution Section

Π Ο Λ Ι Τ Ι Κ Α Κ Α Ι Σ Τ Ρ Α Τ Ι Ω Τ Ι Κ Α Γ Ε Γ Ο Ν Ο Τ Α

Solve the difference equation

Statistical analysis of extreme events in a nonstationary context via a Bayesian framework. Case study with peak-over-threshold data

Forced Pendulum Numerical approach

Iterated trilinear fourier integrals with arbitrary symbols

D Alembert s Solution to the Wave Equation

EE512: Error Control Coding

Fractional Colorings and Zykov Products of graphs

Inverse trigonometric functions & General Solution of Trigonometric Equations

Πανεπιστήµιο Κρήτης - Τµήµα Επιστήµης Υπολογιστών. ΗΥ-570: Στατιστική Επεξεργασία Σήµατος. ιδάσκων : Α. Μουχτάρης. εύτερη Σειρά Ασκήσεων.

Lifting Entry 2. Basic planar dynamics of motion, again Yet another equilibrium glide Hypersonic phugoid motion MARYLAND U N I V E R S I T Y O F

Rapid Acquisitio n of Doppler Shift in Satellite Co mmunicatio ns

A Two-Sided Laplace Inversion Algorithm with Computable Error Bounds and Its Applications in Financial Engineering

MATHEMATICS. 1. If A and B are square matrices of order 3 such that A = -1, B =3, then 3AB = 1) -9 2) -27 3) -81 4) 81

1. (a) (5 points) Find the unit tangent and unit normal vectors T and N to the curve. r(t) = 3cost, 4t, 3sint

Numerical Analysis FMN011

Queensland University of Technology Transport Data Analysis and Modeling Methodologies

The Probabilistic Method - Probabilistic Techniques. Lecture 7: The Janson Inequality

Jesse Maassen and Mark Lundstrom Purdue University November 25, 2013

ΚΥΠΡΙΑΚΗ ΕΤΑΙΡΕΙΑ ΠΛΗΡΟΦΟΡΙΚΗΣ CYPRUS COMPUTER SOCIETY ΠΑΓΚΥΠΡΙΟΣ ΜΑΘΗΤΙΚΟΣ ΔΙΑΓΩΝΙΣΜΟΣ ΠΛΗΡΟΦΟΡΙΚΗΣ 24/3/2007

4.6 Autoregressive Moving Average Model ARMA(1,1)

: Monte Carlo EM 313, Louis (1982) EM, EM Newton-Raphson, /. EM, 2 Monte Carlo EM Newton-Raphson, Monte Carlo EM, Monte Carlo EM, /. 3, Monte Carlo EM

Lecture 3: Asymptotic Normality of M-estimators

12. Radon-Nikodym Theorem

Web-based supplementary materials for Bayesian Quantile Regression for Ordinal Longitudinal Data

Probability theory STATISTICAL MODELING OF MULTIVARIATE EXTREMES, FMSN15/MASM23 TABLE OF FORMULÆ. Basic probability theory

ITU-R BT ITU-R BT ( ) ITU-T J.61 (

Transcript:

Outlie etectio heory Chapter7. etermiistic Sigals with Ukow Parameters afiseh S. Mazloum ov. 3th Backgroud Importace of sigal iformatio Ukow amplitude Ukow arrival time Siusoidal detectio Classical liear model Backgroud Statistical ecisio heory I PF for assumed hypothesis is completely kow. pproaches: eyma Pearso theorem Bayesia approach based o miimizatio of Bayes risk Sigal model dl etermiistic sigal Radom sigal Backgroud (Cot. Statistical ecisio heory II PF has ukow parameters (i this chapter determiistic sigals pproaches: UMPdoes otusually exist Geeralized Likelihood Ratio est (GLR ecide if p( x;, LG ( x p( x;, Bayesia approach ecide if (, ( p( x; p x p d p( x; p(, p( d x

Importace of Sigal Iformatio ssume there is o kowledge of sigal : x [ ] ω[ ],,..., : x [ ] s [ ] + ω [ ],,...,,, ω[ ] ~ WG with variace s [ ]~ determiistic ad completely ukow GLR decides if p( x; s[],..., s[ ], p ( x ; where s [ ]is MLE of s [ ]for,,...,,, Importace of Sigal Iformatio (Cot. Uder the PF of p ( x; exp [ ] x ( π Uder the PF of hus, x x s [ ] x [ ] p ( x ; s [],..., s [ ], exp ( [ ] [ ] x s ( π ( π exp x [ ] ( π eergy detector ( X x [ ] xs [ ] [ ] Importace of Sigal Iformatio (Cot. etectio performace ( ( P Q Q P d Loss i performace d E d MF dmf log log db d E Matched filter coheretly combies data Eergy detector icoheretly combies data Ukow mplitude etectig a determiistic sigal with ukow amplitude i WG UMP test GLR Bayesia approach : [ ] [ ],,...,,, : x [ ] s [ ] + ω[ ],,..., :ukow amplitude ω[ ] ~ WG with variace s [ ]: determiistic ad completely kow

Ukow mplitude (Cot. UMP test: LR decides if exp ( [ ] [ ] xs p( x; ( π p( x; exp [ ] x ( π x [ ] s [ ] > UMP does ot exist xs [ ] [ ] > > xs [ ] [ ]< < Ukow mplitude (Cot. GLR decides if ( ; px, ( π px ( ; is MLE of uder ( X x[ ] s[ ] exp ( x[ ] s[ ] exp x [ ] ( π xs [ ] [ ] s [ ] or xs [ ] [ ] > Ukow mplitude (Cot. Ukow mplitude (Cot. GLR detector performace P Pr u( x ; { } { } P Pr u( x ; xs [ ] [ ] > GLR detector performace ( ( / ( / ( P Q Q P d + Q Q P + d where d, s [ ] uder xs ux ( [ ] [ ] s [ ], s [ ] uder

Ukow mplitude (Cot. Ukow mplitude (Cot. Bayesia approach, uder x s + w x + w ( [ s[], s[],..., s[ ] ] radom variable with PF μ, s w WG with variace (, I P test statistic μ ( x ( x s + ( s s x s + s s + correlator Squared correlator P test decides if (results i Sectio 5.6 ( ( x x C + Cω μ + xc C ( C + C x> ω ω μ μ ω C C I if (kow amplitude case ( x x μ s ( x ( x s ss If (ukow amplitude μ Usig Bayesia detector we require kowledge of ad. Ukow rrival ime Ukow rrival ime (Cot. etectig a determiistic sigal with ukow arrival time i WG : [ ],,..., : x [ ] s [ ] + ω[ ],,..., GLR decides if p( x;, p( ( x ; is MLE of uder + M max xs [ ] [ ] ukow delay ω[ ] WG with variace s [ ] detemiistic ad kow [, M-] + M Observatio iterval Uder + M p ( x ;, exp [ ] x π M. exp [ ] [ ] π ( x s. exp x [ ] + M π

Ukow rrival ime (Cot. est statistic + M + M ( xs [ ] [ ] s[ ] + M ( x x[ ] s[ ] + M ( x max x[ ] s[ ] [, M ] + Choose ( > max over < M s [ ] x [ ] Ch ( x s [ ] Ukow rrival ime (Cot. etectio performace of GLR is difficult! PF of correlated Gaussia radom variable has to be determied. + M P Pr max [ ] [ ] ; [, M] x s + M P Pr max xs [ ] [ ] γ ; [, M] > elay is less tha samplig iterval ( x max X( f S( fexp( j π f df [, M] * Siusoidal etectio etectio of a siusoid i WG : x [ ] ω[ ],,..., ω [ ],,...,,,, + M,...,, : x [ ] cos( π f + ϕ + ω[ ], +,..., + M GLR approach ukow, ϕ ukow, ϕ, f ukow, ϕ, f, ukow Siusoidal etectio (Cot. etectio of a siusoid i WG with ukow amplitude ad phase, GLR decides if p ( x ;, ϕ, p( x; ad ϕ are MLE of ad ϕ α + α α ϕ arcta α α x [ ]cos π f α x[ ]siπ f

Siusoidal etectio (Cot. We decide if exp ( [ ] cos( ϕ exp [ ] x ( π x π f + ( π x [ ]exp( j π f I( f periodogram detector icoheret or quadrature MF Siusoidal etectio (Cot. GLR detectio performace { } { } P Pr I( f ; P Pr I( f ; I( f ξ + ξ joitly Gaussia ξ ξξ ξ x [ ]cosπ f, I uder ξ x [ ]siπ f ξ cosϕ, I uder si ϕ Siusoidal etectio (Cot. Siusoidal etectio (Cot. GLR detectio performace P Q exp χ γ P Q χ λ ( etectio of a siusoid i WG with ukow GLR decides if p ( x ;, ϕ, f,, p( x;, ϕ, f, P Q l χ ( λ P λ, ϕ, f ad are MLE of, ϕ, f ad α + α α + M ϕ arcta α α M + M x π f M α [ ]cos ( x π f [ ]si (

Siusoidal etectio (Cot. fter simplificatio, p( x;, ϕ, f (,, I f l p( x; where I ( f x[ ]exp( j f We decide if I ( f max >, f + M + M π M + Choose max over, f < x [ ] exp( j π f Classical Liear Model Liear Bayesia model etectio problem with ukow sigal parameters coverts to geeral Gaussia problem P detector Classical liear model Parameters assumed determiistic GLR GLR Classical Liear Model ssume that x + w is kow pobservatio matrix of rak GLR for hypothesis testig problem : b : b is p vector of parameters w is oise vector with PF (, I is r pmatrix of rak r b is r vector bis cosistet set of liear equatios p GLR Classical Liear Model (Cot. We decide if ( b ( ( ( l L ( b x G x ( x is the MLE of uder

GLR Classical Liear Model (Cot. etectio performace P Q χ ( r GLR Classical Liear Model (Cot. Ukow amplitude sigal i WG : [ ] [ ] x ω,,..., : x [ ] s [ ] + ω [ ],,..., P Q χ λ ( ( r ( b ( ( λ b : x [ ] s [ ] + ω[ ],,,..., : x [ ] s [ ] + ω [ ],,,..., x + w : [ s[], s[],..., s[ ]] : GLR Classical Liear Model (Cot. We decide if ( b ( ( ( l LG ( b x x, b ( x ( x x[ s ] [ ] s [ ] x[ s ] [ ] ( x s [ ] GLR Classical Liear Model (Cot. etectio performace P Q χ ( P Q ( χ ( λ r r s [ ] whereλ ( ( / ( / ( P Q Q P d + Q Q P + d where d