Divergence for log concave functions

Σχετικά έγγραφα
SOLUTIONS TO MATH38181 EXTREME VALUES AND FINANCIAL RISK EXAM

Areas and Lengths in Polar Coordinates

Areas and Lengths in Polar Coordinates

Homomorphism of Intuitionistic Fuzzy Groups

Second Order Partial Differential Equations

Chapter 6: Systems of Linear Differential. be continuous functions on the interval

Congruence Classes of Invertible Matrices of Order 3 over F 2

Takeaki Yamazaki (Toyo Univ.) 山崎丈明 ( 東洋大学 ) Oct. 24, RIMS

Solutions to Exercise Sheet 5

b. Use the parametrization from (a) to compute the area of S a as S a ds. Be sure to substitute for ds!

Dynamic types, Lambda calculus machines Section and Practice Problems Apr 21 22, 2016

Tridiagonal matrices. Gérard MEURANT. October, 2008

12. Radon-Nikodym Theorem

( y) Partial Differential Equations

Heisenberg Uniqueness pairs

The ε-pseudospectrum of a Matrix

Uniform Convergence of Fourier Series Michael Taylor

C.S. 430 Assignment 6, Sample Solutions

SOLUTIONS TO MATH38181 EXTREME VALUES AND FINANCIAL RISK EXAM

Other Test Constructions: Likelihood Ratio & Bayes Tests

Example Sheet 3 Solutions

ANSWERSHEET (TOPIC = DIFFERENTIAL CALCULUS) COLLECTION #2. h 0 h h 0 h h 0 ( ) g k = g 0 + g 1 + g g 2009 =?

Ordinal Arithmetic: Addition, Multiplication, Exponentiation and Limit

Dr. D. Dinev, Department of Structural Mechanics, UACEG

Statistics 104: Quantitative Methods for Economics Formula and Theorem Review

Chapter 6: Systems of Linear Differential. be continuous functions on the interval

The Pohozaev identity for the fractional Laplacian

SPECIAL FUNCTIONS and POLYNOMIALS

A Lambda Model Characterizing Computational Behaviours of Terms

ST5224: Advanced Statistical Theory II

1. If log x 2 y 2 = a, then dy / dx = x 2 + y 2 1] xy 2] y / x. 3] x / y 4] none of these

MATHEMATICS. 1. If A and B are square matrices of order 3 such that A = -1, B =3, then 3AB = 1) -9 2) -27 3) -81 4) 81

Reminders: linear functions

EE512: Error Control Coding

Affine Weyl Groups. Gabriele Nebe. Summerschool GRK 1632, September Lehrstuhl D für Mathematik

Finite Field Problems: Solutions

The Probabilistic Method - Probabilistic Techniques. Lecture 7: The Janson Inequality

5. Choice under Uncertainty

Partial Differential Equations in Biology The boundary element method. March 26, 2013

Abstract Storage Devices

Distances in Sierpiński Triangle Graphs

Mock Exam 7. 1 Hong Kong Educational Publishing Company. Section A 1. Reference: HKDSE Math M Q2 (a) (1 + kx) n 1M + 1A = (1) =

1. (a) (5 points) Find the unit tangent and unit normal vectors T and N to the curve. r(t) = 3cost, 4t, 3sint

4.6 Autoregressive Moving Average Model ARMA(1,1)

Strain gauge and rosettes

SCHOOL OF MATHEMATICAL SCIENCES G11LMA Linear Mathematics Examination Solutions

Oscillatory integrals

Math 446 Homework 3 Solutions. (1). (i): Reverse triangle inequality for metrics: Let (X, d) be a metric space and let x, y, z X.

Fractional Colorings and Zykov Products of graphs

Formal Semantics. 1 Type Logic

SCITECH Volume 13, Issue 2 RESEARCH ORGANISATION Published online: March 29, 2018

ECE598: Information-theoretic methods in high-dimensional statistics Spring 2016

k A = [k, k]( )[a 1, a 2 ] = [ka 1,ka 2 ] 4For the division of two intervals of confidence in R +

Fourier Series. MATH 211, Calculus II. J. Robert Buchanan. Spring Department of Mathematics

ECON 381 SC ASSIGNMENT 2

Homework 8 Model Solution Section

Econ 2110: Fall 2008 Suggested Solutions to Problem Set 8 questions or comments to Dan Fetter 1

Cyclic or elementary abelian Covers of K 4

Continuous Distribution Arising from the Three Gap Theorem

forms This gives Remark 1. How to remember the above formulas: Substituting these into the equation we obtain with

2 Composition. Invertible Mappings

A Bonus-Malus System as a Markov Set-Chain. Małgorzata Niemiec Warsaw School of Economics Institute of Econometrics

A Note on Intuitionistic Fuzzy. Equivalence Relation

3.4 SUM AND DIFFERENCE FORMULAS. NOTE: cos(α+β) cos α + cos β cos(α-β) cos α -cos β

Lecture 2. Soundness and completeness of propositional logic

6.1. Dirac Equation. Hamiltonian. Dirac Eq.

Differentiation exercise show differential equation

DERIVATION OF MILES EQUATION FOR AN APPLIED FORCE Revision C

Statistical Inference I Locally most powerful tests

Laplace Expansion. Peter McCullagh. WHOA-PSI, St Louis August, Department of Statistics University of Chicago

Numerical Analysis FMN011

Homomorphism in Intuitionistic Fuzzy Automata

F19MC2 Solutions 9 Complex Analysis

Answer sheet: Third Midterm for Math 2339

Lecture 2: Dirac notation and a review of linear algebra Read Sakurai chapter 1, Baym chatper 3

Matrices and Determinants

Jordan Form of a Square Matrix

Aquinas College. Edexcel Mathematical formulae and statistics tables DO NOT WRITE ON THIS BOOKLET

Intuitionistic Fuzzy Ideals of Near Rings

Solution Series 9. i=1 x i and i=1 x i.

CHAPTER 25 SOLVING EQUATIONS BY ITERATIVE METHODS

ΚΥΠΡΙΑΚΗ ΕΤΑΙΡΕΙΑ ΠΛΗΡΟΦΟΡΙΚΗΣ CYPRUS COMPUTER SOCIETY ΠΑΓΚΥΠΡΙΟΣ ΜΑΘΗΤΙΚΟΣ ΔΙΑΓΩΝΙΣΜΟΣ ΠΛΗΡΟΦΟΡΙΚΗΣ 24/3/2007

Integrals in cylindrical, spherical coordinates (Sect. 15.7)

A Two-Sided Laplace Inversion Algorithm with Computable Error Bounds and Its Applications in Financial Engineering

Lecture 21: Properties and robustness of LSE

Chap. 6 Pushdown Automata

Tutorial on Multinomial Logistic Regression

ES440/ES911: CFD. Chapter 5. Solution of Linear Equation Systems

Inverse trigonometric functions & General Solution of Trigonometric Equations

Homework 3 Solutions

Lecture 26: Circular domains

Sequent Calculi for the Modal µ-calculus over S5. Luca Alberucci, University of Berne. Logic Colloquium Berne, July 4th 2008

A Hierarchy of Theta Bodies for Polynomial Systems

Generating Set of the Complete Semigroups of Binary Relations

Concrete Mathematics Exercises from 30 September 2016

10/3/ revolution = 360 = 2 π radians = = x. 2π = x = 360 = : Measures of Angles and Rotations

On the Galois Group of Linear Difference-Differential Equations

Notes on the Open Economy

w o = R 1 p. (1) R = p =. = 1

Problem Set 3: Solutions

Transcript:

Divergence or log concave unctions Umut Caglar The Euler International Mathematical Institute June 22nd, 2013 Joint work with C. Schütt and E. Werner

Outline 1 Introduction 2 Main Theorem 3 -divergence 4 -divergences or convex bodies 5 -divergences or s-concave unctions

Introduction K is a convex body in R n

Introduction K is a convex body in R n Aine surace area as 1 (K = K κ(x 1 n+1 dµ(x

Introduction K is a convex body in R n Aine surace area as 1 (K = K κ(x 1 n+1 dµ(x L p aine surace area as p (K = K κ n+p p n(p 1 x,n(x n+p (Blaschke, Leichtweiss, Lutwak, Meyer-Werner, Schütt-Werner... dµ

Introduction : R n [0, is log concave i = e ψ, ψ : R n R convex.

Introduction : R n [0, is log concave i = e ψ, ψ : R n R convex. Theorem 1 (Artstein-Klartag-Schütt-Werner, 12 Let : R n [0, be a log concave unction such that dx = 1. supp( ( ln det (Hess ( ln dx 2 [ Ent( Ent(g ] where g(x = (2π n 2 e x 2 2. Note that Ent( = ln dx and Ent(g = ln(2πe n 2.

Introduction Let : R n [0, be a log concave unction. The polar (Artstein-Klartag-Milman o is (x = in y e x,y (y

Introduction Let : R n [0, be a log concave unction. The polar (Artstein-Klartag-Milman o is (x = in y e x,y (y Functional Blaschke Santaló inequality (Ball; Artstein-Klartag-Milman ( ( dx dx (2π n

Main Theorem Theorem 2 (C.-Schütt-Werner, 13 Let : (0, R be a convex unction. Let : R n [0, be a log concave unction. (,x e 2 ( det (Hess ( ln dx dx ( dx dx

Main Theorem Theorem 2 (C.-Schütt-Werner, 13 Let : (0, R be a convex unction. Let : R n [0, be a log concave unction. (,x e 2 ( det (Hess ( ln dx dx ( dx dx I is concave, the inequality is reversed. I is linear, there is equality.

Main Theorem Theorem 2 (C.-Schütt-Werner, 13 Let : (0, R be a convex unction. Let : R n [0, be a log concave unction. (,x e 2 ( det (Hess ( ln dx dx ( dx dx I is concave, the inequality is reversed. I is linear, there is equality. I is strictly convex or concave, there is equality or (x = Ce Ax,x, where C > 0 and A is an n n positive-deinite matrix.

Main Theorem Theorem 2 = Theorem 1 (,x ( e det (Hess ( ln dx 2 dx ( dx dx

Main Theorem Theorem 2 = Theorem 1 (,x ( e det (Hess ( ln dx 2 dx ( dx dx Put (t = ln t in Theorem 2: [ ], x 2 ln + ln (det (Hess ( ln

Main Theorem Theorem 2 = Theorem 1 (,x ( e det (Hess ( ln dx 2 dx ( dx dx Put (t = ln t in Theorem 2: [ ], x 2 ln + ln (det (Hess ( ln = n dx 2 Ent( + ln (det (Hess ( ln

Main Theorem Theorem 2 = Theorem 1 (,x ( e det (Hess ( ln dx 2 dx ( dx dx Put (t = ln t in Theorem 2: [ ], x 2 ln + ln (det (Hess ( ln = n dx 2 Ent( + ln (det (Hess ( ln ( ln dx

Main Theorem Theorem 2 = Theorem 1 (,x ( e det (Hess ( ln dx 2 dx ( dx dx Put (t = ln t in Theorem 2: [ ], x 2 ln + ln (det (Hess ( ln = n dx 2 Ent( + ln (det (Hess ( ln ( ln dx ln (det (Hess ( ln 2 Ent( + ln (e n dx

Main Theorem Theorem 2 = Theorem 1 (,x ( e det (Hess ( ln dx 2 dx ( dx dx Put (t = ln t in Theorem 2: [ ], x 2 ln + ln (det (Hess ( ln = n dx 2 Ent( + ln (det (Hess ( ln ( ln dx ln (det (Hess ( ln 2 Ent( + ln (e n dx 2 Ent( + ln (2πe n

-divergence The expressions o Theorem 2

-divergence The expressions o Theorem 2 Deinition 3 (Csiszar, Morimoto, Ali-Silvery (X, µ is a measure space. P = pµ and Q = qµ are measures on X that are absolutely continuous with respect to the measure µ. : (0, R is a convex or a concave unction.

-divergence The expressions o Theorem 2 Deinition 3 (Csiszar, Morimoto, Ali-Silvery (X, µ is a measure space. P = pµ and Q = qµ are measures on X that are absolutely continuous with respect to the measure µ. : (0, R is a convex or a concave unction. The -divergence D (P, Q o P and Q is D (P, Q = X ( p qdµ q

-divergence Examples D (P, Q = X ( p qdµ q 1. (t = ln t gives the Kullback-Leibler divergence or relative entropy rom P to Q D KL (P Q = q ln p q dµ. X

-divergence Examples D (P, Q = X ( p qdµ q 1. (t = ln t gives the Kullback-Leibler divergence or relative entropy rom P to Q D KL (P Q = q ln p q dµ. 2. The convex or concave unctions (t = t α leads to the Rényi entropy X o order α D α (P Q = 1 ( α 1 ln p α q 1 α dµ X The case α = 1 is the relative entropy D KL (P Q.

-divergences or convex bodies (X, µ = ( K, µ K

-divergences or convex bodies (X, µ = ( K, µ K Q K = q K µ K, q K = x, N(x P K = p K µ K, p K = κ x,n(x n

-divergences or convex bodies (X, µ = ( K, µ K Q K = q K µ K, q K = x, N(x P K = p K µ K, p K = κ x,n(x n Q K and P K are the cone measures o K and K.

-divergences or convex bodies (X, µ = ( K, µ K Q K = q K µ K, q K = x, N(x P K = p K µ K, p K = κ x,n(x n Q K and P K are the cone measures o K and K. L p -aine surace areas are α-rényi entropy powers (Werner, 12 as p (K = e n n+p D n+p p (P K Q K with α = p n+p.

-divergences or convex bodies The -divergence or a convex body K in R n with respect to the (cone measures P K and Q K was deined by Werner D (P K, Q K = = K K ( ( pk q K q K dµ K κ(x x, N(x n+1 x, N(x dµ K

-divergences or s-concave unctions Deinition 4 Let s R. : R n [0, is s-concave i or all λ (0, 1, or all x, y ((1 λx + λy [(1 λ(x s + λ(y s ] 1 s

-divergences or s-concave unctions Deinition 4 Let s R. : R n [0, is s-concave i or all λ (0, 1, or all x, y ((1 λx + λy [(1 λ(x s + λ(y s ] 1 s relation to log concave unctions: Let be a log concave unction. Then or all s s = (1 + s ln 1 s + is s-concave and s as s 0

-divergences or s-concave unctions Deinition 5 (-divergences or s-concave unctions q (s ( = 1 s [ det p (s =, x Hess ( ln + s ( n+ 1 s,x 1 s 2 ] D (s (s (P, Q (s = det ( 2 1 s,x [ Hess ( ln + s ] 2 n+1+ 1 s ( 1 s, x dx

-divergences or s-concave unctions D (s (s (P, Q (s =. [ det ( 2 Hess ( ln + s 1 s,x ] 2 n+1+ 1 s ( 1 s, x dx

-divergences or s-concave unctions D (s (s (P, Q (s =. [ det ( 2 Hess ( ln + s 1 s,x ] 2 n+1+ 1 s ( 1 s, x dx s 0

-divergences or s-concave unctions D (s (s (P, Q (s =. [ det ( 2 Hess ( ln + s 1 s,x ] 2 n+1+ 1 s ( 1 s, x dx (e,x 2 det [Hess ( ln ] s 0 dx

-divergences or s-concave unctions D (s (s (P, Q (s =. [ det ( 2 Hess ( ln + s 1 s,x ] 2 n+1+ 1 s ( 1 s, x dx (e,x 2 det [Hess ( ln ] s 0 dx =: D (P, Q

-divergences or s-concave unctions D (s (s (P, Q (s =. [ det ( 2 Hess ( ln + s 1 s,x ] 2 n+1+ 1 s ( 1 s, x dx (e,x 2 det [Hess ( ln ] s 0 dx =: D (P, Q or log concave with the corresponding q = and p = 1 e,x det [Hess ( ln ].

-divergences or s-concave unctions Theorem 2 ( D (P, Q dx ( dx dx I is concave, the inequality is reversed. I is linear, there is equality.

-divergences or s-concave unctions Theorem 2 ( D (P, Q dx ( dx dx I is concave, the inequality is reversed. I is linear, there is equality. Theorem 1 Let dx = 1. ( D KL (P Q ln dx ln (2πe n

-divergences or s-concave unctions relation to convex bodies : R n [0, s-concave. s > 0 such that 1 s N. For such we consider the convex bodies introduced by Artstein-Klartag-Milman K s ( = { (x, y R n R 1 x s : s supp(, y s ( x } s

-divergences or s-concave unctions relation to convex bodies : R n [0, s-concave. s > 0 such that 1 s N. For such we consider the convex bodies introduced by Artstein-Klartag-Milman K s ( = { (x, y R n R 1 x s : s supp(, y s ( x } s Proposition 6 D (s (s (P, Q (s = D (P Ks(, Q Ks( s n 2 S 1 s 1

-divergences or s-concave unctions Thank you! Email: uxc8@case.edu