Top Banner
View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment on photo
43

E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

Dec 18, 2015

Download

Documents

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 2: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.
Page 3: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

The basic Azzalini skew-normal model is:

Adding location and scale parameters we get

 Where denotes the standard normal density and denotes the corresponding distribution function.

Page 4: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

Genesis: Begin with (X,Y) with a bivariate normal distribution.

But, only keep X if Y is above average.

More generally, keep X if Y exceeds a given threshold, not necessarily its mean.

This model is discussed in some detail in Arnold, Beaver,Groeneveld and Meeker (1993)

Page 5: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

We call these hidden truncation models, because we don’t get to observe the truncating variable Y.

We just see X.

Page 6: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

Thus our simple model is

With bells and whistles (i.e. with location and scale parameters) we have:

Page 7: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

A more general model of the same genre is of the form

In such a model it may be necessary to evaluate the required normalizing constant numerically.

E.G. Cauchy, Laplace, logistic, uniform, etc.

Page 8: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

Multivariate extension: Beginwith a (k+m) dimensional r.v.(X,Y), but only keep X if Y>c

Often (X,Y) is assumed to havea classical multivariate normal

distribution.

The “closed skew-normal model”.

Page 9: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

Back to the case where X and Y are univariate.

The distribution of the observed X’s is

Page 10: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

with corresponding density:

“parameterized” by the choice ofmarginal distribution for Y, the choice of conditional distributionof X given Y and the criticalvalue 0y

.

Page 11: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

Instead of writing the joint densityof (X,Y) as

we can write it as

The model then looks a little different

Page 12: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

It now is of the form:

So that the “hidden truncation” version of the density of X, is clearly displayed as

a weighted version of the original density of X.

Page 13: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

The weight function is:

Page 14: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

This weighted form of hidden truncation densities appears in Arellano-Valle et al. (2002) with 0 0y

.But perhaps someone in the audience knowsan earlier reference.

Page 15: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

In this formulation our density is “parameterized”by the marginal density of X and the weight function which is determined by the conditional density of Y given X and the critical value 0y

.

Page 16: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

In fact the weight function, by a judiciouschoice of conditional distribution of Y given Xand a convenient choice of 0y

can be any weight function bounded above by 1.

Page 17: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

General hidden truncation models ( also called selection models by

Arelleno-Valle, Branco and Genton (2006) )are of the form:

Page 18: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

We focus on 3 special cases

We really only need to consider cases 1 and 3.Case 2 becomes case 1 if we redefine Y to be –Y.

Page 19: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

Life will be smoothest if these conditionalsurvival functions are available in analytic

or at least in tabulated form.

Page 20: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

These may be troublesome to deal with.Exception when (X,Y) is bivariate normal.

Page 21: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.
Page 22: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.
Page 23: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

Note that a very broad class of densities can be obtained from a given density via hidden truncation.

Suppose we wish to generate g(x) from f(x).

If g(x)/f(x) is bounded above by c, then we can take a joint density for (X,Y) such that P(Y<0|X=x) = g(x)/cf(x) and thus obtain g(x).

Page 24: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

Suppose that

And

And we consider two-sided hidden truncation

Page 25: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.
Page 26: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

More generally, we may consider

to get:

Page 27: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

Included in such models as a limiting case, we

find

which has arisen as a marginal of

a bivariate distribution with skew-normal conditionals

Page 28: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

In fact we can obtain just about any weighted normal density in this way .

To get:

We :

and

Page 29: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

We can apply hidden truncation to other bivariate models.

(i) The normal conditionals density

Page 30: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

(ii) Distributions with exponential components:

i.e.

Page 31: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

the corresponding two sided truncation model is

and the lower truncation model is

again an exponential density

Page 32: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

A similar phenomenon occurs with the exponential conditionals distribution

Page 33: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

If the conditional failure rate depends on x in a non-linear manner we can get more interesting distributions via hidden truncation.

E.G.

in particular consider

which yields a truncated normal distribution:

Page 34: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

(iii) Pareto components

Page 35: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

Multivariate cases:

Page 36: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

Classical multivariate normal case:

So that:

Page 37: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

Notation

Page 38: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

The distribution of

will then be given by

Let us define:

The corresponding density of will be

Z

Page 39: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

a.k.a.

closed skew-normal distribution

fundamental skew-normal distribution

multiple constraint skew-normal distribution

Page 40: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

Densities corresponding to two sided truncation have received less attention

though such truncation may be more common in practice than one sided.

They look a bit more ugly

Page 41: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.
Page 42: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.

Thank you for your attention.

Page 43: E-mail this photo View full size photo Visit the album this photo belongs to Check out the slide show Download photo Bookmark photo Publish photo Comment.