N. Hemachandra (Indian Institute of Technology Bombay, India) and Puja Sahu (Indian Institute of Technology Bombay, India)

Copyright: © 2015
|Pages: 25

DOI: 10.4018/978-1-4666-7272-7.ch021

Chapter Preview

TopIt is well known that normally distributed data sets are observed in numerous situations. One major reason for this is the following situation. Suppose one has a random error which is the aggregate of a large collection of errors. Then, under mild conditions, by the classical Central Limit Theorem and its variants, as discussed in Billingsley (1995), Chung (2001), Fristedt and Gray (1997), Kallenberg (2002), Wasserman (2005), etc., the standardized sum of the collections of errors (and hence suitable scaling of the centered random error) has approximately the distribution of a zero mean normal random variable.

A central theme in statistical inference is that given a sample from a parametric distribution, one is interested in finding a suitable ‘best’ estimator for a parameter of the distribution. Most of such inference procedures concentrate on the unbiased estimators and finding the ‘best’ (i.e., the one having the minimum variance) amongst them. These are the classical Uniformly Minimum Variance Unbiased Estimators, (UMVUE) (Casella & Berger, 2002), (DeGroot & Schervish, 2012), etc. However, one can tradeoff the bias of the estimator to achieve lower variance and hence find a better estimator in terms of Mean Squared Error (MSE) as MSE is the sum of squared bias and variance of the estimator, leading to the optimal MSE estimator. Further, one can view both squared bias and variance of an estimator as equally important and hence search for an estimator that minimizes the maximum of these two (undesirable) quantities, the minmax estimator.

In fact, one can view MSE as capturing a quality of an estimator and hence compare various estimators on the basis of their MSEs. Also, one can compare estimators in terms of the percentage of squared bias in MSE. Yet an another way to compare estimators is to view this comparison as a multi-criteria problem involving squared bias and variance and then search for those estimators that are Pareto optimal: the set of estimators such that reducing of one of these quantities leads to increase in the other quantity.

In this chapter, we illustrate the above aspects of estimators and various measures of quality of estimators when the underlying data is normally distributed and the parameter we are interested is the variance of this normal random variable.

Consider a random sample (*X*_{1}, *X*_{2}, *..., X _{n}*) of size from a

But one can also consider the following estimators of *σ*^{2}:

Similarly for the *µ* unknown case, we decided to look for estimators for *σ*^{2} of the form

It is assumed that the sample size,, is at least two. Also, we can restrict ourselves to as estimators of this nature dominate the zero estimator corresponding to , both on MSE as well as minmax criteria. Details on this and related points are in given in the technical report (Hemachandra & Sahu, 2014).

Minmax Estimator: We define the minmax estimator as the one which minimizes the maximum of the squared bias and the variance values for an estimator with coefficient, c . .

Pareto Optimality: Pareto optimality or efficiency is achieved over the multi-criteria for an estimator, when none of the component can be improved upon without making worse the other component.

Variance: The variance of an estimator T of the parameter ? is defined as: .

Bias: The bias of an estimator T of the parameter ? is defined as: .

MSE: Mean Squared Error (MSE) of an estimator T of the parameter ? is defined as: , which can be simplified to the following form: .

Search this Book:

Reset

Copyright © 1988-2020, IGI Global - All Rights Reserved