ADVANCES IN ECONOMETRICS
VOLUME 17
MAXIMUM LIKELIHOOD ESTIMATION OF MISSPECIFIED MODELS: TWENTY YEARS LATER EDITED BY
THOMAS B. FOMBY Department of Economics, Southern Methodist University, USA
R. CARTER HILL Economics Department, Louisiana State University, USA
2003
ELSEVIER JAI
Amsterdam - Boston - Heidelberg - London - New York - Oxford - Paris San Diego - San Francisco - Singapore - Sydney - Tokyo
Copynghted matenal
ELSEVIER Ltd The Boulevard. Langford Lane Kid lington, Oxford OX5 1GB, UK
© 2003 Elsevier Ltd. A U rights reserved. This work is prote.cte.d under copyright by Elsevier. and the following tcnns and conditions apply to its usc: Photocopying Single photocopies of single chapters may be made for personal use as allowed by natiooal copyright laws. Pcnnission of the Publisher and pnymcnt of a fee is required for all other photocopying. including multiple or systematic copying, copying for advertising or promotional purposes. resale, and all forms of document delivery. Special rates arc avai lable for educational institutions that wish to make photocopies for non-profit educational classroom usc.
Permissions may be sought directly from Elsevier Global Rights Department. PO Box 800. Oxford OX5 lOX, UK; phone: (+44) 1865 843830, fax: (+44) 1865 853333, e-mail:
[email protected]. You may alsocontac.t Global Rights di rectly through Elsevier's home page (http://www.elsevier.com), by selecting 'Obtaining Permissions' .
In the USA, users rnay clear permissions and make payments through the Copyright Cleanrnce Center. [nc.. 222 Rosewood Drive, Danvers, MA 0 1923, USA; phone: (+I) (978) 7508400, fax: (+ I) (978) 7504744, and in the UK dwough the Copyright Licensing Agency Rapid Clearance Service (CLARCS), 90 Tottenbam Co\IJ·t Road, London WIP OLP. UK; phone: (+44) 207 631 5555; fax: (+44) 207 6315500. Other countries may have a local reprographic rights agency for payments. Derivative Works Tables of cements may be reproduced for internal circulation! but pennission of Elsevier is required for external resale or distribution of such material. Pennission of the Publi sher is required for all other derivative works, including compilations and tr.mslations. Electronic St.orage or Usage Pennission of the Publisher is required to store or use electronically any material conrained in this work,
including any chapter or part of a chapter. Except as outlined above, no part of th.i s work may be reproduced, stored in a retrieval system or transmincd in any form or by any me•ms~ electronic, mechanical. photocopying. recording or otherv.tise. without prior wrinen permission of the Publisher. Address permissions requests to: Elsevier Global Rights Department, at the mai l. fax and e--mai l addresses
noted above. Notice No responsibi lity is assumed by the Publisher for any injury <md/or damage to persons or property as a matter of products liability, negligence or otherwise, or from any usc or opc.ration of any methods, products, instructions or ideas contained in the material herein. Because of rapid advances in the medical sciences. in particular. independent verification of diagnoses and drug dosages should be made.
First edition 2003
Library of Congress Cataloging in Publication Data A catalogue record from the British Library has been applied for. ISBN: 0-7623- 1075-8 ISSN: 073 1-9053 (Series) @The paper used in this pubijcation meets the requirements of ANSUNISO 239.48-1992 ( Pennanence of Paper). Printed in The Netherlands.
Copynghted matenal
CONTENTS LIST OF CONTRIBUTORS
vii
INTRODUCTION Thomas B. Fomby and R. Carter Hill
ix
A COMPARATIVE STUDY OF PURE AND PRETEST ESTIMATORS FOR A POSSIBLY MISSPECIFIED TWO-WAY ERROR COMPONENT MODEL Badi H. Baltagi, Georges Bresson and Alain Pirotte
1
TESTS OF COMMON DETERMINISTIC TREND SLOPES APPLIED TO QUARTERLY GLOBAL TEMPERATURE DATA Thomas B. Fomby and Timothy J. Vogelsang
29
THE SANDWICH ESTIMATE OF VARIANCE James W. Hardin
45
TEST STATISTICS AND CRITICAL VALUES IN SELECTIVITY MODELS R. Carter Hill, Lee C. Adkins and Keith A. Bender
75
ESTIMATION, INFERENCE, AND SPECIFICATION TESTING FOR POSSIBLY MISSPECIFIED QUANTILE REGRESSION Tae-Hwan Kim and Halbert White
107
QUASI-MAXIMUM LIKELIHOOD ESTIMATION WITH BOUNDED SYMMETRIC ERRORS Douglas Miller, James Eales and Paul Preckel
133
v
vi
CONSISTENT QUASI-MAXIMUM LIKELIHOOD ESTIMATION WITH LIMITED INFORMATION Douglas Miller and Sang-Hak Lee
149
AN EXAMINATION OF THE SIGN AND VOLATILITY SWITCHING ARCH MODELS UNDER ALTERNATIVE DISTRIBUTIONAL ASSUMPTIONS Mohamed F. Omran and Florin Avram
165
ESTIMATING A LINEAR EXPONENTIAL DENSITY WHEN THE WEIGHTING MATRIX AND MEAN PARAMETER VECTOR ARE FUNCTIONALLY RELATED Chor-yiu Sin
177
TESTING IN GMM MODELS WITHOUT TRUNCATION Timothy J. Vogelsang
199
BAYESIAN ANALYSIS OF MISSPECIFIED MODELS WITH FIXED EFFECTS Tiemen Woutersen
235
LIST OF CONTRIBUTORS Lee C. Adkins
Oklahoma State University, Stillwater, USA
Florin Avram
University de Pau, France
Badi H. Baltagi
Texas A&M University, College Station, USA
Keith A. Bender
University of Wisconsin-Milwaukee, Milwaukee, USA
Georges Bresson
Universit´e Paris II, Paris, France
James Eales
Purdue University, West Lafayette, USA
Thomas B. Fomby
Southern Methodist University, Dallas, USA
James W. Hardin
University of South Carolina, Columbia, USA
R. Carter Hill
Louisiana State University, Baton Rouge, USA
Tae-Hwan Kim
University of Nottingham, Nottingham, UK
Sang-Hak Lee
Purdue University, West Lafayette, USA
Douglas Miller
Purdue University, West Lafayette, USA
Mohammed F. Omran
University of Sharjah, UAE
Alain Pirotte
Universit´e de Valenciennes and Universit´e Paris II, Paris, France
Paul Preckel
Purdue University, West Lafayette, USA
vii
viii
Dhor-yiu Sin
Hong Kong Baptist University, Hong Kong
Timothy J. Vogelsang
Cornell Univerisity, Ithaca, USA
Halbert White
University of California, San Diego, USA
Tiemen Woutersen
University of Western Ontario, Ontario, Canada
INTRODUCTION It is our pleasure to bring you a volume of papers which follow in the tradition of the seminal work of Halbert White, especially his work in Econometrica (1980, 1982) and his Econometric Society monograph no. 22 Estimation, Inference and Specification Analysis (1994). Approximately 20 years have passed since White’s initial work on heteroskedasticity-consistent covariance matrix estimation and maximum likelihood estimation in the presence of misspecified models, so-called quasi-maximum likelihood (QMLE) estimation. Over this time, much has been written on these and related topics, many contributions being by Hal himself. For example, following Hal’s pure heteroskedasticity robust estimation work, Newey and West (1987) extended robust estimation to autocorrelated data. Extensions and refinements of these themes continue today. There is no econometric package that we know of today that does not have some provision for robust standard errors in most of the estimation methods offered. All of these innovations can be credited to the germinating ideas produced by Hal in his econometric research. Thus, we offer this volume in recognition of the pioneering work that he has done in the past and that has proved to be so wonderfully useful in empirical research. We look forward to seeing Hal’s work continuing well into the future, yielding, we are sure, many more useful econometric techniques that will be robust to misspecifications of the sort we often face in empirical problems in economics and elsewhere. Now let us turn to a brief review of the contents of this volume. In the spirit of White (1982), Baltagi, Bresson and Pirotte in their paper entitled “A Comparative Study of Pure and Pretest Estimators for a Possibly Misspecified Two-way Error Component Model” examine the consequences of model misspecification using a panel data regression model. Maximum likelihood, random and fixed effects estimators are compared using Monte Carlo experiments under normality of the disturbances but with possibly misspecified variance-covariance matrix. In the presence of perfect foresight on the form of the variance-covariance matrix, GLS (maximum likelihood) is always the best in MSE terms. However, in the absence of perfect foresight (the more typical case), the authors show that a pre-test estimator is a viable alternative given that its performance is a close second to correct GLS whether the true specification is a two-way, one-way error component or a pooled regression model. The authors further show that incorrect GLS, ix
x
maximum likelihood, or fixed effects estimators may lead to a big loss in mean square error. In their paper “Tests of Common Deterministic Trend Slopes Applied to Quarterly Global Temperature Data” Fomby and Vogelsang apply the multivariate deterministic trend-testing framework of Franses and Vogelsang (2002) to compare global warming trends both within and across the hemispheres of the globe. They find that globally and within hemispheres the seasons appear not to be warming equally fast. In particular, winters appear to be warming faster than summers. Across hemispheres, it appears that the winters in the northern and southern hemispheres are warming equally fast whereas the remaining seasons appear to have unequal warming rates. In his paper “The Sandwich Estimate of Variance” Hardin examines the history, development, and application of the sandwich estimate of variance. In describing this estimator he pays attention to applications that have appeared in the literature and examines the nature of the problems for which this estimator is used. He also describes various adjustments to the estimate for use with small samples and illustrates the estimator’s construction for a variety of models. In their paper “Test Statistics and Critical Values in Selectivity Models” Hill, Adkins, and Bender examine the finite sample properties of alternative covariance matrix estimators of the Heckman (1979) two-step estimator (Heckit) for the selectivity model so widely used in Economics and other social sciences. The authors find that, in terms of how the alternative versions of asymptotic variancecovariance matrices used in selectivity models capture the finite sample variability of the Heckit two-step estimator, the answer depends on the degree of censoring and on whether the explanatory variables in the selection and regression equation differ or not. With severe censoring and if the explanatory variables in the two equations are identical, then none of the asymptotic standard error formulations is reliable in small samples. In larger samples the bootstrap does a good job in reflecting estimator variability as does a version of the White heteroskedasticity-consistent estimator. With respect to finite sample inference the bootstrap standard errors seem to match the nominal standard errors computed from asymptotic covariance matrices unless censoring is severe and there is not much difference in the explanatory variables in the selection and regression equations. Most importantly the critical values of the pivotal bootstrap t-statistics lead to better test size than those based on usual asymptotic theory. To date the literature on quantile regression and least absolute deviation regression has assumed either explicitly or implicitly that the conditional quantile regression model is correctly specified. In their paper “Estimation, Inference, and Specification Testing for Possibly Misspecified Quantile Regression” Kim and White allow for possible misspecification of a linear conditional quantile
xi
regression model. They obtain consistency of the quantile estimator for certain “pseudo-true” parameter values and asymptotic normality of the quantile estimator when the model is misspecified. In this case, the asymptotic covariance matrix has a novel form, not seen in earlier work, and they provide a consistent estimator of the asymptotic covariance matrix. They also propose a quick and simple test for conditional quantile misspecification based on the quantile residuals. Miller, Eales, and Preckel propose in their paper “Quasi-Maximum Likelihood Estimation with Bounded Symmetric Errors” a QMLE estimator for the location parameters of a linear regression model with bounded and symmetrically distributed errors. The errors outcomes are restated as the convex combination of the bounds, and they use the method of maximum entropy to derive the quasi-log likelihood function. Under the stated model assumptions, they show that the proposed estimator is unbiased, consistent, and asymptotically normal. Miller, Eales, and Preckel then conduct a series of Monte Carlo exercises designed to illustrate the sampling properties of QMLE to the least squares estimator. Although the least squares estimator has smaller quadratic risk under normal and skewed error processes, the proposed QML estimator dominates least squares for the bounded and symmetric error distribution considered in their paper. In their paper “Consistent Quasi-Maximum Likelihood Estimation with Limited Information” Miller and Lee use the minimum cross-entropy method to derive an approximate joint probability model for a multivariate economic process based on limited information about the marginal quasi-density functions and the joint moment conditions. The modeling approach is related to joint probability models derived from copula functions. They note, however, that the entropy approach has some practical advantages over copula-based models. Under suitable regularity conditions, the authors show that the quasi-maximum likelihood estimator (QMLE) of the model parameters is consistent and asymptotically normal. They demonstrate the procedure with an application to the joint probability model of trading volume and price variability for the Chicago Board of Trade soybean futures contract. There is growing evidence in the financial economics literature that the response of current volatility in financial data to past shocks is asymmetric with negative shocks having more impact on current volatility than positive shocks. In their paper “An Examination of the Sign and Volatility Switching ARCH Models Under Alternative Distributional Assumptions” Omran and Avram investigate the asymmetric ARCH models of Glosten et al. (1993) and Fornari and Mele (1997) and the sensitivity of their models to the assumption of normality in the innovations. Omran and Avram hedge against the possibility of misspecification by basing the inferences on the robust variance-covariance matrix suggested by White (1982). Their results
xii
suggest that using more flexible distributional assumptions on financial data can have a significant impact on the inferences drawn from asymmetric ARCH models. Gourieroux et al. (1984) investigate the consistency of the parameters in the conditional mean, ignoring or misspecifying other features of the true conditional density. They show that it suffices to have a QMLE of a density from the linear exponential family (LEF). Conversely, a necessary condition for a QMLE being consistent for the parameters in the conditional mean is that the likelihood function belongs to the LEF. As a natural extension in Chapter 5 of his book, White (1994) shows that the Gourieroux et al. (1984) results carry over to dynamic models with possibly serially correlated and/or heteroskedastic errors. In his paper “Estimating a Linear Exponential Density when the Weighting Matrix and Mean Parameter Vector are Functionally Related” Sin shows that the above results do not hold when the weighting matrix of the density and the mean parameter vector are functionally related. A prominent example is an autoregressive moving-average (ARMA) model with generalized autoregressive conditional heteroscedasticity (GARCH) error. However, correct specification of the conditional variance adds conditional moment conditions for estimating the parameters of the conditional mean. Based on the recent literature of efficient instrumental variables estimator (IVE) or generalized method of moments (GMM), the author proposes an estimator that is based on the QMLE of a density from the quadratic exponential family (QEF). The asymptotic variance of this modified QMLE attains the lower bound for minimax risk. In this modeling approach the GARCH-M is also allowed. In his paper “Testing in GMM Models Without Truncation” Vogelsang proposes a new approach to testing in the generalized method of moments (GMM) framework. The new tests are constructed using heteroskedasticity autocorrelation (HAC) robust standard errors computed using nonparametric spectral density estimators without truncation. While such standard errors are not consistent, a new asymptotic theory shows that they lead to valid tests nonetheless. In an over-identified linear instrumental variables model, simulations suggest that the new tests and the associated limiting distribution theory provide a more accurate first order asymptotic null approximation than both standard nonparametric HAC robust tests and VAR-based parametric HAC robust tests. Finite sample power of the new tests is shown to be comparable to standard tests. In applied work, economists analyze individuals or firms that differ in observed and unobserved ways. These unobserved differences are usually referred to as heterogeneity and one can control for the heterogeneity in panel data by allowing for time-invariant, individual-specific parameters. This fixed effect approach introduces many parameters into the model that causes the “incidental parameter problem”: the maximum likelihood estimator is in general inconsistent. Woutersen (2001) shows how to approximately separate the parameters of interest from
xiii
the fixed effects using a reparameterization. He then shows how a Bayesian method gives a general solution to the incidental parameter for correctly specified models. In his paper in this volume “Bayesian Analysis of Misspecified Models with Fixed Effects” Woutersen extends his 2001 work to misspecified models. Following White (1982) he assumes that the expectation of the score of the integrated likelihood is zero at the true values of the parameters. He then derives √ the conditions under which a Bayesian estimator converges at the rate of N, where N is the number of individuals. Under these conditions, Woutersen shows that the variance-covariance matrix of the Bayesian estimator has the form of White (1982). He goes on to illustrate the approach by analyzing the dynamic linear model with fixed effects and a duration model with fixed effects. Thomas B. Fomby and R. Carter Hill Co-editors
REFERENCES Fornari, F., & Mele, A. (1997). Sign- and volatility-switching ARCH models: Theory and applications to international stock markets. Journal of Applied Econometrics, 12, 49–65. Franses, P. H., & Vogelsang, T. J. (2002). Testing for common deterministic trend slopes, Center for Analytic Economics Working Paper 01–15, Cornell University. Glosten, L. R., Jagannathan, R., & Runkle, D. (1993). On the relationship between expected value and the volatility of nominal excess returns on stocks. Journal of Finance, 43, 1779–1801. Gourieroux, C., Monfort, A., & Trognon, A. (1984). Pseudo-maximum likelihood methods: Theory. Econometrica, 52, 681–700. Heckman, J. J. (1979). Sample selection bias as a specification error. Econometrica, 47, 153–161. Newey, W., & West, K. (1987). A simple positive semi-definite heteroskedasticity and autocorrelation consistent covariance matrix. Econometrica, 55, 703–708. White, H. (1980). A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica, 48, 817–838. White, H. (1982). Maximum likelihood estimation of misspecified models. Econometrica, 50, 1–25. White, H. (1994). Estimation, inference and specification analysis. Econometric Society Monograph No. 22. Cambridge, UK: Cambridge University Press. Woutersen, T. M. (2001). Robustness against incidental parameters and mixing distributions, Working Paper, Department of Economics, University of Western Ontario.
A COMPARATIVE STUDY OF PURE AND PRETEST ESTIMATORS FOR A POSSIBLY MISSPECIFIED TWO-WAY ERROR COMPONENT MODEL Badi H. Baltagi, Georges Bresson and Alain Pirotte ABSTRACT In the spirit of White’s (1982) paper, this paper examines the consequences of model misspecification using a panel data regression model. Maximum likelihood, random and fixed effects estimators are compared using Monte Carlo experiments under normality of the disturbances but with a possibly misspecified variance-covariance matrix. We show that the correct GLS (ML) procedure is always the best according to MSE performance, but the researcher does not have perfect foresight on the true form of the variance covariance matrix. In this case, we show that a pretest estimator is a viable alternative given that its performance is a close second to correct GLS (ML) whether the true specification is a two-way, a one-way error component model or a pooled regression model. Incorrect GLS, ML or fixed effects estimators may lead to a big loss in MSE. A fundamental assumption underlying classical results on the properties of the maximum likelihood estimator . . . is that the stochastic law which determines the behavior of the phenomena investigated (the “true” structure) is known to lie within a specified parametric family of probability distributions (the model). In other words, the probability model is Maximum Likelihood Estimation of Misspecified Models: Twenty Years Later Advances in Econometrics, Volume 17, 1–27 Copyright © 2003 by Elsevier Ltd. All rights of reproduction in any form reserved ISSN: 0731-9053/doi:10.1016/S0731-9053(03)17001-6
1
2
BADI H. BALTAGI, GEORGES BRESSON AND ALAIN PIROTTE assumed to be “correctly specified”. In many (if not most) circumstances, one may not have complete confidence that this is so. [e.g. White, 1982, p. 1]
1. INTRODUCTION Due to the non-experimental nature of econometrics, researchers use the same data set to select the model and to estimate the parameters in the selected model. Often, we employ a preliminary test estimator (or pretest estimator for short) whenever we test some aspect of a model’s specification and then decide, on the basis of the test results, what version of the model to estimate or what estimation method to use. Unfortunately, the statistical properties of pretest estimators are, in practice, very difficult to derive. The literature on pretest estimators is well surveyed in Judge and Bock (1978, 1983) and in the special issue of the Journal of Econometrics (1984) edited by Judge. More recently, asymptotic aspects have been considered and different selection strategies (especially general-to-specific and specific-to-general) have been discussed. For a summary of the latest developments, see Giles and Giles (1993) and Magnus (1999). In the panel data literature, few pretest studies have been conducted. These include Ziemer and Wetzstein (1983) on the pooling problem and Baltagi and Li (1997) on the estimation of error component models with autocorrelated disturbances. The Baltagi and Li (1997) Monte-Carlo study compares the finite sample performance of a number of pure and pretest estimators for an error component model with first-order AR or MA remainder disturbances. They show that the correct GLS procedure is always the best but the researcher does not have perfect foresight on which one it is (GLS assuming random error component with the remainder term following an AR(1) or MA(1) process). In that case, Baltagi and Li show that the pretest estimator is a viable alternative given that its performance is a close second to correct GLS whether the true serial correlation process is AR(1) or MA(1). It is the aim of this paper to study the small sample performance of pure and pretest estimators in a panel data regression model when the two-way error component structure for the disturbances may be misspecified. More specifically, this study performs Monte-Carlo experiments to compare the properties of 11 alternative estimators when the true model may be a two-way error component model with both individual and time effects, a one-way error component model with only time or individual effects, or simply a pooled regression model with no time or individual effects. The estimators considered are: Ordinary Least Squares (OLS), Fixed effects (Within), Feasible Generalized Least Squares (FGLS) and Maximum Likelihood (ML) assuming normality of the disturbances. The only
A Comparative Study of Pure and Pretest Estimators
3
type of misspecification considered is where one or both variance components are actually equal to zero. The pretest estimator is based on the results of two tests. The first test is the Kuhn-Tucker test suggested by Gouri´eroux, Holly and Monfort (1982) which tests whether both random effects are zero versus the alternative that at least one of them is positive. If the null hypothesis that both time and individual effects are jointly zero is not rejected, the pretest estimator reduces to OLS. If it is rejected, a second test proposed by Baltagi, Chang and Li (1992) is implemented. This is a conditional LM test for whether one of the variance components is zero given that the other variance component is positive. Either hypothesis can be tested first, the order does not matter. If both hypotheses are rejected, the pretest estimator reduces to the two-way FGLS estimator. If one of these hypotheses is rejected while the other is not, the pretest estimator reduces to a one-way FGLS estimator. Of course, if both hypotheses are not rejected, the pretest estimator reduces to the OLS estimator. This is described in the flow chart given below, see Fig. 1. The
Fig. 1. Flow Chart for the Pretest Estimator. Note: GHM: Gouri´eroux, Holly and Monfort test. BCL: Baltagi, Chang and Li test. Relative MSE = MSE(estimator)/MSE(True GLS).
4
BADI H. BALTAGI, GEORGES BRESSON AND ALAIN PIROTTE
SAS computer code underlying the pretest estimator in the flow chart is given in the Appendix. Using Monte Carlo experiments, we compare the performance of this pretest estimator as well as the standard one-way and two-way error component estimators using the relative mean squared error (MSE) criterion. The basis for comparison is the MSE of the true GLS estimator which is based on the true variance components. In fact, the relative MSE of each estimator is obtained by dividing its MSE by that of true GLS. Section 2 describes the model and the pretest estimator. Section 3 presents the Monte-Carlo design and the results of experiments. Section 4 provides our conclusion.
2. PURE AND PRETEST ESTIMATORS FOR A TWO-WAY ERROR COMPONENT MODEL Consider the two-way error component model written in matrix notation: y = ␥NT + X + u
(1)
where y is an NT × 1 vector denoting the dependent variable y i,t stacked such that the slower index is i = 1, 2, . . ., N, and the faster index is t = 1, 2, . . ., T. ␥ is a scalar, NT is a vector of ones of dimension NT × 1, X is an NT × k matrix of independent variables x j,i,t , with j = 1, 2, . . ., k. The disturbances follow a two-way error component model u = Z + Z +
(2)
with Z = I N ⊗ T and Z = N ⊗ I T . I N and I T are identity matrices of dimension N ×N and T × T. N and T are vectors of ones of dimension N × 1 and T × 1. The variance-covariance matrix of u is given by = E[uu ] = 2u [(I N ⊗ J T ) + (J N ⊗ I T ) + (1 − − )I NT ]
(3)
where J T = T T , J N = N N , 2u = 2 + 2 + 2 , = 2 /2u and = 2 /2u , see Baltagi (2001). The GLS estimator of  is given by ˆ TGLS = (21 B i,xx + 22 B t,xx + W it,xx )−1 (21 B i,xy + 22 B t,xy + W it,xy ) where 21 =
2 , T2 + 2
22 =
2 N2 + 2
(4)
A Comparative Study of Pure and Pretest Estimators
5
JT JN ⊗ X IN − B i,xx = X N T JT JN B t,xx = X ⊗ IT − X N T JN JT W it,xx = X IN − ⊗ IT − X N T
with B denoting the Between variation and W denoting the Within variation. We compute the MSE resulting from blind estimation of (i) a two-way error component (TWEC) model, (ii) a one-way individual error component (OWIEC) model, (iii) a one-way time error component (OWTEC) model or (iv) a pooled regression model with no individual or time effects. Note that if both variance components are positive, i.e. 2 > 0 and 2 > 0, estimating this TWEC model by OLS or assuming it is a OWEC model yields to possible loss in efficiency. This loss will depend on the size of the panel, the magnitude of the variance components and the Between and Within variation in X. Based on the sequence of hypotheses tests described above on the variance components, the pretest estimator is either OLS, the OWEC (individual or time) FGLS, or the TWEC estimator, see the flow chart given in Fig. 1. This pretest estimator is based on two Lagrange Multiplier (LM) tests. The first one is based on modifying the Breusch and Pagan (1980) joint LM test for the null hypothesis that both the individual and time variance components are zero (see Baltagi, 2001): H 0,A :
2 = 0
and
2 = 0
(5)
This is done using the Kuhn-Tucker test suggested by Gouri´eroux, Holly and Monfort (1982) allowing for the fact that the alternative hypothesis is one-sided given that variances cannot be negative: 2 A + B2 A2 2m = B2 0
if A > 0, B > 0 if A > 0, B ≤ 0 if A ≤ 0, B > 0 if A ≤ 0, B ≤ 0
where 2m denotes the mixed 2 distribution and A=
NT u˜ (I N ⊗ J T )˜u −1 2(T − 1) u˜ u˜
6
BADI H. BALTAGI, GEORGES BRESSON AND ALAIN PIROTTE
and
B=
u˜ (J N ⊗ I T )˜u NT −1 2(N − 1) u˜ u˜
and u˜ denote the OLS residuals. Under the null hypothesis:
2m ∼ 41 2 (0) + 21 2 (1) + 41 2 (2) If we do not reject the null hypothesis, the pretest estimator is the OLS estimator. If we reject H 0,A , we compute two conditional LM tests proposed by Baltagi, Chang and Li (1992). These test the following two null hypotheses with the order being immaterial: H 0,B :
2 = 0
given that
2 > 0
(6)
H 0,C :
2 = 0
given that
2 > 0
(7)
and
The corresponding LM test for testing H 0,B : 2 = 0 (assuming 2 > 0) is given by: √ 2 2 2˜ 2 ˜ ˜ LM = D T (T − 1)[˜ 4 + (N − 1)˜ 42 ] where
u˜ ((J N /N) ⊗ (J T /T))˜u −1 ˜ 22 N − 1 u˜ ((I N − J N /N) ⊗ (J T /T))˜u + −1 ˜ 2 (N − 1)˜ 2
˜ = T D 2
1 ˜ 22
with ˜ 22 = u˜ ((J N /N) ⊗ I T )˜u/T and ˜ 2 = u˜ ((I N − (J N /N)) ⊗ I T )˜u/T(N − 1). The estimated disturbances u˜ denote the one-way time effects GLS residuals using the maximum likelihood estimates ˜ 22 and ˜ 2 . Similarly, the alternative LM test statistics for testing H 0,C : 2 = 0 (assuming 2 > 0) can be obtained as follows: √ 2 2 2˜ 1 ˜ ˜ D LM = N(N − 1)[˜ 4 + (T − 1)˜ 41 ]
A Comparative Study of Pure and Pretest Estimators
where
7
u˜ ((J N /N) ⊗ (J T /T))˜u −1 ˜ 21 T − 1 u˜ ((J N /N) ⊗ (I T − (J T /T)))˜u + − 1 ˜ 2 (T − 1)˜ 2
˜ = N D 2
1 ˜ 21
with ˜ 21 = u˜ (I N ⊗ (J T /T))˜u/N and ˜ 2 = u˜ (I N ⊗ (I T − (J T /T)))˜u/N(T − 1). The estimated disturbances u˜ denote the one-way individual effects GLS residuals using the maximum likelihood estimates ˜ 21 and ˜ 2 . If both hypotheses H 0,B and H 0,C are rejected, the pretest estimator is the TWEC FGLS estimator. If we reject H 0,C but we do not reject H 0,B , the pretest estimator is the OWEC time FGLS estimator. Similarly, if we reject H 0,B but we do not reject H 0,C , the pretest estimator is the OWEC individual FGLS estimator. If both hypotheses H 0,B and H 0,C are not rejected, the pretest estimator is OLS. Hence, if both H0,B and H0,C are not rejected ˆ OLS ˆ OWT-FGLS if H0,B is not rejected, while H0,C is rejected ˆ pre = ˆ OWI-FGLS if H0,C is not rejected, while H0,B is rejected ˆ TW-FGLS if both H0,B and H0,C are rejected This pretest estimator is compared with the pure one-way and two-way estimators using Monte Carlo experiments.
3. THE MONTE CARLO RESULTS First, we describe the Monte Carlo design. We use the following simple regression model: y i,t = ␥ + x i,t + u i,t
i = 1, . . . , N
and
t = 1, . . . , T
(8)
with u i,t = i + t + i,t
(9)
Throughout the experiment1 ␥ = 5,  = 0.5 and 2 = 20. The latter means that the total variance of the disturbances is fixed at 20 for all experiments. We consider three values for the number of individuals in the panel (N = 25, 50 and 500); two values for the time dimension (T = 10 and 20). The exogenous variable is generated by choosing a random variable i,t , uniformly distributed on the
8
BADI H. BALTAGI, GEORGES BRESSON AND ALAIN PIROTTE
interval [−5, 5] and forming: x i,t = ␦1 x i,t−1 + i,t ,
␦1 = 0.5
For each cross-sectional unit T + 10 observations are generated starting with x i,0 = 0. The first ten observations are then dropped in order to reduce the dependency on initial values. The parameters and are varied over the set (0, 0.01, 0.2, 0.4, 0.6, 0.8) such that (1 − − ) is always positive. For each experiment, 5,000 replications were performed. For every replication, (NT + N + T) IIN(0, 1) random numbers were generated. The first N numbers were used to generate the i ’s as IIN(0, 2 ). The second T numbers were used to generate the t ’s as IIN(0, 2 ), and the last NT numbers were used to generate the i,t ’s as IIN(0, 2 ). Next, the u i,t ’s were formed from (9) and the y’s were calculated from (8). Twenty-six experiments were performed for each pair of values of N and T. This means that a total of 156 designs were run, and for each design, 11 estimators were computed 5,000 times.
3.1. Results of the LM Tests The Kuhn-Tucker test of Gouri´eroux, Holly and Monfort (GHM) performs well in testing the null of H 0,A : 2 = 2 = 0. When one of the individual or time variance components is more than 1% of the total variance, this test has high power rejecting the null in over 98% of the cases for T = 10 and N = 25. In fact, this power becomes almost 100% when T = 20 and/or N = 50, 500. The power performance improves as T increases for fixed N or as N increases for a fixed T. Also, the power of this test increases as the other variance component increases. For example, for (N, T) = (25, 10) and for ( = 0.01 and = 0, 0.01, 0.2, 0.4 and 0.6), the rate for rejection of the null increases very quickly from 7% to 12.7% to 97.9% to 99.9% to 100%. When both variances components are zero, the size of the test is around 5% for all values of N and T. In fact the frequency of type I error is 4.8%, 5.1% for N = 25 and T = (10, 20) and 4.4%, 5.5% for N = 50 and T = (10, 20) and 5.4%, 5.1% for N = 500 and T = (10, 20). The conditional LM test of Baltagi, Chang and Li (BCL) for testing H 0,B : 2 = 0 implicitly assumes that 2 > 0. Conversely, the other conditional LM test of BCL for testing H 0,C : 2 = 0 implicitly assumes that 2 > 0. These two conditional LM tests perform well. When = 0, and if 2 represents more than 1% of the total variance, the H 0,B test has high power rejecting the null in over 99.9% of the cases when N = 25 and T = 10. Similarly, when = 0, and if 2 represents more than 1% of the total variance, the H 0,C test has also high power rejecting the null in
A Comparative Study of Pure and Pretest Estimators
9
more than 99.9% of the cases when N = 25 and T = 10. This power performance improves as T increases for fixed N or as N increases for a fixed T. Finally, when both variance components are higher than 20% of the total variance, the non rejection rate for the TWEC estimator is more than 99.3% for N = 25 and T = 10 and increases to 100% for the other values of N and T considered. Using the flow chart given above, the pretest estimator is determined for each replication depending on the outcome of these tests. For 5,000 replications and (N, [T]) = (25, [10, 20]), (50, [10, 20]), (500, [10, 20]), this choice of the pretest estimator is given by Tables 1–3. For example, for N = 25 and T = 10, and = = 0.4, the pretest estimator is identical to the two-way FGLS estimator for all 5,000 replications. If = 0.01, and = 0.8, the pretest estimator is a two-way FGLS estimator in 2,259 replications and a one-way time effects FGLS estimator in the remaining 2,741 replications. We checked the sensitivity of our pretest estimator to the level of significance used by increasing it from 5 to 10%. The results are given in Table 1. For example, for N = 25 and T = 10 and = = 0.4, the 10% pretest estimator is still identical to the two-way FGLS estimator for all 5,000 replications. If = 0.01 and = 0.8, the 10% pretest estimator is a two-way FGLS estimator in 2,754 replications and a one-way time effects FGLS estimator in the remaining 2,246 replications. This is an improvement over the 5% pretest estimator in that we are selecting the right estimator more often.
3.2. Performance of the Estimators Now let us turn to the relative MSE comparisons of pure and pretest estimators for (N, [T]) = (25, [10, 20]), (50, [10, 20]) and (500, [10, 20]). Tables 4–6 report our findings and Figs 2–4 plot some of these results based on 5,000 replications. From these tables and figures, we observe the following: (1) When the true model is a pooled regression with no individual or time effects, i.e. = = 0, the two-way fixed effects estimator (Within) performs the worst. Its relative MSE with respect to true GLS, which in this case is OLS, yields 1.456 for (N = 25, T = 10) and 1.264 for (N = 25, T = 20). The Within estimator wipes out the Between variation whereas the OLS estimator weights both the Between and Within variation equally. When the Between variation is important, this can lead to considerable loss in efficiency. This performance improves as the variance components increase. The one-way fixed effects estimators perform better than the two-way Within estimator yielding a relative MSE of 1.041 and 1.384 for (N = 25, T = 10) and 1.056 and 1.190 for
10
Table 1. Number of Non-Rejections of H 0,A , H 0,B and H 0,C for 5,000 Replications N = 25, T = 10 and T = 20. Pretest GHM H 0,A T = 10
BCL OLS
T = 20
T = 10
BCL TIME
T = 20
T = 10
BCL INDIV
T = 20
T = 10
BCL TW
T = 20
T = 10
T = 20
5%
10%
5%
10%
5%
10%
5%
10%
5%
10%
5%
10%
5%
10%
5%
10%
5%
10%
5%
10%
0 0 0 0 0 0
0 0.01 0.2 0.4 0.6 0.8
4758 4648 109 0 0 0
4579 4411 62 0 0 0
4747 4375 2 0 0 0
4571 4068 1 0 0 0
6 18 18 2 0 4
19 16 12 2 0 3
0 4 0 0 0 0
1 1 0 0 0 0
116 101 4 0 0 0
174 156 4 0 0 0
117 117 0 0 0 0
189 182 0 0 0 0
102 203 4601 4691 4685 4675
191 354 4481 4491 4465 4486
112 452 4683 4676 4652 4708
191 628 4487 4447 4443 4481
18 30 268 307 315 321
37 63 441 507 535 511
24 52 315 324 348 292
48 121 512 553 557 519
0.01 0.01 0.01 0.01 0.01 0.01
0 0.01 0.2 0.4 0.6 0.8
4479 4366 88 0 0 0
4223 4069 58 0 0 0
4296 3958 0 0 0 0
3961 3532 0 0 0 0
14 9 3 0 0 0
8 16 4 0 0 0
3 1 0 0 0 0
3 0 0 0 0 0
377 341 4 0 0 0
519 460 4 0 0 0
563 457 0 0 0 0
760 587 0 0 0 0
101 200 3983 3818 3219 1841
174 269 3655 3411 2779 1490
84 421 3701 3201 2453 766
141 550 3256 2727 1962 556
29 84 922 1182 1781 3159
76 186 1279 1589 2221 3510
54 163 1299 1799 2547 4234
135 331 1744 2273 3038 4444
0.2 0.2 0.2 0.2 0.2
0 0.01 0.2 0.4 0.6
135 106 0 0 0
90 68 0 0 0
1 1 0 0 0
0 0 0 0 0
7 1 0 0 0
5 1 0 0 0
0 0 0 0 0
0 0 0 0 0
4596 4310 12 0 0
4436 4046 8 0 0
4714 3901 0 0 0
4499 3438 0 0 0
5 3 24 4 0
4 5 21 2 0
0 0 0 0 0
0 0 0 0 0
257 580 4964 4996 5000
465 880 4971 4998 5000
285 1098 5000 5000 5000
501 1562 5000 5000 5000
0.4 0.4 0.4 0.4
0 0.01 0.2 0.4
4 4 0 0
1 3 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
4721 4211 0 0
4524 3840 0 0
4716 3519 0 0
4520 3003 0 0
0 0 2 0
0 0 1 0
0 0 0 0
0 0 0 0
275 785 4998 5000
475 1157 4999 5000
284 1481 5000 5000
480 1997 5000 5000
0.6 0.6 0.6
0 0.01 0.2
0 1 0
0 1 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
0 0 0
4726 3905 0
4526 3442 0
4727 2640 0
4514 2109 0
0 0 0
0 0 0
0 0 0
0 0 0
274 1094 5000
474 1557 5000
273 2360 5000
486 2891 5000
0.8 0.8
0 0.01
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
4683 2741
4477 2246
4708 938
4498 659
0 0
0 0
0 0
0 0
317 2259
523 2754
292 4062
502 4341
GHM H 0,A : Gouri´eroux, Holly and Monfort test (number of non-rejections). If GHM H 0,A is rejected then BCL tests: BCL OLS : both H 0,B and H 0,C are not rejected; BCL TIME : H 0,B is not rejected while H 0,C is rejected BCL INDIV : H 0,C is not rejected while H 0,B is rejected; BCL TW : both H 0,B and H 0,C are rejected.
BADI H. BALTAGI, GEORGES BRESSON AND ALAIN PIROTTE
A Comparative Study of Pure and Pretest Estimators
11
Table 2. Number of Non-Rejections of H 0,A , H 0,B and H 0,C for 5,000 Replications N = 50, T = 10 and T = 20. Pretest GHM H 0,A
BCL OLS
BCL TIME
BCL INDIV
BCL TW
T = 10
T = 20
T = 10
T = 20
T = 10
T = 20
T = 10
T = 20
T = 10
T = 20
0 0 0 0 0 0
0 0.01 0.2 0.4 0.6 0.8
4782 4529 2 0 0 0
4726 4086 0 0 0 0
0 7 0 0 0 0
1 3 0 0 0 0
110 105 0 0 0 0
139 99 0 0 0 0
91 316 4711 4693 4687 4663
109 741 4695 4685 4703 4705
17 43 287 307 313 337
25 71 305 315 297 295
0.01 0.01 0.01 0.01 0.01 0.01
0 0.01 0.2 0.4 0.6 0.8
4013 3816 0 0 0 0
3424 2726 0 0 0 0
3 1 0 0 0 0
3 3 0 0 0 0
821 749 0 0 0 0
1369 1153 0 0 0 0
90 253 3325 2820 1871 658
80 567 2447 1688 732 66
73 181 1675 2180 3129 4342
124 551 2553 3312 4268 4934
0.2 0.2 0.2 0.2 0.2
0 0.01 0.2 0.4 0.6
7 18 0 0 0
0 0 0 0 0
0 0 0 0 0
0 0 0 0 0
4721 4197 0 0 0
4712 3335 0 0 0
0 0 0 1 0
0 0 0 0 0
272 785 5000 4999 5000
288 1665 5000 5000 5000
0.4 0.4 0.4 0.4
0 0.01 0.2 0.4
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
4725 4005 0 0
4697 2688 0 0
0 0 0 0
0 0 0 0
275 995 5000 5000
303 2312 5000 5000
0.6 0.6 0.6
0 0.01 0.2
0 0 0
0 0 0
0 0 0
0 0 0
4726 3399 0
4705 1610 0
0 0 0
0 0 0
274 1601 5000
295 3390 5000
0.8 0.8
0 0.01
0 0
0 0
0 0
0 0
4713 1610
4684 161
0 0
0 0
287 3390
316 4839
(N = 25, T = 20). Two-way FGLS is slightly worse than OLS yielding a relative MSE of 1.007 for (N = 25, T = 10) and 1.010 for (N = 25, T = 20). One-way FGLS performs better than two-way FGLS yielding a relative MSE of 1.000 and 1.005 for (N = 25, T = 10) and 1.002 and 1.005 for (N = 25, T = 20). The ML estimators perform well yielding a relative MSE that is no more than 1.004 for (N = 25, T = 10), while the 5 and 10% pretest estimator yield a relative MSE no more than 1.003 for (N = 25, T = 10) and no more than 1.002 for (N = 25, T = 20). (2) When the true specification is a one-way individual error component model, OWIEC ( = 0), the two-way Within estimator continues to perform badly relative to true GLS yielding a relative MSE of 1.066 for = 0.8 and N = 25,
12
BADI H. BALTAGI, GEORGES BRESSON AND ALAIN PIROTTE
Table 3. Number of Non-Rejections of H 0,A , H 0,B and H 0,C for 5,000 Replications N = 500, T = 10 and T = 20. Pretest GHM H 0,A
BCL OLS
BCL TIME
BCL INDIV
BCL TW
T = 10
T = 20
T = 10
T = 20
T = 10
T = 20
T = 10
T = 20
T = 10
T = 20
0 0 0 0 0 0
0 0.01 0.2 0.4 0.6 0.8
4729 3425 0 0 0 0
4743 923 0 0 0 0
1 7 0 0 0 0
1 0 0 0 0 0
152 85 0 0 0 0
128 14 0 0 0 0
103 1384 4676 4683 4692 4653
111 3865 4712 4688 4698 4710
15 99 324 317 308 347
17 198 288 312 302 290
0.01 0.01 0.01 0.01 0.01 0.01
0 0.01 0.2 0.4 0.6 0.8
198 109 0 0 0 0
2 0 0 0 0 0
2 2 0 0 0 0
0 0 0 0 0 0
4549 2643 0 0 0 0
4753 530 0 0 0 0
6 50 64 21 7 1
1 0 2 1 0 0
245 2196 4936 4979 4993 4999
244 4470 4998 4999 5000 5000
0.2 0.2 0.2 0.2 0.2
0 0.01 0.2 0.4 0.6
0 0 0 0 0
0 0 0 0 0
0 0 0 0 0
0 0 0 0 0
4762 2171 0 0 0
4746 138 0 0 0
0 0 0 0 0
0 0 0 0 0
238 2829 5000 5000 5000
254 4862 5000 5000 5000
0.4 0.4 0.4 0.4
0 0.01 0.2 0.4
0 0 0 0
0 0 0 0
0 0 0 0
0 0 0 0
4773 1068 0 0
4738 14 0 0
0 0 0 0
0 0 0 0
227 3932 5000 5000
262 4986 5000 5000
0.6 0.6 0.6
0 0.01 0.2
0 0 0
0 0 0
0 0 0
0 0 0
4759 169 0
4761 0 0
0 0 0
0 0 0
241 4831 5000
239 5000 5000
0.8 0.8
0 0.01
0 0
0 0
0 0
0 0
4720 0
4745 0
0 0
0 0
280 5000
255 5000
T = 10 (see Table 4). The corresponding relative MSE for OLS is 9.090. The correct one-way fixed effects estimator has a relative MSE of 1.007 while the wrong one-way fixed effects estimator has a relative MSE of 9.772. These results are quite stable as N increases from 25 to 50 to 500. The two-way FGLS estimator yields a relative MSE of 1.004 for = 0.8, while the correct one-way FGLS estimator yields a relative MSE of 1.002. The wrong one-way FGLS yields a relative MSE of 9.090. The performance of two-way ML is similar to that of FGLS yielding a relative MSE of 1.003. This is compared to 1.002 for the correct one-way ML and 9.093 for the wrong one-way ML estimator. The pretest estimator yields a relative MSE of 1.007 for the 5% level
Table 4. Relative MSE of  with Respect to True GLS for 5,000 Replications N = 25, T = 10 and T = 20. Two-Way Error Component OLS
Within
FGLS
One-Way Time Error Component ML
Within
FGLS
One-Way Individual Error Component
ML
Within
FGLS
ML
0 0 0 0 0 0
0 0.01 0.2 0.4 0.6 0.8
1.000 1.000 1.003 1.005 1.405 1.553 2.138 2.617 3.763 4.852 9.090 11.161
1.456 1.440 1.180 1.119 1.087 1.066
1.264 1.215 1.104 1.080 1.073 1.065
1.007 1.017 1.016 1.009 1.003 1.004
1.010 1.009 1.006 1.003 1.006 1.002
1.003 1.011 1.017 1.008 1.003 1.003
1.006 1.007 1.006 1.003 1.006 1.001
1.041 1.056 1.050 1.059 1.488 1.672 2.273 2.860 4.022 5.320 9.772 12.275
1.000 1.002 1.007 1.008 1.409 1.556 2.142 2.619 3.763 4.852 9.090 11.161
1.000 1.002 1.006 1.008 1.409 1.556 2.142 2.619 3.764 4.854 9.093 11.166
1.384 1.353 1.104 1.062 1.028 1.007
1.190 1.143 1.031 1.014 1.005 1.001
1.005 1.010 1.011 1.004 1.000 1.002
1.005 1.004 1.002 1.001 1.001 1.000
1.004 1.007 1.013 1.004 1.000 1.002
1.004 1.004 1.003 1.001 1.002 1.000
0.01 0.01 0.01 0.01 0.01 0.01
0 0.01 0.2 0.4 0.6 0.8
1.002 1.001 1.001 1.006 1.354 1.571 2.156 2.625 3.890 4.772 9.430 11.051
1.501 1.463 1.155 1.102 1.058 1.029
1.257 1.225 1.073 1.060 1.046 1.024
1.017 1.014 1.012 1.011 1.004 1.007
1.010 1.009 1.005 1.001 1.005 1.003
1.011 1.010 1.013 1.011 1.005 1.009
1.007 1.034 1.042 1.007 1.042 1.045 1.006 1.412 1.673 1.001 2.296 2.852 1.006 4.149 5.223 1.004 10.127 12.102
1.002 1.002 1.004 1.005 1.361 1.579 2.166 2.634 3.897 4.780 9.437 11.052
1.002 1.002 1.004 1.005 1.361 1.579 2.165 2.633 3.897 4.781 9.440 11.056
1.434 1.391 1.108 1.061 1.030 1.056
1.205 1.172 1.031 1.025 1.014 1.045
1.013 1.008 1.011 1.009 1.012 1.045
1.007 1.008 1.007 1.007 1.011 1.044
1.010 1.007 1.013 1.010 1.012 1.045
0.2 0.2 0.2 0.2 0.2
0 0.01 0.2 0.4 0.6
1.183 1.181 1.725 2.927 7.169
1.252 1.260 2.056 3.799 9.422
1.427 1.403 1.110 1.050 1.020
1.211 1.162 1.038 1.017 1.006
1.015 1.011 1.007 1.003 1.002
1.006 1.009 1.001 1.002 1.000
1.011 1.008 1.008 1.004 1.002
1.005 1.009 1.001 1.002 1.000
1.005 1.010 1.562 2.771 7.114
1.007 1.013 1.827 3.535 9.160
1.003 1.005 1.552 2.747 7.033
1.000 1.008 1.811 3.502 9.050
1.003 1.005 1.552 2.747 7.033
1.000 1.008 1.811 3.502 9.049
1.789 1.737 1.563 1.614 2.168
1.553 1.513 1.429 1.650 2.299
1.192 1.189 1.368 1.522 2.092
1.256 1.270 1.390 1.631 2.289
0.4 0.4 0.4 0.4
0 0.01 0.2 0.4
1.543 1.598 2.480 6.084
1.702 1.753 3.157 7.878
1.471 1.346 1.063 1.029
1.196 1.142 1.016 1.008
1.016 1.007 1.006 1.003
1.005 1.008 1.004 1.000
1.011 1.006 1.007 1.003
1.004 1.009 1.004 1.000
1.002 1.010 1.914 5.029
1.005 1.017 2.257 6.315
1.000 1.011 1.908 5.019
1.000 1.015 2.254 6.294
1.000 1.011 1.908 5.019
1.000 1.015 2.254 6.294
2.555 2.525 2.360 3.668
2.171 2.161 2.363 3.745
1.546 1.603 2.051 3.421
0.6 0 2.354 0.6 0.01 2.360 0.6 0.2 4.775
2.718 1.457 2.716 1.373 6.168 1.041
1.180 1.123 1.012
1.015 1.011 1.005
1.005 1.006 1.000
1.010 1.009 1.005
1.005 1.007 1.000
1.001 1.009 2.934
1.001 1.001 1.030 1.009 3.531 2.932
1.001 1.001 1.029 1.009 3.526 2.932
1.001 4.107 1.029 4.065 3.525 4.867
3.585 3.446 4.973
0.8 0 4.492 0.8 0.01 4.444
5.679 1.443 5.278 1.292
1.191 1.094
1.013 1.012
1.007 1.004
1.005 1.009
1.005 1.007
1.001 1.039
1.000 0.999 1.069 1.038
1.000 0.999 1.068 1.038
1.000 8.266 1.068 8.047
7.692 7.016
Pretest T = 10
T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 5%
T = 20
10%
5%
10%
1.003 1.009 1.019 1.008 1.002 1.007
1.003 1.009 1.016 1.009 1.002 1.004
1.002 1.007 1.006 1.002 1.003 1.001
1.002 1.008 1.007 1.003 1.005 1.002
1.007 1.008 1.007 1.007 1.011 1.044
1.008 1.007 1.013 1.010 1.007 1.014
1.010 1.009 1.013 1.012 1.006 1.011
1.004 1.006 1.008 1.002 1.008 1.005
1.005 1.006 1.008 1.001 1.008 1.004
1.188 1.187 1.368 1.522 2.091
1.256 1.269 1.390 1.631 2.289
1.008 1.012 1.007 1.003 1.002
1.011 1.011 1.007 1.003 1.002
1.003 1.014 1.001 1.002 1.000
1.003 1.012 1.001 1.002 1.000
1.703 1.760 2.299 3.688
1.547 1.601 2.051 3.421
1.704 1.759 2.299 3.688
1.005 1.015 1.006 1.003
1.007 1.014 1.006 1.003
1.002 1.016 1.004 1.000
1.003 1.014 1.004 1.000
2.355 2.364 4.144
2.718 2.718 4.768
2.359 2.366 4.141
2.721 1.005 1.007 1.003 1.004 2.719 1.016 1.017 1.015 1.012 4.767 1.005 1.005 1.000 1.000
4.492 4.444
5.679 5.279
4.502 4.453
5.686 1.002 1.007 1.003 1.004 5.284 1.024 1.026 1.010 1.006
Table 5. Relative MSE of  with Respect to True GLS for 5,000 Replications N = 50, T = 10 and T = 20. Two-Way Error Component OLS
Within
FGLS
One-Way Time Error Component ML
Within
FGLS
One-Way Individual Error Component
ML
Within
FGLS
ML
Pretest
T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20
0 0 0 0 0 0
0 0.01 0.2 0.4 0.6 0.8
1.000 1.001 1.345 2.231 3.850 9.091
1.000 1.004 1.462 2.425 4.381 10.433
1.457 1.441 1.167 1.103 1.071 1.071
1.159 1.133 1.037 1.013 1.015 1.012
1.005 1.010 1.004 1.007 1.004 1.006
1.006 1.004 1.002 0.999 1.001 1.001
1.002 1.008 1.004 1.006 1.004 1.005
1.005 1.004 1.002 0.999 1.001 1.000
1.038 1.038 1.418 2.386 4.103 9.766
1.010 1.012 1.480 2.449 4.446 10.599
1.001 1.003 1.349 2.234 3.850 9.091
1.001 1.005 1.463 2.425 4.381 10.433
1.001 1.003 1.349 2.235 3.851 9.094
1.001 1.005 1.463 2.425 4.382 10.434
1.385 1.370 1.115 1.046 1.021 1.006
1.146 1.121 1.027 1.010 1.005 1.001
1.002 1.007 1.001 1.003 1.002 1.001
1.005 1.003 1.003 1.000 1.000 1.000
1.001 1.006 1.001 1.003 1.003 1.001
1.004 1.003 1.003 1.000 1.000 1.000
1.002 1.005 1.003 1.006 1.004 1.003
1.003 1.005 1.002 1.000 1.000 1.000
0.01 0.01 0.01 0.01 0.01 0.01
0 0.01 0.2 0.4 0.6 0.8
1.009 1.008 1.350 2.123 4.012 8.915
1.001 1.004 1.452 2.483 4.340 10.698
1.407 1.428 1.164 1.072 1.045 1.027
1.160 1.130 1.036 1.008 1.005 1.007
1.006 1.008 1.013 1.005 1.005 1.000
1.003 1.007 1.000 1.000 1.000 1.000
1.005 1.007 1.012 1.005 1.005 0.999
1.002 1.006 1.000 1.000 1.001 1.000
1.019 1.024 1.411 2.223 4.269 9.550
1.007 1.012 1.462 2.507 4.394 10.871
1.004 1.004 1.359 2.135 4.036 8.944
1.000 1.004 1.451 2.485 4.346 10.702
1.004 1.004 1.359 2.134 4.035 8.944
1.000 1.004 1.451 2.485 4.346 10.702
1.385 1.393 1.143 1.082 1.061 1.104
1.151 1.123 1.038 1.010 1.013 1.016
1.011 1.014 1.019 1.030 1.037 1.089
1.003 1.006 1.005 1.005 1.009 1.013
1.010 1.013 1.019 1.030 1.037 1.089
1.002 1.005 1.005 1.005 1.009 1.013
1.007 1.012 1.016 1.015 1.010 1.002
1.001 1.008 1.000 1.000 1.001 1.000
0.2 0.2 0.2 0.2 0.2
0 0.01 0.2 0.4 0.6
1.417 1.408 1.916 3.361 7.924
1.110 1.110 1.770 3.310 8.281
1.401 1.353 1.080 1.027 1.013
1.130 1.103 1.016 1.010 1.002
1.004 1.007 1.003 1.003 1.000
1.000 1.003 1.002 1.001 1.000
1.004 1.006 1.003 1.003 1.000
1.000 1.003 1.002 1.001 1.000
1.003 1.004 1.538 2.960 7.178
0.999 1.008 1.679 3.141 8.010
1.000 1.004 1.534 2.942 7.137
1.000 1.008 1.678 3.141 8.002
1.000 1.004 1.534 2.942 7.137
1.000 1.008 1.678 3.141 8.002
2.230 2.131 1.912 2.213 3.503
1.272 1.236 1.160 1.244 1.478
1.423 1.419 1.671 2.064 3.361
1.110 1.109 1.142 1.234 1.477
1.422 1.417 1.669 2.063 3.362
1.110 1.109 1.142 1.234 1.477
1.003 1.009 1.003 1.003 1.000
1.000 1.007 1.002 1.001 1.000
0.4 0.4 0.4 0.4
0 0.01 0.2 0.4
2.152 2.121 3.108 7.124
1.272 1.282 2.363 6.250
1.442 1.359 1.092 1.021
1.154 1.103 1.012 1.000
1.007 1.008 1.006 1.003
1.003 1.005 1.000 1.000
1.005 1.008 1.006 1.003
1.002 1.005 1.000 1.000
1.002 1.007 1.839 5.027
1.000 1.012 2.035 5.678
1.000 1.005 1.835 5.014
1.000 1.012 2.034 5.675
1.000 1.005 1.835 5.014
1.000 1.012 2.034 5.675
3.693 3.504 3.750 5.770
1.513 1.462 1.471 1.946
2.154 2.126 3.072 5.276
1.272 1.282 1.451 1.939
2.157 2.127 3.066 5.273
1.273 1.282 1.451 1.939
1.002 1.011 1.006 1.003
1.002 1.011 1.000 1.000
0.6 0.6 0.6
0 3.717 0.01 3.563 0.2 7.027
1.608 1.584 4.220
1.434 1.332 1.028
1.150 1.101 1.006
1.004 1.009 1.002
1.002 1.000 1.000
1.002 1.007 1.002
1.002 1.000 1.000
1.002 1.014 2.992
1.000 1.019 3.166
1.000 1.014 2.990
1.000 1.019 3.167
1.000 1.014 2.990
1.000 1.019 3.166
6.812 6.275 9.060
1.959 1.841 2.358
3.717 3.565 7.296
1.608 1.583 2.363
3.725 3.571 7.275
1.609 1.584 2.363
1.000 1.016 1.002
1.000 1.003 1.000
0.8 0.8
0 8.309 0.01 7.560
2.605 2.572
1.434 1.257
1.156 1.068
1.005 1.008
1.003 1.002
1.002 1.010
1.002 1.005
0.999 1.040
1.000 1.068
1.000 1.040
1.000 1.068
1.000 1.040
1.000 15.556 1.068 13.760
3.280 3.097
8.309 7.561
2.605 2.572
8.330 7.578
2.608 2.573
1.002 1.016
1.002 1.003
Table 6. Relative MSE of  with Respect to True GLS for 5,000 Replications N = 500, T = 10 and T = 20. Two-Way Error Component OLS
Within
FGLS
One-Way Time Error Component ML
Within
FGLS
One-Way Individual Error Component
ML
Within
FGLS
ML
Pretest
T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20
0 0 0 0 0 0
0 0.01 0.2 0.4 0.6 0.8
1.0000 1.0000 1.0003 1.0042 1.3294 1.4564 2.2113 2.5550 3.7842 4.3887 8.9208 10.2392
1.3847 1.3620 1.1117 1.0434 1.0238 1.0070
1.1634 1.1278 1.0318 1.0033 1.0030 1.0026
0.9995 0.9995 1.0006 1.0004 1.0012 0.9999
1.0005 1.0013 1.0001 0.9997 1.0000 1.0004
0.9995 0.9994 1.0005 1.0006 1.0009 1.0000
1.0004 1.0013 1.0000 0.9998 0.9999 1.0005
1.0005 1.0012 1.0020 1.0057 1.3319 1.4573 2.2143 2.5601 3.7886 4.3937 8.9306 10.2588
0.9999 1.0001 1.0005 1.0044 1.3296 1.4563 2.2114 2.5551 3.7842 4.3887 8.9208 10.2392
0.9999 1.0001 1.0005 1.0044 1.3296 1.4563 2.2114 2.5551 3.7842 4.3887 8.9208 10.2393
1.3839 1.3602 1.1098 1.0429 1.0229 1.0075
1.1618 1.1264 1.0311 1.0020 1.0043 1.0010
0.9996 0.9992 1.0003 1.0004 1.0009 1.0000
1.0003 1.0011 1.0003 0.9999 1.0002 1.0000
0.9997 0.9992 1.0003 1.0006 1.0007 1.0000
1.0003 1.0011 1.0003 1.0000 1.0001 1.0001
0.9991 1.0000 1.0005 1.0005 1.0010 1.0000
1.0005 1.0022 1.0001 0.9998 1.0001 1.0002
0.01 0.01 0.01 0.01 0.01 0.01
0 0.01 0.2 0.4 0.6 0.8
1.0035 1.0082 1.0034 1.0102 1.3410 1.4964 2.1063 2.4500 3.9391 4.4676 9.5283 10.5948
1.3681 1.3583 1.1122 1.0558 1.0253 1.0044
1.1420 1.1288 1.0258 1.0080 1.0053 1.0033
1.0007 1.0018 1.0004 0.9998 0.9999 1.0000
1.0003 1.0012 1.0001 0.9998 1.0001 1.0002
1.0007 1.0018 1.0003 0.9998 0.9999 1.0000
1.0003 1.0012 1.0000 0.9998 1.0000 1.0004
1.0000 0.9993 1.0007 1.0044 1.3378 1.4916 2.1022 2.4504 3.9364 4.4620 9.5312 10.5994
1.0001 1.0001 1.0004 1.0047 1.3382 1.4916 2.1025 2.4489 3.9363 4.4608 9.5283 10.5945
1.0001 1.0001 1.0004 1.0048 1.3382 1.4916 2.1025 2.4489 3.9363 4.4608 9.5283 10.5944
1.3723 1.3613 1.1197 1.0632 1.0386 1.0316
1.1520 1.1357 1.0334 1.0150 1.0185 1.0308
1.0040 1.0047 1.0059 1.0069 1.0125 1.0265
1.0083 1.0069 1.0072 1.0068 1.0133 1.0275
1.0040 1.0047 1.0059 1.0069 1.0126 1.0266
1.0082 1.0069 1.0072 1.0067 1.0134 1.0276
1.0006 1.0018 1.0004 0.9998 0.9999 1.0000
1.0000 1.0018 1.0001 0.9998 1.0001 1.0002
0.2 0.2 0.2 0.2 0.2
0 0.01 0.2 0.4 0.6
1.0681 1.0782 1.5772 2.8667 6.8041
1.1324 1.1347 1.8159 3.4774 8.2858
1.3704 1.3086 1.0814 1.0388 1.0112
1.1673 1.1217 1.0223 1.0076 0.9993
1.0004 1.0005 1.0009 1.0002 0.9999
1.0004 1.0008 1.0000 1.0001 1.0000
1.0003 1.0005 1.0009 1.0003 0.9997
1.0003 1.0008 0.9999 1.0001 1.0002
1.0001 1.0052 1.4799 2.7436 6.6017
0.9999 1.0071 1.6590 3.2521 7.8137
1.0000 1.0052 1.4800 2.7435 6.6014
1.0000 1.0071 1.6591 3.2523 7.8141
1.0000 1.0051 1.4801 2.7435 6.6014
0.9999 1.0071 1.6591 3.2524 7.8142
1.4919 1.4636 1.2527 1.2694 1.4786
1.3394 1.2871 1.2219 1.2677 1.6046
1.0681 1.0780 1.1494 1.2150 1.4515
1.1324 1.1333 1.1927 1.2592 1.6063
1.0683 1.0779 1.1495 1.2152 1.4517
1.1326 1.1333 1.1927 1.2591 1.6062
1.0000 1.0027 1.0009 1.0002 0.9999
1.0001 1.0009 1.0000 1.0001 1.0000
0.4 0.4 0.4 0.4
0 0.01 0.2 0.4
1.2314 1.2073 2.1520 5.0555
1.3080 1.3702 2.4451 6.3740
1.3726 1.2901 1.0437 1.0152
1.1448 1.1010 1.0163 1.0053
1.0014 1.0010 1.0007 1.0000
1.0005 0.9997 1.0002 0.9999
1.0013 1.0010 1.0008 0.9999
1.0005 0.9997 1.0003 0.9999
1.0000 1.0079 1.8988 4.6241
1.0000 1.0127 2.0180 5.4440
1.0000 1.0079 1.8988 4.6240
1.0000 1.0128 2.0180 5.4441
1.0000 1.0079 1.8988 4.6239
1.0000 1.0128 2.0180 5.4443
1.8041 1.6786 1.5496 1.9361
1.5472 1.5734 1.5928 2.1714
1.2314 1.2070 1.4534 1.8801
1.3080 1.3701 1.5575 2.1567
1.2321 1.2072 1.4535 1.8803
1.3083 1.3702 1.5575 2.1569
1.0008 1.0022 1.0007 1.0000
1.0001 0.9997 1.0002 0.9999
0.6 0.6 0.6
0 1.5187 0.01 1.5049 0.2 3.6441
1.7458 1.3640 1.1626 1.0007 1.0013 1.0006 1.0012 1.0000 1.7692 1.3013 1.1152 1.0000 0.9994 1.0000 0.9995 1.0086 4.5223 1.0403 1.0054 1.0002 1.0000 0.9999 0.9999 2.8528
1.0000 1.0000 1.0146 1.0086 3.2219 2.8528
1.0000 1.0001 1.0146 1.0087 3.2219 2.8529
1.0001 2.3217 2.1538 1.5187 1.7458 1.5200 1.7468 1.0002 1.0004 1.0147 2.1883 2.1151 1.5050 1.7691 1.5058 1.7696 1.0000 0.9994 3.2218 2.4157 2.7416 2.3414 2.6995 2.3421 2.6994 1.0002 1.0000
0.8 0.8
0 2.2152 0.01 2.3828
2.8935 1.3399 1.1702 1.0002 1.0014 0.9997 1.0008 1.0000 2.9377 1.2511 1.0701 1.0020 1.0010 1.0045 1.0065 1.0391
1.0000 1.0000 1.0674 1.0392
1.0000 0.9996 1.0673 1.0395
0.9997 3.6829 3.7162 2.2152 2.8935 2.2185 2.8962 1.0004 1.0008 1.0669 3.7392 3.5924 2.3828 2.9377 2.3853 2.9392 1.0020 1.0010
16 BADI H. BALTAGI, GEORGES BRESSON AND ALAIN PIROTTE
Fig. 2. Relative MSE of  for N = 25 and T = 10 for 5,000 Replications ( = 0).
A Comparative Study of Pure and Pretest Estimators
Fig. 3. Relative MSE of  for the N = 25 and T = 10 for 5,000 Replications ( = 0). 17
18 BADI H. BALTAGI, GEORGES BRESSON AND ALAIN PIROTTE
Fig. 4. Relative MSE of  for N = 25 and T = 10 for 5,000 Replications ( = 0.2).
A Comparative Study of Pure and Pretest Estimators
19
and 1.004 for the 10% level. Figure 2, corresponding to N = 25 and T = 10, confirms that for = 0, the wrong one-way Within estimator performs the worst in terms of relative MSE. For high values of (0.5–0.8), its relative MSE explodes. Similarly, OLS, the wrong one-way FGLS and ML estimators have the same increasing shape for their relative MSE as gets large. Inside the box, the correct one-way ML and FGLS perform the best followed by two-way ML and FGLS. The 5% pretest estimator is in that box with relative MSE not higher than 1.041 for N = 25, T = 10, = 0 and = 0.1. (3) Similarly, when the true specification is a one-way time effect error component model, OWTEC ( = 0), the two-way Within estimator continues to perform badly relative to true GLS yielding a relative MSE of 1.443 for = 0.8 and N = 25, T = 10 (see Table 4). The corresponding relative MSE for OLS is 4.492. The correct one-way fixed effects estimator has a relative MSE of 1.001 while the wrong one-way fixed effects estimator has a relative MSE of 8.266. The two-way FGLS estimator yields a relative MSE of 1.013 for = 0.8, while the correct one-way FGLS estimator yields a relative MSE of 0.999. The wrong one-way FGLS yields a relative MSE of 4.492. The performance of two-way ML is similar to that of FGLS yielding a relative MSE of 1.005. This is compared to 0.999 for the correct one-way ML and 4.502 for the wrong one-way ML estimator. The 5% pretest estimator yields a relative MSE of 1.002 while the 10% pretest estimator yields a relative MSE of 1.007. Figure 3, corresponding to N = 25 and T = 10, confirms that for = 0, the wrong one-way Within estimator performs the worst in terms of relative MSE. For high values of (0.5–0.8), its relative MSE explodes. Similarly, OLS, the wrong one-way FGLS and ML estimators have the same increasing shape for their relative MSE as gets large. Inside the box, the correct one-way ML and FGLS perform the best followed by two-way ML and FGLS. The 5% pretest estimator is in that box with relative MSE not higher than 1.015 for N = 25, T = 10, = 0 and = 0.1. (4) When the true specification is a two-way error component model, TWEC, say = = 0.4, the two-way Within estimator performs well with a relative MSE of 1.029 for N = 25, T = 10 compared to 6.084 for OLS, see Table 4. The two-way FGLS and ML estimators have a relative MSE of 1.003. The wrong one-way time effects FGLS and ML estimators have a relative MSE of 5.019, while the wrong one-way individual effects FGLS and ML estimators have a relative MSE of 3.421. The wrong one-way fixed effects estimators have a relative MSE of 5.029 for time and 3.668 for individual effects. The pretest estimator matches the two-way FGLS estimator in MSE performance. This is not surprising given the results of the tests in Table 1. The larger the variance components the more likely it is for the pretest to match the two-way
20
BADI H. BALTAGI, GEORGES BRESSON AND ALAIN PIROTTE
FGLS estimator in 100% of the cases. Figure 4, corresponding to N = 25 and T = 10, confirms that for = 0.2, OLS performs the worst, followed by the wrong one-way time effects estimators and the wrong one-way individual effects estimators, whether this is Within, FGLS or ML estimators. Inside the box, the correct two-way ML and FGLS estimators perform the best, followed closely by the 5% pretest estimator. The latter has relative MSE no higher than 1.022 for N = 25, T = 10, = 0.2 and = 0.1. In summary, it is clear from Figs 2–4 that the wrong Within, FGLS or ML estimators can result in a big loss in MSE. The pretest estimator comes out with a clear bill of health being no more than 3% above the MSE of true GLS. This performance improves as N or T increases. It is also not that sensitive to doubling the size of the test from 5 to 10%. 3.3. Robustness to Non-Normality So far, we have been assuming that the error components have been generated by the normal distribution. In this section, we check the sensitivity of our results to non-normal disturbances. In particular, we generate the i ’s and t ’s from 2 distributions and we let the remainder disturbances follow the normal distribution. In all experiments, we fix the total variance to be 20. Table 7 gives the choice of the pretest estimator under non-normality of the random effects for N = 25 and T = 10, 20 using the 5 and 10% significance levels, respectively. Comparing the results to the normal case in Table 1, we find that the GHM test committs a higher probability of type II error under non-normality. For example, when = 0 and = 0.2, GHM does not reject the null when false in 34% of the cases at the 5% level of significance and 29% of the cases at the 10% level of significance as compared to 2.7 and 1.8% of the cases under normality. The BCL tests are affected in the same way too. For = 0.2 and = 0.4, the choice of the pretest as a two-way estimator is only 89.2% at the 5% level and 92.6% at the 10% level. This is compared to almost 100% of the cases under normality no matter what significance level is chosen. Despite this slight deterioration in the correct choice of pretest estimator under non-normality, the resulting relative MSE performance reported in Table 8 seems to be unaffected. This indicates that, at least for our limited experiments, the pretest estimator seems to be robust to non-normality of the disturbances of the 2 type. We have also presented results for N = 25 and T = 20 at both the 5 and 10% significance levels. The choice of the pretest estimator as well as its relative MSE improves as T doubles from 10 to 20 for N = 25.
Pretest GHM H 0,A T = 10
BCL OLS
T = 20
T = 10
BCL TIME
T = 20
T = 10
BCL INDIV
T = 20
T = 10
BCL TW
T = 20
T = 10
T = 20
5%
10%
5%
10%
5%
10%
5%
10%
5%
10%
5%
10%
5%
10%
5%
10%
5%
10%
5%
10%
0 0 0 0 0 0
0 0.1 0.2 0.4 0.6 0.8
4753 2055 1735 162 4 0
4578 1689 1405 115 3 0
4758 641 564 9 0 0
4559 483 419 5 0 0
11 53 56 15 1 1
16 39 44 14 0 1
3 2 4 0 0 0
5 0 1 0 0 0
110 28 22 3 0 0
179 28 40 2 0 0
117 13 9 0 0 0
200 17 14 0 0 0
109 2658 2966 4519 4691 4639
186 2900 3136 4375 4508 4454
111 4070 4181 4684 4686 4682
191 4029 4137 4466 4445 4480
17 206 221 301 304 360
41 344 375 494 489 545
11 274 242 307 314 318
45 471 429 529 555 520
0.1 0.1 0.1 0.1 0.1
0 0.1 0.2 0.4 0.6
1837 624 492 27 1
1598 437 360 15 0
703 56 44 0 0
529 36 28 0 0
25 0 1 0 0
21 2 3 0 0
3 0 0 0 0
2 0 0 0 0
2930 852 759 44 0
2991 685 631 27 0
4037 375 255 1 0
3994 281 196 1 0
35 822 793 830 452
57 745 700 666 360
16 353 322 145 41
20 266 240 112 27
173 2702 2955 4099 4547
333 3131 3306 4292 4640
241 4216 4379 4854 4959
455 4417 4536 4887 4973
0.2 0.2 0.2 0.2 0.2
0 0.1 0.2 0.4 0.6
1704 449 344 12 0
1458 331 249 5 0
559 35 19 0 0
449 21 12 0 0
25 6 1 0 0
13 5 0 0 0
2 0 0 0 0
1 0 0 0 0
3020 801 662 21 0
3124 639 518 13 0
4225 276 204 2 0
4155 196 135 1 0
34 812 741 623 283
39 747 640 512 220
5 294 245 111 9
8 226 184 87 8
217 2932 3252 4344 4717
366 3278 3593 4470 4780
209 4395 4532 4887 4991
387 4557 4669 4912 4992
0.4 0.4 0.4 0.4
0 0.1 0.2 0.4
266 33 13 0
206 23 8 0
10 0 0 0
6 0 0 0
5 0 0 0
4 0 0 0
0 0 0 0
0 0 0 0
4466 628 445 0
4331 445 300 0
4695 131 79 0
4532 96 55 0
3 114 82 13
6 93 61 10
0 3 3 0
0 1 3 0
260 4225 4460 4987
453 4439 4631 4990
295 4866 4918 5000
462 4903 4942 5000
0.6 0.6 0.6
0 0.1 0.2
26 0 0
18 0 0
0 0 0
0 0 0
2 0 0
2 0 0
0 0 0
0 0 0
4682 211 92
4479 158 62
4706 38 7
4474 32 4
0 6 2
0 6 1
0 0 0
0 0 0
290 4783 4906
501 4836 4937
294 4962 4993
526 4968 4996
0.8 0.8
0 0.1
1 0
1 0
0 0
0 0
0 0
0 0
0 0
0 0
4706 13
4494 6
4702 4
4473 3
0 0
0 0
0 0
0 0
293 4987
505 4994
298 4996
527 4997
A Comparative Study of Pure and Pretest Estimators
Table 7. Number of Non-Rejections of H 0,A , H 0,B and H 0,C for 5,000 Replications Under Non-Normality of the Random Effects N = 25, T = 10 and T = 20.
21
Table 8. Relative MSE of  with Respect to True GLS for 5,000 Replications Under Non-Normality of the Random Effects N = 25, T = 10 and T = 20. Two-Way Error Component OLS
Within
FGLS
One-Way Time Error Component ML
Within
FGLS
One-Way Individual Error Component
ML
Within
FGLS
ML
Pretest T = 10
T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 T = 10 T = 20 5%
T = 20
10%
5%
10%
0 0 0 0 0 0
0 0.1 0.2 0.4 0.6 0.8
1.000 1.094 1.130 1.528 2.297 4.823
1.000 1.211 1.196 1.740 2.783 6.050
1.478 1.277 1.211 1.143 1.079 1.073
1.285 1.114 1.103 1.079 1.075 1.063
1.016 0.998 0.985 0.987 0.988 0.996
1.010 0.999 0.994 0.994 1.003 0.998
1.010 0.996 0.985 0.987 0.989 0.996
1.007 1.000 0.994 0.994 1.003 0.998
1.037 1.144 1.187 1.621 2.441 5.175
1.055 1.292 1.270 1.868 3.014 6.636
1.001 1.096 1.133 1.532 2.298 4.823
1.002 1.212 1.199 1.742 2.785 6.050
1.001 1.096 1.133 1.532 2.299 4.825
1.002 1.212 1.198 1.743 2.786 6.052
1.407 1.222 1.154 1.079 1.037 1.018
1.207 1.050 1.046 1.018 1.007 1.005
1.011 0.994 0.981 0.981 0.989 0.993
1.005 0.999 0.992 0.992 0.999 0.996
1.008 0.994 0.983 0.983 0.989 0.993
1.005 0.999 0.993 0.992 0.999 0.997
1.003 1.009 0.999 0.991 0.989 0.994
1.004 1.005 0.995 0.988 0.990 0.994
1.002 1.006 0.997 0.993 1.001 0.997
1.002 1.003 0.996 0.994 1.001 0.998
0.1 0.1 0.1 0.1 0.1
0 0.1 0.2 0.4 0.6
1.076 1.209 1.192 1.676 2.958
1.104 1.323 1.355 2.058 3.681
1.448 1.208 1.171 1.075 1.038
1.204 1.068 1.056 1.026 1.021
1.009 0.995 0.974 0.977 0.985
1.009 0.987 0.985 0.992 0.994
1.005 0.996 0.974 0.978 0.986
1.008 0.987 0.985 0.992 0.994
1.009 1.169 1.139 1.633 2.952
1.011 1.269 1.296 2.022 3.681
1.001 1.149 1.123 1.601 2.885
1.002 1.242 1.272 1.971 3.576
1.001 1.149 1.123 1.601 2.885
1.002 1.242 1.272 1.971 3.575
1.585 1.344 1.309 1.284 1.411
1.337 1.204 1.193 1.238 1.398
1.083 1.097 1.079 1.161 1.318
1.110 1.118 1.119 1.206 1.378
1.080 1.096 1.079 1.162 1.318
1.109 1.118 1.119 1.206 1.378
1.008 1.009 0.984 0.980 0.988
1.009 1.005 0.982 0.978 0.987
1.005 0.990 0.988 0.992 0.994
1.008 0.988 0.986 0.991 0.994
0.2 0.2 0.2 0.2 0.2
0 0.1 0.2 0.4 0.6
1.059 1.269 1.262 1.949 4.149
1.097 1.346 1.428 2.244 5.372
1.437 1.171 1.144 1.065 1.023
1.203 1.058 1.048 1.023 1.007
1.004 0.994 0.976 0.980 0.994
1.001 0.999 0.977 0.992 0.999
0.999 0.996 0.978 0.981 0.995
1.000 0.999 0.977 0.992 0.999
1.011 1.196 1.218 1.896 4.051
1.012 1.290 1.346 2.209 5.275
0.992 1.183 1.192 1.861 3.979
0.997 1.268 1.323 2.154 5.156
0.992 1.183 1.191 1.861 3.979
0.997 1.268 1.323 2.154 5.155
1.550 1.340 1.320 1.335 1.596
1.320 1.188 1.234 1.274 1.691
1.069 1.127 1.108 1.214 1.541
1.101 1.125 1.149 1.243 1.681
1.066 1.127 1.110 1.215 1.542
1.100 1.125 1.149 1.244 1.681
1.000 1.009 0.989 0.983 0.995
0.998 1.002 0.985 0.982 0.995
1.001 1.001 0.978 0.992 0.999
1.000 1.000 0.978 0.992 0.999
0.4 0.4 0.4 0.4
0 0.1 0.2 0.4
1.290 1.522 1.650 3.510
1.343 1.707 1.948 4.294
1.421 1.149 1.114 1.027
1.211 1.046 1.029 1.005
1.012 0.993 0.969 0.998
1.005 0.993 0.983 0.999
1.009 0.995 0.970 0.999
1.004 0.993 0.983 1.000
1.002 1.291 1.344 2.988
1.004 1.411 1.555 3.631
1.002 1.284 1.338 2.974
0.999 1.399 1.543 3.598
1.002 1.284 1.338 2.974
0.999 1.399 1.543 3.598
1.962 1.652 1.768 2.297
1.690 1.537 1.651 2.342
1.297 1.356 1.433 2.085
1.349 1.433 1.553 2.288
1.295 1.355 1.430 2.084
1.348 1.433 1.553 2.288
1.009 1.003 0.976 0.998
1.009 0.999 0.972 0.998
1.002 0.994 0.984 0.999
1.003 0.994 0.983 0.999
0.6 0 1.615 0.6 0.1 2.154 0.6 0.2 2.754
1.789 2.636 3.460
1.429 1.090 1.052
1.190 1.025 1.013
1.010 0.998 0.974
1.007 0.996 0.994
1.006 0.999 0.975
1.006 0.997 0.994
1.002 1.521 1.814
1.002 1.790 2.248
0.998 1.518 1.809
1.000 1.783 2.237
0.998 1.518 1.809
1.000 1.783 2.237
2.657 2.378 2.993
2.277 2.320 3.005
1.619 1.914 2.383
1.790 2.173 2.790
1.619 1.912 2.381
1.791 1.003 1.004 1.002 1.006 2.173 1.001 1.000 0.996 0.996 2.789 0.976 0.975 0.994 0.994
0.8 0 2.739 0.8 0.1 5.495
3.139 7.043
1.447 1.045
1.176 1.012
1.013 0.996
1.003 0.992
1.008 0.999
1.002 0.992
1.001 2.956
1.001 3.472
0.999 2.953
0.999 3.465
1.000 2.953
0.999 3.465
4.871 6.307
4.138 6.298
2.740 4.834
3.139 5.821
2.745 4.825
3.142 1.005 1.004 1.000 1.001 5.821 0.997 0.996 0.992 0.992
A Comparative Study of Pure and Pretest Estimators
23
4. CONCLUSION Our experiments show that the correct FGLS procedure is always the best, followed closely by the correct ML estimator. However, the researcher does not have perfect foresight on the true specification, whether it is two-way, one-way, or a pooled regression model with no time or individual effects. The pretest estimator proposed in this paper provides a viable alternative given that its MSE performance is a close second to correct FGLS for all type of misspecified models considered. The fixed effects estimator has the advantage of being robust to possible correlation between the regressors and the individual and time effects. It is clear from our experiments that the wrong fixed effects estimator, like its counterpart the wrong random effects estimator can lead to huge loss in MSE performance. We checked the sensitivity of our results to doubling the significance level for the pretest estimator from 5 to 10% as well as to specifying non-normal random effects. We found our pretest estimator to be robust to non-normality.
NOTE 1. The results of the experiments are invariant to the choice of the true values of the regression parameters ␥ and  and the remainder variance, see Breusch (1980).
ACKNOWLEDGMENTS The authors would like to thank Carter Hill for his helpful comments as well as the participants of the LSU econometrics conference in Baton Rouge, Louisiana, November 2–3, 2002. Baltagi would like to thank the Private Enterprise Research Center for its research support.
REFERENCES Baltagi, B. H. (2001). Econometric analysis of panel data. Chichester: Wiley. Baltagi, B. H., Chang, Y. J., & Li, Q. (1992). Monte Carlo results on several new and existing tests for the error component model. Journal of Econometrics, 54, 95–120. Baltagi, B. H., & Li, Q. (1997). Monte Carlo results on pure and pretest estimators of an error component ´ model with autocorrelated disturbances. Annales d’Economie et de Statistique, 48, 69–82. Breusch, T. S. (1980). Useful invariance results for generalized regression models. Journal of Econometrics, 13, 327–340. Breusch, T. S., & Pagan, A. R. (1980). The Lagrange multiplier test and its applications to model specification in econometrics. Review of Economic Studies, 47, 239–253.
24
BADI H. BALTAGI, GEORGES BRESSON AND ALAIN PIROTTE
Giles, J. A., & Giles, D. E. A. (1993). Pre-test estimation and testing in econometrics: Recent developments. Journal of Economic Surveys, 7, 145–197. Gouri´eroux, C., Holly, A., & Monfort, A. (1982). Likelihood ratio test, Wald test, and Kuhn-Tucker test in linear models with inequality constraints on the regression parameters. Econometrica, 50, 63–80. Judge, G. G., & Bock, M. E. (1978). The statistical implications of pre-test and Stein-Rule estimators in econometrics. Amsterdam: North-Holland. Judge, G. G., & Bock, M. E. (1983). Biased estimation. In: Z. Griliches & M.D. Intrilligator (Eds), Handbook of Econometrics (Vol. 1, pp. 601–649). Amsterdam: North-Holland. Magnus, J. R. (1999). The traditional pretest estimator. Theory of Probability and Its Applications, 44, 293–308. White, H. (1982). Maximum likelihood estimation of misspecified models. Econometrica, 50, 1–25. Ziemer, R. F., & Wetzstein, M. E. (1983). A Stein-rule method for pooling data. Economics Letters, 11, 137–143.
APPENDIX This appendix gives the SAS computer code behind the flow chart in Fig. shows how the pretest estimator was constructed. DO z = 1 TO rep; /* rep = number of replications /* Pretest estimator /* /* Gouri´ eroux, Holly and Monfort (GHM) test: /* H(0,A): sigma mu = 0 , sigma lambda = 0 /* res ols1 = SHAPE(res ols,N,T);/* OLS residuals */ bet ires = SHAPE(REPEAT(res ols1[,:],1,T),NT,1) bet tres = SHAPE(REPEAT(res ols1[:,],N,1),NT,1) u1 = SQRT (NT / (2*(T-1)) ) u2 = SQRT (NT / (2*(N-1)) ) A = u1 * (((T*bet ires‘*bet ires)/ (res ols‘*res os )) - 1) B = u2 * (((N*bet tres‘*bet tres)/ (res ols‘*res os )) - 1) IF A > 0 THEN DO; IF B > 0 THEN DO; GHM[z,1] = A**2 + B**2; END; IF B <= 0 THEN DO;
1. It */ */ */ */ */ */ ; ; ; ; ; ;
A Comparative Study of Pure and Pretest Estimators
25
GHM[z,1] = A**2; END; END; IF A <= 0 THEN DO; IF B > 0 THEN DO; GHM[z,1] = B**2; END; IF B <= 0 THEN DO; GHM[z,1] = 0; END; END; /* Count for H(0,A) => OLS */ IF GHM[z,1] <= 4.321 THEN count[z,1] = 1; /* /* Baltagi, Chang and Li (BCL) test: /* H(0,B): (sigma mu = 0 / sigma lambda > 0) /* res 1 = SHAPE(res mlt,N,T) ; /* One-way time ML residuals */ res bar = res mlt[:] bet ires = SHAPE(REPEAT(res 1[,:],1,T),NT,1) bet tres = SHAPE(REPEAT(res 1[:,],N,1),NT,1) bi res = bet ires - REPEAT(res bar,NT,1) wt res = res mlt - bet tres mg res = REPEAT(res bar,NT,1) sigt2 = (t(bet tres)*bet tres ) / T sigtnu = (t(wt res)*wt res ) / (T*(N-1)) Dmu1 = t(mg res)*mg res Dmu2 = t(bi res)*bi res Dmu = (T/2)* ((1/sigt2)*(dmu1/sigt2 - 1) +((N-1)/sigtnu)*(Dmu2/((N-1)*sigtnu ) - 1)) num = SQRT(2.0)*sigt2*sigtnu den = SQRT (T*(T-1)* (sigtnu**2 + (N-1)*sigt2**2) ) BCL[z,1] = (num/den)*Dmu; /* Count for H(0,B) => One-Way time FGLS */ IF BCL[z,1] <= 1.64 THEN BCL[z,2] = 1;
*/ */ */ */
; ; ; ; ; ; ; ; ; ;
; ; ;
26
BADI H. BALTAGI, GEORGES BRESSON AND ALAIN PIROTTE
/* /* Baltagi, Chang and Li (BCL) test: /* H(0,C): (sigma lambda = 0 / sigma mu > 0) /* res 1 = SHAPE(res mli,N,T) ; /* One-way ind. ML residuals */ res bar = res mli[:] res 1 = SHAPE(res mli,N,T) bet ires = SHAPE(REPEAT(res 1[,:],1,T),NT,1) bet tres = SHAPE(REPEAT(res 1[:,],N,1),NT,1) bt res = bet tres - REPEAT(res bar,NT,1) wi res = res mli - bet ires mg res = REPEAT(res bar,NT,1) sigt2 = (t(bet ires)*bet ires ) / N sigtnu = (t(wi res)*wi res ) / (N*(T-1)) Dmu1 = t(mg res)*mg res Dmu2 = t(bt res)*bt res (N/2)* ((1/sigt2)*(dmu1/sigt2 - 1) D lamb = +((T-1)/sigtnu) *(Dmu2/((T-1)*sigtnu ) - 1)) num = SQRT(2.0)*sigt2*sigtnu den = SQRT (N*(N-1)* (sigtnu**2 + (T-1)*sigt2**2) ) BCL[z,3] = (num/den)*D lamb;
*/ */ */ */
; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
/* Count for H(0,C) => One-Way individual FGLS */ IF BCL[z,3] <= 1.64 THEN BCL[z,4] = 1; /* Pretest count IF count[z,1] = 1 THEN count IF count[z,1] = 0 THEN DO; IF BCL[z,2] = 1 & BCL[z,4] = IF BCL[z,2] = 1 & BCL[z,4] = IF BCL[z,2] = 0 & BCL[z,4] = IF BCL[z,2] = 0 & BCL[z,4] = END;
*/ pre[z,1] = 1; 1 0 1 0
THEN THEN THEN THEN
count count count count
/* Pretest estimator vector IF count[z,1] = 1 THEN DO ; /* OLS */ pretest[z,1] = beta ols[z,1] ; END ;
pre[z,2] = pre[z,3] = pre[z,4] = pre[z,5] =
*/
1; 1; 1; 1;
A Comparative Study of Pure and Pretest Estimators
IF count[z,1] = 0 THEN DO ; IF BCL[z,2] = 1 & BCL[z,4] = 1 THEN DO; /* OLS */ pretest[z,1] = beta ols[z,1] ; END ; IF BCL[z,2] = 1 & BCL[z,4] = 0 THEN DO; /* OW time FGLS */ pretest[z,1] = beta fgls ot[z,1] ; END ; IF BCL[z,2] = 0 & BCL[z,4] = 1 THEN DO; /* OW ind. FGLS */ pretest[z,1] = beta fgls oi[z,1] ; END ; IF BCL[z,2] = 0 & BCL[z,4] = 0 THEN DO; /* Two-Way FGLS */ pretest[z,1] = beta fgls tw[z,1] ; END ; END; END; /* End of replications loop */ /* Number of non-rejections of H(0,A), H(0,B) and H(0,C)*/ count 1 = SUM(count pre[,1]); /* GHM H(0,A) /* BCL OLS count 2 = SUM(count pre[,2]); count 3 = SUM(count pre[,3]); /* BCL TIME count 4 = SUM(count pre[,4]); /* BCL INDIV /* BCL TW count 5 = SUM(count pre[,5]);
27
*/ */ */ */ */
TESTS OF COMMON DETERMINISTIC TREND SLOPES APPLIED TO QUARTERLY GLOBAL TEMPERATURE DATA Thomas B. Fomby and Timothy J. Vogelsang ABSTRACT We examine the global warming temperature data sets of Jones et al. (1999) and Vinnikov et al. (1994) in the context of the multivariate deterministic trend-testing framework of Franses and Vogelsang (2002). We find that, across all seasons, global warming seems to be present for the globe and for the northern and southern hemispheres. Globally and within hemispheres, it appears that seasons are not warming equally fast. In particular, winters appear to be warming faster than summers. Across hemispheres, it appears that the winters in the northern and southern hemispheres are warming equally fast whereas the remaining seasons appear to have unequal warming rates. The results obtained here seem to coincide with the findings of Kaufmann and Stern (2002) who use cointegration analysis and find that the hemispheres are warming at different rates.
1. INTRODUCTION The use of heteroskedasticity autocorrelation (HAC) robust covariance matrix estimators to form standard errors is now a standard of practice in the econometrics Maximum Likelihood Estimation of Misspecified Models: Twenty Years Later Advances in Econometrics, Volume 17, 29–43 © 2003 Published by Elsevier Ltd. ISSN: 0731-9053/doi:10.1016/S0731-9053(03)17002-8
29
30
THOMAS B. FOMBY AND TIMOTHY J. VOGELSANG
literature and is a legacy of the seminal contribution of White (1980).1 Although White (1980) focused on the case of heteroskedasticity, it was soon recognized, especially in the emerging generalized method of moments literature (Hansen, 1982), that robust covariance matrix estimators were needed for dependent, i.e. autocorrelated, data. As pointed out by Hansen (1982) and others, obtaining consistent standard errors for dependent, but stationary, data is equivalent to estimating a spectral density matrix at frequency zero. Thus began a fruitful marriage of the non-parametric spectral density estimation literature developed in the much earlier time series statistics literature (see Priestley, 1981) and the emerging robust standard error literature in econometrics. Important contributions in the econometrics literature that grew from this marriage include White and Domowitz (1984), Newey and West (1987), Gallant (1987), Gallant and White (1988), Andrews (1991), Andrews and Monahan (1992), Hansen (1992), Newey and West (1994), den Haan and Levin (1997) and Robinson (1998). In this paper, we are interested in testing hypotheses about global warming, especially with respect to potential differences in global warming trends by hemisphere, North versus South. Because we approximate the trends in temperature with simple linear trend functions, hypotheses about global warming can be parameterized in terms of linear trend slope coefficients. As is well known from the classic work of Grenander and Rosenblatt (1957), deterministic trend parameter estimates have asymptotic variances that are proportional to zero frequency spectral densities. Therefore, the tests we use in this paper require HAC robust covariance matrix estimators. Our analysis focuses on global temperature data that are aggregated to the seasonal level (winter, spring, summer, autumn). We examine global data as well as data for the northern and southern hemispheres. We want to examine the presence or absence of climatic warming, both globally and hemispherical, and to determine to what extent temperature trends differ across seasons globally, across seasons within hemispheres, and for seasons across hemispheres. We test our hypotheses using univariate trend tests proposed by Vogelsang (1998) and Bunzel and Vogelsang (2003) and multivariate trend tests developed by Franses and Vogelsang (2002). The data we use are the quarterly temperature series of Jones, Osborn, Briffa and Parker (1999), hereafter JOBP, and of Vinnikov, Groisman and Lugina (1994), hereafter VGL. The JOBP data span the years 1856–1998 while the VGL data span the years 1881–1993. Although both series are available in monthly frequencies, we examine the quarterly series in order to reduce the interesting tests of trend to a manageable number. With respect to previous research on comparing the warming trends of the hemispheres, not much work has been done. For example, in the Intergovernmental
Tests of Common Deterministic Trend Slopes Applied
31
Panel on Climate Change (IPCC) Report Climate Change 2001: Synthesis Report, no comparisons of the temperature trends of the northern and southern hemispheres are mentioned. The National Oceanic and Atmospheric Administration’s (NOAA) website www.ncdc.noaa.gov/oa/climate/globalwarming.html states (page 2) that global surface temperatures are increasing but that “the warming has not been globally uniform (report’s emphasis).” Furthermore, the site states (page 2) “Some areas (including parts of the southeastern U.S.) have, in fact, cooled over the last century.” Evidently, there has been some regional analysis of temperature trends but, alas, it has not been reported in any formal government reports that these authors can find. However, there is one paper of note. Kaufmann and Stern (2002) apply cointegration analysis to hemispheric temperature series along with atmospheric forcing variables (carbon dioxide, sulfur emissions, etc.) to examine the effects that human activity might have on warming by hemisphere. They find, like we do here, that the hemispheres are warming at different rates. The rest of the paper is organized as follows. In the next section, we describe the statistical models and test statistics. In Section 2, we present a univariate analysis that provides evidence on the existence of warming trends. In Section 3, we use multivariate analysis to test hypotheses about intra-seasonal and interhemispherical warming trends. We find that there is strong evidence of warming in all the season but that the extent of warming varies across the seasons. Comparisons between the hemispheres suggest similar warming trends in winters but differences in the other seasons. Section 4 concludes.
2. UNIVARIATE ANALYSIS: EVIDENCE OF GLOBAL WARMING We begin by describing a univariate analysis designed to answer the following simple question. For a given temperature series, is there evidence of a systematic warming trend? Let yt denote a temperature series for t = 1, 2, . . ., T. We approximate the systematic part of yt with a linear time trend that leads to the model y t = + t + u t .
(1)
Global warming is consistent with a positive trend slope parameter, whereas a zero or negative trend slope parameter would be evidence that global warming is not occurring. We take no global warming to be the null hypothesis and global
32
THOMAS B. FOMBY AND TIMOTHY J. VOGELSANG
warming to be the alternative hypothesis: H0 :
 ≤ 0,
 > 0.
H1 :
An alternative to model (1) is obtained by computing partial sums of the raw data z t = t + 
t2 + t 2
+ St ,
(2)
where z t = tj=1 y j and S t = tj=1 u j . For each of models (1) and (2), we consider t-tests that are not only robust to serial correlation in ut but are also robust to the possibility that ut has a unit root. These tests do not suffer from the usual over-rejection problem that is often present with HAC robust tests when serial correlation is highly persistent. For model (1), we use one of the tests proposed by Bunzel and Vogelsang (2003) and for model (2), we used one of the tests proposed by Vogelsang (1998). Both tests depend on a common adjustment factor that controls the over-rejection problem when ut has a unit root. It is convenient to first describe this adjustment factor before defining the test statistics. Consider model (1) augmented with additional regressors that are polynomials in time y t = + t +
9
␦i t i + u t .
(3)
i=2
Under the assumption that model (1) adequately captures the deterministic component of yt , the ␦i coefficients in regression (3) are all zero. Consider the following test statistic which is the standard Wald test (normalized by T−1 ) for testing the joint hypothesis that the ␦i coefficients are zero J=
RSS1 − RSS3 RSS3
(4)
where RSS1 is the OLS residual sum of squares from regression (1) and RSS3 is the OLS residual sum of squares from regression (3). The J statistic was originally proposed by Park and Choi (1988) and Park (1990) as a unit root test. When ut has a unit root, J has a well-defined asymptotic distribution while when ut is covariance stationary, J converges to zero. Bunzel and Vogelsang (2003) analyzed t-tests for  using OLS estimates from model (1) and recommended the following test. Let ˆ denote the OLS estimate
Tests of Common Deterministic Trend Slopes Applied
33
from model (1). Let uˆ t denote the OLS residuals from model (1) and define ˆ 2 = ␥ˆ 0 + 2 T
T −1 j=1
sin(j/M) ␥ˆ j , j/M
where ␥ˆ = t=j+1 uˆ t uˆ t−j and M = max(0.02T, 2). ˆ 2 is the Daniell kernel non-parametric zero frequency spectral density estimator. Define the t-test ˆ −  t DAN = exp(−bJ), ˆ se() ˆ = ˆ 2 ( (t − ¯t )2 )−1 with ¯t = T −1 T t and b is a pre-specified where se() t=1 constant (see Bunzel & Vogelsang, 2003) that depends on the significance level of the test. Bunzel and Vogelsang (2003) showed that t DAN has nearly optimal power when ut is covariance stationary. The adjustment factor, exp(−bJ), was proposed by Vogelsang (1998) as a method of solving the over-rejection problem that occurs when ut has a unit root. Without the adjustment factor, t DAN would over-reject quite substantially when ut has strong serial correlation or a unit root. ˜ We also consider a test proposed by Vogelsang (1998). Let t z = (˜ − )/se() ˜ ˜ where  is the OLS estimate of beta from model (2) and se() is the classic (non-HAC robust) OLS standard error. Define the statistic t − PS = T −1/2 t z exp(−bJ). While t − PS is not as powerful as tDAN when ut is covariance stationary, it can have higher average power when ut has strong (nearly integrated) serial correlation. As with tDAN , t − PS does not over-reject when ut has a unit root. We applied the t DAN and t − PS tests to each of the global temperature series in our data sets and report the results in Tables 1 and 2. Table 1 gives results for the JOBP data and Table 2 gives the results for the VGL data. We follow the global climate literature convention and define the seasons as follows: the winter quarter (season) consists of December, January, and February in the northern hemisphere and June, July, and August in the southern hemisphere. The spring quarter consists of March, April, and May in the northern hemisphere and September, October, and November in the southern hemisphere. The summer quarter consists of June, July, and August in the northern hemisphere and December, January, and February in the southern hemisphere. Finally, the autumn quarter consists of September, October, and November in the northern hemisphere and March, April, and May in the southern hemisphere. In the tables, we see that the null hypothesis of no global warming is strongly rejected in nearly all cases.2 The exception is the summer in the northern
34
Table 1. Global Warming Trends By Season; JOBP Data 1857–1998. Location
Season
ˆ
t − PS
J
5%
2.5%
1%
5%
2.5%
1%
4.861b
3.626a
2.851c
2.524b
4.639c
3.442b
2.013c
0.437∗∗∗ 0.630∗∗ 0.978 0.584∗∗
0.0045 0.0043 0.0038 0.0045
2.835c 5.974c
1.785 4.532b
North
DJF (Winter) MAM (Spring) JJA (Summer) SON (Autumn)
0.0049 0.0041 0.0026 0.0044
5.889c 4.055c 1.415 5.667c
South
DJF (Summer) MAM (Autumn) JJA (Winter) SON (Spring)
0.0041 0.0044 0.0048 0.0043
7.357c 6.358c 5.945c 5.658c
2.255 0.927 3.064a
0.0038 0.0036 0.0033 0.0042
1.634 3.479c
1.689 1.245 2.956b
2.023 1.227 0.758 2.200
5.277b 3.167b 0.892 4.637b
4.517a 2.234 0.464 3.490a
0.0041 0.0033 0.0019 0.0044
2.962c 1.690 0.649 3.349c
2.777b 1.462 0.495 2.975b
2.469 1.122 0.302 2.401
0.232∗∗∗ 0.521∗∗ 0.976 0.424∗∗∗
6.311b 5.123b 4.493b 4.256b
5.078a 3.772a 3.022a 2.843a
0.0034 0.0036 0.0041 0.0036
3.506c 2.599c 2.899c 2.356c
3.203b 2.288b 2.458b 1.993
2.719a 1.816 1.822 1.470
0.324∗∗∗ 0.457∗∗∗ 0.592∗∗ 0.602∗∗
Notes: DJF = Dec–Feb, MAM = Mar–May, JJA = Jun–Aug, SON = Sep–Nov. The superscripts a, b, and c denote rejection of the null hypothesis of no global warming at the 1, 2.5, and 5% levels of significance, respectively. The superscripts ∗∗∗ , ∗∗ , and ∗ denote rejection of a unit root in the errors at the 1, 2.5, and 5% levels of significance, respectively. The J is a left tail test with 1, 2.5, and 5% critical values of 0.488, 0.678 and 0.908, respectively. The pre-specified constants for the t DAN test are 1.322 (5%), 1.795 (2.5%) and 2.466 (1%). The pre-specified constants used for the t − PS test are 0.716 (5%), 0.995 (2.5%) and 1.501 (1%). Critical Values for Test Statistics % tDAN t − PS 0.950 1.710 1.720 0.975 2.052 2.152 0.990 2.462 2.647
THOMAS B. FOMBY AND TIMOTHY J. VOGELSANG
DJF MAM JJA SON
5.979c
Globe
˜
t DAN
Location
Season
ˆ
˜
t DAN 5%
2.5%
1%
t − PS
J
5%
2.5%
1%
Globe
DJF MAM JJA SON
0.0058 0.0064 0.0047 0.0041
6.263c 6.568c 6.117c 4.287c
5.379b 5.557b 5.131b 3.448b
4.336a 4.385a 4.000a 2.532a
0.0057 0.0061 0.0044 0.0042
3.893c 3.847c 3.744c 2.193c
3.559b 3.486b 3.375 1.929
3.024a 2.914a 2.797a 1.528
0.321∗∗∗ 0.353∗∗∗ 0.372∗∗∗ 0.460∗∗∗
North
DJF (Winter) MAM (Spring) JJA (Summer) SON (Autumn)
0.0075 0.0064 0.0029 0.0041
3.675c 5.147c 2.231c 1.829c
2.709b 4.280b 1.660 1.248
1.758 3.296a 1.091 0.726
0.0079 0.0060 0.0024 0.0046
2.044c 3.237c 1.368 1.042
1.708 2.903b 1.149 0.832
1.233 2.383 0.837 0.552
0.645∗∗ 0.389∗∗∗ 0.625∗∗ 0.808∗
South
DJF (Summer) MAM (Autumn) JJA (Winter) SON (Spring)
0.0039 0.0063 0.0063 0.0040
5.269c 8.162c 9.164c 7.157c
4.695b 7.272b 8.350b 6.784b
3.987a 6.174a 7.317a 6.289a
0.0034 0.0060 0.0064 0.0038
3.544c 4.430c 6.017c 6.504c
3.311b 4.139b 5.695b 6.302b
2.927a 3.658a 5.156a 5.952a
0.244∗∗∗ 0.244∗∗∗ 0.197∗∗∗ 0.113∗∗∗
Tests of Common Deterministic Trend Slopes Applied
Table 2. Global Warming Trends By Season; VGL Data 1881–1993.
Notes: DJF = Dec–Feb, MAM = Mar–May, JJA = Jun–Aug, SON = Sep–Nov. The superscripts a, b, and c denote rejection of the null hypothesis of no global warming at the 1, 2.5, and 5% levels of significance, respectively. The superscripts ∗∗∗ , ∗∗ , and ∗ denote rejection of a unit root in the errors at the 1, 2.5, and 5% levels of significance, respectively. The J is a left tail test with 1, 2.5, and 5% critical values of 0.488, 0.678 and 0.908, respectively. The pre-specified constants for the t DAN test are 1.322 (5%), 1.795 (2.5%) and 2.466 (1%). The pre-specified constants used for the t − PS test are 0.716 (5%), 0.995 (2.5%) and 1.501 (1%). Critical Values for Test Statistics % tDAN t − PS 0.950 1.710 1.720 0.975 2.052 2.152 0.990 2.462 2.647
35
36
THOMAS B. FOMBY AND TIMOTHY J. VOGELSANG
hemisphere using the JOBP data. In that case, the OLS point estimate of  is only 0.026 and the null hypothesis of no global warming cannot be rejected by either t-test. The corresponding OLS point estimate using the VGL data is also relatively small, 0.029, but in that case the null hypothesis of no global warming can be rejected at the 5% level using t DAN . Differences in the strength of the serial correlation in the JOBP series versus the VGL series, as indicated by the J statistic, could explain these conflicting results. Note that overall, the J statistic suggests that most time series in our data sets have covariance stationary errors. It is interesting to note that in general the VGL data leads to larger slope estimates than the JOBP data set. This may be a function of the years spanned by the data because unreported results for the JOBP data set using the years 1881–1993 have larger slope point estimates than reported in Table 1.
3. MULTIVARIATE ANALYSIS: SEASONAL PATTERNS IN GLOBAL WARMING NORTH/SOUTH COMPARISONS Because evidence of global warming is convincing in the data, we can then ask whether warming is occurring at the same rates across the seasons and hemispheres. The point estimates in Tables 1 and 2 suggest there are interesting differences and similarities. For the globe, there is relatively little difference in warming trends across the seasons in the JOBP data set, but some differences are evident in the VGL data where warming in the December–May months appears greater than in the June–November months. Within hemispheres, there are interesting warming patterns across the seasons. For both data sets and both hemispheres, summers appear to be warming the slowest and winters appear to be warming the fastest. Patterns across seasons seem similar in the north and south. Are they the same? Hypotheses such as these can be written as linear restrictions on the slope parameters across the series and we can apply the multivariate linear trend tests of Franses and Vogelsang (2002). Consider the multivariate trend model y1,t = 1 + 1 t + u1,t y2,t = 2 + 2 t + u2,t .. . yn,t = n + n t + un,t that can be compactly written as Y t = + t + U t
(5)
Tests of Common Deterministic Trend Slopes Applied
37
where Y t = ( y 1,t , y 2,t , . . . , y n,t ) , U t = (u 1,t , u 2,t , . . . , u n,t ) ,  = (1 , 2 , . . . , n ) and = (1 , 2 , . . . , n ) . For hypotheses about seasonal differences in the slopes within the globe or a hemisphere, n = 4. For hypothesis involving differences or similarities between the north and south, n = 8. We are interested in testing hypotheses of the form H0 :
R = r,
H1 :
R = r,
(6)
where R is a q × n matrix and r is a q × 1 vector of known constants. The linear hypotheses of (6) are quite general. They include linear hypotheses on slopes within given trend equations as well as joint trend hypotheses across equations. We apply two tests analyzed by Franses and Vogelsang (2002). Both statistics are functions of the following HAC variance covariance matrix estimator. Let ˆ i and ˆ i denote the single equation OLS estimates of i and i . Let uˆ i,t = y i,t − ˆ i − ˆ i t denote the equation by equation OLS residuals. Stack the OLS estimates and residuals into vectors ˆ = (ˆ 1 , ˆ 2 , . . . , ˆ n ) and Uˆ = (uˆ 1,t , uˆ 1,2 , . . . , uˆ 1,n ) . Define T −1 j ˆ ˆ
= 0 + k (ˆ j + ˆ j ), M where ˆ j = T
−1 T
j=1
ˆ ˆ t=j+1 Ut Ut−j .
ˆ The first, denoted by ˆ QS ˆ , follows Andrews We use two configurations of . M=M (1991) and uses the quadratic spectral kernel3 for k(x) and a data dependent ˆ based on the VAR(1) plug-in formula. See Andrews (1991) bandwidth, M, ˆ Bart for the formulas. The second configuration is denoted by M=T and uses the Bartlett kernel for k(x) and bandwidth M = T. As shown by Kiefer and Vogelsang ˆ Bart (2002), Kiefer, Vogelsang and Bunzel (2000) first proposed using M=T in stationary regressions, and Franses and Vogelsang (2002) extended their results to multivariate linear trend models. The statistics we use are defined as −1 −1 T QS ˆ M=M R (R ˆ − r), W = (R ˆ − r) R
(t − ¯t )2 t=1
−1 −1 T R ˆ − r ˆ Bart (t − ¯t )2
. F ∗ = (R ˆ − r) R M=T R q t=1
Note that the F∗ statistic was labeled F ∗2 by Franses and Vogelsang (2002). Under the assumption that the errors are covariance stationary, the distribution theory
38
THOMAS B. FOMBY AND TIMOTHY J. VOGELSANG
for W is standard and W converges in distribution to a 2q random variable. The asymptotic distribution theory for F∗ is non-standard and was developed by Franses and Vogelsang (2002) for the case where the errors are covariance stationary4 . Simulation evidence reported by Franses and Vogelsang (2002) suggests that the F∗ tests suffers much less from the over-rejection problem caused by strong positive serial correlation than W whereas power of F∗ is only slightly lower than power of W. Therefore, rejections obtained using F∗ are more robust to the overrejection problem. Finite sample simulation evidence in Franses and Vogelsang (2002) also suggested that the performance of both W and F∗ are improved when ˆ is computed using VAR(1) prewhitening (see Andrews & Monahan, 1992 for
details). Therefore, we use VAR(1) prewhitening in all cases. Note that the use of prewhitening has no effect on the asymptotic distributions of the tests. The hypotheses we are interested in testing vis-`a-vis the JOBP and VGL data sets are the following: (i) For the northern and southern hemispheres, separately, and for the globe as a whole, are all seasons, simultaneously, without trend? In the presence of trend, are the trends of all seasons in each hemisphere equal to each other? For the globe, are the trends of all seasons equal to each other? For each hemisphere and, separately, for the globe, are there pairs of seasons that have equal trends? We refer to these hypotheses as “Intra-seasonal” hypotheses because they relate to the comparison of trends of seasons within separate hemispheres or the globe itself (ii) Are the trends for the four seasons the same across hemispheres? Across the hemispheres do the winters have the same trend? the springs? the summers? the autumns? We refer to these hypotheses as “Inter-seasonal” hypotheses because they relate to the comparison of trends of seasons across hemispheres. Tables 3 and 4 report the results of the Intra-seasonal hypothesis tests. Some major conclusions that can be drawn are as follows: The null hypothesis that all of the seasons jointly have zero slopes is strongly rejected using both the W and F∗ statistics. The null hypothesis that the warming trends are the same across the seasons is rejected in all cases with the possible exception of the southern hemisphere in the JOBP data set. There the slope point estimates are similar and the F∗ statistic cannot reject the null hypothesis that they are equal. Pair-wise tests of the null of equal slopes across the seasons confirm what is apparent in the point estimates. Summers (June–August) in the northern hemisphere are warming slower than the winters (December–February) and to
Tests of Common Deterministic Trend Slopes Applied
39
Table 3. Intra-Seasonal Hypotheses; JOBP Data 1857–1998. Global
All seasons zero (q = 4) All seasons equal (q = 3) DJF = MAM (q = 1) DJF = JJA (q = 1) DJF = SON (q = 1) MAM = JJA (q = 1) MAM = SON (q = 1) JJA = SON (q = 1)
North
South
W
F∗
W
F∗
W
F∗
131.7a 20.96a 0.822 8.489a 0.080 5.754b 0.179 12.92a
364.6a 45.13c 6.260 42.40c 0.155 15.39 0.227 22.42
144.4a 40.15a 2.607 24.83a 0.838 15.90a 0.517 26.17a
248.0a 52.50c 28.08 145.9a 1.434 88.56a 0.692 27.96
106.0a 8.137c 4.397c 7.952a 1.563 3.397 0.410 4.286c
123.0a 16.98 10.81 45.88c 5.744 14.54 6.052 26.64
Notes: The superscripts a, b, and c denote rejection of a null hypothesis at the 1, 2.5, and 5% levels of significance, respectively. Critical Values for Test Statistics, q = 4 % W F∗ 0.950 9.488 43.83 0.975 11.14 54.59 0.990 13.28 69.29 Critical Values for Test Statistics, q = 3 % W F∗ 0.950 7.815 41.45 0.975 9.348 52.86 0.990 11.34 68.67 Critical Values for Test Statistics, q = 1 % W F∗ 0.950 3.841 41.53 0.975 5.024 58.56 0.990 6.635 83.95
a lesser extent slower than the spring or autumn (according to the slope point estimates). The same pattern, summers (December–February) warming slower than winters (June–August), occurs in the southern hemisphere as well and the formal statistical evidence is convincing in the case of the VGL data. The Inter-seasonal hypothesis tests are reported in Table 5. There appears to be some heterogeneity in seasonal patterns of warming between the northern and southern hemispheres. The joint hypothesis that winters are warming at the same rate in the northern and southern hemispheres, springs are warming at the same rate, etc. can be rejected for both series using the W statistic.
40
THOMAS B. FOMBY AND TIMOTHY J. VOGELSANG
Table 4. Intra-Seasonal Hypotheses; VGL Data 1881–1993. Global
All Seasons Zero (q = 4) All Seasons Equal (q = 3) DJF = MAM (q = 1) DJF = JJA (q = 1) DJF = SON (q = 1) MAM = JJA (q = 1) MAM = SON (q = 1) JJA = SON (q = 1)
North
W
F∗
82.78a 45.74a 2.286 9.312a 16.17a 22.88a 39.83a 3.007
137.0a 127.8a 12.04 82.94b 78.94b 95.53a 130.2a 6.014
W 86.56a 83.66a 3.359 43.81a 27.57a 56.01a 15.94a 3.728
South F∗
W
F∗
247.8a 321.3a 8.027 63.91b 280.8a 234.0a 21.74 3.421
142.7a 24.50a 13.97a 15.66a 0.001 0.042 20.76a 18.50a
238.3a 34.07a 23.12 27.40 0.002 0.162 63.92b 73.81b
Notes: The superscripts a, b, and c denote rejection of a null hypothesis at the 1, 2.5, and 5% levels of significance, respectively. Critical Values for Test Statistics, q = 4 % W F∗ 0.950 9.488 43.83 0.975 11.14 54.59 0.990 13.28 69.29 Critical Values for Test Statistics, q = 3 % W F∗ 0.950 7.815 41.45 0.975 9.348 52.86 0.990 11.34 68.67 Critical Values for Test Statistics, q = 1 % W F∗ 0.950 3.841 41.53 0.975 5.024 58.56 0.990 6.635 83.95
Using the more size robust F∗ test, this null hypothesis can also be rejected for the VGL data set but not for the JOBP data set. Pair-wise tests of equal warming for given seasons between the hemispheres suggest that warming patterns in the winter, spring, and autumn are equal in the northern and southern hemispheres for the JOBP data set with only a difference in the summers where warming has been greater in the southern hemisphere. For the VGL data set, winters and summers have been warming at the same rates in the northern and southern hemispheres with differences in warming rates in the spring and autumn. Overall, these tests suggest that there is substantial heterogeneity in seasonal warming trends across hemispheres.
Tests of Common Deterministic Trend Slopes Applied
41
Table 5. Inter-Hemisphere Hypotheses. JOBP Data
All seasons in north and south equal (q = 4) North winter = South winter (q = 1) North spring = South spring (q = 1) North summer = South summer (q = 1) North autumn = South autumn (q = 1)
VGL Data
W
F∗
W
F∗
18.91a 0.020 0.293 8.921a 0.000
29.10 0.157 1.600 25.90 0.000
49.79a 1.731 9.480a 1.872 6.043b
233.3a 5.186 46.75c 7.394 15.05
Notes: The superscripts a, b, and c denote rejection of a null hypothesis at the 1, 2.5, and 5% levels of significance, respectively. Critical Values for Test Statistics, q = 4 % W F∗ 0.950 9.488 43.83 0.975 11.14 54.59 0.990 13.28 69.29 Critical Values for Test Statistics, q = 1 % W F∗ 0.950 3.841 41.53 . 0.975 5.024 58.56 0.990 6.635 83.95
4. CONCLUSIONS The multivariate deterministic trends model of Franses and Vogelsang (2002) is used to examine some interesting hypotheses concerning global warming by season and hemisphere. Global warming appears to be present in each season in the global series of the JOBP and VGL data sets with the possible exception of the June–August season in the northern hemisphere for the JOBP data set. A more informative look at seasonal warming, however, can be obtained by looking at the hemispheric temperatures separately. For both hemispheres and both data sets, winters appear to be warming the fastest and summers the slowest with their trends being significantly different. This heterogeneity of warming occurs not only within hemispheres but also across hemispheres. Only the winter season appears to have the same warming trend across hemispheres. Coming to understand why differential warming trends exist by season and hemisphere would provide an interesting topic for future research.
42
THOMAS B. FOMBY AND TIMOTHY J. VOGELSANG
NOTES 1. The idea of using heteroskedasticity robust standard errors appeared earlier in the statistics literature in work by Eicker (1967). White (1980, p. 821) points out this fact and notes with surprise that the econometrics literature seemed unaware of these results for over ten years. 2. These results confirm for the quarterly frequency the statistical significance of warming reported by Fomby and Vogelsang (2002) for annual global temperature. 3. Franses and Vogelsang (2002) only considered the Bartlett kernel. 4. The assumption of covariance stationary errors is reasonable for the global warming data given the J statistic results reported in Tables 1 and 2.
REFERENCES Andrews, D. W. K. (1991). Heteroskedasticity and autocorrelation consistent covariance matrix estimation. Econometrica, 59, 817–854. Andrews, D. W. K., & Monahan, J. C. (1992). An improved heteroskedasticity and autocorrelation consistent covariance matrix estimator. Econometrica, 60, 953–966. Bunzel, H., & Vogelsang, T. J. (2003). Powerful trend function tests that are robust to strong serial correlation with an application to the Prebisch-Singer hypothesis, Working Paper, Department of Economics, Cornell University. den Haan, W. J., & Levin, A. (1997). A practictioner’s guide to robust covariance matrix estimation. In: G. Maddala & C. Rao (Eds), Handbook of Statistics: Robust Inference (Vol. 15, pp. 291–341). New York: Elsevier. Eicker, F. (1967). Limit theorems for regressions with unequal and dependent errors, Proceedings of the fifth Berkeley Symposium on mathematical statistics and probability, Vol. 1, University of California Press, 59–82. Fomby, T. B., & Vogelsang, T. J. (2002). The application of size robust trend analysis to global warming temperature series. Journal of Climate, 15, 117–123. Franses, P. H., & Vogelsang, T. J. (2002). Testing for common deterministic trend slopes, center for analytic economics, Working Paper 01–15, Cornell University. Gallant, A. (1987). Non-linear statistical models. New York: Wiley. Gallant, A., & White, H. (1988). A unified theory of estimation and inference for non-linear dynamic models. New York: Blackwell. Grenander, U., & Rosenblatt, M. (1957). Statistical analysis of stationary time series. New York: Wiley. Hansen, L. P. (1982). Large sample properties of generalized method of moments estimators. Econometrica, 50, 1029–1054. Hansen, B. E. (1992). Consistent covariance matrix estimation for dependent heterogenous processes. Econometrica, 60, 967–972. Intergovernmental Panel on Climate Change (IPCC) Report: Climate change 2001: Synthesis report available at the URL www.ipcc.ch/pub/un/syreng/spm.pdf Jones, P. D., Parker, D. E., Osborn, T. J., & Briffa, K. J. (1999). Global monthly and annual temperature anomalies (degrees C), 1856–1998, Feb., Climatic Research Unit, School of Environmental Sciences, University of East Angelia, Norwich, United Kingdom. This data is available from
Tests of Common Deterministic Trend Slopes Applied
43
the authors or a more recent version of the data (through 2000) is available from the Oak Ridge National Laboratory at http://cdiac.esd.ornl.gov/ftp/trends/temp/jonescru Kaufmann, R. K., & Stern, D. I. (2002). Cointegration analysis of hemispheric temperature relations. Journal of Geophysical Research, 107 (DX), 10.1029/2000JD000174, 2002. (On-line version.) Kiefer, N. M., & Vogelsang, T. J. (2002). Heteroskedasticity-autocorrelation robust standard errors using the Bartlett Kernel without truncation. Econometrica, 70, 2093–2095. Kiefer, N. M., Vogelsang, T. J., & Bunzel, H. (2000). Simple robust testing of regression hypotheses. Econometrica, 68, 695–714. Newey, W. K., & West, K. D. (1987). A simple, positive semi-definite, heteroskedasticity and autocorrelation consistent covariance matrix. Econometrica, 55, 703–708. Newey, W. K., & West, K. D. (1994). Automatic lag selection in covariance estimation. Review of Economic Studies, 61, 631–654. Park, J. Y. (1990). Testing for unit roots and cointegration by variable addition. In: T. Fomby & F. Rhodes (Eds), Advances in Econometrics: Cointegration, Spurious Regressions and Unit Roots (pp. 107–134). London: JAI Press. Park, J. Y., & Choi, I. (1988). A New Approach to Testing for a Unit Root, Center for Analytic Economics, Cornell University, Working Paper 88–23. Priestley, M. B. (1981). Spectral analysis and time series (Vol. 1). New York: Academic Press. Robinson, P. (1998). Inference-without smoothing in the presence of non-parametric autocorrelation. Econometrica, 66, 1163–1182. Vinnikov, K. Y., Groisman, P. Y., & Lugina, K. M. (1994). Global and hemispheric temperature anomalies from instrumental surface air temperature records. In: T. A. Boden, D. P. Kaiser, R. J. Sepanski & F. W. Stoss (Eds), Trends 1993: A compendium of data on global change. Carbon Dioxide Information Analysis Center, Oak Ridge National Laboratory, 615–627. This data is available from the authors or from the Oak Ridge National Laboratory at http://cdiac.esd.ornl.gov/ftp/trends93/temp/global.618 http://cdiac.esd.ornl.gov/ftp/trends93/ temp/nhem.621 http://cdiac.esd.ornl.gov/ftp/trends93/temp/shem.624 Vogelsang, T. J. (1998). Trend function hypothesis testing in the presence of serial correlation correlation parameters. Econometrica, 65, 123–148. White, H. (1980). A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica, 48, 817–838. White, H., & Domowitz, I. (1984). Non-linear regression with dependent observations. Econometrica, 52, 143–161.
THE SANDWICH ESTIMATE OF VARIANCE James W. Hardin ABSTRACT This article examines the history, development, and application of the sandwich estimate of variance. In describing this estimator, we pay attention to applications that have appeared in the literature and examine the nature of the problems for which this estimator is used. We describe various adjustments to the estimate for use with small samples, and illustrate the estimator’s construction for a variety of models. Finally, we discuss interpretation of results.
1. INTRODUCTION Section 2 examines the assumptions allowing construction of the sandwich estimate of variance. Section 3 illustrates the robustness property of the sandwich estimator in a simple univariate setting along with further developments and generalizations. We illustrate this construction with several detailed illustrations in the subsequent sections. Various applications are examined subject to the assumptions of the sandwich estimator including linear regression, two-stage models compared to the Murphy–Topel variance estimate, other two-stage models, multi-stage models, and generalized estimating equations. Section 8 then presents a summary.
Maximum Likelihood Estimation of Misspecified Models: Twenty Years Later Advances in Econometrics, Volume 17, 45–73 Copyright © 2003 by Elsevier Ltd. All rights of reproduction in any form reserved ISSN: 0731-9053/doi:10.1016/S0731-9053(03)17003-X
45
46
JAMES W. HARDIN
2. HISTORICAL DEVELOPMENT The history of the sandwich estimate of variance focuses on the results presented by Huber (1967) wherein the author formally developed properties of maximum likelihood estimators (i) not assuming that the true distribution underlying observations belonged to the parametric family defining the estimator and (ii) the regularity conditions do not involve second and higher derivatives of the likelihood. Huber took advantage of the consistency results of Wald (1949) and was likely aware of hints and motivations for this particular problem in Fisher (1935). The Berkeley conference at which Huber presented his results was also the forum where Eicker (1967) discussed results for the particular case of linear regression. His work extended an earlier illustration of the asymptotic results for families of regressions in Eicker (1963). While there are several results provided in Huber’s paper, our focus is on the corollary (p. 231) which states that if the expected value of the estimating equation E((x, 0 )) has a nonsingular derivative A at 0 , then √ for the estimating function T n (x 1 , . . . , x n ), or simply T n , of 0 , we have that n(T n − 0 ) is asymptotically normal with mean zero and covariance matrix given by V S = A−1 BA−T . We call V S the sandwich estimator. Here, B is the covariance matrix of the estimating equation (x, 0 ) and A is the Hessian matrix for the estimating equation. The assumptions underlying the corollary include (1) x 1 , x 2 , . . . , x n are independent random variables with a common probability distribution. (2) The expected value of the estimating equation has a unique zero at 0 which is in the parameter space of . (3) The estimating equation is measurable and separable; this condition ensures that the estimating equation infima is measurable. (4) The expectation of the covariance of the estimating equation is finite (this is matrix B above). Other assumptions ensure that the estimating equation is smooth near 0 ; that the derivative of the estimating equation at 0 is finite. Huber’s paper is aimed at statistical theorists such that the applicability of the results was not immediately apparent to a wide audience of interested researchers. Independently, White (1980) derived the sandwich estimate of variance (and its properties) in the case of linear regression. While the presentation was still theoretical, the practical utility of the results was more easily discerned; White (1982b) subsequently placed even more emphasis on the robustness properties of the estimator. These papers brought the sandwich estimator to the forefront
The Sandwich Estimate of Variance
47
for many researchers and is the reason that the sandwich estimator is known as White’s estimator to so many scientists. White’s goal mirrors that of Huber’s in that both articles (Huber, 1967; White, 1980) investigate the assumptions that justify the construction of a valid variance estimate under misspecification. The end result is that test statistics and confidence intervals based on the sandwich estimate of variance are robust to model misspecification. In general, the construction of the sandwich estimator is straightforward. More sophisticated analysis is required to use the resulting estimator as a genesis for deriving test statistics for model misspecification. This application is emphasized in White (1982b). In Section 7, we address the interpretation of analyses using the sandwich estimator. While the title of Huber’s paper implies that the corollary is in terms of maximum likelihood models, the assumptions actually include the application ˆ of estimating equations of the form of this variance estimator for solutions, , (x, ) = 0. This specification does not require that the estimating equation is a derivative of a log-likelihood. In the usual application of the sandwich estimate of variance, a model is derived from a likelihood. The estimating equation is then the derivative of the log-likelihood with respect to the vector of parameters. Setting this equation to zero and solving for the parameters yields maximum likelihood estimates. However, we need not start from a likelihood specification. A simple example is quantile regression which directly specifies the estimating equation. A second example is generalized linear models (GLMs) or the class of GEE models that have a genesis in the estimating equation. The GEE models directly introduce second order variance components. The most general presentation of GLMs and GEE do not start from a likelihood. Rather, these models specify an estimating equation that implies a quasi-likelihood. The results presented here apply to this larger class of models based on estimating equations. Stefanski and Boos (2002) build on the results of Hampel (1974) by pointing out that we are constructing the variance estimate of an M-estimator such that the corollary holds for this entire class. Another powerful result is given in Binder and Patak (1994) where the authors show that the estimating equation may be partitioned. This result allows us to easily justify the application of the corollary to two (and higher) stage models. We highlight this result in the next section. Miller (1974) presents a review of the jackknife and infinitesimal jackknife wherein the equivalence of the variance estimate built from the infinitesimal jackknife and the variance matrix described in the corollary can be inferred. We use this result to highlight the derivation of the sandwich estimate of variance for the proportional hazards model in the next section; see Cox (1972) and Lin and Wei (1989).
48
JAMES W. HARDIN
Over the last 35 years there have been many rediscoveries, studies, summaries, and extensions of this estimator. Royall and Cumberland (1978) look at the estimator in regard to survey sampling, and Royall and Cumberland (1985) investigate the coverage probabilities of confidence intervals constructed from the sandwich estimate of variance. Gail et al. (1988) investigate the usefulness of the sandwich estimator in biostatistical applications. Newey and West (1987) expand on the work of White (2000) to extend the sandwich estimator for the case of autocorrelation in linear regression. White’s text presents a general treatment for this case. The Newey–West contribution was to derive a formula for which the resulting estimator was always positive definite since White’s treatment was not guaranteed to produce results with that property; this focus by Newey and West is the genesis of the title of the their paper. The so-called Newey–West estimator replaces the usual B matrix with a weighted sum of matrices calculated using lagged residuals where the weights are taken from the Bartlett kernel. Following the Newey and West paper, several papers focused on alternatives to the Bartlett kernel weights. These papers include Gallant (1987) specifying weights from the Parzen (1957) kernel and Andrews (1991) specifying weights from the Tukey–Hanning kernel. Newey and West’s original description required a specification of the number of lags to consider in constructing the matrix in the middle of the sandwich. Later, Newey and West (1994) considered automated techniques, and Lumley and Heagerty (1999) considered adaptive, as opposed to kernel, methods for selecting weights. Wooldridge (1991) provides an excellent review that focuses on the interpretation of the sandwich estimator including the extensions of Newey and West. Another review which focuses on the properties of the sandwich estimate of variance is given in Kauermann and Carroll (2001). Application of the sandwich estimate of variance for panel data is discussed in Xie et al. (2000). Due to the specific circumstances and assumption sets under which various authors have derived this estimator, it is known by various names. These names include the sandwich estimator (used throughout this article), Huber’s estimator, White’s estimator, the survey design estimator, and the robust variance matrix. It is also called the empirical variance estimator since the B matrix is formed from the observations without regard to underlying parametric theory, but we dislike this practice since only the B matrix in the construction is empirical. Hardin and Hilbe (2001) present a more complete list with comments.
3. ROBUSTNESS This section presents a simple illustration of the robustness property of the sandwich estimator; see Royall (1986) for further illuminating examples. We will
The Sandwich Estimate of Variance
49
consider estimating the probability of success p from an assumed binomial model. In addition, we will examine both variance estimators (naive and sandwich) when the underlying true model is actually hypergeometric. Consider a sample of n observations y 1 , . . . , y n from the binomial (m, p) distribution. We want to estimate the variance of pˆ in order to develop valid asymptotic confidence intervals. The log-likelihood (where NF is the normalization factor) is given by L( p; y 1 , . . . , y n ) =
n
{y i ln p + (m − y i ) ln(1 − p) + NF}
i=1
where the estimating equation for p is then n n 1 1 ∂L yi − (m − y i ) = 0 = ( p) = ∂p p 1−p i=1
i=1
It is clear from the estimating equation that the maximum likelihood estimator is pˆ = y¯ /m. Further, we can easily derive the expected value of the inverse second derivative A = E( ( p)) as pq/mn where q = 1 − p. The empirical part of the sandwich estimator (the matrix B) is given by n yi m − yi 2 − p q i=1
Assuming that the Binomial model is true, the expected value of B is given by mn/pq, and the sandwich estimate of variance has expected value pq mn pq pq = mn pq mn mn Since the variance of pˆ is also pq/mn, we see that both the usual Hessian estimator and the sandwich estimator have the same (correct) value. Now, let’s assume that the true underlying model is hypergeometric (M, Y, m). Instead of considering this distribution in terms of the number of success in the population Y, we consider the distribution in terms of the proportion of successes in the population p = Y/M. In this case, the expected value of the empirical part of the sandwich estimator is pq(M − m)/[mn(M − 1)] and the sandwich estimate of variance then has expected value pq pq M − m pq pq(M − m) = (1) mn mn M − 1 mn mn(M − 1) while the expected value of the Hessian does not change. The variance of pˆ assuming the hypergeometric distribution is the same as given for the sandwich estimator (Eq. (1)) illustrating the robustness to misspecification
50
JAMES W. HARDIN
of the underlying model. It is also important to note that the sandwich estimator is not necessarily larger than the information-based variance estimator. In this particular case, it is smaller on average. The validity of a confidence interval is affected by (i) the consistency of the √ estimator pˆ for p, (ii) the asymptotic normality (limiting distribution) of n(pˆ − p), and (iii) the consistency of the information-matrix-based estimate of the variance of the limiting distribution. The first two properties are quite robust – another focus of Huber (1967) is a formal investigation of these properties. The weakness in results (for model-based variance estimators) is in the last property where the (Hessian) variance estimate is defined by the assumed distribution of the outcome. Hessian-based variance estimators are not robust to misspecification of the distribution. In addition to this simple illustration, we can also find direct results for generalized linear models with misspecified variances. Here, assume a misspecified model where the true variance is V 2 (), but we fit the model assuming the variance is V 1 (). The estimating equation for the fitted model is given by n y i − i ∂ () = =0 a()V 1 () ∂ i=1
where g() = and g −1 () = are the pair of link/inverse link functions, and we assume that the variance is a function of the mean V(y) = a()V 1 (). For the constant only model (single parameter case = X = ), the maximum likelihood estimator is given by ˆ = g( y/n). Under the true model, we have E(y) = , V(y) = a()V 2 (), and, therefore, E(y 2 ) = a()V 2 () + 2 . Now, we can investigate the variance of the maximum likelihood estimator and compare that to the model-based and sandwich variance estimators. The sandwich estimator is robust to misspecification of the underlying model and therefore should be robust to misspecification of the variance function. The variance of the maximum likelihood estimator (fitted under the incorrect model) under the true model is given by y 1 1 ˆ V() = V g = g 2 2 nV(y) = g 2 a()V 2 () n n n 2 ∂ 1 = a()V 2 () n ∂
The Sandwich Estimate of Variance
51
while the model based variance and the middle of the sandwich estimator (the empirical estimator) are given by 2 1 ∂ −1 A = a()V 1 () n ∂ n n ∂ 2 1 B= i ()2 = ( y − i )2 ∂ a()2 V 1 ()2 i i=1
i=1
Using the expected value of the empirical variance estimator to examine the expected value of the sandwich estimator results in 2 n 1 ∂ E(y 2i − 2y i i + 2i ) E(B) = ∂ a()2 V 1 ()2 =n
V 2 () a()V 1 ()2
E(V S ) = A
−1
E(B)A
−T
∂ ∂
2
i=1
2 1 ∂ = a()V 2 () n ∂
Compared to the variance of the estimator, we see that the model-based variance ˆ under misspecification of variance, while the estimator is incorrect A−1 = V() ˆ sandwich estimator is correct on average E(V S ) = V().
4. APPLICATIONS In the following subsections, we highlight the detailed construction of the sandwich estimate of variance for various models. This collection of examples allows us to emphasize the techniques that may be utilized. We include in our discussion the use of the so-called modified sandwich estimate of variance. See Kim and White (2003) for a detailed use of the sandwich variance estimate for quantile regression, and Vogelsang (2003) for an application under generalized methods of moments models.
4.1. Single Equation Maximum Likelihood Models The applicability and derivation of the sandwich variance estimate for single equation maximum likelihood models is straightforward. Models derived assuming
52
JAMES W. HARDIN
independent and identically distributed outcomes clearly satisfy the assumptions of the corollary and, thus admit construction of the sandwich estimator. Derivation of the estimator involves writing the log-likelihood. We then take a derivative with respect to the parameter vector of interest. This derivative, called the score equation, is the estimating equation; it is the equation which when solved provides the estimates of the parameters. The contributions to the score equation, apart from the covariates, are residuals called scores. The sandwich estimate of variance for single equation maximum likelihood models V S = A−1 BA−T is constructed using n
∂() i ()i (T ) , B= A= − ∂ i=1
For example, consider the Poisson regression model for which the expected count is reparameterized via the log link to ensure non-negativity of the predicted counts. Our goal is to construct the sandwich estimate of variance for the regression parameters . The log-likelihood L is given by L(|X, y 1 , . . . , y n ) =
n
−exp(xi ) + y i xi  − ln (y i + 1)
i=1
and the estimating equation is n ∂L yi ∂ () = = −1 x ji = [0] ∂j i ∂ i i=1
Estimation of the A and B matrices assuming the log link xi  = ln(i ) is then Aˆ = −XT Diag()X, ˆ
ˆ = B
n
xi (y i − ˆ i )2 xTi
i=1
ˆ and xi is the ith row of the design matrix. This straightforwhere ˆ = exp(xi ) ward construction is valid for both FIML models, and LIML models including ancillary parameters. Consider an underlying true model where observations are grouped into panels. Assuming that the observations are correlated within panels, but that panels are uncorrelated, admits a further generalization of the usual sandwich estimate of variance. We believe that this generalization is first formally used in Rogers (1993), though the author, who was a student of Huber, claims that the extension was obvious to his advisor. The modified sandwich estimate of variance is a modification of the meat of the sandwich; the B matrix. Instead of summing the outer product of the individual
The Sandwich Estimate of Variance
53
score contributions, we instead sum the products of the panel-based sums of score contributions. The bread of the sandwich, the A matrix, is unchanged in this modification. We describe this procedure assuming that there are n panels where each panel has n i observations. Constructing the appropriate estimated matrix for Poisson regression, we have n n n i i T ˆ = B xit (y it − ˆ it ) (y it − ˆ it )xit i=1
t=1
t=1
See Section 7 for further notes on interpreting this estimator. Other modifications focus on the score contributions. Kauermann and Carroll (2001) point out that these contributions are biased and can be replaced with unbiased contributions. At least by these authors, the resulting estimator is then called the unbiased sandwich estimate of variance. MacKinnon and White (1985) also consider the unbiased sandwich variance estimator among other estimators for a study in linear regression, and we will look at their findings in more detail in Section 6.
4.2. The Infinitesimal Jackknife Approach While the focus of Cain and Lange (1984) is the development of influence statistics, we follow the same arguments for building the infinitesimal jackknife variance estimate in order to highlight the equivalence to the sandwich estimate of variance for the Cox proportional hazards model formally derived in Lin and Wei (1989). These arguments are also presented in Miller (1974) and Efron (1981). The partial likelihood L is given by exp(xi ) L= k∈R i exp(xk ) i∈D
The model is developed for survival analysis. The terminology of this area of study assumes that a group of patients are followed over time. Some of these patients will die. The likelihood is in terms of the death times D i in the set of all death times D. At each death time, there is a pool of patients R i who are at risk to die. Though the terminology is in terms of death and people, the model holds for studies in which we change death to failure and patients to items. The specification attempts to model survival times and so individual patients actually appear in many of the contributions to the likelihood. This violates the assumption of independence needed to construct the sandwich estimate of
54
JAMES W. HARDIN
variance. What is needed is an equivalent representation of the likelihood in terms of the independent contributions to the likelihood for each patient. Equivalently, we seek the change in ˆ when we leave out an individual patient j. Initially, we consider a (patient) weighted analysis where all of the weights are one except for patient j. A first order Taylor expansion about the weight for patient j ˆ given by wj is approximately equal to the change in the fitted coefficients; ∂/∂w j is approximately equal to ˆ − ˆ (j) where ˆ (j) is the usual leave-out notation indicating the the fitted coefficients are obtained leaving out observations on patient j. The variance of this estimator then has the same form as the sandwich estimator. The derivative we seek is obtained by considering that the estimating equation is a function of both  and wj so that an application of the chain rule defines ˆ /∂w ˆ (∂/∂)(∂ j ) = 0. If we solve for the derivative of interest, we then have ˆ ˆ −1 ∂/∂wj . The variance is formed noting that the first term ∂/∂wj = −(∂/∂) in the resulting product is the A−1 in the sandwich estimator. To obtain the middle of the infinitesimal (sandwich) variance estimator ∂/∂wj , we must specify the manner in which the weights enter the partial likelihood wj exp(xi ) L= k∈R i exp(xk ) i∈D
Under this specification, the estimating equation is then given by ˆ w w x exp(x ) i k k k k∈R ˆ = w i xi − i ˆ k∈R i wk exp(xk ) i∈D and we differentiate this with respect to wj to obtain a form of the estimating equation that satisfies the independence assumption. The result is an estimating equation that is squared (in the outer matrix sense) to estimate the meat of the sandwich and is the same as given in Lin and Wei (1989). Binder (1992) illustrates the same variance estimate including sampling weights in the original design.
4.3. Two-Stage Maximum Likelihood Models Numerous models have been presented in the literature in which one model is embedded in another. Such models are broadly known as two-step estimation problems and are characterized as Model 1 :
E[y1 |x1 , 1 ]
Model 2 :
E[y2 |x2 , 2 , E[y1 |x1 , 1 ]]
The Sandwich Estimate of Variance
55
The overall model indicates that there are two parameter vectors to estimate. The first parameter vector 1 appears in both models, but the second parameter vector 2 appears only in the second model. Model 1 has n 1 observations and Model 2 has n 2 observations. In general, n 1 = n 2 and selection models, in particular, are characterized by n 1 > n 2 . There are two standard approaches to estimation. The first approach is a full information maximum likelihood, FIML, model in which we specify the joint distribution f(y1 , y2 |x1 , x2 , 1 , 2 ) and maximize the joint log-likelihood function. Alternatively, we can adopt a limited information maximum likelihood, LIML, two-step procedure. In this approach, we estimate the first model since it does not involve the second parameter vector. Subsequently, we estimate the second parameter vector conditional on the results of the first step estimation; we maximize the conditional log-likelihood L given by L=
n
f [y 2i |x2i , 2 , (x1i , ˆ 1 )]
i=1
Here, and throughout this section, we assume that there are n observations, x1i is the ith row of the X1 design matrix, x2i is the ith row of the X 2 design matrix, and ˆ 1 is the maximum likelihood estimate obtained from the estimation of Model 1. 4.3.1. A Comparison to the Murphy–Topel Estimator We present a comparison of the sandwich estimate of variance and the eponymous Murphy–Topel variance estimator for two-stage models. Greene (2000) gives a concise presentation of one of the results in Murphy and Topel (1985). The presentation, summarized from Hardin (2002), describes a general formula of a valid variance estimator for 2 in a two-stage maximum likelihood estimation model. Interested readers can also consult Lee et al. (1980) for illustration of specific two-stage models. This LIML estimation fits one model which is then used to generate covariates for a second model of primary interest. Calculation of a variance estimate for the regressors 2 in the primary model of interest must address the fact that one or more of the regressors have been generated via (x1 , ˆ 1 ). In order to highlight the derivation and comparison to the sandwich estimate of variance, we assume that 1 is a q × 1 vector of unknown parameters associated with an n × q matrix of covariates X. In addition, 2 is a p × 1 vector of unknown parameters associated with an n × p matrix of covariates W . Following Greene (2000), the formula for the Murphy–Topel variance estimator for 2 is given by V 2 + V 2 [CV 1 C T − RV 1 C T − CV 1 R T ]V 2
(2)
56
JAMES W. HARDIN
where V 1 = (q × q) Asymptotic variance matrix of ˆ 1 based on L1 (1 ) V 2 = (p × p) Asymptotic variance matrix of ˆ 2 based on L2 (2 |1 ) ∂L2 ∂L2 C = (p × q) matrix given by ∂2 ∂T 1 ∂L2 ∂L1 R = (p × q) matrix given by T ∂2 ∂T1
(3)
It should be emphasized that this estimator is only one of several results presented in the original paper. Most textbooks, however, refer only to this specific formula. The component matrices of the Murphy–Topel estimator are estimated by evaluating the formulas at the maximum likelihood estimates ˆ 1 and ˆ 2 . The presentation assumes the existence of a log-likelihood for the first model L1 (1 ) and a conditional log-likelihood for the second (primary) model of interest L2 (2 |1 ). Examining the formula, we see that there is a penalty term added to the naive variance for the estimation that is performed in the first stage. While this aspect of the formula strikes us as a necessity, the origin of the penalty term is not intuitively obvious. The illustration of the sandwich estimate of variance in this instance serves two purposes. First, we highlight the construction of the estimator when the estimating equation is partitioned. Second, we illustrate that the derivation of the sandwich estimate of variance admits an intuitive feel for the penalty term in the Murphy–Topel variance estimate. Our goal is the construction of the sandwich estimate of variance for = (1 , 2 ) partitioning the overall estimating equation as [()] =
1 (1 ) 2 (2 |1 )
= [0]
It is obvious that if our goal is the covariance matrix for 2 instead of the covariance matrix for the complete vector (1 , 2 ), we need only look at the lower ˆ −1 . Likewise, the sandwich estimate of ˆ −1 B ˆA right p × p partition of Vˆ S = A variance for 1 is given by the upper left q × q partition of Vˆ S .
The Sandwich Estimate of Variance
57
Using log-likelihood notation L, we calculate the sandwich estimator working separately with the individual terms of the two model log-likelihoods to get 2 2 ∂ L1 ∂ L1 ∂2 L1 0 ∂ ∂T ∂ ∂T ∂ ∂T 1 2 1 1 1 A= 2 1 = ∂ L2 ∂2 L2 ∂2 L2 ∂2 L2 ∂2 ∂T ∂2 ∂T2 ∂2 ∂T1 ∂2 ∂T2 1 ∂L1 ∂L1 ∂L1 ∂L2 ∂1 ∂1 ∂T1 ∂T2 B = ∂L2 ∂L2 ∂L1 ∂L2 ∂2 ∂2 ∂T1 ∂T2
(4)
The upper right matrix entry of A is zero since 2 does not enter into L1 . That a particular partition is zero is either clear from the two models or is assumed, as in the case of the population averaged generalized estimating equations of Liang (1987). Inserting the component matrices for the Murphy–Topel estimator, we have −V −1 V ∗−1 0 RT 1 1 A= , B= (5) −C ∗ −V −1 R V ∗−1 2 2 The use of asterisks (∗) as superscripts distinguishes similar matrix components where the superscript appears when the component in the sandwich estimator differs from the corresponding component in the Murphy–Topel estimator. For example, the C matrix in the Murphy–Topel estimator is the outer product of the gradients, Eq. (3), while the C ∗ matrix in the sandwich estimator is the inverse matrix of second derivatives; see the lower left matrix of Eq. (4). Carrying out the matrix multiplication A−1 BA−T , we have the partitioned sandwich estimate of variance given by V S (1 ) = V 1 V ∗−1 1 V 1 = V S1
∗T ∗T T CovS (1 , 2 ) = V 1 R T V 2 − V 1 V ∗−1 1 V 1 C V 2 = V 1 R V 2 − V S1 C V 2 ∗T ∗T V S (2 ) = V 2 C ∗ V 1 V ∗−1 1 V 1 C V 2 − V 2 RV 1 C V 2
−V 2 C ∗ V 1 R T V 2 + V 2 V ∗−1 2 V2
∗−1 ∗ ∗T = V 2 V ∗−1 − RV 1 C ∗T − C ∗ V 1 R T ]V 2 2 V 2 + V 2 [C V 1 V 1 V 1 C
= V S2 + V 2 [C ∗ V S1 C ∗T − RV 1 C ∗T − C ∗ V 1 R T ]V 2
(6) As anticipated, the sandwich estimate of variance for 1 is the usual sandwich estimate of variance which considers only the first model. This is the anticipated
58
JAMES W. HARDIN
result since the first model does not involve the second parameter vector 2 . The sandwich estimate of variance for 2 given in Eq. (6) is similar in form to the Murphy–Topel variance estimate in Eq. (2). The two key differences are the use of the sandwich estimators from the separate estimating equation partitions, V S1 and V S2 from the individual models, and the specification of the matrix of second derivatives estimator C ∗ over the outer product of the gradient estimator C. Application of the usual sandwich estimator V S2 considering only the second model provides an estimator that is asymptotically correct when the model is correctly specified. However, V S2 does not have the usual robustness properties if the model is misspecified since the penalty term (the second summand in Eq. (6) is missing). The two-stage Heckman selection, or heckit, model described in Heckman (1976), is an example for which the previous derivation applies. The maximum likelihood Heckman selection model is a single equation maximum likelihood specification that admits a sandwich estimate of variance as described in Section 4.1. 4.3.2. Two-Stage Linear Regression In the two-stage linear regression case (identity link and Gaussian variance) referred to as two stage least squares, the derivation greatly simplifies. This simplification is shown in detail in White (1982a). Here, we present the results of the simplification and summarize the implications for construction of the sandwich variance estimate. The naive (model-based) covariance matrix takes advantage of the fact that V(Y − X W ) = V{Y i − X Wi }I = 2 I where 2 is the mean square ˆ Thus, the variance of the regression coefficients is estiof Y i − X Wi . ˆ = ˆ 2 (XT X P )−1 , where the projection matrix given by ˆ mated by V () P T XP = XS (X S X S )−1 X TS X W is a matrix of the predicted values from using the instruments XS . Therefore, the correct asymptotic variance can be obtained simply by performing a standard linear regression of Y on X P . The sandwich estimate of variance is then clearly given by (XTP X P )−1 X TP (Y − X W )(Y − X W )T X P (X TP X P )−1 such that the usual sandwich estimate from the (second stage) linear regression of Y on X P is correct. Thus, for the standard linear regression case, we may obtain both a modelbased and a sandwich estimate of variance by considering only the second stage regression – making it very easy to obtain results in software that includes the sandwich estimate of variance for linear regression. These simplifications are not true in the general case of a GLM as illustrated in the previous subsection.
The Sandwich Estimate of Variance
59
4.4. Multi-Stage Models We continue development of the sandwich estimate of variance where there are more than 2 models. Our specific example is a presentation in terms of generalized linear models where some of the covariates are measured with error. While there are many techniques for addressing measurement error, our application assumes access to unbiased instruments. The construction would be easy were it not so notationally vexing, but we provide all of the details to highlight the application. We introduce a notation altered from the usual notation for measurement error models. The usual notation involves naming individual matrices: Z for covariates measured without error, W for covariates measured with error, S for the instruments of W , and R for the augmented matrix of exogenous variables [ZS]. To avoid confusion with the measurement error notation and the usual notation associated with generalized linear models (the W weight matrix in the iteratively reweighted least squares, IRLS, algorithm), we demote the usual measurement error notational conventions as subscripts of X. We begin with an n × p matrix of covariates measured without error given by the augmented matrix X = (X1 X2 ), and consider the case for which X 1 = XZ , X2 is unobserved, and X W = X2 plus measurement error. X Z is an n × p z matrix of covariates measured without error (possibly including a constant), and X W is an n × p x (p z + p x = p) matrix of covariates with classical measurement error that estimates X2 . We wish to employ an n × p s (where p s ≥ p x ) matrix of instruments XS for X W . Greene (2000) discusses instrumental variables and provides a clear presentation to supplement the following concise description. The method of instrumental variables assumes that some subset X W of the independent variables are correlated with the error term in the model. In addition, we have a matrix X S of independent variables which are correlated with XW . Given X, Y and X W are uncorrelated. Using these relationships, we can construct an approximately consistent estimator which may be succinctly described. One performs a regression for each of the independent variables (each column) of XW on the instruments and the independent variables not correlated with the error term (X Z X S ). Predicted values are obtained from each regression and substituted for the associated column of XW in the analysis of the GLM of interest. This construction provides an approximately consistent estimator of the coefficients in the GLM (it is consistent in the linear case). If we have access to the complete matrix of covariates measured without error (if we know X 2 instead of just X W ), we denote the linear predictor p = j=1 [X 1 X 2 ]j j , and the associated derivative as ∂/∂j = [X1 X 2 ]j . The
60
JAMES W. HARDIN
estimating equation for  is then
n y i − i ∂ [X 1 X 2 ]ji V(i ) ∂ i i=1
However, since we do not know X 2 , we use X R = (XZ X S ) to denote the augmented matrix of exogenous variables which combines the covariates measured without error and the instruments. We regress each of the p x components (each of the j columns) of XW on X R to obtain an estimated (p z + p s ) × 1 coefficient vector ␥j for j = 1, . . . , p x . The complete coefficient vector ␥ = (␥T1 , ␥T2 , . . . , ␥Tp x )T for these IV regressions is described by the estimating equation T XR (X W1 − X R ␥1 ) T XR (X W2 − X R ␥2 ) 2 = . (7) .. XTR (X Wpx − X R ␥px ) ˆ 2 = [XR ␥ˆ 1 , XR ␥ˆ 2 , . . . , X R ␥ˆ p ] of We may then form an n × p x matrix X x predicted values from the instrumental variables regressions to estimate X2 . Combining the (predicted value) regressors with the independent variables measured without error, we may write the estimating equation of the GLM as n y i − i ∂ [XZ X R ␥]ji (8) 1 = V(i ) ∂ i i=1
where
[XZ X R ␥]ji =
(XZ )ji (X R ␥j−pz )i
if 1 ≤ j ≤ pz if pz < j ≤ pz + px
Operationally, we obtain a two-stage estimate ˆ by first replacing each unknown covariate X W i for i = 1, . . . , p x with the fitted values of the regression of X Wi on (XZ X S ). We call the resulting n × p x matrix of fitted values Xˆ 2 . We then perform a (second stage) usual GLM fit of Y on (X ZXˆ 2 ). This GLM fit provides an estimate of . The construction of the sandwich estimate of variance then follows as in the previous section. The variance matrix obtained from the (second stage) GLM fit described in the previous section assumes that Xˆ 2 = X2 . This is clearly unacceptable. We derive an appropriate sandwich estimate of variance that takes into account the estimation of X2 .
The Sandwich Estimate of Variance
61
The two-stage derivation resulting in an estimate for  involves estimating the combined parameter vector given by = (T ␥T )T . These results are from the estimating equations given in Eqs (7) and (8). While we are ultimately interested in , we must consider all of the parameters in forming the associated variance matrix. Although there are several partitions of the total estimating equation, we specify only two partitions. The partitions devoted to specifying the instrumental variables regression are block diagonal and grouped into a single block for discussion. Again, our goal is construction of the sandwich estimate of variance given by V S = A−1 BA−T . We form the variance matrix, A, for by obtaining the necessary derivatives. The variance matrix A (information matrix) may be calculated numerically, but the analytic derivatives are not difficult. The detailed presentation of these derivatives is
∂1 − ∂ (p +p )×(pz +px ) z x A= ∂2 − ∂ (px (ps +pz ))×(pz +px )
−1 ∂1 − ∂␥ (pz +px )×(px (pz +ps )) ∂2 − ∂␥ (px (pz +ps ))×(px (pz +ps ))
where the derivatives of the first partition are given by 2 n ∂1 1 ∂ =− ∂k V(i ) ∂ i i=1 2 2 ∂ 1 1 ∂V(i ) ∂ − (i − y i ) − V(i ) ∂2 i V(i )2 ∂ i ∂ × [XZ X R ␥]ji [X Z XR ␥]ki
(9)
j = 1, . . . , p z + p x ; k = 1, . . . , p z + p x yields a matrix of size (p z + p x ) × (p z + p x ). 2 n 1 ∂1 ∂ =− V(i ) ∂ i ∂␥k i=1 2 2 ∂V(i ) ∂ 1 1 ∂ − (i − y i ) − 2 ∂ i ∂ V(i ) ∂2 i V(i ) × [XZ X R ␥]ji X Rki +p z
(10)
62
JAMES W. HARDIN
j = 1, . . . , p z + p x ; k = 1, . . . , p z + p s ; = 1, . . . , p x yields a matrix of size (p z + p x ) × (p x (p z + p s )) and the derivatives of the second partition are given by ∂2 =0 ∂k
(11)
j = 1, . . . , p z + p s ; k = 1, . . . , p z + p x ; = 1, . . . , p x yields a matrix of size (p x (p z + p s )) × (p z + p x ). ∂2 =− X Rji X Rki ∂␥k n
(12)
i=1
j = 1, . . . , p z + p s ; k = 1, . . . , p z + p s ; = 1, . . . , p x yields a block diagonal matrix of size(p x (p z + p s )) × (p x (p z + p s )) where each block matrix is of size (p z + p s ) × (p z + p s ). The elements of the variance matrix are formed from the definitions above. Mapping these equations is accomplished by defining the matrix A using [XZ X R ␥]ji =
XZji
if 1 ≤ j ≤ pz
(X R ␥(j−pz ) )i
if pz < j ≤ pz + px
in which we apply the notation XZji = ith observation of the jth column of XZ X Rji = ith observation of the jth column of XR ␥j−pz = IV coefficient vector from regressing X W(j−pz ) on XR +pz = ( + pz )th coefficient of  (X R ␥(j−pz ) )i = ith observation of (the predicted values from) X R ␥j−pz ␥k = kth coefficient of the th IV coefficient vector Equation (9) defines the (j, k) elements of A for j, k = 1, . . . , p z + p x . Equation (10) defines the (j, k) elements of A for j = 1, . . . , p z + p x and k = p z + p x + , where = 1, . . . , p x (p z + p s ). This notation addresses the cross derivatives for all of the (p z + p s ) × 1 coefficient vectors ␥m for m = 1, . . . , p x . Equation (11) calculates the (j, k) elements of A for j = p z + p x + , where = 1, . . . , p x (p z + p s ) and k = 1, . . . , p z + p x . Equation (12) defines the (j, k) elements of A for j, k = p z + p x + , where = 1, . . . , p x (p z + p s ). These are the covariances of all of the (p z + p s ) × 1 coefficient vectors ␥m for m = 1, . . . , p x .
The Sandwich Estimate of Variance
63
Given that i = [1i 2i ], the middle of the sandwich estimate of variance is then B = ni=1 i Ti . A suitable estimate may be calculated using j=1,...,(p z +p x ) y i − i ∂ [X Z XR ␥] ˆ ji V(i ) ∂ i (p z +p x )×1 j=1,...,(p +p ) [(X W1 − X R ␥ˆ 1j )X Rji ](pz +ps )×1z s [(X − X ␥ˆ )X ]j=1,...,(pz +ps ) W2 R 2j Rji (pz +ps )×1 ˆ 2i = .. . j=1,...,(pz +ps ) [(X Wpx − X R ␥ˆ pxj )X Rji ](pz +ps )×1
ˆ 1i =
(p x (p z +p s ))×1
The sandwich estimate of variance for  is then the upper (p z + p x ) × (p z + p x ) matrix of V S constructed from the illustrated matrices A and B.
5. GENERALIZED ESTIMATING EQUATION MODELS Liang and Zeger (1986), hereafter LZ, present methods for extending the class of generalized linear models to the analysis of longitudinal data. The estimating equation derived by the authors is not specified from joint distributions of the subject’s observations. Instead, they use familiar quasi-likelihood arguments to introduce a score equation for multivariate Gaussian outcomes. Our previous examples and discussion focused on the robustness of the sandwich estimator when the underlying parametric model was misspecified. In this application, we see that the sandwich estimator is robust even when the underlying model is left completely unspecified. See Gourieroux et al. (1984) for further justification of the use and properties of GEE-based estimators for Poisson models. The data of interest are characterized by an outcome variable y it and a p × 1 vector of covariates x it where multiple observations t = 1, . . . , n i are collected from each of the subjects (panels) i = 1, . . . , n. The total number of observations is given by N = ni=1 n i . If we have a single observation per panel (n i = 1 for all i = 1, . . . , n), then we can apply the generalized linear modeling techniques of McCullagh and Nelder (1989) for a wide variety of continuous and discrete models. Repeated observations per panel, however, introduce an added level of correlation among the observations that must be addressed. The approach of LZ focuses on a marginal distribution of the outcome variable in which the repeated observations per panel are addressed through the inclusion
64
JAMES W. HARDIN
of a working correlation matrix. The correlation matrix is usually parameterized subject to some form, and the associated parameter estimation is treated as ancillary to the generalized linear model (GLM) of interest. Notation is introduced by describing the marginal density of y it given as a member of the exponential family of distributions f(y it ) = exp[y it it − a(it ) + b(y it )] where it = g(it ), it = x it . In this notation, g(·) is a link function relating the linear predictor it to the expected value of y it . The exponential family of distributions also admits a scalar component of the variance . We know that the mean is given by E(y it ) = a (it ) = it , and the variance by V(y it ) = a (it )/. An estimate of  is obtained through n theTscore equation (from the likelihood analysis) is given by solution to i=1 X i i S i = 0 where X i is the n i × p matrix of observations for panel i, i = Diag(∂it /∂it ) is an n i × n i matrix, and S i = Y i − a (i ) is an n i × 1 vector. In the definition of i , and throughout the remainder of this paper, we write Diag(·) to denote a diagonal matrix. Following the arguments of LZ, one may introduce a working correlation matrix in the calculation of the variance by defining Ai as the n i × n i matrix 1/2 1/2 Diag(a (it )). The variance matrix is V i = (1/)Ai R(␣)Ai where we write R(␣) to indicate the parameterization of the correlation matrix by ␣. Note that if R(␣) is the identity matrix, the definition of the variance matrix is unchanged from the definition in the usual GLM approach. The generalized estimating equation for  is given by ni=1 D Ti V −1 i Si = 0 where D i = ∂i /∂ = Ai i X i . Similarly, there is an estimating equation for the structural parameters ␣ of the working correlation matrix. The partitioned GEE is given by n ∂ T −1 yi − i xji Diag [V(i )] () = ∂ a() i=1
(␣) =
n i=1
∂i ∂␣
T
H −1 i (W i − i )
where W i = (ri1 ri2 , ri1 ri3 , . . . , rini −1 rini )T H i = Diag(V (W ij )) i = E(W i ) and r ij is the Pearson residual for the jth observation of the ith panel. To construct the sandwich estimate of variance for the class of GEE models described in LZ, note that an explicit assumption of the model is that  and ␣ are uncorrelated. Therefore, the cross covariances are zero as we saw in the
The Sandwich Estimate of Variance
65
illustration comparing the sandwich estimate of variance to the Murphy–Topel variance estimate. The result of this assumption is that the sandwich estimate of variance may be formed exactly as illustrated for a single equation model. The remaining issue is that the single estimating equation of interest fails to satisfy the independence assumption; we must consider the sums of score contributions per panels (the panels are independent). The modified sandwich estimate of variance is the correct choice for this specification. Pan (2001) suggested an alternative to the usual modified sandwich estimate of variance. As usual, the alternative derives from modifying the meat of the sandwich (cf. the Newey–West extension). The author first points out that the empirical correction factor may be written n ∂i T ∂i B= Diag V(i )−T Cov(yi )V(i )−1 Diag ∂ ∂ i=1
This presentation emphasizes that the covariance of the outcome is estimated using information from individual panels Cov(yi ) = S i S Ti ,
S i = yi − i
The author argues that a better estimate of the covariance would consider information across panels, and he altered the correction factor to n −1/2 ∂i 1/2 1 1/2 T −1/2 Cov(yi ) = Ai Ai , Ai S i S i Ai Ai = Diag n ∂ i=1
We emphasize that one could easily add instrumental variables into the LZ population-averaged GEE model. This addition to the model only incurs further partitioning of the estimating equation. Other than complicating the derivatives and notation, these additional pieces of the overall estimating equation are addressed in the same manner illustrated in earlier examples. Hardin and Hilbe (2002) provides the details on this more complicated example.
6. SMALL SAMPLE ADJUSTMENTS The price we pay for obtaining consistency for misspecified models is that the sandwich variance estimator is more variable than a comparable naive variance estimator. Sometimes, it is far more variable; Kauermann and Carroll (2001) provide specific examples illustrating this property. Additional references that highlight the increased variability of the sandwich variance estimator include
66
JAMES W. HARDIN
Efron (1986) discussing results from Wu (1986) and Breslow (1990) for overdispersed Poisson regression. More recently, Long and Ervin (2000) investigate small sample adjustments for linear regressions, and Hill et al. (2003) provide results and analysis from a comparison of several variance estimators for the heckit model. Finally, Rothenberg (1988) investigates the power of tests of linear regression coefficients based on sandwich estimators. Due to increased interest in the sandwich estimator and its use in construction of hypothesis tests and confidence intervals, there has been a corresponding interest in improving performance in small samples. These adjustments are ad hoc; they are constructed for specific applications. While the sandwich estimator plays an important role in the construction of confidence intervals and tests that are robust to model misspecification, the estimator is not without criticism. Drum and McCullagh (1993) cite the simple case of the comparison of means from two independent samples. The usual and sandwich estimates of variance correspond to the alternate forms of the t-test; separate and pooled variances, respectively. The authors point out that when one or both of the two samples is small, there is a substantial loss of power using the pooled (sandwich) variance estimator. Bias in small samples is further addressed in Chesher and Jewitt (1987). There are two approaches we could take to address the small sample behavior of the sandwich estimator. The first approach is to apply a scalar adjustment (possibly based on the number of independent score contributions), and the second approach is a distributional change in the construction of confidence intervals and tests to use a distribution with heavier tails than the normal. MacKinnon and White (1985) investigate both approaches for small samples in linear regression. Their investigation includes the unadjusted sandwich estimator (labeled hc0), scalar adjustments to the sandwich estimator (labeled hc1), the unbiased sandwich estimator (labeled hc2), and an alternative that is equivalent to an asymptotic jackknife estimator (labeled hc3). Hill et al. (2003) include similar estimators in their investigation of the heckit estimator. For linear regression treating 2 as an ancillary parameter, we have the estimating equation for  given by () =
1 T X (Y − X) 2
yielding Aˆ = ˆ 2 (X T X)−1 ˆ 2X ˆ = 1 X T Diag(Y i − xi ) B ˆ 4
The Sandwich Estimate of Variance
67
Thus, the unadjusted sandwich estimate of variance is given by ˆ 2 X(X T X)−1 hc0 = (XT X)−1 X T Diag(Y i − xi ) Focusing on the meat of the sandwich estimator B, the authors noted first that a reasonable scalar adjustment is given by n/(n − p). This adjustment inflates the usual sandwich estimator. n ˆ 2 X(X T X)−1 hc1 = (X T X)−1 X T Diag(Y i − xi ) n−p It should be noted that the use of this particular scalar adjustment is usually limited to linear regression models. Other regression models include the common small sample scalar adjustment n/(n − 1). The modified sandwich variance estimator is similarly adjusted using the scale factor g/(g − 1) where g is the number of panels or groups. The inflation is unimportant for large samples, but for small samples can overcome the underestimation of the variance estimate. A second adjustment considers that the B matrix is biased for the variance. E(B −1 ) = ˆ 4 [X T (I − X(X T X)−1 XT )X]−1 To overcome this bias, the middle of the sandwich estimator can instead be estimated by ˆ Diag[1 − xi (X T X)−1 xi ]−1 (Y − X ) ˆ TX ˆ U = 1 X T (Y − X ) B ˆ 4 so that
−1
hc2 = (X X) T
Y i − xi ˆ X Diag √ hii T
2 X(X T X)−1
where h ii is the ith diagonal of the hat matrix I − X(X T X)−1 X. The final adjusted sandwich estimator in MacKinnon and White (1985) is 2 Y i − xi ˆ T −1 T X(X T X)−1 hc3 = (X X) X Diag h ii which is shown to be equivalent to an asymptotic jackknife estimator in Wu (1986). These approaches serve as starting points for investigating small sample adjustments in other types of models. Hill et al. (2003) present findings of a simulation study of the properties of variance estimators for the heckit model. Interestingly, they use the wrong sandwich estimator, but the results indicate that the small sample adjustment
68
JAMES W. HARDIN
included in their estimator overcomes the underestimation in ignoring the extra term of the correct sandwich estimator. Still, a better estimator is likely found by including a small sample adjustment to the correct sandwich estimator. Confidence intervals are constructed based on the normal distribution as Huber and White both derive the asymptotic normality of the coefficients of the estimating equation. Kauermann and Carroll (2001) show that the sandwich estimator is more variable than the Hessian. Accordingly, they argue that the Student’s t distribution should be favored in small samples. The choice of degrees of freedom still remains an issue. For linear regression, Kauermann and Carroll (2001) recommend 3 degrees of freedom. Others have recommended n − p degrees of freedom where n is the number of independent score contributions (number of observations or the number of panels) and p is the number of estimated coefficients. Kent (1982) recommends using F(1, n − p) citing consistency arguments.
7. INTERPRETATION OF RESULTS Lin (1989) points out that the derivation in White (1980) has the idea that the Fisher information matrix can be consistently estimated by either the score derivative matrix A or the squared score matrix B. When these two estimates differ, it is an indication that the assumed model is incorrect. Binder (1983), in a discussion of complex surveys, showed that the information matrix A could be replaced by the observed matrix of second derivatives A = ∂(x, )/∂. To see this subtle distinction imagine the case of a maximum likelihood estimator such that the estimating equation is in fact the derivative of the log-likelihood, L, given by (x, ) = ∂L/∂. Huber’s result specified E(∂2 L/∂2 ) = (∂L/∂)2 whereas Binder specified (−∂2 L/∂2 )−1 . Hardin and Hilbe (2001) show in detail that these two approaches are numerically equal for the class of generalized linear models when the canonical link function is used, and Efron and Hinkley (1978) investigate the small sample properties of variance estimators based on the two approaches. Interpretation of results starts with noting that the construction of the variance for a model that is correctly specified involves specification of A and B that are asymptotically equal. The end result of this is that the sandwich estimate of variance is asymptotically equal to the inverse matrix of negative second derivatives (Hessian) of a likelihood-based model; it is the inverse matrix of derivatives of the estimating equation. This is the usual variance estimate such that if the model is correctly specified. Ignoring small sample discrepancies, this means that there is no difference in the two approaches. Since there are advantages to the sandwich estimate of variance, there is a clear motivation to using it in construction of tests and confidence intervals. However, we
The Sandwich Estimate of Variance
69
must point out that the common use of the modifier robust leads many researchers to the incorrect conclusion that the sandwich estimate of variance is more conservative than the usual specification of the inverse matrix of second derivatives. This is not true. The sandwich estimate of variance can provide standard errors that are smaller than Hessian-based standard errors. Kauermann and Carroll (2001) present a lucid review of these issues in terms of linear and logistic regression showing that the size of the standard errors is a function of the kurtosis of the design values. The use of the modified sandwich estimate of variance is more complicated. The estimator is asymptotically justified and so requires a large number of panels. Further, the rank of the resulting matrix can not exceed the number of panels. For example, a data set with five panels each containing 100,000 observations would not be of sufficient size for testing a model with six coefficients. The bread of the sandwich estimator is the expected Hessian, Huber (1967), or the observed Hessian, Binder (1983). While these estimators are asymptotically equivalent, in the case of generalized linear models using noncanonical links, they are numerically different. In constructing the sandwich estimator, the use of the expected Hessian is sometimes called semi-robust while the use of the observed Hessian is called robust. The distinction is irrelevant in the case of the canonical link since the expected and observed Hessians are the same. Using noncanonical links, the distinction refers to results which, while still robust to variance misspecification, are not robust to misspecification of the link function. Knowledge that the sandwich estimate of variance is constructed assuming misspecification, has led some researchers to misinterpret analysis results. Specifically, consider the modified sandwich estimate of variance. This estimator is said to be robust to any within-panel correlation. That it is robust to any within-panel correlation comes from the fact that no specific structure was assumed in the construction of the variance estimate. We merely added the correlated score contributions together, and considered the collection of uncorrelated sums. Lurking underneath this statement is that we have misidentified the underlying true model; we have estimated an observation-level model on panel data. It would therefore be inconsistent, and incorrect, to interpret likelihood-based tests of our fitted model. Further, it is incorrect to interpret individual coefficients as if they were panel-based since we did not fit a panel model.
8. SUMMARY The sandwich estimate of variance may be applied in a number of situations. We illustrated this application for single-equation models, estimating equation models, multi-stage models, estimating equation models, generalized estimating equation
70
JAMES W. HARDIN
models, and proportional hazards models which failed to satisfy the independence assumption. Utilizing results that allow partitioning of the estimating equation, summation of the score contributions, and the infinitesimal jackknife, we can derive formulas for the sandwich estimate of variance for a wide variety of applications. For the two-stage models, we provided intuition for the (naive) Murphy–Topel estimator by illustrating the derivation of the appropriate sandwich estimate of variance. The power of the estimator is not without its limits. While we enjoy many benefits of robustness for associated confidence intervals, we must take care in the interpretation of the model and tests of coefficients. The popularity of the (asymptotically justified) variance estimator has also led to research into improving properties in small samples. This research introduces many ad hoc small sample adjustments, but there is no universally accepted adjustment.
ACKNOWLEDGMENTS The author would like to thank Carter Hill and Tom Fomby for organizing such a successful conference. Several conference participants, including Hal White and Tim Vogelsang, pointed out additional references that have been incorporated in this paper. Hill and Fomby also provided several useful suggestions to improve the final presentation.
REFERENCES Andrews, D. W. K. (1991, May). Heteroskedasticity and autocorrelation consistent covariance matrix estimation. Econometrica, 59, 817–858. Binder, D. A. (1983). On the variances of asymptotically normal estimators from complex surveys. International Statistical Review, 51, 279–292. Binder, D. A. (1992). Fitting Cox’s proportional hazards models from survey data. Biometrika, 79(1), 139–147. Binder, D. A., & Patak, Z. (1994). Use of estimating functions for estimation from complex surveys. Journal of the American Statistical Association, 89(427), 1035–1043. Breslow, N. E. (1990, June). Tests of hypotheses in overdispersed Poisson regression and other quasilikelihood models. Journal of the American Statistical Association, 85(410), 565–571. Cain, K. C., & Lange, N. T. (1984, June). Approximate case influence for the proportional hazards regression model with censored data. Biometrics, 40, 493–499. Chesher, A., & Jewitt, I. (1987). The bias of the heteroskedasticity consistent covariance matrix estimator. Econometrica, 55, 1217–1222. Cox, D. R. (1972). Regression models and life tables. Journal of the Royal Statistical Society – Series B, 34, 187–220.
The Sandwich Estimate of Variance
71
Drum, M., & McCullagh, P. (1993). Comment on: Regression models for discrete longitudinal responses. Statistical Science, 8, 284–309. Efron, B. (1981). Nonparametric estimates of standard error: The jackknife, the bootstrap and other methods. Biometrika, 68(3), 589–599. Efron, B. (1986). Discussion of: Jackknife, bootstrap and other resampling methods in regression analysis. The Annals of Statistics, 14(4), 1301–1304. Efron, B., & Hinkley, D. (1978). Assessing the accuracy of the maximum likelihood estimator: Observed versus expected fisher information. Biometrika, 65(3), 457–487. Eicker, F. (1963). Asymptotic normality and consistency of the least squares estimators for families of linear regressions. The Annals of Mathematical Statistics, 34(2), 447–456. Eicker, F. (1967). Limit theorems for regressions with unequal and dependent errors. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability (Vol. 1, pp. 59–82). Berkeley, CA: University of California Press. Fisher, R. A. (1935). The logic of inductive inference. Philosophical Transactions of the Royal Society, 39, 39–54. Gail, M. H., Tan, W. Y., & Piantadosi, S. (1988). Tests for no treatment effect in randomized clinical trials. Biometrika, 75, 57–64. Gallant, A. R. (1987). Nonlinear statistical models. New York: Wiley. Gourieroux, C., Monfort, A., & Trognon, A. (1984). Pseudo maximum likelihood methods: Applications to Poisson models. Econometrica, 52, 701–720. Greene, W. (2000). Econometric analysis (4th ed.). Upper 29, Saddle River, NJ: Prentice-Hall. Hampel, F. R. (1974). The influence curve and its role in robust estimation. Journal of the American Statistical Association, 69(346), 383–393. Hardin, J. W. (2002). The robust variance estimator for two-stage models. Stata Journal, 2, 253–266. Hardin, J. W., & Hilbe, J. M. (2001). Generalized linear models and extensions. College Station, TX: Stata Press. Hardin, J. W., & Hilbe, J. M. (2002). Generalized estimating equations. Boca Raton, FL: Chapman & Hall/CRC. Heckman, J. (1976). The common structure of statistical models of truncation, sample selection, and limited dependent variables and a simple estimator for such models. The Annals of Economic and Social Measurement, 5, 475–492. Hill, R. C., Adkins, L. C., & Bender, K. (2003). Test statistics and critical values in selectivity models. In: Advances in Econometrics: Maximum Likelihood Estimation of Misspecified Models: Twenty Years Later (Vol. 17). New York: Elsevier. Huber, P. J. (1967). The behavior of maximum likelihood estimates under non-standard conditions. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability (Vol. 1, pp. 221–233). Berkeley, CA: University of California Press. Kauermann, G., & Carroll, R. J. (2001). The sandwich variance estimator: Efficiency properties and coverage probability of confidence intervals. Journal of the American Statistical Association, 96, 1386–1397. Kent, J. T. (1982). Robust properties of likelihood ratio tests. Biometrika, 69(1), 19–27. Kim, T.-H., & White, H. (2003). Estimation, inference, and specification testing for possibly misspecified quantile regression. In: Advances in Econometrics: Maximum Likelihood Estimation of Misspecified Models: Twenty Years Later (Vol. 17). New York: Elsevier. Lee, L.-F., Maddala, G. S., & Trost, R. P. (1980, March). Asymptotic covariance matrixs of twostage probit and two-stage tobit methods for simultaneous equations models with selectivity. Econometrica, 48(2), 491–503.
72
JAMES W. HARDIN
Liang, K.-Y. (1987). Estimating functions and approximate conditional likelihood. Biometrika, 74(4), 695–702. Liang, K. Y., & Zeger, S. L. (1986). Longitudinal data analysis using generalized linear models. Biometrika, 73, 13–22. Lin, D. Y. (1989). Goodness-of-fit tests and robust statistical inference for the Cox proportional hazards model. Unpublished dissertation, The University of Michigan. Lin, D. Y., & Wei, L. J. (1989). The robust inference for the cox proportional hazards model. Journal of the American Statistical Association, 84(408), 1074–1078. Long, J. S., & Ervin, L. H. (2000). Correcting for heteroskedasticity with heteroskedasticity consistent standard errors in the linear regression model: Small sample considerations. The American Statistician, 54, 217–223. Lumley, T., & Heagerty, P. (1999). Weighted empirical adaptive variance estimators for correlated data regression. Journal of the Royal Statistical Society – Series B, 61(2), 459–477. MacKinnon, J. G., & White, H. (1985). Some heteroskedasticity consistent co-variance matrix estimators with improved finite sample properties. Journal of Econometrics, 29, 305–325. McCullagh, P., & Nelder, J. A. (1989). Generalized linear models (2nd ed.). London: Chapman & Hall. Miller, R. G. (1974). The jackknife – a review. Biometrika, 61(1), 1–15. Murphy, K. M., & Topel, R. H. (1985). Estimation and inference in two-step econometric models. Journal of Business and Economic Statistics, 3(4), 370–379. Newey, W. K., & West, K. D. (1987). A simple, positive semi-definite, heteroskedasticity and autocorrelation consistent covariance matrix. Econometrica, 55, 703–708. Newey, W. K., & West, K. D. (1994). Automatic lag selection in covariance matrix estimation. Review of Economic Studies, 61, 631–653. Pan, W. (2001, September). On the robust variance estimator in generalised estimating equations. Biometrika, 88(3), 901–906. Parzen, E. (1957). On consistent estimates of the spectrum of a stationary time series. Annals of Mathematical Statistics, 28, 329–348. Rogers, W. (1993). Regression standard errors in clustered samples. In: STB Reprints (Vol. 3, pp. 88–94). College Station, TX: Stata Press. Rothenberg, T. J. (1988). Approximative power functions for some robust tests of regression coefficients. Econometrica, 56, 997–1019. Royall, R. M. (1986). Model robust confidence intervals using maximum likelihood estimators. International Statistical Review, 54(2), 221–226. Royall, R. M., & Cumberland, W. G. (1978, June). Variance estimation in finite population sampling. Journal of the American Statistical Association, 73(362), 351–358. Royall, R. M., & Cumberland, W. G. (1985, June). Conditional coverage properties of finite population confidence intervals. Journal of the American Statistical Association, 80(390), 355–359. Stefanski, L. A., & Boos, D. D. (2002, February). The calculus of M-estimation. The American Statistician, 56(1), 29–38. Vogelsang, T. J. (2003). Testing in GMM models without truncation. In: Advances in Econometrics: Maximum Likelihood Estimation of Misspecified Models: Twenty Years Later (Vol. 17). New York: Elsevier. Wald, A. (1949). Note on the consistency of the maximum likelihood estimate. Annals of Mathematical Statistics, 20, 595–601. White, H. (1980, May). A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica, 48(4), 817–838.
The Sandwich Estimate of Variance
73
White, H. (1982a, March). Instrumental variables regression with independent observations. Econometrica, 50(2), 483–499. White, H. (1982b, January). Maximum likelihood estimation of misspecified models. Econometrica, 50(1), 1–25. White, H. (2000). Asymptotic theory for econometricians (rev. ed.). New York: Academic Press. Wooldridge, J. M. (1991). On the application of robust, regression-based diagnostics to models of conditional means and conditional variances. Journal of Econometrics, 47, 5–46. Wu, C. F. J. (1986). Jackknife, bootstrap and other resampling methods in regression analysis. The Annals of Statistics, 14(4), 1261–1295. Xie, M., Simpson, D. G., & Carroll, R. J. (2000, June). Random effects in censored ordinal regression: Latent structure and Bayesian approach. Biometrics, 56, 376–383.
TEST STATISTICS AND CRITICAL VALUES IN SELECTIVITY MODELS R. Carter Hill, Lee C. Adkins and Keith A. Bender ABSTRACT The Heckman two-step estimator (Heckit) for the selectivity model is widely applied in Economics and other social sciences. In this model a non-zero outcome variable is observed only if a latent variable is positive. The asymptotic covariance matrix for a two-step estimation procedure must account for the estimation error introduced in the first stage. We examine the finite sample size of tests based on alternative covariance matrix estimators. We do so by using Monte Carlo experiments to evaluate bootstrap generated critical values and critical values based on asymptotic theory.
1. INTRODUCTION Many researchers use Heckman’s (1979) two-step estimation procedure (Heckit) to deal with selectivity in the linear regression model. Selection bias results when the regression dependent variable is observed only when a “latent” selection variable is positive. While the two-step estimation procedure is easy to implement, i.e. a probit estimation of the selection equation followed by least squares estimation of an augmented regression, the applied literature reveals that researchers (and econometric software vendors) take a variety of approaches when computing standard errors. This is important since the standard errors are the basis for t-statistics that are used in significance tests. Maximum Likelihood Estimation of Misspecified Models: Twenty Years Later Advances in Econometrics, Volume 17, 75–105 Copyright © 2003 by Elsevier Ltd. All rights of reproduction in any form reserved ISSN: 0731-9053/doi:10.1016/S0731-9053(03)17004-1
75
76
R. CARTER HILL, LEE C. ADKINS AND KEITH A. BENDER
The literature on sample selection bias is huge, and we will not attempt a survey. Two articles of note are by Vella (1998) and Puhani (2000). In this paper we focus on two issues. First, how do the alternative versions of asymptotic variance-covariance matrices used in selectivity models capture the finite sample variability of the Heckit twostep estimator? Second, is it possible to use bootstrapping to improve finite sample inference? Three aspects of this question are: ◦ Do bootstrap standard errors match finite sample variability better than nominal standard errors computed from asymptotic covariance matrices? ◦ Do critical values of test statistics generated by bootstrapping pivotal t-statistics lead to better test size (and power?) than those based on usual asymptotic theory? ◦ Does modern software make obtaining bootstrap standard errors and critical values feasible for empirical researchers? Our plan is to develop the model and Heckman’s two-step estimator in Sections 2 and 3, respectively, and then describe the alternative covariance matrix estimators we consider in Section 4. In Section 5, we comment on the practices used in empirical research and some choices available in commercial software. Section 6 contains the design of the Monte Carlo experiment as well as discussion of the output measures we recover. Section 7 presents the results of the Monte Carlo experiment, followed by conclusions in Section 8.
2. THE SELECTIVITY MODEL Following Greene (1997, pp. 974–981) consider a model consisting of two equations. The first equation is the “selection equation,” which is defined as z ∗i = wi ␥ + u i ,
i = 1, . . . , N
(2.1)
where z ∗i is a latent variable, ␥ is a K × 1 vector of parameters, wi is a 1 × K row vector of observations on K exogenous variables and ui is a random disturbance. The latent variable is unobservable, but we do observe the dichotomous variable 1 z∗i > 0 zi = (2.2) 0 otherwise The second equation is the linear model of interest. It is y i = x i  + e i ,
i = 1, . . . , n,
N>n
(2.3)
Test Statistics and Critical Values in Selectivity Models
77
where yi is an observable random variable,  is an M × 1 vector of parameters, x i is a 1 × M vector of exogenous variables and ei is a random disturbance. We assume that the random disturbances are jointly distributed as 1 0 ui ∼N , (2.4) 0 ei 2e A “selectivity problem” arises when yi is observed only when z i = 1, and if = 0. In such a situation, the ordinary least squares estimator of  in (2.3) is biased and inconsistent. A consistent estimator is the two-step procedure suggested by Heckman (1979) and clarified by Greene (1981). It is known as “Heckman’s twostep estimator,” or more simply as “Heckit.” The basis for this estimation procedure is the conditional regression function E[y i |z i > 0] = E[y i |u i > −wi ␥] = x i  + E[e i |u i > −wi ␥] = x i  + ( · e )i (2.5) where i =
(wi ␥) (wi ␥)
(2.6)
is the “inverse Mill’s ratio,” (·) is the standard normal probability density function evaluated at the argument, and (·) is the cumulative distribution function for a standard normal random variable evaluated at the argument. In a regression equation format, y i = E[y i |z i > 0] + vi = x i  + ( · e )i + vi = x i  +  i + vi
(2.7)
where the random disturbance vi has conditional mean and variance given by E[vi |z i > 0] = 0,
var(vi |z i > 0) = 2e (1 − 2 ␦i )
(2.8)
with ␦i = i (i + wi ␥)
(2.9)
Thus, the regression error vi in (2.7) is heteroskedastic. If i were known and non-stochastic, then the selectivity corrected model (2.7) could be estimated by generalized least squares. Alternatively, the heteroskedastic model (2.7) could be estimated by ordinary least squares, and the heteroskedasticity consistent covariance matrix estimator (HCE) of Huber (1967), Eicker (1963) and White (1980) used for hypothesis testing and construction of confidence intervals. Unfortunately i is not known and must estimated, introducing variability not accounted for by a heteroskedasticity correction.
78
R. CARTER HILL, LEE C. ADKINS AND KEITH A. BENDER
3. HECKIT: THE HECKMAN TWO-STEP ESTIMATOR The widespread use of Heckit is no doubt in part due to the ease with which it is computed. In the first step of this two-stage estimation process, the method of maximum likelihood is used to estimate the probit model parameters ␥, based upon the observable random variable zi . Denote the MLE as ␥ˆ and its asymptotic covariance matrix as V. We will compute V as the negative of the inverse Hessian evaluated at the MLE. Specifically, if f i1 is the (Bernoulli) probability function of zi , then ln f i1 = ln ([ (wi ␥)]z i [1 − (wi ␥)]1−z i ) (3.1) N and the log-likelihood function for the probit model is L 1 = i=1 ln f 1i . For convenience let i = (wi ␥) and i = (wi ␥). Then, for future reference, the gradient vector of the probit model log-likelihood function is N
N
i=1
i=1
(w ␥) (wi ␥) ∂L 1 i = zi (1 − z i ) wi − wi ∂␥ (wi ␥) 1 − (wi ␥)
(3.2)
and the Hessian is
N i + (w ␥i ) i i − (w ␥i )(1 − i ) ∂2 L 1 wi wi = − i z i + (1 − z i ) 2 2 ∂␥∂␥ ) (1 − i i i=1 (3.3) Then, using the negative of the inverse Hessian evaluated at the MLE, we compute the asymptotic covariance matrix V of the probit estimator as 2 −1 ∂ L1 V=− (3.4) ∂␥∂␥ ␥), Given the MLE ␥, ˆ we compute ˆ i = (wi ␥)/ (w ˆ i ˆ i = 1, . . . , n. The variable ˆi is used as a regressor in the second step equation,
y i = x i  +  ˆ i + vi +  (i − ˆ i ) = x i  +  ˆ i + vi ˜  ˆ ∗ + vi = xi  + vi = [x i i ]  ˜ ˜ ˜
(3.5)
Stacking the n complete observations in (3.5) into matrices, the Heckit estimator of the M + 1 parameters ∗ is the ordinary least squares estimator applied to the augmented regression in (3.5), that is b ∗ = (X X)−1 X y
˜ ˜
˜
(3.6)
Test Statistics and Critical Values in Selectivity Models
79
¯ˆ 2 , where vˆ = y − Xb ∗ , b is the least An estimator of 2e is ˆ 2e = (ˆv vˆ /n) + ␦b ˜ ˜ ˜ ˜ ˆ squares estimator of  , ␦i is the plug-in estimator of ␦i in (2.9), and ␦ˆ¯ = n ˆ ˆ 2 = b 2 /ˆ 2e . i=1 ␦i /n. An estimator of is
4. HECKIT: ALTERNATIVE COVARIANCE MATRIX ESTIMATORS CONSIDERED IN THE MONTE CARLO The focus in this paper is the computation of the covariance matrix estimate. There are a number of alternatives used in the literature, some of which are appropriate and some of which are not. (1) One alternative is to use the standard estimator for the covariance matrix of the OLS estimator, V OLS = ˆ 2v (X X)−1 ,
ˆ 2v =
˜ ˜
vˆ vˆ ˜˜ n − (M + 1)
(4.1)
This estimator is incorrect for two reasons: it ignores the heteroskedasticity in (2.7), even if we assume i is known, and it ignores that in (3.5) λˆ i is stochastic. (2) A second possibility is to account for the heteroskedasticity in (2.7), using the estimator ˆ ](X X)−1 V HET = ˆ 2e (X X)−1 [X (1− 2 )X
˜ ˜
˜
˜ ˜ ˜
(4.2)
ˆ = diag(␦ˆ i ) is a diagonal matrix with non-zero elements ␦ˆ i . This where estimator is the covariance matrix of the ordinary least squares estimator in the presence of heteroskedasticity of the form in (2.8). This estimator does not account for the fact that λˆ i in (3.5) is stochastic. The error term vi in (3.5) is for each observation a function of the probit MLE ␥. ˆ This means˜that cov(vi , vj ) = 0, which (4.2) does not account for. ˜ same ˜ (3) In this spirit, one might use the White (1980) heteroskedasticity consistent estimator (HCE) V HCE = (X X)−1 X D p X(X X)−1
˜ ˜
˜
˜ ˜ ˜
(4.3)
where Dp is a diagonal matrix. For the basic heteroskedasticity consistent estimator V HC0 the squared least squares residuals are on the diagonal, D 0 = diag(ˆv2i ). This estimator suffers the same flaw as VHET , but is easier to compute since˜V HC0 is readily available in most regression software. We also consider a modification of the standard heteroskedasticity consistent estimator V HC0 . This modification is denoted V HC3 by Davidson
80
R. CARTER HILL, LEE C. ADKINS AND KEITH A. BENDER
and MacKinnon (1993, p. 554) and has been studied recently by Long and Ervin (2000). To obtain V HC3 we replace the diagonal matrix D0 with D 3 = diag(ˆv2i /(1 − xi (X X)−1 xi )2 ). Davidson and MacKinnon note (1993, ˜ ˜ ˜model with homoskedastic errors the expected p. 70) that in˜ a linear˜regression value of these weighted residuals would equal the error variance. Justification for using V HC0 is found in Lee (1982). Amemiya (1984, p. 33) summarizes the argument by noting that the Heckman estimator is consistent under assumptions less restrictive than the usual bivariate normality of the error terms. Under the less restrictive assumptions White’s HCE provides a consistent estimator of the asymptotic covariance matrix. The specific form we use is Lee (1982, p. 365) equation (51), which is V Lee = (X X)−1 (V HC0 − X GVG X)(X X)−1
˜ ˜
˜
˜ ˜ ˜
where G is the matrix with i’th row λ ∂λi /∂␥ . See (4.8) below for the derivative. (4) The asymptotic covariance matrix for b ∗ was obtained by Heckman (1979, p. 159) and refined by Greene (1981, pp. 795–798). It is, following Greene (1997, p. 981), ˆ V HECK = ˆ 2e (X X)−1 [X (1 − 2 )X + Q](X X)−1
˜ ˜
˜
˜
˜ ˜
(4.4)
ˆ with V the asymptotic covariance matrix ˜ W where Q = ˆ 2 FVF and F = X of the probit estimator, the negative of the inverse Hessian, and with W being the regressor matrix from the probit estimation in the first stage. (5) An asymptotically equivalent, but seldom if ever used in selectivity models, asymptotic covariance matrix estimator is based on the Murphy-Topel (1985) general result. We are including the MT estimator because of its use in an increasingly wide variety of contexts, and its availability as an automated command in LIMDEP 8.0. In Greene’s (1997, p. 467) notation y i = h(x i , ∗ , wi , ␥) + vi = x i + i + vi = xi ∗ + vi
˜
(4.5)
Let cov(b ∗ |ˆ i ) = V HET = 2e V b (see Eq. (4.2)). Then the unconditional covariance matrix of the least squares estimator is V MT = 2e V b + V b [CVC − RVC − CVR ]V b
(4.6)
where V is the asymptotic covariance matrix of the probit estimator. The matrix C is given by C=
x 0i
∂h , ∂␥
x 0i =
∂h = x˜ i , ∂∗
∂i ∂h =  ∂␥ ∂␥
(4.7)
Test Statistics and Critical Values in Selectivity Models
81
where (wi ␥) ∂i = − [ (wi ␥) · (wi ␥) + (wi ␥)]wi = ␥i ∂␥ [ (wi ␥]2
(4.8)
The matrix R is R=
∂ln f i1 ˜ ˜ ∂␥
xi vˆ i
(4.9)
For i = 1, . . ., n the selectivity indicator z i = 1 in the probit model so that for these observations the i’th term of the log-likelihood function L1 is ln f i1 = (wi ␥) and ∂ln f i1 /∂␥ = φ(wi ␥)/ (wi ␥)wi = i wi . (6) Hardin (2002, 2003) has introduced a robust variance estimator for two-stage estimators similar in construction to the Murphy-Topel estimator. In it, which we call VRMT , the matrix C in (4.6) is replaced by C∗ = −
∂2 L 2 ∂1 ∂2
(4.10)
where L2 is the log-likelihood function of the second stage estimator, conditional on the parameters in the first stage. In the context of Heckit the first stage estimator is probit, and 1 = ␥. The second stage is least squares estimation of the augmented model (4.5), so 2 = ∗ = (  ). To compute the matrix ∗ C we write the log-likelihood function for the second stage regression as n 1 1 (y i − x i  − i  )2 1 2 L2 = − ln 2 − ln − 2 2 2 2 i=1 n n 1 1 v2i 1 2 − ln 2 − ln − = ln f i2 (4.11) = 2 2 2 2 i=1
i=1
Then, 1 ∂ln f i2 ∗ = 2 ∂ and
(yi − xi  − i  )xi
(yi − xi  − i  )i
(4.12a)
∂i  − xi − 2 xi ∂2 ln f i2 1 ∂␥ = ␥i = xi ␥i = ∗ 2 v  ∂ ∂ i ∂ ∂␥ i i − 2 i vi − i  2 i ∂␥ ∂␥ (4.12b)
82
R. CARTER HILL, LEE C. ADKINS AND KEITH A. BENDER
Finally, n C ∗ = − xi ␥i = −X ␥
(4.13)
i=1
where X is a matrix whose rows are xi and γ is a matrix with rows λγi which is given in (4.8). The second modification of the Murphy-Topel estimator Hardin introduces is to replace the probit covariance matrix V by the “sandwich” estimator V s = V · V −1 opg · V, where V −1 opg =
∂L 1 ∂L 1 ∂γ ∂γ
where L1 is the probit log-likelihood function, and Vopg is the “outer product of the gradient” estimator of the probit covariance matrix. (7) Our concern is not just the asymptotic reliability of covariance matrix estimators. Selectivity corrections are often applied in samples that are not “large.” It is known that standard errors computed from asymptotically valid covariance matrices can seriously understate true estimator variability in finite samples (Horowitz, 1997). In the context of models with limited dependent variables this has been illustrated by Griffiths, Hill and Pope (1987). We use the bootstrap approach (Freedman & Peters, 1984 a, b; Jeong & Maddala, 1993) to compute measures of finite sample variability. As suggested by Jeong and Maddala (1993, p. 577) we resample, with replacement, from the rows of the data matrix to create a large number of “bootstrap samples.” LIMDEP and STATA employ this scheme for automated bootstrapping. Using each bootstrap sample we re-estimate the model, storing the parameter estimates as we go. The bootstrap estimate of the estimator standard error is the sample standard deviation of all the estimates. Horowitz (1997) argues that while the bootstrap can be used to approximate standard errors of estimation, it is preferable to use the bootstrap to obtain critical values for t-statistics that are used as a basis for hypothesis testing. The crux of the argument is that bootstrap standard errors converge to the true standard errors as the sample size gets larger, but that bootstrapped critical values of test statistics converge to the true critical values at an even faster rate. Thus, instead of computing bootstrap standard errors and using these as a basis for a new t-statistic, it is perhaps better to bypass the computation of the standard error and just compute the critical value of the commonly used asymptotic t-statistic.
Test Statistics and Critical Values in Selectivity Models
83
Using standard econometric practice, to test the null hypothesis H 0 : k = 0k against the alternative H 0 : k = 0k we use the t-statistic t = (b k − 0k )/se(b k ), where se (b k ) is a valid asymptotic standard error for the consistent estimator b k . For example, se (b k ) might be the Heckit standard error from VHECK , or the standard error computed from the Murphy-Topel asymptotic covariance matrix VMT . The null hypothesis is rejected if |t| ≥ t c , where tc is the critical value from the standard normal or t-distribution. The problem is that using the standard critical values with t-statistics derived from asymptotic theory leads to tests with incorrect size, or probability of type I error. Horowitz suggests that we can obtain improved critical values using the bootstrap. In each bootstrap sample we obtain the t-statistic value for the (true in the sample) hypothesis H 0 : k = b k . That is, we compute for each bootstrap sample t b = (ˆ b − b k )/se b , where ˆ b is an estimate from a consistent estimator in the b’th bootstrap sample, and seb is the value of the asymptotic standard error of the estimator ˆ b . In the bootstrap world it is b k , the estimate based on the original and full sample, that plays the role of the true parameter value. Hence the statistic tb is centered at the “true in the sample” parameter value, and it is asymptotically pivotal. The absolute values of these t-statistics are sorted by magnitude and the positive t-critical value tc is chosen to be the upper ␣-percentile value. We will report, from the Monte Carlo experiment that we outline in the next section, both the standard errors computed by the bootstrap, and the bootstrap t-critical values.
5. APPROACHES IN THE EMPIRICAL LITERATURE: SOME COMMENTS At least four different strategies are being used to obtain standard errors in selectivity models appearing in the applied literature.
5.1. Heckman’s Asymptotic Covariance Matrix Many authors cite the analytic results of Heckman (1979) or Greene (1981), who derive expressions for asymptotic covariance matrices in selectivity models, as the source of their standard errors. We may include in this group the authors who indicate they use software packages LIMDEP or STATA which will compute the Heckman asymptotic covariance matrix. It is our view that authors of empirical papers should clearly state which software is being used, which version, and
84
R. CARTER HILL, LEE C. ADKINS AND KEITH A. BENDER
the commands for options actually employed. Not doing so hinders the work of other researchers in the area and obscures calculations that may be incorrect. For example, early versions of STATA 6.0 contained an error when computing the Heckman asymptotic covariance matrix, a reminder that we should all keep our software updated.
5.2. Maximum Likelihood Estimator Less seldom used in applications is the method of maximum likelihood. The most recent versions of LIMDEP and STATA include both two-step estimator and maximum likelihood options. In addition, both packages offer a Huber/White/sandwich estimator for the asymptotic covariance matrix when maximum likelihood estimation is chosen. Examples in the applied literature are Hunter (2000) and Wu and Kwok (2002). Nawata (1994) notes that standard software routines for finding the MLE may not converge, or may converge to a local rather than a global maximum. This may explain why the two-step estimator is widely used instead of maximum likelihood. Nawata (1994) offers an alternative to standard optimization routines for maximizing the log-likelihood function. Nawata and Nagase (1996) compare the finite sample properties of the MLE and Heckit. They conclude, confirming the result in Nawata (1993), that a key indicator to the likely performance of Heckit relative to the MLE is the collinearity between the systematic portion of the selection equation and the regressors in the equation of interest. If the selection (probit) equation and the equation of interest have a substantial number of variables in common then the Heckit estimator is not a good choice relative to the MLE. Nawata and McAleer (2001) compare the t-test, likelihood ratio test and Lagrange multiplier test of the hypothesis that the errors in the selection equation and equation of interest are uncorrelated using maximum likelihood. They find that even if there is no collinearity between the regressors in the two equations the t-test based on maximum estimates performs poorly due to poor variance estimates.
5.3. White’s Heteroskedasticity Consistent Estimator We discovered a large group of authors who rely upon White’s HCE in selectivity models. Puhani (2000, p. 55) states: “In order to obtain a simple and consistent estimator of the asymptotic variance-covariance matrix, Lee (1982, p. 364f.) suggests to use White’s (1980) method.” We are extremely curious about this
Test Statistics and Critical Values in Selectivity Models
85
point. We note first that blind use of the HCE does not account for the fact that the parameters of the first stage probit model are estimated. Second, Lee (1982, p. 365) indicates that he suggests HCE only for part of his two-step estimator’s (which is a generalization of the standard Heckit estimator) variance-covariance matrix. We are unsure whether applied researchers have relied on Lee’s (1982, p. 364) sentence “A relatively simpler approach which avoids the above complication is to adopt the method in White (1980),” assuming it means that a simple heteroskedasticity correction is adequate asymptotically in the two-step estimation process. Amemiya (1984, p. 33) summarizes the argument by noting that the Heckman estimator is consistent under assumptions less restrictive than the usual bivariate normality of the error terms. Under the less restrictive assumptions White’s HCE provides a consistent estimator of the asymptotic covariance matrix. Simpson (1986, p. 801), in the context of a model somewhat more involved than the usual selectivity model, acknowledges that Ordinary least squares estimates . . . will be consistent, but the resulting standard errors will be incorrect and the estimation of correct standard errors will be complex. Therefore, the estimates of the standard errors reported . . . use White’s (1980) procedure to adjust for heteroskedasticity induced by sample selection. This procedure does not correct for the fact that γ is unknown and must be estimated.
Similarly, Ermisch and Wright (1993, p. 123) obtain t-statistics using OLS standard errors, but then say, When the t-statistics are computed from standard errors corrected for heteroskedasticity using White’s (1980) method, conclusions about statistical significance are the same. These t-statistics are not, however, the appropriate ones . . . While they correct for heteroskedasticity, they do not allow for the fact that the λ regressor is estimated. The correct asymptotic standard errors for the dichotomous selection case are derived in Heckman (1979, pp. 158–159).
5.4. Ordinary Least Squares Another strategy is to use least squares regression. The ill-conditioning in the Heckit regression model, which includes the inverse Mills ratio, becomes severe when the variables in the probit selection equation are highly correlated with the variables in the regression equation. The ill-conditioning in the augmented regression occurs in this case because the inverse Mills ratio, despite the fact that it is a non-linear function the selection equation variables, is well approximated by a linear function over broad ranges. In such cases Monte Carlo evidence exists (summarized in Puhani, 2000) supporting the small sample estimation efficiency of OLS relative to Heckit and Heckit alternatives.
86
R. CARTER HILL, LEE C. ADKINS AND KEITH A. BENDER
5.5. Recent Developments in Covariance Matrix Estimation In recent years the standard approaches to computing standard errors have been expanded in two directions. First, the use of bootstrapping has become more refined. Originally used as an empirical method for computing standard errors, bootstrapping is now seen as a basis for computing empirically relevant critical values for hypothesis tests (Deis & Hill, 1998; Horowitz, 1997; Horowitz & Savin, 2000). The advantage of this approach is that it leads to the use of a test procedure having Type I error specified by the researcher in finite samples. As Horowitz and Savin (2000) point out, this feature facilitates power comparisons among alternative tests. Newer versions of the software STATA and LIMDEP have automated bootstrap commands. These can be used to obtain bootstrap standard errors for any estimation procedure via resampling the data. With the appropriate modifications the pivotal statistics can be resampled, making bootstrap critical values easy to obtain. Some sample programs are provided in the appendix to this paper showing the commands required. “Sandwich” covariance matrix estimators are being used in a wide variety of contexts. The heteroskedasticity-consistent covariance matrix estimator (HCE) introduced by Huber (1967), Eicker (1967) and White (1980) is ubiquitous. The software STATA offers robust covariance estimation as an option for virtually all models that can be estimated by maximum likelihood (STATA 7.0 User’s Guide, p. 254). These robust covariance estimators are used to obtain “consistent estimates of the covariance matrix under misspecified working covariances as well as under heteroscedastic errors” (Kauermann & Carroll, 2001, p. 1387). Recently Hardin (2002) has proposed a sandwich estimator for two-step models, a class of models that includes Heckit. He develops a sandwich covariance matrix estimator similar in construction to the Murphy-Topel (1985) estimator for two-step estimators, and he provides instructions for using STATA to implement the estimator. LIMDEP 8.0 offers a general procedure for two-step estimators with the Murphy-Topel covariance matrices automated for some special cases. It is our conjecture that bootstrapping a pivotal t-statistic, using a standard error from any consistent asymptotic covariance matrix estimator for the Heckit model (or any other), should yield critical values such that hypothesis tests are the proper size. Then the question is “Do any of the alternative covariance matrix estimators lead to power advantages?” We have not yet investigated this question.
6. THE MONTE CARLO DESIGN The Monte Carlo Design we employ is that of Zuehlke and Zeman (1991) with a modification used by Nawata and Nagase (1996). The performance of each
Test Statistics and Critical Values in Selectivity Models
87
covariance estimator is examined under various circumstances likely to affect their performances. The sample size, severity of censoring, degree of selection bias and the correlation between the independent variables in the selection and regression equations are all varied within the Monte Carlo experiment. The specific model we employ consists of the selection equation z ∗i = ␥1 + ␥2 wi + u i = ␥1 + 1wi + u i ,
i = 1, . . . , N
(6.1)
The sample size N = 100 and 400. The value of the parameter ␥1 controls the degree of censoring. Following Zuehlke and Zeman (1991) we specify ␥1 = −0.96, 0 or 0.96, which correspond to expected sub-samples of size n equaling 25, 50 and 75% of N, given that u i ∼ nid(0, 1) The regression equation of interest is y i = 1 + 2 x i + e i = 100 + 1x i + e i ,
i = 1, . . . , n,
N>n
(6.2)
We assume the regression error e i ∼ nid(0, e = 1). The selection bias is controlled through the error correlation = [0, 0.5 or 1] in (2.4). The remaining element of the experiment is the correlation between the regressor w in the selection equation and the regressor x in the regression equation. Following Nawata and Nagase (1996) we specify this correlation to be xw = [0.90, 0.95 or 1]. Varying ␥1 , and xw as describes gives us 27 Monte Carlo design points for each sample size N. For each design point and sample size we generate 500 Monte Carlo samples. We use 200 bootstrap samples. The Monte Carlo results we report are designed to measure (i) The finite sample accuracy of nominal standard errors of the Heckit estimator based on the alternative covariance matrix estimators described in Section 4. The accuracy is evaluated by comparing the average nominal standard errors to the Monte Carlo estimates’ standard deviations. (ii) The size of t-tests of significance based on each standard error method for the slope parameter in the regression equation, based on the usual asymptotic critical values ±1.645 for tests of nominal 10% size and ±1.96 for nominal 5% size tests. That is, we compute the t-statistic tm =
ˆ m −  se m
(6.3)
where ˆ m and  are Heckit estimates for parameters in the augmented regression equation from the Monte Carlo sample and the true parameter value, respectively, and se m is a standard error computed from the Monte Carlo sample. The true null hypothesis is rejected if |t m | ≥ t c , with t c = 1.645 or 1.96. The test size is the percentage of times in 500 Monte Carlo samples
88
R. CARTER HILL, LEE C. ADKINS AND KEITH A. BENDER
we reject the null hypothesis. Clearly we prefer tests of an assumed nominal size of 0.05 or 0.10 to have actual size close to those values. (iii) The size of t-tests of significance based on bootstrapping critical values of the distribution of the “pivotal” statistic associated with each standard error method. Specifically, in each Monte Carlo sample m we resample, with replacement, from the rows of the data matrix [y z x w] to obtain a bootstrap sample b of size N. A pivotal statistic is obtained for each of 200 bootstrap samples by computing tb =
ˆ b − ˆ m se b
(6.4)
where ˆ b and ˆ m are Heckit estimates for parameters in the augmented regression equation from the bootstrap and Monte Carlo samples respectively, and se b is a standard error computed from the bootstrap sample. Recall that for the m’th Monte Carlo sample, the estimate ˆ m based on the full sample is the “true in the sample” value and thus using it to center the t-statistic makes it asymptotically pivotal. The bootstrap critical values are obtained by taking the 0.90 and 0.95 percentiles of empirical distribution of |t b | , for the nominal 10 and 5% size tests, respectively. The size of a two-tailed test using the bootstrap critical values is computed by calculating the percentage of the time the t-statistic in (6.3) falls above or below the computed percentiles. That is, a nominal 5% test is obtained by rejecting the (true) null hypothesis if |t m | ≥ t c , with t c being the bootstrap critical value, which is the 95th percentile of the sorted |t b | values. The actual test size using the bootstrap critical values is the percentage of times in 500 Monte Carlo samples we reject the null hypothesis.
7. THE MONTE CARLO RESULTS When viewing the tabled results recall that the interpretation of the parameters controlling the experimental design: ␥ controls the degree of censoring in the sample. When ␥ = −0.96, 0.0, 0.96 1 1 the sizes of the selected sub-samples of size n are approximately 25, 50 and 75%, respectively, of the original sample of N observations. is the correlation between the errors in the regression and selection equation. It takes the values 0.0 (under which OLS on the sub-sample is BLUE), 0.5 and 1.0. As the value of increases the magnitude of the selection problem, as measured by λ = · e , increases.
Test Statistics and Critical Values in Selectivity Models
89
is the correlation between the explanatory variables in the selection equaxw tion and the regression model of interest. The parameter xw takes the values 0.90, 0.95 and 1.0. The latter case represents the undesirable situation in which the explanatory variables in the selection equation are identical to those in the regression equation. The columns labeled OLS are results that use the standard errors from V OLS in (4.1). Columns labeled HCE0 contain results based on the covariance matrix estimator V HC0 , and so on. Table 1a reports for N = 100 the average of the nominal (asymptotic) standard errors relative to the true estimator standard error as measured by the sampling variation of the Heckit estimator of the parameter 2 . The column labeled MCSE is the standard error of the estimates in the Monte Carlo simulation. This is the true finite sample variability. Several cases are of interest: When ␥ = −0.96 and = 1 the Monte Carlo standard errors become signifi1
xw
cantly larger than in the other cases. This is an indication of the general difficulties encountered when the independent variables used in each of the two-steps are the same, especially if the sample for the regression is heavily censored. When = 0, the OLS standard error should accurately reflect the sampling variation of the Heckit estimator since it is BLUE. For the extreme design point ␥1 = −0.96 or 0.0, and xw = 1, the OLS estimator understates the Heckit estimator variability. The other estimators HCE3, HECK (and its near image, MT) and BOOT all overestimate the variability in this case. Bootstrap standard errors measure finite sample variation quite well when = 0 except for the case when xw = 1. Given = 0 and xw = 1, the performance of HCE3, HECK and BOOT improve as the degree of censoring diminishes. Of the two White HCE estimators, the usual HCE0 tends to understate the finite sample variation of Heckit and HCE3 tends to overstate it, but by a relatively small margin. Both estimators improve as censoring is reduced. When the degree of censoring is large the Murphy-Topel and Robust MurphyTopel estimators are not reliable for this sample size. For less censored cases, in this example, the usual MT estimator performs better than the robust version, RMT. Indeed, the MT estimator mirrors the results of HECK even in this small sample. The LEE estimator is appropriate when errors are non-normal, but in this case it severely understates the true sample variation of Heckit when censoring is severe or moderate. In our experiment we did not consider non-normal errors or the robustness of alternative standard error estimators. Comparing HECK and BOOT, we see that HECK does not fare well when censoring is large, but it becomes progressively better as the degree of censoring
␥1
xw
MCSE
OLS
HCE0
HCE3
HECK
MT
RMT
LEE
90
Table 1a. Nominal Standard Errors Relative to the Monte Carlo Standard Errors, N = 100 Coefficient: 2 . BOOT
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
0.3879 0.5654 1.4435 0.3796 0.7730 1.3504 0.2679 0.4568 1.9669
0.9830 0.9868 0.8550 1.0066 1.0203 0.8554 0.9476 0.9137 0.8628
0.8865 0.8852 0.6240 0.9107 0.8775 0.6831 0.8611 0.8295 0.7620
1.0694 1.0988 1.2476 1.0793 1.1497 1.0929 1.0579 1.0870 1.0860
0.9277 0.9571 1.2703 0.9557 0.9063 1.1962 0.9103 0.9117 1.3601
0.9270 0.9564 1.2555 0.9556 0.9050 1.1827 0.9101 0.9111 1.3675
0.9971 1.0808 1.2485 0.9779 1.0484 1.1726 0.9738 0.9903 1.3373
0.8700 0.8837 0.9763 0.9054 0.8593 0.8989 0.8758 0.8414 0.9200
0.9923 1.0284 1.4686 1.0346 1.0210 1.2761 1.0019 1.0435 1.1929
0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
0.3131 0.3901 0.7672 0.2966 0.2904 0.6089 0.2121 0.2728 0.5708
1.0177 1.0063 0.9378 0.9811 0.9389 0.8743 0.9640 0.9088 0.7867
0.9655 0.9362 0.8461 0.9370 0.7811 0.7671 0.9029 0.9199 0.7927
1.0705 1.0654 1.0414 1.0348 1.1728 1.0205 1.0333 1.0548 0.9392
0.9886 1.0259 1.1127 0.9503 1.0037 1.0587 0.9611 0.9937 0.9993
0.9877 1.0222 1.0966 0.9494 0.9982 1.0387 0.9558 0.9853 0.9769
1.1285 1.2529 1.0906 1.0354 1.3274 1.0435 1.0926 1.2130 0.9738
0.9635 0.9381 0.9610 0.9276 0.8900 0.8958 0.9356 0.9139 0.8800
1.0152 1.0186 1.0871 0.9869 1.1165 1.0490 0.9735 0.9897 0.9681
0.96 0.96 0.96 0.96 0.96 0.96 0.96 0.96 0.96
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
0.1996 0.2625 0.3075 0.1996 0.2585 0.2967 0.1888 0.1975 0.2725
1.0309 0.9917 1.0136 0.9957 1.0170 0.9830 1.0125 0.9735 0.9297
0.9808 0.9514 0.9637 0.9610 0.9638 0.9018 0.9813 0.9575 0.8682
1.0662 1.0307 1.0443 1.0288 1.0644 1.0746 1.0606 1.0591 1.0424
1.0213 0.9841 1.0560 0.9909 1.0111 1.0675 1.0228 1.0353 1.0678
1.0173 0.9792 1.0372 0.9881 1.0062 1.0553 1.0165 1.0165 1.0451
1.7107 1.2908 1.0508 1.4615 1.4529 1.1216 1.3934 1.6213 1.1670
0.9769 0.9456 1.0208 0.9650 0.9726 0.9842 0.9865 0.9888 0.9735
1.0060 0.9646 1.0291 0.9834 0.9961 1.0610 1.0029 0.9845 1.0310
R. CARTER HILL, LEE C. ADKINS AND KEITH A. BENDER
−0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96
Test Statistics and Critical Values in Selectivity Models
91
declines. When censoring is severe (␥1 = −0.96) the bootstrap estimator of sampling variation is strongly preferred, except for xw = 1. If censoring is moderate (␥1 = 0.0) BOOT is preferred when = 0. For other cases of moderate censoring HECK and BOOT are similar, except in the unusual case = 0.5 and xw = 9.5. In the case with mild censoring (␥1 = 0.96) HECK and BOOT perform similarly. Table 1b reports for N = 400 the same information as Table 1a. Having more data is better, and all estimators more accurately capture finite sampling variation of the Heckit estimator. Furthermore, the same relative relationships exist between them. When the degree of censoring is large, HECK does not do as well as BOOT or HCE3. The bootstrap standard error BOOT also provides a close measure of finite sample variation in other designs. The exceptions are the designs ␥1 = 0.0, = 0.5 and xw = 9.0 and ␥1 = 0.96, = 0 and xw = 1 In these anomalous cases all standard errors understate the true variation. Tables 2a and 2b report for N = 100 and N = 400, respectively, the ␣ = 0.05 critical values for asymptotic tests. These critical values were computed by sorting the absolute values of the difference between the Monte Carlo Heckit estimates and the true parameter value divided by the relevant asymptotic standard error. Given the evidence in Table 1a it is not surprising that these critical values are not ±1.96, as asymptotic theory would predict. When N = 100 and ␥ = −0.96 (censoring is severe), the empirically deter1 mined critical values are quite different from ±1.96 for all estimators in almost all cases. This is especially true for xw = 1. It is worth noting, however, that even when N = 100, for ␥ = 0.0 or 0.96 (less 1 severe censoring) and = 0.5 or 1.0 (moderate or severe selection bias) with xw = 0.90 or xw = 0.95, then the usual Heckit standard error, HCE3 and BOOT are in a range consistent with the usual 1.96. For N = 100, using the bootstrap standard error, BOOT, produces nominal critical values closer to ±1.96 than HECK when censoring is severe, but the results illustrate that simply using bootstrap standard errors does not solve the problem of testing in small samples. When N = 100 using the bootstrap standard error yields a t-statistic whose critical values are close to ±1.96 even in the severe censoring case. Compare, for example, the critical values based on BOOT with those from HECK (and the others) when censoring is severe and xw = 1. Blindly comparing a Heckit tstatistic to ±1.96 is a less troubling when using the bootstrap standard error than the alternatives. In this context HCE3 also provides a definite improvement over HECK.
␥1
92
Table 1b. Nominal Standard Errors Relative to the Monte Carlo Standard Errors, N = 400 Coefficient: 2 . xw
MCSE
OLS
HCE0
HCE3
HECK
MT
RMT
LEE
BOOT
−0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
0.2388 0.3108 0.8865 0.2047 0.3032 0.8982 0.1440 0.1933 0.5204
0.9658 1.0394 1.0087 0.9403 0.9442 0.9134 0.8999 1.0029 0.8198
0.9419 0.9988 0.9258 0.9186 0.9164 0.8637 0.9024 0.9542 0.8906
0.9905 1.0544 1.0422 0.9631 0.9666 0.9848 0.9508 1.0033 1.0814
0.9517 1.0250 1.1326 0.9302 0.9307 1.0635 0.9319 0.9718 1.1485
0.9516 1.0248 1.1263 0.9300 0.9302 1.0575 0.9295 0.9693 1.1340
0.9662 1.0603 1.1234 0.9466 0.9552 1.0532 0.9361 0.9833 1.1334
0.9230 0.9913 0.9715 0.9184 0.9197 0.9010 0.8939 0.9513 0.9338
0.9695 1.0274 1.0391 0.9404 0.9478 0.9758 0.9311 0.9786 1.0567
0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
0.1398 0.1853 0.2964 0.1405 0.1795 0.3006 0.1063 0.1412 0.2503
1.0055 1.0034 1.0171 0.9445 1.0264 1.0294 1.0008 0.8934 0.7969
0.9805 0.9890 0.9411 0.9344 1.0090 1.0116 1.0015 0.9371 0.8545
1.0144 1.0190 1.0613 0.9601 1.0423 1.0753 1.0265 0.9723 0.9801
1.0027 1.0005 1.0565 0.9472 1.0298 1.0810 1.0159 0.9739 1.0071
1.0026 1.0000 1.0538 0.9461 1.0284 1.0742 1.0118 0.9634 0.9893
1.0727 1.0517 1.0552 0.9871 1.1029 1.0740 1.0206 1.0001 0.9970
0.9813 0.9860 0.9676 0.9378 1.0018 1.0142 1.0004 0.9400 0.8980
0.9980 1.0030 1.0519 0.9497 1.0260 1.0578 1.0200 0.9625 0.9633
0.96 0.96 0.96 0.96 0.96 0.96 0.96 0.96 0.96
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
0.1111 0.1138 0.1769 0.0997 0.1376 0.1643 0.0966 0.1079 0.1409
0.9841 1.0576 0.9365 0.9909 0.9956 1.0011 0.9825 0.8835 0.8950
0.9701 1.0454 0.9182 0.9797 0.9874 0.9894 0.9757 0.9273 0.9288
0.9894 1.0714 0.9487 1.0010 1.0095 1.0332 0.9941 0.9545 0.9600
0.9818 1.0580 0.9533 0.9955 1.0003 1.0421 0.9963 0.9596 0.9861
0.9817 1.0574 0.9502 0.9941 0.9975 1.0354 0.9887 0.9468 0.9672
1.1602 1.2216 0.9554 1.1672 1.1762 1.0474 1.0744 1.0662 0.9778
0.9661 1.0505 0.9369 0.9802 0.9831 1.0014 0.9811 0.9410 0.9635
0.9759 1.0575 0.9431 0.9893 1.0013 1.0290 0.9890 0.9567 0.9733
R. CARTER HILL, LEE C. ADKINS AND KEITH A. BENDER
␥1
xw
OLS
HCE0
HCE3
HECK
MT
RMT
LEE
BOOT
−0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
2.1564 1.9765 2.1854 2.0495 1.9881 2.1838 2.1766 2.1372 2.3388
2.4997 2.4784 3.3944 2.4514 2.5483 2.9830 2.5664 2.5000 2.8207
2.0921 2.0300 2.2879 2.0473 2.0967 2.1977 2.1281 1.9635 2.1199
2.2959 1.9034 1.0708 2.1605 2.4759 1.2258 2.2015 2.0984 1.2288
2.2960 1.9148 1.0896 2.1606 2.4722 1.2676 2.2045 2.0981 1.2198
2.2913 1.8836 1.0890 2.1153 2.4870 1.2799 1.9579 1.9684 1.2635
2.4987 2.4783 2.4424 2.4514 2.5119 2.2716 2.5658 2.4867 2.2081
2.2475 2.1307 1.4372 2.0689 2.1011 1.5520 2.1364 2.0471 1.6392
0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
1.9518 2.1152 2.0411 2.0201 2.0782 2.3039 2.0709 2.1359 2.3178
2.0702 2.2941 2.3298 2.1913 2.8374 2.7945 2.3460 2.2299 2.7172
1.8953 2.0492 1.8919 2.0182 2.1033 2.3425 2.0931 1.9406 2.3249
1.9681 1.8647 1.2812 2.0889 1.9094 1.5838 2.0664 1.9634 2.0401
1.9701 1.8697 1.2866 2.0950 1.9186 1.6462 2.0850 1.9823 2.0613
1.8695 1.7915 1.3344 1.9332 1.6178 1.6463 2.0038 1.6567 1.9249
2.0635 2.2503 1.9916 2.1881 2.7738 2.4435 2.3231 2.2175 2.3276
2.0093 2.0836 1.6607 2.1184 1.9887 2.0065 2.1118 2.0637 2.1305
0.96 0.96 0.96 0.96 0.96 0.96 0.96 0.96 0.96
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
1.9096 1.9942 1.9253 2.1139 1.9368 2.0130 2.0607 1.9905 2.1119
2.0825 2.1298 2.1346 2.2656 1.9385 2.2224 2.1647 2.0239 2.3250
1.9320 1.9958 1.9263 2.1211 1.7726 1.9966 2.0214 1.8937 2.0976
1.8630 1.9569 1.6599 2.1102 1.9358 1.7260 2.0333 1.8877 1.8567
1.8879 1.9955 1.7813 2.1126 1.9411 1.7470 2.0370 1.9386 1.8631
1.6744 1.8357 1.7885 1.7838 1.6993 1.6652 1.5831 1.4887 1.7598
2.0453 2.0626 1.9637 2.2339 1.9153 2.0930 2.1646 1.9670 2.1743
2.0021 2.1470 1.9374 2.2155 1.9506 1.8365 2.0948 1.9886 2.0130
93
Test Statistics and Critical Values in Selectivity Models
Table 2a. Nominal 0.05 Critical Values for Asymptotic Tests, N = 100 Coefficient: 2 .
␥1
94
Table 2b. Nominal 0.05 Critical Values for Asymptotic Tests, N = 400 Coefficient: 2 . xw
OLS
HCE0
HCE3
HECK
MT
RMT
LEE
BOOT
−0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
2.0500 1.8944 1.8752 2.1030 2.1649 2.0592 2.2114 2.0727 2.3443
2.1451 2.0885 2.2606 2.1336 2.1965 2.2756 2.2487 2.1301 2.4222
2.0523 1.9700 2.0678 2.0331 2.0492 2.0304 2.1376 2.0216 2.0593
2.0785 1.9001 1.3247 2.1268 2.1724 1.4440 2.1462 2.1494 1.8965
2.0795 1.8986 1.3388 2.1280 2.1748 1.4656 2.1491 2.1520 1.8980
2.0447 1.8787 1.3454 2.0869 2.1238 1.4657 2.1304 2.1324 1.8969
2.1435 2.0874 2.1320 2.1313 2.1959 2.0921 2.2427 2.1224 2.2716
2.1276 2.0033 1.9484 2.0827 2.1395 1.9184 2.2424 2.1424 1.9422
0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
1.9659 1.8788 1.9069 2.0941 1.9059 1.9118 1.9238 2.1775 2.3878
2.0334 1.9846 2.1461 2.1415 1.9633 1.9348 1.8755 2.2601 2.5730
1.9766 1.9231 2.0072 2.0938 1.9035 1.8304 1.8320 2.1856 2.2710
1.9674 1.8731 1.6711 2.0622 1.9073 1.7409 1.9160 2.0703 1.9941
1.9665 1.8791 1.6868 2.0679 1.9237 1.7682 1.9227 2.0854 2.0103
1.9243 1.8339 1.6884 1.9699 1.7781 1.7681 1.8550 1.9107 1.9815
2.0330 1.9735 2.1198 2.1296 1.9625 1.9340 1.8742 2.2142 2.4375
1.9672 1.9741 1.9156 2.1316 1.9302 1.8751 1.8836 2.1287 2.1631
0.96 0.96 0.96 0.96 0.96 0.96 0.96 0.96 0.96
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
1.9685 1.9170 2.1018 1.9689 1.9287 1.9138 1.9865 2.1878 2.1758
2.0711 1.8881 2.2210 2.0432 2.0100 2.0252 1.8974 2.0817 2.2229
2.0390 1.8575 2.1754 2.0042 1.9722 1.9444 1.8620 2.0182 2.1715
1.9733 1.8954 1.9464 1.9731 1.9223 1.7525 1.9589 2.0688 2.0610
1.9735 1.9034 1.9670 1.9788 1.9223 1.7698 1.9754 2.0788 2.0626
1.8247 1.6659 1.9777 1.7784 1.8189 1.7754 1.8189 1.8654 2.0304
2.0570 1.8753 2.1772 2.0251 2.0015 1.9883 1.8956 2.0299 2.1527
2.0502 1.8722 2.0706 2.0590 2.0391 1.9547 1.9626 2.0396 2.1981
R. CARTER HILL, LEE C. ADKINS AND KEITH A. BENDER
Test Statistics and Critical Values in Selectivity Models
95
When ␥ = 0.0 or 0.96 (less severe censoring) and = 1, BOOT, HCE3 and 1 xw other estimators exhibit critical values that are larger than 1.96. In Tables 3a and 3b , we report for N = 100 and N = 400, respectively, the sizes of the nominal ␣ = 0.05 asymptotic tests. These sizes are computed by calculating the percentage of true null hypotheses rejected in the Monte Carlo experiment, when the t-statistics based on alternative standard error estimators are compared to ±1.96. When N = 100, HECK does not produce tests of predicted size when censoring is severe (␥1 = −0.96) or if xw = 1. Using the bootstrap standard error in these cases is certainly better, except when xw = 1. In other cases using the bootstrap standard error is a good choice; comparing the resulting t-statistic to ±1.96 leads to tests of approximately the correct size. The exception to this rule is when censoring is moderate (␥1 = 0.0), = 0 (so that OLS is BLUE) and xw = 1. When N = 100, HCE3 results in less size distortion than HCE0, which rejects too frequently, a finding consistent with its “too small” standard errors noted in Table 1a. If the usual critical values ±1.96 are employed, then using standard error HCE3 by far the best alternative in our simulation when censoring is severe and xw = 1. In fact using HCE3 seems a good choice overall, with its only real problem occurring when censoring is moderate and the error correlation is = 0.5 and xw = 1. When N = 400 using t-statistics based on the bootstrap standard error yield sizes closer to the nominal ␣ = 0.05 value than using HECK, especially for xw = 1. MT and HECK perform similarly. RMT under-rejects in all cases when censoring is not severe. HCE3 is again preferable to HCE0 over all degrees of censoring and in virtually all cases. Tables 4a and 4b contain the sizes of the nominal ␣ = 0.05 tests based on bootstrap critical values using the pivotal statistic in Eq. (6.4). The usefulness of bootstrapping critical values is immediately obvious. When N = 100, using bootstrap critical values for the t-statistic based on HECK provides tests of close to proper size in all cases other than xw = 1. The MurphyTopel (MT) results are very similar to HECK and the robust version RMT is close, though with a few more extreme values. HCE3 seems to perform relatively well with the bootstrap critical values, even when xw = 1 and censoring is severe (␥1 = −0.96) or not (␥1 = 0.96). If N = 400, using the bootstrap critical values with HCE3 again seems a good alternative across all designs. For smaller amounts of censoring (␥1 = 0.96)
␥1
96
Table 3a. Sizes of the Nominal 0.05 Asymptotic Tests, N = 100 Coefficient: 2 . xw
OLS
HCE0
HCE3
HECK
MT
RMT
LEE
BOOT
−0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
0.0780 0.0540 0.0720 0.0680 0.0560 0.0740 0.0660 0.0760 0.0940
0.1180 0.0940 0.1940 0.1020 0.1000 0.1500 0.1000 0.1300 0.1640
0.0580 0.0600 0.0740 0.0580 0.0500 0.0700 0.0680 0.0500 0.0620
0.0940 0.0380 0.0000 0.0760 0.1040 0.0020 0.0680 0.0680 0.0000
0.0940 0.0380 0.0000 0.0760 0.1040 0.0020 0.0680 0.0680 0.0020
0.0900 0.0380 0.0000 0.0700 0.1040 0.0020 0.0480 0.0500 0.0020
0.1180 0.0940 0.1360 0.1020 0.0980 0.0900 0.1000 0.1300 0.0940
0.0920 0.0680 0.0040 0.0640 0.0640 0.0180 0.0660 0.0540 0.0200
0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
0.0480 0.0660 0.0540 0.0580 0.0680 0.0780 0.0700 0.0720 0.1140
0.0660 0.0880 0.0900 0.0740 0.1620 0.1580 0.1060 0.0820 0.1360
0.0460 0.0580 0.0440 0.0500 0.0700 0.1000 0.0620 0.0420 0.0880
0.0500 0.0400 0.0000 0.0600 0.0400 0.0100 0.0720 0.0500 0.0600
0.0500 0.0420 0.0000 0.0600 0.0460 0.0120 0.0720 0.0540 0.0620
0.0420 0.0320 0.0000 0.0480 0.0200 0.0120 0.0580 0.0280 0.0440
0.0660 0.0820 0.0520 0.0740 0.1540 0.1160 0.1000 0.0780 0.1020
0.0600 0.0620 0.0100 0.0660 0.0500 0.0520 0.0760 0.0540 0.0620
0.96 0.96 0.96 0.96 0.96 0.96 0.96 0.96 0.96
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
0.0420 0.0520 0.0420 0.0680 0.0480 0.0540 0.0620 0.0560 0.0680
0.0640 0.0760 0.0660 0.0860 0.0460 0.0920 0.0680 0.0640 0.1140
0.0440 0.0500 0.0460 0.0680 0.0380 0.0520 0.0540 0.0420 0.0620
0.0440 0.0460 0.0140 0.0640 0.0440 0.0140 0.0640 0.0460 0.0360
0.0440 0.0540 0.0180 0.0640 0.0460 0.0160 0.0640 0.0460 0.0360
0.0240 0.0380 0.0260 0.0340 0.0300 0.0080 0.0180 0.0060 0.0200
0.0580 0.0620 0.0500 0.0820 0.0420 0.0700 0.0660 0.0520 0.0860
0.0640 0.0700 0.0460 0.0800 0.0480 0.0360 0.0600 0.0520 0.0500
R. CARTER HILL, LEE C. ADKINS AND KEITH A. BENDER
␥1
xw
OLS
HCE0
HCE3
HECK
MT
RMT
LEE
BOOT
−0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
0.0580 0.0460 0.0460 0.0740 0.0620 0.0560 0.0780 0.0600 0.1140
0.0740 0.0680 0.0880 0.0760 0.0780 0.0860 0.0880 0.0700 0.1020
0.0560 0.0500 0.0580 0.0540 0.0600 0.0520 0.0780 0.0540 0.0600
0.0620 0.0460 0.0000 0.0740 0.0680 0.0000 0.0660 0.0620 0.0400
0.0620 0.0460 0.0000 0.0740 0.0680 0.0020 0.0660 0.0640 0.0400
0.0580 0.0420 0.0000 0.0680 0.0680 0.0020 0.0600 0.0640 0.0380
0.0740 0.0680 0.0720 0.0760 0.0780 0.0680 0.0880 0.0700 0.0800
0.0700 0.0520 0.0480 0.0680 0.0720 0.0460 0.0800 0.0620 0.0460
0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
0.0500 0.0420 0.0420 0.0640 0.0480 0.0400 0.0420 0.0800 0.1140
0.0620 0.0540 0.0660 0.0720 0.0500 0.0480 0.0400 0.0780 0.1260
0.0540 0.0420 0.0500 0.0680 0.0460 0.0400 0.0360 0.0700 0.0980
0.0520 0.0380 0.0120 0.0600 0.0460 0.0160 0.0360 0.0540 0.0540
0.0520 0.0380 0.0160 0.0620 0.0460 0.0200 0.0380 0.0560 0.0560
0.0420 0.0360 0.0180 0.0520 0.0320 0.0200 0.0300 0.0440 0.0520
0.0620 0.0520 0.0640 0.0720 0.0500 0.0460 0.0400 0.0720 0.1080
0.0500 0.0500 0.0460 0.0760 0.0480 0.0340 0.0420 0.0640 0.0800
0.96 0.96 0.96 0.96 0.96 0.96 0.96 0.96 0.96
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
0.0520 0.0440 0.0600 0.0500 0.0460 0.0400 0.0540 0.0920 0.0820
0.0640 0.0460 0.0720 0.0580 0.0540 0.0620 0.0480 0.0800 0.0800
0.0580 0.0420 0.0640 0.0540 0.0520 0.0480 0.0480 0.0640 0.0720
0.0520 0.0440 0.0480 0.0500 0.0420 0.0260 0.0480 0.0700 0.0560
0.0520 0.0440 0.0500 0.0500 0.0440 0.0260 0.0500 0.0740 0.0600
0.0320 0.0260 0.0500 0.0240 0.0380 0.0240 0.0400 0.0300 0.0560
0.0640 0.0460 0.0620 0.0560 0.0540 0.0520 0.0480 0.0620 0.0680
0.0660 0.0380 0.0580 0.0600 0.0540 0.0460 0.0500 0.0640 0.0700
97
Test Statistics and Critical Values in Selectivity Models
Table 3b. Sizes of the Nominal 0.05 Asymptotic Tests, N = 400 Coefficient: 2 .
␥1
98
Table 4a. Sizes of the Nominal 0.05 Bootstrap Tests, N = 100 Coefficient: 2 . xw
OLS
HCE0
HCE3
HECK
MT
RMT
LEE
−0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
0.0740 0.0520 0.0400 0.0540 0.0440 0.0380 0.0540 0.0380 0.0320
0.0620 0.0400 0.0600 0.0560 0.0560 0.0540 0.0620 0.0380 0.0400
0.0620 0.0460 0.0420 0.0580 0.0580 0.0440 0.0640 0.0520 0.0400
0.0720 0.0480 0.0100 0.0520 0.0640 0.0220 0.0620 0.0640 0.0200
0.0720 0.0480 0.0120 0.0520 0.0640 0.0260 0.0620 0.0620 0.0220
0.0860 0.0780 0.0120 0.0560 0.1000 0.0380 0.0580 0.0680 0.0260
0.0660 0.0480 0.0680 0.0560 0.0560 0.0460 0.0620 0.0400 0.0460
0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
0.0540 0.0600 0.0300 0.0600 0.0860 0.0700 0.0680 0.0560 0.0620
0.0420 0.0460 0.0220 0.0480 0.1060 0.0780 0.0680 0.0440 0.0560
0.0420 0.0440 0.0200 0.0500 0.0800 0.0720 0.0720 0.0440 0.0560
0.0500 0.0640 0.0020 0.0540 0.0860 0.0500 0.0680 0.0540 0.1060
0.0480 0.0640 0.0040 0.0520 0.0860 0.0540 0.0660 0.0540 0.0980
0.0520 0.0900 0.0060 0.0560 0.0800 0.0560 0.0800 0.0560 0.1020
0.0440 0.0500 0.0180 0.0460 0.1180 0.0820 0.0700 0.0480 0.0700
0.96 0.96 0.96 0.96 0.96 0.96 0.96 0.96 0.96
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
0.0560 0.0660 0.0340 0.0700 0.0400 0.0520 0.0520 0.0380 0.0660
0.0460 0.0600 0.0340 0.0620 0.0360 0.0440 0.0500 0.0360 0.0560
0.0480 0.0620 0.0320 0.0620 0.0340 0.0460 0.0480 0.0380 0.0560
0.0560 0.0640 0.0220 0.0680 0.0480 0.0580 0.0560 0.0420 0.0820
0.0520 0.0680 0.0280 0.0680 0.0480 0.0620 0.0560 0.0420 0.0800
0.0740 0.0820 0.0520 0.0820 0.0560 0.0860 0.0480 0.0580 0.0760
0.0500 0.0580 0.0240 0.0640 0.0400 0.0600 0.0500 0.0380 0.0760
R. CARTER HILL, LEE C. ADKINS AND KEITH A. BENDER
xw
OLS
HCE0
HCE3
HECK
MT
RMT
LEE
−0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96 −0.96
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
0.0660 0.0480 0.0560 0.0700 0.0760 0.0560 0.0820 0.0660 0.0640
0.0660 0.0500 0.0480 0.0560 0.0720 0.0500 0.0640 0.0600 0.0560
0.0640 0.0500 0.0420 0.0560 0.0680 0.0460 0.0640 0.0600 0.0520
0.0640 0.0460 0.0280 0.0700 0.0780 0.0340 0.0760 0.0640 0.1260
0.0640 0.0460 0.0280 0.0700 0.0760 0.0340 0.0760 0.0660 0.1200
0.0680 0.0500 0.0280 0.0640 0.0760 0.0340 0.0840 0.0640 0.1140
0.0660 0.0500 0.0620 0.0560 0.0720 0.0580 0.0620 0.0600 0.0760
0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
0.0 0.0 0.0 0.5 0.5 0.5 1.0 1.0 1.0
0.90 0.95 1.00 0.90 0.95 1.00 0.90 0.95 1.00
0.0480 0.0400 0.0560 0.0740 0.0480 0.0380 0.0340 0.0620 0.0960
0.0500 0.0320 0.0520 0.0760 0.0420 0.0300 0.0260 0.0580 0.0840
0.0520 0.0320 0.0520 0.0760 0.0420 0.0260 0.0260 0.0580 0.0840
0.0540 0.0480 0.0540 0.0740 0.0500 0.0620 0.0380 0.0680 0.0900
0.0540 0.0460 0.0540 0.0740 0.0500 0.0640 0.0380 0.0660 0.0880
0.0620 0.0520 0.0560 0.0680 0.0540 0.0620 0.0440 0.0740 0.0920
0.0500 0.0320 0.0560 0.0760 0.0420 0.0340 0.0260 0.0580 0.0920
0.96 0.96 0.96
0.0 0.0 0.0
0.90 0.95 1.00
0.0620 0.0380 0.0600
0.0600 0.0360 0.0520
0.0600 0.0360 0.0540
0.0620 0.0420 0.0700
0.0620 0.0400 0.0660
0.0740 0.0420 0.0680
0.0580 0.0360 0.0580
␥1
Test Statistics and Critical Values in Selectivity Models
Table 4b. Sizes of the Nominal 0.05 Bootstrap Tests, N = 400 Coefficient: 2 .
99
100
R. CARTER HILL, LEE C. ADKINS AND KEITH A. BENDER
there is very little difference across the empirical sizes no matter which standard error is used. If N = 400, using HECK with bootstrap critical values is a good choice when censoring is not severe.
8. SUMMARY AND CONCLUSIONS Our research goals for this work were: First, how do the alternative versions of asymptotic variance-covariance matrices used in selectivity models capture the finite sample variability of the Heckit twostep estimator? The answer depends on the degree of censoring and on whether the explanatory variables in the selection and regression equation differ or not. With severe censoring and if the explanatory variables in the two equations are identical, then none of the asymptotic standard error formulations is reliable in small samples. In larger samples the bootstrap does a good job in reflecting estimator variability, as does the White HCE in which the diagonal matrix of squared residuals is weighted, element-wise, by the squared reciprocals of the diagonal of an identity less the “hat” matrix, which we have called V HC3 , following Davidson and MacKinnon (1993). These are both better choices than the usual Heckit asymptotic covariance matrix in the sense of coming closer to the finite sample variation or being slightly conservative. If selection and regression equations have different variables, and if the sample is small, the bootstrap does relatively well if censoring is strong or moderate. Second, is it possible to use bootstrapping to improve finite sample inference? Three aspects of this question are: ◦ Do bootstrap standard errors match finite sample variability better than nominal standard errors computed from asymptotic covariance matrices? As noted in the previous summary point, the answer to this is yes, unless censoring is severe, and the explanatory variables in the selection and regression equations are the same. ◦ Do critical values of test statistics generated by bootstrapping pivotal t-statistics lead to better test size than those based on usual asymptotic theory? The answer is yes, and this is the most interesting and useful finding in the current research. ◦ If censoring is severe, or when the sample is small, we recommend using HCE3 with bootstrapped critical values when carrying out tests about the slope parameters, or when constructing interval estimates. ◦ If the sample is large and censoring is moderate or less severe, then using the standard Heckit standard errors with bootstrapped critical values is satisfactory.
Test Statistics and Critical Values in Selectivity Models
101
◦ Does modern software make obtaining bootstrap standard errors and critical values feasible for empirical researchers? Yes. Sample programs in the appendix show that it is simple to obtain bootstrap standard errors, and almost as simple to obtain bootstrap critical values with Heckit or HCE3 standard errors.
ACKNOWLEDGMENTS The authors would like to thank Bill Greene for responding to our queries about LIMDEP and making an adjustment in the program. The authors benefited from discussion by participants at the LSU Advances in Econometrics Conference, November 2002, Tom Fomby and Viera Chmelarova. Any errors are ours.
REFERENCES Amemiya, T. (1984). Tobit models: A survey. Journal of Econometric, 24, 3–61. Davidson, R., & MacKinnon, J. (1993). Estimation and inference in econometrics. New York: Oxford University Press. Deis, D., & Hill, R. C. (1998). An application of the bootstrap method to the simultaneous equations model of the demand and supply of audit services. Contemporary Accounting Research, 15, 83–99. Eicker, F. (1963). Asymptotic normality and consistency of the least squares estimators for families of linear regressions. Annals of Mathematical Statistics, 34, 447–456. Ermisch, J. F., & Wright, R. E. (1993). Wage offers and full-time and part-time employment by British women. The Journal of Human Resources, 28, 111–133. Freedman, D., & Peters, S. (1984a). Bootstrapping and econometric model: Some empirical results. Journal of Business & Economic Statistics, 2, 150–158. Freedman, D., & Peters, S. (1984b). Bootstrapping a regression equation: Some empirical results. Journal of the American Statistical Association, 79, 97–106. Greene, W. H. (1981). Sample selection bias as a specification error: Comment. Econometrica, 49, 795–798. Greene, W. H. (1997). Econometric analysis (3rd ed.). Upper Saddle River, NJ: Prentice-Hall. Griffiths, W. E., Hill, R. C., & Pope, P. (1987). Small sample properties of probit estimators. Journal of the American Statistical Association, 73, 191–193. Hardin, J. W. (2002). The robust variance estimator for two-stage models. The Stata Journal, 2, 253–266. Hardin, J. W. (2003). The Sandwich estimate of variance. In: T. B. Fomby & R. C. Hill (Eds), Advances in Econometrics, 17, Maximum Likelihood Estimation of Misspecified Models: Twenty Years Later (pp. 45–73). Elsevier. Heckman, J. J. (1979). Sample Selection Bias as a Specification Error. Econometrica, 47, 153–161. Horowitz, J. L. (1997). Bootstrap methods in econometrics: Theory and numerical performance. In: D. M. Kreps & K. F. Wallis (Eds), Advances in Economics and Econometrics: Theory and Applications, Seventh World Congress (Vol. 3, pp. 188–222). Cambridge: Cambridge University Press.
102
R. CARTER HILL, LEE C. ADKINS AND KEITH A. BENDER
Horowitz, J. L., & Savin, N. E. (2000). Empirically relevant critical values for hypothesis tests: A bootstrap approach. Journal of Econometrics, 95, 375–389. Huber, P. J. (1967). The behavior of maximum likelihood estimation under non-standard conditions. In: L. M. LeCam & J. Neyman (Eds), Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability (Vol. 1, pp. 221–233). Berkeley: University of California Press. Hunter, L. W. (2000). What determines job quality in nursing homes? Industrial and Labor Relations Review, 53, 463–481. Jeong, J., & Maddala, G. S. (1993). A perspective on application of bootstrap methods in econometrics. In: G. S. Maddala, C. R. Rao & H. D. Vinod (Eds), Handbook of Statistics (Vol. 11, pp. 573–610). New York: North-Holland. Kauermann, G., & Carroll, R. J. (2001). A note on the efficiency of Sandwich covariance matrix estimation. Journal of the American Statistical Association, 96, 1387–1396. Lee, L.-F. (1982). Some approaches to the correction of selectivity bias. Review of Economic Studies, 49, 355–372. Long, J. S., & Ervin, L. H. (2000). Correcting for heteroscedasticity with heteroscedasticity consistent standard errors in the linear regression model: Small sample considerations. American Statistician, 54, 217–224. Mroz, T. A. (1987). The sensitivity of an empirical model of married women’s hours of work to economic and statistical assumptions. Econometrica, 55, 765–799. Murphy, K. M., & Topel, R. H. (1985). Estimation and inference in two-step econometric models. Journal of Business & Economic Statistics, 34, 370–379. Nawata, K. (1993). A note on the estimation of models with sample selection biases. Economics Letters, 42, 15–24. Nawata, K. (1994). Estimation of sample selection bias models by the maximum likelihood estimator and Heckman’s two-step estimator. Economics Letters, 45, 33–40. Nawata, K., & McAleer, M. (2001). Size characteristics of tests for sample selection bias: A Monte Carlo comparison and empirical example. Econometric Reviews, 20, 105–112. Nawata, K., & Nagase, N. (1996). Estimation of sample selection bias models. Econometric Reviews, 15, 387–400. Puhani, P. A. (2000). The Heckman correction for sample selection and its critique. Journal of Economic Surveys, 14, 53–68. Simpson, W. (1986). Analysis of part-time pay in Canada. Canadian Journal of Economics, 19, 798– 807. Vella, F. (1998). Estimating models with sample selection bias: A survey. Journal of Human Resources, 33, 127–172. White, H. J. (1980). A Heteroskedasticity-consistent covariance matrix estimator and a direct test for Heteroskedasticity. Econometrica, 48, 817–838. Wu, C., & Kwok, C. C. Y. (2002). Why do U.S. firms choose global equity offerings? Finanacial Management, Summer, 47–65. Zuehlke, T. W., & Zeman, A. R. (1991). A comparison of two-stage estimators of censored regression models. Review of Economics and Statistics, 73, 185–188.
Test Statistics and Critical Values in Selectivity Models
103
APPENDIX A In this appendix we provide bare bones code in Stata 8.0 and LIMDEP 8.0 to carry out bootstrapping in the Heckit model. The data, code files and output are available at http://www.bus.lsu.edu/economics/faculty/chill/personal/Heckit.htm
The Example The data are from Thomas Mroz’s widely cited example (1987, “The Sensitivity of an Empirical Model of Married Women’s Hours of Work to Economic and Statistical Assumptions,” Econometrica, 55, 765–799) and consist of 753 observations from the 1987 Panel Study of Income Dynamics. The linear model of interest has the logarithm of wage dependent on education, experience and age: ln(wage) = 1 + 2 ed + 3 ex + 4 ex2 + 5 age + e
(A.1)
However, many in the sample are observed with zero wages, suggesting that there may be sample selection bias; omitted factors in the wage equation may be correlated with a decision to work. The selection equation considered is: z ∗ = ␥1 + ␥2 ed + ␥3 ex + ␥4 ex2 + ␥5 age + ␥6 klt6 + v
(A.2)
where klt6 is the number of children less than 6 years old present. The latent variable, z∗ , is only observed in one of two states; either one works for wages (z = 1) or does not (z = 0). The correlation between v and e is .
APPENDIX B STATA 8.0: THE .DO FILE clear #delimit; use c:\stata\mroz; heckman lwage educ exper expersq age, select(educ exper expersq age kidslt6) twostep; scalar b1= b[exper]; scalar se1= se[exper];
104
R. CARTER HILL, LEE C. ADKINS AND KEITH A. BENDER
di “Coefficient b1” b1 “Standard Error” se1; set seed 1431241; bootstrap “heckman lwage educ exper expersq age, select (educ exper expersq age kidslt6) twostep” “ b[exper] se[exper] e(lambda) e(rho),” reps(400) level(95) saving(bsstboot) replace; drop all; use bsstboot; gen ttest1 = ( bs 1 − b1)/ bs 2; gen abt=abs(ttest1); pctile abt, p(95); di “The 97.5% critical value is” r(r1); summarize ttest1 abt, detail; histogram ttest1, bin(20) normal; program notes: If the estimated ρ is outside [−1,1], Stata truncates the estimate and makes the error variance computation consistent. To obtain results comparable to LIMDEP, use the rhotrunc option. We are not advocating one approach or the other.
APPENDIX C LIMDEP 8.0 COMMAND FILE reset read;file=c:\mroz.raw;nobs=753;nvar=22;names=inlf,hours,kidslt6,kidsge6, age,educ,wage,repwage,hushrs,husage,huseduc,huswage,faminc,mtr,motheduc, fatheduc,unem,city,exper,nwifeinc,lwage,expersq$ ? M defines coefficient of interest. NSAM is number of bootstraps ? In this example different variables are in selection and regression equations namelist; w=one,educ,exper,expersq,age,kidslt6 $ namelist; x=one,educ,exper,expersq,age $ calc; m=3; nsam=400; k = col(x)+1$ matrix; boott = init(nsam,k,0); bootest = init(nsam,k,0) $
Test Statistics and Critical Values in Selectivity Models
105
probit; lhs=inlf; rhs=w; hold $ select; lhs=lwage; rhs=x$ matrix; truebeta = b $ calc; iter=0 $ proc calc; iter=iter+1 $ draw;n=753;replace$ probit; lhs=inlf; rhs=w; hold $ select; lhs=lwage; rhs=x$ ? tvec = absolute values of t-stats centered at sample estimates matrix; bhat = b; se = vecd(varb); sevec = esqr(se); rse = diri(sevec); dvec = bhat-truebeta; tvec = dirp(dvec,rse); tvec = dirp(tvec,tvec); tvec = esqr(tvec); boott(iter,∗) = tvec’; bootest(iter,∗) = bhat’ $ endproc exec; n=nsam; silent $ matrix; tm=part(boott,1,nsam,m,m); bm=part(bootest,1,nsam,m,m) $ sample; 1-400 $ create; boot bm=bm$ dstat; rhs=boot bm$ ? To sort t-statistics must create variable create; boot tm=tm$ sort; lhs = boot tm $ calc; nval = .95∗ nsam+1 $ matrix; list; tc = part(boot tm,nval,nval,1,1) $ stop $ program notes: If the estimated ρ is outside [−1,1], LIMDEP truncates the estimate. Reminder–in Project Settings specify enough memory for sample size of 753 observations.
ESTIMATION, INFERENCE, AND SPECIFICATION TESTING FOR POSSIBLY MISSPECIFIED QUANTILE REGRESSION Tae-Hwan Kim and Halbert White ABSTRACT To date, the literature on quantile regression and least absolute deviation regression has assumed either explicitly or implicitly that the conditional quantile regression model is correctly specified. When the model is misspecified, confidence intervals and hypothesis tests based on the conventional covariance matrix are invalid. Although misspecification is a generic phenomenon and correct specification is rare in reality, there has to date been no theory proposed for inference when a conditional quantile model may be misspecified. In this paper, we allow for possible misspecification of a linear conditional quantile regression model. We obtain consistency of the quantile estimator for certain “pseudo-true” parameter values and asymptotic normality of the quantile estimator when the model is misspecified. In this case, the asymptotic covariance matrix has a novel form, not seen in earlier work, and we provide a consistent estimator of the asymptotic covariance matrix. We also propose a quick and simple test for conditional quantile misspecification based on the quantile residuals.
Maximum Likelihood Estimation of Misspecified Models: Twenty Years Later Advances in Econometrics, Volume 17, 107–132 Copyright © 2003 by Elsevier Ltd. All rights of reproduction in any form reserved ISSN: 0731-9053/doi:10.1016/S0731-9053(03)17005-3
107
108
TAE-HWAN KIM AND HALBERT WHITE
1. INTRODUCTION Since the seminal work of Koenker and Bassett (1978) and Bassett and Koenker (1978), the literature on quantile regression and least absolute deviation (LAD) regression has grown rapidly in many interesting directions, such as simultaneous equation and two stage estimation (Amemiya, 1982; Powell, 1983), censored regression (Buchinsky & Hahn, 1998; Powell, 1984, 1986), serial correlation and GLS estimation (Weiss, 1990), bootstrap methods (Hahn, 1995; Horowitz, 1998), structural break testing (Bai, 1995), ARCH models (Koenker & Zhao, 1996), and unit root testing (Herce, 1996).1 All these papers, however, assume explicitly or implicitly that the conditional quantile regression model is correctly specified. When the model is misspecified, confidence intervals and hypothesis tests based on the conventional covariance matrix are, as we show, invalid. Even though misspecification is a generic phenomenon and correct specification is rare in reality, there has to date been no theory proposed for inference when a conditional quantile model may be misspecified. In this paper, we allow for possible misspecification of a linear conditional quantile regression model. We obtain consistency of the quantile estimator for certain “pseudo-true” parameter values and asymptotic normality of the quantile estimator when the model is misspecified. In this case, the asymptotic covariance matrix has a novel form, not seen in earlier work, and we provide a consistent estimator of the asymptotic covariance matrix. Of course, one can estimate the conditional quantile model without assuming correct specification using various non-parametric methods such as kernel estimation (Sheather & Marron, 1990), nearest-neighbor estimation (Bhattacharya & Gangopadhyay, 1990), or using artificial neural networks (White, 1992). Our results thus provide a convenient parametric alternative to non-parametric methods when researchers are not sure about correct specification or when they want to keep a parametric model for reasons of parsimony or interpretability even though it may not pass a specification test such as the non-parametric kernel based test proposed by Zheng (1998).
2. BASIC ASSUMPTIONS AND MODEL Consider a random series (Y t , X t ) where t = 1, 2, . . . , T, Y t is a scalar, Xt is a k × 1 vector, and k ≡ k˜ + 1. The first element in Xt is one for all t. First, we specify the data generating process. Assumption 1. The sequence {Y t , X t } is independent and identically distributed (iid).
Estimation, Inference, and Specification Testing
109
The iid assumption is made for clarity and simplicity. It can be straightforwardly relaxed. We denote the conditional distribution of Yt given X t = x by F Y|X (·|x). As is now standard in the quantile regression literature, we define the “check” function : R → R + for given ∈ (0, 1) as (z) ≡ z (z), where (z) ≡ − 1[z≤0] . We define the th conditional quantile of Yt given Xt as q (Y t |X t ) ≡ inf{y : F Y|X (y|X t ) ≥ }. Next, we impose the following assumption on the joint density of (Y t , X t ). Assumption 2. The random vector (Y t , X t2 , X t3 , . . . , X tk ) is continuously distributed with joint probability density f Y,X (·, ·) and conditional probability density f Y|X (·|x) for Yt given X t = x. Under Assumption 2, the conditional quantile q (Y t |X t ) satisfies f Y|X (y|X t )dy − = 0, which is equivalent to
q (Yt |Xt ) −∞
E[ (Y t − q (Y t |X t ))|X t ] = 0.
(2.1)
The condition (2.1) can be used to check if a given function of Xt is the th conditional quantile of Yt given Xt or not. It is well known that q (Y t |X t ) ∈ arg min E[ (Y t − f(X t ))], f
(2.2)
where f belongs to a space of measurable functions defined as F ≡ {g : R k → R such that g is measurable and E|g(X t )| < ∞}. Here, we focus only on the affine space A(⊂ F) ≡ {g : R k → R such that for some k × 1 vector , g(X t ) = X t  and E|g(X t )| < ∞}. For the objective function in (2.2) to be well-defined, we impose some moment conditions on (Y t , X t ). The following conditions are sufficient. Assumption 3. E|Y t | < ∞, and E||X t || < ∞, where ||X t || ≡ (X t X t )1/2 . Now we give a definition of correct model specification. Definition 1. We say a conditional quantile model {h(·, ) ∈ F,  ∈ R k } is correctly specified for q (Y t |X t ) if and only if there exists a vector 0 ∈ R k such that h(X t , 0 ) = q (Y t |X t ) almost surely, i.e. q θ ∈ F. We impose the following quantile version of the orthogonality condition. Assumption 4. There exists ∗ such that E(X t (Y t − X t ∗ )) = 0.
110
TAE-HWAN KIM AND HALBERT WHITE
Given the “pseudo-true parameters” ∗ of Assumption 4, we can define the “error” t ≡ Y t − X t ∗ . Assuming that E( (t )|X t ) = 0, which is stronger than Assumption 4, is equivalent to assuming that the conditional quantile model is correctly specified. This can be easily checked using (2.1). Thus, Assumption 4 permits the conditional quantile model to be misspecified. Let B denote a subset in Rk large enough to contain ∗ . Then, under our conditions Assumption 4 implicitly defines the parameter of interest ∗ as the solution to the minimization problem: min E[ (Y t − X t )] ∈B
which is well-defined by Assumption 3. As discussed by White (1994, pp. 74–75), this optimization problem corresponds to maximizing the expected log-likelihood for a particular density function. The regression quantile parameter estimator ˆ T , obtained by minimizing the sample analog min S T () ≡ T ∈B
−1
T
(Y t − X t ),
(2.3)
t=1
can therefore be viewed as a quasi-maximum likelihood estimator (QMLE).
3. CONSISTENCY AND ASYMPTOTIC NORMALITY First, we establish the consistency of the quantile estimator ˆ T for ∗ using Lemmas 2.2 and 2.3 in White (1980a). The consistency result is the first step in deriving the asymptotic normality of the quantile estimator. The following additional assumptions suffice for the proof of consistency. Assumption 3 . There exists ␦ > 1 such that E(||X t ||␦ ) < ∞. Assumption 5. ∗ ∈ B, where B is a compact subset of Rk . Assumption 6. For all x, f |X (0|x) > 0 where f |X (·|x) is the conditional density of t ≡ Y t − X t ∗ given X t = x. Lemma 1. Suppose that Assumptions 1, 2, 3 , 4, 5, and 6 hold. Then ˆ T − ∗ = o p (1). All proofs are provided in the Mathematical Appendix. There are several techniques available in the literature to derive asymptotic normality for the quantile and the LAD estimators. Among these are the linear programming method (Bassett & Koenker, 1978; Koenker & Bassett, 1978); the
Estimation, Inference, and Specification Testing
111
smoothing method (Bloomfield & Steiger, 1983); the convexity method (Pollard, 1991); and the generalized Taylor expansion method (Phillips, 1991). Here, we follow the method used by Huber (1967), Ruppert and Carroll (1980), and later extended by Pollard (1985). Huber (1967) gave sufficient conditions that deliver asymptotic normality for any sequence ˆ T satisfying T −1/2
T
(Z t , ˆ T ) = o p (1).
(3.1)
t=1
In our case, (Z t ,ˆ T ) = X t (Y t − X t ˆ T ). The condition (3.1) can be viewed as the first order condition for the quantile estimator ˆ T because the left hand term is essentially the vector of left partial derivatives of the objective function in (2.3) evaluated at ˆ T . Because we define the quantile estimator ˆ T using (2.3) rather than (3.1), we must establish (3.1). For this, we use the following assumption. Assumption 3 . There exists ␦ > 2 such that E(||X t ||␦ ) < ∞. Lemma 2. Suppose that Assumptions 2 and 3 hold. Then T −1/2 (Y t − X t ˆ T ) = o p (1).
T
t=1 X t
Next, we define () ≡ E[X t (Y t − X t )]. Since () can be shown to be continuously differentiable in , we have by the mean value theorem () = (∗ ) − Q ∗ ( − ∗ ),
(3.2)
≡ E[f |X (∗t |X t )X t X t ] and ∗t is between 0 and X t ( − ∗ ). Note that 0 by the definition of ∗ . We use the expression for () in (3.2) to obtain
Q∗
where (∗ ) = a variant of the Taylor expansion of (), which will be the key step obtaining the asymptotic distribution of the quantile estimator. We impose the following conditions. Assumption 3 . E(||X t ||3 ) < ∞.
Assumption 7. The conditional density f |X (|x) of t given X t = x is Lipschitz continuous: i.e. |f |X (1 |x) − f |X (2 |x)| ≤ L 0 |1 − 2 | for some constant 0 < L 0 < ∞ and for all x. Lemma 3. Suppose that Assumption 3 and 7 hold. Then ||() − (∗ ) + Q 0 ( − ∗ )|| = o(|| − ∗ ||), where Q 0 ≡ E[f |X (0|X t )X t X t ]. The final step in obtaining asymptotic normality of the quantile estimator ˆ T is to show that T 1/2 (ˆ T ) converges to some random variable in distribution. In fact, using Theorem 3 in Huber (1967), −T 1/2 (ˆ T ) and T −1/2 Tt=1 X t (t ) turn
112
TAE-HWAN KIM AND HALBERT WHITE
out to be asymptotically equivalent. To show this, we impose some additional assumptions. Assumption 8. ∗ is an interior point of B. Assumption 9. Q0 is positive definite. Assumption 10. There exists a constant f1 such that f |X (|x) ≤ f 1 for all and x. Lemma Assumptions 1, 2, 3 , 4−6 and 8–10 hold. Then T4. Suppose that1/2 −1/2 (ˆ T ) = o p (1). T t=1 X t (t ) + T Combining Lemma 3 and Lemma 4 and adding one more assumption permit us to state our main theorem. We impose Assumption 11. V ≡ E( (t )2 X t X t ) is positive definite. Theorem 1. Suppose that Assumptions 1, 2, 3 , 4–11 hold. Then d −1 T 1/2 (ˆ T − ∗ ) → N(0, C) where C ≡ Q −1 0 VQ 0 is positive definite. The asymptotic distribution in Theorem 1 includes all previously obtained results as special cases. Suppose that the linear conditional quantile model is correctly specified. Then it can be shown that V = (1 − )Q where Q ≡ E(X t X t ). This case thus corresponds to Powell (1984) who obtains d −1 T 1/2 (ˆ T − ∗ ) → N(0, (1 − )Q −1 0 QQ 0 ). Consider the more restricted case where not only is the linear conditional quantile model correctly specified but also there is no conditional heterogeneity in the density f at the origin (no “heteroaltitudinality”), that is f |X (0|X t ) = f(0). Then one can show that Q 0 = f(0)Q as well as V = (1 − )Q. This corresponds to the standard case of Koenker and d Bassett (1978), who obtain T 1/2 (ˆ T − ∗ ) → N(0, ((1 − )/f(0)2 )Q −1 ). Now consider testing a hypothesis about ∗ : H 0 : R∗ = r H a : R∗ = r, where R is a finite q × k matrix of full row rank and r is a finite q × 1 vector. Then Theorem 1 implies that, for example, d 2 ˆ −1 R ]−1 (R ˆ T − r)→ T(R ˆ T − r) [R C q T
(3.3)
p ˆT → under the null hypothesis, where C C is a covariance matrix estimator, consistent for C despite the possible misspecification. To implement such tests ˆ T . This is the focus of our next section. we require a consistent estimator C
Estimation, Inference, and Specification Testing
113
4. CONSISTENT COVARIANCE MATRIX ESTIMATION In this section, we provide an estimator for the asymptotic covariance matrix C that is consistent despite possible misspecification. The asymptotic covariance matrix consists of two components: Q0 and V. Powell (1984) suggested the following estimator for Q0 without formally proving its consistency: ˆ 0T ≡ (2ˆcT T)−1 Q
T
1[−ˆcT ≤ˆt ≤ˆcT ] X t X t ,
(4.1)
t=1
where cˆ T may be a function of the data and ˆ t ≡ Y t − X t ˆ T . We impose the following conditions on the sequence {ˆcT }. Assumption 12. There is a stochastic sequence {ˆcT } and a non-stochastic sequence {cT } such that p
(i) ccˆ TT → 1 (ii) c T = o(1)√ (iii) c −1 T = o( T ). ˆ 0T . We can now rigorously establish the consistency of Powell’s estimator Q Lemma 5. Suppose that T 1/2 ||ˆ T − ∗ || = O p (1) and Assumptions 1, 3 , 7, p ˆ 0T → Q0. 10 and 12 hold. Then Q Next, we use the plug-in principle to propose a consistent estimator of V: Vˆ T ≡ T −1
T uˆ 2t X t X t , t=1
where uˆ t ≡ (ˆt ). The estimator Vˆ T is completely analogous to White’s (1980b) estimator, for which uˆ t is the OLS residual. Lemma 6. Suppose that T 1/2 ||ˆ T − ∗ || = O p (1) and Assumptions 1, 3 , and p 10 hold. Then Vˆ T → V. We now define our estimator for the asymptotic covariance matrix C as ˆ −1 . ˆ −1 Vˆ T Q ˆT ≡ Q C 0T 0T
(4.2)
p ˆT → Together, Lemmas 5 and 6 imply C C, ensuring the consistency of the covariance estimator. This allows us to obtain a computable Wald statistic and its asymptotic distribution as follows.
114
TAE-HWAN KIM AND HALBERT WHITE
Theorem 2. Suppose that Assumptions 1, 2, 3 , 4–12 hold. Let the null hypothesis be given by H 0 : R∗ = r where R is a given finite q × k matrix of full row rank and r is a given finite q × 1 vector. Then under H0 , d
ˆ −1 R ]−1 (R ˆ T − r)→2q , T(R ˆ T − r) [R C T ˆ T is defined in (4.2). where C Although we do not pursue the issue here, we note that just as MacKinnon and White (1985) found modifications of Vˆ T that afforded improvements in finite sample properties, so also may there be analogous modifications of Vˆ T here. We leave this to subsequent research.
5. A TEST FOR CORRECT QUANTILE SPECIFICATION As we have seen in Section 3, if the conditional quantile model is correctly specified, then we have the quantile version of information matrix equality: V = (1 − )Q. We formally state this in the following lemma. Lemma 7. Suppose that Assumptions 2 and 3 hold and let u t ≡ (t ). If the conditional quantile model is correctly specified (i.e. E(u t |X t ) = 0), then we have V = (1 − )Q: that is, E(u 2t X t X t ) = E(u 2t )E(X t X t ). Equivalently, this can be written E((u 2t − 2u )X t X t ) = 0, where 2u ≡ E(u 2t ) = (1 − ). It is interesting to note that in order to have the same equality as in Lemma 7 in the context of OLS regression, we require two conditions: (1) the conditional expectation model is correctly specified; and (2) that there is no conditional heteroskedasticity in ut . See White (1980b) for details. However, for quantile regression, correct specification is the only sufficient condition due to the special structure of ut . According to Lemma 7, any misspecification in the conditional quantile is a form of conditional heteroskedasticity in ut . In such situations, inference based on the information equality is invalid. Zheng (1998) has developed a consistent test for conditional quantile misspecification. That test is based on a non-parametric kernel estimation and may accordingly be somewhat cumbersome to implement. We now propose a very easy to use specification testing procedure that exploits the quantile version of the information matrix equality in Lemma 7. Under the null hypothesis of correct specification of the conditional quantile function, we have E[h(X t )(u 2t − 2u )] = 0,
(5.1)
Estimation, Inference, and Specification Testing
115
where h(·) is a measurable s × 1 vector function. The information matrix test obtains when h(Xt ) selects some elements from the matrix X t X t . Using the fact that u 2t = 2u − (1 − 2) (t ) the expression in (5.1) can be shown to be equivalent to E[h(X t ) (t )] = 0.
(5.2)
A scaled sample version of the expectation in (5.2), which is our proposed test statistic for the null of correct specification, is given by T −1/2 m(ˆ T ),
where m(ˆ T ) = T −1 Tt=1 h(X t ) (Y t − X t ˆ T ). Note that to avoid degeneracies h(Xt ) cannot have elements equal to any element of Xt , as Lemma 2 ensures that T −1/2 Tt=1 X t (Y t − X t ˆ T ) = o p (1). We further restrict the space to which the function h(·) belongs using the following moment condition. Assumption 13. There exists ␦ > 2 such that E(||h(X t )||␦ ) < ∞. The following lemma is useful in deriving the asymptotic distribution of the proposed statistic. and 13 hold. Then Lemma 8. Suppose that Assumptions T 1, 3 ∗ ∗ 1/2 −1/2 sup ∈BT |T [m() − m( )] − T t=1 h(X t )[F t () − F t ( )]| = o p (1), ∗ 1/2 where B T ≡ { ∈ B : T || −  || ≤ M T and M T = O(1)}, and F t () ≡ F Y|X (X t |X t ).
The proof easily follows from Andrews (1989) once we show that T 1/2 [m T () − m T (∗ )] − T −1/2
T
h(X t )[F t () − F t (∗ )] = T −1/2
t=1
T
H(Z t ,),
t=1
where H(Z t ,) ≡ h(X t ){1[Y t ≤X t ] − 1[Y t ≤X t ∗ ] − [F t () − F t (∗ )]}. As the indicator functions 1[Y t ≤X t ] , 1[Y t ≤X t ∗ ] and the cumulative density functions Ft (), Ft (∗ ) are functions of bounded variation, the iid assumption (Assump tion 1) and the moment T conditions (Assumptions 3 and 13) are sufficient −1/2 to show that T t=1 H(Z t ,) is stochastically equicontinuous; that is, sup ∈BT |T −1/2 Tt=1 H(Z t , )| ≤ o p (1) using Theorems II.2 and II.3 in Andrews (1989). Theorem 3. Suppose that Assumptions 1, 2, 3 , 4–13 hold. (i) Suppose that the conditional quantile model is correctly specid −1/2 fied. Then 0 T 1/2 m(ˆ T ) → N(0, I s×s ) provided 0 ≡ (1 − )
116
TAE-HWAN KIM AND HALBERT WHITE
−1 −1 −1 (A 0 Q −1 0 QQ 0 A 0 − A 0 Q 0 A − A Q 0 A 0 + 0) is non-singular, where A 0 ≡ E[f |X (0|X t )X t h(X t ) ], A ≡ E(X t h(X t ) ) and D ≡ E(h(X t )h(X t ) ). (ii) Suppose that the conditional quantile model is correctly specified and that there is no conditional heteroaltitudinality in f Then d −1/2 T 1/2 m(ˆ T ) → N(0, I s×s ) provided ≡ (1 − )(D − A QA) is non-singular.
It is straightforward to derive consistent estimators for A, A0 and D using the plug-in principle. For example, ˆ T ≡ T −1 A
T
X t h(X t )
t=1
ˆ 0T ≡ (2ˆcT T)−1 A
T
1[−ˆcT ≤ˆt ≤ˆcT ] X t h(X t )
t=1
ˆ T ≡ T −1 D
T
h(X t )h(X t ) ,
t=1
ˆ 0T in (4.1). It can be easily where cˆ T and ˆ t are the same as in the definition of Q p p p ˆ T → A, A ˆ 0T → A 0 and D ˆT → shown using Lemma 5 that A D. Therefore, the null of correct specification of the conditional quantile function can be tested using the fact that under the null d 2 ˆ −1 m(ˆ T )→ Tm(ˆ T ) s
ˆ is a consistent estimator for either 0 or as desired, and which can be where ˆ 0T , Q ˆ T, A ˆ 0T , A ˆ T and D ˆ T. constructed using Q In particular applications, it may be of interest to test for conditional heteroaltiˆ 0T − fˆ T (0)Q ˆ T ), where fˆ T (0) is tudinality. Such a test can be based on vec h(Q an appropriately chosen consistent estimator of f(0) Because of the complexity introduced by the presence of kernel-type estimators in this difference, the analysis of the asymptotic distribution is somewhat involved, and we leave this to further work.
6. MONTE CARLO SIMULATIONS We conduct simulation experiments to investigate the finite sample properties of our new covariance matrix estimator and to compare it with conventional
Estimation, Inference, and Specification Testing
117
covariance matrix estimators. For later reference we label the various estimators as follows: ˆ −1 , (1 − )fˆ (0)−2 Q −1 ˆ Q ˆQ ˆ −1 , Q-SE2 : (1 − )Q 0 0 −1 ˆ ˆ −1 ˆ Q-SE2 : Q V Q .
Q-SE1 :
0
0
We compare the performance of these alternative estimators in three different set-ups: Case 1 The linear conditional quantile model is correctly specified and there is no conditional heteroaltitudinality in the density f, Case 2 The linear conditional quantile model is correctly specified but there is conditional heteroaltitudinality in the density f, Case 3 The linear conditional quantile model is misspecified and there is conditional heteroaltitudinality in the density f. We expect that Q-SE1 and Q-SE2 will achieve the best performance in Case 1 and Case 2 respectively, but Q-SE3 will be the winner in the most general case (Case 3). Bootstrapping the covariance matrix for quantile regressions has also gradually gained popularity. Hence, we also include the bootstrap covariance estimator in our simulation study. We use the design matrix bootstrap covariance estimator used in Buchinsky (1995), defined as B
1 ˜ ˆ (i () − ())( ˜ i () − ˆ i ()) B i=1
ˆ where () is the -quantile estimator, ˜ i () is the ith bootstrap estimator obtained by resampling the pair (y t , X t ) and B is the number of bootstrap samples. We set B to 500. When estimating Q-SE2 and Q-SE3, we need to make a choice for the bandwidth parameter cT . In our simulations we use three different methods to choose the bandwidth parameter, all of which are derived and discussed in Silverman (1986): two parametric choices based on the standard deviation (2 ) and the interquartile range (R ) of the underlying density f (the expressions are given by 1.06 T −1/5 and 0.79R T −1/5 respectively) and one non-parametric choice based on leastsquares cross-validation. Let (·) be the standard normal cumulative density function. We specify the data generating processes for our cases as follows:
118
TAE-HWAN KIM AND HALBERT WHITE
Case 1 y t = 1 + X t1 + X t2 + t , t ∼iid(−−1 (), 1) Case 2 y t = 1 + X t1 + X t2 + t , t = (X t )t , (X t ) = 1 + X 2t1 + X 2t2 , t ∼iid(−−1 (), 1) Case 3 y t = 1 + X t1 + X t2 + X t3 + 3i=1 3j=1 X ti X tj + t with t specified as in Case 2. In all cases the Xti s are drawn from the standard normal distribution with cross correlation 0.5; the value for the quantile () is set to 0.7. The number of observations and the number of replications are 50 and 1,000 respectively. For each replication we fit following quantile regression: y t = ˆ 0 () + ˆ 1 ()X t1 + ˆ 2 ()X t2 + e t (). The standard error for each coefficient is calculated using the various methods explained above. We report simulation means of the coefficient estimates and of the standard errors in Table 1. The results for Q-SE2 and Q-SE3 in Table 1 are based on the bandwidth choice using the interquartile range, that is cˆ T = 0.79R T −1/5 . We obtained qualitatively similar results using other bandwidth choices, so these are omitted. When the quantile regression model is correctly specified and there is no conditional heteroaltitudinality in the density f (Case 1), all methods to compute standard errors behave similarly except for the bootstrap method, which yields standard errors slightly larger than the other methods. In the last column under the heading “True Std. Dev.” we report the simulated standard deviations of the Table 1. Simulation Means of 0.7-Quantile Estimates and Standard Errors. Quantile Estimates
Q-SE1
Q-SE2
Q-SE3
Bootstrap Std. Errors
True Std. Dev.
Case 1 Xt 1 Xt 2 Constant
1 1 0.99
0.19 0.19 0.19
0.21 0.21 0.20
0.21 0.20 0.20
0.23 0.23 0.22
0.20 0.19 0.19
Case 2 Xt 1 Xt 2 Constant
1 0.99 0.99
0.30 0.30 0.29
0.42 0.41 0.32
0.41 0.40 0.31
0.44 0.43 0.34
0.40 0.37 0.28
Case 3 Xt 1 Xt 2 Constant
1.36 1.32 5.25
1.04 1.04 0.89
1.24 1.23 1.16
1.37 1.36 1.18
1.59 1.60 1.40
1.35 1.37 1.19
Estimation, Inference, and Specification Testing
119
quantile estimates, which closely approximate the true standard deviation of the sampling distribution for the quantile estimator. Not surprisingly, the correct covariance estimator Q-SE1 in Case 1 is smallest and closest to the true standard deviation. It is interesting to note that the efficiency loss caused by using Q-SE2 and Q-SE3 is practically negligible. In Case 2 where Q-SE2 is the valid covariance estimator, both Q-SE2 and Q-SE3 are reasonably close to the truth. The bootstrap standard errors are giving noticeable over-estimates and Q-SE1 is giving noticeable under-estimates. Finally, we turn to Case 3, where Q-SE3 is the only valid covariance estimator. It is clear from the table that only Q-SE3 is close to the truth. Again, the bootstrap standard errors provide over-estimates. While the other two covariance estimators (Q-SE1 and Q-SE2) both provide under-estimates, Q-SE1 is much worse than Q-SE2. The implication is that, at least in the case considered here, any null hypothesis is more likely to be rejected than it should be when the test is based on Q-SE1 or Q-SE2. Our simulation study illustrates that: (i) when the linear conditional quantile model is misspecified and there is conditional heteroaltitudinality in the density f, our new covariance estimator can allow researchers to conduct valid hypothesis tests; (ii) even when these conditions are not satisfied, using our covariance estimator is not likely to cause a serious efficiency loss; and (iii) the bootstrap method to calculate standard errors for quantile regressions should be used with care.
7. APPLICATION TO SHARPE STYLE ANALYSIS In this section, we apply our results to Sharpe style analysis. Following Sharpe’s (1988, 1992) seminal work, the Sharpe style regression has become a popular tool to analyze the style of an investment fund. The Sharpe style regression is carried out by regressing fund returns (over a period of time from a fund manager) on various factors mimicking relevant indices. By analyzing the coefficients of the factors, one can understand the style of a fund manager (e.g. style composition, style sensitivity, or style change over time). As Bassett and Chen (2001) point out, all previous papers have used the method of least squares and hence have concentrated on the relationship between the fund returns and the style factors focused on the mean of the return distribution conditional on the factors. Manager style, however, can be different in different parts of the conditional distribution. For example, a fund manager can change her style when the fund’s performance is very good or bad, which corresponds to high quantiles or low quantiles of the conditional distribution. Bassett and Chen (2001) have proposed using the quantile regression method to analyze the style
120
TAE-HWAN KIM AND HALBERT WHITE
of a fund manager over the entire conditional distribution. They used the returns on the Fidelity Magellan Fund (Rt ) over a 5 year sample period (January, 1992 – December, 1997) with 60 monthly observations. The Russell indices are the factors, which can be classified as follows:
Growth (G) Value (V)
Large (L)
Small (S)
Russell 1000 growth (X LG t ) LV Russell 1000 value (X t )
Russell 2000 growth (X SG t ) SG Russell 2000 value (X t )
The Sharpe style quantile regression equation is then given by LV SG SV R t = ␣() + LG ()X LG t + LV ()X t + SG ()X t + SV ()X t + t . (7.1)
On the grounds that for the equity-only funds (e.g. the Magellan Fund or S & P 500 Index), unconstrained and constrained (non-negativity and summing-to-one) cases are usually similar, Bassett and Chen estimate the equation in (7.1) without the non-negativity and summing-to-one constraints. Their findings can be summarized as follows: (i) for the conditional mean, the Magellan fund has an important LargeValue tilt (coefficient 0.69) and otherwise is equally divided between Large-Growth (0.14) and Small-Growth (0.20); (ii) the tilt to Large-Value appears at the other quantiles with an exception being the Quantile = 0.1, where the coefficient for Large-Growth is the largest; and (iii) in all the quantile regressions, most coefficients are not significant due to large standard errors. We use the same data set with a longer sample period (January, 1979 to December, 1997), yielding 228 monthly observations. Figure 1 shows a time-series plot of the Magellan Fund. Our belief is that the lack of significance encountered by Bassett and Chen is due to the relatively small number of observations. Since we are not sure about the correctness of the linear conditional quantile specification in (7.1), but would like to keep the linear specification, we calculate standard errors using the various methods explained in Section 6. The results for the least squares and quantile regressions are reported in Table 2. We take representative values of 0.1, 0.3, 0.5, 0.7 and 0.9 for in our quantile regressions. For the conditional mean of the distribution (that is, from the least squares regression), the Magellan fund appears to be heavily oriented toward Large-Growth (0.40) and also has an important Large-Value tilt (0.30). The remaining share is equally divided between Small-Growth (0.18) and Small-Value (0.21). In contrast to the findings of Bassett and Chen (2001), the Large-Growth component clearly stands out. This is, however, consistent with their finding that Large-Value orientation is an important component of the style of the Magellan
Estimation, Inference, and Specification Testing
121
Fig. 1. Time-Series Plot of Fidelity Magellan Fund Monthly Returns.
Fund. Further, it is obvious from Fig. 1 that the stock market crash in 1987 generated a huge outlier in the returns series. Considering that the least squares estimator is sensitive to outliers, one might like to see how robust the results are given this circumstance. The least absolute deviations (LAD) estimator is a potentially less sensitive alternative (but see Sakata & White, 1995, 1998). The LAD results are reported in the middle of Table 2 ( = 0.5). The coefficient for Large-Growth and Small-Growth are almost unchanged, but the coefficient for Large-Value changes from 0.30 to 0.38 while the coefficient for Small-Value has been reduced by half. As we change the value of , the style weight for Large-Growth (ˆ LG ()) is also gradually decreasing with while the style weight for Large-Value (ˆ LV ()) becomes more important as increases except at = 0.9 where there is a sudden drop. The style pattern for Small-Growth (ˆ SG ()) is also noticeably changing with . The tilt to Small-Growth is substantially increasing with , indicating that the fund tends to invest heavily in Small-Growth stocks when the fund’s performance is good, but reduces its share to a statistically insignificant point (when = 0.1, ˆ SG () is not significant) when the fund’s performance is poor. The allocation to Small-Value (ˆ SV ()) is decreasing with except at = 0.9 where it is sharply increasing. In order to see the change in the style against in detail, we examine a grid of values for (from 0.1 to 0.9 with 0.1 increment) and plot each quantile ˆ estimate () with its 95% confidence interval (constructed using Q-SE3) against . This plot is displayed in Fig. 2. The figure confirms our earlier observations.
122
TAE-HWAN KIM AND HALBERT WHITE
Table 2. Mean Style and Quantile Style for Fidelity Magellan Fund. Estimation
Std. Err.
ˆ LG ()
ˆ LV ()
ˆ SG ()
ˆ SV ()
LS-SE1 LS-SE2
0.40 0.07 0.07
0.30 0.08 0.08
0.18 0.06 0.06
0.21 0.08 0.07
0.45 0.11 0.11
Q-SE1 Q-SE2 Q-SE3
0.49 0.11 0.15 0.15
0.21 0.13 0.19 0.21
0.01 0.09 0.10 0.10
0.36 0.12 0.16 0.16
−1.43 0.17 0.19 0.19
Q-SE1 Q-SE2 Q-SE3
0.45 0.08 0.10 0.10
0.30 0.09 0.12 0.12
0.11 0.07 0.08 0.09
0.19 0.09 0.08 0.08
−0.25 0.13 0.16 0.16
Q-SE1 Q-SE2 Q-SE3
0.40 0.08 0.07 0.07
0.38 0.09 0.09 0.09
0.18 0.06 0.08 0.08
0.12 0.09 0.09 0.09
0.44 0.12 0.13 0.13
Q-SE1 Q-SE2 Q-SE3
0.35 0.08 0.06 0.06
0.39 0.10 0.08 0.08
0.24 0.07 0.06 0.06
0.10 0.09 0.07 0.07
1.07 0.13 0.14 0.13
Q-SE1 Q-SE2 Q-SE3
0.27 0.12 0.15 0.13
0.20 0.14 0.20 0.20
0.32 0.10 0.09 0.08
0.26 0.13 0.12 0.11
2.49 0.19 0.25 0.25
Least squares
Quantile = 0.1
Quantile = 0.3
Quantile = 0.5
Quantile = 0.7
Quantile = 0.9
␣() ˆ
Note: LS-SE1 = Conventional standard errors for the least squares estimates. LS-SE2 = White’s heteroskedasticity-consistent standard errors for the least squares estimates.
The pattern of the quantile style (as a function of ) we have found is qualitatively similar to the findings in Bassett and Chen (2001) except for certain large values of , but we can now provide confidence intervals around the quantile style weights that are robust to the potential misspecification of the conditional quantile function. In order to examine the potential for misspecification, we apply our quantile specification test using the selection function h(X t ) = vec h(JX t X t J ) with J = [04×1 I 4×4 ]. The test statistics for the selected values for and for the three alternatives to compute the bandwidth are given in Table 3. The results are fairly robust to the choice of the bandwidth. The overall conclusion is that for most quantiles we do not have evidence strong enough to reject at the 5% level the null that the linear quantile model in (7.1) is correctly specified. The last row in the
Estimation, Inference, and Specification Testing
123
Fig. 2. Quantile Style for Fidelity Magellan Fund.
table, however, indicates that when = 0.9, the linear specification in (7.1) may be misspecified. It is worth noting again that the standard errors in Table 2 and the confidence intervals in Fig. 2 are still valid under this potentially misspecified circumstance.2
Table 3. Information Matrix Specification Test Statistics. Quantile ()
0.1 0.3 0.5 0.7 0.9
Bandwidth Choice: 1.06 T −1/5
Bandwidth Choice: 0.79R T −1/5
12.49 14.52 15.62 16.33 22.10
15.79 14.42 15.42 16.58 22.13
Bandwidth Choice: Least-Squares Cross-Validation 12.40 14.48 15.42 16.58 22.13
Note: The critical value at the 5%-level for the 2 distribution with 10 degrees of freedom is 18.31.
124
TAE-HWAN KIM AND HALBERT WHITE
8. CONCLUSION We have obtained the asymptotic normality of the quantile estimator for a possibly misspecified model and provided a consistent estimator of the asymptotic covariance matrix. This covariance estimator is misspecification-consistent, that is, it is still valid under misspecification. If researchers confine themselves to a parametric world, then our results are useful when there is uncertainty about correct specification or when one wishes to maintain a model that does not pass a specification test. Although we have restricted our discussion to the linear conditional quantile model for iid data, our methods extend straightforwardly to non-linear conditional quantile models with dependent and possibly heterogeneous data. Investigation of these cases is a promising direction for future research. White (1994, esp. pp. 74–75) provides some consistency results for such cases. See Komunjer (2001) for some asymptotic distribution results in this direction.
NOTES 1. An excellent survey on recent developments in quantile regression, particularly with regard to empirical applications of quantile regression, is provided in Buchinsky (1998). For readers who would like to approach quantile regression from a historical perspective, Koenker (2000) is worth reading. An introductory exposition of quantile regression can be also found in books such as Peracchi (2001), Birkes and Dodge (1993). 2. All MATLAB programs and the data set used in the paper can be obtained at the following website: http://www.nottingham.ac.uk/∼leztk/publications.html
ACKNOWLEDGMENTS The authors would like to thank Douglas Stone for providing the data used in the paper and Clive Granger, Patrick Fitzsimmons, Alex Kane, Paul Newbold, Christophe Muller, Christian Gourieroux, Adrian Pagan, and Jin Seo Cho for their helpful comments. White’s research was supported by NSF grants SBR-9811562 and SES-0111238 and Kim’s research was supported by a grant from the University of Nottingham.
REFERENCES Andrews, D. W. K. (1989). Asymptotics for semiparametric econometric models: II. Stochastic equicontinuity and nonparametric kernel estimation. Cowles Foundation discussion paper No. 909R.
Estimation, Inference, and Specification Testing
125
Amemiya, T. (1982). Two stage least absolute deviation estimators. Econometrica, 50, 689–711. Bai, J. (1995). Least absolute deviation estimation of a shift. Econometric Theory, 11, 403–436. Bassett, G., & Chen, H. L. (2001). Portfolio style: Return-based attribution using regression quantiles. Empirical Economics, 26, 293–305. Bassett, G., & Koenker, R. (1978). Asymptotic theory of least absolute error regression. Journal of the American Statistical Association, 73, 618–622. Bhattacharya, P. K., & Gangopadhyay, A. K. (1990). Kernel and nearest-neighbor estimation of a conditional quantile. The Annals of Statistics, 18, 1400–1415. Billingsley, P. (1986). Probability and measure. New York: Wiley. Birkes, D., & Dodge, Y. (1993). Alternative methods of regression. New York: Wiley. Bloomfield, P., & Steiger, W. L. (1983). Least absolute deviations: Theory, applications, and algorithms. Boston: Birkhauser. Buchinsky, M. (1995). Estimating the asymptotic covariance matrix for quantile regression models: A Monte Carlo study. Journal of Econometrics, 68, 303–338. Buchinsky, M. (1998). Recent advances in quantile regression models: A practical guideline for empirical research. The Journal of Human Resources, 33, 88–126. Buchinsky, M., & Hahn, J. (1998). An alternative estimator for the censored quantile regression model. Econometrica, 66, 653–671. Doo