Preface
The survival analysis has become an increasingly active and very important area of research. This is clearly evident from the large body of literature that has been developed in the form of books, volumes and research papers. In addition, several conferences, workshops and short courses have been conducted all over the world during the past two decades. This is the reason we felt that it is indeed a right time to dedicate a volume in the Handbook of Statistics series to highlight some recent advances in both theory and applications in the area of survival analysis. With this specific purpose in mind, we solicited articles from leading experts working in the area of survival analysis from both theoreticians and practitioners. This, in our opinion, has resulted in a volume with a nice blend of articles (40 in total) highlighting theoretical, methodological and applied issues in survival analysis. For convenience of readers, we have divided this volume into 18 parts as follows: I II III IV V VI VII VIII IX X XI XII XIII XIV XV XVI XVII XVIII
General methodology. Censored data and inference. Truncated data and inference. Hazard rate estimation. Comparison of survival curves. Competing risks and analysis. Proportional hazards model and analysis. Accelerated models and analysis. Frailty models and applications. Models and applications. Multivariate survival data analysis. Recurrent event data analysis. Current status data analysis. Disease progression analysis. Gene expressions and analysis. Quality of life analysis. Flowgraph models and applications. Repair models and analysis.
We hope that this broad coverage of the area of survival analysis will not only provide the readers with a general overview of the area but also describe to them what the current state in each of the topics listed above is. We express our sincere thanks to all the authors for their fine contributions and for helping us to bring out this volume in a timely manner. Our special thanks go to v
vi
Preface
Ms. Nicolette van Dijk, Ms. Edith Bomers and Ms. Andy Deelen of Elsevier, Amsterdam, for taking a keen interest in this project and also helping us with the final production of this volume.
N. Balakrishnan C.R. Rao
Table of contents
Preface
v
Contributors xxi
PART I. GENERAL METHODOLOGY
Ch. 1. Evaluation of the Performance of Survival Analysis Models: Discrimination and Calibration Measures 1 R.B. D’Agostino and B.-H. Nam 1. Introduction 1 2. Discrimination index 2 3. Calibration measures in survival analysis Appendix A 20 References 25
6
Ch. 2. Discretizing a Continuous Covariate in Survival Studies 27 J.P. Klein and J.-T. Wu 1. 2. 3. 4.
Introduction 27 Techniques based on the Cox model with a single covariate Extensions of Contal and O’Quigley’s approach 37 Discussion 41 Acknowledgements 42 References 42
vii
28
viii
Table of contents
Ch. 3. On Comparison of Two Classification Methods with Survival Endpoints 43 Y. Lu, H. Jin and J. Mi 1. 2. 3. 4. 5. 6.
Introduction 43 Degree of separation index 44 Estimation and inference procedures 48 Distribution property of test statistics under the null hypothesis Application examples 55 Discussion and conclusion 56 Acknowledgement 58 References 58
52
Ch. 4. Time-Varying Effects in Survival Analysis 61 T.H. Scheike 1. 2. 3. 4. 5.
Time-varying effects in survival analysis 61 Estimation for proportional or additive models 67 Testing in proportional and additive hazards models Survival with malignant melanoma 79 Discussion 83 Acknowledgement 83 References 83
74
Ch. 5. Kaplan–Meier Integrals 87 W. Stute 1. 2. 3. 4. 5. 6. 7.
Introduction 87 The SLLN 91 The CLT 93 Bias 95 The jackknife 97 Censored correlation and regression 100 Conclusions 102 References 103
PART II. CENSORED DATA AND INFERENCE
Ch. 6. Statistical Analysis of Doubly Interval-Censored Failure Time Data 105 J. Sun 1. 2. 3. 4. 5.
Introduction 105 Nonparametric estimation of a distribution function 107 Semiparametric regression analysis 114 Nonparametric comparison of survival functions 117 Discussion and future researches 119 References 121
Table of contents
Ch. 7. The Missing Censoring-Indicator Model of Random Censorship 123 S. Subramanian 1. 2. 3. 4.
Introduction 123 Overview of the estimators of a survival function 127 Semiparametric estimation in the MCI model 134 Conclusion 139 Acknowledgement 140 References 140
Ch. 8. Estimation of the Bivariate Survival Function with Generalized Bivariate Right Censored Data Structures 143 S. Kele¸s, M.J. van der Laan and J.M. Robins 1. Introduction 143 2. Modeling the censoring mechanism 144 3. Constructing an initial mapping from full data estimating functions to observed data estimating functions 147 4. Generalized Dabrowska’s estimator 151 5. Orthogonalized estimating function and corresponding estimator 153 6. Simulations 159 7. Discussion 162 Appendix A 162 References 172
Ch. 9. Estimation of Semi-Markov Models with Right-Censored Data 175 O. Pons 1. 2. 3. 4. 5.
Introduction 175 Definition of the estimators 176 Asymptotic distribution of the estimators 181 Generalization to models with covariates 189 Discussion 193 References 194
PART III. TRUNCATED DATA AND INFERENCE Ch. 10. Nonparametric Bivariate Estimation with Randomly Truncated Observations 195 Ü. Gürler 1. 2. 3. 4.
Introduction 195 Estimation of the bivariate distribution function 197 Estimation of bivariate hazard 202 Bivariate density estimation 205 References 206
ix
x
Table of contents
PART IV. HAZARD RATE ESTIMATION
Ch. 11. Lower Bounds for Estimating a Hazard 209 C. Huber and B. MacGibbon 1. 2. 3. 4. 5. 6.
Introduction 209 Framework 210 Kullback information and Hellinger distances based on hazards 213 A general device to derive lower bounds for estimating a function 215 Lower bound for the rate of estimation of a hazard function with right censoring 218 Rate of convergence for the kernel estimator of the hazard function 222 Acknowledgement 224 Appendix A 224 References 225
Ch. 12. Non-Parametric Hazard Rate Estimation under Progressive Type-II Censoring 227 N. Balakrishnan and L. Bordes 1. 2. 3. 4.
Introduction 227 Smoothing cumulative hazard rate estimator 228 Asymptotics 230 Simulation study 238 Appendix A: Technical results for the mean 244 Appendix B: Technical results for the variance 246 References 248
PART V.
COMPARISON OF SURVIVAL CURVES
Ch. 13. Statistical Tests of the Equality of Survival Curves: Reconsidering the Options 251 G.P. Suciu, S. Lemeshow and M. Moeschberger 1. 2. 3. 4. 5. 6. 7.
Introduction 251 Underlying alternative hypothesis and assumptions 252 An overview of available tests 256 Hypothesis testing and statistical computer packages 259 Applications to papers from major medical journal 260 Suggested guidelines 260 Discussion and conclusions 261 References 261
Table of contents
Ch. 14. Testing Equality of Survival Functions with Bivariate Censored Data: A Review 263 P.V. Rao 1. 2. 3. 4. 5. 6.
Introduction 263 Testing H0 with uncensored paired data 265 Within-pair difference tests with censored data 269 Pooled sample tests with censored data 272 Testing H0 when there are missing data 273 Overview 274 References 275
Ch. 15. Statistical Methods for the Comparison of Crossing Survival Curves 277 C.T. Le 1. 2. 3. 4.
Introduction 277 The modified Kolmogorov–Smirnov test 281 A Levene-type test 282 Linear rank tests 287 References 289
PART VI. COMPETING RISKS AND ANALYSIS Ch. 16. Inference for Competing Risks 291 J.P. Klein and R. Bajorunaite 1. 2. 3. 4. 5. 6. 7.
Introduction 291 Basic quantities 292 Univariate estimation 293 Inference based on the crude hazard rates 298 Tests based on the cumulative incidence function 300 Regression techniques based on the cumulative hazard function 305 Discussion 309 Acknowledgement 310 References 310
Ch. 17. Analysis of Cause-Specific Events in Competing Risks Survival Data 313 J. Dignam, J. Bryant and H.S. Wieand 1. 2. 3. 4. 5.
Introduction 313 Competing risks analysis based on cause-specific hazard functions 316 Competing risks analysis based on cumulative incidence functions 319 Examples: Competing risks analysis of events after breast cancer treatment 323 Summary 327 Acknowledgements 327 References 327
xi
xii
Table of contents
Ch. 18. Analysis of Progressively Censored Competing Risks Data 331 D. Kundu, N. Kannan and N. Balakrishnan 1. 2. 3. 4. 5. 6. 7. 8. 9.
Introduction 331 Model: Description and notation 333 Estimation 334 Confidence intervals 339 Bayesian analysis 342 Simulation study 343 Numerical example 345 Some generalizations and extensions 346 Conclusions 347 References 348
Ch. 19. Marginal Analysis of Point Processes with Competing Risks 349 R.J. Cook, B. Chen and P. Major 1. 2. 3. 4. 5.
Introduction 349 Rate functions for point processes 352 Point processes with terminal events 354 Application to a breast cancer trial 357 Discussion 360 Acknowledgements 360 References 360
PART VII. PROPORTIONAL HAZARDS MODEL AND ANALYSIS
Ch. 20. Categorical Auxiliary Data in the Discrete Time Proportional Hazards Model 363 P. Slasor and N. Laird 1. 2. 3. 4. 5. 6. 7.
Introduction 363 The standard and joint discrete-time proportional hazards models 364 Specification of the survival model and censoring 367 Discretizing continuous auxiliary data 367 Joint models: Recurrent events predicting survival 374 Other scenarios for censoring and survival 377 Discussion 378 Acknowledgements 379 Appendix A 379 References 382
Table of contents
Ch. 21. Hosmer and Lemeshow type Goodness-of-Fit Statistics for the Cox Proportional Hazards Model 383 S. May and D.W. Hosmer 1. 2. 3. 4. 5.
Introduction 383 The Hosmer and Lemeshow type test statistics 383 Necessity for time-dependent indicator variables 386 Examples 389 Summary 391 Appendix A 391 Appendix B 391 Appendix C 392 References 393
Ch. 22. The Effects of Misspecifying Cox’s Regression Model on Randomized Treatment Group Comparisons 395 A.G. DiRienzo and S.W. Lagakos 1. 2. 3. 4. 5.
Introduction 395 Notation and statistics 396 Conditions for valid tests 397 Bias correction 399 Discussion 402 Acknowledgement 404 Appendix A: MATLAB code for computing statistical tests 404 References 408
Ch. 23. Statistical Modeling in Survival Analysis and Its Influence on the Duration Analysis 411 V. Bagdonaviˇcius and M. Nikulin 1. 2. 3. 4. 5. 6. 7. 8. 9.
Introduction 411 The Cox or the proportional hazards model 412 Accelerated failure time model 413 Generalized proportional hazards model 415 Regression models with cross-effects of survival functions 419 Changing shape and scale models 420 Models with time-dependent regression coefficients 421 Additive hazards model and its generalizations 422 Remarks on parametric and semi-parametric estimation 423 References 428
xiii
xiv
Table of contents
PART VIII. ACCELERATED MODELS AND ANALYSIS Ch. 24. Accelerated Hazards Model: Method, Theory and Applications 431 Y.Q. Chen, N.P. Jewell and J. Yang 1. 2. 3. 4. 5. 6. 7. 8.
Introduction 431 Estimation 432 Asymptotic results 433 Efficiency consideration 434 Model adequacy 435 Extensions 437 Implementation and application 438 Some remarks 440 References 441
Ch. 25. Diagnostics for the Accelerated Life Time Model of Survival Data 443 D. Zelterman and H. Lin 1. 2. 3. 4. 5. 6.
Introduction 443 The likelihood and estimating equations 444 A Gibbs-like estimation procedure 448 Diagnostic measures 449 The bootstrap procedure 451 Numerical examples 453 Acknowledgement 459 References 459
Ch. 26. Cumulative Damage Approaches Leading to Inverse Gaussian Accelerated Test Models 461 A. Onar and W.J. Padgett 1. 2. 3. 4. 5.
Inverse Gaussian as a lifetime or strength model 462 Inverse Gaussian accelerated test models 463 Estimation for the inverse Gaussian accelerated test models 469 Application of the inverse Gaussian accelerated test models to chloroprene exposure data 474 Conclusion 476 Acknowledgement 477 References 477
Ch. 27. On Estimating the Gamma Accelerated Failure-Time Models 479 K.M. Koti 1. 2. 3. 4.
The failure time Gamma model 479 The maximum likelihood equations 480 The problem 481 The hybrid approximation 482
Table of contents 5. 6. 7. 8.
xv
The SAS/IML subroutine NLPTR 487 Pediatric cancer data 487 Leukemia data 488 Concluding remarks 489 Acknowledgements 490 Appendix A: Fisher information matrix 490 References 493
PART IX. FRAILTY MODELS AND APPLICATIONS
Ch. 28. Frailty Model and its Application to Seizure Data 495 N. Ebrahimi, X. Zhang, A. Berg and S. Shinnar 1. 2. 3. 4. 5.
Introduction 495 Inference for the shared frailty model 498 The shared frailty model for recurrent events 504 Seizure data and its analysis 507 Concluding remarks 516 Acknowledgements 516 References 516
PART X. MODELS AND APPLICATIONS
Ch. 29. State Space Models for Survival Analysis 519 W.Y. Tan and W. Ke 1. 2. 3. 4. 5. 6. 7. 8.
Introduction 519 The state space models and the generalized Bayesian approach 519 Stochastic modeling of the birth–death–immigration–illness–cure processes 521 A state space model for the birth–death–immigration–illness–cure processes 524 The multi-level Gibbs sampling procedures for the birth–death–immigration–illness–cure processes 526 The survival probabilities of normal and sick people 528 Some illustrative examples 529 Conclusions 534 References 534
Ch. 30. First Hitting Time Models for Lifetime Data 537 M.-L.T. Lee and G.A. Whitmore 1. 2. 3. 4. 5.
Introduction 537 The basic first hitting time model 537 Data for model estimation 538 A Wiener process with an inverse Gaussian first hitting time 538 A two-dimensional Wiener model for a marker and first hitting time 539
xvi
Table of contents
6. Longitudinal data 541 7. Additional first hitting time models 541 8. Other literature sources 542 Acknowledgements 543 References 543
Ch. 31. An Increasing Hazard Cure Model 545 Y. Peng and K.B.G. Dear 1. 2. 3. 4. 5.
Introduction 545 The model 546 Simulation study 549 Illustration 552 Conclusions and discussion 555 Acknowledgements 556 References 556
PART XI. MULTIVARIATE SURVIVAL DATA ANALYSIS
Ch. 32. Marginal Analyses of Multistage Data 559 G.A. Satten and S. Datta 1. 2. 3. 4. 5.
Introduction 559 “Explainable” dependent censoring in survival analysis 560 Multistage models: Stage occupation probabilities and marginal transition hazards 562 Estimation of marginal waiting time distributions 564 Regression models for waiting time distributions 566 Appendix A: Modeling the censoring hazard using Aalen’s linear hazards model 570 References 573
Ch. 33. The Matrix-Valued Counting Process Model with Proportional Hazards for Sequential Survival Data 575 K.L. Kesler and P.K. Sen 1. 2. 3. 4. 5. 6. 7.
Introduction 575 Introduction to multivariate survival methods 577 The matrix valued counting process framework 579 Matrix valued counting process framework with repeated measures data 585 Estimation 592 Example 593 Discussion 595 Appendix A 596 References 600 Further reading 601
Table of contents
PART XII. RECURRENT EVENT DATA ANALYSIS
Ch. 34. Analysis of Recurrent Event Data 603 J. Cai and D.E. Schaubel 1. 2. 3. 4. 5.
Introduction 603 Notation and basic functions of interest 603 Semiparametric models for recurrent event data 605 Nonparametric estimation of the recurrent event survival and distribution functions 618 Conclusion 621 Acknowledgement 621 References 621
PART XIII. CURRENT STATUS DATA ANALYSIS
Ch. 35. Current Status Data: Review, Recent Developments and Open Problems 625 N.P. Jewell and M. van der Laan 1. 2. 3. 4. 5. 6.
Introduction 625 Motivating examples 626 Simple current status data 627 Different sampling schemes 630 Complex outcome processes 634 Conclusion 640 References 641
PART XIV. DISEASE PROGRESSION ANALYSIS
Ch. 36. Appraisal of Models for the Study of Disease Progression in Psoriatic Arthritis 643 R. Aguirre-Hernández and V.T. Farewell 1. 2. 3. 4. 5.
Introduction 643 Data 643 Markov models 644 Poisson and negative binomial models 654 Discussion 670 Appendix A: Formulas for the estimated transition probabilities 671 References 672
xvii
xviii
PART XV.
Table of contents
GENE EXPRESSIONS AND ANALYSIS
Ch. 37. Survival Analysis with Gene Expression Arrays 675 D.K. Pauler, J. Hardin, J.R. Faulkner, M. LeBlanc and J.J. Crowley 1. 2. 3. 4.
Introduction 675 Methods 678 Results 681 Discussion 684 Appendix A 685 References 686
PART XVI. QUALITY OF LIFE ANALYSIS
Ch. 38. Joint Analysis of Longitudinal Quality of Life and Survival Processes 689 M. Mesbah, J.-F. Dupuy, N. Heutte and L. Awad 1. 2. 3. 4. 5. 6. 7.
Introduction 689 Presentation of the clinical trial: QoL instruments and data 691 Preliminary analysis 693 Time to QoL deterioration 696 Semi-Markovian multi-state model 698 Joint distribution of QoL and survival–dropout processes 709 Discussion 720 References 726
PART XVII. FLOWGRAPH MODELS AND APPLICATIONS
Ch. 39. Modelling Survival Data using Flowgraph Models 729 A.V. Huzurbazar 1. 2. 3. 4. 5. 6. 7. 8. 9. 10.
Series flowgraph model: HIV blood transfusion data 731 Data analysis of HIV/AIDS data 732 Converting flowgraph MGFs to densities 734 Likelihood construction in flowgraph models 737 Parametric assumptions 737 Parallel flowgraph models 740 Loop flowgraph models 740 A systematic procedure for solving flowgraphs 742 Data analysis for diabetic retinopathy data 743 Summary 745 References 746
Table of contents
PART XVIII. REPAIR MODELS AND ANALYSIS
Ch. 40. Nonparametric Methods for Repair Models 747 M. Hollander and J. Sethuraman 1. 2. 3. 4. 5. 6. 7.
Introduction 747 General repair models 748 Estimation in the DHS model 752 Estimation in the BBS model 755 A two-sample test in the BBS model 758 Goodness-of-fit tests in the BBS model 759 Testing the minimal repair assumption in the BBS model 761 Acknowledgement 763 References 763
Subject Index 765 Contents of Previous Volumes 773
xix
Contributors
R. Aguirre-Hernández, Departamento de Probabilidad y Estadistica, IIMAS–UNAM, Mexico, e-mail:
[email protected] (Ch. 36). L. Awad, Biostatistics Department, Aventis Pharma, Antony, France, e-mail: lucile.
[email protected] (Ch. 38). V. Bagdonaviˇcius, UFR Sciences et Modélisation, Université Victor Segalen Bordeaux 2, 33076 Bordeaux, France, e-mail:
[email protected] (Ch. 23). R. Bajorunaite, Department of Mathematics, Statistics and Computer Science, Marquette University, Milwaukee, WI 53201-1881, USA, e-mail:
[email protected] (Ch. 16). N. Balakrishnan, Department of Mathematics and Statistics, McMaster University, Hamilton, Ontario L8S 4K1, Canada, e-mail:
[email protected] (Chs. 12, 18). A. Berg, Department of Biology, Northern Illinois University, DeKalb, IL 60115, USA, e-mail:
[email protected] (Ch. 28). L. Bordes, Département Génie Informatique, Division Mathématiques Appliquées, Université de Technologie de Compiègne, 60205 Compiègne cedex, France, e-mail:
[email protected] (Ch. 12). J. Bryant, Department of Biostatistics, Graduate School of Public Health, University of Pittsburgh and National Surgical Adjuvant Breast and Bowel Project Biostatistical Center, Pittsburgh, PA 15213, USA, e-mail:
[email protected] (Ch. 17). J. Cai, Department of Biostatistics, School of Public Health, University of North Carolina, Chapel Hill, NC 27599, USA, e-mail:
[email protected] (Ch. 34). B. Chen, Department of Statistics and Actuarial Science, University of Waterloo, Waterloo, Ontario N2L 3G1, Canada, e-mail:
[email protected] (Ch. 19). Y.Q. Chen, Division of Biostatistics, School of Public Health, University of California, Berkeley, CA 94720, USA, e-mail:
[email protected] (Ch. 24). R.J. Cook, Department of Statistics and Actuarial Science, University of Waterloo, Waterloo, Ontario N2L 3G1, Canada, e-mail:
[email protected] (Ch. 19). J.J. Crowley, Cancer Research and Biostatistics, Seattle, WA 98101, USA, e-mail:
[email protected] (Ch. 37). R.B. D’Agostino, Department of Mathematics and Statistics, Statistics and Consulting Unit, Boston University, Boston, MA 02215, USA, e-mail:
[email protected] (Ch. 1). S. Datta, Department of Statistics, University of Georgia, Athens, GA 30602, USA, e-mail:
[email protected] (Ch. 32). xxi
xxii
Contributors
K.B.G. Dear, National Centre for Epidemiology and Population Health and Centre for Mental Health Research, The Australian National University, Canberra, ACT 0200, Australia, e-mail:
[email protected] (Ch. 31). J. Dignam, Department of Health Studies, The University of Chicago, Chicago, IL 60637, USA, e-mail:
[email protected] (Ch. 17). A.G. DiRienzo, Department of Biostatistics, Harvard School of Public Health, Boston, MA 02115, USA, e-mail:
[email protected] (Ch. 22). J.-F. Dupuy, Université de Bretagne-Sud, UFR SSI, 56017 Vannes cedex, France, e-mail:
[email protected] (Ch. 38). N. Ebrahimi, Division of Statistics, Northern Illinois University, DeKalb, IL 60115, USA, e-mail:
[email protected] (Ch. 28). V.T. Farewell, MRC Biostatistics Unit, University of Cambridge, Cambridge, UK, e-mail:
[email protected] (Ch. 36). J.R. Faulkner, Southwest Oncology Group, Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA, e-mail:
[email protected] (Ch. 37). Ü. Gürler, Department of Industrial Engineering, Bilkent University, Ankara, Turkey, e-mail:
[email protected] (Ch. 10). J. Hardin, Department of Mathematics, Pomona College, Claremont, CA 91711, USA, e-mail:
[email protected] (Ch. 37). N. Heutte, Université de Paris V and Université de Caen, France, e-mail: n.heutte@ lisieux.iutcaen.fr (Ch. 38). M. Hollander, Department of Statistics, Florida State University, Tallahassee, FL 32306, USA, e-mail:
[email protected] (Ch. 40). D.W. Hosmer, Department of Biostatistics and Epidemiology, University of Massachusetts, Amherst, MA 01003, USA, e-mail:
[email protected] (Ch. 21). C. Huber, UFR Biomédicale, Université René Descartes, 75270 Paris cedex 06, France, e-mail:
[email protected] (Ch. 11). A.V. Huzurbazar, Department of Mathematics and Statistics, University of New Mexico, Albuquerque, NM 87131, USA, e-mail:
[email protected] (Ch. 39). N.P. Jewell, Division of Biostatistics, School of Public Health, University of California, Berkeley, CA 94720, USA, e-mail:
[email protected] (Chs. 24, 35). H. Jin, Department of Radiology, University of California, San Francisco, CA 94143, USA, Department of Mathematics, South China Normal University, Guangdong, China, e-mail:
[email protected] (Ch. 3). N. Kannan, Department of Management Science and Statistics, The University of Texas at San Antonio, San Antonio, TX 78249, USA, e-mail:
[email protected] (Ch. 18). W. Ke, Department of Mathematical Sciences, The University of Memphis, Memphis, TN 38152, USA, e-mail:
[email protected] (Ch. 29). S. Kele¸s, Division of Biostatistics, School of Public Health, University of California, Berkeley, CA 94720, USA, e-mail:
[email protected] (Ch. 8). K.L. Kesler, Division of Biostatistics, Rho, Inc., 100 Eastowne Drive, Chapel Hill, NC 27514, USA, e-mail:
[email protected] (Ch. 33). J.P. Klein, Division of Biostatistics, Medical College of Wisconsin, Milwaukee, WI 53226, USA, e-mail:
[email protected] (Chs. 2, 16).
Contributors
xxiii
K.M. Koti, 1401 Rockville Pike, Suite 200S, HFM-219, Food and Drug Administration, Rockville, MD 20852, USA, e-mail:
[email protected] (Ch. 27). D. Kundu, Department of Mathematics, Indian Institute of Technology, Kanpur, UP, India 208 016, e-mail:
[email protected] (Ch. 18). S.W. Lagakos, Department of Biostatistics, Harvard School of Public Health, Boston, MA 02115, USA, e-mail:
[email protected] (Ch. 22). N. Laird, Department of Biostatistics, Harvard School of Public Health, Boston, MA 02115, USA, e-mail:
[email protected] (Ch. 20). C.T. Le, Department of Biostatistics, MMC 303 Mayo, School of Public Health, University of Minnesota, Minneapolis, MN 55455, USA, e-mail:
[email protected] (Ch. 15). M. LeBlanc, Southwest Oncology Group, Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA, e-mail:
[email protected] (Ch. 37). M.-L.T. Lee, Channing Laboratory, Department of Medicine, Brigham and Women’s Hospital and Harvard Medical School, Boston, MA 02115, USA, e-mail: meiling@ channing.harvard.edu (Ch. 30). S. Lemeshow, Division of Epidemiology and Biometrics, College of Medicine and Public Health, School of Public Health, The Ohio State University, Columbus, OH 43210, USA, e-mail:
[email protected] (Ch. 13). H. Lin, Division of Biostatistics, Yale University, New Haven, CT 06520, USA, e-mail:
[email protected] (Ch. 25). Y. Lu, Department of Radiology, University of California, San Francisco, CA 94143, USA, e-mail:
[email protected] (Ch. 3). B. MacGibbon, Départamento de Mathématiques, Université du Québec à Montréal, Succursale Centre-Ville, Montréal, Québec H3C 3P8, Canada, e-mail: brenda@ math.uqam.ca (Ch. 11). P. Major, Hamilton Regional Cancer Centre and Department of Medicine, McMaster University, Hamilton, Ontario, Canada, e-mail:
[email protected] (Ch. 19). S.J. May, Devision of Biostatistics, Department of Family & Preventive Medicine, University of California San Diego, La Jolla, CA 92093-0717, USA, e-mail: smay@ucsd. edu (Ch. 20). M. Mesbah, Université de Bretagne-Sud UFR SSI, F56017 Vannes cedex, France, e-mail:
[email protected] (Ch. 38). J. Mi, Department of Statistics, Florida International University, University Park, Miami, FL 33199, USA, e-mail:
[email protected] (Ch. 3). M. Moeschberger, Division of Epidemiology and Biometrics, College of Medicine and Public Health, School of Public Health, The Ohio State University, Columbus, OH 43210, USA, e-mail:
[email protected] (Ch. 13). B.-H. Nam, Department of Mathematics and Statistics, Statistics and Consulting Unit, Boston University, Boston, MA 02215, USA, e-mail: byungho.math.bu.edu (Ch. 1). M. Nikulin, Mathematical Statistics, University Victor Segalen Bordeaux 2, Bordeaux, France, Laboratory of Statistical Methods, Steklov Mathematical Institute, St. Petersburg, Russia, e-mail:
[email protected] (Ch. 23). A. Onar, Department of Management Science, University of Miami, Coral Gables, FL 33124, USA, e-mail:
[email protected] (Ch. 26).
xxiv
Contributors
W.J. Padgett, Department of Statistics, University of South Carolina, Columbia, SC 29208, USA, e-mail:
[email protected] (Ch. 26). D.K. Pauler, Southwest Oncology Group, Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA, e-mail:
[email protected] (Ch. 37). Y. Peng, Department of Mathematics and Statistics, Memorial University of Newfoundland, St. John’s, Newfoundland A1C 5S7, Canada, e-mail:
[email protected] (Ch. 31). O. Pons, INRA Biométrie, 78352 Jouy-en-Josas cedex, France, e-mail: odile.pons@ jouy.inra.fr (Ch. 9). P.V. Rao, Department of Statistics, University of Florida, Gainesville, FL 32611, USA, e-mail:
[email protected] (Ch. 14). J.M. Robins, Department of Epidemiology, Harvard School of Public Health, Boston, MA 02115, USA, e-mail:
[email protected] (Ch. 8). G.A. Satten, Centers for Disease Control and Prevention, Atlanta, GA 30333, USA, e-mail:
[email protected] (Ch. 32). D.E. Schaubel, Department of Biostatistics, University of Michigan, Ann Arbor, MI 48109, USA, e-mail:
[email protected] (Ch. 34). T.H. Scheike, Department of Biostatistics, University of Copenhagen, Blegdamsvej 3, DK-2200, KBH-N, Denmark, e-mail:
[email protected] (Ch. 4). P.K. Sen, Department of Biostatistics, School of Public Health, University of North Carolina, Chapel Hill, NC 27599, USA, e-mail:
[email protected] (Ch. 33). J. Sethuraman, Department of Statistics, Florida State University, Tallahassee, FL 32306, USA, e-mail:
[email protected] (Ch. 40). S. Shinnar, Departments of Neurology and Pediatrics, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY 10467, USA, e-mail:
[email protected] (Ch. 28). P. Slasor, Genzyme Corporation, Cambridge, MA 02142, USA, e-mail: peter.slasor@ genzyme.com (Ch. 20). W. Stute, Mathematical Institute, Justus-Liebig University, Giessen, D-35392, Germany, e-mail:
[email protected] (Ch. 5). S. Subramanian, Department of Mathematics and Statistics, The University of Maine, Orono, Maine 04469, USA, e-mail:
[email protected] (Ch. 7). G.P. Suciu, Division of Epidemiology and Biometrics, College of Medicine and Public Health, School of Public Health, The Ohio State University, Columbus, OH 43210, USA, e-mail:
[email protected] (Ch. 13). J. Sun, Department of Statistics, University of Missouri, Columbia, MO 65211, USA, e-mail:
[email protected] (Ch. 6). W.Y. Tan, Department of Mathematical Sciences, The University of Memphis, Memphis, TN 38152, USA, e-mail:
[email protected] (Ch. 29). M. van der Laan, Division of Biostatistics, School of Public Health, University of California, Berkeley, CA 94720, USA, e-mail:
[email protected] (Chs. 8, 35). G.A. Whitmore, Faculty of Management, McGill University, Montréal, Québec H3A 1G5, Canada, e-mail:
[email protected] (Ch. 30).
Contributors
xxv
H.S. Wieand, Department of Biostatistics, Graduate School of Public Health, University of Pittsburgh and National Surgical Adjuvant Breast and Bowel Project Biostatistical Center, Pittsburgh, PA 15213, USA, e-mail:
[email protected] (Ch. 17). J.-T. Wu, TAP Pharmaceutical Products Inc., Lake Forest, IL 60045, USA, e-mail:
[email protected] (Ch. 2). J. Yang, Division of Biostatistics, School of Public Health, University of California, Berkeley, CA 94720, USA, e-mail:
[email protected] (Ch. 24). D. Zelterman, Division of Biostatistics, Yale University, New Haven, CT 06520, USA, e-mail:
[email protected] (Ch. 25). X. Zhang, Division of Biostatistics, Medical College of Wisconsin, Milwaukee, WI 53226, USA, e-mail:
[email protected] (Ch. 28).
1
Handbook of Statistics, Vol. 23 ISSN: 0169-7161 © 2004 Elsevier B.V. All rights reserved. DOI 10.1016/S0169-7161(03)23001-7
Evaluation of the Performance of Survival Analysis Models: Discrimination and Calibration Measures
R.B. D’Agostino and Byung-Ho Nam
1. Introduction Background: Performance measures in mathematical predictive models Consider a vector of variables V (V1 , V2 , . . . , Vk ), independent variables in a regression, or risk factors in a model setting, and a variable W , the dependent variable, or outcome variable having 1 for positive outcome and 0 for negative outcome. Here, ‘positive outcome’ indicates occurrence or presence of an event such as coronary heart disease. Prediction functions or Health Risk Appraisal functions (HRAF) are mathematical models that are functions of the data ( V ), which relates to the probability of an event (W ). Symbolically, for the configuration of V of the data f ( V ) = f (V1 , V2 , . . . , Vk ) = P (W = 1) = P , where P (W = 1) is the probability of a positive outcome or an event. Our focus is to evaluate the performance of a HRAF with regard to its ability to predict the outcome variable. Here, we consider a time to event survival time model with censored observations such as the Cox regression model. Much of the following extends methods applied previously to logistic regression (Hanley and McNeil, 1982; Hosmer and Lemeshow, 1980). The Cox regression model is a survival analysis model that relates V to the development of an event over a period of time t, taking into consideration the time to event and censoring, for example, dropouts, lost to follow-up. The following is its mathematical expression: exp(β V −β V ) , P (T t) = S0 T = t/V ) is the survival probability for those with the mean vector values V . where S0 (T = t/V Measures of predictive accuracy The accuracy of a model is the degree to which the predicted values coincide with the observed outcomes. When the outcome variable is dichotomous and predictions are stated as probabilities that an event will occur, models can be checked for two general 1
2
R.B. D’Agostino and B.-H. Nam
concepts, discrimination and calibration. Our focus here is to evaluate the performance of a model with regard to its discrimination and calibration. Discrimination refers to a model’s ability to correctly distinguish the two classes of outcomes. A model with good discrimination ability produces higher predicted probabilities to subjects who had events than subjects who did not have events. Perfect discrimination would result in two non-overlapping sets of predicted probabilities from the model, one set for the positive outcomes, the other for the negative outcomes. The area under the Receiver Operating Characteristic (ROC) Curve is one the most used measures for a model discrimination (Hanley and McNeil, 1982). Calibration describes how closely the predicted probabilities agree numerically with the actual outcomes. A model is well-calibrated when predicted and observed values agree for any reasonable grouping of the observation, ordered by increasing predicted values. A common form of the calibration statistic is based on the Pearson χ 2 statistic that compares the observed and expected outcomes within each M group defined by the rank ordering of the predicted probabilities (Hosmer and Lemeshow, 1980). Although a model with a good calibration will tend to have good discrimination and vice versa, a given model may be good on one measure but weak on another. Harrel et al. (1996) recommend that good discrimination is always to be preferred to good calibration since a model with a good discrimination can always be recalibrated but the rank orderings of the probabilities cannot be changed to improve discrimination.
2. Discrimination index 2.1. Discrimination index in logistic regression The area under the Receiver Operating Characteristic (ROC) Curve is one the most used measures for a model discrimination. The following is how to construct ROC curve from the logistic regression: Suppose we have n subjects. From the logistic regression, we can compute for all n subjects their predicted probabilities (Y1 , Y2 , . . . , Yn ). Then, select some probability value Y ∗ and state as the decision rule that all subjects with predicted probabilities equal or above that value Y ∗ will be classified as positive, and all others will be classified as negative. Hence, for each Y ∗ , a two by two table such as following can be generated: Call subject + if Yi > Y ∗ True State
+ −
+ a c
− b d
From this table, sensitivity = a/(a + b), and specificity = d/(c + d) can be calculated. If one selects all possible values of Y ∗ for decision cutoff points and plots sensitivity on Y axis and 1-specificity on X axis in two-dimensional graph and connect the plots by
Evaluation of the performance of survival analysis models
3
Fig. 1. Receiver operating characteristic (ROC) curve.
a line curve, then the resulting curve is called Receiver Operating Characteristic (ROC) Curve. See Figure 1. The area under this curve is a measure for model discrimination. The interpretation of this area, also called the C statistic, is that it is the estimated probability for positive outcome being higher than that for a negative outcome. Thus, (Y1 > Y2 ), C statistic = C = area under the ROC curve = P where Y1 = predicted probabilities for those who had events, Y2 = predicted probabilities for those without events. The value of C varies from 0.5 with no discrimination ability to 1 with perfect discrimination and is related only to the ranks of the predicted probabilities. Bamber (1975) recognized that the area under the ROC curve is an unbiased estimator of the probability of correctly ranking a (event, no-event) pair and that this probability is closely connected with the Mann–Whitney statistic. Hanley and McNeil (1982) further developed the relationship between the area under the ROC curve and the Mann–Whitney statistic and showed that the two are closely related, i.e., C statistic =
1 WY Y , N1 · N2 1 2
(2.1)
where N1 = number of those who had events, N2 = number of those without events, WY1 Y2 = [number of pairs(Y1 , Y2 ) with Y1 > Y2 ] + 12 [number of pairs(Y1 , Y2 ) with Y1 = Y2 ]. Lehmann (1951, 1975) showed that the Mann–Whitney statistic is asymptotically normally distributed. 2.2. Extension of C statistics to survival analysis Suppose we have n individuals, among which n1 developed events in time t (event), n2 do not develop events in time t (non-event) and n3 were censored by time t (censored) (n = n1 + n2 + n3 ). Define Ti = survival time for ith individual, i = 1, 2, . . . , n, Yi = predicted probability for developing an event in time t for ith individual, i = 1, 2, . . . , n. Then, we have n
4
R.B. D’Agostino and B.-H. Nam
pairs of (T1 , Y1 ), (T2 , Y2 ), . . . , (Tn , Yn ). Define 1 aij bij , Q n−1 n
Overall C =
i=1 j =1
where Q = the total number of comparisons made, 1 if Ti < Tj , and at least one member of the pair (Ti , Tj ) is the aij = to an observed event, i, j = 1, 2, . . . , n, 0 otherwise, 1 if Yi > Yj , and at least one member of the pair (Yi , Yj ) is the bij = predicted probability of an event, i, j = 1, 2, . . . , n, 0 otherwise. For a time to event survival model, we expand the notation as follows: T1i = survival time for event, i = 1, 2, . . . , n1 , Y1i = predicted probability for event, i = 1, 2, . . . , n1 , T2j = survival time for non-event, j = 1, 2, . . . , n2 , Y2j = predicted probability for non-event, j = 1, 2, . . . , n2 , T3j = survival time for censored, j = 1, 2, . . . , n3 , Y3j = predicted probability for censored, j = 1, 2, . . . , n3 . From the above, we have three sets of comparisons: (1) event vs. non-event: comparing those who developed events against those did not; (2) event vs. event: comparing those who developed events against those who also developed events; (3) event vs. censored: comparing those who developed events against those who were censored. Note that these three comparisons are independent one another. Now, we examine the first comparison and develop a first component for an overall C. This concerns comparison of events vs. non-events. Define n1 n 1 aij bij , C1 = Q1
(2.12)
i=1 j =1
where Q1 = the total number of comparisons made, 1 if T1i < T2j , aij = 0 otherwise, bij = 1
if Y1i > Y2j .
Here, since all the survival times for those who did not develop events are longer than the maximum value of the event time for those who developed events, it is obvious that aij is always equal to 1. Hence, n1 n 1 C1 = bij . Q1
(2.13)
i=1 j =1
The numerator in C1 is exactly the same as the Mann–Whitney statistic for continuous data when we compare the predicted probabilities for dichotomous outcomes where
Evaluation of the performance of survival analysis models
5
Q1 = n1 · n2 . Thus, C1 can be expressed as C1 =
1 WY Y . n1 · n2 1 2
(2.14)
Therefore, C1 is asymptotically normally distributed. Next, we develop a second component of overall C(event vs. event). One important note to make here is that one who developed an event earlier in time has higher predicted probability for an event. Define C2 =
n1 n1 −1 1 aij bij , Q2
(2.15)
i=1 j =1
where
aij =
1 if T1i < T1j , i, j = 1, 2, . . . , n1 , i < j, 0 otherwise,
1 if Y1i > Y1j , i, j = 1, 2, . . . , n1 , i < j, 0 otherwise. C2 is very closely related to the rank correlation coefficient τˆ (Kendall, 1970). τˆ has the total score in its numerator. Here, C2 has the total positive score, PS in its numerator. Both τˆ and C2 have the same denominator Q2 , which is equal to 12 n1 (n1 − 1). It can be shown that C2 has a linear relationship with τˆ , bij =
1 τˆ + 1 . (2.16) 2 Kendall (1970) showed that τˆ is asymptotically normally distributed. See the appendix for its mean and variance. Hence C2 is also asymptotically normal. Now, we develop the third component of overall C (event vs. censored). Define C2 =
C3 =
n3 n1 1 aij bij , Q3
(2.17)
i=1 j =1
where
aij =
1 if T1i < T3j , i = 1, 2, . . . , n1 , j = 1, 2, . . . , n3 , 0 otherwise,
1 if Y1i > Y3j , i = 1, 2, . . . , n1 , j = 1, 2, . . . , n3 , 0 otherwise. In this component, we only take a pair of comparison [(T1i , Y1i ), (T3j , Y3j )] where the censored time (T3j ) is longer than the event time (T1i ). Thus, the numerator C3 can be n1of n3 n3 1 expressed as ni=1 j =1 (bij | aij = 1). Also, Q3 should be equal to i=1 j =1 aij . An important assumption that we make here is that the censoring occurs completely at random so that C3 is independent of C1 and C2 . The numerator of C3 is the same as the Mann–Whitney statistic given that we only include the pairs where the censored time is longer than the event time. Hence, C3 can be described as a conditional Mann–Whitney bij =
6
R.B. D’Agostino and B.-H. Nam
statistic. We express C3 as C3 =
1 c W . Q3 Y1 Y3
(2.18)
Since the Mann–Whitney statistic is asymptotically normally distributed, we can argue that C3 is also asymptotically normal. See appendix for its mean and variance. Now, we combine all three components into one overall discrimination index C. From (3.1), (3.2) and (3.3), we have C=
1 Q1 1 · WY Y WY1 Y2 + P + WYc1 Y3 = Q1 + Q2 + Q3 Q1 + Q2 + Q3 Q1 1 2 +
Q3 Q2 1 1 1 c · · (τˆ + 1) + · W Q1 + Q2 + Q3 Q2 2 Q1 + Q2 + Q3 Q3 Y1 Y3
= a · C1 + b · C2 + (1 − a − b) · C3
(2.19)
so, C is a linear combination of C1 , C2 and C3 where a=
Q1 , Q1 + Q2 + Q3
b=
Q2 . Q1 + Q2 + Q3
Now, we can argue that the overall C tends to normality since C1 , C2 and C3 are all asymptotically independent one another and each of them is asymptotically normal. See Appendix A for the mean and variance of the overall C.
3. Calibration measures in survival analysis Calibration measures are often statistics that partition a data set into groups and assess how the average predicted probability compares with the outcome prevalence in each group. Common forms of calibration statistics are based on the Pearson χ 2 statistic which summarize the model fit by comparing observed and expected outcomes within M groups defined by the rank ordering of the predicted probabilities. Hosmer and Lemeshow’s chi-square statistics are widely used for goodness of fit for logistic regression. In this work, we present a chi-square type statistic for the survival time data with censored observations. We use Poisson log-linear model as an approximation to the survival time model in investigating the asymptotic behavior of the statistic based on the theoretical framework of goodness of fit statistic for generalized linear models (Shillington, 1980). The asymptotic behavior of the statistic is examined by investigating the asymptotic null distribution of the statistic for the Poisson approximation. 3.1. A chi-square statistic for the survival time model with censored observations The chi-square statistic that Hosmer and Lemeshow (1980, 1982) have produced for the logistic regression model has the following formula: χ2 =
M [Yj /nj − p¯j ]2 . p¯j (1 − p¯ j ) j =1
(3.1)
Evaluation of the performance of survival analysis models
7
Here, nj , Yj , and p¯j are respectively, the number of the observations, the number of positive outcomes (event) and the average predicted probabilities from the logistic regression model in the j th cell where j = 1, 2, . . . , M. The most popular version of the above ranks the model’s predicted probabilities into deciles and then compares the proportion of positive outcomes in each decile with the averaged predicted probabilities in each decile. Here, each decile contains 10 percent of the observations. For a survival time model with censored observation, we propose a statistic, similar to the H–L chi-square statistic; it has the following formula: χ2 =
M [KMj − p¯j ]2 , p¯j (1 − p¯ j )
(3.2)
j =1
where KMj and p¯j indicate the Kaplan–Meier estimate for failure, and the average predicted probabilities for a positive outcome (event) from survival time model such as the Cox proportional hazard model in the j th cell where j = 1, 2, . . . , M. To examine the asymptotic behavior of this statistic, we first examine the likelihood function for survival data with the general proportional hazard model under the assumption of random censoring and then express the likelihood as a Poisson likelihood, with a loglinear model for the Poisson mean corresponding to the log-linear model for the hazard function. 3.2. Poisson approximation to survival time model First, consider the definition of the hazard function, P (t T < t + δt | T t) h(t) = lim δt →0 δt F (t + δt) − F (t) f (t) , = lim = δt →0 δtS(t) S(t)
t H0 (t) = h0 (u) du,
(3.3) (3.4)
0
S(t) = exp −H0 (t) exp(η) .
(3.5)
Generally, the hazard function depends on both time and on a set of covariates, some of which may depend on time. The proportional hazards model separates these components by specifying the hazard at time t for an individual with covariate vector V is h(t; V ) = h0 (t)ϕ( V ), where ϕ( V ) is a function of the values of the vector of explanatory variables for an individual with covariate vector V . The function ϕ( V ) can be interpreted as the hazard at time t for an individual whose vector of explanatory variables is V , relative to the hazard for an individual for when V = 0. Since ϕ( V ) is positive, it is convenient to express ϕ( V ) as exp(η) where η = β V which is the linear predictor. If we have k explanatory variates, then β V = β1 v1 + β2 v2 + · · · + βk vk .
8
R.B. D’Agostino and B.-H. Nam
This model implies that the ratio of hazard for two individuals depends on the difference between their linear predictors at any time. If there are no time dependent covariates, the hazard is constant, independent of time. Various assumptions may be made about h0 (t). Cox’s model (1972) treats h0 (t) as analogous to the block factor in a blocked experiment, defined only at points where events occur, hence making no assumption about the trend with time. h0 (t) is permitted to have arbitrary values and irrelevant in the sense that it does not enter into the estimation equations derived from the likelihood function. In order to construct the likelihood function for survival data, an assumption about the nature of censoring must be made. Here, we assume that the censoring is completely at random censoring where the censoring time, Ci for the ith individual is a random variable with survivor and density functions Gi (c) and gi (c), respectively, for i = 1, . . . , n. And further, we assume that C1 , . . . , Cn are stochastically independent of one another and of event time t1 , . . . , tn . Kalbfleisch and Prentice (1980, p. 40) constructed a likelihood function for survival data under the assumption of random censoring: P Ti ∈ (t, t + dt), wi = 1; V i , β = P Ti ∈ (t, t + dt), Ci > t; V i , β = Gi (t + 0)f (t; V i , β ) dt
(3.6)
and P Ti ∈ (t, t + dt), wi = 0; V i , β = gi (t)S(t + 0); V i , β dt,
(3.7)
S(t + 0; V i , β ) = lim S(u; V i , β ).
(3.8)
where u→t +
If S is continuous, then S(t + 0; V i , β ) = S(t; V i , β ).
(3.9)
Kalbfleisch and Prentice also assume that the censoring is noninformative (i.e., that Gi (t) does not involve β). Therefore, the likelihood on the data (ti ; wi , V i ) for i = 1, . . . , n, is L( β ) ∝
n
f (ti ; β, V i )wi S(ti ; β, V i )1−wi
(3.10)
i=1
and the pairs (ti , wi ), i = 1, . . . , n are independent (given V 1 , . . . , V n ). In a similar fashion, Aitkin and Clayton (1980) constructed a likelihood function for β with proportional hazard model. Consider the following example. Suppose that a study is performed with n subjects. At the end of the study, an individual with an event at time t contributes a factor f (t) to the likelihood, while one who was censored at time t contributes S(t) to the likelihood. Define W as a variate taking the value 1 for those who had events and 0 for those who were censored (suppose r subjects (of n) had events). Now, we develop a likelihood function for the survival data with general proportional-hazards model.
Evaluation of the performance of survival analysis models
From (3.3), (3.4) and (3.5), we have S(t) = exp −H0 (t) exp( β V ) , F (t) = h0 (t) exp β V − H0 (t) exp( β V ) .
9
(3.11) (3.12)
Then the likelihood takes the form L=
n
f (ti )wi S(ti )1−wi .
(3.13)
i=1
Hence, ln(L) =
n wi ln f (ti ) + (1 − wi ) ln S(ti ) i=1
=
n wi ln(h0 (ti ) + ηi − H0 (ti ) exp(ηi ) i=1
+ (1 − wi ) −H0 (ti ) exp(ηi )
n h0 (ti ) wi ln(H0 (ti ) + ηi − H0 (ti ) exp(ηi ) + wi ln = . (3.14) H0 (ti ) i=1
Now, if we write µi = H0 (ti ) exp(ηi ), then ln(L) becomes n n h0 (ti ) wi ln(µi ) − µi + wi ln ln(L) = . H0 (ti ) i=1
(3.15)
i=1
Here, the first term is identical to the kernel of the likelihood function for n independent Poisson variates Wi with mean µi , while the second term does not depend on the unknown β’s. Therefore, if H (t) is given, then we can obtain the estimates of the β’s by treating the censoring indicator variate Wi as a Poisson variate with mean µi = H0 (ti ) exp(ηi ). This Poisson model is a log-linear model which takes the form of a generalized linear model. The link function is the same as for log-linear models except that there is a fixed intercept ln(H0 (ti )) to be included in the linear predictor (ln(µi ) = ln(H0 (ti )) + ηi , where ηi = β V i ). Aitkin and Clayton (1980) described the use of GLIM (Baker and Nelder, 1978) to fit explicit distributions (Exponential, Weibull, extreme-value) by expressing the likelihood in each case as a Poisson likelihood, with the log-linear model for the Poisson mean corresponding to the log-linear model for the hazard function. They described the estimation procedure for the β’s as follows: A simple iterative maximization of the log-likelihood function is possible in GLIM. Given initial estimates of the unknown parameters in H0 (t), the ML estimate of the β’s is obtained for the Poisson model in GLIM with ln(H0 (ti )) as a known function (also known as offset) incorporated in the log-linear model. In the next section, we develop a chi-square type statistic for goodness of fit for the survival data.
10
R.B. D’Agostino and B.-H. Nam
3.3. Chi-square statistic based on the Poisson approximation Let Wi denote a Poisson random variable taking value 1 or 0 (1 for those who had events, 0 for those who were censored) and let V i = (Vi1 , Vi2 , . . . , Vik ) be the vector of independent variables, for i = 1, 2, . . . , n. The expectation and variance of Wi are as follows: E(Wi ) = H0 (ti ) exp β V i , (3.16) Var(Wi ) = H0 (ti ) exp β V i , (3.17) where β = {β1 , β2 , . . . , βk } is the 1 × k vector of regression parameters. We partition the space of V into M separate and distinct classes R1 , R2 , . . . , RM where M > k. We assign each observation to its appropriate class. We now consider the sum of Poisson random variables (Wi ) falling into each class, and define i∈Ij Wi − E( i∈Ij Wi ) Zj ( β ) = (3.18) , Var( i∈Ij Wi ) where Ij = {i: vi ∈ Rj }, for j = 1, 2, . . . , M. Define 2 M M [ 2 i∈Ij Wi − E( i∈Ij Wi )] 2 . Zj ( β ) = χ (β ) = Var( i∈Ij Wi ) j =1
(3.19)
j =1
Since {Wi }, i ∈ Ij are independent Poisson random variables, and the sum of independent Poisson random variables is also a Poisson random variable with mean equal to the sum of the individual means, E (3.20) Wi = E(Wi ) = H0 (ti )eβvi i∈Ij
and variance, Var
i∈Ij
i∈Ij
i∈Ij
Wi = Var(Wi ) = H0 (ti )eβ vi . i∈Ij
(3.21)
i∈Ij
Therefore, from (3.17), (3.18) and (3.19), β vi 2 M [ ] i∈Ij Wi − i∈Ij H0 (ti )e 2 χ (β ) = . β vi i∈Ij H0 (ti )e j =1
(3.22)
If the value of β is known, then we can use the central limit theorem to show that Zj ( β ) is asymptotically normally distributed with mean zero and unit variance for i = 1, . . . , n. Also, since the Zj ( β )’s are independent, the χ 2 ( β ) statistic defined in (3.19) has asymptotic χ 2 (M) distribution. However, most times, the value of β is not known, hence the unknown parameter β must be estimated. If we use an estimator
Evaluation of the performance of survival analysis models
11
of β obtained based on the grouped observations such as the minimum modified chisquare estimator, then the estimated χ 2 ( β ) has asymptotic χ 2 (M − k) distribution. In most cases in practice, however χ 2 ( β ) is estimated by substituting the maximum ˆ which is based on the ungrouped observations. The resulting likelihood estimator, β, χ 2 ( β ) statistic with the maximum likelihood estimator βˆ can be expressed as, from (3.22), M [ K = χ βˆ = 2
2
j =1
i∈Ij
Wi −
i∈Ij
ˆ
i∈Ij
H0 (ti )eβvi ]2 ˆ
H0 (ti )eβvi
.
(3.23)
ˆ even though the data are grouped into M cells, the expected In the K 2 statistic with β, cell frequencies are obtained based on the original observations. Stepanians (1994) stated that Chernoff and Lehmann (1954) derived the null distribution of the estimated Pearson’s chi-square statistic by the maximum likelihood estimator based on the ungrouped observations for testing goodness of fit to a family of distributions. Chernoff ˆ is and Lehmann proved the theorem saying that the asymptotic distribution of χ 2 ( β) that of: M d χ 2 βˆ = Z βˆ Z βˆ −→ λj yj2 ,
(3.24)
j =1
where the yi ’s are independent and normally distributed with mean zero and unit variance, and λi ’s are the eigenvalues of the asymptotic covariance matrix of Z( βˆ ). They showed that the eigenvalues of the covariance matrix consist of M − k − 1 ones, one zero, and k values between zero and one. Also, Moore and Spruill (1971, 1975) showed that Chernoff and Lehmann’s theorem can be extended to cells with random boundaries. Analogous to Chernoff and Lehmann’s results, Shillington (1980) proved the theorem for generalized linear model which states −1 d 0 1 0 ˆ Z β −→ N 0, I − B B , I N
(3.25)
where B 0 , described in (3.31), is B(β 0 ) evaluated at the true value of the parameter vector β, β 0 , and M d χ 2 βˆ = z βˆ z βˆ −→ λj Uj ,
(3.26)
j =1
where the Uj ’s are independent χ 2 (1)’s and the λj ’s are the eigenvalues of the asymptotic covariance matrix of Z( βˆ ). It was shown that the eigenvalues λj ’s are in the interval [0, 1], for j = 1, . . . , M. It was also shown that at least M − k of the eigenvalues are exactly equal to one. Therefore, the asymptotic distribution of χ 2 ( βˆ ) would fall between χ 2 (M − k) and χ 2 (M). The asymptotic distribution of χ 2 ( βˆ ) can be expressed
12
R.B. D’Agostino and B.-H. Nam
as M d χ 2 βˆ −→ λj χ 2 (1) = χ 2 (M − k) + j =1
M
λj χ 2 (1).
(3.27)
j =M−k+1
As Shillington stated that the more homogeneous the v’s within each cell, the closer the ˆ to χ 2 (M − k) because the λj ’s in (3.27) will tend approximate distribution of χ 2 (β) to zero, the approximate distribution of χ 2 ( βˆ ) would depend on the variability of the v’s within the M groups. For a more practical approach, Stepanians (1994) suggested that we calculate the theoretical mean and the variance of the null distribution of the statistic. Since the mean of χ 2 (1) is equal to one and the variance of χ 2 (1) is two, the following can be stated with respect to the mean and variance of the asymptotic null ˆ statistic: distribution of the χ 2 (β) M M 2 2 λj χ (1) = λj , E χ βˆ = E (3.28) j =1
j =1
M M 2 2 ˆ λj χ (1) = 2 λ2j . Var χ β = Var j =1
(3.29)
j =1
Hence, by calculating the eigenvalues of the covariance matrix we will be able to deˆ statistic. In order to rive the mean and the variance of the null distribution of the χ 2 (β) 0 calculate the eigenvalues, we must obtain I and B matrix in the asymptotic covariance matrix of Z( βˆ ). Iis the Fisher information matrix for the maximum likelihood estimaˆ evaluated at the true value of the parameter vector β. The j rth element of B( β ) tor β, is expressed as follows: ∂ ∂βr E( i∈Ij Wi ) . Bj r (β) = (3.30) N · Var( i∈Ij Wi ) Now, we evaluate I and B( β ) with respect to its true parameter value. First, consider the j rth element of the matrix from ∂ 0 ∂βr E( i∈Ij Wi ) Bj r β = . N · Var( i∈Ij Wi ) β=β 0
(3.31)
From (3.20),
∂ ∂ E Wi = H0 (ti )eβ vi = H0 (ti )xir eβ vi . ∂βr ∂βr i∈Ij
i∈Ij
Hence, from (3.21) and (3.32), we have β vi 0 i∈Ij H0 (ti )xir e Bj r β = . N · i∈Ij H0 (ti )eβ vi
(3.32)
i∈Ij
(3.33)
Evaluation of the performance of survival analysis models
13
Now, the Fisher information matrix I is the following: 2 ∂ l(L) Irs = − ∂βr βs 2 ∂ Wi ln H0 (ti )eβ vi − H0 (ti )eβ vi =− ∂βr βs i h0 (ti ) Wi ln + H0 (ti ) =−
=
N
i
∂2 ∂βr βs
Wi ln H0 (ti ) + Wi β vi − H0 (ti )eβvi i
H0 (ti )vir vis eβ vi .
(3.34)
i=1
Hence, the Fisher information matrix I can be expressed as follows: I= V Diag H0 (ti ) exp β vi V ,
(3.35)
where V is the N × k matrix of independent variables, Diag[H0 (ti ) exp(β vi )] is an N × N diagonal matrix with the stated elements on the main diagonal. Now, with I and B( β 0 ), we are able to obtain the covariance matrix of Z( β ), hence we are able to calculate the eigenvalues of the covariance matrix to derive the mean and the variance of the null distribution of the K 2 statistic. Next, we investigate the asymptotic null distribution of K 2 under various conditions. The investigation is conducted by generating extensive numerical examples from a variety of conditions and calculating the eigenvalues of the covariance matrices. For each generated example, the theoretical mean and the variance of the null distribution of the statistic K 2 are calculated from the eigenvalues. Then, those calculated means and the variances are used to derive the approximate null chi-square distribution for the statistic K 2 . While we consider only two possible outcomes, 1 for the event, 0 for the censored in generating numerical examples for investigating the asymptotic behavior of the K 2 statistic in Poisson log-linear model, it is important to notice that a Poisson random variable W can have integer value greater than one. Our assumption is that if we have very large probability for zero and reasonably small probability for one so that these two probabilities cover almost the entire probability space for W , then we will be able to obtain the asymptotic null distribution of the K 2 statistic. For validation of our assumption, we employed a truncated Poisson random variable that deliberately has only two possible outcomes, zero for censored observations and one for events. We also develop a similar chi-square statistic, Kt2 based on the truncated Poisson distribution. Now, we examine the distribution function of a truncated Poisson random variable. First, let Wi be an ordinary Poisson random variable with parameter ui = H0 (ti ) exp( β V i ). Then, the truncated Poisson distribution function is the following:
14
R.B. D’Agostino and B.-H. Nam
Let
P (Wi = k) =
0 if k 2, Ci e−ui uki /k! for k = 0, 1,
(3.36)
where Ci = 1
1
Ci = 1
1
−ui uj /j ! j =0 e i
.
Here, −ui uj /j ! j =0 e i
=
1 1 = −u . e−ui ui + e−ui e i (ui + 1)
(3.37)
Let Wt be the truncated Poisson random variable having only two values, 0 and 1. Then, for k = 0, 1, P (Wt i = k) =
e−ui uki uki 1 · = . e−ui (ui + 1) k! (ui + 1) · k!
Hence, from (3.38), the probability mass function for Wt i can be expressed as wti 1−wti ti uw ui ui i = f (wt i , ui ) = . 1− (ui + 1) · wt i ! 1 + ui 1 + ui Let δi = ui /(1 + ui ), then w f (wt i , ui ) = δi i (1 − δi )1−wi
Here,
δi = (1 − δi ) exp wt i log . 1 − δi
δi log = log H0 (ti ) exp β V i = log H0 (ti ) + β V i . 1 − δi
(3.38)
(3.39)
(3.40)
(3.41)
(3.39) and (3.41) indicate that the truncated Poisson model is a generalized linear model with the random component equal to the binary response Wt i with parameter δi , and with the logit link. Thus, we can apply the theoretical framework of the goodness of fit statistic for the generalized linear model. Now, we have ui = δi , P (Wt i = 1) = (3.42) ui + 1 P (Wt i = 0) =
1 = 1 − δi . ui + 1
Then, the expectation and variance of Wt i are ui = δi , E(Wt i ) = P (Wt i = 1) = ui + 1 ui ui · 1− Var(Wt i ) = = δi (1 − δi ). ui + 1 ui + 1
(3.43)
(3.44) (3.45)
Evaluation of the performance of survival analysis models
15
Here, we develop a similar chi-square type statistic Kt2 based on the truncated Poisson model in the same way as we developed the K 2 statistic for the Poisson loglinear model. Let Vi = (Vi1 , Vi2 , . . . , Vik ) be the vector of independent variables, for i = 1, 2, . . . , n. We partition the space of V into M separate and distinct classes R1 , R2 , . . . , RM where M > k. We assign each observation to its appropriate class. Consider the sum of the truncated Poisson random variables falling into each class. Define i∈Ij Wt i − E( i∈Ij Wt i ) Zj (β) = (3.46) , Var( i∈Ij Wt i ) where Ij = {i: xi ∈ Rj }, for j = 1, 2, . . . , M. Define 2 M M [ 2 i∈Ij Wt i − E( i∈Ij Wt i )] 2 χ (β) = . Zj (β) = Var( i∈Ij Wt i ) j =1
(3.47)
j =1
Since {Wt i }s, for i ∈ Ij , are independent, the mean of the sum of the independent random variables are the sum of the individual means of the independent random variables, ui E Wt i = E(Wt i ) = ui + 1 i∈Ij
i∈Ij
=
i∈Ij
H0 (ti ) exp( β V i )
i∈Ij
1 + H0 (ti ) exp( β V i )
.
(3.48)
Also, Var
i∈Ij
=
ui 1 · Wt i = Var(Wt i ) = 1 + ui 1 + ui i∈Ij
i∈Ij
H0 (ti ) exp( β V i ) i∈Ij
1 + H0 (ti ) exp( β V i )
1 . 1 + H0 (ti ) exp( β V i )
(3.49)
Therefore, from (3.47), (3.48) and (3.49), χ 2( β ) =
M j =1
i∈Ij
i∈Ij
Wt i −
H0 (ti ) exp( β V i ) 2 i∈Ij 1+H0 (ti ) exp( β V i )
H0 (ti ) exp( β V i ) · 1+H (t ) 1exp( β V ) 1+H0 (ti ) exp( β V i ) i 0 i
.
(3.50)
Now, define Kt2 = χ 2 βˆ = Z βˆ Z βˆ , where βˆ is the maximum likelihood estimator of β.
(3.51)
16
R.B. D’Agostino and B.-H. Nam
From the previous discussion, and from (3.26), (3.26), we know that d 1 −1 0 Z βˆ −→ N 0, I − B 0 B , I N where B 0 , described in (3.31), is B(β 0 ) evaluated at the true value of the parameter vector β, β 0 , and M d χ 2 βˆ = z βˆ z βˆ −→ λj Uj , j =1
where the Uj ’s are independent χ 2 (1)’s and the λj ’s are the eigenvalues of the asymptotic covariance matrix of Z( βˆ ). As discussed above, from (3.28) and (3.29), M M 2 λj χ (1) = λj , E χ βˆ = E
2
j =1
j =1
M M 2 2 ˆ Var χ β = Var λj χ (1) = 2 λ2j . j =1
j =1
Hence, by calculating the eigenvalues of the covariance matrix we will be able to deˆ statistic. In order to rive the mean and the variance of the null distribution of the χ 2 (β) 0 calculate the eigenvalues, we must obtain the I and B(β ) matrix in the asymptotic covariance matrix of Z( βˆ ). I is the Fisher information matrix for the maximum likelihood ˆ estimator β, evaluated at the true value of the parameter vector β. The j rth element of B( β ) is expressed as follows: ∂ ∂βr E( i∈Ij Wi ) . Bj r (β) = N · Var( i∈Ij Wi ) Now, from (3.16) and (3.44), E(Wt i ) =
H0 (ti ) exp( β V i ) ui = , ui + 1 1 + H0 (ti ) exp( β V i )
∂ ∂ H0 (ti ) exp( kl=1 vil βl ) E Wt i = k ∂βr ∂βr i∈Ij i∈I 1 + H0 (ti ) exp( l=1 vil βl ) =
i∈Ij
=
i∈Ij
xil
H0 (ti ) exp(
k
l=1 vil βl ) k 1 + H0 (ti ) exp( l=1 vil βl )
vil · ui (1 − ui ).
1 1 + H0 (ti ) exp(
k
l=1 vil βl )
(3.52)
Evaluation of the performance of survival analysis models
17
Therefore, for the truncated Poisson model, the j rth element of the matrix B( β 0 ) is 0 i∈Ij vil ui ( β)(1 − ui ( β)) Bj r β = (3.53) . 0 N i∈Ij ui ( β)(1 − ui ( β)) β=β Now, the Fisher information matrix I for the maximum likelihood estimator βˆ evaluated at the true value of the parameter vector β is ∂2 l(L) ∂βr βs 2 ∂ δi =− log(1 − δi ) + wt i log ∂βr βs 1 − δi
Irs = −
i
=−
∂2 ∂βr βs
− log 1 + H0 (ti ) exp β V i i
+ wt i · log H0 (ti ) + β V i =−
vir vis δi (1 − δi ).
(3.54)
i
Hence, the Fisher information matrix I can be expressed as follows: I= V Diag δi (1 − δi ) V ,
(3.55)
where V is the n × k matrix of independent variables, Diag[δi (1 − δi )] is an n × n diagonal matrix with the stated elements on the main diagonal, for i = 1, 2, . . . , n. Now, with I and B( β 0 ), we are able to obtain the covariance matrix of Z( β ), hence we are able to calculate the eigenvalues of the covariance matrix to derive the mean and the variance of the null distribution of Kt2 statistic. 3.4. The asymptotic null distribution of K 2 and Kt2 We investigate the asymptotic null distribution of K 2 and Kt2 under a various conditions. The investigation is conducted by generating exhaustive numerical examples from a variety of conditions and calculating the eigenvalues of the covariance matrices. For each generated example, the theoretical mean and the variance of the null distribution of the statistic K 2 and Kt2 are calculated from the eigenvalues. Then, those calculated means and the variances are used to derive the approximate null chi-square distribution for the statistic K 2 and Kt2 . Numerical examples were generated to represent a wide range of situations by various selection of the numbers of groupings (M), the numbers of parameters βs (k), the sample sizes (N ), baseline survival (S0 (t)) and the distribution of V ’s. In selecting the number of parameters β’s, we have a restriction that the number of parameters should be smaller than the number of groups, i.e., k < M. When we group the
18
R.B. D’Agostino and B.-H. Nam
Table 1 Summary of specifications for numerical configurations Examples with all continuous variables M
Statistics
N
k
Choice of S0 (t)
βj
10
K2
200 400
2 to 9
0.6 0.7 0.8 0.9
0.1 0.2 0.3 ... 0.8 0.9 1.0
2×
8×
4×
10 =
1280
Total
Kt2
1×
2×
Total
Examples with all ordinal variables M
Statistic
N
k
Choice of S0 (t)
βj
10
K2
400
4 to 9
0.6 0.7 0.8 0.9 0.95
0.2 0.4 0.6 0.8 1.0
1×
6×
5×
5=
300
Total
Kt2 1×
2×
Examples with all binary variables M
Statistic
N
k
S0 (t)
β1 , β2 , β3 , . . .
10
K2
400
5 to 9
0.6 0.7 0.8
0.2, 0.21, 0.22, 0.23, . . . 0.4, 0.41, 0.42, 0.43, . . . 0.6, 0.61, 0.62, 0.63, . . .
0.9 0.95 5×
0.8, 0.81, 0.82, 0.83, . . . 1.0, 1.01, 1.02, 1.03, . . . 5=
Kt2 1×
2×
1×
5×
250
observations into M classes, the random variable of interest is not the individual observation any more. The grouped observations, namely the mean or sum of the responses in the cell are the variables of interest. Hence, we are dealing with M “observations” and the number of parameters should be smaller than the number of “observations”. Detail description of the specification is in Table 1. 3.4.1. Algorithms for generating numerical examples SAS programs were used to generate the grid of numerical examples. SAS procedure PROC IML was employed for matrix calculations. First, we determine the values of M, k, N, S0 (t) and β’s to represent a wide range of situations. Second, we generate V ’s. For continuous distribution of V ’s, k independent standard normal variables were generated using different random number generators to form k × 1 vector. Each procedure was repeated N times to form an N × k matrix for V ’s. For discrete distributions of
Evaluation of the performance of survival analysis models
19
V ’s, standard normal variables were generated and transformed into ordinal categorical variables. Then, given β, S0 (t) and V ’s, we calculated the expectation ui = E[Wi ] = H0 (t) exp β V i , where H0 (t) = − log(S0 (t)), and S0 (t) is the baseline survival function for time t. For the K 2 statistic, we calculate ξ( Xi ) = P (Wi = 1) = exp(−ui ) · ui . The observations are then sorted in ascending order by the value of ξ( Xi ) for K 2 for i = 1, . . . , N and the sorted observations are grouped into M classes such that each group has an equal number of observations. Here, we used M = 10, then the observations are divided into deciles such that each group contains N/10 observations. Hence, the first decile has the smallest mean value of ξ( V )’s and the 10th decile has the largest mean value of ξ( V )’s. Next, the matrix B( β 0 ) was constructed according to (3.33). Then, the Fisher information matrix I was constructed according to (3.35). With B( β 0 ) and I, the covariance matrix was obtained according to (3.25). Then, the eigenvalues of the covariance matrix were calculated and used for obtaining the theoretical mean and the variance of the null distribution of the statistic by the following equations: M M 2 2 ˆ E χ β =E λj χ (1) = λj , j =1
j =1
M M 2 2 ˆ Var χ β = Var λj χ (1) = 2 λ2j . j =1
j =1
From those eigenvalues, we were able to investigate the mean and the variance of the asymptotic null distribution of the K 2 statistic. The same procedures as above were applied for Kt2 . We calculated δ( V i ) = P (Wt i = 1) = ui /(1 + ui ) for the Kt2 statistic. The observations are then sorted in ascending order by the value of δ( V i ) for i = 1, . . . , N . The remaining steps for getting B( β 0 ) and I for Kt2 are the same as those obtained above for K 2 . 3.4.2. Results of generated examples A summary of the results from the generated examples are in Table 2. For all continuous and ordinal variables, χ 2 (M − 1) is the appropriate approximate null distribution of the statistic for both K 2 and Kt2 . For all binary variables, we can conclude that the null distribution also would be close to χ 2 (M − 1). In conclusion, for M = 10, the appropriate approximate null distribution of these two statistics are χ 2 (9). 3.5. Comparison of the proposed statistic (3.2) and Kt2 From (3.50), Kt2 can be expressed as follows: Kt2 =
M (Wj /nj − µ¯ j )2 , µ¯ j (1 − µ¯ j ) j =1
20
R.B. D’Agostino and B.-H. Nam
Table 2 The theoretical means for the approximate null χ 2 distribution derived by calculation of eigenvalues M = 10 K2
Kt2
Continuous
M − 1 (100%) n = 640
M − 1 (100%) n = 640
Ordinal
M − 1 (100%) n = 150
M − 1 (100%) n = 150
Binary
M − 1 (84%) M − 2 (16%) n = 125
M − 1 (100%) n = 125
where nj , Wj , and µ¯ j are respectively, the number of the observations, the number of positive outcomes (event) and the average value of ui /(ui + 1) in the j th cell where j = 1, 2, . . . , M and i ∈ Ij . Since Kt2 showed consistent asymptotic behavior from above generated examples (as shown in Table 2) and the two statistics are very similar, comparing these two statistics using real data (Framingham Heart Study) would give us a good idea how the proposed chi-square statistics would behave asymptotically. We examined the calibration measures of one of the Framingham prediction functions (predicting risk of coronary heart disease in 4, 5, 8 and 10 years) using these two statistics. From the results as shown in Table 3, we expect that the asymptotic behavior of the proposed statistic would be very close to that of Kt2 .
Appendix A (1) Mean and Variance of C statistic, the area under the ROC curve in logistic regression E(C) = P (Y1 > Y2 ) = P1 , 1 P1 (1 − P1 ) + (n2 − 1) P12 − P12 + (n1 − 1) P13 − P12 , n1 n2
Var(C) = where
P12 = P Y2 < Y1 and Y2 < Y1 for Y1 = Y1 , P13 = P Y2 < Y1 and Y2 < Y1 for Y2 = Y2 . (2) Mean and Variance of (τˆ ) E(τˆ ) = τ, Var(τˆ ) =
4(n1 − 2) 2 Var(τi ) + 1 − τ2 , n1 (n1 − 1) n1 (n1 − 2)
Evaluation of the performance of survival analysis models
21
Table 3 Calibration measures by decile (M = 10) Men, 10 years Decile 1 2 3 4 5 6 7 8 9 10
Wj nj
KMj
p¯ j
µ¯ j
proposed χ 2
Kt2
0.00000 0.00410 0.02049 0.03689 0.04918 0.07787 0.06967 0.13115 0.17213 0.23770
0.0000 0.0044 0.0211 0.0380 0.0508 0.0838 0.0735 0.1430 0.1847 0.2594
0.00955 0.01834 0.02768 0.03854 0.05085 0.06667 0.08646 0.11640 0.16391 0.28466
0.00950 0.01818 0.02730 0.03782 0.04960 0.06454 0.08291 0.11008 0.15173 0.24922
2.34375 2.63477 0.39255 0.00195 0.00002 1.14996 0.51936 1.67822 0.76949 0.76467
2.33142 2.70966 0.42590 0.00581 0.00092 0.71854 0.56273 1.10532 0.78927 0.17292
Total
10.2547
8.82249
Men, 8 years Decile 1 2 3 4 5 6 7 8 9 10
Wj nj
KMj
p¯ j
µ¯ j
proposed χ 2
Kt2
0.00000 0.00000 0.01639 0.02869 0.04098 0.05328 0.04508 0.10246 0.12705 0.18443
0.0000 0.0000 0.0167 0.0290 0.0418 0.0555 0.0463 0.1091 0.1328 0.1949
0.00679 0.01305 0.01972 0.02751 0.03636 0.04779 0.06216 0.08408 0.11933 0.21279
0.00676 0.01297 0.01953 0.02713 0.03571 0.04667 0.06030 0.08071 0.11268 0.19171
1.66102 3.22704 0.11530 0.02030 0.20580 0.31903 1.05309 1.98285 0.42097 0.46611
1.65482 3.20554 0.12525 0.02234 0.19667 0.23922 0.99685 1.55506 0.50377 0.08358
9.47151
8.58310
Total Men, 5 years Decile 1 2 3 4 5 6 7 8 9 10 Total
Wj nj
KMj
p¯ j
µ¯ j
proposed χ 2
Kt2
0.00000 0.00000 0.00410 0.01639 0.03279 0.02869 0.02459 0.05328 0.08197 0.13115
0.0000 0.0000 0.0042 0.0165 0.0330 0.0292 0.0249 0.0549 0.0835 0.1349
0.00402 0.00774 0.01171 0.01636 0.02167 0.02855 0.03725 0.05063 0.07244 0.13280
0.00401 0.00771 0.01165 0.01623 0.02144 0.02815 0.03657 0.04938 0.06991 0.12396
0.98129 1.90381 1.19004 0.00028 1.47642 0.00371 1.03835 0.09235 0.44438 0.00938
0.97912 1.89630 1.20746 0.00040 1.49726 0.00260 0.99433 0.07882 0.54578 0.11596
7.14001
7.31802
(continued on next page)
22
R.B. D’Agostino and B.-H. Nam
Table 3 (Continued) Men, 4 years Decile 1 2 3 4 5 6 7 8 9 10
Wj nj
KMj
p¯ j
µ¯ j
proposed χ 2
Kt2
0.00000 0.00000 0.00000 0.01230 0.01639 0.02049 0.02049 0.03689 0.07787 0.11475
0.0000 0.0000 0.0000 0.0123 0.0165 0.0207 0.0208 0.0376 0.0792 0.1174
0.00318 0.00612 0.00927 0.01296 0.01717 0.02264 0.02956 0.04024 0.05771 0.10672
0.00317 0.00611 0.00923 0.01287 0.01702 0.02238 0.02913 0.03945 0.05609 0.10087
0.77532 1.50358 2.28318 0.00824 0.00649 0.04132 0.65318 0.04405 2.07231 0.29198
0.77397 1.49889 2.27244 0.00642 0.00579 0.03982 0.64407 0.04222 2.18665 0.51855
7.67966
7.98882
Total Women, 10 years Decile 1 2 3 4 5 6 7 8 9 10
Wj nj
KMj
p¯ j
µ¯ j
proposed χ 2
Kt2
0.00000 0.00356 0.00356 0.00356 0.01068 0.00355 0.02491 0.03559 0.06406 0.12811
0.0000 0.0036 0.0039 0.0036 0.0108 0.0037 0.0259 0.0383 0.0686 0.1379
0.00103 0.00238 0.00414 0.00684 0.01101 0.01643 0.02387 0.03730 0.05986 0.13215
0.00103 0.00237 0.00413 0.00681 0.01094 0.01629 0.02359 0.03661 0.05811 0.12261
0.29078 0.17763 0.00388 0.43324 0.00109 2.82776 0.04970 0.00786 0.38101 0.08100
0.29061 0.16688 0.02228 0.43947 0.00187 2.85932 0.02142 0.00826 0.18149 0.07905
4.25395
4.07065
Total Women, 8 years Decile 1 2 3 4 5 6 7 8 9 10 Total
Wj nj
KMj
p¯ j
µ¯ j
proposed χ 2
Kt2
0.00000 0.00356 0.00000 0.00356 0.01068 0.00355 0.02491 0.02135 0.05338 0.10676
0.0000 0.0036 0.0000 0.0036 0.0108 0.0037 0.0259 0.0223 0.0561 0.1125
0.00083 0.00190 0.00331 0.00547 0.00880 0.01315 0.01912 0.02992 0.04813 0.10752
0.00083 0.00190 0.00330 0.00545 0.00876 0.01306 0.01894 0.02947 0.04699 0.10099
0.23232 0.42906 0.93267 0.17986 0.12837 1.94044 0.68894 0.56177 0.38927 0.07270
0.23221 0.40981 0.93109 0.18544 0.11823 1.98107 0.53991 0.64735 0.25623 0.10307
5.55540
5.40440
(continued on next page)
Evaluation of the performance of survival analysis models
23
Table 3 (Continued) Women, 5 years Wj nj
KMj
p¯ j
µ¯ j
proposed χ 2
Kt2
0.00000 0.00356 0.00000 0.00356 0.00711 0.00000 0.01068 0.01068 0.03915 0.06406
0.0000 0.0036 0.0000 0.0036 0.0071 0.0000 0.0108 0.0073 0.0404 0.0658
0.000485 0.001116 0.001945 0.003215 0.005182 0.007748 0.011279 0.017691 0.028575 0.065117
0.000485 0.001116 0.001943 0.003210 0.005169 0.007717 0.011215 0.017533 0.028167 0.062573
0.13649 1.55486 0.54766 0.01300 0.20044 2.20190 0.00579 1.74594 1.41538 0.00216
0.13645 1.50527 0.54711 0.01070 0.20752 2.19326 0.00737 0.76703 1.23732 0.01055
7.82362
6.62257
Decile 1 2 3 4 5 6 7 8 9 10 Total
Women, 4 years Wj nj
KMj
p¯ j
µ¯ j
proposed χ 2
Kt2
0.00000 0.00000 0.00000 0.00356 0.00712 0.00000 0.00712 0.00356 0.03915 0.05694
0.0000 0.0000 0.0000 0.0036 0.0071 0.0000 0.0072 0.0036 0.0404 0.0583
0.000408 0.000938 0.001635 0.002702 0.004356 0.006513 0.009485 0.014885 0.024065 0.055093
0.000408 0.000937 0.001633 0.002698 0.004346 0.006492 0.009440 0.014773 0.023774 0.053245
0.11467 0.26379 0.46005 0.08413 0.48791 1.84882 0.15620 2.44051 3.19271 0.05551
0.11464 0.26366 0.45967 0.07735 0.49867 1.84273 0.16210 2.42801 2.86085 0.07610
9.10430
8.78379
Decile 1 2 3 4 5 6 7 8 9 10 Total
where, τ is the rank correlation coefficient and Var(τi ) is unknown quantity and 1 1 − τ2 . 2 (3) C3 tends to normality with Var(τi )
E(C3 ) = P (Y1 > Y3 | T1 < T3 ) = P3 , 1 Var(C3 ) = 2 Q3 · P3 (1 − P3 ) + A · P32 − P32 + B · P33 − P32 , Q3 where
P32 = P Y1 > Y3 , Y1 > Y3 | T1 < T3 , T1 < T3 , P33 = P Y1 > Y3 , Y1 > Y3 | T1 < T3 , T1 < T3 , Q3 ,
A and B are unknown quantities.
and
24
R.B. D’Agostino and B.-H. Nam
(4) Mean and Variance of overall C E[C] = E a · C1 + b · C2 + (1 − a − b) · C3 1 = a · P1 + b · (τ + 1) + (1 − a − b) · P3 2 n1 · n2 = · P1 1 n3 1 n1 · n2 + 2 n1 (n1 − 1) + ni=1 j =1 aij − 1) · (τ + 1) 1 n3 n1 · n2 + − 1) + ni=1 j =1 aij n1 n3 i=1 j =1 aij + · P3 , 1 n3 n1 · n2 + 12 n1 (n1 − 1) + ni=1 j =1 aij
+
1 4 n1 (n1
1 2 n1 (n1
Var[C] = Var a · C1 + b · C2 + (1 − a − b) · C3 = a 2 Var[C1 ] + b 2 Var[C2 ] + (1 − a − b)2 Var[C3 ] 1 = a2 · P1 (1 − P1 ) + (n1 − 1) P12 − P12 n1 · n2 + (n2 − 1) P13 − P12 4(n1 − 2) 2 2 1 2 +b · · Var(τi ) + 1−τ 4 n1 (n1 − 1) n1 (n1 − 1) + (1 − a − b)2 ·
=
1 Q3 · P3 (1 − P3 ) + A · P32 − P32 2 Q3 + B · P33 − P32 n1 · n2
1 n3 2 {n1 · n2 + − 1) + ni=1 j =1 aij } × P1 (1 − P1 ) + (n1 − 1) P12 − P12 + (n2 − 1) P13 − P12 1 2 n1 (n1
{ 12 n1 (n1 − 1)}2 1 · n1 n3 1 2 {n1 · n2 + 2 n1 (n1 − 1) + i=1 j =1 aij } 4 2 4(n − 2) 2 Var(τi ) + × 1−τ n(n − 1) n(n − 1) +
1
+
1 n3 2 {n1 · n2 + − 1) + ni=1 j =1 aij } n n 3 1 2 2 × aij · P3 (1 − P3 ) + A P32 − P3 + B P33 − P3 . 1 2 n1 (n1
i=1 j =1
Evaluation of the performance of survival analysis models
25
References Aitkin, M., Clayton, D. (1980). The fitting of exponential, Weibull and extreme value distributions to complex censored survival data using GLIM. Appl. Statist. 29, 156–163. Baker, R.J., Nelder, J.A. (1978). General Linear Interactive Modelling (GLIM). Release 3. Numerical Algorithms Group, Oxford. Bamber, D. (1975). The area above the ordinal dominance graph and the area below the receiver operating graph. J. Math. Psychol. 12, 387–415. Chernoff, H., Lehmann, E.L. (1954). The use of maximum likelihood estimates in tests for goodness of fit. Ann. Math. Statist. 25, 579–586. Hanley, J.A., McNeil, B.J. (1982). The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143, 29–36. Harrell, F.E., Lee, K.L., Mark, D.B. (1996). Tutorial in Biostatistics, Multivariable prognostic models: Issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Statist. Medicine 15, 361–387. Hosmer, D.W., Lemeshow, S. (1980). A goodness-of-fit test for the multiple logistic regression model. Commun. Statist. A 10, 1043–1069. Hosmer, D.W., Lemeshow, S. (1982). A review of goodness of fit statistics for use in the development of logistic regression models. Amer. J. Epidemiol. 115, 92–106. Kalbfleisch, J.D., Prentice, R.L. (1980). The Statistical Analysis of Failure Time Data. Wiley, New York. Kendall, M.G. (1970). Rank Correlation Methods. Griffin, London. Lehmann, E.L. (1951). Consistency and unbiasedness of certain nonparametric tests. Ann. Math. Statist. 22, 165–179. Lehmann, E.L., D’Abrera, H.J.M. (1975). Nonparametrics (Statistical Methods Based on Ranks). Holdenday, California. Moore, D.S. (1971). A chi-square statistic with random cell boundaries. Ann. Math. Statist. 42, 147–156. Moore, D.S., Spruill, M.C. (1975). Unified large-sample theory of general chi-square statistics for tests of fit. Ann. Statist. 3, 599–616. Shillington, E.R. (1980). A generalized chi-square goodness of fit procedure. Unpublished doctoral dissertation. University of Waterloo, Canada. Stepanians, M. (1994). Goodness of fit techniques and robustness considerations for multiple logistic regression model. Unpublished doctoral dissertation. Boston University, Boston.
2
Handbook of Statistics, Vol. 23 ISSN: 0169-7161 © 2004 Elsevier B.V. All rights reserved. DOI 10.1016/S0169-7161(03)23002-9
Discretizing a Continuous Covariate in Survival Studies
John P. Klein and Jing-Tao Wu
1. Introduction Many medical studies focus on the relationship between the time to some event, such as death or relapse, and covariates measured at the time at which therapy is initiated. When these covariates are discrete or categorical an interpretation of the effects of the covariates on outcome is relatively simple. Using a proportional hazard model the effect of a binary covariate on outcome is interpreted in terms of the relative risk of a patient with the characteristic as compared to a patient without the characteristic. When the covariate is continuous the interpretation of the effect of the covariate on outcome is more difficult. Here one typically reports the relative risk of a patient with a one-unit increase in the covariate. Most clinical investigators would rather have the continuous covariate converted into a binary covariate reflecting high and low risk values of the covariates. While this model may not be optimal for a continuous covariate, it is the model that is most often reported in the medical literature. There are a number of graphical techniques (see Klein and Moeschberger, 2003), such as martingale residual plots, which can be used to check if a threshold model is correct, but quite often the decision to use such a model is made by the clinical investigator on the grounds that it is more understandable than a model which treats the covariate as continuous. Once a decision is made to use a threshold model, the problem is to determine the cut-point between high risk and low risk patients. In some cases, the cut-point can be determined from the literature. Often cut-points need to be determined from the data. Selection of the cut-point can be made either by a data-oriented or outcome-oriented approach (Schulgen et al., 1994). In the data-oriented approach, cut-points are based on the distribution of the covariate in the study population. For example, the median could be used. The outcome-oriented approach picks a cut-point for which the discretized covariate has the largest effect on outcome. In this paper, we examine the outcome-oriented approach. In this approach it is important that adjustments be made to standard hypothesis tests to account for the fact that we picked a cut-point which makes the outcomes in the two groups as far apart as possible. In the next section, we shall survey methods for making adjustments to the test of no covariate effect when a cut-point procedure is used for a single continuous covariate in the proportional hazards model. We present the results of a Monte Carlo 27
28
J.P. Klein and J.-T. Wu
study that compares these methods. The results of this study suggest that a rescaled sequential approach suggested by Contal and O’Quigley (1999) performs the best. In Section 3, we extend this approach first to the accelerated failure time model with a single covariate and then to the case where there are additional auxiliary covariates to be modeled in both the proportional hazard model and the accelerated failure time model.
2. Techniques based on the Cox model with a single covariate In this section, we discus techniques for discretizing a single covariate, X, based on a right-censored random variable. We shall base the techniques on the Cox (1972) proportional hazards model. The data available to us consists of (Ti , δi , Xi ) where Ti is the on study time, δi is the indicator of an event (δi = 1 if Ti is an event, δi = 0 if censored) and Xi is the single continuous covariate. We also define the counting process, Ni (t) = I [Ti t, δi = 1] and Yi (t) = I [Ti t]. 2.1. Martingale residuals A graphical technique for assessing if a threshold model for X is warranted is the martingale residual plot. To construct this plot, when there is a single covariate, we first compute the Nelson–Aalen estimator of the cumulative hazard function of the failure time ignoring the covariate. That is we compute dN• (t) (t) = , H (2.1) Y• (t) Ti t where dN• (t) = dNi (t) is the total number of events at time t and Y• (t) = Yi (t) is the total number at risk at time t. The martingale residual for the ith subject is defined by Mi = Ni (Ti ) − Hi (Ti ).
(2.2)
To determine the functional form of X to be used in a proportional hazards regression, Themeau et al. (1990) show that one can examine a plot Mi versus Xi . A LOESS smooth of the scatter diagram is used to determine the functional form f (X) to be used in a Cox regression analysis as h(t | X) = h0 (t) exp{f (X)}. When the data is suggestive of a threshold model then we would expect the plot to show a distinct jump around the threshold and be approximately constant on either side of the jump. To illustrate the type of plots we use data taken from an International Blood and Marrow Registry study of alternative donor bone marrow transplantations (BMT) reported in Szydlo et al., 1997. This study consisted of patients with Acute Lymphocytic Leukemia (ALL) (n = 449), Acute Myeloid Leukemia (AML) (n = 632), and Chronic Myeloid Leukemia (CML) (n = 972). Patients were transplanted with their disease in either an early (n = 1154), intermediate (n = 529) or advanced (n = 372) stage based on remission status. In the study 1224 patients had an HLA-identical sibling donor, 238 a 1-antigen HLA mismatched related donor, 102 a 2-antigen HLA mismatched related
Discretizing a continuous covariate in survival studies
29
Fig. 1. Martingale residuals.
donor, 383 an HLA matched unrelated donor and 108 an HL mismatched unrelated donor. The endpoint of interest in the study was treatment failure defined as death or relapse which ever came first. Our interest is in modeling the effect of age at transplantation on the rate of treatment failure. In the study patients’ ages ranged from 7 months to 57.4 years with a median age of 30.3 years and a interquartile range of 19.5 years. The mean age was 29.06 with a standard error of 0.28 years. Figure 1 shows the martingale residual plot for this data. The solid line is the LOESS regression line. The line shows that there appears to be a change in the effect of age on outcome occurring at about 40 years of age. While this curve may be more suggestive of two piecewise linear functions of age, clinical interest is in the discretizing of the age covariate.
30
J.P. Klein and J.-T. Wu
2.2. Estimation of the threshold parameter Estimation of the threshold parameter, γ , is based on the Cox proportional hazards model. The assumed model is h(t | X, γ ) = h0 (t) exp βγ I [X γ ] . (2.3) Estimates of γ are based on finding the value of γ which maximizes a test statistics for testing H0 : βγ = 0. Possible tests are the score, Wald or likelihood ratio tests. For any of these tests one computes the value of the test statistics for all possible values of γ in the range where there is data. One can show that the values of the statistics change only at values of γ = Xi where Xi is an observed covariate value so that the statistics needs to be computed at only a finite number of potential values for γ . All three statistics are based on the basic proportional hazard partial log likelihood given by L(βγ , γ ) =
n
βγ I [Xi γ ]Ni (∞)
i=1
−
n
∞
log
i=1 0
n
Yj (u) exp βγ I [Xj γ ] dNi (u).
(2.4)
j =1
In this special case (2.4) can be simplified. Let Ri be the total number at risk, Di the γ γ number of deaths, Ri the number at risk with X γ , and Di the number of deaths with X γ at risk at time Ti . Then we can write (2.4) as L(βγ , γ ) =
n
γ γ γ
βγ Di − Di log Ri eβγ + Ri − Ri .
(2.5)
i=1
The score statistics for a fixed γ is given by Di Ri eβγ ∂L(βγ , γ ) γ U (βγ , γ ) = = Di − , γ γ ∂βγ (Ri − Ri ) + Ri eβγ i=1 γ
n
(2.6)
and the Fisher information is given by ∂U (βγ , γ ) Di (Ri − Ri )Ri eβγ I (βγ , γ ) = − = . γ γ ∂βγ [(Ri − Ri ) + Ri eβγ ]2 n
γ
γ
(2.7)
i=1
The value of βγ , bγ , that maximizes (2.5) is the profile maximum likelihood estimator for this value of γ . Estimates of γ are found by finding the Xi that maximize the likelihood ratio test statistics for testing βγ = 0 defined by LR(γ ) = 2 Log L(bγ , γ ) − Log L(0, γ ) , (2.8) by maximizing the Wald test of βγ = 0 given by Z(γ ) = bγ2 I (bγ , γ ),
(2.9)
Discretizing a continuous covariate in survival studies
31
Fig. 2. Score, Wald and likelihood ratio statistics.
or by maximizing the score test given by Sc(γ ) =
U (0, γ ) . I (0, γ )
(2.10)
Note that maximizing the likelihood ratio statistics is equivalent to maximizing the profile likelihood since log[L(0, γ )] is the same for all γ . To illustrate the calculations we again use the data on bone marrow transplant patients. In Figure 2 we plot the three test statistics against age. The maximum for the score and Wald statistics are at 0.8 years with chi-squares of 15.61 and 12.17, respectively for the test statistics. The maximum value for the likelihood ratio statistics is found at 41.2 years with a chi-square is 7.69 When age is treated continuously the values of the chi-square statistics are 2.63 (p = 0.1047) for the likelihood ratio test and
32
J.P. Klein and J.-T. Wu
2.62 (p = 0.1055) for both the Wald and score tests so that there is no evidence of an effect of age on outcome. If we use the test statistics based on the threshold models without any adjustment for the fact that we picked the threshold with the largest chi-square, we have p-values for the age effect of 0.0056 for the likelihood ratio test, 0.0005 for the Wald test and < 0.0001 for the score test. Clearly, some type of adjustment needs to be made to these p-values and this is discussed in the next section. 2.3. Inference for β In the previous section we saw how to estimate the threshold parameter based on test statistics for testing the hypothesis that βγ = 0. While these test statistics are appropriate for estimating γ , they are clearly not appropriate for making inference about βγ since they are based on the largest possible value of the test statistics. Some type of correction for this selection bias is needed to preserve the type I error rate. The first two corrections are based on the score statistics. The first, due to Jespersen (1986), is based on the statistics WJ defined by WJ =
Supγ |U (0, γ )| √ , D
(2.11)
where D is the number of events in the sample. Jespersen shows that under the null hypothesis this statistics converges in distribution to the sup |W 0 (p)|, 0 p 1, where W 0 ( ) is a Brownian Bridge. Billingsley (1968) shows that ∞
0 j +1 2 2 , (−1) exp −2j k P sup W (p) k = 2 (2.12) 0p1
j =1
so that p-values and critical values of the test can be found. Contal and O’Quigley (1999) also provide a corrected test based on the score statistics. The test is based on the following result due to Billingsley (1968). Suppose that φ1 , . . . , φn are exchangeable random variables that meet the following three conditions: n i=1
ϕi → 0, p
n i=1
ϕi2 → 1 p
and
max |ϕi | → 0
1in
p
as n → ∞.
(2.13)
Then Sn (p) =
[np]
ϕi ⇒ W 0 (p),
(2.14)
i=1
where [ ] is the greatest integer function. When there is no censoring so that n = D, one can show that the log rank test is precisely equal to Savage’s test which is a linear rank test with exponential scores for the ith smallest death time given by ai = 1 −
i j =1
1 . D−j +1
(2.15)
Discretizing a continuous covariate in survival studies
33
If the event times are ordered from smallest to largest then one can show that the score statistics (2.5) can be written using these scores as U (γ ) = −
n
I [X(i) γ ]ai ,
(2.16)
i=1
where X(i) is the value of X associated with the ith smallest death time. The scores, a’s, have a mean of zero and variance σ 2 given by D 2 a 2 σ = i=1 i . (2.17) D−1 If we order the data with X1 < · · · < XD then we have that ai /[(D − 1)1/2σ ] meets the conditions of (2.13) and [Dp] U (X[Dp] ) 1 ai = √ Sn (p) = √ . σ D − 1 i=1 σ D−1
(2.18)
This result, in the no censoring case, allows the limiting Brownian motion result to be applied. When there is censoring the results hold using the log rank statistics with (2.17) computed using the observed number of deaths, D. The test of no effect of X on outcome is then based on the maximum value of |Sn (p)| over the possible cut-points and this statistics has the same limiting distribution as Jespersen’s statistics. We shall show extensions of this approach to more complicated models in later sections. A third method of adjustment is due to Lausen and Schumacher (1992, 1996). To apply this approach the possible range of threshold values needs to be restricted. Values of γ are restricted to be in the range [X(nε), X(n(1−ε))] where X(k) is the kth order statistics of the continuous variable and 0 < ε < 0.5. Let C(γ ) be a standardized test statistics for the two sample problems with groups defined by the threshold parameter γ , then Lausen and Schumacher show that Max C(γ ), γ ∈ [X(nε) , Xn(1−ε) ]
⇒
|W 0 (u)| , √ u∈[ε,1−ε] u(1 − u) sup
as n → ∞.
Miller and Siegmund (1982) show that |W 0 (u)| P sup √ >b u∈[ε,1−ε] u(1 − u) (1 − ε)2 ϕ(b) 1 ∼ ln , +4 = ϕ(b) b − b ε2 b
(2.19)
(2.20)
where φ( ) is the standard normal density function. These results suggest the following corrected p-value approach. For all γ in the range [X(nε) , X(n(1−ε))] we compute either the Wald, score or likelihood ratio test pvalue. Let Pmin be the smallest of these p-values over the range of threshold parameters.
34
J.P. Klein and J.-T. Wu Table 1 P -values of tests of the age effect Method Age treated continuously Score test Wald test Likelihood ratio test Threshold models Score test no adjustment Wald test no adjustment Likelihood ratio test no adjustment Jespersen’s correction Contal and O’Quigley correction Lausen and Schumacher e = 0.04 score test Lausen and Schumacher e = 0.04 Wald test Lausen and Schumacher e = 0.04 likelihood ratio test Lausen and Schumacher e = 0.1 score test Lausen and Schumacher e = 0.1 Wald test Lausen and Schumacher e = 0.1 likelihood ratio test Lausen and Schumacher e = 0.2 score test Lausen and Schumacher e = 0.2 Wald test Lausen and Schumacher e = 0.2 likelihood ratio test
The corrected p-value to test β = 0 is given by (1 − ε)2 ϕ(z) 1 ln , +4 Pcor = ϕ(z) z − 2 z z ε
P -value
0.1055 0.1055 0.1047
< 0.0001 0.0005 0.0055 0.1836 0.1806 0.0593 0.0601 0.0691 0.0441 0.0447 0.0516 0.0398 0.0402 0.0459
(2.21)
where z = Φ −1 (1 − Pmin /2) with Φ the standard normal distribution function. Table 1 shows the results of the various methods of testing for an age effect in the BMT data. Here we see that if no correction is made then there is a highly significant age effect. Using Jespersen’s or Contal and O’Quigley’s corrections, the age effect is not significant, in agreement with the continuous covariate model. For Lausen and Schumacher’s correction, the conclusion depends on the test statistics and on the value of ε. 2.4. Comparison of test procedures To compare the various strategies for testing the hypothesis that β is equal to zero we present part of a large scale Monte Carlo study found in Wu (2001). In the study, we simulate data from a Cox proportional hazards model with a baseline hazard rate equal to 1.0. For each observation a continuous covariate is generated from a uniform distribution on the interval [−1, 1]. Censoring is by an independent exponential random variable with a rate selected to yield the indicted censoring percentage. Table 2 shows the estimated power when data is simulated under the null hypothesis of no effect (β = 0). The level of the test is 0.05. Here we see that the unadjusted
Discretizing a continuous covariate in survival studies
35
Table 2 Observed significance based on difference methods of adjustment N
%
Continuous model
Unadjusted
Jespersen
Contal
Cen
Score
Wald
Like. ratio
Score
Wald
Like. ratio
and O’Quigley
0
0 20 40
5.2 5.2 6.0
4.7 4.8 5.2
4.8 5.2 5.8
66.3 63.7 62.5
60.7 55.4 56.4
55.5 51.9 53.9
1.2 2.0 2.3
2.1 2.9 4.6
100
0 20 40
5.6 4.6 5.8
5.6 4.5 5.8
5.6 4.7 5.8
70.7 69.9 66.1
67.7 66.1 60.4
60.7 61.6 57.9
2.2 2.8 3.1
2.7 3.8 4.4
200
0 20 40
4.7 5.3 4.7
4.6 5.3 4.6
4.5 5.3 4.5
75.0 71.4 70.9
71.9 67.6 67.6
65.4 62.9 61.1
3.6 3.6 2.7
4.1 3.0 3.1
Lausen and Schumacher approach %
Score test
Wald test
Likelihood ratio test
Cen ε = 0.04 ε = 0.10 ε = 0.20 ε = 0.04 ε = 0.10 ε = 0.20
ε = 0.04 ε = 0.10 ε = 0.20
50
0 20 40
17.2 16.9 17.3
6.5 6.9 7.2
4.4 5.1 5.3
7.2 6.5 7.2
4.3 4.7 4.3
3.5 3.6 3.9
2.7 3.8 3.8
3.2 3.8 4.2
2.7 3.6 4.6
100
0 20 40
9.8 10.6 8.7
5.4 5.7 5.0
4.7 4.5 5.5
7.2 7.5 5.7
4.2 4.4 4.0
3.9 4.6 4.5
3.6 4.5 4.2
3.5 4.7 3.9
3.3 4.2 4.4
200
0 20 40
7.2 6.2 5.9
5.7 5.7 4.2
4.5 47 4.1
5.5 5.5 4.9
5.3 5.4 3.6
4.3 4.7 3.6
4.5 4.6 3.1
4.5 4.7 3.1
4.3 4.6 3.6
methods, which base the test on the threshold model without any correction, are clearly not correct in that they reject the null hypothesis much too often. The adjusted p-value approach of Lausen and Schumacher, when based on the score test, also appears to reject the null hypothesis too often. Both Jespersen’s and Contal and O’Quigley’s methods provide appropriate protection to the null hypothesis and each may be a bit conservative. The adjusted p-value approach when applied using either the Wald or the likelihood ratio test seems to perform well when ε is either 0.1 or 0.2. Similar results hold when the baseline hazard rate is increasing or decreasing. To further compare the methods we examine their performance under the alternative hypothesis (β = 0). In Table 3 we look at how well they perform under the model h(t | X) = exp{βX} and in Tables 4 and 5 we look at the model h(t | X) = exp{βI [X γ ]} for γ = 0, 0.5. In these three tables we see that all three methods of adjustment have similar powers and that they perform quite well for large sample sizes. For all three methods there is a loss of power as compared to the continuous model, even when the threshold model is true. This suggests that there is a small price to pay for the simpler interpretation of the threshold model.
36
J.P. Klein and J.-T. Wu
Table 3 Power under continuous covariate model N
Ln(1.5)
Ln(2)
%
Continuous model
Jespersen
Cen
Score
Wald
Like. ratio
50
0 20 40
33.5 29.3 24.9
33.2 28.1 24.2
33.3 28.5 24.1
100
0 20 40
61.5 55.4 41.4
61.4 54.9 40.8
200
0 20 40
88.6 81.7 72.1
50
0 20 40
100
200
Contal
Lausen and Schumacher
and O’Quigley
Wald ε = 0.1
Like. ratio ε = 0.1
15.2 12.9 10.5
19.7 18.2 17.4
20.0 16.3 13.9
20.2 17.0 14.1
61.4 54.9 40.8
40.7 34.2 24.1
45.1 38.4 29.1
45.3 36.2 26.7
44.6 36.2 27.6
88.6 81.7 71.9
88.6 81.7 72.1
78.4 70.4 56.4
79.2 72.7 60.1
77.7 69.9 53.7
77.3 70.6 55.3
75.2 63.1 53.3
74.2 62.0 51.9
74.4 62.9 52.8
43.3 37.3 37.6
51.1 45.3 37.2
51.4 42.9 31.0
52.8 45.4 33.8
0 20 40
96.2 92.1 83.7
96.2 91.8 83.4
9.1 91.8 83.5
87.6 80.3 68.6
89.3 83.0 73.3
88.6 80.1 68.3
88.7 81.3 68.9
0 20 40
100.0 100.0 98.9
100.0 100.0 98.8
100.0 100.0 98.8
99.6 99.3 95.3
99.6 99.3 95.9
99.9 99.6 95.5
00.9 99.2 99.5
Table 4 Power based on threshold model with γ = 0 N
Ln(1.5)
Ln(2)
%
Continuous model
Jespersen
Contal and O’Quigley
Lausen and Schumacher
Cen
Score
Wald
Like. ratio
Wald ε = 0.1
Like. ratio ε = 0.1
50
0 20 40
21.7 17.9 14.9
21.3 17.0 14.2
21.2 17.4 14.6
10.0 8.3 8.9
13.0 12.7 12.9
12.4 10.1 8.2
12.8 11.4 9.6
100
0 20 40
39.5 35.5 28.1
39.3 35.2 27.7
39.3 35.2 27.7
29.4 27.2 21.6
32.7 31.0 24.2
28.9 23.3 17.8
28.5 24.7 19.2
200
0 20 40
69.3 57.7 47.2
69.1 57.6 47.0
69.1 57.6 46.0
67.1 54.8 44.7
68.5 57.5 47.6
61.8 49.2 37.4
63.7 49.1 38.0
50
0 20 40
51.0 45.1 40.5
49.7 44.4 39.4
49.7 44.4 39.4
31.0 27.1 25.6
38.6 35.9 34.1
35.0 30.2 23.3
34.6 30.6 26.4
100
0 20 40
82.4 76.1 67.6
82.1 75.5 67.2
82.1 75.5 67.3
77.9 71.7 60.0
80.5 75.6 65.7
73.7 65.9 54.4
74.1 66.2 54.8
200
0 20 40
98. 97.3 92.3
98.5 97.0 92.2
98.5 97.0 92.2
98.8 97.6 95.0
99.0 98.1 93.6
98.1 95.9 90.2
98.1 96.1 90.4
Discretizing a continuous covariate in survival studies
37
Table 5 Power based on threshold model with γ = 0.5 N
Ln(1.5)
Ln(2)
%
Continuous model
Cen
Score
Wald
Like. ratio
50
0 20 40
14.5 14.0 11.5
14.4 13.5 10.9
14.5 13.7 11.5
100
0 20 40
27.4 21.9 18.8
27.3 21.8 18.3
200
0 20 40
49.0 39.6 29.5
50
0 20 40
100
200
Jespersen
Contal
Lausen and Schumacher
and O’Quigley
Wald ε = 0.1
Like. ratio ε = 0.1
6.5 6.9 5.6
10.1 9.3 7.8
7.9 7.6 4.7
11.5 10.1 7.4
27.3 21.7 18.7
19.8 17.0 12.3
22.5 19.9 14.4
19.0 13.2 9.3
22.2 17.7 14.0
48.7 39.4 29.3
48.8 39.6 29.3
46.3 37.6 27.6
48.2 39.6 30.2
42.2 32.7 22.4
45.9 39.2 28.0
35.6 29.9 24.9
35.1 29.4 23.9
35.0 29.4 23.9
23.3 18.3 16.7
28.4 26.0 22.0
20.8 13.7 11.5
29.8 24.9 19.9
0 20 40
61.6 53.6 45.2
61.2 53.1 44.9
61.2 53.1 44.9
57.9 49.7 39.0
61.7 53.6 43.1
4.7 45.1 32.7
60.2 52.5 42.6
0 20 40
88.9 85.2 73.2
88.7 84.9 73.1
88.7 85.2 73.0
92.3 87.6 75.0
93.1 88.6 76.9
90.8 86.1 72.5
92.5 89.5 77.0
3. Extensions of Contal and O’Quigley’s approach In this section, we presented two extensions of Contal and O’Quigley’s correction. The first, in Section 3.1, is an extension of the approach to the accelerated failure time model with single continuous covariate. This extension is based on the score statistics for that model. The second extension allows adjustments for other covariates in either the Cox model (Section 3.2) or the accelerated failure time model (Section 3.2). These extensions are based on applying the correction to residuals that are based on the adjustment for other covariates. 3.1. Accelerated failure time models with a single covariate As in the previous section we assume that we have a single continuous covariate, X. We wish to estimate a threshold model for X under a parametric accelerated failure time model. Our desired threshold model is ln(T ) = µ + β · I [X γ ] + σ E,
(3.1)
where E is a random error term, µ is the intercept, β the regression coefficient, γ the threshold parameter and σ the scale parameter. Of primary interest is estimation of γ and tests of the hypothesis that β = 0 or equivalently, P [T < t | X γ ] =
38
J.P. Klein and J.-T. Wu
P [T < t | X > γ ]. Data consists of {(Ti , δi , Xi ), i = 1, . . . , n}. We also assume that the γ Xi ’s are ordered from smallest to largest. We also let Zi = I [Xi γ ], i = 1, . . . , n. γ To construct the procedure we let L (Ti , (µ, β, σ )) be the contribution to the log likelihood, based on (3.1), for the ith observation. Let γ
Uβ ((µ, β, σ )) =
n ∂Lγ (Ti , (µ, β, σ ))
∂β
i=1
(3.2)
and let (µ0 , σ0 ) be the maximum likelihood estimates of (µ, σ ) when β = 0. We can write the score statistics as γ
γ
Uβ ((µ0 , β = 0, σ0 )) = Uβ =
n
γ
Zi ψi ,
(3.3)
i=1
where ψi is a score associated with the ith ordered X. Since our data is ordered by increasing X, if we set γ equal to the [np]th smallest X we have that γ
Uβ (p) =
[np]
ψi .
(3.4)
i=1
Using a result of Billingsley (1968) on partial sums of ergodic process one can show that the process γ
Uβ (p) S(p) = √ v n
(3.5)
converges weakly to W , a Brownian Motion process on the unit interval, when v = (E[ψi2 ])1/2 . Wu (2001) shows that for the Weibull, exponential, log logistic and log nor mal models, the ψi ’s have mean zero and v can be estimated consistently by ψi2 /n. In these cases [np] ψi . S(p) = i=1 (3.6) n 2 i=1 ψi Since ψi = 0, we have that S(p) − pS(1) = S(p) so that S(p) converges to a Brownian Bridge by Billingsley’s results and the maximum value of |S(p)| has the limiting distribution of the supremum of a Brownian Bridge so that p-value can be found using (2.12). The value of p which maximizes |S(p)| gives the estimate of γ equal to the [np]th smallest of the X’s. The weights ψ depend on the distribution of the errors, E. Wu shows that the desired weights are of the form f (z) 1 fE (z) ψ= (3.7) −δ E (1 − δ) , σ0 SE (z) fE( (z) where SE (z) and fE (z) are the survival function and density function of the error distribution and z = [ln(T ) − µ0 ]/σ0 . The values of ψ can be computed for a number of
Discretizing a continuous covariate in survival studies
39
special cases. The values are ψ = T exp[−µ0 ] − δ
(3.8)
for the exponential distribution with an extreme value error distribution SE (x) = exp(x − ex ) and σ = 1; 1 ln(T ) − µ0 ψ= (3.9) exp −δ σ0 σ0 for the Weibull distribution with also the extreme value distribution for E; 0 −δ exp ln(Tσ)−µ 1 0 ψ= 0 σ0 1 + exp ln(Tσ)−µ 0
(3.10)
for the log logistic which has a logistic error distribution with SE (x) = (1 + ex )−1 ; and 2 0) (1 − δ) exp − (ln(T )−µ ln(T ) − µ0 1 2σ02 ψ= (3.11) √ ln(T )−µ0 + δ σ0 σ0 2π 1 − Φ σ0
for the log normal regression with a normal distribution for E. Table 6 shows the results of fitting the exponential, Weibull, log logistic and log normal accelerated failure time models to the bone marrow transplant data. In the table we see that there is a marginal effect of age on outcome when age is treated continuously. All four models show that in the threshold model that age has no effect on outcome. All methods give the same threshold estimate of 41.2 years of age. Note that had we not made the adjustment for multiple testing, all four error distributions would have had highly significant age effects at 41.2 years. Table 6 Estimates and tests based on the accelerated failure time model Model
Threshold
Estimate of β (SE)
p-value
Exponential
Continuous
< 0.0001
Weibull
Continuous
Log normal
Continuous
Log logistic
Continuous
Exponential
41.20
Weibull
41.20
Log normal
41.20
Log logistic
41.20
−0.0113 (0.0022) −0.0090 (0.0046) 0.0093 (0.0046) −0.0089 (0.0047) 0.3124 (0.0735) 0.4148 (0.1427) 0.4267 (0.1475) 0.4634 (0.1499)
0.0489 0.0440 0.0658 0.2974 0.2646 0.1463 0.1519
40
J.P. Klein and J.-T. Wu
3.2. Adjustment for other covariates In many instances we wish to fit a threshold model after adjustment for other fixed time covariates, Z, which may affect outcome. We are also interested in testing the hypothesis P [T t | X γ , Z] = P [T t | X > γ , Z] for all t. We assume either a Cox regression model with h(t | X, Z) = h0 (t) exp β ∗ Z + βI [X γ ] (3.12) or an accelerated failure time model with ln(T ) = µ + β ∗ Z + βI [X γ ] + σ E.
(3.13)
One way of estimating γ and β is to first estimate the regression coefficient, β ∗ , by b∗ in a model without X. We then compute an appropriate residual, Ri , for the ith observation. Under models (3.12) or (3.13) these residuals will have either an exact or a limiting distribution of an accelerated failure time model. Using these residuals we can then use the results of Section 3.1 to make inference about X in the threshold model. When the Cox model (3.12) is in use, we compute Ri as the Cox and Snell (1968) residual. The residual is defined by 0 (Ti ) exp b∗ Zi , Ri = H (3.14) where 0 (t) = H
Tj t
dN• (Tj ) . ∗ Y k=1 k (Tj ) exp{b Zk }
n
(3.15)
It is well known (cf. Klein and Moeschberger (2003)) that these residuals behave like a censored sample from a unit exponential. Using this fact, we can apply the results of Section 3.1 with ψi = Ri − δi . For the accelerated failure time model (3.13) with error distribution E we define the residual by 1 Ri = (3.16) ln[Ti ] − µˆ − b∗ Zi , i = 1, . . . , n, σˆ where all parameters are estimated under a model without X. If the error distribution is selected properly then the Ri ’s are a sample from a standardized version of the error distribution with µ = 0 and σ = 1. The scores are then fE (Ri ) fE (Ri ) ψi = (1 − δi ) (3.17) − δi , SE (Ri ) fE (Ri ) and the results of the previous section apply. We illustrate this procedure in Table 7. Here all inference for the effect of age on treatment failure in the BMT example is adjusted for the patient’s disease state at transplant (early, intermediate or advanced) and the type of donor they had for the transplant. The results show, after adjustment for these factors, that there is a strong effect of age on outcome when age is treated continuously. In the threshold model the age remains
Discretizing a continuous covariate in survival studies
41
Table 7 Estimates and tests for age effect adjusted for disease stage and type of donor Method
Threshold
Estimate of β (SE)
p-value
Cox
Continuous
< 0.0001
Exponential
Continuous
Weibull
Continuous
Log logistic
Continuous
Log normal
Continuous
0.0111 (0.0025) −0.0145 (0.0025) −0.0199 (0.0043) −0.0195 (0.0043) −0.0205 (0.0043) −0.2457 (0.0625) 0.4054 (0.0729) 0.4433 (0.1083) 0.5108 (0.1128) 0.5536 (0.1124)
Cox
33.9
Exponential
20.7
Weibull
33.8
Log logistic
35.6
Log normal
35.6
< 0.0001 < 0.0001
< 0.0001 0.0016 0.0066 0.0033 0.0004 < 0.0001
significantly associated with outcome after the adjustments for multiple testing. The various models disagree on where the cut-point should be with possible values ranging from 20.7 years for the exponential distribution to 35.6 years for either the log normal or log logistic models. All of these adjustments can be programmed quite easily using standard statistical software that computes a residual from the fitted regression models.
4. Discussion We have presented the current state of the art in data driven methods for discretizing a continuous covariate. We have looked at methods for a single cut-point but these could easily be extended to more than two groups. Our Monte Carlo study shown in Section 2 and found in more detail in Wu (2001) shows that the method suggested by Contal and O’Quigley performs quite well. This method is also easy to program using standard statistical packages and, as seen in Section 3, can be extended to solve other problems. While these methods are useful when the cut-point is unknown, in many cases the best cut-point should be based on the subject matter under consideration. For example, in the bone marrow example the biology of the transplant may suggest a cut-point that reflects the difference between pediatric and adult patients. Whatever the cut-point is, it is important that the cut-point makes plausible biological sense.
42
J.P. Klein and J.-T. Wu
Acknowledgements This research was supported by grant R01-CA54706-09 from the National Cancer Institute.
References Billingsley, P. (1968). Convergence of Probability Measures. Wiley, New York. Contal, C., O’Quigley, J. (1999). An application of changepoint methods in studying the effect of age on survival in breast cancer. Comput. Statist. Data Anal. 30, 253–270. Cox, D.R. (1972). Regression models and life-tables (with discussion). J. Roy. Statist. Soc. B 34, 187–220. Cox, D.R., Snell, E.J. (1968). General definition of residuals (with discussion). J. Roy. Statist. Soc. B 30, 248–275. Jespersen, N.C.B. (1986). Dichotomizing a continuous covariate in the Cox regression model. Statist. Res. Unit Univ. Copenhagen Res. Report 86 (2). Klein, J.P., Moeschberger, M.L. (2003). Survival Analysis: Techniques for Censored and Truncated Data, 2nd edn. Springer, New York. Lausen, B., Schumacher, M. (1996). Evaluating the effect of optimized cutoff values in the assessment of prognostic factors. Comput. Statist. Data Anal. 21, 307–326. Lausen, B., Schumacher, M. (1992). Maximally selected rank statistics. Biometrics 48, 73–85. Miller, R., Siegmund, D. (1982). Maximally selected chi-square statistics. Biometrics 38, 1011–1016. Schulgen, G., Lausen, B., Olsen, J.H., Schumacher, M. (1994). Outcome oriented cutpoints in analysis of quantitative exposures. Amer. J. Epidemiology 140, 172–184. Szydlo, R., Goldman, J.M., Klein, J.P., Gale, R.P., Ash, R.C., Bach, F.H., Bradley, B.A., Casper, J.T., Flomenberg, N., Gajewski, J.L., Gluckman, E., Henslee-Downey, P.J., Hows, J.M., Jacobsen, N., Kolb, H.J., Lowenberg, B., Masaoka, T., Rowlings, P.A., Sondel, P.M., van Bekkum, D.W., van Rood, J.J., Vowels, M.R., Zhang, M., Horowitz, M.M. (1997). Results of allogeneic bone marrow transplants for leukemia using donors other than HLA-identical siblings. J. Clinical Oncology 15(5), 1767–1777. Themeau, T.M., Grambsh, P.M., Fleming, T.R. (1990). Martingale-based residuals for survival models. Biometrika 77, 147–160. Wu, J.-T., (2001). Statistical methods for discretizing a continuous covariate in a censored data regression model. Ph.D. Thesis. Division of Biostatistics, Medical College of Wisconsin.
3
Handbook of Statistics, Vol. 23 ISSN: 0169-7161 © 2004 Elsevier B.V. All rights reserved. DOI 10.1016/S0169-7161(03)23003-0
On Comparison of Two Classification Methods with Survival Endpoints
Ying Lu, Hua Jin and Jie Mi
1. Introduction Methods of prognostic prediction and classification, such as staging systems for diseases, are commonly used to assist decision making in clinical management (Stitt et al., 1991; Lu and Stitt, 1994; Sevin et al., 1996; Zhang and Singer, 1999; Esserman et al., 1999; Therasse et al., 2000; Kashani-Sabet et al., 2001; Reynolds, 2002). These staging or classification systems create a finite number of exclusive and exhaustive groups based on known prognostic factors. A successful system will maximize between-group survival differences. Without loss of generality, we assume the classification severity is an ordinal variable corresponding to disease severity, such that group 1 has longer mean survival time than group 2, and so on. These systems have been used to design treatment strategies in patient management. Often, there are several prognostic classification methods for the same disease and patient population that may depend on different prognostic factors or the same prognostic factors but different thresholds. Comparison of the method’s efficiency in separating patients according to survival profiles is necessary. When comparing two classification rules, the common approach utilizes the Cox regression model with both classification methods as ordinal variables (Kashani-Sabet et al., 2001). One may assume that the first method contains all information of the second if the type-3 p-value for the second method is above a pre-specified significance level but the same p-value for the first method is below that level. On the other hand, if both methods are significant in the presence of the other, they are considered to be complimentary. If none of their type-3 p-values reaches the significance level, no conclusion can be derived. Such an approach does not answer the question imposed whether one method is preferred over another and fails to provide an objective index about their separation efficiency. Furthermore, while it may be possible to test whether one classification method provides additional information over another one, it cannot determine whether one classification method is equivalent or non-inferior to another method (Lewis, 1999). The goal of this paper is to develop a statistical procedure for comparing the efficiency of two classification methods. In Section 2, we define an index to measure the classification efficiency based on mean survival times and discuss its mathematical 43
44
Y. Lu, H. Jin and J. Mi
properties. In Section 3, we give an estimation procedure based on restricted mean lifetime and inference procedures to test for two types of hypotheses. In Section 4, we use simulation to evaluate the distribution properties of the proposed test statistics under finite sample size. In Section 5, we demonstrate our testing procedures in two medical applications. In the last section, we provide comments and conclusion.
2. Degree of separation index Let T be the random variable of survival time of a population and its survivor function as S(t) = P (T > t). Suppose a classification method G separates patients into g exclusive and exhaustive groups. Let J be the random variable of the classification assignment of a randomly selected subject from the population; pj = P (J = j ), j = 1, 2, . . . , g, be the corresponding probability of being in the j th group; ∞ and Sj (t) = P (T > t | J = j ) be the corresponding survivor function and mj = 0 Sj (t) dt be the corresponding mean surg vival time. To be exclusive and exhaustive, j =1 pj = 1. We denote such a classifica, p), with m = (m1 , . . . , mg ) and p = (p1 , . . . , pg ) being two g-dimensional tion as G(m ∼ ∼ ∼ ∼ vectors. It is easy to see that S(t) =
P (T t, G = j )
j
=
P (T t | G = j )P (G = j ) =
j
Sj (t)pj
(1)
j
and
∞
m=
S(t) dt =
0
=
0
j
∞
∞ 0
Sj (t)pj dt
j
Sj (t) dt pj =
mj pj .
(2)
j
An efficient classification should maximize between-group differences in survival times, which can be measured by the between-group variance of mean survival times. The larger the between-group variance in mean survival times, the larger the difference in mean survival times between prognostic groups. Here, we introduce our definition of degree of separation (DOS).
On comparison of two classification methods with survival endpoints
45
D EFINITION 1. For a classification rule G(m, p), a measurement of degree of separa∼ ∼ tion is defined as the variance of mj , i.e., 2 ∞
2 Sj (t) − S(t) dt pj , , p) = (mj − m) pj = DOS(m (3) ∼ ∼
j
j
0
where m is the overall mean survival time defined in (2). Intuitively, mj − m is the area between the j th group and the overall survival curves. To facilitate our discussion on the properties of DOS, we introduce a discrete random , p). It is variable ξ defined by P (ξ = mi ) = pi , 1 i g and denote this as ξ ∼ (m ∼ ∼ easy to see that DOS(m , p ) = var(ξ ). ∼ ∼ In the rest of this section, we will give some sufficient conditions under which we can compare the variances of two discrete random variables and consequently compare DOSs associated with different classification methods. Let ξ ∼ (a , p), η ∼ (c , q) be two discrete random variables where a ∈ R k , c ∈ R l , ∼ ∼ ∼ ∼ ∼ ∼ p ∈ (0, 1)k , q ∈ (0, 1)l and ki=1 pi = lj =1 qj = 1. Define d = (d1 , . . . , dl ) by di = ∼ ∼ ∼ ci + E(ξ ) − E(η), 1 i l and assume η∗ ∼ (d, q). Then ∼ ∼
l l ci + E(ξ ) − E(η) qi = E(ξ ). di qi = E η∗ = i=1
i=1
This implies that 2
2
2 DOS(c , q) = var(η) = var η∗ = E η∗ − Eη∗ = E η∗ − (Eξ )2 ∼ ∼
and thus, 2
, q) = E ξ 2 − E η∗ . DOS(a∼, p) − DOS(c ∼ ∼
∼
We can assume that ξ is a positive random variable because otherwise we can consider |ξ |. We further define ∼ e = (e1 , . . . , el ) = (|d1 |, . . . , |dl |) and ζ = |η∗ | ∼ (e∼, q). ∼
st
st
P ROPOSITION 1. If ξ ζ , then DOS(a , p) DOS(c , q), where is the usual stochas∼ ∼ ∼ ∼ tic ordering. P ROOF. Evidently E(ζ 2 ) = E((η∗ )2 ) and DOS(a∼, p) − DOS(c , q) = E(ξ 2 ) − E(ζ 2 ). ∼ ∼ st
∼
Therefore DOS(a∼, p) − DOS(c , q) 0 since 0 ξ ζ implies E(ξ 2 ) E(ζ 2 ). ∼ ∼ ∼ Now consider the case when both ξ and η have the same probability distribution vector p. Namely, we assume ξ ∼ (a , p) and η ∼ (c , p). Once again, we define the ∼ ∼ ∼ ∼ ∼ random variable ζ as in the above. To study this case, we need partial ordering b as defined by Sobel (1954), Savage (1957) and Lehman (1966). For more details we refer to Marshall and Olkin (1979). To be self-contained, the definition of b is given as follows.
46
Y. Lu, H. Jin and J. Mi
D EFINITION 2. Let µ, ν be two vectors of dimension k, with one obtained by a permu∼ ∼ tation from the other. The vector µ is said to immediately precede ν , denoted as µ
νi = µj , and µn = νn , ∀n = i, j . D EFINITION 3. We say that µ b ν if µ = ν , or if there exists a finite chain λ1 , . . . , λn ∼ ∼ ∼ ∼ ∼ ∼ such that µ
∼
∼
∼
∼
That is, ν can be obtained from µ by successive interchanges, each of which corrects an ∼ ∼ inversion of the natural order. We need also the relative-arrangement partial order a . x, y , ∼ u, ∼ ν be four vectors where ∼ x and ∼ u have the same dimenD EFINITION 4. Let ∼ ∼ ν have the same dimension l. We say that (x , y ) a (u , ν ) if ∼ u is a sion k, and y and ∼ ∼ ∼ ∼ ∼ ∼ permutation of x , ν is a permutation of y , and if there exist permutations π1 and π2 ∼ ∼
∼
such that π1 x = x∗ , π2 u = u∗ = x∗ and π1 y b π2 ν where x∗ = (x1∗ , . . . , xk∗ ) satisfies ∼ ∼ ∼ ∼ ∼ ∼ ∼ ∼ x1∗ · · · xk∗ . Let ξ ∼ (a , p) and η ∼ (c , p). We define e and ζ ∼ (e , p) as before. ∼ ∼
∼ ∼
∼
∼ ∼
P ROPOSITION 2. If (p, a ) a (p, e ), then DOS(a , p) DOS(c , p). ∼ ∼
∼ ∼
∼ ∼
∼ ∼
P ROOF. Without loss of generality, we can assume that p = p∗ , i.e., p1 · · · pk . ∼
∼
Hence from (p, a∼) a (p, ∼ e ), we have a∼ b ∼ e. ∼ ∼ e . Suppose that 1 i < j k such that ei < ej , First we show the result when a∼
ei = aj and an = en , ∀n = i, j . Then
Eξ 2 − Eη2 = ai2 pi + aj2 pj − ei2 pi + ej2 pj
= ej2 pi + ei2 pj − ei2 pi − ej2 pj = ej2 − ei2 (pi − pj ) 0 since ej ei 0 and pi pj . e , then there is a finite chain ∼d1 , . . . , ∼dn such that Now, if a∼ b ∼ a
∼
From this chain we have a chain of inequalities DOS(a , p) DOS(d1 , p) · · · DOS(dn , p) DOS(e , p) ∼ ∼
∼
and the desired result follows.
∼
∼
∼
∼ ∼
Below we study the comparison of DOS when one separation can be obtained from the other, either from further separations or by combining some groups into one.
On comparison of two classification methods with survival endpoints
47
D EFINITION 5. Let G and H be two classification methods and DOS(a , p), DOS(c , q) ∼ ∼
∼ ∼ f1
be the associated degree of separation. We say that H is finer than G, denoted as G < H , if there is an index i such that a = (a1 , . . . , ai−1 , ai , ai+1 , . . . , ak ) ∈ R k ,
∼
p = (p1 , . . . , pi−1 , pi , pi+1 , . . . , pk ) ∈ (0, 1)k ,
∼
c = (a1 , . . . , ai−1 , ai1 , . . . , ail , ai+1 , . . . , ak ) ∈ R k+l−1 ,
∼
q = (p1 , . . . , pi−1 , pi1 , . . . , pil , pi+1 , . . . , pk ) ∈ (0, 1)k+l−1
∼
satisfying l
pin = pi
l
and
n=1
ain pin = ai pi .
(4)
n=1
R EMARK . The modification of Definition 5 in the case of i = 1 or k is obvious. , q) D EFINITION 6. Let G and H be two classification methods and DOS(a∼, p), DOS(c ∼ ∼ ∼ be the associated degrees of separation. We say that H is finer than G of order j , denoted fj
f1
f1
f1
as G < H , if there exists a chain of separation K1 , . . . , Kj −1 such that G < K1 < · · · < f1
Kj −1 < H . fj
P ROPOSITION 3. Suppose that G < H for an integer j 1. Then DOS(G) DOS(H ). f1
P ROOF. Without loss of generality we can assume G < H . Let DOS(G) = DOS(a∼, p), ∼ DOS(H ) = DOS(c , q) and ξ ∼ (a∼, p), η ∼ (c , q). We have ∼ ∼ ∼
E(η) =
j =i
∼
aj pj +
l n=1
ain pin =
∼
aj pj + ai pi = E(ξ ),
j =i
by (4). Thus DOS(a , p) − DOS(c , q) = Eξ 2 − Eη2 = ai2 pi − ∼ ∼
∼ ∼
l
2 ain pin .
n=1
Note using the Lagrange multiplier l method, we can see that the minimum value of l that 2 xn pin = ai pi is achieved when x1 = · · · = xl = n=1 xn pin subject to constraint n=1 2 p 0 and consequently the desired ai , and equals to ai2 pi . Hence, ai2 pi − ln=1 ain in result follows. R EMARK . Proposition 3 suggests that the thinner the separation is, the better the degree of separation. This is true in general. However, in practical applications, because the classification rule was developed based on a limited number of observations, a very
48
Y. Lu, H. Jin and J. Mi
thin classification will result in errors when applied to new data. This is similar to percentage of variations explained by a linear regression model and the number of variables in the model. 3. Estimation and inference procedures and p based on data To estimate DOS in Definition 1, we must estimate the vectors m ∼ ∼ from prospective cohort studies. Estimation of vector p is relatively straightforward. ∼ Suppose that there are ni patients in group i, the maximum likelihood estimates of pi is pˆi = ni /n, (5) where n = i ni , the total number of patients in the study. Estimation of mean survival time m is relatively complicated and may even be infea∼ sible because of the presence of censoring (Susarla and Van Ryzin, 1980; Gill, 1983; Zheng, 1995). An alternative to the overall mean survival time is the restricted mean life to a suitably chosen finite time L (Irwin, 1949; Elveback, 1958; Kaplan and Meier, 1958; Karrison, 1987; Zucker, 1998; Chen and Tsiatis, 2001), which can be defined as L mi (L) = (6) Si (t) dt 0
for group i for i = 1, 2, . . . , g, and the restricted mean lifetime of the population can also be expressed as L L m(L) = S(t) dt = Si (t)pi dt 0
=
0
L
Si (t) dt pi =
0
i
i
mi (L)pi .
i
Under this restriction, the index to measure the degree of the separation becomes 2 DOS m(L), p = mi (L) − m(L) pi . ∼
∼
(7)
(8)
i
Note that Eq. (7) is similar to that of (3). Furthermore, all previous properties discussed in Propositions 1–3 still hold. In the following sections, we skip L in our notation for DOS. The choice of the length of time L is critical in evaluation of the restricted mean lifetime. One approach is the use of the “effective sample size” (Kaplan and Meier, 1958). Let Ci (t) denote the survivor function for the independent and identically distributed censoring random variables in the group i and Ci− (t) be the left continuous version of Ci (t). The largest possible observation time for the group i is τi = sup[t: min{Si (t), Ci (t)} > 0]. Then τ = mini (τi ) is the theoretically largest pos i (t) are the Kaplan– sible observation time for all classification groups. If Si (t) and C Meier estimators of the corresponding survivor functions, then the largest actual ob i (t)} > 0]. Thus, served follow-up time for the group i is Ti = sup[t: min{ Si (t), C LAO = min(Ti ) i
(9)
On comparison of two classification methods with survival endpoints
49
is the largest actual follow-up time for all classification groups, which is a random variable and the best estimator for τ . For any given L in (0, LAO], we can derive an estimate of the restricted mean lifetime L
Si (t) dt. m ˆi = (10) 0
In fact, it follows from Gill (1983) and Pepe and Fleming (1991) that
d
√ ˆ i − mi → N 0, σi2 when ni → ∞ and ni m 2 L L Si2 (t)Ci− (t) dSi (t) < ∞ σi2 = − Si (u) du
(11)
t
0
and its consistent estimator of σˆ i2 is found by substituting the Kaplan–Meier estimators for Si and Ci− in (11). An estimator of DOS, thus is
2 = m ˆi −m DOS (12) ˆ pˆ i . i
The variance of estimator (12) can be derived by a δ-method. Because ∂DOS = mi (mi − 2m), ∂pi and
∂DOS = 2pi (mi − m), ∂mi
∂DOS 2 ∂DOS 2
= Var DOS Var pˆ i + Var m ˆi ∂pi ∂mi i
+
∂DOS ∂DOS i =j
∂pi
∂pj
i
Cov pˆ i , pˆj ,
by we can estimate Var(DOS)
2 pˆ i (1 − pˆ i ) 2
2 2 + ˆ i − 2m ˆi −m = m ˆ 2i m ˆ 4pˆ i m ˆ σˆ i2 σˆ DOS n i
−
i
i =j
pˆi pˆ j ˆ i − 2m m ˆ im ˆj m ˆ m ˆ j − 2m ˆ n
(13)
− DOS)/σˆ DOS → N(0, 1) for n → ∞. with m ˆ = im ˆ i pˆi . We expect (DOS In most clinical applications, different classification methods are developed from different studies. Comparison of their efficiency can be based on their performance in different studies as long as the patient inclusion criteria of these studies are the same. However, the most appropriate comparison of two classification methods should use the same patient samples. Thus, we focus our inference procedures on comparing the DOSs of two classification rules based on paired observations. Let G1 and G2 be two classification methods resulting in g1 and g2 groups respectively, where g1 , g2 2. We apply both methods to a prospective cohort and follow
50
Y. Lu, H. Jin and J. Mi
Table 1 Layout for the joint split of G1 and G2 G2 = 1
G2 = 2
...
G2 = g2
Total
G1 = 1
n11 (p11, m11 )
n12 (p12 , m12 )
...
n1g2 (p1g2 , m1g2 )
n1+ (p1+ , m1+ )
G1 = 2
n21 (p21 , m21 ) ...
n22 (p22 , m22 ) ...
...
n2g2 (p2g2 , m2g2 ) ...
n2+ (p2+ , m2+ ) ...
G1 = g1
ng1 1 (pg1 1 , mg1 1 )
ng1 2 (pg1 2 , mg1 2 )
...
ng1 g2 (pg1 g2 , mg1 g2 )
ng1 + (pg1 + , mg1 + )
Total
n+1 (p+1 , m+1 )
n+2 (p+2 , m+2 )
...
n+g2 (p+g2 , m+g2 )
n (1, m)
...
...
An (i, j ) cell in Table 1 represents the result of G1 = i and G2 = j and nij subjects having this classification (for i = 1, 2, . . . , g1 and j = 1, 2, . . . , g2 ). Parameters pij and mij are the model parameters corresponding to the probability of being in this cell and the restricted mean lifetime for this group. A “+” sign is used to denote summation over the corresponding subscript.
these patients for a period of time. Observations from such a study are summarized in Table 1. An (i, j ) cell in Table 1 represents a result in which G1 = i and G2 = j and nij subjects have this classification (for i = 1, 2, . . . , g1 and j = 1, 2, . . . , g2 ). Parameters pij and mij are the model parameters corresponding to the probability of being in this cell and the restricted mean lifetime for this group. A “+” sign is used to denote summation over the corresponding subscript. In fact, we have mij pij j mij pij , m+j = i and mi+ = pi+ p+j mi+ pi+ = m+j p+j = mij pij . m= i
j
i
j
Here we may use (G1 , G2 ) = {(mij , pij ), i = 1, 2, . . . , g1 ; j = 1, 2, . . . , g2 } to denote the joint separation (G1 , G2 ). Under this framework, the degree of separation for G1 and G2 are ,p ) = (mi+ − m)2 pi+ and DOS1 = DOS(m ∼•+ •+ ∼
i
DOS2 = DOS(m+• , p+• ) = ∼
∼
(m+j − m)2 p+j ,
j
respectively. The most common inference problem is to determine whether two classifications have the same degree of separation, i.e., H0 : DOS1 = DOS2
versus H1 : DOS1 = DOS2 .
(14)
Alternatively we may be interested in a one-sided inference that replaces the equality in the null hypothesis with an inequality in the direction desired.
On comparison of two classification methods with survival endpoints
51
A different class inference problem is the equivalence or non-inferiority test (Lewis, 1999; Liu et al., 2002). For example, to determine if G2 is not worse than G1 within an acceptable level (non-inferiority), we can construct a one-sided null hypothesis for non-inferiority: H0 : DOS2 /DOS1 c0
versus H1 : DOS2 /DOS1 > c0
(15)
where 0 < c0 1 is the pre-specified constant corresponding to the acceptable limit of equivalence. This null hypothesis assumes that G1 has a larger DOS than G2 , but G2 has other advantages, such as low cost, that make it preferable as long as its loss in efficiency is still tolerable. Reorganizing hypothesis (15) as H0 : T = c0 DOS1 − DOS2 0
versus
H1 : T = c0 DOS1 − DOS2 < 0
(16)
we have a one-sided hypothesis testing problem. When c0 = 1, hypothesis (16) is a one-sided hypothesis testing for (14). Unrestricted maximum likelihood estimates of {pij } are pˆ ij = nij /n, pˆi+ = ni+ /n, and pˆ+j = n+j /n. Here we need only focus on estimation of the restricted mean lifetime mij for the subgroup with pij > 0. By replacing subscript i with ij for definitions of Ti in Eq. (9), the new LAO = min{Tij : pˆ ij > 0}, as an estimator of τ . Similarly, we can replace subscript i with ij in Eqs. (10) and (11) to estimate the restricted mean survival time and its variance for cell (i, j ) with pij > 0. A test statistic
2
2 1 − DOS 2 = c0 T = c0 DOS m ˆ i+ − m m ˆ +j − m ˆ pˆi+ − ˆ pˆ+j (17) i
j
is constructed for hypotheses (16) under a one-sided test or (14) in a two-sided test with c0 = 1. Here, ˆ ij pˆ ij ˆ ij pˆ ij j : pˆ ij >0 m i: pˆ ij >0 m , m ˆ +j = and m ˆ i+ = pˆ i+ pˆ +j m ˆ= m ˆ ij pˆij . ij : pˆ ij >0
Alternatively, m ˆ i+ , m ˆ +j , and m ˆ can be estimated by the pooled marginal and overall survival curves. They will be slightly different from the average in proportion, but will have only a slight impact on numerical results. Again, based on the δ-method, the asymptotic variance of T is ∂T 2 ∂T 2
var T = var m var p ij + ij ∂mij ∂pij i,j
+
i,j
(i1 ,j1 ) =(i2 ,j2 )
∂T ∂T cov p i1 j1 , p i2 j2 ∂pi1 j1 ∂pi2 j2
(18)
52
Y. Lu, H. Jin and J. Mi
with
∂T = 2pij c0 mi+ − m+j + (1 − c0 )m , ∂mij ∂T = c0 mi+ (2mij − mi+ ) − m+j (2mij − m+j ) + 2(1 − c0 )mmij , ∂pij pij (1 − pij ) var p , ij = n
pi1 j1 pi2 j2 cov p , i1 j1 , p i2 j2 = − n
and
Var m ˆ ij = σij2 that is similar to Eq. (11) except for replacing subscript i with ij . We expect T → N(0, 1) for n → ∞ Z=
var T when c0 DOS1 − DOS2 = 0. We will reject the null hypothesis in inference setting (14) if |Z| > z1−α/2 for c0 = 1. The corresponding asymptotic type I error is P (|Z| > z1−α/2 |DOS1 = DOS2 ) = α. Here z1−α is the 1 − α percentile for the standard normal distribution. For non-inferiority testing (16), we will reject the null hypothesis when Z < −z1−α . The corresponding asymptotic type I error is sup P (|Z| > z1−α/2 |c0 DOS1 DOS2 ) α. The type I error achieves the significant level α only when the equality in the null hypothesis is true.
4. Distribution property of test statistics under the null hypothesis While the δ-method assures that Z approximates the standard normal distribution under the null hypothesis, the distribution property of Z with a finite sample size is unknown. In this section, we use simulation methods to examine the distribution property under a finite sample size. Our simulation experiments were based on random variables generated from exponential distributions. In our experiments, we assumed that two classification methods G1 and G2 separated subjects into 3 prognostic groups and, consequently, 9 subgroups according to their joint distribution in Table 1. We further assumed that the probability of a patient being classified into any one of the 9 cells was 1/9. Time to death in each of the 9 cells followed exponential distributions with their expectations given in Table 2. Censoring time was exponentially distributed with mean censoring time of 25 and independent of classification results and survival times. The ratios of the two DOS indices with the restricted mean lifetime for L = 25 were respectively 1, 0.85 and 0.70 in the three examples. Alternative hypotheses were two-sided for the experiment 1 (c0 = 1) and one-sided for the other two experiments (c0 = 0.85 and 0.70, respectively).
On comparison of two classification methods with survival endpoints
53
Table 2 Mean survival times (mij ) in three simulation experiments Classification result of G2
Experimental conditions
Classification
for L = 25
result of G1
1
2
3
EXP 1 DOS1 − DOS2 = 0
1 2 3
100 50 25
50 25 10
25 10 5
EXP 2 0.85DOS1 − DOS2 = 0
1 2 3
95 50 25
50 25 10
30 10 5
EXP 2 0.70DOS1 − DOS2 = 0
1 2 3
90 50 24
50 25 10
35 10 6
The survival time in each classification combination followed an exponential distribution with mean survival time specified in the corresponding cell. Censoring time also followed an exponential distribution with mean censoring time of 25. Censoring time was independent of classifications and their corresponding survival times. Proportion of subjects to be classified into any of the nine cells (pij ) was 1/9. Table 3 Percentages rejecting the null hypothesis in 500 trials when the null hypothesis of equality was true and significance level was 5% EXP
1 2 3
True data structure
DOS1 = DOS2 0.85DOS1 − DOS2 = 0 0.70DOS1 − DOS2 = 0
Null hypothesis H0
DOS1 = DOS2 0.85DOS1 − DOS2 0 0.70DOS1 − DOS2 0
Sample sizes 800
1 800
2 700
4.2% 6.4% 5.4%
5.6% 6.4% 5.6%
5.0% 4.8% 4.4%
The first simulation experiment tested for equality of two DOSs and the rejection rate was based on a twosided test. Experiments 2 and 3 tested for non-inferiority and the rejection rates were based on a one-sided test.
For each selected sample size n and experimental conditions, we repeatedly generated simulated data 500 times. Table 3 summarizes the percentage rejecting the null hypothesis according to normal approximation at a significance level of 5% when the null hypothesis was true. The 95% binomial confidence interval for a 5% rejection rate in 500 repetitions ranges from 3.09% to 6.91%. All type I errors in Table 3 were within this confidence range. Figure 1 shows Q–Q plots of test statistics Z in three experimental conditions for sample sizes 800 and 2 700, respectively. The figure shows a reasonable approximation to the standard normal distributions under given sample sizes. The null hypothesis in (16) is a composite hypothesis and asymptotic normality only holds when c0 DOS1 = DOS2 . To verify that the overall type I error rate does not exceed pre-specified significant level, we performed additional simulation studies based on data generated under the experimental condition 3 in Table 2. The true relationship
54
Y. Lu, H. Jin and J. Mi
Fig. 1. Q–Q plots for Z-statistics derived in three simulation experiments when the null hypothesis of equality was true. The columns from left to right of this plot were for data generated under experimental conditions 1 to 3 in Table 2 and null hypotheses specified in rows of Table 3. The top row Q–Q plots were for sample size 800 in each trial and the bottom row were those of sample size 2 700.
Table 4 Percentages rejecting the null hypothesis in 500 trials when the null hypothesis of inequality was true and significance level was 5% EXP
3 3 3
True data structure
0.70DOS1 − DOS2 = 0 0.70DOS1 − DOS2 = 0 0.70DOS1 − DOS2 = 0
Null hypothesis H0
0.80DOS1 − DOS2 0 0.90DOS1 − DOS2 0 0.95DOS1 − DOS2 0
Sample sizes 800
1 800
2 700
1.6% 1.0% 0.8%
1.2% 0.4% 0.0%
0.6% 0.2% 0.0%
Data was generated under the experimental condition 3 in Table 2. Tests were for non-inferiority and the rejection rates were based on a one-sided test.
between two classification methods was that 0.7DOS1 = DOS2 . Thus, for c0 = 0.8, 0.9, and 0.95, the null hypothesis H0 : c0 DOS1 − DOS2 > 0 was true. Table 4 presented the percentages of rejecting H0 at a 5% significant level. The type I error rates were all below 2% and decreased as c0 increased. Figure 2 showed the corresponding Q–Q plots for the test statistics Z for sample sizes 800 and 2 700. While the test statistics Z no longer followed the standard normal distribution, they still approximately followed normal distributions.
On comparison of two classification methods with survival endpoints
55
Fig. 2. Q–Q plots for Z-statistics derived in three simulation experiments when the null hypothesis of inequality was true. The columns from left to right of this plot were for null hypotheses for c0 = 0.8, 0.9, and 0.95, respectively, in Table 4 when data were generated from experimental condition 3 in Table 2. The top row Q–Q plots were for sample size 800 in each trial and the bottom row were those of sample size 2 700.
5. Application examples In this section, we give two examples of applying DOS in medical research. E XAMPLE 1. Lu et al. (2003) used the tree structured survival analysis (TSSA) method (Segal, 1988) to classify post-menopausal women into 4 different subgroups with distinct distributions of time to hip fracture after their bone mineral density (BMD) measurement. The classification was derived from prospective cohort data of 7 665 women enrolled in the Study of Osteoporotic Fractures (SOF) (Cummings et al., 1993; Cummings et al., 1995). All of these women had forearm, calcaneal, hip and spine bone mineral density (BMD) measurements. Time to hip fracture after BMD measurement was also recorded for these women and was treated as the outcome variable. A random sample consisting of 75% (training data set) of women from the 7 665 available was used to generate 4 prognostic subgroups while the other 25% (validation data set) was used to validate the results. Two classification rules were developed for the TSSA analyses. The first tree analysis used risk factors of age and BMD of hip and calcaneus and was referred to as Model 1 in the paper. The second tree analysis replaced calcaneal BMD with age and was referred to as Model 2. Model 1 was the optimum classification according to the TSSA method. Model 2, however, replaced calcaneal BMD by age to avoid additional BMD
56
Y. Lu, H. Jin and J. Mi
Table 5 The restricted time L, the acceptable limit for non-inferiority c0 , and the corresponding p-value for Example 1 Data
L
c0
p-value
Generation data
1825 2000 2350∗
0.65 0.70 0.75
0.032 0.037 0.040
Validation Data
1825 2000 2287∗
0.49 0.50 0.55
0.050 0.042 0.045
examination. If DOS of Model 2 has an acceptable difference from that of Model 1, Model 2 would be a preferred non-inferior alternative to Model 1 for economic reasons. Using the testing procedures proposed in Section 3, we selected a suitable restricted time L to be 1825 days (5 years) and 2000 days. The observed LAO of the generation and the validation data were 2350 and 2287 days respectively. For a given L, we also selected c0 for which we had a one-sided p-value below 5%. These results were summarized in Table 5. This table suggests that the acceptable level c0 increased with L under the same significant level. The longer the restricted time L, the more stringent thresholds we can place on non-inferiority. Thus, the observed LAO can be a reasonable choice of the restricted time in this case. E XAMPLE 2. Sevin et al. (1996) proposed a new staging system for early cervical carcinomas also based on the tree structured survival analysis method (TSSA) based on 301 patients (Segal and Bloch, 1989). They further compared their staging system with another system proposed by Kamura et al. (1993). Both methods classified patients into three different prognostic groups based on disease free survival time for the same patient population. We used this example to illustrate our proposed test for superiority. We selected a restricted time L of 60 months (5 years) and rejected the null hypothesis of equal DOS at a significance level of 5%. The actual p-value was 0.6%, leading to the conclusion that the two prognostic staging systems were different in their classification efficiency for the data. The DOS for the classification resulted by TSSA was 40.53 in comparison to 2.33 of Kamura’s, suggesting the TSSA classification be significantly better than that of Kamura in this patient population. If we changed L to 71 months, we had a lower p-value of 0.3%, again, indicating stronger statistical efficiency by increasing the restricted time L.
6. Discussion and conclusion In this paper, we introduced an index DOS to measure the efficiency in prognostic separation by a classification method based on restricted mean lifetimes. This index was used to compare the efficiency of two classification methods with survival time as the endpoint. We provided mathematical relationships between partial ordering of DOS and classification methods. We proposed estimating and testing procedures of two DOSs
On comparison of two classification methods with survival endpoints
57
based on paired data. Our simulation results suggested that the proposed testing procedure have a desired type I error rate under reasonable study sample sizes. Clinical examples demonstrated its uses in medical research. Comparing the mean survival times between two survival curves has been studied by many investigators (Pepe and Fleming, 1989; 1991; Mukhopadhyay and Chattopadhyay, 1991; Shen and Fleming, 1997; Murray, 2001). However, none of the previous research has addressed the problem of comparing the variations in mean survival times obtained from two classification methods. While DOS is one measurement of such variations, other choices are possible and may be more appropriate under various conditions. Further studies of different indices for classification efficiency, such as the average LP Wasserstein distances between survival curves from classified groups, or those based on variation in distribution quantiles such as median survival times, etc., are warranted. The limiting time L is critical in comparing two DOS indices. Because of the nonparametric nature of our approach and limitations introduced by censoring, we could not compare mean survival time beyond LAO, a random variable to estimate time τ as the maximum positive support for the survival and censoring density functions. Traditionally, L is chosen after observation of data. Karrison (1987) suggested choosing the largest L consistent with an effective sample size greater than two-thirds of the total
( sample size, that is to say, n(L) ˆ > 23 n, where n(t) ˆ = S(t)(1 − S(t))/V S(t)). However, to use the non-inferiority testing procedure proposed in this paper, we need only choose an L LAO. Our example shows that LAO itself is a good choice of the restricted time. The test efficiency increased with the restricted time L. This is because the survival differences increased with the length of follow-up in our examples. The longer the L, the more difference in the survival curves. This may not be true, however, for a classification that results in survival curves that cross each other at a later time. Another difficulty is the estimation of the survival functions. In Section 3, we used the Kaplan–Meier estimator to estimate restricted mean lifetime for classification combinations of two classification methods. Although the marginal and overall restricted mean lifetimes are linear combinations of the restricted mean lifetime of these cells in mathematics, the corresponding estimated Kaplan–Meier marginal and overall restricted mean lifetime for their corresponding marginal or overall data were not identical to the linear averages from cell means obtained from mathematical formulas. However, our simulations showed little difference between these two methods. An alternative is the estimator defined in (1.10) of Susarla and Van Ryzin (1980), which possesses the same asymptotic normality property as the Kaplan–Meier estimator although their properties are different from each other for small sample sizes (Park, 1987). We propose the use of DOS to compare two pre-established classification methods each of which derives only a finite number of groups. Our Proposition 3 suggests that DOS increases with further separation of patients. Therefore, DOS is not suitable for use as a criterion to develop classification rules. It is possible to add a penalty function to DOS based on the number of resulting groups that is similar to the AIC in linear models. However, this is beyond the scope of our paper.
58
Y. Lu, H. Jin and J. Mi
Acknowledgement We thank Mr. David Breazeale for his editorial help. We also thank Dr. Ying-Qing Chen for helpful discussions. The study is supported by a grant from the National Institutes of Health R03 AR47104. The first two authors are supported by a grant from the National Institutes of Health R03 AR47104.
References Chen, P.-Y., Tsiatis, A.A. (2001). Causal inference on the difference of the restricted mean lifetime between two groups. Biometrics 57, 1030–1038. Cummings, S., Black, D., Nevitt, M., Browner, W., Cauley, J., Ensrud, K., Genant, H., Hulley, S., Palermo, L., Scott, J., Vogt, T. (1993). Bone density at various sites for prediction of hip fractures: The study of osteoporotic fractures. Lancet 341, 72–75. Cummings, S., Nevitt, M., Browner, W., Stone, K., Fox, K., Ensrud, K., Cauley, J., Black, D., Vogt, T. (1995). Risk factors for hip fracture in white women. Study of osteoporosis research group (see comments). New England J. Medicine 332, 767–773. Elveback, L. (1958). Estimation of survivorship in chronic disease: The ‘Actuarial’ method. J. Amer. Statist. Assoc. 53, 420–440. Esserman, L., Hylton, N., Yassa, L., Barclay, J., Frankel, S., Sickles, E. (1999). Utility of magnetic resonance imaging in the management of breast cancer: Evidence for improved preoperative staging. J. Clin. Oncol. 17, 110–119. Gill, R. (1983). Large sample behaviour of the product-limit estimator on the whole line. Ann. Statist. 11, 49–58. Irwin, J.O. (1949). The standard error of an estimate of expectational life. J. Hygiene 47, 188–189. Kamura, T., Tsukamoto, N., Tsuruchi, N., Kaku, T., Saito, T., To, N., Akazawa, K., Nakano, H. (1993). Histopathologic prognostic factors in stage IIb cervical carcinoma treated with radical hysterectomy and pelvic-node dissection – An analysis with mathematical statistics. Internat. J. Gynecol. Cancer 3, 219– 225. Kaplan, E.L., Meier, P. (1958). Nonparametric estimation from incomplete observations. J. Amer. Statist. Assoc. 53, 457–481. Karrison, T. (1987). Restricted mean life with adjustment for covariates. J. Amer. Statist. Assoc. 82, 1169– 1176. Kashani-Sabet, M., McMillan, A., Zackheim, H. (2001). A modified staging classification for cutaneous T-cell lymphoma. J. Amer. Acad. Dermatol. 45, 700–706. Lehman, E.L. (1966). Some concepts of dependence. Ann. Math. Statist. 37, 1137–1153. Lewis, J. (1999). Statistical principles for clinical trials (ICH E9): An introductory note on an international guideline. Statist. Medicine 18, 1903–1942. Liu, J.-P., Hsueh, H.-M., Hsieh, E., Chen, J.J. (2002). Tests for equivalence or non-inferiority for paired binary data. Statist. Medicine 21, 231–245. Lu, Y., Black, D., Mathur, A.K., Genant, H.K. (2003). Study of hip fracture risk using tree structured survival analysis. J. Miner. Stoffwechs 10 (1), 11–16. Lu, Y., Stitt, F. (1994). Using Markov processes to describe the prognosis of HIV-1 infection. Medical Decision Making 14, 266–272. Marshall, A.W., Olkin, I. (1979). Inequalities: Theory of Majorization and Its Applications. Academic Press, New York. Mukhopadhyay, N., Chattopadhyay, S. (1991). Sequential methodologies for comparing exponential mean survival times. Sequential Anal. 10, 139–148. Murray, S. (2001). Using weighted Kaplan–Meier statistics in nonparametric comparisons of paired censored survival outcomes. Biometrics 57, 361–368.
On comparison of two classification methods with survival endpoints
59
Park, D.H. (1987). Small sample study on estimators of life distributions and of mean survival times using randomly censored data. Commun. Statist. Part B Simulation Comput. 16, 221–232. Pepe, M.S., Fleming, T.R. (1989). Weighted Kaplan–Meier statistics: A class of distance tests for censored survival data. Biometrics 45, 497–507. Pepe, M.S., Fleming, T.R. (1991). Weighted Kaplan–Meier statistics: Large sample and optimality considerations. J. Roy. Statist. Soc. Ser. B (Methodological) 53, 341–352. Reynolds, T. (2002). Updates to staging system reflect advances in imaging, understanding. JNCI Cancer Spectrum 94, 1664–1666. Savage, I. (1957). Contributions to the theory of rank order statistics-the “trend” case. Ann. Math. Statist. 28, 968–977. Segal, M. (1988). Regression trees for censored data. Biometrics 44, 35–47. Segal, M., Bloch, D. (1989). A comparison of estimated proportional hazards models and regression trees. Statist. Medicine 8, 539–550. Sevin, B.-U., Lu, Y., Nadji, M.N., Bloch, D., Koechli, O.R., Averette, H.A. (1996). Surgically defined prognostic parameters in early cervical carcinoma: A tree structured survival analysis. Cancer 78, 1438–1446. Shen, Y., Fleming, T.R. (1997). Weighted mean survival test statistics: A class of distance tests for censored survival data. J. Roy. Statist. Soc. Ser. B (Methodological) 59, 269–280. Sobel, M. (1954). On a generalization of an inequality of Hardy, Littlewood and Polya. Proc. Amer. Math. Soc. 5, 596–602. Stitt, F.W., Lu, Y., Dickinson, G.M., Klimas, N.G. (1991). Automated severity classification of AIDS hospitalizations. Medical Decision Making 11, S41–S45. Susarla, V., Van Ryzin, J. (1980). Large sample theory for an estimator of the mean survival time from censored samples. Ann. Statist. 8, 1002–1016. Therasse, P.A., Arbuck, S.G., Eisenhauer, E.A., Wanders, J., Kaplan, R.S., Rubinstein, L., Verweij, J., Van Glabbeke, M., van Oosterom, A.T., Christian, M.C., Gwyther, S.G. (2000). New guidelines to evaluate the response to treatment in solid tumors (see comments). J. National Cancer Instit. 92, 205–216. Zhang, H., Singer, D. (1999). Recursive Partitioning Tree and Application in Health Sciences. Springer, New York. Zheng, Z. (1995). Two methods of estimating the mean survival time from censored samples. Sankhya Ser. A Indian J. Statist. 57, 126–136. Zucker, D.M. (1998). Restricted mean life with covariates: Modification and extension of a useful survival analysis method. J. Amer. Statist. Assoc. 93, 702–709.
4
Handbook of Statistics, Vol. 23 ISSN: 0169-7161 © 2004 Elsevier B.V. All rights reserved. DOI 10.1016/S0169-7161(03)23004-2
Time-Varying Effects in Survival Analysis
Thomas H. Scheike
1. Time-varying effects in survival analysis Since Aalen’s Ph.D. Thesis in 1975 (Aalen, 1975 and 1978) many authors have considered event time data in the counting process setup which is described briefly below. See Brémaud (1981) and Jacobsen (1982) for thorough general mathematical expositions on counting process theory, and the more recent expositions by Fleming and Harrington (1991) and Andersen et al. (1993). Assume that n independent subjects are observed over some period of time [0, τ ]. For each subject a counting process, Ni (t), that gives the number of events occurring before time t is observed together with possibly additional information in terms of p-dimensional covariates Xi (t). Models for survival data, or more generally counting process data, are very conveniently formulated through the intensity process λi (t) which is defined as P (Ni (t + h) − Ni (t) 1| Past) . h→0 h
λi (t) = lim
We make the usual regularity assumptions (see Andersen et al., 1993) and the additional assumption that subjects are independent and identically distributed. The aim of this exposition is to present some recent developments that deal with time-varying effects of covariates. The work presented here summarizes and extends some of the material in the Doctoral thesis of Scheike (2002b). In medical studies, it is often expected that effects are time-varying, and since traditional models do not allow for a natural description of such effects there is a need to extend these models. One reason for the lacking use of the few models that do exist is probably the lack of inferential tools to go along with the non-parametric time-varying effects that may be estimated in some models. I here suggest a procedure for making inference about nonparametric time-varying effects that is easy to do in practice. One typically wishes to test if an effect is in fact time-varying, or significant at all. Another limitation of the few existing models that have dealt with time-varying effects are that these models typically force all effects to be time-varying. I here also emphasize the use of semi-parametric models where some effects are time-varying and some are time-constant, thus giving the extended flexibility only for effects where a simple description is not possible. 61
62
T.H. Scheike
Time-varying effects may be modelled completely non-parametrically by a general intensity model λi (t) = λ t, Xi (t) . Smoothing techniques have been suggested for estimation of λ( ); see, e.g., Nielsen and Linton (1995) and the references therein. Such a model may be useful when the number of covariates is small compared to the amount of data, but the generality of the model makes it difficult to get a clear, if any, conclusion about covariate effects. McKeague and Utikal (1991) considered the model as a tool for goodness-of-fit procedures. One often finds that the data may be summarized sufficiently well by a regression model where covariate effects are expressed through regression coefficients. I here consider regression models that can be written in the form λi (t) = Yi (t)h α(t) + XiT (t)β , (1) where β is a set of p-dimensional regression coefficients, Yi (t) is a predictable at risk indicator taking values 0 or 1, α(t) is a non-parametric function and h is a known link function. One choice of h is h(x) = exp(x) and this leads to Cox’s regression model (slightly re-parametrized) (Cox, 1972), and another choice h(x) = x leads to a semiparametric version of the additive risk model (see McKeague and Sasieni, 1994 or Lin and Ying, 1994) that is a special case of the additive risk model by Aalen (1980) that is considered below. An immediate extension of the above model assumes that the intensity is of the dynamic additive regression form λi (t) = Yi (t)h α(t) + XiT (t)β(t) , (2) where β(t) is a p-dimensional (suitably well behaved) function of time-varying regression coefficients. We shall show how to deal with this model for the two choices of h just mentioned. The focus of the presentation given here is to provide efficient estimators that can be used for inferential purposes. Two important hypotheses that one often has interest in examining are that one of the regression coefficient functions is constant, Hc : βj (t) ≡ βj , or that a regression coefficient is non-significant, H0 : βj (t) ≡ 0. To examine for time-varying effects in model (2) it is often preferable with a number of successive tests that investigate the covariates one at a time, rather than just doing an overall test for all covariates at one time, such as Hgc : β(t) ≡ β. Several authors have considered testing of the overall hypothesis, Hgc : β(t) ≡ β, in the context of the proportional hazards model (see, e.g., Grambsch and Therneau (1994), Wei (1984), Lin et al. (1993), Murphy (1993) and Marzec and Marzec (1997)). The approach of Murphy is related to the approach presented here and also makes it possible to consider the effects individually. Successive tests make it possible to use backwards model selection procedures to investigate for time-varying effects. I here present a procedure for successive testing for the dynamic additive intensity model, model (2) for two choices of h, that relies on work by Scheike (2002a) for h(z) = z and Martinussen et al. (2002) and Scheike and Martinussen (2002) for h(z) = exp(z), as well as some new work presented here. Successive testing is more complicated than the overall testing because it necessitates
Time-varying effects in survival analysis
the study of the semi-parametric sub-model λi (t) = Yi (t)h α(t) + XiT (t)β(t) + ZiT (t)γ ,
63
(3)
where β(t) is a p-dimensional time-varying regression coefficient, γ is a q-dimensional regression coefficient, and (Xi (t), Zi (t)) is a set of (p + q)-dimensional predictable covariate vectors. In practice, the standard procedures to check for time-varying effects of covariates are based either on graphical procedures or tests for the extended model with timevarying covariates. To illustrate the use of the standard procedures, consider the simple model where the true intensity has the form λ˜ i (t) = Yi (t)h α(t) + Xi β(t) + Zi γ , (4) where both Xi and Zi are 1-dimensional. A typical graphical procedure for investigating whether Zi has a time-varying effect is based on stratifying Zi into S strata and then fitting the stratified model: λi (t) = Yi (t)h αs (t) + Xi β for Zi in stratum s, s = 1, . . . , S. (5) A closer examination of the estimates of αs (t) to see if these baseline intensities are consistent with the hypothesized baseline α(t) + Zi γ is then used to check if the effect of Zi depends on time. In reality, one only investigates the global hypothesis that all covariate effects are not time-varying. E XAMPLE . To illustrate that the graphical procedure does not say much about the timevarying nature of individual covariates, consider the following little example. Assume that the true intensity is λ˜ i (t) = Yi (t) 0.5 + Xi f (t) + Zi 0.3 , where f (t) = 3 for t < 0.5 and 0 otherwise. Covariates Xi and Zi were the absolute values of a 2-dimensional standard normal with mean 0, variance 1 and correlation 0.7. 400 independent realizations of survival times that were censored at time 3 were simulated. This led to approximately 15% of censorings. The data were then stratified into three stratum according to the value of Zi , and the stratified model (5) was fitted. If the model λi (t) = Yi (t) α(t) + Xi β + Zi γ is true then stratifying in S strata leads to the approximate baselines α(t) + γs , s = 1, . . . , S, thus implying that the difference between any two of the cumulative baselines should result in straight lines. Figure 1 shows the difference between the three cumulative baselines versus time. The plot suggests that the difference between the cumulative baselines is not linear in time. One difficulty with the graphical procedure is the lacking description of variability that, however, in principle can be constructed under the null. In conclusion, the plots reveal lacking fit of the model but say nothing about the time-varying effect of Z.
64 T.H. Scheike
Fig. 1. Difference between stratified cumulative baselines.
Time-varying effects in survival analysis
65
Lin et al. (1993) (see also Wei, 1984) suggested some important omnibus test for the goodness-of-fit of the proportional hazards model (Cox’s regression model). They suggest that one should consider the behaviour of the components of the score processes, as well as other cumulative processes. Later their important bootstrapping technique is appropriately modified to the extended setting of the semi-parametric models considered here. Denoting the score process under Cox’s regression model by U (β, t), they suggest a technique for approximating the distribution of the observed score process ˆ t), where βˆ is the estimator of the regression coefficients. U (β, A formal test for how well the observed score process behaves, under the null, can be constructed by considering the different components of the observed score and computing, say, ˆ t , j = 1, . . . , p Sj = supUj β, t
whose percentiles can be simulated under the null. E XAMPLE . Consider the true model λ˜ i (t) = Yi (t) exp 0.5 + Xi β1 (t) + Zi 0.3 , where β1 (t) = 4t for t < 0.2, β1 (t) = 0.8 − (t − 0.2) for t 0.2. Covariates Xi and Zi were 2-dimensional standard normal with mean 0, variance 1 and correlation 0.7. The survival times were censored at time 3. The simulation is based on 400 independent realizations. Simulating the score processes under the null hypothesis, H0 : β1 (t) ≡ β1 , β2 (t) ≡ β2 , gives random realizations of the score process under the null. Figure 2 shows 50 such random realizations as well as the observed score process. The example given here resulted in the p-values 0.00 and 0.00 for the observed score processes for X and Z, respectively. The score process test thus reveals the lacking fit, but cannot be used to state anything about the covariates individually. Alternatively, if the effect of Zi is believed to be approximately of log-type, a standard approach is to consider the model λi (t) = Yi (t)h α(t) + Xi β + Zi γ + Zi log(t) θ (6) and use the test for H : θ = 0 as a test for time-varying effects of Zi . This test is also generally invalid as a test for the time-varying effect of Z due to the incorrect modelling of X. E XAMPLE . Assume that the true intensity is on the form λ˜ i (t) = Yi (t) 0.5 + Xi f (t) + Zi 0.3 , where f (t) = 3 for t < 0.5 and 0 otherwise. Covariates Xi and Zi were the absolute values of a 2-dimensional standard normal with mean 0, variance 1 and correlation 0.7. Survival times were censored at time 3, and 200 independent realizations were used.
66
T.H. Scheike
Fig. 2. Score processes for covariates X and Z (thick lines) and 50 random realizations under null hypothesis.
The model
λi (t) = Yi (t) α(t) + Xi β + Zi γ + Zi f (t) θ ,
where f (t) is assumed known was used to test the hypothesis H : θ = 0. The test H : θ = 0 was rejected in all of 500 repetitions, thus leading to an observed level at 1 far away from the significance level that was chosen to 0.05. The test for timevarying effects based on (2) developed later resulted in an observed level of 0.352 for X and 0.048 for Z, thus showing some ability to correctly reject the hypothesis that X have a time-constant effect, and resulting in the correct level for Z. The power for X could be improved within the suggested framework. To summarize, the standard procedures do not work for testing for time-varying effect of an individual covariate (Z), since they are based on an incorrect modelling assumption about the effect of other covariates (X). Both (5) and (6) assume that the effect of Xi is time-constant and therefore cannot be used as a basis for testing the timevarying effect of Z. When the effect of X is strongly time-varying, both procedures may thus lead to incorrect conclusions if used to investigate for time-varying effects of Z. In Scheike and Martinussen (2002) it was demonstrated that the test procedure (6) can lead to seriously biased tests in the proportional setting (h(z) = exp(z)). It is therefore important to remember, although one often forgets, that most test procedures only in general say something about the overall goodness-of-fit or the hypothesis Hgc : β(t) ≡ β. To investigate the covariates individually for time-varying effects by a correct procedure one may start by considering the model λi (t) = Yi (t)h α(t) + Xi β1 (t) + Zi β2 (t)
Time-varying effects in survival analysis
67
and in this model test the hypothesis H : β2 (t) ≡ γ , and if accepted then proceed to test the use of the model (4) for H : β(t) ≡ β. To accommodate the successive testing approach the general procedure, pursued for both the proportional and additive risk model, is to provide an efficient estimation procedure for the semi-parametric model where it is assumed that λi (t) = Yi (t)h α(t) + XiT (t)β(t) + ZiT (t)γ . Estimators of γ and B(t), the cumulative regression coefficient function B(t) = t an estimator of β(s) may be derived, but when β(s) ds, are suggested. Based on B(t) 0 focus is on inferential procedures, the cumulative regression coefficients are preferable to the regression coefficients themself. Direct estimation of β(s) has been studied in a number of papers for model (2), see the references given below. Given the estimators for the semi-parametric model one may proceed to construct a test for time-varying effects for one of the components of Xi by comparing, e.g., the fit of the model T T λi (t) = Yi (t)h α(t) + Xi,1 (t)β1 (t) + Xi,2 β2 (t) + ZiT (t)γ with that of the model under the null (H0 : β2 (t) ≡ β2 ) T T λi (t) = Yi (t)h α(t) + Xi,1 (t)β1 (t) + Xi,2 β2 + ZiT (t)γ . 2 (t) with βˆ2 t. One simple way of doing this is to compare B The rest of paper is structured as follows. Section 2 deals with estimation for the proportional and additive models. Section 3 develops an approach for inferential procedures which makes it possible to make successive testing for covariate effects. Section 4 gives a worked example for the malignant melanoma data of Andersen et al. (1993). Finally, Section 5 contains some discussion. 2. Estimation for proportional or additive models In this section it is shown how to estimate the parameters for the dynamic additive intensity model for the proportional and the additive hazards models. The proportional and additive models give rise to estimation procedures that are very similar. One important difference between the two models, however, is that due to the non-linearity of the proportional models a smoothing parameter is needed to deal with non-parametric effects, whereas this can be avoided for the additive hazards model. Essentially, the proportional model is linearized in an iterative procedure which is in each step equivalent to the additive estimation procedure. Although the proportional model makes it more difficult to estimate non-parametric effects, the model has the advantage of always leading to positive hazards. I also present some new models that combine additive and proportional models. Some technical conditions are needed. These conditions, roughly speaking, consist of the assumption of independent and identically distributed subjects, with covariates that are suitably bounded and lead to a full design for all time points (asymptotically). Regression coefficients are suitably smooth: twice continuously differentiable for the
68
T.H. Scheike
proportional model and locally integrable for the additive model. More precise conditions are given in the cited work but I here aim at presenting the main arguments rather than a more technical description. t Some notation is also needed, define the cumulative intensity Λi (t) = 0 λi (s) ds such that Mi (t) = Ni (t) − Λi (t) is a martingale. Let further N(t) = (N1 (t), . . . , Nn (t)) be an n-dimensional counting process, Λ(t) = (Λ1 (t), . . . , Λn (t)) its compensator, λ(t) = (λ1 (t), . . . , λn (t)) an n-dimensional intensity process, M(t) = (M1 (t), . . . , Mn (t)) the n-dimensional martingale, and Ft the history generated by the observed processes. When each individual has predictable p-dimensional covariates Xi (t) we organize them into n × p matrices, i.e., X(t) = (X1 (t), . . . , Xn (t))T , finally D(wi ) denotes a diagonal matrix of dimension n × n with diagonal elements w1 , . . . , wn . 2.1. Cox’s proportional regression model Models for the intensity have been dominated by Cox’s regression model (Cox, 1972; Andersen and Gill, 1982) which states that the intensity is of the form λi (t) = Yi (t)λ0 (t) exp Xi (t)T β , where Yi (t) is a predictable at risk indicator and Xi (t) ∈ p is a predictable covariate vector. The baseline λ0 (t) gives the intensity for an individual with covariates equal to 0. If the covariates are time-independent, the model stipulates that the hazard rates for different values of the covariates are proportional. When studying treatment effects one often encounters effects that change over time, and one of the limitations of Cox’s regression model is that the baseline intensity is the only parameter that depends on time. It is therefore natural to consider an extended model λi (t) = Yi (t)λ0 (t) exp Xi (t)T β(t) , (7) where β(t) ∈ p is a suitably smooth p-dimensional function of regression coefficients. This model has been studied by a number of authors, e.g., Zucker and Karr (1990), Murphy and Sen (1991), Hastie and Tibshirani (1993) and Grambsch and Therneau (1994). Murphy and Sen (1991) study a histogram sieve t estimator of the cumulative time-varying regression coefficients effects (B(t) = 0 β(s) ds). More recently Pons (2000) and Cai and Sun (2002) have suggested local estimation techniques. The work presented here is based on Martinussen et al. (2002) (MSS) and Scheike and Martinussen (2002). MSS deal with a slightly re-parametrized version of the Cox model that leads to formulae that are easier to relate to the additive model presented later. For a positive baseline model (7) can be written as λi (t) = Yi (t) exp Xi (t)T β(t) , (8) incorporating the baseline in the β(t) vector and extending the design vector. The model is very flexible and may be thought of as a one term Taylor expansion of log(λi (t, xi (t))) around the 0 covariate. With the aim of presenting inferential procedures, focus is on estimation of the cumulative regression coefficients since these accommodate inferential procedures. Important
Time-varying effects in survival analysis
69
hypotheses are to decide whether a regression coefficient function is time-varying (significantly) or time-constant, and whether a regression coefficient is significant or not. This can be done by modifying the elegant and very useful bootstrapping technique suggested by Lin et al. (1993, 1994) that makes it possible to obtain approximate percentiles for complicated distributions. t To efficiently estimate the cumulative regression coefficient functions B(t) = 0 β(s) ds, MSS suggested a simple iterative procedure derived from the score equations of the likelihood based on the parametrization (8). The score equations can be written conveniently as X(t)T dN(t) − λ(t) dt = 0 which, combined with a Newton–Raphson iteration procedure and smoothing, define an estimation procedure. The method depends on the choice of smoothing parameter. (k) ) for the cumulative (k+1) = g(B Following MSS, this leads to the iteration step B regression coefficients where t t −1 X(s)T dN(s) (t) = ˜ ds + A(s) g B β(s) 0
0
t
−
−1 X(s)T λ˜ (s) ds, A(s)
(9)
0
˜ ˜ where λ(s) = (λ˜ 1 (t), . . . , λ˜ n (t)), and λ˜ i (t) = Yi (t) exp(Xi (t)T β(t)) and Yi (t) exp Xi (t)T β(t) Xi (t)Xi (t)T Aβ (t) = i
= A ˜ . For simplicity, β(t) ˜ is a p × p matrix and A is taken to be a simple kernel β estimator of β(t), that is,
˜ = b−1 K u − t dB(u), β(t) b with K a continuous kernel with support [−1, 1] satisfying K(u) du = 1, uK(u) du = 0, and b the bandwidth. that can be shown to be consistent and asymptotIterating leads to an estimator B(t) ically Gaussian under a set of regularity conditions. These regularity conditions include the assumption that the regression coefficients β(t) are twice continuously differentiable, and that the smoothing is asymptotically such that b ∼ n−α for 1/8 < α < 1/4. The choice of the smoothing parameter is a serious practical problem and is also present for the other suggestions for solving the model, and is due to non-linearity of the model. Model (8) is very flexible and sometimes too large for medium to small data sets, therefore, and to further summarize effects that are not time-dependent, MSS also deals with the semi-parametric model λi (t) = Yi (t) exp Xi (t)T β(t) + Zi (t)T γ , (10)
70
T.H. Scheike
where Xi (t) ∈ p and Zi (t) ∈ q are predictable covariate vectors. This model is extremely useful when one wishes to establish inferential procedures as already indicated in the introduction. The score equations for β(t) and γ are X(t)T dN(t) − λ(t) dt = 0, Z(t)T dN(t) − λ(t) dt = 0. The equations can be used to give an efficient estimation procedure when a Newton– Raphson procedure is combined with smoothing. The score equation for γ , after a linear Taylor expansion about a set of initial esti mates γ˜ and B(t), leads to the iteration step τ
−1 T gγ (γ˜ ) = γ˜ + Z(t) G(t)W (t)Z(t) dt 0 τ × Z(t)T G(t) dN(t) − λ˜ dt , (11) 0
where G(t) = (I −W (t)X(t)(X(t)T W (t)X(t))−1 X(t)T ), W (t) = D(λ˜ i (t)) and λ˜ i (t) = ˜ Similarly, the updating step for B is exp(Xi (t)T β(t)). t t −1 (t) = ˜ ds + gB B X(s)T W (s)X(s) X(s)T β(s) 0
0
× dN(s) − λ˜ ds − W (s)Z(s) gγ (γ˜ ) − γ˜ ds . (12) These iterations lead to consistent and efficient estimates of the cumulative regression t functions B(t) = 0 β(s) ds and γ . Under regularity conditions, see MSS, the asymptotic distribution of the cumulative estimators can be derived and variances can be estimated. Further, D
n1/2 (γˆ − γ ) → V
as n → ∞,
where V is a mean-zero normal with variance Σ11 (τ ), and D − B (t) → n1/2 B W (t) as n → ∞ in D[0, τ ]p , where W (t) is a mean-zero Gaussian process with variance Σ22 (·)(t). The covariance between V and W (t) is Σ12 (t). Estimators for these covariances are given in MSS but in Section 3 I provide some alternative simple and robust estimators that have not been presented before. The regularity conditions include assumptions about the smoothness of β(t), as well as the undersmoothing assumption about the smoothing parameter that must satisfy b ∼ n−α for 1/8 < α < 1/4. Non-parametric effects are studied on the cumulative scale since variability is most simply described on this scale. Based on the asymptotic description of the cumulative regression effects under the semi-parametric model, it is possible to construct successive tests for time-dependence of covariate effects. A detailed study of how to do this was
Time-varying effects in survival analysis
71
carried out in Scheike and Martinussen (2002) and in the next section these tests are presented. 2.2. Aalen’s additive model An alternative to the proportional hazard model of Cox and the semi-parametric extension considered in the previous sections is Aalen’s additive hazard model (Aalen, 1980, 1989; McKeague, 1988; Huffer and McKeague, 1991) where the intensity depends linearly on covariates λi (t) = Xi (t)T β(t),
(13)
(t) ∈ p
where Xi is a predictable covariate vector and β(t) are locally integrable. Aalen suggested a simple estimator of the cumulative time-varying effects where no smoothing parameter is needed. Efficient estimates based on smoothing are obtained to estimate λi (t), but the method is not sensitive to the choice of the smoothing parameters. The score equations give direct estimation of the increments X(t)T W (t) dN(t) − λ(t) dt = 0 with W (t) = D(1/λi (t)), which gives the following estimator of B(t): t = X(s)− dN(s), B(t) 0
where X(s)− = (X(s)T W (s)X(s))−1 X(s)T W (s). Aalen (1980) studied the estimator for the in-efficient choice W (t) = D(1), and McKeague (1988) and Huffer and McKeague (1991) considered a procedure where the weight matrix D(1/λi (t)) was replaced by an estimator. This leads to an efficient estimator (see Sasieni (1992) and Greenwood and Wefelmeyer (1991)). The Aalen model is very flexible and may be interpreted as a first order Taylor expansion of a completely general intensity function λ(t, X(t)) around covariate value 0. Often one can further simplify the description of covariate effects and then the semi-parametric version studied by McKeague and Sasieni (1994) is very useful, by assuming that λi (t) = Xi (t)T β(t) + Zi (t)T γ , ∈ p
(14)
∈ q
where Xi (t) and Zi (t) are predictable covariate vectors. Simple estimators of the cumulative effects B(t) and γ that can be studied asymptotically are available based on solving the simultaneous score equations X(t)T W (t) dN(t) − λ(t) dt = 0, Z(t)T W (t) dN(t) − λ(t) dt = 0 with W (t) = D(1/λi (t)). The equations may be solved for any weight matrix and then yield consistent estimators, and here the unweighted estimator W (t) = D(1) is used. t It is of interest to focus on estimation of the cumulative regression functions B(t) = 0 β(s) ds and γ , and also to suggest tests for the significance or time-dependence of β(·).
72
T.H. Scheike
Following McKeague and Sasieni (1994), under model (14) the following estimators are derived: τ
−1 τ γˆ = Z(s)T H (s)Z(s) ds Z(s)T H (s) dN(s), 0
= B(t)
0
t
X(s)− dN(s) − Z(s)γˆ ds ,
0
where H (s) = (I − X(s)X(s)− ), with the convention that H (s) is zero when the inverse matrix does not exist. McKeague and Sasieni showed that the estimators are consistent and asymptotically Gaussian with variances that can be estimated. It can be shown that D
n1/2 (γˆ − γ ) → V
as n → ∞,
where V is a mean-zero normal with variance Σ11 (τ ), and D − B (t) → n1/2 B W (t)
as n → ∞
D[0, τ ]p ,
in where W (t) is a mean-zero Gaussian process with variance Σ22 (·)(t). The covariance between V and W (t) is Σ12 (t). Estimators for these covariances are given in McKeague and Sasieni (1994), but in Section 3 I provide some alternative simple robust estimators formula based on Scheike (2002a). One general problem with the additive risk models is that the estimated intensity for a subject may become negative. 2.3. Additive–multiplicative intensity models The additive and proportional hazard models may be combined in various ways to achieve flexible and useful models. Generally, the additive and multiplicative models postulate different relationships between the hazard and covariates, and the subject matter seldom indicates clearly which of the models should be preferred. The models may often be used to complement each other and to provide different summary measures. One advantage of the additive models is that time-varying effects are easy to estimate, and that no smoothing parameter needs to be chosen. Lin and Ying (1995) considered the following additive–multiplicative intensity model: λi (t) = Yi (t) g Xi (t)T β + λ0 (t)h Zi (t)T γ , where (Xi (t)T , Zi (t)T ) is a (p + q)-covariate vector. One problem with this model is that only the baseline is time-varying and therefore data with time-varying effects will often not be well described by the model. Dabrowska (1997): considers the following general stratified Cox model: λi (t) = Yi (t)λ t, Xi (t) exp Zi (t)T β . For this model interest may be in the effect of the variables Z while avoiding modelling error of the additional covariates X. Dabrowska suggests a smooth profile estimation
Time-varying effects in survival analysis
73
technique for this model. This makes the choice of a smoothing parameter necessary, and further restricts the covariates in the non-parametric term to be continuously varying. The non-parametric part of the model is not expected to be able to handle too many covariates for small to medium sized data sets. In addition, the non-parametric effects can be difficult to summarize. A first order Taylor expansion of the Dabrowska baseline hazard around the zero covariate for the non-parametric yields the Aalen model instead of λ(t, Xi (t)), i.e., λi (t) = Yi (t) Xi (t)T α(t) exp Zi (t)T β , (15) where (Xi (t)T , Zi (t)T ) is a (p +q)-predictable covariate vector. This model was studied in Scheike and Zhang (2002a and 2002b) . The efficient score equations are X(t)T W (t) dN(t) − λ(t) dt = 0, Z(t)T dN(t) − λ(t) dt = 0, where W (t) = D(φi (t)/λi (t)), φ(t) = (φ1 (t), . . . , φn (t)), and φi (t) = exp (Zi (t)T β). Choosing the weight matrix W as D(exp (Zi (t)T β)) makes it possible to get initial estimates that for small samples do as well or better than the efficiently weighted estimates. The model allows a very flexible description of covariate effects of Xi (t) while introducing some structure to make estimation and interpretation easier than in the general model. Scheike and Zhang (2002a and 2002b) derive the asymptotic properties for the model, and based on this tests and confidence bands may be established. This model may be fitted without the choice of any smoothing parameters. Martinussen and Scheike (2002) consider the following additive–multiplicative intensity model: λi (t) = α T (t)Xi (t) + ρi (t)λ0 (t) exp β t Zi (t) , (16) where α(·) is a q-vector of time-varying regression coefficients and ρi (t)is a risk indit cator. Our interest is in estimation of the unknown parameters β, A(t) = 0 α(s) ds and t Λ(t) = 0 λ0 (s) ds. The score equations for the unknown parameters are given as X(t)T W (t) dN(t) − λ(t) dt = 0, φ(t)T W (t) dN(t) − λ(t) dt = 0, Z(t)T V (t) dN(t) − λ(t) dt = 0, where W (t) = D(1/λi (t)), V (t) = D(λ0 (t)φi (t)/λi (t)), φ(t) = (φ1 (t), . . . , φn (t)), and φi (t) = ρi (t) exp(β(t)T zi (t)). Efficient estimators are found by solving the score equations for the parameters and the estimators are provided with an asymptotic description that makes inference possible. Essentially the model reduces to an Aalen model for known β and this may be utilized to obtain a score equation for β that only depends on observed quantities. The model extends both the Cox and the Aalen model and may in principle be used to investigate goodness-of-fit for these models, but many practical issues need to be resolved to make this operational. Sasieni (1996) considered the special
74
T.H. Scheike
case of this model where α T (t)Xi (t) is replaced by a known function of Xi (t). Recently, Zahl (2002) in independent and yet unpublished work analysed the same model and gave detailed case studies. A different iterative estimation procedure is suggested by Zahl, but unfortunately no large sample properties are given.
3. Testing in proportional and additive hazards models In this section a unified treatment of how to do the successive testing that was discussed in the introduction is presented. The work is based on Scheike (2002a) for the additive risk model and on Scheike and Martinussen (2002) for the proportional hazards model. The approach is based on a modification of the simulation technique by Lin et al. (1993, 1994), that was recently used in Lin et al. (2000) and Scheike (2002a). The basic idea is that when one considers estimators of some functional η(t) and have an estimator η(t) ˆ such that n t η(t) ˆ − η(t) = hi (s) dMi (s) + op n−1/2 i=1 0
where hi (s) and Mi (s) are independent and identically distributed processes with Mi (s) t the zero mean martingale and hi (s) predictable, such that Qi (t) = 0 hi (s) dMi (s) are independent zero mean processes, then, under regularity conditions, one can show that the asymptotic distribution of η(t) ˆ − η(t) is equivalent to the asymptotic distribution of i (t)Gi Q i
i (t) = t hˆ i (s) dM i (s) are where G1 , . . . , Gn are standard normals and the estimators Q 0 fixed given the counting process data. This is essentially a version of the conditional multiplier central limit theorem. An alternative to simulating in this way is to do as Lin et al. (1993) who show that when Mi are martingales one can do something slightly simpler. Essentially one can use t hˆ i (s) dNi (s) Gi i
0
that also has the same asymptotic distribution as η(t) ˆ − η(t). The simulations based on the martingale residuals, however, have the advantage that they lead to standard errors that are more generally applicable (see Lin et al. (2000) and Scheike (2002a) for more on this robustness property). i (t). How one estimates Λ i (t) i (t) = Ni (t) − Λ The martingale is estimated by M differs slightly in proportional and additive models. For the additive hazard models the formula can be implemented slightly simpler, without smoothing, as t + zi (t)γˆ dt . i (t) = Λ Xi (t)T dB(t) 0
Time-varying effects in survival analysis
75
3.1. Asymptotics and approximations The simulation technique and results for the proportional and additive models are essentially the same and therefore a unified treatment of the two cases h(z) = z and h(z) = exp(z) is presented. The similarity of the formulae for the two cases is due to the fact that we have worked with the slightly re-parametrized version of Cox’s regression model, where the baseline is included in the regression design. For the traditional parametrization of the baseline and the partial likelihood approach, alternative formulae are obtained (see Scheike and Martinussen (2002)). The proportional and additive hazard models lead to equivalent formula when W (s) = D(λˆ i (t)) in the proportional setting and W (s) = D(1) in the additive setting. The ith diagonal of W (s) is denoted Wi (s). In the case of efficiently weighted estimator for the additive model, a different weight matrix should be used. Let X(t) = (Y1 (t)X1 (t), . . . , Yn (t)Xn (t))T be the n × p matrix of covariates for all n independent subjects at time t, where Yi (t) are the at-risk indicators, these were built into the covariates in the section on the additive models. t Assume that efficient estimators of β(t), B(t) = 0 β(s) ds and γ are at hand and and γˆ . ˆ denote these by β(t), B(t) 3.1.1. Non-parametric model and testing The non-parametric model states that λi (t) = Yi (t)h XiT (t)β(t) ,
(17)
where β(t) is a p-dimensional time-varying regression coefficient and Xi (t) is a pdimensional predictable covariate vector. To derive and approximate the asymptotic properties of the estimator the following observation is of use; − B(t) = Qi (t) + op n−1/2 , B(t) i
where
t
Qi (t) =
X(s)T W (s)X(s)
−1
Xi (s) dMi (s)
0
t with Mi (t) = Ni (t) − 0 Yi (s)h(Xi (s)T β(s)) ds. For n large this is essentially a sum of independent and identically distributed mean 0 random variables and its covariance may thus be estimated by i (t)⊗2 , (t) = Q V i
where i (t) = Q
t 0
i (t) = Ni (t) − with M
X(s)T W (s)X(s)
t 0
−1
i (s) Xi (s) dM
ˆ Yi (s)h(Xi (s)T β(s)) ds, and where for a vector a, a ⊗2 = aa T .
76
T.H. Scheike
Under regularity conditions it follows that n1/2 (B(t)−B(t)) converges to a Gaussian (t). process with a variance function that is estimated consistently by nV Now, if (G1 , . . . , Gn ) are independent and standard normally distributed then i (t)Gi ∆1 (t) = n1/2 Q i
n1/2 (B(t)
has the same limit as − B(t)). The random variables (G1 , . . . , Gn ) must be independent of the (Ni ( ), Yi ( ), Xi ( ), i = 1, . . . , n) that are considered fixed at the observed values. Let the j th component of the kth realization of ∆1 (t) be denoted as ∆k1,j (t). For the non-parametric model (17) one may wish to test the hypothesis, H0 : βj (t) ≡ γ , that one of the non-parametric components has time-constant effect. A simple test, implemented in the second example in the introduction and in the case study given later, is based on computing the test-statistic j (τ ) B t . sup Bj (t) − τ t ∈[0,τ ] This test can be improved in many different ways and a more detailed discussion is given for the semi-parametric model. To compute (approximately) percentiles for the observed test-statistic under the null, compute ∆k1,j (τ ) k t sup ∆1,j (t) − τ t ∈[0,τ ] for a large number of realizations. It is also of interest to construct simultaneous confidence bands and a test for H0 : βj (·) ≡ 0, or equivalently H0 : Bj (·) ≡ 0. To test if a time-varying component is non-significant, Bj (·) ≡ 0, the following test was applied: j (t) B sup j (t) t ∈[0,τ ] V (t). j (t) is the j th diagonal element of V where V Percentiles can be estimated from realizations of ∆1 (t): k ∆1,j (t) . sup j (t) t ∈[0,τ ] V 3.1.2. Semi-parametric model Consider the semi-parametric model λi (t) = Yi (t)h XiT (t)β(t) + ZiT (t)γ ,
(18)
where β(t) is a p-dimensional time-varying regression coefficient and γ is a q-dimensional time-constant regression coefficient, and (Xi (t), Zi (t)) is a set of (p + q)dimensional predictable covariate vectors.
Time-varying effects in survival analysis
77
Similarly to the derivation for the non-parametric model, see Scheike (2002a) for the additive model and Scheike and Martinussen (2002) for the partial likelihood approach, it can be derived that n1/2 (γˆ − γ ) is asymptotically normal with mean 0 and a variance that is estimated consistently by 1 C −1 , nC −1 Σ τ where C = 0 Z(s)T H (s)W (s)Z(s) ds, H (s) = (I −W (s)X(s)(X(s)T W (s)X(s))−1 × X(s)T ; ⊗2 , 1 = Σ W 2,i i
and
τ
W2,i =
Yi (s) Zi (s) − Z(s)T W (s)X(s)
0
−1 × X(s)T W (s)X(s) Xi (s) dMi (s), 2,i is defined from W2,i by replacing the unknown quantities with their and where W estimates. − B(t)) is equivalent to the asymptotic The asymptotic distribution of n1/2 (B(t) distribution of W4,i (t) n1/2 i
where
t
W3,i (t) =
X(s)T W (s)X(s)
−1
xi (s) dMi (s),
0
W4,i (t) = W3,i (t) − P (t)C −1 W2,i t − B(t)) is asymptotand P (t) = 0 X(s)− W (s)Z(s) ds. It can be shown that n1/2 (B(t) ically Gaussian with a pointwise variance that is estimated consistently by 4,i (t)⊗2 . n W i
To make simultaneous confidence bands and tests note that if (G1 , . . . , Gn ) are independent and standard normally distributed then 4,i (t)Gi ∆2 (t) = n1/2 W i
− B(t)). The construction of simultaneous confidence has the same limit as n1/2 (B(t) bands for B(t) and tests of the significance of the non-parametrics effects may be based on replications of ∆2 (t) (see previous section).
78
T.H. Scheike
3.2. Test for time-dependent effects in semi-parametric model To test if some covariate effects do not depend on time, such as the hypothesis H0 : βp (t) = γq+1 , p (·) and γˆq+1 , where B p (·) is obtained in the full model and consider functionals of B γˆq+1 is computed under the null-hypothesis (see Martinussen and Scheike (1999) for similar ideas in a regression setup). To distinguish between the design under the model with freely varying βp (t) and under the semi-parametric null, let the designs under the and Z(s) and use a similar notation for other quantities defined null be denoted X(s) under the null. Two functionals to test the null are p (·), γˆq+1 = sup F1 B Bp (t) − γˆq+1 t t ∈[0,τ ]
and p (·), γˆq+1 = F2 B
τ
p (t) − γˆq+1 t B
2
dt.
0
These tests may be improved in many different ways, e.g., by including information about the variation of the estimators. The functionals both have the drawback that the estimation is cumulated over time such that if a time-varying effect is only present for large t it can be difficult to detect due to cumulated random noise. If this is expected one may consider the functional for some pre-specified time-period. Alternatively, one may consider functionals that are better suited to explore more local aspects of the cumulative regression coefficient, such as, e.g., p (t) − B p (s) − γˆq+1 (t − s). sup sup B t ∈[0,τ ] s∈[0,τ ]
p (t) − γˆq+1 t is asymptotically equivalent to a Gaussian process that can be approxB imated by W5,i (t) i
with −1 W 2,i W5,i (t) = W4,i (t) − t P(t)C and where the last term is computed under the null. The asymptotic distribution of i W5,i (t) is the same as the asymptotic distribution of 5,i (t)Gi ∆3 (t) = W i
where (G1 , . . . , Gn ) are independent and standard normally distributed. Therefore the percentiles of F1 or F2 may be obtained from random samples of ∆3 (·). p (·) only, is to compute A simpler test based on B t F3 Bp (·) = sup Bp (t) − Bp (τ ) τ t ∈[0,τ ] and the asymptotic properties of this test may be simulated as before.
Time-varying effects in survival analysis
79
4. Survival with malignant melanoma The data is described in further detail in Andersen et al. (1993, p. 11). 205 patients with malignant melanoma had their tumor removed and were followed until death (from malignant melanoma) or the end of the study (15 years later). 57 deaths were recorded in the observation period. The aim of the study is to learn about the mortality rate from malignant melanoma, and estimate the predictive effect of the covariates sex (males = 1, females = 0), ulceration (present = 1, absent = 0), age (years) and thickness of tumor (mm). These data are well known to many and here it is to show how the successive testing models may be implemented to learn about the time-varying nature of the effects. A standard Cox regression model gave the log-relative risk effects (sd) 1.20 (0.31), 0.36 (0.27), 0.01 (0.01) and 0.09 (0.04) for ulceration, sex, age and thickness, respectively. The Lin et al. (1993) score test for goodness-of-fit of the Cox model gave the plots, shown in Figure 3. The figure reveals that the first and fourth components of the score process under Cox’s regression model indicate lacking fit. The p-values for the four components were 0.004, 0.61, 0.51 and 0.01930, respectively. The model thus being clearly rejected. First we consider the Cox–Aalen model as an alternative. Recall that for this model λi (t) = Yi (t) Xi (t)T α(t) exp Zi (t)T β . Trying to extend the model only for those covariates where it is really needed, I therefore consider the Cox–Aalen model with ulceration and thickness as additive components and sex and age as multiplicative components. For this model, a score process test for the two multiplicative effects (Scheike and Zhang, 2002b) reveals that the model fits well. The score processes for sex and age are quite similar to those in Figure 3. Figure 4 shows the additive non-parametric effects. The effects of ulceration and thickness appear to be rather constant but additive. In fact, a test for constant additive effect of ulceration and thickness gave the p-values 0.69 and 0.17, respectively (Scheike and Zhang, 2002b). The multiplicative effect of the Cox–Aalen model gave log-relative risk at 0.34 (0.27) and 0.01 (0.01), respectively. Estimates that are equivalent to those from the Cox model. Fitting the model completely within the additive risk framework gives the estimates shown in Figure 5. Note that the additive effects of the Cox–Aalen model are somewhat reduced compared to the Aalen model. Deciding which of the two models one prefers is difficult, and due to the limited amount of the data the power of more sophisticated goodness-of-fit test is not expected to be helpful. Successive testing of time-varying effects for the Aalen model of the covariates resulted in p-values 0.39, 0.48, 0.58 and 0.36 for age, sex, ulceration and thickness tested successively in that order. For the final semi-parametric model the estimates were 0.058 (0.017), 0.019 (0.016), 0.00063 (0.00048) and 0.0074 (0.0040) for ulceration, sex, age and thickness, respectively. These constant effects are depicted as the straight lines in Figure 5. The relative sizes and significance of the estimates are comparable to those of the Cox model. But the model gives a different alternative interpretation of the effects,
80 T.H. Scheike
Fig. 3. Score processes for covariates of melanoma data.
Time-varying effects in survival analysis
81
Fig. 4. Cox–Aalen model: cumulative coefficients for additive effects of melanoma data with 95% pointwise confidence intervals.
82
T.H. Scheike
Fig. 5. Aalen model: cumulative coefficients for effects of melanoma data with 95% pointwise confidence intervals. Straight lines represent estimates of time-constant effects.
Time-varying effects in survival analysis
83
note also that the goodness-of-fit procedure indicates that the Cox model does not give a satisfactory summary of the data.
5. Discussion I have reviewed some recent work on additive and proportional hazard models that focussed on time-varying regression coefficient models. The additive and proportional models supplement each other and will give different types of summary measures that show different aspects of the covariates. An important aspect that was emphasized is that semi-parametric versions of the models are very usefull to obtain a satisfactory description of covariate effects. Also, when inference was the interest it was emphasized that the semi-parametric models were needed to do successive tests. For the semi-parametric models I gave a procedure for testing important hypotheses for the non-parametric and parametric terms of the model. One seldom has sufficient data to decide clearly whether proportional or additive models should be preferred, and in practice the best fit may be obtained by models that allow for both multiplicative and additive effects. The models reviewed here are all sufficiently flexible to fit most data quite well. One is therefore probably better off trying to decide based on the subject matter whether or not effects are multiplicative or additive. Additive effects lead to excessive risk, and can therefore be considered as leading to mortality due to different reasons. In contrast, multiplicative effects have a general effect on the intensity and also modify the effects of other covariates. A practical consideration that might help guide the statistical analysis is that nonparametric effects are most easily dealt with in additive hazard models, since this can be done without choosing any smoothing parameters. The drawback of additive models, however, is that the model fitting may lead to negative hazards. To avoid negative hazards one may implement model fitting techniques with constraints but this appears to lead to complicated procedures. Acknowledgement The author received partial support from a grant from the National Institutes of Health. Some of the work was done while the author was employed at Department of Mathematical Sciences at Aalborg University. References Aalen, O.O., (1975) Statistical inference for a family of counting processes. Ph.D. Thesis. Department of statistics, University of California at Berkeley. Aalen, O.O. (1978). Non-parametric inference for a family of counting processes. Ann. Statist. 6, 534–545. Aalen, O.O. (1980). A model for non-parametric regression analysis of counting processes. In: Klonecki, W., Kozek, A., Rosinski, J. (Eds.), Lecture Notes in Statistics-2: Mathematical Statistics and Probability Theory. Springer, New York, pp. 1–25. Aalen, O.O. (1989). A linear regression model for the analysis of lifetimes. Statist. Medicine 8, 907–925. Andersen, P.K., Borgan, Ø., Gill, R.D., Keiding, N. (1993). Statistical Models Based on Counting Processes. Springer, New York.
84
T.H. Scheike
Andersen, P.K., Gill, R.D. (1982). Cox’s regression model for counting processes: A large sample study. Ann. Statist. 10, 1100–1120. Brémaud, P. (1981). Point Processes and Queues, Martingale Dynamics. Springer, New York. Cai, Z., Sun, Y. (2002). Local linear estimation for time-dependent coefficients in Cox’s regression models. Scand. J. Statist. Submitted for publication. Cox, D.R. (1972). Regression models and life tables. J. Roy. Statist. Soc. Ser. B 34, 406–424. Dabrowska, D.M. (1997). Smoothed Cox regression. Ann. Statist. 25, 1510–1540. Fleming, T.R., Harrington, D.P. (1991). Counting Processes and Survival Analysis. Wiley, New York. Grambsch, P.M., Therneau, T.M. (1994). Proportional hazards tests and diagnostics based on weighted residuals. Biometrika 81, 515–526 (corr: 95v82 p. 668). Greenwood, P.E., Wefelmeyer, W. (1991). Efficient estimation in a nonlinear counting-process regression model. Canad. J. Statist. 19, 165–178. Hastie, T., Tibshirani, R. (1993). Varying-coefficient models. J. Roy. Statist. Soc. Ser. B 55, 757–796. Huffer, F.W., McKeague, I.W. (1991). Weighted least squares estimation for Aalen’s additive risk model. J. Amer. Statist. Assoc. 86, 114–129. Jacobsen, M. (1982). Statistical Analysis of Counting Processes. Springer, New York. Lin, D.Y., Fleming, T., Wei, L. (1994). Confidence bands for survival curves under the proportional hazards model. Biometrika 81, 73–81. Lin, D.Y., Wei, L.J., Ying, Z. (1993). Checking the Cox model with cumulative sums of martingale-based residuals. Biometrika 80, 557–572. Lin, D.Y., Ying, Z. (1994). Semi-parametric analysis of the additive risk model. Biometrika 81, 61–71. Lin, D.Y., Ying, Z. (1995). Semi-parametric analysis of general additive–multiplicative hazard models for counting processes. Ann. Statist. 23, 1712–1734. Lin, D.Y., Wei, L.J., Yang, I., Ying, Z. (2000). Semiparametric regression for the mean and rate function of recurrent events. J. Roy. Statist. Soc. Ser. B 62, 711–730. Martinussen, T., Scheike, T.H. (1999). A semi-parametric additive regression model for longitudinal data. Biometrika 86, 691–702. Martinussen, T., Scheike, T.H. (2002). A flexible additive multiplicative hazard model. Biometrika 89, 283– 298. Martinussen, T., Scheike, T.H., Skovgaard, I. (2002). Efficient estimation of fixed and time-varying covariate effects in multiplicative intensity models. Scand. J. Statist. 28, 57–74. Marzec, L., Marzec, P. (1997). On fitting Cox’s regression model with time-dependent coefficients. Biometrika 84, 901–908. McKeague, I.W. (1988). Asymptotic theory for weighted least squares estimators in Aalen’s additive risk model. In: Statistical Inference from Stochastic Processes, pp. 139–152. McKeague, I.W., Sasieni, P.D. (1994). A partly parametric additive risk model. Biometrika 81, 501–514. McKeague, I.W., Utikal, K.J. (1991). Goodness-of-fit tests for additive hazards and proportional hazards models. Scand. J. Statist. 18, 177–195. Murphy, S.A. (1993). Testing for a time dependent coefficient in Cox’s regression model. Scand. J. Statist. 20, 35–50. Murphy, S.A., Sen, P.K. (1991). Time-dependent coefficients in a Cox-type regression model. Stoch. Proccess. Appl. 39, 153–180. Nielsen, J.P., Linton, O.B. (1995). Kernel estimation in a nonparametric marker dependent hazard model. Ann. Statist. 23, 1735–1749. Pons, O. (2000). Nonparametric estimation in a varying-coefficient Cox model. Math. Meth. Statist. 9, 376– 398. Sasieni, P.D. (1992). Information bounds for the additive and multiplicative intensity models. In: Klein, J., Goel, P. (Eds.), Survival Analysis: State of the Art. Kluwer Academic, Dordrecht, pp. 249–263 (disc: P263-265). Sasieni, P.D. (1996). Proportional excess hazards. Biometrika 83, 127–141. Scheike, T. (2002a). The additive non-parametric and semi-parametric Aalen model as the rate function for a counting process. Lifetime Data Anal. 8, 247–262. Scheike, T.H. (2002b). Dynamic event history models. Dr. Scient Thesis. Univeristy of Copenhagen, Faculty of Sciences.
Time-varying effects in survival analysis
85
Scheike, T., Martinussen, T. (2002). On efficient estimation and tests of time-varying effects in the proportional hazards model. Scand. J. Statist. Submitted for publication. Scheike, T.H., Zhang, M.-J. (2002a). An additive–multiplicative Cox–Aalen model. Scand. J. Statist. 28, 75– 88. Scheike, T.H., Zhang, M.-J. (2002b). Extensions and applications of the Cox–Aalen survival model. Biometrics. Submitted for publication. Wei, L.J. (1984). Testing goodness of fit for proportional hazards model with censored observations. J. Amer. Statist. Assoc. 79, 649–652. Zahl, P. (2002). Regression analysis with multiplicative and time-varying additive regression coefficients with examples from breast and colon cancer. Statist. Medicine. Submitted for publication. Zucker, D.M., Karr, A.F. (1990). Non-parametric survival analysis with time-dependent covariate effects: A penalized partial likelihood approach. Ann. Statist. 18, 329–353.
5
Handbook of Statistics, Vol. 23 ISSN: 0169-7161 © 2004 Elsevier B.V. All rights reserved. DOI 10.1016/S0169-7161(03)23005-4
Kaplan–Meier Integrals
Winfried Stute
1. Introduction Assume that we observe independent identically distributed (i.i.d.) variables X1 , . . . , Xn on the real line from some unknown distribution function (d.f.) F , i.e., F (x) = P(X1 x),
x ∈ R.
The nonparametric maximum likelihood estimator (NPMLE) of F then equals 1 1{Xi x} , n n
Fn (x) =
x ∈ R,
i=1
the empirical distribution function. It plays an important role in statistical inference and many of its basic properties are summarized in the monograph by Shorack and Wellner (1986). A class of simple statistical functionals to which more complicated ones may often be traced back by appropriate analytical approximations or probabilistic projection methods are linear functionals of Fn or empirical integrals n 1 ϕ(Xi ), T (Fn ) = ϕ dFn = n i=1
where ϕ is a given function. In many applications, ϕ may vary within a given class of functions yielding a stochastic process indexed by ϕ. Simple ϕ’s are • • • •
ϕ(x) = x k ; ϕ(x) = 1{xx0 } ; ϕ(x) = eit x ; ϕ(x) = ψ(x, θ );
to name only a few. In the first example we obtain for T (Fn ) the kth empirical moment, the second yields Fn (x0 ), while the third gives the empirical characteristic function at t. Finally, the fourth choice leads to a parametrized family appearing in M-estimation. Under a finite first moment assumption, |ϕ| dF < ∞, the Strong Law of Large Numbers (SLLN) yields lim ϕ dFn = ϕ dF with probability one, n→∞
87
88
W. Stute
ϕ 2 dF < ∞, the Central Limit Theorem (CLT) gives us 1/2 n ϕ[dFn − dF ] → N 0, σ 2 in distribution,
while under
where
σ = 2
ϕ dF − 2
2 ϕ dF
.
Even much more elementary, we have E ϕ dFn = ϕ dF, i.e., the empirical integral is an unbiased estimator of the target ϕ dF . Since along with 2 these unknown, to compute confidence intervals quantities, also σ will be generally for ϕ dF , we need an estimator for σ 2 . Needless to say, in the present framework, an unbiased estimator of σ 2 is given by 1
ϕ(Xi ) − n−1 n
σn2 =
2 ϕ dFn .
i=1
In the analysis of lifetime data one often faces the problem of some kind of censorship. Under right censorship, rather than Xi , one observes Zi = min(Xi , Yi )
and δi = 1{Xi Yi } .
Here Yi is a so-called censoring variable assumed to be independent of Xi for each 1 i n. As a sequence, Y1 , . . . , Yn are also i.i.d. from some unknown d.f. G. The 0–1 variable δi indicates whether Xi is censored (δi = 0) or not (δi = 1). The problem one faces is to recover F or targets related with F from the available observations (Zi , δi ), 1 i n. This is a so-called inverse problem. A crucial quantity in this context is the cumulative hazard function of F : F (dy) , ΛF (x) = 1 − F (y−) [0,x]
where in the following F (y−) = lim F (x) x↑y
and F {y} = F (y) − F (y−). Similarly for ΛF . If, for some reason, we transform the nonnegative X to a random variable which may also take on negative values, the above integral should be computed over (−∞, x]. All what follows equally applies to this setup as well.
Kaplan–Meier integrals
Now, see Shorack and Wellner (1986), p. 301, 1 − ΛF {ai } , 1 − F (x) = e−Λc (x)
89
(1.1)
ai ∈A ai x
with Λc denoting the continuous part of ΛF and A being the set of its atoms (respectively jumps). The point is that (1.1) of course not only applies to F but to any d.f., in the sense that it reveals a way how to compute a d.f. when its cumulative hazard function is given. Under censorship we may introduce 1 (x) = P(Z x, δ = 1) H and H (x) = P(Z x),
x ∈ R,
where (Z, δ) denotes a prototype of (Zi , δi ). Since these variables are observable, we may compute 1n (x) = 1 1{Zi x,δi =1} H n n
i=1
and 1 1{Zi x} n n
Hn (x) =
i=1
and apply existing empirical process theory to these functions whenever necessary. Due to independence of X and Y we also have (1 − H ) = (1 − F )(1 − G) and 1 (x) = H
x
1 − G(y−) F (dy).
0
Conclude that
x
ΛF (x) = 0
1 (dy) H . [1 − H (y−)]
Plugging in the empirical counterparts we obtain x n 1n (dy) 1{Zi x,δi =1} H Λn (x) = = , [n − Rank Zi + 1] 0 [1 − Hn (y−)] i=1
the Nelson–Aalen estimator of ΛF . Now, using (1.1), we get the d.f. associated with Λn , namely n (x) = 1−F
n
i=1
1 − Λn {Zi }
1{Z x,δ =1} i
i
.
(1.2)
90
W. Stute
n which is more convenient A simple rearrangement of terms yields a representation of F for further purposes: 1{Z x} n i:n δ[i:n] n (x) = 1− . 1−F (1.3) n−i +1 i=1
Here, Z1:n Z2:n · · · Zn:n are the ordered Z-values, where ties within lifetimes or within censoring times are ordered arbitrarily and ties among lifetimes and censoring times are treated as if the former precede the latter. The label δ[i:n] denotes the concomitant associated with Zi:n , i.e., δ[i:n] = δj if Zi:n = Zj . If all δ’s equal 1, i.e., if there is n is due to Kaplan and Meier (1958), who n = Fn . The estimator F no censorship, then F derived it as a limit from then already existing life-table estimators. In view of its shape it is therefore called the product-limit estimator. The product structure is in contrast with the sum structure of Fn , which belongs to the empirical measure µn =
1 1 δX , δ Xi = n n i n
n
i=1
i=1
(1.4)
a sum of weighted Dirac-measures δXi , where 1 if x ∈ A, δx (A) = 0 if x ∈ / A. n , note that the To obtain the analog of (1.4) for the measures µˆ n associated with F weight attached to Zi:n equals δ[j:n] n−1 δ[i:n] n−j . Win = (1.5) n−i +1 n−j +1 j =1
Hence we may write µˆ n =
n
Win δZi:n
i=1
and, as a consequence, n Win ϕ(Zi:n ). ϕ dFn =
(1.6)
i=1
Such integrals are henceforth called Kaplan–Meier (K–M) integrals. If we put ϕ(x) = n (x0 ) back so that all results obtained for (1.6) particularly apply 1{xx0 } , we obtain F n as a process in x0 , we have to allow for a class of indicators. n itself. To study F to F n constitutes the NPMLE of F under random censorThe Kaplan–Meier estimator F ship. We may expect that K–M integrals play the same fundamental role for right censored data as ordinary empirical integrals play for standard i.i.d. data. It is the purpose of the present article to review some of the most important properties of K–M integrals. Section 2 will discuss their strong consistency, and in Section 3 their distributional convergence will be addressed. Bias considerations are surprisingly difficult now and are dealt with in Section 4. Issues related to variance estimation are reviewed in Section 5 while Section 6 summarizes many extensions and applications to the regression setting.
Kaplan–Meier integrals
91
2. The SLLN Historically, consistency under random censorship was first established for indicators, n (x) itself. Since F n (x) depends on Λn through (1.2) and Λn has a simple ini.e., for F tegral form, a promising strategy is to first analyze Λn . Standard properties of empirical n1 immediately yield d.f.’s applied to Hn and H lim sup Λn (x) − ΛF (x) = 0 with probability 1 (2.1) n→∞ xT
as long as T satisfies T < τH , where τH = inf x: H (x) = 1 ∞ is the least upper bound for the support of H . If F is continuous, then ΛF is unbounded on the real line so that the restriction to compact subsets of [0, τH ) is indispensable for uniform consistency. As a consequence, the approach via (2.1) does not give a quick n on the whole support answer as to uniform (or Glivenko–Cantelli) convergence of F of Z. Worse than that, the question whether an extension of the SLLN holds under right censorship, i.e., lim (2.2) ϕ dFn = ϕ dF with probability 1 n→∞
for a larger class of ϕ’s, is far from being trivial. Another possibility would be to analyze (1.6) directly, for a general ϕ. At this stage of the discussion it is worthwhile recalling the different techniques available to prove the ordinary SLLN: • Kolmogorov’s original proof and Etemadi’s (1981) beautiful modification. Their proofs heavily depend on the fact that the summands of the sample mean are independent and the weights all equal n−1 and are therefore nonrandom. In contrast, Eq. (1.6) reveals that K–M integrals are sums of weighted functions of order statistics, where the weights Win are random and depend on the labels in a complicated way. Note that Win = 0 whenever δ[i:n] = 0, i.e., Zi:n is censored. • Recalling that an i.i.d. sequence is strictly stationary and ergodic, the classical SLLN is also implied by the ergodic theorem. There is, however, little hope that K–M integrals can be handled within this framework. • Sample means are also martingales in reverse time so that the SLLN becomes a special case of a martingale convergence theorem. That the limit is a constant follows from the zero–one law. Martingales in n provide a general framework to which empirical integrals mayfit also n under random censorship. It may be seen, however, that the expectation of ϕ dF usually differs from n to n so that there is no hope that K–M integrals form a reverse martingale in n. Fortunately, it turns out that the probabilistic structure of K–M integrals is rich enough to make this technique applicable. For this, put Fn = σ (Zi:n , δ[i:n] , 1 i n, Zn+1 , δn+1 , . . .).
92
W. Stute
n is adapted to Fn with Fn ↓ F∞ . Furthermore, F∞ is trivial by the Hewitt– Then ϕ dF Savage zero–one law. The following relation is taken from Lemma 2.2 in Stute and Wang (1993a): n+1 − Rn+1 , E (2.3) ϕ dFn | Fn+1 = ϕ dF where Rn+1 =
n−1 n − j δ[j:n+1] 1 ϕ(Zn+1:n+1 )δ[n+1:n+1] (1 − δ[n:n+1] ) . n+1 n−j +1 j =1
If all data are uncensored, then Rn+1 = 0 so that (2.3) recovers the aforementioned fact that sample means of i.i.d. data form a reverse martingale in n. Under censorship the martingale structure may be violated. For nonnegative ϕ, we have Rn+1 0 so that at least n+1 . n | Fn+1 ϕ dF E ϕ dF It follows that for ϕ 0, K–M integrals are supermartingales in reverse time. Existing convergence theorems together with the Hewitt–Savage zero–one law yield convergence to a constant with probability one and in the mean. Since any ϕ may be decomposed into its positive and negative parts, the consistency is obtained for a general F -integrable ϕ. Since the data (Zi , δi ), 1 i n, provide no information τHabout F beyond τH , it is likely that K–M integrals can only provide estimators for −∞ ϕ dF . It turns out that in the presence of discontinuities also τH needs special caution. Identification of the limit leads to the following Theorem due to Stute and Wang (1993a). T HEOREM 2.1. Under |ϕ| dF < ∞, we have with probability 1 and in the mean: lim (2.4) ϕ(x)F (dx) + 1{τH ∈A} ϕ(τH )F {τH }, ϕ dFn = n→∞
{x<τH }
where A is the set of H -atoms (possibly empty). If F and G have unbounded support, then τH = ∞ so that the right-hand side of (2.4) equals ϕ dF . Cases when τH < ∞ are discussed in Stute and Wang (1993a). Theorem 2.1 in particular may be applied to all indicators ϕ(x) = 1{xt } , t τH . Note that τH is included so that we have pointwise consistency over the closed interval (−∞, τH ]. This is important to apply a uniformity argument for Glivenko–Cantelli n . The following result is due to Stute and Wang (1993a). convergence for F C OROLLARY 2.2. Put F (t) F (t) = F (τH −) + 1{τH ∈A} F {τH } Then
if t < τH , if t τH .
(t) → 0 with probability 1. sup Fn (t) − F t ∈R
Kaplan–Meier integrals
93
Wang (1999) applied Theorem 2.1 to obtain strong consistency of M-estimators under random censorship. Stute and Wang (1993b) extended the SLLN for K–M integrals to multi-sample U -statistics, while Bose and Sen (1999) were able to extend the methodology to one-sample U -statistics. From time to time practitioners doubt the validity of independence between X and Y . n also holds in the general A closer look at our proofs reveals that convergence of ϕ dF case. The limit then naturally needs to be expressed through quantities which determine the distribution of (Z, δ), namely H and m(x) = P(δ = 1 | Z = x). Putting
x−
γ0 (x) = 0
1 − m(y) H (dy), 1 − H (y)
one gets with probability 1 and in the mean lim ϕ dFn = ϕmγ0 dH, n→∞
(2.5)
which collapses to the right-hand side of (2.4) if X and Y are independent. If this as sumption is slightly violated it is likely that the limit (2.5) is close to ϕ dF so that K–M integrals are reliable estimators also under weak dependence between X and Y .
3. The CLT Kaplan and Meier (1958), in their landmark paper, not only derived the formula for n (x) but also added – on heuristic grounds – some useful comments on the (limit) coF n (x) and F n (y). Among other things they pointed out that the variance has variance of F many similarities with Greenwood’s (1926) and Irwin’s (1949) formula in connection with actuarial estimates. They also mention (p. 476) that “in the derivation of approxin (x) may have is neglected”. For the limit covariance they mate formulas any bias that F come up with the expression (in our terms) x 1−G dF. 1 − F (x) 1 − F (y) (3.1) 2 0 (1 − H ) In the context of functional distributional convergence (3.1) was justified by Breslow and Crowley (1974). In their extension of Donsker’s invariance principle for the empirical process, they showed that the Kaplan–Meier process
n (x) − F (x) , 0 x T < τH αˆ n (x) = n1/2 F weakly converges in the Skorokhod space D[0, T ] to a centered Gaussian process with covariance (3.1). This process may be written as a scaled time transformed Brownian motion α∞ (x) = 1 − F (x) BΓ (x) ,
94
W. Stute
where
x
Γ (x) = 0
1−G dF. (1 − H )2
For a general ϕ, the literature was less elaborate for some time. Kaplan and Meier (1958) also considered the mean lifetime pertaining to ϕ(x) = x. Since X is assumed to be nonnegative, integration by parts yields ∞ ∞ 1 − F (x) dx, xF (dx) = 0
0
respectively, ∞
n (dx) = xF
0
∞
n (x) dx. 1−F
(3.2)
0
n is a bona fide distribution function. This Note that the last equation only holds when F is the case if and only if the largest observation is uncensored. For a rigorous treatment of (3.2) Sander (1975) came to the conclusion that “it is extremely difficult to obtain the T distribution theory for the estimators of 0 (1 − F (x)) dx whenever T = ∞”. Susarla and Van Ryzin (1980) apparently were the first to provide a rigorous treatment for the mean lifetime estimator truncated at Mn but such that Mn → ∞ at appropriate rates, as n → ∞. Gill (1983) applied convergence of the Kaplan–Meier process plus integration by parts to obtain, under some additional tail assumptions on the censoring mechanism, distributional convergence of the mean lifetime estimator and K–M integrals for ϕ’s which are nonnegative, continuous and nonincreasing. Schick et al. (1988) obtained, for n in terms of a sum of i.i.d. random this class of ϕ’s, a weak representation of ϕ dF variables plus a remainder. In all of these papers integration by parts was essential. n , under regularity Yang (1994) was able to extend distributional convergence of ϕ dF conditions on F , to those ϕ’s satisfying ϕ2 dF < ∞. (3.3) 1−G See also Akritas (2000). The integral (3.3) will become part of the limit variance so that n as a sum of (3.3) is indispensable. Stute (1995) obtained a representation of ϕ dF i.i.d. random variables plus a remainder which is valid under no regularity assumptions on F and G. Moreover, the paper was written up for the case Z = min(X, Y ) only as a historical tribute but may be readily extended to the case of general censorship, in which as in Section 2 the distributional characteristics of the observed (Z, δ) are H and m and not F and G. The key observation of this approach is the fact that a K–M integral n may be written as ϕ dF n
Win ϕ(Zi:n )
i=1
=
ϕ(w) exp n 0
w−
ln 1 +
1 n1 (dw) n0 (dz) H H n(1 − Hn (z))
Kaplan–Meier integrals
95
n1 is defined as in the first section and correspondingly in which H n0 (x) = 1 1{Zi x,δi =0} . H n n
i=1
Expansion of the logarithmic term and neglecting error terms leads one to a U -statistic of degree three. Its Hájek projection is the desired (simple) sum of i.i.d. random variables to which the ordinary CLT applies. For a large class of ϕ’s the error terms are o(1) with probability one so that an application of the LIL also establishes the law of the iterated logarithm for K–M integrals. n was discussed in Stute (1995). The general formula for the limit variance of ϕ dF For the purpose of the present paper it is enough to consider independent censorship with a continuous F . We then have τH n − ϕ dF → N 0, σ12 in distribution ϕ dF n1/2 (3.4) 0
with
2 τH ϕ2 ϕ dF dF − 1−G 0 0 2 τH 1 − F (x) − ϕ dF G(dx). [1 − H (x)]2 x
σ12 =
τH
(3.5)
Note that in this three-terms formula for σ12 , the last term vanishes if there is no censorship (G ≡ 0) so that in this case σ12 reduces to σ 2 from Section 1:
2 σ12 = σ 2 = ϕ 2 dF − ϕ dF . Akritas (2000) used continuous time martingale theory to come up with a variance which may be expressed through the function τH 1 ϕ(x) ˜ = 1 − F (x−) ϕ(x) − ϕ dF . 1 − F (x) x We prefer, however, (3.5) since it not only reduces to σ 2 if G ≡ 0 but also since the automatic estimator of σ12 proposed and studied in Section 5 mimics (3.5). A useful extension of the above result is due to Bose and Sen (2002) who also obtained the CLT for K–M U -statistics.
4. Bias n (x) was already briefly discussed in Kaplan As we learned in Section 2, the bias of F and Meier (1958). A first rigorous treatment may be found in Gill’s (1980) thesis. In his formula (3.2.17) he showed that n (x) − F (x) ≡ Bias F n (x) 0, −F (x)H n (x) EF
96
W. Stute
n (x) is always biased downwards. It also reveals that Kaplan and Meier (1958) i.e., F were right in neglecting the bias when x with H (x) < 1 is fixed. What the left inequality also suggests is that the bias increases as x gets large and that it may then become a nonnegligible quantity. Mauro (1985) extended the right inequality to a general K–M integral:
n 0 for ϕ 0. Bias ϕ dF This is also immediate from integrating (2.3). Zhou (1988) was able to establish a lower bound whenever ϕ 0 is continuous and Riemann-integrable:
n n . − ϕ(t)H (t)F (dt) Bias ϕ dF Phadia and Shao (1999) and Zhang (1999) derived an exact expression for the kth mon (x). ment of 1 − F In Stute (1994b) we derived a formula and an expansion for the bias of a general K–M integral in such a way that (see p. 476): (1) (2) (3) (4) (5)
unbiasedness was readily recovered if there is no censorship; Bias → 0 as n → ∞ for a general ϕ; sharp lower and upper bounds are easily available; all expressions only depend on the joint distribution of the observed (Z, δ)’s; the effect of light, medium or heavy censoring on the bias may be easily discovered.
The solution to this program is surprisingly complicated. But what comes out is that informally speaking the bias of a Kaplan–Meier integral may – be zero, if there is no censoring; – decrease to zero exponentially fast, if, e.g., ϕ is bounded and vanishes right of some T < τH ; – decrease to zero at any polynomial rate, if, e.g., 0 ϕ(x) ↑ ∞ as x → ∞ and censoring is heavy. In particular, the bias may decrease to zero at a rate slower than n−1/2 and therefore becomes an important quantity in assessing the quality of the approximation of ϕ dF n . Gather and Pawlitschko (1998) showed that if ϕ 0 is nondecreasing, by ϕ dF the bias becomes smaller if we set artificially δ[n:n] = 1 even if the largest datum is censored. Denote this estimator with Fn∗ . See also Chen et al. (1982). Wellner (1985) n (x) with Fn∗ (x), i.e., for the nonincreasing ϕ = 1[0,x] , and was led to prefer compared F Fn , because in the cases investigated by him the upward bias of Fn∗ was worse than the n . This puzzling effect is caused by the fact that F n need not be a downward bias of F bona fide d.f. so that what is good for a nondecreasing ϕ does not automatically apply to a nonincreasing one. n which is based on the followStute (1994a) proposed another modification of F ing observation. Suppose that all X’s were observable. Then the empirical d.f. based estimate of ΛF would be Λn (x) =
n 1{Xi:n x} . n−i +1 i=1
(4.1)
Kaplan–Meier integrals
97
In order to measure the impact of censoring we compute the conditional expectation of the Nelson–Aalen estimator with respect to the ordered X’s. It then turns out that n
1{Xi:n x} E Λn (x) | Xi:n , 1 i n = 1 − Gn−i+1 (Xi:n ) . n−i +1 i=1
Compared with (4.1) we see that censoring causes an additional bias term n 1{Xi:n x} n−i+1 G (Xi:n ). n−i+1
(4.2)
i=1
This is particularly large if G compared with F has short tails. Since (4.2) is unknown n and then to substione may be tempted to replace G by its Kaplan–Meier estimator G tute the (unknown) X-sample by some bootstrap replicates X1∗ , . . . , Xn∗ . Utilizing (1.1) n : again we finally come up with the following modified version of F n n ∗ ) n−i+1 ∗ x} G (Xi:n 1{Xi:n 1{Zi:n x,δ[i:n] =1} n n1 (x) = . 1− 1− 1−F n−i+1 n−i +1 i=1
i=1
n1 only jumps at the Z’s, we obtain for some weights W 1 : Since F in n1 (x) = F
n
1 Win 1{Zi:n x} .
i=1
Likewise,
n1 = ϕ dF
n
1 Win ϕ(Zi:n ).
i=1 1 W so that for ϕ 0 the modified procedure reduces the It is easily seen that Win in 1 and W becomes downward bias of the K–M integral. The difference between Win in negligible for small to moderate i while for i = n, n − 1, . . . there may be a difference resulting in an upweighing of the extreme order statistics. The asymptotic theories for both estimators are the same. For finite size, Stute (1994a) pointed out through sample n1 may have a significantly smaller bias and, an extensive simulation study that ϕ dF somewhat unexpectedly, also a smaller variance.
5. The jackknife The jackknife has been proposed to serve two purposes, see Quenouille (1956) and Tukey (1958): (i) If Tn happens to be a biased statistic, the jackknife is expected to provide a modification of Tn with a smaller bias. For later reference, let Tn = S(Fn ) be a statistical functional evaluated at the (ordinary) empirical distribution function Fn . Denote
98
W. Stute
with Fn(k) the empirical d.f. of the sample X1 , . . . , Xk−1 , Xk+1 , . . . , Xn and put Tn := n−1
n S Fn(k) . k=1
Then the bias-corrected substitute for Tn is defined as Tn = Tn − (n − 1) Tn − Tn . (ii) In the above notation, the jackknife estimate of variance of Tn is defined as Var(Jack) =
n − 1 (k) 2 Tn − Tn n n
k=1
with Tn(k) = S Fn(k) . A general account of the jackknife may be found in Gray and Schucany (1972) and Efron and Tibshirani (1993). For Tn = ϕ dFn , there is no need for a bias correction. This is also confirmed by the jackknife, in view of Tn = Tn . The jackknife estimate of variance equals n−1 times the sample variance, which is what one would expect. Note that the crucial thing about (i) and (ii) is that the statistic of interest is a function of Fn and therefore attaches mass 1/n to each of the data. As a consequence deletion of one point just results in a change of the mass 1/n to 1/(n − 1). For the K–M integral the situation is completely different since now the statistic is a sum of (functions n(k) the of) order statistics weighted by the complicated random Win ’s. Denoting with F n(k) ) not Kaplan–Meier estimator from the entire sample except (Zk:n , δ[k:n] ), then S(F only involves changes of the standard weights, but also incorporates replacement of the weights Win by new ones depending on the labels δ[i:n] , 1 i n. This may be one of the reasons why the jackknife under random censorship has been dealt with only in few papers. Gaver and Miller (1983) proved that the jackknife corrected Kaplan–Meier estin (x). Stute and Wang (1994) mator at a fixed x < τH has the same limit distribution as F derived, for an arbitrary ϕ, a finite sample formula for the jackknife modification of ϕ n : Sn ≡ ϕ dF n−2 n − 1 − j δ[j:n] n−1 ϕ(Zn:n )δ[n:n] (1 − δ[n−1:n] ) Snϕ + . Snϕ = n n−j
(5.1)
j =1
Hence the correction term depends on the largest Z-observation only but on all δconcomitants. Also the jackknife is much more cautious about attaching masses to the last observation when it is censored than what has been recommended in the ad-hoc proposal leading to Fn∗ in the previous section. It is also worthwhile to compare the correction term in (5.1) with Rn+1 in (2.3). First, both vanish unless the largest observation is uncensored and the second last is censored. Only in this case the extreme right data contain enough information on F to make a slight change of Wnn desirable. Shen (1998) extended (5.1) to the delete-2 jackknife but came to the conclusion that
Kaplan–Meier integrals
99
for nondecreasing ϕ’s both jackknife corrected estimators are outperformed by with Fn∗ defined in Section 4. As to the variance, (3.5) suggests that
ϕ dFn∗
ϕ σ12 as n → ∞. Var Sn ∼ n So what Var(Jack) is expected to do is nVar(Jack) → σ12
(5.2)
with probability 1.
Since (omitting ϕ) nVar(Jack) = (n − 1)
n
Sn(k)
2
− n(n − 1) S 2n
(5.3)
k=1
and Sn(k)
k−1 i−1 ϕ(Zi:n )δ[i:n] n − j − 1 δ[j:n] = n−i n−j j =1
i=1
+
δ[j:n] n k−1 i−1 n−j ϕ(Zi:n )δ[i:n] n − j − 1 δ[j:n] n−i +1 n−j n−j +1 j =1
i=k+1
j =k+1
already is a complicated expression to be squared in (5.3), it is a priori not obvious at all if Var(Jack) is able to work out the three terms in the expression (3.5) for σ12 . In Stute (1996a) a finite sample formula for nk=1 [Sn(k) ]2 was derived from which one obtains that up to an error term nVar(Jack) = (n − 1)
n−1
ϕ 2 (Zi:n )δ[i:n]
i−1 n − j − 1 2δ[j:n] 1 n 2 − S (n − i)2 n−j n−1 n j =1
i=1
j −1 n−2 (n − k − 1)(n − k + 1) 2δ[k:n] − (n − 1) (1 − δ[j :n] )bj (n − k)(n − k) j =1
×
n
k=1
2 ϕ(Zi:n )Win
,
i=j +1
where bj = bj n =
1 1 1 1 − . − + (n − j − 1)2 (n − j )2 (n − j − 1) n − j
This somewhat mysterious representation of nVar(Jack) in fact constitutes the empirical analog of the three-terms expression (3.5) for σ12 and collapses to the classical estimator
100
W. Stute
of σ 2 if there is no censorship. By the SLLN for K–M integrals the second term converges to −( ϕ dF )2 . The first and third expressions need some special care. But after all it can in fact be shown that they converge to the desired limits. Provided the error term is negligible these pieces altogether would imply (5.2). Unfortunately, and somewhat unexpectedly, this holds true only when ϕ(x) → 0 as x → τH . So, in particular, the jackknife yields a consistent estimate of σ12 for ϕ = 1[0,t ] with t < τH . For a general ϕ, it may be inconsistent due to the observation that the remainder term becomes nonnegligible iff |ϕ(Zn:n )| is moderately large and δ[n−1:n] = 0
and δ[n:n] = 1.
(5.4)
If, under (5.4), we redefine δ[n:n] by artificially putting δ[n:n] = 0, we obtain a slightly changed version of Var(Jack), for which the remainder term vanishes and the three leading terms still converge. In other words, this modification satisfies (5.2) under the only assumption that σ12 is finite. T HEOREM 5.1 (Stute (1996a)). Under ity 1:
< ∞, we have with probabilϕ 2 /(1 − G) dF
= σ12 . lim nVar(Jack)
n→∞
6. Censored correlation and regression In many situations we not only observe (Z, δ) but also a covariable vector U associated with the true but possibly censored lifetime X. In such a situation one may be interested in the joint distribution F 0 (u, x) = P(U u, X x),
u ∈ Rp , x ∈ R.
Here p is the dimension of U and U u is to be understood componentwise. In this setup the vector U is always observable but may be correlated with the censoring variable. Sometimes the dependence between U and X is assumed to be of a particular type. As to regression we only mention the Cox-proportional hazards model and the accelerated failure time regression model. See, e.g., Kalbfleisch and Prentice (1981), Lawless (1982), Ritov (1990) and Tsiatis (1981). We first discuss some estimation issues where no such model assumptions are required and the approach is completely nonparametric. Also no conditions as to continuity etc. are needed. For identifiability reasons we just have to require that P(δ = 1 | U, X) = P(δ = 1 | X).
(6.1)
Condition (6.1) may be viewed as a Markov property of the “sequence” U, X, δ. It was introduced in Stute (1993) and further discussed in Stute (1996b, 1999). We observe independent data (Ui , Zi , δi ), 1 i n. A function ϕ may now also depend on Ui so that the K–M integral becomes Snϕ ≡ Sn =
n i=1
Win ϕ(U[i:n] , Zi:n ).
(6.2)
Kaplan–Meier integrals
101
The random vector U[i:n] denotes the concomitant vector associated with Zi:n . To demonstrate the richness of the above class of statistics we present some examples of ϕ together with the targets: • ϕ(u, x) = 1{uu0 ,xx0 } leads to the K–M estimator of F 0 (u0 , x0 ): n
0n (u0 , x0 ) = F
Win 1{U[i:n] u0 ,Zi:n x0 } .
i=1
• For univariate U ’s, consider ϕ1 (u, z) = uz, ϕ4 (u, z) = z2 ,
ϕ2 (u, z) = z, ϕ5 (u, z) = u2 .
ϕ3 (u, z) = u,
ϕ
Denote with Sn i the corresponding K–M integrals. Combination of these yields estimates of the covariance and correlation of (U, X). Rank correlation is dealt with in Stute (1993). • Set, for B ⊂ Rp (measurable) and y ∈ R: ϕ1 (u, z) = (z − y)1{z>y,u∈B} , ϕ Sn 1
ϕ2 (u, z) = 1{z>y,u∈B} .
ϕ Sn 2
The ratio of and estimates the mean residual lifetime at y, subject to U ∈ B. • Here we assume that the true (Ui , Xi ) satisfy a linear regression model Xi = Uit β0 + εi ,
1i n
(possibly after an appropriate transformation of Xi ). The nonlinear case was dealt with in Stute (1999). The errors satisfy E[εi | Xi ] = 0, but dependence between εi and Xi as in many heteroscedastic models is allowed. The weighted least squares estimator in the present framework is defined as the minimizer βn of β→
n
2 t Win Zi:n − U[i:n] β ≡ Sn (β).
i=1
It has the explicit representation −1 n , βn = M1n M2n Z
where n = (Z1:n , . . . , Zn:n )t Z and M1n (i, j ) =
n
j
i Wkn U[k:n] U[k:n] ,
1 i, j p,
k=1 i M2n (i, s) = Wsn U[s:n] ,
1 i p, 1 s n.
i Here U[s:n] denotes the ith coordinate of U[s:n] .
102
W. Stute
Now, it may be seen that in all examples the consistency of the relevant estimators may be traced back to the consistency of proper K–M integrals (6.2). In the present situation the analog of Theorem 2.1 becomes (see Stute (1993)) lim Snϕ = ϕ(U, X) dP + 1{τH ∈A} ϕ(U, τH ) dP = S ϕ . n→∞
{X<τH }
{X=τH }
ϕ Sn
As a possible application the strong consistency of applied to proper ϕ’s yields the strong consistency of βn . The statistic (6.2) also allows for an i.i.d. representation which yields the asymptotic ϕ normality of n1/2 (Sn − S ϕ ). See Stute (1996b) for details. As one of several applications we obtained the asymptotic normality of n1/2 (βn − β0 ). The limit covariance matrix can be consistently estimated by utilizing the aforementioned jackknife applied to proper ϕ’s. As another application we briefly mention an extension of the F -test when the dependent variable is subject to censoring. Assume that the (linear) hypothesis of interest is H : Aβ0 = c, where A and c are a given q × p matrix and a q-vector, respectively. The weighted least squares estimator of β0 with K–M weights satisfying H then equals −1 t −1 t −1 A AM1n A (Aβn − c). βˆH = βn − M1n The corresponding F -type test statistic becomes t −1 −1 t −1 Ln = n βn − βˆH At AM1n ΣM1n A A βn − βˆH . Here Σ is an estimable covariance matrix obtained from the linear expansion of several K–M integrals. It may then be shown that Ln → χq2
in distribution,
(6.3)
where χq2 is the chi-square distribution with q degrees of freedom. Assertion (6.3) constitutes the asymptotic extension of the famous F -test to censored regression. As another application in censored regression, we only mention that results on K–M integrals may be applied to get prediction intervals for a future lifetime given the covariable. The F -test is an example of a test, where a certain hypothesis about a parameter is tested but there is no doubt about the overall validity of the model. Tests assessing the goodness-of-fit of the model are different and have found a lot of interest in the last ten years. As to censored regression, K–M methodology was applied in this context in Stute et al. (2000).
7. Conclusions K–M integrals are analogs of empirical integrals when the data are subject to right censoring. They may be viewed as basic statistics to which more complicated quantities
Kaplan–Meier integrals
103
may be traced back through linearization. In this article we reviewed the most important properties of K–M integrals: Strong and distributional convergence as well as bias and variance issues. Also K–M integrals (or sums) have interesting applications in multivariate statistics.
References Akritas, M.G. (2000). The central limit theorem under censoring. Bernoulli 6, 1109–1120. Bose, A., Sen, A. (1999). The SLLN for Kaplan–Meier U -statistics. J. Theoret. Probab. 12, 181–200. Bose, A., Sen, A. (2002). Asymptotic distribution of the Kaplan–Meier U -statistics. J. Multivariate Anal. Submitted for publication. Breslow, N.E., Crowley, J.J. (1974). A large sample study of the life table and product-limit estimates under random censorship. Ann. Statist. 2, 437–453. Chen, Y.Y., Hollander, M., Langberg, N.A. (1982). Small sample results for the Kaplan–Meier estimator. JASA 77, 141–144. Efron, B., Tibshirani, R.J. (1993). An Introduction to the Bootstrap. Chapman and Hall, New York. Etemadi, N. (1981). An elementary proof of the strong law of large numbers. Z. Wahrscheinlichkeitstheorie Verw. Gebiete 55, 119–122. Gather, U., Pawlitschko, J. (1998). On Efron’s and Gill’s version of the Kaplan–Meier integral. Comm. Statist. Theory Meth. 27, 181–192. Gaver, N.P., Miller, R.G. (1983). Jackknifing the Kaplan–Meier survival estimator for censored data: Simulation results and asymptotic analysis. Comm. Statist. Theory Meth. 12, 1701–1718. Gill, R.D. (1980). Censoring and Stochastic Integrals. In: Math. Centre Tracts, Vol. 124. Math. Centrum, Amsterdam. Gill, R.D. (1983). Large sample behavior of the product-limit estimator on the whole line. Ann. Statist. 11, 49–58. Gray, H.L., Schucany, W.R. (1972). The Generalized Jackknife Statistics. Dekker, New York. Greenwood, M. (1926). The natural duration of cancer. Reports on Public Health and Medical Subjects, No. 33. His Majesty’s Stationary Office. Irwin, J.O. (1949). The standard error of an estimate of expectational life. J. Hygiene 47, 188–189. Kalbfleisch, J.D., Prentice, R.L. (1981). The Statistical Analysis of Failure Time Data. Wiley, New York. Kaplan, E.L., Meier, P. (1958). Nonparametric estimation from incomplete observations. JASA 53, 457–481. Lawless, J.F. (1982). Statistical Models and Methods for Lifetime Data. Wiley, New York. Mauro, D. (1985). A combinatoric approach to the Kaplan–Meier estimator. Ann. Statist. 13, 142–149. Phadia, E.G., Shao, P.Y. (1999). Exact moments of the product limit estimator. Statist. Probab. Lett. 41, 277– 286. Quenouille, M.H. (1956). Notes on bias in estimation. Biometrika 43, 353–360. Ritov, Y. (1990). Estimation in a linear regression model with censored data. Ann. Statist. 18, 303–328. Sander, J.M. (1975). Asymptotic normality of linear combinations of functions of order statistics with censored data. Tech. Report, No. 8. Div. Biostatistics Stanford University. Schick, A., Susarla, V., Koul, H. (1988). Efficient estimation of functionals with censored data. Statist. Decisions 6, 349–360. Shen, P.-S. (1998). Problems arising from jackknifing the estimate of a Kaplan–Meier integral. Statist. Probab. Lett. 40, 353–361. Shorack, G.R., Wellner, J.A. (1986). Empirical Processes with Applications to Statistics. Wiley, New York. Stute, W. (1993). Consistent estimation under random censorship when covariables are present. J. Multivariate Anal. 45, 89–103. Stute, W. (1994a). Improved estimation under random censorship. Comm. Statist. Theory Meth. 23, 2671– 2682. Stute, W. (1994b). The bias of Kaplan–Meier integrals. Scand. J. Statist. 21, 475–484. Stute, W. (1995). The central limit theorem under random censorship. Ann. Statist. 23, 422–439.
104
W. Stute
Stute, W. (1996a). The jackknife estimate of variance of a Kaplan–Meier integral. Ann. Statist. 24, 2679–2704. Stute, W. (1996b). Distributional convergence under random censorship when covariables are present. Scand. J. Statist. 23, 461–471. Stute, W. (1999). Nonlinear censored regression. Statist. Sinica 9, 1089–1102. Stute, W., González Manteiga, W., Sánchez Sellero, C. (2000). Nonparametric model checks in censored regression. Comm. Statist. Theory Meth. 29, 1611–1629. Stute, W., Wang, J.L. (1993a). The strong law under random censorship. Ann. Statist. 21, 1591–1607. Stute, W., Wang, J.L. (1993b). Multi-sample U -statistics for censored data. Scand. J. Statist. 20, 369–374. Stute, W., Wang, J.L. (1994). The jackknife estimate of a Kaplan–Meier integral. Biometrika 81, 602–606. Susarla, V., Van Ryzin, J. (1980). Large sample theory for an estimator of the mean survival time from censored samples. Ann. Statist. 8, 1002–1016. Tsiatis, A.A. (1981). A large sample study of Cox’s regression model. Ann. Statist. 8, 93–108. Tukey, J.W. (1958). Bias and confidence in not quite large samples. Ann. Math. Statist. 29, 614 (Abstract). Wang, J.L. (1999). Asymptotic properties of M-estimators based on estimating equations and censored data. Scand. J. Statist. 26, 297–318. Wellner, J.A. (1985). A heavy censoring limit theorem for the product limit estimator. Ann. Statist. 13, 150– 162. Yang, S. (1994). A central limit theorem for functionals of the Kaplan–Meier estimator. Statist. Probab. Lett. 21, 337–345. Zhang, P.H. (1999). Exact bias and variance of the product limit estimator. Sankhy¯a (Ser. B) 61, 413–421. Zhou, M. (1988). Two-sided bias bound of the Kaplan–Meier estimator. Probab. Theory Rel. Fields 79, 165– 173.
6
Handbook of Statistics, Vol. 23 ISSN: 0169-7161 © 2004 Elsevier B.V. All rights reserved. DOI 10.1016/S0169-7161(03)23006-6
Statistical Analysis of Doubly Interval-Censored Failure Time Data
Jianguo Sun
1. Introduction This article discusses statistical analysis of doubly interval-censored failure time data (De Gruttola and Lagakos, 1989; Fang and Sun, 2001). By doubly interval-censored data we mean that the survival time of interest is defined as the elapsed time between two related events, called initial and subsequent events. Furthermore, observations on the occurrences of both events could be right- or interval-censored. A right-censored observation means that the occurrence time of an event is known either exactly or to be greater than a censoring time (Kalbfleisch and Prentice, 1980), while an intervalcensored observation means that the occurrence of an event is observed only to belong to an interval (Sun, 1998). One field that often sees doubly interval-censored failure time data is disease progression or epidemiological studies where initial and subsequent events may represent infection and subsequent onset of certain disease, respectively. In these situations, doubly interval-censored observations occur mainly due to the nature of the disease and/or the structure of the study design. A well-known example of doubly interval-censored data arises from follow-up studies of patients who have been or are at risk of being infected by the human immunodeficiency virus (HIV) and thus are also at risk of developing the acquired immune deficiency syndrome (AIDS). In this case, one variable, which is of great interest to clinicians and physicians and which plays an important role in the study of natural history of the disease and in projections of the course of the epidemic, is AIDS incubation time (survival time of interest), the time between the HIV infection (initial event) and the diagnosis of AIDS (subsequent event). Since the HIV infection can usually only be determined through periodic blood tests, observations on it are thus often interval-censored and given in the form of the dates of the last negative test and the first positive test. In the meantime, observations on the diagnosis of AIDS could be either right- or interval-censored due to, for example, the end of the study and the periodic follow-up nature of the study design (De Gruttola and Lagakos, 1989; Kim et al., 1993). Doubly interval-censored failure time data include usual right- or interval-censored failure time data as special cases (Kalbfleisch and Prentice, 1980; Sun, 1998). For exam105
106
J. Sun
ple, they reduce to interval-censored data if the occurrence of initial event can be exactly observed and observations on the occurrence of subsequent event are interval-censored. Furthermore, if observations on the occurrence of subsequent event are right-censored, we then have usual right-censored failure time data for the survival time of interest. Note that in the above special cases, for the analysis of the survival time, it is equivalent to treat the occurrence time of the initial event being time zero, which is what is usually done in this case. The analysis of doubly interval-censored data has recently attracted much attention, especially in the context of the analysis of AIDS incubation time (Bacchetti, 1990; Jewell, 1994; Jewell et al., 1994; Gómez and Lagakos, 1994; Sun, 1995, 1997; Tu, 1995). In this case, most of researches focus on two basic problems: nonparametric estimation of the distribution function of the AIDS incubation time and its regression analysis. In addition to interval-censoring, another factor that complicates the analysis is left-truncation. The truncation occurs since an AIDS cohort follow-up study usually includes only subjects who have been infected by HIV, but not developed AIDS at the time of recruitment. This means that the subject’s AIDS incubation time is left-truncated by the time from HIV infection to the recruitment to the study. The first paper that considered nonparametric estimation of the distribution function of the AIDS incubation time is given by De Gruttola and Lagakos (1989). They discussed situations without truncation and proposed to estimate jointly the distribution of HIV infection time and the AIDS incubation distribution using the full likelihood approach. In particular, they proposed a self-consistency algorithm for the joint estimation. Following De Gruttola and Lagakos (1989), a few other authors considered the same problem. For example, Gómez and Lagakos (1994) and Gómez and Calle (1999) presented some marginal estimation methods also for no truncation situation. Lim et al. (2002), Sun (1995, 1997) and Tu (1995) developed some algorithms for the situation where there exist both doubly interval-censoring and left-truncation. Frydman (1992, 1995) discussed the problem under the framework of three-state Markov model. For regression analysis of doubly interval-censored failure time data, several authors considered the problem under the proportional hazards model for the survival time of interest (Cox, 1972; Kalbfleisch and Prentice, 1980). Among these, Kim et al. (1993) studied the full likelihood approach for analyzing AIDS incubation time and derived the maximum likelihood estimates of the distribution of HIV infection time, the baseline survival function of the AIDS incubation time and regression parameters. Goggins et al. (1999) used the same approach and presented a Monte Carlo EM algorithm. In contrast, to investigate the effect of covariates on AIDS incubation time, Sun et al. (1999) developed an estimating equation-based approach that only involves estimation of regression parameters of interest. Following Sun et al. (1999), Pan (2001) presented a multiple imputation method for the problem. Other references that discuss the analysis of doubly interval-censored data include Fang and Sun (2001) and Sun (2001). The former studied the asymptotic consistency of the nonparametric maximum likelihood estimate of the distribution of survival time of interest, while the latter considered the treatment comparison problem and proposed a nonparametric test procedure. Many authors have considered the analysis of right- and interval-censored failure time data, the special cases of doubly interval-censored data and this is especially
Statistical analysis of doubly interval-censored failure time data
107
the case for right-censored data. Among others, an excellent book about the analysis of right-censored data is given by Kalbfleisch and Prentice (1980). For intervalcensored data, several review papers have been given (Huang and Wellner, 1997; Lindsey and Ryan, 1998; Sun, 1998), where one can find most references about the methods proposed for their analyses. The remainder of the article is organized as follows. Section 2 discusses nonparametric estimation of the distribution of the survival time of interest. In particular, we will first consider the situation where no truncation exists and then talk about the situation with truncation on observations on the occurrence of subsequent event. Several algorithms will be described and compared for the nonparametric estimation. Section 3 deals with regression analysis of doubly interval-censored failure time data. For this, we will discuss two methods for fitting the proportional hazards model to the data. Section 4 considers the problem of nonparametric comparison of survival functions based on doubly interval-censored failure time data and Section 5 concludes the article with some discussion and directions for future researches. Throughout the article, we will assume that the survival time of interest is independent of the time of the occurrence of initial event (De Gruttola and Lagakos, 1989; Kim et al., 1993; Sun, 2001). Some comments on this will be given below. Also we will assume that the mechanisms yielding right- or interval-censoring and truncation are independent of the underlying survival time of interest.
2. Nonparametric estimation of a distribution function Consider a survival study that involves n independent subjects. For subject i, let Xi and Si denote the times of occurrences of initial and subsequent events, respectively, i = 1, . . . , n. Define Ti = Si − Xi , the survival time of interest. In an AIDS cohort study, Xi and Si represent HIV infection time and AIDS diagnosis time, respectively, and Ti corresponds to AIDS incubation time. In this section, we will assume that all random variables Xi , Si and Ti take discrete values (De Gruttola and Lagakos, 1989; Sun, 1997). Suppose that for each subject, two intervals [Li , Ri ] and [Ui , Vi ] are observed to which Xi and Si belong. That is, Xi ∈ [Li , Ri ] and Si ∈ [Ui , Vi ], i = 1, . . . , n. Furthermore, suppose that there exists a truncation interval [Bi1 , Bi2 ] for Si . That is, information about Si is available only if the subsequent event occurs inside the interval [Bi1 , Bi2 ]. Consequently, [Ui , Vi ] ⊂ [Bi1 , Bi2 ] and we have truncated and doubly interval-censored data on the Ti ’s. If Bi1 = 0 and Bi2 = ∞, we then have usual doubly interval-censored failure time data. Furthermore, if Li = Ri , the data on the Ti ’s become interval-censored failure time data (Sun, 1998), while they reduce to right-censored data if we also have Ui = Vi or Vi = ∞ (Kalbfleisch and Prentice, 1980), i = 1, . . . , n. 2.1. Estimation without truncation In this subsection, we consider the situation where Bi1 = 0 and Bi2 = ∞, i = 1, . . . , n. That is, there does not exist truncation. Let u1 < · · · < ur denote the possible mass
108
J. Sun
points for the Xi ’s and v1 < · · · < vs the possible mass points for the Ti ’s. Define αji k = I (Li uj Ri , Ui uj + vk Vi ), wj = Pr(Xi = uj ) and fk = Pr(Ti = vk ), j = 1, . . . , r, k = 1, . . . , s. Then the full likelihood function L1 can be written as n r s L1 {wj }j =1,...,r , {fk }k=1,...,s = αji k wj fk
(1)
i=1 j =1 k=1
(De Gruttola and Lagakos, 1989). To estimate the distribution function F = {fk }k=1,...,s of the Ti ’s, we will describe two algorithms. The first one (De Gruttola and Lagakos, 1989) is a generalization of the self-consistency algorithm given in Turnbull (1976) for interval-censored and truncated failure time data. It is based on the above full likelihood function and jointly estimates F and H = {wj }j =1,...,r , the distribution function of the Xi ’s, together. The second algorithm (Gómez and Lagakos, 1994) uses the same self-consistency idea, but involves two steps and estimates F and H separately. Define αji k wj fk , s i l=1 m=1 αlm wl fm
Iji k = r wj∗
1 i = Ij k , n n
s
i=1 k=1
fk∗
(2)
1 i = Ij k , n n
r
(3)
i=1 j =1
j = 1, . . . , r, k = 1, . . . , s. Note that the quantity Iji k is the conditional expectation of the event Xi = uj and Ti = vk , and ni=1 Iji k can be regarded as an estimate of the number of subjects with Xi = uj and Ti = vk given the observed data. Of course, they are functions of F and H except when exact data on both Xi and Si are obtained. Using the Iji k ’s, for estimation of F , De Gruttola and Lagakos (1989) proposed the following self-consistency algorithm, which will be referred to as method I. Step 1. Choose starting values for F and H . Step 2. Compute the Iji k ’s, wj∗ ’s and fk∗ ’s (updated estimates of the wj ’s and fk ’s) from Eqs. (2) and (3), respectively. Step 3. Repeat step 2 until convergence. It can be shown that the estimate resulting from this algorithm is either a saddle point or local maximum of the likelihood function L1 . One way to distinguish the maximum likelihood estimate from a saddle point is to examine the matrix evaluated at the final estimate of negative second derivatives of the logarithm of L1 with respect to F and H . If the eigenvalues of the matrix are positive, then the estimate is a local or globe maximum and if they are both positive and negative, the estimate is a saddle point. Given the wˆ j ’s and fˆk ’s, the cumulative distribution functions of the Xi ’s and Ti ’s can be estimated, respectively, by (x) = (t) = H wˆ j , F fˆk . uj x
vk t
Statistical analysis of doubly interval-censored failure time data
109
Note that if Li = Ri , the above algorithm reduces to the self-consistency algorithm given in Turnbull (1976) for interval-censored data. In this case, we have i α.k fk i m=1 α.m fm
I.ki = s and fk∗ =
(4)
1 i I.k , n n
(5)
i=1
i i = I (Ui xi + vk Vi ), or α.k = I (Ui vk Vi ) if treating all xi = 0. The where α.k same algorithm can also be found in Sun (1998). To describe the second algorithm, which will be referred to as method II, suppose that Ui = Vi or Vi = ∞, i = 1, . . . , n. That is, right-censored data on the Si ’s are obtained. Note that in this case, if one is only interested in estimating H , it is natural to employ the marginal likelihood n Lm {wj }j =1,...,r = wj i=1 j :Li uj Ri
based on only interval-censored data on the Xi ’s. For estimation of F , one can then assume that H is known and use the full likelihood function L1 given in (1), which reduces to L1 {fk }k=1,...,s | {wj }j =1,...,r δ 1 δ 2 n i i = wj fk i=1
j,k:Li uj Ri ,uj +νk =Ui
×
δ 1 (1−δ 2 ) i
wj fk
i
,
j :Li uj Ri k:uj +vk Ui
where δi1 = I (Ri < ∞) and δi2 = I (Ui = Vi ), i = 1, . . . , n. This is the idea behind method II given in Gómez and Lagakos (1994), which can be described as follows. Step 1. Estimate H = ({wj }j =1,...,r ) using the nonparametric marginal maximum likelihood estimate from Lm , which can be obtained by method I with replacing (2) and (3) by (4) and (5). Step 2. Given wj = wˆ j from step 1 and the current estimate of the fk , say fˆk(l) , calculate the updated estimate of fk by fˆk(l+1) = {N1(l) (k) + N2(l) (k)}/(n − m), where φij wˆ j (uj =Ui −vk ) fˆk δi1 δi2 r , (l) ˆ j fˆj (vj =Ui −uj ) j =1 φij w i=1 r (l) n j =1 φij I (Ui < uj + vk )wˆ j fˆk (l) 1 2 δi 1 − δi r N2 (k) = ˆ j h:vh >Ui −uj fˆh(l) j =1 φij w i=1 and m = ni=1 (1 − δi1 ), where φij = I (uj ∈ [Li , Ri ]). N1(l) (k) =
n
(l)
110
J. Sun
Step 3. Repeat step 2 until convergence. It is easy to see that method I can be more efficient than method II since it is based on the full likelihood function. However, the former could be slower than the latter. Also, method I may have an identifiability problem with smaller data sets and some starting values will converge to saddle points of the likelihood instead of the maximum. In contrast, method II does not have these problems and is more stable and converges more rapidly. These two methods both concern estimation of the distribution or probability function of the survival time of interest. It is worth noting that the resulting estimates may be rough especially if the probability function is the main target. An alternative for the estimation is to use a penalized likelihood method, which adds an additional term to the likelihood function to control the smoothness of the estimates. For example, Bacchetti (1990) and Joly and Commenges (1999) developed some penalized likelihood methods for estimation of the hazard function of AIDS incubation time. 2.2. Estimation with truncation Now we consider doubly interval-censored and truncated failure time data. As in the previous subsection, we will describe two estimation procedures, one for general situations and one for the case where right-censored observations are available for the Si instead of interval-censored observations. For general situations, the method (method III) described is a two-step self-consistency estimation procedure involving joint estimation of H and F and the idea behind the method is similar to, but not the same as, that used in method II. It includes as a special case the method developed by Sun (1995), which discussed nonparametric estimation of F when H is known or can be estimated separately. So far we have assumed that the distribution function of the Ti ’s is completely unknown. Sometimes this may not be the case or other considerations have to be taken into account for the estimation. For example, AIDS incubation time has been found to be quite long. On the other hand, most AIDS studies have relatively shorter durations and do not provide enough information about the tail of the distribution of the AIDS incubation time. To obtain efficient estimate of the distribution, it is thus natural to estimate the tail parametrically, while still estimating the first part of the distribution nonparametrically (Lim et al., 2002). We will describe an EM estimation procedure below for such situations when right-censored observations are obtained for the Si . In the following, we will assume that [B 1 −Ri ,B 2 −Li ] dF (t) = 1. i
i
i
Let the uj ’s, vk ’s, φij ’s, αji k ’s, F = ({fk }k=1,...,s ) and H = ({wj }j =1,...,r ) be defined as before. Also let γjik , . . . , s = I (Li uj Ri , Bi1 uj + vk Bi2 ), j = 1, . . . , r, k = 1, . . . , s. Then the conditional likelihood function of the data given Xi ∈ [Li , Ri ] has the form s n r i j =1 k=1 αj k wj fk Lc {wj }j =1,...,r , {fk }k=1,...,s = r s i j =1 k=1 γj k wj fk i=1
Statistical analysis of doubly interval-censored failure time data
111
(Sun, 1997). To estimate F based on the above likelihood, define αik = I (vk ∈ [Ui − Ri , Vi − Li ]), βik = I (vk ∈ [Bi1 − Ri , Bi2 − Li ]), ∗ k:Ui −ul vk Vi −ul fk , if ul ∈ [Li , Ri ], φil = 1, otherwise and ηil∗ =
1,
k:Bi1 −ul vk Bi2 −ul
fk ,
if ul ∈ [Li , Ri ], otherwise,
l = 1, . . . , r, i = 1, . . . , n. Also define ∗ Ui ul +vk Vi wl , if vk ∈ [Ui − Ri , Vi − Li ], αik = 1, otherwise and ∗ βik =
1,
Bi1 ul +vk Bi2
wl , if vk ∈ [Bi1 − Ri , Bi2 − Li ], otherwise,
k = 1, . . . , s, i = 1, . . . , n. For joint estimation of H and F , Sun (1997) proposed the following two-step self-consistency estimation procedure. (0)
Step 0. Estimate H as in step 1 of method II and denote the estimate by H (0) = (wj ). (l)
Step 1. At the lth iteration, define the improved estimate, F (l) = ({fk }k=1,...,s ), of F as the maximum likelihood estimate of F from the conditional likelihood function (l−1) Lc with assuming that H is known and wj = wj from the previous iteration. This can be obtained by iterating the following self-consistency equation (b)
fk
=
1 M(F (b−1), H (l−1))
n
µik F (b−1) , H (l−1)
i=1
+ νik F (b−1) , H (l−1) ,
k = 1, . . . , s
with respect to b until convergence, with the fk(l−1) ’s as the initial estimates, where ∗f ∗ )f αik αik (1 − βik βik k k , νik (F, H ) = s µik (F, H ) = s ∗ ∗f α α f β β ij j ij j =1 j =1 ij ij j n s and M(F, H ) = i=1 k=1 [µik (F, H ) + νik (F, H )]. (l) Step 2. Define the improved estimate, H (l) = ({wj }j =1,...,r ), of H as the maximum (l)
likelihood estimate of H from Lc with assuming that F is known and fk = fk from step 1. This can be obtained by iterating the following self-consistency equation, (b)
wj =
1 M ∗ (H (b−1), F (l) )
n ∗ (b−1) (l) µij H ,F i=1
+ νij∗ H (b−1), F (l) ,
j = 1, . . . , r
112
J. Sun
with respect to b until convergence, with H (l−1) as the initial estimates, where φij φij∗ wj (1 − φij ηij∗ )wj ∗ µ∗ij (H, F ) = r , ν (H, F ) = r ij ∗ ∗ k=1 φik φik wk k=1 φik ηik wk and M ∗ (H, F ) = ni=1 rj =1 [µ∗ij (H, F ) + νij∗ (H, F )]. Step 3. Go back to step 1 and repeat this cycle until convergence. It can be shown that the conditional likelihood function Lc increases at each iteration between steps 1 and 2 and the algorithm converges to a local or maximum of Lc . Also, it can be shown that if there is no truncation, method III yields equivalent estimates to those given by method I. In other words, the estimates given by the above method are not equivalent to those given by method II, but the method has the same advantages over method I as method II in this case. This is because in method II, estimation of H is done in just one step and has nothing to do with estimation of F , while method III uses the similar idea, but estimates H and F together. For the special case where the Xi ’s are observed exactly, method III reduces to the Turnbull’s (1976) self-consistency algorithm. In the remainder of this subsection, we will consider a little simplified, but still realistic situation. Suppose that Bi2 = ∞ and Ui = Vi or Vi = ∞, i = 1, . . . , n. That is, right-censored and left-truncated data are observed for the Si ’s. Let S(t) and f (t) denote the survival and probability functions of the Ti ’s, respectively. We assume that f (t) has the form fk , if vk τ, f (vk ) = S(τ )/Gθ (τ ) gθ (vk ), otherwise, where τ denotes the change point of S(t) and gθ (t) = g(t, θ ) is a probability function characterized by the parameter vector θ with the cumulative distribution function Gθ (t) and Gθ (t) = 1 − Gθ (t). The above model assumes that the distribution of the Ti ’s is completely unknown up to τ and then follows a parametric model. Suppose that v1 < · · · < vk0 τ < vk0 +1 < · · · < vs . Then the goal becomes to estimate φ = {f1 , . . . , fk0 , θ }. Here we assume that τ is known, and for this case Lim et al. (2002) proposed an EM algorithm for the estimation. To describe the EM algorithm, assume that each subject i with Li < Ri or Ri < Bi1 corresponds to the outcome of a random sample drawn from a population with the conditional distribution H given X ∈ [Li , Ri ]; subject i was the first unit drawn whose initial event occurs within [Li , Ri ] and whose subsequent event occurs at or after Bi1 . Let Wi,x,s ∗ denote the number of subjects drawn from this conceptual population, prior to the selection of subject i, with X = x and Si = s ∗ , where Li x Ri and x s ∗ Bi1 . First note that for the current situation, the log likelihood function can be written as k0
L(φ) = E Dj log(fj ) + Cj log S(vj )
j =1
Statistical analysis of doubly interval-censored failure time data
113
s
Dj log S(τ )gθ (vk )/Gθ (τ )
+E
j =k0 +1
+ Cj log S(τ )Gθ (vj )/Gθ (τ ) ,
(6)
where Dj =
i −vj n R
Wi,x,x+vj +
i=1 x=Li
n I Xi = Ui − vj , δi2 = 1 i=1
and Cj =
n I Xi = Ui − vj , δi2 = 0 , i=1
where = I (Ui = Vi ) as defined before, i = 1, . . . , n. In the above expression for Dj , the inner sum in the first term is defined to be 0 whenever the upper limit of summation is smaller than the corresponding lower limit. Note that in Eq. (6), the term inside the expectation is the log likelihood function of φ that would be obtained if there were no truncation on the Si ’s and no interval-censoring on the Xi ’s. Now the EM algorithm can be described as follows. Let φ (l) = (f1(l) , . . . , fk(l) , θ (l)) 0 denote the current value of the estimates after l cycles of the EM algorithm. δi2
E-step. Calculate (l) wi,x,s ∗
=E W
i,x,s ∗
|φ
(l)
= hci (x)f (l) (s ∗
− x)
Ri
hci (u)S (l) Bi1 − u
u=Li
and
(l) bi,x = Pr Xi = x | φ (l) , Li Xi Ri , Ui , δi2 2
2
hci (x){f (l) (ti − x)}δi {S (l) (ti − x)}1−δi
= R i
u=Li
2
2
hci (u){f (l) (ti − u)}δi {S (l) (ti − u)}1−δi
,
where f (l) (·) and S (l) (·) represent the values of f (·) and S(·) after l cycles of the algorithm, respectively, and hci (x) = Pr(X = x | X ∈ [Li , Ri ]). Then calculate the expectations i −vj n R n (l) (l) wi,x,x+v + δi2 bi,U E Dj | φ (l) = j i −vj
i=1 x=Li
(7)
i=1
and n (l) E Cj | φ (l) = 1 − δi2 bi,U . i −vj i=1
(8)
114
J. Sun
M-step. Replace the expectations of Dj and Cj in (6) by (7) and (8), respectively, and maximize L(φ) with respect to φ to obtain the updated estimate φ (l+1) . It is worth noting that this EM algorithm is applicable even if there exists no change point. It represents a compromise between and provides an alternative to parametric and nonparametric estimation. It can be easily seen that it also applies to situations where the Xi ’s, Si ’s and Ti ’s are continuous variables. In the above, we have assumed that the tail of the distribution of the Ti ’s follows a parametric model. An EM algorithm can be similarly developed for situations where the first part of the distribution can be described by a parametric model, while the tail is completely unknown. Both algorithms given above for estimation of the fk ’s are developed based on the conditional likelihood Lc . An alternative is to use the full likelihood function given by r s i n j =1 k=1 αj k wj fk LF {wj }j =1,...,r , {fk }k=1,...,s = (9) , ji0 kij2 w f j k i=1 j =1 k=kij1 where ji0 = max{j ; uj Bi2 }, kij 1 = min{k; vk max{0, Bi1 − uj }}, and kij 2 = max{k; vk Bi2 − uj }. Note that although Lc and the above full likelihood look similar, there exists a major difference between them. If the Xi ’s are observed exactly, the conditional likelihood Lc is then independent of the wj ’s. Thus in this case, as expected, the estimation of the distribution F = {fk }k=1,...,s of the Ti ’s based on Lc can be carried out without estimating H = {wj }j =1,...,r . In contrast, if we employ LF given in (9), F has to be estimated simultaneously with H . Furthermore, in the case of interval-censored and truncated data, Lc becomes the likelihood function considered in Turnbull (1976), the commonly used one in this case, while LF does not. Tu (1995) studied LF given in (9) when all truncation intervals are identical. 3. Semiparametric regression analysis This section considers semiparametric regression analysis of doubly interval-censored failure time data under the proportional hazards model. We will describe two methods: one is based on the full likelihood function of the data and developed for discrete survival time and the other is based on the estimating equation approach and applies to continuous survival time. In this section, we assume that there is no truncation. First consider situations where all concerned variables are discrete. Let the Xi ’s, Si ’s, Ti ’s, uj ’s, vk ’s, wj ’s and αji k ’s be defined as in the previous section. Also as before, let [Li , Ri ] and [Ui , Vi ] denote the intervals to which Xi and Si are observed to belong. For subject i, suppose that there exists a vector of covariates Zi , i = 1, . . . , n. Also suppose that the effect of covariates on the Ti ’s follows the proportional hazards model (Cox, 1972) given by
Sk (Zi ) = Pr(Ti > vk | Zi ) = (p1 · · · pk )exp(Zi β) given Zi , where β denotes a vector of regression parameters and pk = Pr(Ti > vk | Ti > vk−1 , Zi = 0),
(10)
Statistical analysis of doubly interval-censored failure time data
115
k = 1, . . . , s. Then the full likelihood function L1 given in (1) has the form n r s αji k wj fk (Zi ) L1 {wj }j =1,...,r , {fk }k=1,...,s =
(11)
i=1 j =1 k=1
(Kim et al., 1993), where exp(Zi β) fk (Zi ) = (p1 · · · pk−1 )exp(Zi β) 1 − pk .
To estimate the parameters ({wj }j =1,...,r , {pk }k=1,...,s , β), it is convenient to reparameterize the pk ’s by γk = log(log(pk )). This will remove the range restrictions on the pk ’s and improve convergence in the estimation algorithm given below. Under the new parameters γk ’s, we have γk−1 γ1 fk (Zi ) = e(e +···+e )exp(Zi β) 1 − e−exp(γk +Zi β) . For estimation of ({wj }j =1,...,r , {γk }k=1,...,s , β), Kim et al. (1993) generalized method I described in the previous section and gave the following procedure. Step 1. Choose initial estimates for ({wj }j =1,...,r , {γk }k=1,...,s , β). Step 2. At the lth iteration, set γk = γˆk(l−1) and β = βˆ (l−1) and maximize L1 given in (11) with respect to the wj ’s using the self-consistency algorithm to obtain updated (l) (l−1) and βˆ (l−1) denote the estimates given in the (l − 1)th estimate wˆ j , where γˆk iteration. (l) Step 3. Set wj = wˆ j and maximize L1 given in (11) with respect to the γk ’s and β (l) using the Newton–Raphson algorithm to obtain γˆk and βˆ (l) . Step 4. Repeat steps 2 and 3 until convergence. (l)
Note that in step 2, the updated estimate wˆ j can be obtained by method I given in the previous section by applying it only to the wj ’s while holding other parameters fixed. As for method I, it can be proved that the estimate derived by the above algorithm are critical points of the full likelihood function L1 , and one can distinguish maximizers from saddle points by examining the signs of the eigenvalues of the information matrix. Once the estimates of ({wj }j =1,...,r , {γk }k=1,...,s , β) are obtained, their covariance matrix can be estimated using the inverse of the observed Fisher information matrix. Now we consider the situation where the Ti ’s are continuous survival times. In this case, the proportional hazards model is defined by the hazard function and has the form λi (t) = Yi (t)λ0 (t) exp Zi β (12) (Cox, 1972), where λ0 (t) is an unknown baseline hazard function, Yi is a predictable process taking value 0 or 1 indicating (by the value 1) when the ith subject is under observation, and β denotes the vector of regression coefficients as before. To estimate β, for the remaining of this section, we will assume that observations on the Si ’s are right-censored instead of interval-censored and are given by Si∗ = min{Si , Ci } and δi = I (Si = Si∗ ), i = 1, . . . , n, where Ci is the censoring time associated with subject i and assumed to be independent of Si .
116
J. Sun
For estimation of β, define Yi (t | Xi ) = I (Si∗ − Xi t) and Ni (t | Xi ) = I (Si∗ − Xi t, δi = 1). Let X = (X1 , . . . , Xn ) and 1 j Yi (t | Xi )Zi eZi β , n n
S (j ) (β, t | X) =
i=1
j = 0, 1, where = 1 and Zi1 = Zi . Then β can be estimated by the solution, say βˆp , to the following estimating equation n Rn n R1
−1 (xl ) = 0 dH al ··· U β | {xi }i=1,...,n U β, H = Zi0
L1
l=1
Ln
l=1
denotes the maximum likelihood estimate of the cumulative (Sun et al., 1999), where H distribution function of the Xi ’s based on interval-censored data on the Xi ’s only, al = Rl Ll dH (x), l = 1, . . . , n, and n τ1
U (β | X) = 0
i=1
S (1) (β, t | X) Zi − (0) dNi (t | Xi ), S (β, t | X)
where τ1 is the longest possible follow-up time. It is easy to see that if the Xi ’s are ex) = U (β | X), which is the partial likelihood score function actly observed, then U (β, H of β based on right-censored data, and the proposed estimate βˆp of β reduces to the partial likelihood estimate. Under mild regularity conditions, Sun et al. (1999) proved that βˆp is consistent and 1/2 n (βˆp − β0 ) has an asymptotic normal distribution with mean zero and covariance matrix that can be consistently estimated by A(βˆp ) Γ (βˆp ) A (βˆp ), where β0 denotes the )/∂β}−1 and Γ (β) = n−1 ni=1 bˆi (β)bˆ (β), true value of β, A(β) = {−n−1 ∂U (β, H i where τ1 R1 Rn S (1) (β, t | x) ˆbi (β) = Zi − (0) ··· S (β, t | x) 0 L1 Ln n | x) (xl ) dH Yi (t | xi ) exp(β Zi ) dN(t , × dNi (t | xi ) − al nS (0) (β, t | x) l=1 n N (t | x) = i=1 Ni (t | xi ), and x = (x1 , . . . , xn ). It can be easily seen that the above idea can also be applied to discrete survival time situation discussed under model (10). In contrast, the idea described for model (10) does not work for model (12). Another difference between the above two methods for estimation of covariate effect is that the full likelihood method for model (10) involves estimation of a large number of parameters, which makes both computation and study of its properties difficult. In contrast, the estimating equation method estimates only regression parameters of interest and does not require estimation of nuisance parameters. Also, the estimate of covariance matrix given by the full likelihood method may not give realistic and useful results, especially for large data sets. Of course, the estimating equation method could yield less efficient estimates than the full likelihood approach.
Statistical analysis of doubly interval-censored failure time data
117
As mentioned before, the algorithm given above for the full likelihood function L1 in (11) is a generalization of the self-consistency algorithm. As an alternative for determining MLE of L1 , Goggins et al. (1999) presented an EM algorithm. However, it possesses the same shortcomings as the generalized self-consistency algorithm and also estimation of covariance matrix is quite complicated. To estimate β under model (12), another approach is to apply the multiple imputation method on U (β | X) proposed in Pan (2001). This method is simple both conceptually and computationally, but may be less efficient than the two described methods.
4. Nonparametric comparison of survival functions This section discusses nonparametric treatment comparison based on doubly intervalcensored failure time data, for which little research exists compared to estimation of distribution functions and regression analysis. For the problem, Sun (2001) developed a nonparametric test procedure. Let the Xi ’s, Si ’s and Ti ’s be defined as before and suppose that interval-censored observations on the Xi ’s and Si are obtained and given by {[Li , Ri ], [Ui , Vi ]; i = 1, . . . , n} as in the previous sections. Furthermore, suppose that they are discrete variables and study subjects come from p different populations. We assume that the distributions of the Xi ’s are the same among different populations. The goal is to test the null hypothesis, H0 say, that the p populations from which the samples come have identical failure time distributions for the Ti ’s. To help understand the idea, note that for right-censored failure time data, the most popular method is the log-rank test, which has the form of a vector of summations of observed minus expected numbers of failures (e.g., Kalbfleisch and Prentice, 1980). To develop a similar approach, we start by defining pseudoobserved and expected numbers of failures. Define αik = I (vk ∈ [Ui − Ri , Vi − Li ]) and Pk = P (vk ) = Pr(Ti > vk ), and i = 1, . . . , n, k = 0, . . . , s, where the vk ’s are defined as before and v0 = 0. Let H P = (P1 , . . . , Ps ) denote the joint maximum likelihood estimators of the cumulative distribution function of the Xi ’s and the survival function of the Ti ’s under H0 , which can be obtained using method I described in Section 2. Also, as before, let
(x) − H (x − ) , if vk ∈ [Ui − Ri , Vi − Li ], H ∗ x+v ∈[U ,V ] k i i αik = 1, otherwise. Now we can define the estimated or pseudonumbers of failures and subjects at risk as follows. Define n s ∗ k dk = Pk−1 − P αij αij∗ Pj −1 − Pj , αik αik j =1
i=1
nk =
n s r=k i=1
∗ αir αir
r Pr−1 − P
s j =1
αij αij∗
j , Pj −1 − P
118
J. Sun
dkl =
∗ αik αik
s ∗ Pk−1 − Pk αij αij Pj −1 − Pj , j =1
i
and
s s ∗ ∗ r αir αir Pr−1 − P nkl = αij αij Pj −1 − Pj , r=k
j =1
i
where i denotes the summation over subjects i in the population l, l = 1, . . . , p, k = 1, . . . , s. The dj ’s and nj ’s can be regarded as pseudototal numbers of failures and subjects at risk, while dj l ’s and nj l ’s the pseudonumbers of failures and subjects at risk corresponding to each population. By following the log-rank test, a nonparametric test statistic, say U = (U1 , . . . , Up )t , can be defined as m (dkl − nkl dk /nk ) Ul = k=1
(Sun, 2001), the summation of the differences between the pseudoobserved failure numbers and expected failure numbers conditional on the observed data. To apply U for testing H0 , we need to estimate its covariance matrix. For this, Sun (2001) proposed the following bootstrap method. Let M be a prespecified integer. For each l (1 l M), apply the following algorithm: (l)
(l)
Step 1. Let {Xi ; i = 1, . . . , n} be an independent sample of size n such that Xi is drawn from the conditional probability function (x) − H (x − )
(l) H hˆ i (x) = Pr Xi = x = , (L− ) (Ri ) − H H i
x ∈ [Li , Ri ]
given Xi ∈ [Li , Ri ], i = 1, . . . , n. Step 2. For the given Xi(l) ’s, let {(Ti(l) , δi(l) ); i = 1, . . . , n} be an independent rightcensored survival sample of size n such that if Vi = ∞, let Ti(l) = Ui − Xi(l) and δi(l) = 0, and otherwise, let Ti(l) be a random sample drawn from the conditional survival probability function (t−) − P (t) P , P((Ui − Xi(l) )− ) − P(Vi − Xi(l) ) t ∈ Ui − Xi(l) , Vi − Xi(l)
(l) fi (t) = Pr Ti = t =
(l)
(l)
and δi = 1, i = 1, . . . , n, where δi is the censoring indicator. (l) (l) Step 3. Given right-censored failure time data {(Ti , δi ); i = 1, . . . , n}, calculate the (l) (l) (l) (l) numbers of failures and risks denoted by the dk ’s, nk ’s, dkl ’s, and nkl ’s corresponding to the dk ’s, nk ’s, dkl ’s, and nkl ’s and then the statistic U denoted by U (l) (l) (l) (l) (l) with replacing dk , nk , dkl , and nkl by dk , nk , dkl , and nkl , respectively.
Statistical analysis of doubly interval-censored failure time data
119
Step 4. Repeat the steps 1–3 for each r = 1, . . . , M and then estimate the covariance matrix of U by V = V1 + V2 , where 1