QUANTITATIV DATAANALYSIS I Re serch a DoingS ocia to Testldeas
D ONALD I. TRE IMA N
If i?j[i,i:l[fri:,
reserved' Copyright@2009by JohnWiley & Sons'Inc All dghts by JosseY-Bass Published
com cA 941O3-wwwjossevbass ftltijt?tlltJ,l'",, t"' Francisco, form stored in a retrieval system' or tansmitted in any No part of this publication may b€ reproduced' exceptas oth"*ise' ol t:o:lt:q. or bv anv means,elecfonic, mechatucal,photocopying'-recording theprior either Act'without
;:#;i
ffi;;!;".1b;i
ul'iei s'ut"'copvright
roa
"r aulori^tion trttougrtpuy-"ni of-theappropriate-p"-t:1oP1*" "' wrinen Dermissionof the putrisrrer,or 'i]"'iiie (e78) 750-8400' oiuq n-u"'l MA'ore23' ;;;;'I*: il;i""i iliilt:;;;ii should permission for publisher the t n"q*t" '?;;il"*ooa o. onttn"ut *t* fax (978)646-8600, NJ Hoboken' stree! "clt River "oi-yig;' l,1l Inc : to thePer.ir.ion. o"ptii!'ni,i"-rt^ wii"y n Sons' be addressed ssrons. www.wiley.com/so/pen at online or oiriid, iii,1j i1d_oor1,fax 201,744_6008, ascitationsor sourcesfor further information Readersshouldbe awarethat InternetWebsitesoffered waswrittenandwhenit is rcad' this time the between disappeared .. ."1 t """-.ft-ag"a publisherandauthorhaveusedtheir bestefforts Limit of Liability/Disclaimer of warranty: while the or com wi*l respeclto lhe accuracy or lhis book.Lheymakeno repre'enlations wafianlie' in DreDaring or merchanrabil' warranties implied rr,i. roor #i ,fi"iri.aiiy di-ctaimany ;iJ";K, ;i ;;;.;;;;;,,'oi
ffi;il;?;;ili."iu,'pttp"t"
n'*Lantvmavbecreatedorextendedtysalesrei::il
I The aivice and strategies contained herein may-not ,"1* .it"tials .i *iii." nor author shall publisher the leither upp.op;ut". ation.you should consutt wltt, a protessiinut-*-fi.." to special' limited not but including oit*'' be liable for any loss of p.ot t o' "ommerciJdamages' -ydamaBes' or other con(equential. rncidental.
most bookstores To-contactJossey-Bassdirectl) JosseyBass books and products are availablelhrough the United *itio if," Unitla Star". ur 1a0O)956-?739' outside call our CusromerCar" u"p*"n, (317) 572-4002' Siatesat (3ll) 572-3986' oi via fa'x at formats some content that appearsin Jossev-Bassalso publishesits books in a variety ofelecftonic print may not be ivailable in electronic books' Library of Congress Cataloging'in-Publication
Data
Donald J. Treiman, -jutu unalysis : doing social researchto test ideas/ Donald J Treiman d"-tl[G D, Cm,
2.Sociorogv-f,esearch-statist "liJJj;l.T'3;:3:;:,t3*"f33?,*,n"^"thods. methods-Computer + Socialsciences-statistical
methods. 3. Sociology-statisticar -"if'oOt programs. 5. Stata. I Title HA29.T675 2008 300;72-4c22 Printed in the United StatesofAmerica FIRST EDITION
PB Printing
l0 9 8 7 6 5 '1 3 I I
20080131:v
-*fq-$ Tg$XT'-{. fables, Figur€s,Exhibits. and Boxes
Xi
Preface
xxiii
The Author
xxvii
Introduction CROSS-TAB U LATIONS What This ChapterIs About Introductionto the Book via a ConcreteExample Cross-Tabulations What This ChapterHas Shown MORE ON TABLES What This ChapterIs About The Logic of Elaboration SuppressorVariables Additive and InteractionEffects Direct Standardization
xxix 1 1 2 8 19 21 z1 22 ).) 26 28
A Final Note on StatisticalControlsVersusExperiments What This ChapterHas Shown STILLMORE ON TABLES What This ChapterIs About ReorganizingTablesto Extract New Information When to Percentagea Table "Backwards"
45 47 47 48 50
Cross-Tabulations in Which the DependentVariable Is Representedby a Mean Writing About Cross-Tabulations
52 58 61
What This ChapterHas Shown
o-1
Index of Dissimilarity
Vl
Contents
4 ONTHEMANIPULATION OFDATABYCOMPUTER
o)
What This ChaprerIs Abour
tr)
Introduction
66
How Data Files Are Organized Transforming Data What This ChapterHas Shown Appendix 4.A
Doing Analysis Using Stata Tips on Doing Analysis Using Stata Someparticularly Useful Stata 10.0Commands
INTRODUCTIONTO CORRELATION AND REGRESSION (ORDINARYLEASTSQUARES) What This ChapterIs About Introduction Quantifying the Size of a Relationship:RegressionAnalysis Assessingthe Strengthof a Relationship: CorrelationAnalysis The RelationshipBetweenCorrelation and RegressionCoefficients FactorsAffecting the Size of Correlation(and Regression)Coeflicients CorrelationRatios What This ChapterHas Shown 6
INTRODUCTIONTO MULTIPLE CORRELATION AND REGRESSION (ORDINARYLEASTSQUARES) What This ChapterIs About .
Introduction A WorkedExample:The Determinants of Literacy in China Dummy Variables A Strategyfor ComparisonsAcross Grouos A BayesianAlternativefor Comparing Models IndependentValidation What This ChapterHas Shown
MULTIPLE REGRESSION TRICKs: TECHNIQUES FOR HANDLING SPECIAL ANALYTIC PROBLEMS What This ChapterIs About NonlinearTransformations
OI
72 80 80 80 84
87 87 88 89 o1
94 94 99 102
r03 103 104 113 120 124 133 135 136
139 139 140
contentsVii Tesrin,ethe Equality of Coefficients TrendAnalysis: Testingthe Assumption of Linearity LrnearSplines Lrpressing Coefficientsas Deviationsfrom
MULTIPLEIMPUTATIONOF MISSING DATA \\tar This ChapterIs About lntroduction -\ WorkedExample:The Effect of Cultural Capital on EducationalAttainmentin Russia \\hat This ChaprerHas Shown SAMPLEDESIGNAND SURVEYESTIMATION \\har This ChapterIs About SurveySamples Conclusion \nlar This ChapterHas Shown REGRESSION DIAGNOSTICS what This ChapterIs About Introduction A WorkedExample:SocietalDifferences in StatusAttainment RobustRegression
' ! 1 SCALECONSTRUCTION What This ChapterIs About Introduction
149 152
the
Grald Mean (Multiple ClassificationAnalysis) OrherWaysof RepresentingDummy Variables Decomposingthe DifferenceBetween Two Means \\'har This ChapterHas Shown
Bootstrappingand StandardErrors What This ChapterHas Shown
147
r64 166 172 179 181 181 \82 187 194 195 t95 196 )t7
224 225 225 226 229 237 238 240 241 241 1,41
Validiry Reliability
242 243
Vlll
12
Contents ScaleConstruction
246
Errors-in-VariablesRegression What This Chapter Has Shown
258
LOG-LINEARANALYSIS What This ChapterIs About Introduction Choosinga PrefenedModel ParsimoniousModels A Bibliographic Note What This ChapterHas Shown Appendix 12.A Derivation of the Effect parameters Appendix 12.8 Introductionto Maximum Likelihood Estimation Mean of a Normal Distribution Log-Linear Parameters
,'3
BINOMIAL LOGISTICREGRESSION What This ChapterIs About Introduction Relationto Log-LinearAnalysis
261
263 263 264 265 277 294 295 295 297 298 299 301 301 302 303
A WorkedLogistic RegressionExample: PredictingPrevalenceof Armed Threats A SecondWorkedExample:SchoolingprogressionRatiosin Japan
304 314
A Third WorkedExample (Discrete-TimeHazard_Rate Models): Age at First Marriage
318
A FourthWorkedExample(Case-ControlModels): Who WasAppointed to a Nomenklataraposition in Russia? What This ChapterHas Shown Appendix l3.A Some Algebra for Logs and Exponents Appendix 13.8 Introduction to probit Analvsis
327 329 330 330
14 MULTINOMIAL AND ORDINALLOGISTIC REGRESSION AND TOBITREGRESSION WhatThisChapterIs About Muhinomial LogirAnalysis
335 J J.)
336
Contents lX frinal
Logistic Regression
342
Tobit Regression(andAllied Procedures)for Censored DependentVariables Otter Models for the Analysis of Limited DependentVariables &'hat This ChapterHas Shown
t5
353 360 361
IMPROVINGCAUSAL INFERENCE: FIXED EFFECTS AND RANDOM EFFECTS MODELING What This ChapterIs About Introduction Frxed Effects Models for Continuous Variables RandomEffects Models for ContinuousVariables A Worked Example: The Determinants of Income in China Fired Effects Models for Binary Outcomes A Bibliographic Note Wtat This ChapterHasShown
363 363 364 365 371 372 375 380 380
1 6 FINALTHOUGHTS AND FUTURE DIRECTIONS:
RESEARCH DESIGN AND INTERPRETATION ISSUES whar rhis Chapter is About ResearchDesignIssues The Importanceof Probability Sampling A Final Note: Good ProfessionalPractice What This ChaDterHas Shown
38r 381 382 397 400 405
Appendix A: Data Descriptions and Download Locations fot lie Data Used in This Book
407
Appendix B: Survey Estimation with the General Social Survey
4',11
References
417
lndex
431
':-,-,::,li::1,i' ;.l.ll LiFl,-..,
a:.x:X Ii:::.-i,:;,,*rXf":* i-::'.,:: i, TABLES I .1.
Joint FrequencyDisrributionof Militancy by Religiosity Among UrbanNegroesin the U.S., 1964.
1.2.
PercentMilitant by ReligiosityAmongUrbanNegroes in the U.S., 1964.
10
PercentageDistribution of Religiosity by EducationalAttainment, UrbanNegroesin the U.S., 1964.
l3
PercentMilitant by EducationalAttainment,Urban Negroes in the u.s., 1964.
l3
PercentMilitant by Religiosity and EducationalAttainment, UrbanNegroesin the U.S., 1964.
15
PercentMilitant by Religiosity and EducationalAttainment, Urban Negroesin the U.S., 1964(Three-DimensionalFormat).
18
PercentageWho Believe Legal Abortions ShouldBe PossibleUnder SpecifiedCircumstances,by Religion and Education,U.S. 1965 (N : 1,368;Cell Frequencies in Parentheses).
27
Percentage AcceptingAbortion by Religion and Education (HypotheticalData).
28
PercentMilitant by Religiosity,and PercentMilitant by Religiosity Adjusting (Standardizing)for Religiosity Differencesin Educational Attainment,UrbanNegroesin the U.S., 1964(N : 993).
30
1.3. 1.4. 1.5. 1.6. Ll.
2.2. 2.3.
2.4.
PercentageDistribution of Beliefs Regardingthe Scientific View of Evolution(U.S.Adults,1993.1994.and2000).
2.5.
Percentage Accepting the ScientificView of Evolution by ReligiousDenomination(N : 3,663).
2.6.
Percentage Acceptingthe ScientificView of Evolution by Level of Education.
2.7.
Percentage Accepting the ScientificView of Evolution by Age.
2.8.
Percentage Distributionof Educational Attainmentby Religion
2.9.
PercentageDistribution ofAge by Religion.
2.10.
Joint ProbabilityDistribution of EducationandAge.
33
35 35 36
Xll
Tables,Figures,Exhibits,and Boxes
2 .11. PercentageAccepting the ScientificView of Evolution by Religion, Age, and Sex (PercentageBasesin Parentheses) 2.12. ObservedProportionAccepting the ScientificView of Evolution, and ProportionStandardizedfor EducationandAge. 2.r3. PercentageDistribution of OccupationalGroupsby Race,South African Males Age 20-69, Early 1990s(Percentages ShownWithout Controlsand also Directly Standardizedfor Racial Differencesin EducationalAttainment";N = 4,004). 2 .14. Mean Number of ChineseCharactersKnown (Out of 10), for Urban and Rural ResidentsAge 20-69, China 1996(MeansShown Without ControlsandAlso Directly Standardizedfor Urban-Rural Differencesin Distribution ofEducation; N : 6,081). FrequencyDistribution ofAcceptanceof Abortion by Religion andEducation,U.S.Aduits, 1965(N : 1,368). Social Origins of Nobel Prize Winners(1901-1972)and Other U.S. Elires (and,for Comparison,the Occupationsof EmployedMales i900-1920). 3.3. MeanAnnual Income in 1979Among ThoseWorking Full Time in 1980,by Educationand Gender,U.S. Adults (Category FrequenciesShownin Parentheses). Meansand StandardDeviationsof Income in 1979bv Education and Gender,U.S. Adults, 1980. 3.5. MedianAnnual Income in 1979Among ThoseWork rg Full Time in 1980, by Educationand Gender,U.S. Adults (CategoryFrequencies Shownin Parentheses).
6.2.
6.3. 6.4.
PercentageDistribution Over Major OccupationGroupsby Race and Sex,U.S. Labor Force, 1979(N : 96,945). Mean Number of PositiveResponsesto an Acceptanceof Abortion Scale(Range:0-7), by Religion, U.S. Adults, 2006. Means,StandardDeviations,and CorrelationsAmong Variables Affecting Knowledgeof ChineseCharacters,EmployedChinese Adults Age 20-69, 1996(N = 4,802) Determinantsof the Number of ChineseCharactersConectly Identifiedon a Ten-ItemTest,EmployedChineseAdults Age2U69,1996 (StandardEnors in Parentheses). Coefficientsof Models ofAcceptanceofAbortion, U.S. Adults, 1974 (StandardErrors Shownin Parentheses); N : 1,481. Goodness-of-FitStatisticsfor Altemative Models of the Relationship Among Religion, Education,andAcceptanceofAbortion, U.S. Adults, 1973(N = 1,499). DemonstrationThat Inclusionof a Linear Term Does Not Affect PredictedValues.
37 39
4l
42 48 51
52
58 60
101
115
116 127
136
153
Tables, FiguretExhibits. and BoxesXiii ":
"-i
-.4
Cefficiens for a Linear Spline Model of Trends in years of Sciool Compleredby year of Birth, U.S. Adults Age 25 and Older, ad Comparisonswith Other Models (pooled Datafor 1972_2004, \ : -19.324). Goodness-of-FitStatisticsfor Models of Knowledgeof Chinese Cba-actersby year of Birth, Controlling for years of Schooling, rirh \-arious Specifications of the Effect of the Cultural Revolution rTbose Affected by the Cultural Revolution Are Deflned peoole as Tuning Age I I During the period 1966ttuough 1977),Chinese -{dnlts Age 20 ro 69 in 1996(N = 6,086). Cocfficientsfor Models 4, 5, and 7 predicting Knowledgeof Chinese Charactersby year of Birth, Controliins for ye;rs ( p Valuesin parentheses). of Scbooti_ng
--s
CoefficientsofModels of ToleranceofAtheists, U.S. Adults, 1[O to 2004 (N : 4,299). -6, Desiga Matrices for Alternative Ways of Coding Categorical \-ariables(SeeText for Details). Coefficients for a Model of the Determinants of Vocabulary Knorrledge,U.S. Adults, 1994(N : 1,,757R2 : .2445: Sald TestThat CategoricalVariablesAll Equal Zetot F.t,rrrt = 12.48; p <.0000). -tVeans. StandardDeviations, and Correlations for Variables Included rn a Model of EducationalAttainment for U.S. Adults lgg0 to 2004, , b1.Race(BlacksAbove the Diagonal,Non_BlacksBelow). - )Coefficientsof a Model of EducationalAttainment,for Blacks and \on-Blacks, U.S. Adults, 1990to 20O4. - 1n- Decompositionof the Difference in the Meanyears of School Completedby Non-Blacksand Blacks, U.S. Adults, 1990to 2004. LtDescriptiveStatisticsfor the VariablesUsed in the Analysis, Russian -{dulrsAge Twenty-Tivoro Sixty_Ninein 1993 (N: a,6S5). t: Comparisonof Coefficientsfor a Model of EducationalAttamment Estimatedfrom a Casewise-Deleted Data Set [C] (N = 2,661) and from a Vultiply ImputedData Set [M] (N :4,6g5), RussianAdulrs Ase Twenry-Twoto Sixry-Nine in 1993. 9.1Portion ofa Tableof RandomNumbers. of the Total PopulationResidingin Each of the Ten LarqestCitils in Califomia, 1990. +-:,
DesignEffects for SelectedStatistics,Samplesof 3.000 with Clustering(50 Countiesas primary SamplingUnits, 2 Villages or
157
160
161 t65 16g
169
176 I77 178 1g9
Dz D6
ZO1
XiV
9.4.
9.5. 9.6.
tables,Figures, Exhibits, andBoxes Neighborhoodsper County,and 30 Adults Age 20 to 69 per Village or Neighborhood),With andWithout Stratification,by Level ofEducation. Determinantsof the Number of ChineseCharactersCorrectly Identified on a 10-ItemTest,EmployedChineseAdults Age 20-69, 1996(N = 4,802). Coefficientsfor Models of the Determinantsof Income,U.S. Adult Women, 1994,Under VariousDesignAssumptions(N : 1,015). Coefficientsof a Model of EducationalAttainment,U.S. Adults, 1990to 2004(N: 15,932).
10.1. Coefficientsfor Models of the Determinantsof the Strengthof the Occupation-Education Connectionin EighteenNations. 11.1. Valuesof Cronbach'sAlpha for Multiple-Item Scaleswith Various Combinations of the Number of Items and the Averase Correlation Among Items.
210
216 221 223 236
11.3. Abortion FactorLoadinssAfter Varimax Rotation.
246 253 254
11.4. Means,StandardDeviations,and CorrelationsAmong Variables Included in Models of the Acceptanceof Legal Abortion, U.S. Adults, 1984(N : 1,459).
256
11.5. Coefficientsof Ttvo Models PredictingAcceptanceofAbortion, U.S.Adults, 1984.
256
11.2. FactorLoadingsfor Abortion AcceptanceItems Before Rotation.
11.6. 11.7.
Mean Scoreon the ISEI by Level of Education,Chinese Males Age Twenty to Sixty-Nine, 1996.
259
Coefficientsof a Model of the Determinantsof Political ConservatismEstimatedby ConventionalOLS and Errors-inVariablesRegression,U.S. Adults, 1984(N : 1,294).
260
1,2.1. FrequencyDistribution of Programby Sex in a GraduateCourse. 12.2. 12.3. 12.4.
12.5.
265
FrequencyDistribution of Level of Stratificationby Level of Political Integrationand Level of Technology,in Ninety-Two Societies.
268
Models of the RelationshipBetweenTechnoiogy,Political Integration,and Level of Stratificationin Ninety-Two Societies.
269
PercentageDistribution of ExpectedLevel of Stratificationby Level of Political Integrationand Level of Technology,in Ninety-Two Societies(ExpectedFrequenciesfrom Model 7 Are Percentaged).
272
FrequencyDistribution of Whether'A CommunistShouldBe Allowed to Speakin Your Community" by Schooling,Region,and Age, U.S.Adults, 1977(N = 1,478).
273
Tables, Figures, Exhibits, and Boxes XV G..odness-of-Fit Statisticsfor Log-LinearModelsof theAssociations i:n.rns \\:hethera CommunistShouldBe Allowed to Speakin Your C..mmunit\'. Age, Region,andEducation,U.S.Adults, 1977. :r:e.-red Percentage(from Model 8) AgreeingThat 'A Communist S:ruld Be Allowed to SpeakinYour Conrmunity" by Education,Age, .: i Resion.U.S.Adults, 1977. Distribution of Voting by Race,Education,andVoluntary i>:.r.iation Membership. -::quenl - ::quenl Distribution of Occupationby Father'sOccupation, C:rnese-{dults,1996. -:,:;raction Parametersfor the SaturatedModel Applied to Table 12.9. G..odness-of-FitStatisticsfor AlternativeModels of Intergenerational O,-cupational Mobility in China(Six-by-SixTable).
'
275
276 278 280 282 284
F:;quency Distribution of EducationalAttainmentby Size of ?,::e of Residenceat Age Fourteen,ChineseAdults Not Enrolled :: School.1996.
289
P.rcentageEver Threatenedby a Gun, by SelectedVariables,U.S. {Jults. 1973to 1994(N : 19,260).
306
G..t dness-of-FitStatisticsfor VariousModels Predictingthe P::ralenceof ArmedThreatto U.S.Adults, 1973to 1994. Eie!-r Parametersfor Models 2 and4 of Table 13.2.
308 310
Goodness-of-FitStatisticsfor VariousModels of the Processof ErucationalTransitionin Japan(PreferredModel Shownin Boldface).
315
Eiect Parameters for Model 3 ofTable 13.4.
316
OddsRatiosfor a Model Predictingthe Likelihood of Marriagefrom \Ee at Risk, Sex,Race,and Mother's Education,with Interactions Bet$ eenAge at Risk and the OtherVariables. Coeillcientsfor a Model of Determinantsof Nomenklatura \Iembership,Russia,1988.
328
Efiect Parametersfor a Probit Analysis of Gun Threat(Corresponding :.r \lodels 2 and4 ofTable 13.3).
331
Ettect Parametersfor a Model of the Determinantsof English and RussianLanguageCompetencein the CzechRepublic, 1993 p Valuesin Italic.) \ : 3,945).(StandardErrors in Parentheses;
339
Eftect Parametersfor an OrderedLogit Model of Political Party Identification, U.S.Adults, 1998(N : 2,443).
345
PredictedProbability Distributionsof Party Identificationfor Black and non-BIackMales Living in Large CentralCities of Non-Southern S\lSAs and Earning $40,000to $50,000perYear.
349
XVi 14.4. 14.5. 14.6. 14.7.
15.1. 15.2. 15.3.
Tables,Figuret Exhibits,and Boxes Effect Parametersfor a GeneralizedOrdercdLogit Model of political Party Identification,U.S. Adults, 1998. Effect Parametersfor an Ordinary Least-Squares Regression Model of Political party ldentification,U.S. Adults, 199g. Codesfor Frequencyof Sex in the Pastyear, U.S. Adults, 2000. AlternativeEstimatesof a Model of Frequencyof Sex,U.S Adults, 2000 (N : 2,258).(StandardErrors in parenthesesl All CoefficientsAre Significantat .001 or Beyond.) SocioeconomicCharacteristicsof ChineseAdults by Size ofplace of Residence,1996. Comparisonof OLS and FE Estimatesfor a Model of the Determinantsof Family Income,ChineseRMB, 1996(N : 5,342). Comparisonof OLS and FE Estimatesfor a Model of the Effect of Migration and Remittanceson SouthAfrican Black Children,s SchoolEnrollment,2OO2to 2003.(N(FE) : 2,408 Children; N(full RE) = 12,043Children.)
350 354 356
357 373 374
379
FIGURES 2 .1.
The ObservedAssociationBetweenX andy Is Entirelv Spurious and Coes to Zero When Z Is Controlled.
2.2.
The ObservedAssociationBetweenX andy Is partlv Sourious: theEffecrof X on Y ls ReducedWhenZ Is Controll;d(Z Affecrs X and Both Z and X Affect Y). The ObservedAssociationBetweenX andy Is Entirely Exolained by the InterveningVariableZ and Goesto Zero When 2 Is bontrolled. The ObservedAssociationBetweenX andy Is partly Explainedby the InterveningVariableZ: the Effect of X on y Is ReducedWhen Z Is Controlled(X Affects Z, and Both X and Z Affecr y).
2.5. 2.6.
4.1. 5.1. 5.2.
Both X and Z Affect Y, but ThereIs no AssumptionRegarding the CausalOrdering of X and Z. The Size of the Zero-OrderAssociationBetweenX andy (andBetween Z andY) Is Suppressed When the Effects ofX on Z andy haveOpposite Sign, and the Effects ofX and Z ony haveOppositeSign. An IBM punch card. ScatterPlot of Yearsof Schoolingby Father,syears of Schoolins (HypotheticalDara.N : t0). Least-Squares RegressionLine of the RelationBetween Yearsof Schoolingand Father'sYearsof Schoolins.
24 24 25
26 11
88 89
T Tables, Figures, Exhibits. and Boxes XVii -.:-.:-.iuares RegressionLine of the RelationBetweenyears S:: -.-'irn,sand Father'sYearsof Schooling,ShowingHow the '::::: Prediction"or "Residual"Is Defined. '-: -;..:-Squares RegressionLines for Three Conligurationsof Data: : :-:::.rl Independence, (b) PerfectCorrelation,and (c) perfect ----. :-:;ear Correlation-a ParabolaSymmetricalto the X-Axis. -:: I-e;r of a SingleDeviantCase(High Leveragepoint). - :-'.:=:lng DistributionsReducesCorrelations. - :: iiecr of Aggregationon Correlations. of the Relationship Between --:-:: DimensionalRepresentation \::-:er of Siblings,Father'sYearsof Schooling,andRespondent,s -::--. ri Schooling(Hypothetical Data;N : l0).
90
92 95 97 99
105
:r:e;:ed \umber of ChineseCharactersIdentified (Out of Ten) , . \:,r: ol Schoolingand Gender,Urban Origin ChineseAdults Age 20 : :- ::r 1996with NonmanualOccupationsand with years of Father,s S: :l.ine andLevelof CulturalCapitalSetat TheirMeans(N : 4,g02). \::e: ihe temaleline doesnot extendbeyondl6 because thereareno :'::.".esin the samplewith post-graduate education.) 120 :,j-':pranceofAbortion by EducationandReligiousDenomination, 131 -.S. -\dulrs.1974(N : 1.481). --.-: RelationshipBetween 2003 Income andAge, U.S. Adults .{:: Ttlen*'to Sixty-Fourin 2004(N : 1,573). t4l :r-;ted 1n(Income) by YearsOf SchoolCompleted, U.S. Males Females.2004, with Hours Workedper WeekFixed at the -:: l'1i-rntbr Both SexesCombined(42.7;N : 1,459). 1,44 ir:e.-ied Incomeby Yearsof SchoolCompleted, U.S. Malesand ::neles. 2004,with Hours Workedper Week Fixed at the Mean for 3-.rhSeresCombined(42.7). 145 ::end in ArtitudesRegardingGenderEquality,U.S.AdultsSurveyed : i9r-l Through1998(LinearTrendandAnnualMeans;N=21,464). 151 f-:arsof SchoolCompletedby Yearof Birth, U.S.Adults (pooled S:mplesfrom the 1972Through2004GSS;N = 39,324;Scatter Pr.rtShownfor 5 PercentSample). 154 \lean Yearsof Schoolingby Yearof Birth, U.S. adults(SameData :i tbr Figure7.5). 155 Tluee-YearMoving AverageofYears of Schoolingby year of Birth, L.S. Adults(SameDataasfor Figure7.5). 155 Trendin Yearsof SchoolCompletedby Year of Birth, U.S. Adults SameData as for Figure 7.5). PredictedValuesfrom a Linear Splinewith a Knot at 1947. 158
XVlll
Exhibits, andBoxes Tables, Figures,
7 .9.
Graphsof ThreeModels of the Effect of the Cultural Revolution on VocabularyKnowledge,Holding ConstantEducation (at TwelveYears),ChineseAdults, 1996(N : 6,086).
7.10. 10.1. 10.2.
10.3. 10.4.
Figure 7.9 Rescaledto Show the Entire Rangeof the Y-Axis. Four ScatterPlots with Identical Lines.
163 163 226
ScatterPlot of the RelationshipBetweenX andY andAlso the RegressionLine from a Model That IncorrectlyAssumesa Linear RelationshipBetweenX andY (HypotheticalData).
227
Yearsof School Completedby Number of Siblings,U.S. Adults, 1994 (N - 2,992). Yearsof SchoolCompletedby Number of Siblings,U.S. Adults, 1994.
10.5.
A Plot of LeverageVersusSquaredNormalizedResidualsfor Equation7 in TreimanandYip (1989).
10.6.
A Plot of LeverageVersusStudentizedResidualsfor Treimanand Yip's Equation7, with Circles Proportionalto the Size of Cook's D.
lO.7.
Added-VariablePlots for Treiman andYip's Equation7. Plot for Treiman andYip's Equation7. Residual-Versus-Fitted
10.8.
Plots for Treimanand AugmentedComponent-Plus-Residual Yip's Equation7. 10.10. ObjectiveFunctionsfor ThreeM Estimators:(a) OLS Objective Function,(b) Huber ObjectiveFunction,and (c) Bi-Square ObjectiveFunction.
228
zz8 232 233 233 234
10.9.
10.11. SamplingDistributionsof BootstrappedCoefficients (2,000Repetitions)for the ExpandedModel, Estimatedby RobustRegressionon SeventeenCountries. 11.1. 13.1. 13.2. 13.3. 13.4.
13.5.
235
238
240
Loadingsof the SevenAbortion-AcceptanceItems on the First Two 255 Factors,Unrotatedand Rotated30 DegreesCounterclockwise. ExpectedProbability of Marrying for the First Time by Age at 320 Risk,U.S.Adults, 1994(N = 1,556). Risk the First Time by Age at ExpectedProbability of Marrying for (Range:Fifteen to Thirty-Six), Discrete-TimeModel, U.S. Adults, 1994. 3ZZ ExpectedProbability of Marrying for the First Time by Age at Risk (Range:Fifteen to Thirty-Six), Polynomial Model, U.S. Adults, 1994. ExpectedProbability of Manying for the First Time by Age at fusk, Sex, and Mother's Education(Twelveand SixteenYearsof Schooling), Non-Black U.S. Adults, 1994. ExpectedProbability of Marrying for the First Time by Age at Risk, Sex,and Mother's Education(Twelveand SixteenYearsof Schooling),Black U.S.Adults, 1994.
322
326
326
Tables,Figures.Exhibits,and Boxes XIX
:,:.8.1. ProbabilitiesAssociatedwith Valuesof Probit and Logit Coefficients. --+.l. 11.1. 16.1. -6.1.
ThreeEstimatesof the ExpectedFrequencyof Sex per Year, U.S. Married Women,2000 (N : 552). ExpectedFrequencyof Sex PerYearby Genderand Marital Status, U.S.Adults,2000(N : 2,258). 1980Male Disability by Quarterof Birth (Preventedliom Work by a PhysicalDisability). Blau andDuncan'sBasicModel oflhe Processof Stratification.
JJ{
358
359 386 394
EXHIBITS :. 1 :2.
lllistration of How Data Files Are Organized. A CodebookCorresponding to Exhibit4.1.
67 68
BOXES
Stata-do- Files and Jog- Files Direct StandardizationIn Earlier SurveyResearch
3 6 9 10 14 15 16 18 22 27 30 31
The Weaknessof Matching and a Useful Fix
44
TechnicalPointson Table3.3
53 54 66 70 72 75
Open-EndedQuestions SamuelA. Stouffer TechnicalPointson Table 1.1 TechnicalPointson Table 1.2 TechnicalPointson Table 1.3 TechnicalPointson Table 1.4 TechnicalPointson Table 1.5 TechnicalPointson Table 1.6 Paul Lazarsfeld HansZeisel
SubstantivePointsOn Table3.3 A Histodcal Note on Social ScienceComputerPackages HermanHollerith The Way Things Were TreatingMissing Valuesas If They Were Not
XX
Tables,Figures,Exhibits,and Boxes
PeopleGenerallyLike to Respondto (Well-Designed andWell-Administered)Surveys Why Use the " Least Squares" Criterion to Determine the Best-FittingLine? Karl Pearson A Useful Computational Formula for r A "Real Data" Exampleof the Effect of Truncatingthe Distribution A Useful ComputationalFormulafor 12 Multicollinearity ReminderRegardingthe Varianceof DichotomousVariables A Formula for ComputingR':from Conelations Adjusted R'? Always PresentDescriptiveStatistics TechnicalPoint on Table6.2 Why You ShouldInclude the Entire Samplein Your Analysis Gettingp-valuesvia Stata Using Statato Comparethe Goodness-of-fitof RegressionModels R. A. (RonaldAylmer) Fisher
17 9I 93 93 97 101 108 110 111 r1 1 114 117 122
r25 125 126
How to Test the Significanceof the Difference BetweenTwo Coefficients Altemative Ways to EstimateBIC
129
Why the RelationshipBetweenIncome andAge Is Curvilinear
140
A Trick to ReduceCollinearity
145
In SomeYearsof the GSS,Only a Subsetof Respondents WasAsked CertainQuestions
150
134
An AlternativeSpecificationof SplineFunctions Why Black versusNon-black Is Better Than White versus Non-white for SocialAnalysis in the United States
156
A Commenton Credit in Science Why PairwiseDeletion ShouldBe Avoided
175
TechnicalDetailson lhe Variables TelephoneSurveys
188
Mail Surveys
r99 200 202 205
Web Surveys Philip M. Hauser A SuperiorSamplingProcedure
175 183 198
Tables, Figures, Exhibits, and BoxesXXi St-rurces of Nonresponse ["eslieKish Hos the ChineseStratifiedSampleUsed in the Design Erperimentswas Constructed $ii,ehdng Data in Stata Limitarions of the Stata10.0 SurveyEstimationprocedure -{n -{lternativeto SurveyEstimation Ho\l to DownweightSampleSize in Stata Eirs to AssessReliability $-h1' the SAI and GRE TestsInclude SeveralHundredItems TransformingVariablesso That ,,High,'has a ConsistentMeaning ConstructingScalesfrom IncompleteInformation h Log-LinearAnalysis "Interaction',Simply Means ,Association,, l: Defined Other Softwarefor EstimatingLog-Linear Models \larimum Likelihood Estimation ProbitAnalysis Techdcal Point on Table 13.1 Limitations of Wald Tests SmoothingDistributions EstimatingGeneralizedOrder Logit Models With Stata JamesTobin PanelSurveysin the PublicDomain Otis Dudley Duncan SewellWright -\sk a Foreigner To Do It GeorgePeterMurdock ln the United States,Publicly FundedStudiesMust be Made Available to the ResearchComrnunity Al'Available from Aulhor" Archive
207 ?08 212 2,13 215 219 219 244 245 248 249 264 267 294 302 302 305 309 325 349 354 369 395 396 398 401 404
, -, ,_ _ :l ,:-i ,
,"
.a.
: , :. a book abouthow to conducttheoreticallyinfomed quantitativesocialresearch ":-: .. socialresearchto testideas.It derivesfrom a coursefor graduatestudentsin sociprofessionalschools(public -:, .rnd other social sciencesand social science-based -.-----. education,socialwelfare,urbanplanning,and so on) that I havebeenteachingat - -.t tbr somethirty years.The coursehasevolvedasquantitativemethodsin the social , ::::s haveadvanced;early versionsof the coursewere basedon the first half of this -.., r throughChapterSeven),with additionalmaterialsaddedover the years.Interest:-:-.. I havebeenableto retainthe sameformat a twenty-weekcoursewith onethree::-: -e.tureper week and a weekly exercise,culminatingin a term paperwritten dudng --i .-it lbur weeksof the course from the outset,which is, I suppose,a tributeto the --.:=sing level of preparationand quantitativecompetenceof graduatestudentsin ::= .-..ial sciences.The book owes much to lively classdiscussionsover the years,of :: :ubtle andcomplexmethodologicalpoints. tsr rheendof the book,you shouldknow how to makesubstantive senseof a body of data. you That is, prepared should be well produce to publishable papersin -:-,:::ative :-: neld. as well as first-ratedissertationchapters.Of course,thereis alwaysmore to :=:. In the final chapter(ChapterSixteen),I discussadvancedtopics that go beyond ; '.: .an be coveredin a first coursein dataanalysis. Tie focusis on the analysisof datafrom representative samplesof well-definedpop- ,:, rns.althoughsomeexceptionsareconsidered.The populationscanconsistof almost societies,occupations,pottery shards,or what--l -:-rns people,formal organizations, ::. ihe analytic issues are essentially the same.Data collectionproceduresare men- :J only in passing.Thele simply is not enoughspacein an alreadylengthybook to do -.::re to both data analysisand datacollection.Thus, you will needto look elsewhere r .i stematicinstructionon data-collectionprocedures. A strongcasecan be madethat .hould do this after rather than before a courseon data analysisbecausethe main :. : ---emin designinga data collectionefforl is decidingwhat to collect, which means - irst needto know how you will conductyour analysis.An altemativemethod of :--:ring aboutthe practicaldetailsof datacollectionis to becomean apprentice(unpaid, : ,:;essary) to someonewho is aboutto conducta surveyand insistthat you get to par,:::ate in it step-by-step evenwhenyour presence is a nuisance. Thisbookcoversa varietyoftechniques,includingtabularanalysis,log-linearmodels r :abulardata,regressionanalysisin its variousforms,regressiondiagnosticsandrobust -.::-\sion, ways to cope with missing data,logistic regression,factor-basedand other :::.niquesfor scaleconsnxction,andfixed- andrandom-effects modelsasa way to make ,.-.al inferences.But this is not a statisticsbook; the emphasisis on usingtheseproce:-:;s to drawsubstantive conclusionsabouthow the socialworld works.Accordingly,the :' .-.kis designedfol a courseto be taken after a first-yeargraduatestatisticscoursein -: rocial sciences.Although thereare many equationsin the book. this is becauseit is
XXIV
Preface
necessa.ry to understandhow statisticalprocedureswork to usethernintelligently. Because the emphasisis on applications,there are many worked examples,often adaptedfrom my own research.In addition to data from samplesurveysI haveconducted,I also rely heavily on the GeneralSocial Survey,an omnibussurveydesignedfor use by the research community and also for teaching.Appendix A describesthe main data sets used for the substantiveexamplesand provides information on how to obtain them; they are all availablewithout cost. The only prerequisitesfor successfuluseof this book are a prior graduateJevelsocial sciencestatisticscourse,a willingnessto think carefullyandwork hard,andthe ability to do high school algebra-either rememberedor relearned.With only a handful of exceptions (referencesat one or two points to calculus and to matrix algebra),no mathematics beyondhigh school algebrais used.If your high schoolalgebrais rusty, you can find good reviews in Helen Walker, Mathematics Essential for Elementary St,,tistics, and W. L. Bashaw,Mathematicsfor Statistics.These books have been around forever. Although more recent equivalentsprobably exist, school algebra has not changed,so it hardly matters.Copiesof thesebooksarereadily availableat amazon . com, andprobably many otherplacesaswell. The statisticalsoftwarepackageusedin this book is Srara(release10). Downloadable commandfiles (-do- files in Stata'sterminology),files of results(-1og- files), and ancillary computer files used in the computations are available at wwwjosseybass. conr/golquantitativedataanalysis Often the details underlying particular computationsare only found in the downloadable do - and - 1og - files, so be sureto downloadandstudythemcarefully.Thesefiles will be updatedasnew releasesof Statabecomeavailable. I use Statain my teachingand in this book becauseit has very rapidly becomethe statistical packageof choicein leadingsociologyand economicsdepartments. This is not accidental.Statais a fast and efficient packagethat includes most of the statistical procedures of interest to social scientists,and new commandsare being addedat a rapid pace. Although many statistical packagesare available, the thrce leading contenderscurrently are Stata,SPSS,and SAS. As software,Statais clearly superiorto SPSS-it is faster, more accurate,andincludes a wider rangeof applications.SAS, althoughvery powerful, is not nearly as intuitive as Stata and is more difficult to learn (and to teach). Nonetheless, this book canbe readilyusedin conjunctionwith eitherSPSSor SAS, simply by translating the syntaxofthe Stata-do- files.(I havedonesomethinglike this,exploitingAllison's excellent,but SAS-based,expositionof fixed- andrandom-effects models[Allison 2005] by writing the correspondingStatacode.)
FORINSTRUCTORS Somenotes on how I have usedthesematerials in teaching may be helpful to you as you designyour own course. As noted previously,the courseon which this book is basedruns for two quarters (twenty weeks). I have offered one three-hour lecture per week and have assignedan exerciseeveryweek.When I fust taughtthe course,I readtheseexercisesmyself,but as
Preface
XXV
:-:: -::rentshaveincreased,I haveenjoyedthe servicesof a T.A. (chosenfrom among -::.-:. $ ho haddonewell in the coursein previousyears),who assistsstudentswith the : .::ies of computingand statisticsand also readsand commentson the exercises.In lecturesandhaveassignedexercisesfor all but the :::r: \eais. I haveofferedseventeen '.'' the course devotedto producingtwo draftsof a term paper -. -- :ih rhe final monthof : :::rJirihon sessionI readthe first draftsandwrite comments,in an attemptto emulate : : - : -:nal submissionprocess.Thus, in my course,everyonegetsa "reviseand resub::-: :i>ponse.I encouragestudentsto developtheir telm papersin the courseof doing andto completetheir draftsin the two weeksafter the lastexerciseis due. -:= -.:::ises l;-: initial exercisesare designedto lead studentsin a guided way through the , :-:::rics of analysis,and someof the later exercisesdo this as well. But the exercises - -::-.:nglr take a free form: "carry out an analysislike that presentedin the book." ,,:-.:ir e answersareprovidedfor thoseexercisesthat involvedefinitiveanswers that , ,- .3 sin-Iilarto statisticsproblemsets. -:3 .oursesyllabus,weekly exercises,andillustrativeanswersto thoseexercisesfbr i:-[ have written illustrative answersare availablefor downloadingfrom www. : ::_.r.i:s.com/go/quantitativedataanalysis
ACKNOWLEDGMENTS -,. , r:3dearlier,this book hasbeendevelopedin interactionwith manycohortsof gradu-:. .::dents at UCLA who havewrestledwith eachof the chaptersincludedhere and :- . :erealed troubles in the exposition, sometimesby way of explicit comments -- - : r:nerimesvia displaysof confusion.The book would not exist without them, as I :: :: -naginedmyselfwdting a textbook,and so I owe themgreatthanks.Onein partic---. ?.rmelaStoddard,literally causedthe book to be publishedin its currentfolm by : ::-.:ing in the courseof a chanceairplaneconversationwith Andrew Pastemack,a ...' , -Bassacquisitionseditor,that her professorwas thinking of publishingthe chap.. . : usedas a coursetext.Andy contactedme, andthe restis history. h: courseon which this book is basedfirst cameinto being throughcollaboration i -: :r] colleagueJonathanKelley, when he was a visiting professorat UCLA in the - - .. The first exerciseis borrowedfrom him, andthe generalthrustof the course,espe- - -. :re lirst half, owesmuch to hrm. \ly colleague,Bill Mason,recentlyretiredfrom the UCLA Sociologyand Statistics -..:::rients, hasbeenmy statisticalguru for manyyears.Otien I haveturnedto him lbr :: i::s irto difficult statisticalissues.And much that I have learnedabout topics that ;: : :roi part of the cuniculum when I was a graduatestudenthas beenfrom sitting in -,: ::red statisticscoursesofferedby Bill. Anothercolleague,Rob Mare, hasbeenhelp-- -. :nuchthe sameway.My new colleague,JennieBrand,who took over my quantita- : :;ia analysiscoursein the fall of2008, hasreadthe entiremanuscdptandhasoffered relptul suggestions. Finally, the book hasbenefitedgreadyfrom very carefulread--.,. .: :l' a group of about 100 Chinesestudents,to whom I gavea specialversionof the , --:.: in an intensivesumner sessionat Beijing University in July 2008.They caught
XXVI
Preface
ftmy errors that had gone unnoticed and mised often subtle points that resulted in the reworking of selectedportions of the text. My understanding of research design and statistical issues, especially conceming causality and theats to causal inference, has benefited greatly from the weeHy seminar of the Califomia Center for Population Research,which brings together sociologists, economists, ald other social scientists to listen to, and corrment on, presentationsof work in progress,mainly by visitors from other campuses.The lively and wide-ranging discussionhasbeen somethingof a floating tutorial, a realization of what I haveimagined academiclife could and should be like. Finally, my wife, Judith Herschman,has displayed endlesspatience, only occasionally asking, "When are you going to finally publish your methodsbook?"
. : & LJYh**t H t Treiman is distinguishedprofessorof sociologyat the Universityof Califomia u --s 1:.:-:s rLCLA) andwas until recentlydirectorof UCLA's Califomia Centerfor aorurr,:r Re:earch.He hasa BA from ReedCollege(1962)and an MA andphD from ! -n-.-.-:r .-'fChicago(1967).As a graduatestudentat Chicago,he spentmostofhis .f, \aiional Opinion ResearchCenter(NORC), wherehe gainedvaluabletrain_ -: .Er:- :1-nence in surveyresearch.He then taught at the University of Wisconsin, rntae :l :e,-ided that he really was a social demographerat heart, and made the Center ru }:,-1:rrph1 and Ecology his intellectualhome. From Wisconsin,he moved to I 'rrrrn-; Lnirersitv and then, in 1975,to UCLA, wherehe has beenever since,albeit qd E\i=J-1 so.;ournselsewhere,as staff director of a study committee at the National r;rrr='. .:: Sciences,4.Jational ResearchCouncil (1978-1981)and fellowship yearsat Bl:eau ofthe Census(1987-1988), theCenterfor AdvancedStudyin theBehav_ ---i umr rc S.r-ialSciences(1992 1993),andthe NetherlandsInstitutefor AdvancedStudy r M and SocialSciences(1996-1,997). l::--.or Treiman startedhis careeras a studentof social stratificationand status --::rrniries il.!yn-..:-- parricularlyfrom a cross-national perspective,and this has remaineda con_ i'Fr._r :::3resr.He andhis Dutch colleague,Harry Ganzeboom,have beenengagedin a {mr--€:= project to analyze variations in the status attainment Drocess --ross-national [irrlr. :::!-lD! throughoutthe world over the courseof the twentiethcentury.To date, tEl r:-,: ;ompiled an archiveof more than 300 samplesurveysfrom more than 50 m:cs- =ngrns through the last half of the century. In addition to his comparativeproj_ s ?:: -::sor Treimanhas conductedlarge-scalenationalprobability samplesurveysin ir@ \--.,-a | 1991-1994),EastemEurope( 1993-1994),andChina(1996),all concemed q [ -.J::.u! aspectsof socialinequality. :lj .Lrent researchhasmovedin a more demographicdirection.He hasa national !r.rr!---'::\ lample surveycurrentlyin progressin China,which focuseson the determ! m.- :i:amics. andconsequences of internalmigration.
:r,{-rK*milcT-l*ru I -. :or uncommonfor statisticscoursestakenby graduatestudentsin the socialsciences x :E [eated essentiallyasmathematicscourses,with substantialemphasison derivations rnc:roofs. Evenwhenempiricalexamplesareused-which they frequentlyarebecause <;r
(}VTRVIEWOF CHAPTERS 5*1 iis book beginsat the beginning,with the most basicapproachto analyzingnon=-_s^mentaldata-percentagetables.Chapters One throughThree describethe logic r --:.-ss-tabulations and provide many technicaldetails on how to produceattractive b::'u-.e they are clear and easy to read) tables. The two central ideas in thesechapters r,: Je--idingin which directionto percentagetablesand understandingstatisticalcon!:'i. h rumsout that the first of theseis difficult for somestudents-much moredifficult lorc --.rpingwith complexmathematicalformulas,which we do later in the book. Thus, :r- 'J \ ou think you alreadyknow all thereis to know aboutpercentage tables,I encour!p i !1uto pay carcful attentionto thesechapters.Doing so will pay greatdividends. Chapter Four is an introductionto computing.In this chapter,I showhow dataare q:.::;zed for analysisby computer and how analysisis conductedusing statistical
XXX
Introduction
software. I also provide hints for using Stata, the statistical package used in this book. However, the chapter is written in such a way that it also can serveas an introduction to otherstatisticalpackages,suchas SpSSand SAS. Chapters Five through Sevenconsider ordinary least squarescorrelation andregres_ . sion, the workhorse of statistical analysis in the social sciences.These procedureslro_ vide a way of quantirying the relationship between some quantitative oot"o-" it, determinants-for example, how much of a difference in income should we exDect -d for people who differ by a given number of yearsin their level of schooling. holdiog .oo.t*, other conf-ounding factors? They also provide a way of assessinghow good our predic_ tion is-for example, how much of the variability in income can be attributed to differences h education, gender, race, ard so on. Chapter Five focuses on two-variable correlation and regressionto get the logic straight and to consider somecommon errors in interpretation of correration and regression statistics. chapter Six considers multiple regression,which is used when there are severalpredictors of a particular outcome, and inhoduces the idea of "dummy" or dichotomous variables, which require special treatment. Making use of dummy variables and ,.interaction terms," I offer a itrategy for assessingwhether social processesdiffer acrosspopulation groups, a frequent qo"rioo in the social sciences.Chapter Sevenoffers a variety of tricks thaipermit relatively reflned hypothesesto be testedwithin a regressionframework. Most datasetsanalyzedby social scientistsareplaguedby missing data_information on particular variables that is missing for specific individuals. Chapter Eight reviews ways to cope with missing data, culrninating in a demonstrationof how to do multiple imputation of missing data, the current state-of-the-artapproach. Chapter Nine takesup the issueof sampling and iti implications for statistical anal_ _ ysis. r hereas the previous chapters assumed simple random sampling, most general population samplesare actually complex, multistage samples.Correctly analyzing data from such samplesrequiresthat we take accountof the "clustering" of observations when we compute standarderrors.This chapterintroduces srrv4r estimation prccedves, which do this. There are many pitralls to regressionthat can trap the unwary. As noted, these are fust discussed (briefly) in Chapter Five. Chapter Ten gives them a fuller treatrnent, through the introduction of what are known as regressiondiagnosdcs.Theseprocedures provide protection against the possibility of making false inferences frorn regression results. Chapter E_ leven shows why and how to construct multiple_item scales, focusing . pincipally onfactor-based scahngbutalso introducing e.ffea_p)oportional scaling.Often we wart to study conceptsfor which no one item in a questionnaireprovides an adequate measure,for example, "level of living," ..Iiberalisrn,',,lype-A personality,, and ,.depres_ sion." Sumnary measures,or scales, based on several items usually provide variables that are both more reliable autd,more valil than single items. This chapter shows how to createsuch scalesand how to use them. Chapters Tlvelve through Fourteen provide techniques for considenng limited _ dependentvariables. Ordinary least squaresregression is designed to handle outcome
Introduction XXXi rfir:les thatcanbe treatedascontinuous,suchasincome,yearsof schooling,andso on. S.ir r,.n'outcome variablesofinterestto socialscientistsaredichotomous(for example, rnescr peoplevote, man:y,havebeen victimized by crime, and so on; and othersare ui-r:..mous (political affiliation in a multiparty system,occupationalcategory type of attended,andso on). LogJinear analysisandlogisticregressionaretechniques 'm-..r:iN :r with limited dependentvariables.chapter Ttvelveconsiderslog-linearanal-alin-g ,s:o.:.rechniquefor making rigorousinferencesaboutthe relationshipsamonga set of nrr-.:Llmousvariables,that is, inferencesabout the degreeand patternof associations mr:r: cross-tabulated variables.In this sense,logJinear analysisprovides a way of [E: ltatisticalinferenceaboutthe kinds of tableswe considerin ChaptersOne through In-=. Chapter Thirteen introducesbinary logisticregression,an appropriatetechnique ir =;.l1zing dichotomousoutcomes,andthen showshow to usethis techniqueto handle w;'--:t kinds of cases:progressionratios, where what is being studiedare the factors d*--:rv $ hetherpeoplemove througha seriesof steps,sayfrom one level of schooling r :e ne\t: discrete-timehaza.) ratemodels,where what is being studiedis the likeli_ [.x lar an event(say,first marriage)occursat a point in time (say,a given age);and .s=-:..nrol models,which providea way of studyingthe likelihood of rareeventssuch E:iimacring diseases,gainingelite occupations,and so on. Chapter Fourteen shows tLrrra study still other limited dependentvariables:unorderedpolytomousvariables: :. n pe of placeof residen ce-yiamultinomiallogisricregrestion: ordinaloulcomes jr ; fich the order of categoriesis known but not the distance betweencategories,such -ri i:.loe aftitude scales(are you "very happy," "somewhat happy," or ..not too happy"), t:i :-Jinel logistic regression;and "censored"variables,where the range of a scaleis t'rI:c-Jed.for example,an incomevariablewith the top category,.$100,000per year or -w-r: ia tobit regression. \\len using nonexperimental data,it frequentlyis difficult to delinitively establish ftr lne'ariable causesanotherbecausethey both could dependon still a third variable, r:- u-nmeasured. Chapter Fifteen providesa classof techniques,knownasfrxed-effects m: -;ndom-effectsmodels, for dealing with such problems when one has suitable data_ :der panel data, in which data are available for the sameindividuals at more than one rr:E: ln time, or clustereddata,in which observationsare availablefor more than one m-.idual in a family, school,community,or otherunit. When appropriatedataare avail_ rri- fiis is a very powerful approach. The final chapter(Chapter Sixteen) considerstechniquesthat are beyond what I Ir.. beenableto coverin this book and beyondwhat usuallycan be coveredln a first:l-aduatecoursein quantitativedataanalysis.Many of thesetechniques,now widely .q-::ir u,se::r economics,are waysof copingwith variousversionsof theendogeneity problem, ft that unmeasured variables affect predictors both and outcomes, resulting -rossibility tr rir.:.edestimates.Fixed- and random-effects modelsprovide one way of dealingwith :rc: oroblems,but many other techniquesare available,which are reviewedin Chapter i.-;:-n. I also briefly introduceshucturalequationmodeling,a techniquefor dealing r-:: --omplexsocial processesin which an outcomevariableis a predictorvariablefor rtr:,jrer outcome.For example,in statusattainmentanalysis,we would want to study
XXXII
Introduction
how the social status of parents affects education, how parental status and education affect the status of the fust job, and so on. The brief introduction to these advanced techniquesis intended to provide guidancein pursuing more advancedtraining in quantitative analysis. I conclude the chapter with advice on good researchpractice_hints on how to improve the quality of your work and how to save time and energy in the Darqaln.
-:!,q p T r n
CROSS-TABULATIONS IIAT
THISCHAPTER IS ABOUT
! tu :::::.r. r\'estaftwith an introductionto the elementsof quantitativeanalysis_the E:L :: be colered in this book. Then we deal with the most basicof all quantitative 6Ir",q'. 1_1]15. cross-tabulations or percentage tables.(Strictly speaking.not all percent_ i,E! rf,ie. ire cross-tabulations becausewe can pgrcentageunivariatedisrributions.But @ rli:: of this chapterwill be on how to percentagetables involving the -:Dphasis ii@lxtrr=srus tabulationof two or more va.riables.) Although the proceduresare basic, fi!3 E: :!rr triyial. There are clear principles for deciding how to percemage cross_ rllrrifil qs. \\'e will cover theseprinciplesand also their exceptions.In the course of umrs ::.- s e will considerthe logic of causalargument.Then we wil considerother *n'''-o-:res:Jes percentage tables,of summarizingunivariateandmultivariatedistributions fr [a li s ell as ways of assessingthe relative size of associationsbetween oairs of tnnri<: --orlrolling for or hordingconstantothervaiables.Takethis chapterseriousry, 3a ' -.-.'uhaveencounteredpercentagetablesbefore and think you know a lot about t: .t experience,gettingright the logic of how percentage * to a tableprovesto be e-r :i:uh for many students,much more difficult than seeminglyfancier^procedures, .ni: .:-.=uhiple regression. -: rr \\ ill notice that many of the examplesin the first three chaptersare quite old, ,!i'r: :om studiesconductedasfar backasthe 1960s.This is becauseat that time tabu,n-r".'. !is \\ asthe "stateof the art"-the techniqueusedin mostof the articlespublished u ca::: journals.Thus,by going back to the older researchliterature.I haveLeen able to inc ::nicularly clearapplicationsof tabularprocedures.
QuantitativeData Analysis:Doing SocialResearch to Testldeas
INTRODUCTION TO THEBOOKVtA A CONCRETE EXAMPLE ln 1967, Gary Marx publishedan article in the American SociologicalReview tjtled "Religion: opiateor inspirationof civil rights militancy amongNegroes?',(Marx 1967a; see also Marx 1967b).The title expressedtwo competingideas about how religiosity among Blacks might have affected their militancy regarding civil rights. One possibility was that religiouspeoplewould be lessmilitant than nonreligiouspeoplebecausereli_ gron gave them an other-worldly rather than this-worldly orientation, and established religious institutions have generally had a stake in the status quo and hence a conservative orientation. The other possibility was that they would be more militalt because the Black churcheswere a major locus of civil rights militancy, and religion is an important sourceof universal humanistic values.of course,a third possibility was that thergwould be no connectionbetweenreligiosity and militancy. Supposethat we want to decide which of theseideasis correct. How can we do this? One way-which is the focus of our interest here-would be to ask a probability sample of Blacks how religious they are and how militant with respect to civil rights they are, and then to cross-tabulatethe answersto determinethe relative likelihood, or probaliliry that-religious and nonreligious people say they are militant. If religious people are less likely to give militant responsesthan are nonreligious people, the evidencewould sup_ port the first possibility; ifreligious pe ople aremore Tikelyto give militant responses, the evidencewould favor the secondpossib ity; and if there is no difference in the relative likelihoods of religious and nonreligious people giving militant responses,the evidence would.favor the third possibility. Of course,evidencefavoring an idea doesnot definitely prove it. I will say more about this later. simple example contains all of rhe elementsthat we wili be dealing . . fhil ygninglf with in this book and that a researcherneedsto take accountof to arnve at a meaninsful and believableanswerto any researchquestion.Let us consider the elementsone by o-ne. First, the idea: is religion an opiate or inspiration of civil rights militancy? Without an idea, the manipulation ofdata is pointless.As you will seerepeatedly,the nature of the idea a researcherwants to test w l dictate the kind of data chosenand the manipulations performed.without an idea, it is impossible to decide what to do, ard the researcher will be tempted to try to do everything and be at a loss to choose from among the various things he or she has done. Ideas to be tested are generally called hypotheies; they also will be referred to here and in what folrows as theories. Atheory need not be eitheigrandiose or abstractto be labeled as such.Any idea about what causeswhat, or whv and how two variables arc associated,is a theory. Secondis the information, or data, neededto test the idea or hypothesis (or theory). In this book, we will be concemedwith data drawn from probability samplesof popuia_ ttons- A population is any definable collection of things. Mostly we will be concemed with populationsofpeople, suchasthe populationof the united states.But social scientrsts ar_ e also interestedin populationsof organizations,cities, occupations,and so on. A probability sample is a subsetof the population selectedin such a way that the proba_ bility that a given individual in the population will be included in the sampleis known. only by usinga probabilitysampleis it possibleto makeinferencesfrom the characteristics ofthe sampleto the characteristicsof the population from which the sample is drawn.
Cross-Tabu lations
lh s- : r: r-rbsen'e a givenresultin a probabilitysample,we can inf.erwithin a speci_ ri- u{" a har rhe likely resultwill be in the population. lbe i::ngle usedby Marx is actuallyquitecomplex,consisting ofa probabilitysample f, r!: Birks liring in metropolitanarcasoutsidethe South,ptis four .p""iat .u-pt"r, um*t:\ :arnplesof Blacks living in Chicago,New york, Atlanta, and Birmingham. lh ]|:f}-:umber of respondents from the non_--Southem u.ban ,u_pr. pfu. the four spe.l ;rcks is 1.119.and Marx treatsthe combined sampleas representatrve of urban Lbrr - ie Lnited States.This is not, in fact, entirelylegitimate.iater we will explore nur r: r:ight complexsamplesto make them truly representative of fhe populations tn t:sh rher are drawn.Evaluationof the sampleusei in an analysisis un i_port_t rmi :i :< iara analyst,stask.But.for nor, rv" ,"ill go along with Marx in treatinghis rnrc r. I probabilitysampleof U.S. urbanBlacks. L-q ..ur ideasare aboutthe behavioror attitudes of people,a standardway of col_ n*n'r.I ',:-:.ir to ask a probability sample chosenfrom anapiropriate populationto tell r lr:u irir behaviorandattitudesby answeringa set of specificquestions.That is, we iD5,t!-r:e :ample by asking eachindividual in the sample a set of questronsand record_ rtE :3sponses. In mostsamplesurveys,the possibleresponses arepreselected, andthe :iu --eingsurveyed,rhe respondent,is askedto choosi the bestresponsetrom a list tu*a,ir- lee the boxed corment on open_ended questions).For example,one of the m.:Li \Iafl( askedwas ,,-a ,.,culdyau ny abautthecivilrightsdemonstrations over the lastfewyears_that :-E, '.,e hetpedNegroes a greatdeal,helpeda lixle,hurta little,or hun a qreatdeat? Se-peda greatdeal 1 lc-ped a little 2 ::-= a linle 3 E:r a deal 4 -great ]::'r know 5
OPEN-ENDED QUESTIONS
occasionaly, questions
=::=l;1,:ilil::llil:ffi ':"i:i*fru Jil:ffi Jl=lil":::ff T;ff "?::lff
-:-: j,/ttstedon a questionnajre or when the researcher doesn,thavea very good ideaof responses '''-:::he possible wiI be.open-endedquestions mustbe coded,that is,converted -:: a standardset of response categories, as an editingoperatjonin the courseof data :=:3ratton. Thisis verytime-consuming and expensive and is avoidedwheneverpossjble. :- someitemsmust be askedin an open-ended format.Bothin the decennrar censusand - -any contemporary surveys in the unitedStates, for example, a seriesof threeopen-ended :-=stionstypically isaskedto elicitinformation necessary to classify respondents according to .-=-darddetailed(three-digjt) classifications of occupation and industrv.
4
euantitativeDataAnalysis:DoingSocialResearch to Testldeas
Each response,or responsecategory,has a numberassociatedwith it, known as a code. The codes are whar are acrually recorded when ,h" ;;;; ;" pr"p_"d ibr analysis
tomanipurate da,i^,"
;;iiirl,'.o*"
."roondents l-X:.1:':^1": .f 'sed wll 1;"_e*;;. reruse to answer a questionor. in a self_admini.i.r.u qu"rtioo'orre, will choosemore than one response.Sometimes,aninterviewer will forget to reclrO a responseor will ambiguousway. For theserear"r., _-"_?" i, urualy designatedto f:1:.1,_tlnonresponses "" rndrcate "JO" or uncodableresponses. For example, ,oiglr, Ueassigned to nomesponsesto the preceding qu€stion when tlr" Outau." ""a":.1_ U"irrg p.epared for analysis (thistopicis discurr"ctu tt tarer).Howdi;il ;;;finses, or missing data, ". ^-bit rs one of the peremial problems of the survey ;;';;;iiidevote a deal of $ear attentionto this question. """1)";, The term variable refersto each set of responsecategoriesand the associated codes. A machine-readabledata set (v
disks,cD_RoMs,il#*":l':I:,1"j:l;il:,T$il,.'"i;,iffi liii,.j.r-;lL'll codesfor eachindividualin the ,u.pt" .orr".ponOlng a"ri"
,ii."r" .",egonesfor the variablesincludedin rhe data ,"t. "tie eartierquestion i* *;pl; ;h" on ,Suppor", whethercivil rightsdemonsrrations huu"t w"groJir'rfr"l",.,f, in a survey. Suppose, also,thatthefirst respondent;n "tp"O "-,rote tr," .a_prJt ..helped a litde'" Thedatasetwouldthin incluo". 'z- 'ui" aairii r,"iai_*ro",lons in i"ntr,l.-"",ii ii- *" ,i.st individual. To know exactlywhatis includedin a data set,"a ,n"." ir-ri" O'"" setit is located,a codebookis prepuedandusedas
ho.' tou."a"ojJ;ffi"*; t,;#:'.::;:::ffffiJJ:::llg,ffi'".]i1i"",::"'J sary to carry out the sort of analvsisdealt with in this boot
_" u aliu ,"r, u codebookfor the daraset, and documentationthat de.criO", tfr" ,a_pi". W" ,ifii o" *rcerned with problems of data collection or the preparation of u rnu"hin"-."uJult. Outu,"t, except in require
f#il:r;;::::
fuu treatrnent in rheirownrigr,t,_J*"\vil
*ics
nothavetime
l:,j:ffi,ff"";"T:iill",ff ::.riq;ff i3.i:,i:";,ry_:,#n:::ry::f lJ,"x""ff *
and collectivelyexhausdvecatesories. Rerigiousafmiaiion i. *of such a variable.For example,we mighthlaveth" foffo'rvlngr"rfonrl'"ut"jo.i". "**pt" uoo "oo"r, Protestant I Catholic 2 Jewish 3 Other None No answer
5 9
Note that no orderis imDlied,among_ the responses_no response ls ,.better,,or "higher"rhananyother Thevariable .i_!ry p.ouii"r-u ,rr'ii"fi*orr"* peopleinto religiousgroups.Note,further,thatevery individualin the surveyhasa code,even those
Cross-Tabulations5 I
I G'5€f, rb€
t
question. This is i bv includinga residualcategory -r--,-.1.;".*#i"';r1*omplished :-. deslgned vanables, categories arealways .-.-.n raEandcollectively ! cr:F..'!E cot,"*u^r- exhausiive_,h", ^-r^,.lll.t]y ;;,,* i;il;ffi"r*;#XJ;
a f
".
l =-*.r_\.
!
(rnCiupi",el* *" rv,u *';**;*r]::11,1"^i:iiTo :* :"d onryonecode. of coding missingdata..1 pioperty-they
canbe arranged "o.luJ'al crimersion: quantity, value, o.Lu"i.rir" qu"ir;;;iTiffil.'J:ffHlin an order
! I
uno.q"-", *r,"*,i" j-i.i,ii"i f::,::::ordeled :ITg::r "_i"uc, is helpfulness to Negroes. ",,n,"n n""Jry, ,i" 11-.rre
-Etr::.n:.y:-:,:,
encounter
"-)iili::,,l",I.,1
in surveys. r;'orl" d;ses, rLrpuxscs'..don,t oon l ] 5 :J,::,:T:i.::tuarly u lmplicit "no answer" not self-evidentlyordered with r G (-
r-
ff:;*o.;:f E $,.ierhara -.- *r-rc dL}'
:,::,:lf:::,*:*:llg:4;ir'" ,,don't know,, responie is
"#:.rr"ii"i ".0'*" in be,*"",
p,ausib,e argu.
r.:ffi {il; rti-\ a neutra] rafhe " 'i either a a-positive or a or a nesatrve negative response. Puuuve response. To treat To treat F ri,;. *,,, o thi', ,, ;;unj, ^_ ^_^,,-Lrhun
hen
..3:.tl "y,r,.,..h,,"r;'::,.Y::lo_l'::1" the.variableb-yassigning .de ..r.. "oo.
Dhr_-=an
.;;;.;:;il;;'#;;"i:,;T[ffiTl.tfl;J:5il:l'; =-Y ,** *.,n"
qE ffi
- --r'i::5#*::,::,:,"^tTlt$*l,J*;.i;*areundertaken, asparrorrhewritiuporthe ri*oria'ffiffi#;"H;:lfil -urv.i*l ;G;;i:: aneufta, response
ffi."j"li:"*::-1": ses tb. no--aroorra
hlh
:g*
.
so varied' includingsimpleenor. failure ro comHence.thereis no way to predicrhow --he no*.rponi.n,. rnponded hadthey _ done so. Therefore,it probablywould b" *lr"rt -+.*.'*J;;:;;".""o,,":'lt r_ner_ to t s missinsdata. "ui L ry..rrant featre of ordinal variables is that they include no information about D'ahEe tr;ts een catesorie.. For.example, we do not t * ,i",rr* the difference r :ir*', "'' -E+ment rhatcivil rishts demonstrations fif""'u,o thejudgmentthat qr throj a tjnle.. is srearer"orsmalle,rthan ,fr" Oiff*"r"" Uiween ahejudgment r,E -b'o.o a little.: and that they.,helped ;;;;ffii,il. thi. ,"u.on, .o_" - .md social researchers --
ry---o._*,"r,il;"#"1f,T#i[:.j:::JfrX',f .rr a \ ariableanduseonly th" ord". prop".ty.-ffiri. :il:llf*:,:m*::] ryEs bhi ffi
rro,nr
fr" p"rrd"" qe u.ill mainly consid, ""i appropnate takenhere. kinds of statistics,those tbr nominal s..rJrh^ca on-- -;^.^ .-:r.two
doseappropriate forintervai il-,utjo;uiiJ;tr#fl1ff:ff#T
#: ffi",fl":"J"l1'"u*^.r-t*'ins 'i"ti'i",,'"",n*tlvdesigned
ffi;-"*
* - !".r"., i""I"*;;;;;'il]1,:?:ii#,T::.n tr;:ffi:.JH*"1:,1#i.;} j,*:ili,Tffi;,',,J1:;:nn*]:l Tl *"^r";dil;,i:';,f,l'#f :\ample' rhare..or is normaty distributea, 'db-ir s""""J'"ffii @-madcally
h
mLl]
tractablethan
usedthan parametricstatistics;moreove, ,fro"
*"-,r"ry
statisticsaremuch altemativesfor
QuantitativeData Analysis:Doing SocratResearch to Testldeas
rhingandiirrle consensus amongresearchers aboutwhich ordinat :::::ltl:llii sratlstrcto use.*:.same Third, many ordinalstatisticsinvo]veim;Icit assumptrons that arejust as restrictiveas the assumptionsunderlying parametric statistics.For example,it can be show! thatspearman'srank ordercorrelation(an ordinalstatiJcfis ioenticalto the product-moment(Pearson)coneradon(the conventional parametriccorrelationcoefricient) whenintervalor ratio variablesare converted to ranks.In effect,then,the Spearmanrank ordercorrelationassumes an equaldistancebetweeneaaf, .",lr.r,han makingno assumptions aboutthe distancebe "-"-,"g".y
byusingordinar,",i**'G.,""""T;";J:'.:Ti;.:[:T;H.-rH]il[.1 stonscanbe tbundin Davis1971,andHildebrancl andoth.., lt i.i Interw vqriqblesandratio vqriqblesaL.e similaf in thatthe clistanceoetweencatego_ Nor only canwe.saythatonecaregoryis higher rhananother(on some :t"_:l: T.i."irCf"] drn'renslon) bur also how much higher.Such uuriobi.. i.gltiiotelf can Uemanipulated with standardarithmeticoperations:addition, subtractiori-'outr'i oi"ouon, and division.
'-r! l \lt L ..-' \
('1900-?960)wasanearlyteader in thedevelop_,, ot ment surveyresearch. Hewasbornin SacCity,lowa,andearneda B.A. frori Morninglide college;earnedan MA. in riterature at Harvard; served threeyearsasan eaitorofihesiiirty. . ot hisrather; andthenbesan e'"d'"t" rtuoi",in sociotosi at iH;,i.1^"]i3T"jj::i*o the university of chicaso,completing ph.D. his in 1930.i.A/hit; ;a;;";;;.;*;;*"r," F.osburn,who introduced himto starisrics uurpituitr r"no"..,ibed jnirial :1,:_,::::tyl lr: hostility to thesubject. Hestudiedstatisticai methods and**n"ru,i., ,n*nrtu"ryat chicago
univers,v olLondon, ililil T::J.l[:ff;:,:::::::"::1y:::'::,::rtt:,,*a,the
whereheworkedwith Karlpearson, amongothers(seethe bi"grupf,i.uf ,f";h';"r"";;""i;' Chapter Five). Stouffer heldacademic appointments in statistics andsociology Wrr.onrio, Chrcdgo, andHarvd,d. Hewasd srlredresea.cn "t ad-ri.tistrdto,, i""Ong o'nurnO"r. o+toro"
il;;:';.:;;;;il il;:il:*;':::":, TTli: ;:Iil:: i:::1,:.::t::11t:;;.;
sociat science Research councir project to evaruate theinfruence of the,.ilri:; i;'r::,i durinsWorrdWarrr,a studvot sorders rorrhe ;:T:.::*l:':::: iiJ.'lf:: :::*"'hs; Defense Department, whichresulted intheclassic priblica..r"rr, ,n"'ir"*r'ildriffi;
a-studv ortheantkon'm'ni't t'v't",iu J;;
il""-h' :y funded ;::::':,i:l'"'11,".ii-]?jl:: era, by the FordFoundationt Fundfor the Republic, which;;;;; ;;r;;;# (t55) when he diedratherun"*0".,"0t"u, asesixtyartera ::,:r'::: T: :::,,:,!::,* briefiilness, hewas in theprocess
of devetoping for theeopulalio;;il;,;;* . ffiff d:"r*:rg nations. Heatsoplayea un irnpo,tunr rorein deverop_. f:til:1T""_Ti:-l.jl]l]l I statistical standards intheU.s.Bureau oftheBudget. A hailmai.f ur"ri"ra*i*";; ;; ; to usingempiricat daia quanritarive and me*or, . |',nor*i,Vi"ri )l::"r,:iny:"rT,tted roeasabout socialprocesses,
rns rhe statisticiar ;; ;n#il;;;J",*- iffi ruTffi.iil*'#:l""lT.,. o,"n;,;
which makesit fittjng that a poslhumous collectionb{ his .r. papersls titled SocialResearchto Testldeas(1962). .
Cross-Tabulations
I l
'=[F#J&:
I
7
arions ror rhem rhe [r dr#i #i.*#ilder
,fl"T:H,"":f =E::m#':.':,"J"'fi ;i""..",.,,".;:oj:;::;;'# i:l::iiiiird;J:;::$:: iF::;Tiri;fl lE*'"',*'n:"'ff
lffii,tij$1lr",-"1ff ***,$+T.;"-,#n:r
"*::i*'T #l;'tril*fd1#;ltti*Ttfi'trJ,i
lq'jf"f* vanous forms of
ffi'tuffi*,,*j:.l: h g
*
@.lo '\*t \d HI {*at
:,pinion, is rhe povemm.
i*,ii )ii,';'A|,:':Kf", ".
* washinston pushinsintesration toosrowtoo
,rantb workhard. ct I t aheadiustas e&Jilyas anyone else'@isagree.) thould sp"rd .or" ti*" and less time demonstratinS' (Disagree.) tc nuh I wou, u" *or" no'o'mg part in civil righrs demonstrations.(Disagree.) wt like to s"" *or o"^ol,'* tions or lessdemonstrations? (More.) ot+ne^horta oot hoJ
ffi1-*'-;;":;:::;:;;":::::":"::,',;;:"X:T;i ft
,"t
O-Oerty shouldnot haveto sell
to Negroestf he doesn| wsnt b.
-rtf*tf*#r."r::%#.qf =*#tr{*1df #$,dTr*:
8
euantitative DataAnalysis:Doing Social Research to Testtdeas
wil devote considerabre afientionro ijit'i'" j,X,iJii1;li::;",,1":,:lf*, Ereven_we The third elementin any quantitative analysisis the model,the way we organizeand marupulatedata to assessour idea or hypothesis.Th; ;;il; rwo componenrs:the choiceof staristicarprocedure rh. now the variablesin our analysisare related.Given"r,i ";r;;;;;;r;;;;""il'fi, I
;::T,'.x','l;:J*,'.",llfutii::li*:::*.r-d:i ;j:;
witr, our nypotr,e,e.."d;;;#r::Jffi ',.TH,""r'":l'XT:1,"H;,il:"#:i*:i
cross-tabulations of militancvbv religiosity trurr ,rr. i",-i".iiri or succersiue variables,whichare.tiscusseo cont.ol a ,"J .rp""lliol' fi,vpotr,".iOi, tr,utu of thenonretiglous ^bitlar".i, thanof the"r, religio;;;ii; :',:T:.1"1"*"c. mllitant_{r because we navecompering hypotheses, thata lower.percen,"g" rant Larcrin thebookwe will deal "i,i" """-rigious will beraili_ withstatisrr""r moresophisticatedmostlyvariantsof thegeneralli1:,Tmod:llbur -,r"o"ir,rr" ,,re.i.gi. -. *,ril"_rn unchanged. we actuallycarryoutcross_tabulatlon How analysis is thetopicof thenexrsecnon. CROSS.TABULATIONS
rerigious Bracks aremore rikerv (orress ft:,T,1T;:Tfli,ffn:x*:rmine.whether Blacks'
Perhaps the moststraightforward approach rs ro cross-tabulate ,-;:-:llci:"t *tiglt.ill' thatis, to count thet.-qu"n"y oi persons witheachco,o6;12661 ^1L o1|1?,cl
*,-;;;;;;;;;;;,:l :ill:'J:i Hl:ffit:i HI ff:l;ll:;li,lli i ::"^T:. jill'ffi.Tiff'l[T:'J+;i,Ti']iiofmiriraricf ;t ;j'*.""'r rhe rorrowing vieids
. Trt, ^:t" Joint Frequel Among urban Negroes in the,rcy Religiosity
Distribution
Militant
Veryreligjous
61
of Militancy by Religiosity
Nonmilitant
Total
4t
290
C
372
532
t! U
108
t95
169
f
Somewhatreligious
160
Not very religious Not at ali religious 11
36
ld
fl[ @ @
333 soulce.Adaptedfrom Alarx(j967a,
Table6)
660
993
d
Tl I
Cross-Tabulations
: ' . 1; 1. : ' O :' lN T AB L E1 .1 -:ll:li]lSividuals) in thetabteis siveninthetower_riqht ce|(orposition
,= -]_ in l-=: = ='lo1e that this is fewer than the nrrmharofcases .:c6" in i^ the +L^sample tne number --^* -;,*(recallthatthe ^f j9
::-sstsol t,j cases). Thedifference isdueto missing Oau;Ua o, ,or" L_ r : - ::-:: r d not answerall the questions needed to construct the religiositanOmi||Later, wewtlldealextensively with missing datap.U"r, lor tfrup**ni, rgnorethe missingdataand treatthe sampleas if jt consists of g93 -i : ;-: :ei s In the interior of the ta
. : ..::,en that cyore"* 1", ?ll;lffJ :#frHffi:Dcv-dislribution. -,0,."i,"1f --- :: :. :. the variables and response caregones areg,venin the tablestubs.
Ji:ff :[:?,".J."^: :iffi?f:fl:i,T .i_,-': *ffi :::ffi";:::i
: : - 169 230,andsoon;addlngup theentries of eachcoiumnandconfirm_ 'r correspond -:--:- i: :-ey to the row marginal, for example, 6l + 160+ g7 * ,, = ,:a, :-. :r :-; and addingup the row marginars andthe corumnmarginars and contirming :-= -: :_r of eachcorresponds to the tabletotal. lt is easyto intro"duce errors, especrally -:- ::c_,'ngtables,and it is far bett
.:-:::-nt than you,,"ua"o,o ror or.ll,"'lfJ"fij[T;:JJlffi:,l,1"tffi:ruill:
:::'
.: _- iables.
-:': ::: rable.can we decidervhetherreligiosity favorsor inhibits militancy?Not rrr.. ;:. T,r do so. we would needto determin-e the"ret"iiri p-'iloitirythat peopleof rrur ic::- of reli_eiosityare militant. If the probabi[t l""ri"r* ,r* religiosity, we nr*n,nruul ::r--.ude rhar religiosity milit_"y; if tne proUaUitityof militancy rq:i:
#il;:#:::::Tifr [TiJi;':'il?Tl'X.H:'#fl,.T:X ),--.-..;;j'g;',?ffi
10
QuantitativeDataAnalysis;Doing SocialResearch to Testldeas
percenttrltititantby RetigiosityAmong TABLF 1.2. Urban Negroes in the U,S..1964.
very Religious
Somewhat Religious
Not Very Religious
Not at All Religious
TjICHNICAL POINTSON TABLE 1.2 i) Always includethe percentagetotals (the row of 100%s).Although thrs may seem redundantand a wasteof space,jt makesit immediatelyclearto the reader in which directionyou havepercentagedthe table.When the percentagetotalsare omitted, the readermay haveto add up severalrows or columnsto figure jt out. Usingpercentage signson the top row of numbersand againon the Totarrow arsocrearryindicates to the readerthat this is a percentagetable. 2) Wholepercentages areprecjse enough.Thereis no point in beingmoreprecise in the presentationof data than the accuracyof the data warrants. Moreover,fractionsof percentages are usuallyuninteresting. lt is hardto imagjneanyonewantingto know that 37.44percentof womenand 41.87percentof mendo something; it is sufficient to note that 37 percentof women and 42 percentof men do it. Incidentally. a conve_ nrentroundingrule is to round to the evennumber Thus,37.50 becomes 3g, but 36.50 becomes36. Of course,36.5.1becomes37 and 37.4galsobecomes you 37. only want to reportmorethan whole percentagesif you havea distributionwith manV categoriesand are concernedabout roundingerror. 3) Alwaysincludethe numberof caseson which the percentages are based(that is, the denominatorfor the percentages).This enablesthe reader to reconstruct the entiretable of frequencies(within the limjts of roundingerror) and hence to reorganizethe datainto a differentform. Notethat Tablei.2 containsall of the intormation
Cross-Tabulations
't1
you canreconstruct that Table1.1 containsbecause Table1.1 from Table1.2: 27 percentof 230 is 62.1,whichroundsto 62 (withinroundingerrorof 61),and so on. Customarily,percentagebasesare placedin parentheses to clearlyidentify ihem and to helpthem standout from the remainder of the table.
F
Sometimesit is usefulto includea Totalcolumn.as I havedone here.and sometimesnot. Thechoiceshouldbe basedon substantiveconsiderations. In the present case,about one-thirdof the total sampleis militant (as defined by Marx); hence,the marginaldistribution for the dependentvariableis reportedhere. Recall from page7 that "militants"arethosewho gavemilitantresponses to at leastsix of the eight items in the militancyscale.We now seethat about onethirdof the sampledid so.Obviously, if we definedasmilitantallthosewho gave at leastfivemilitantresponses, the percentage militantwouldbe higher. No conventiondictatesthat tables must be arrangedso that the percentages run down,that is,so that eachcolumntotalsto 100 percent.ln Table'1.2, the categoriesof the dependentvadableform the rows.and the categories of the independent variableform the columns.lf it is moreconvenient to reverse this,so that the categories of the independent variableform the rows,this is perfectly acceptable.The only caveat is that within each category of the independentvariable, the percentagedistribution acrossthe categoriesof lhe dependentvariablemusttotalto 100 percent.Thus,if the categories of the dependentvariableform the columns,the tableshouldbe percentaged across each row
The Diredion to Percentagethe Table Note that the direction in which this table is percentagedis not at all arbitrary but rather is determinedby the nature of the hypothesisbeing tested.The question being addressed is whetherreligiosity promotesor hinders militancy. In this formulation, religiosity is presumedto influence, cause,or determine militancy, not the other way around. (One could imagine a hypothesisthat assumedthe opposite-we might srppose that militants would tend to lose interest in religion as their civil rights involvement consumedtheir passions. But that is not the idea being testedhere.) The variable being determined,influenced, or causedis known as the dependentvariable, and the variables that are doing the causing, determining, or influencing are known as independent,or predictor, variables.The choice of causalorder is always a matter of theory and cannotbe determinedfrom the data. The choice of causalorder then dictatesthe way the table is constructed.Tablesshould (almost-an exception will be presentedlater) always be constructedIo expressthe conditional probability of being in eachof the categoriesof the dependentvariable given that an individual is in a particular categoryof the independentvariable(s).(Do not let the fact that the table is expressedin percentagesand the rule is expressedin probabilities confuse
12
QuantitativeDataAnarysis: DoingsociarResearch to Testrdeas
l*l$#i-q_1"",.:fi i:,fi,,f,H1, ,i*s1:1i*1",__;:Tffi :,T:*l%*;.""d,*1,:,i i**qii;ttil,TittrL';tff #l i**"x,:;{ilr#,;:xn:ii:r#:j,:i^: ru;,m;::*fr TiJ#;[ *#",'T; fflj..':,-jTi:ili??1"iif."," ffi'l'ffi*:,lnri:;nll; ;ry:*:.1"i;:1iil:11*t;"#i.Ixli:'f
:txxT:r*,r#fr :ffi:::t;?HTtH:1H$::" ff::i.;iffi i Control Variables Jhus
far, we have determined ti
,,ffi ?::1;:J", mh*::H,"ili:j.{##:HI""3!:,J,,T#j:
a rtrongrheory,lri p.Ji.,.aT'it
religiositycauses peopleto belessrnilirant.lf wehad
:;i#lqfr#;#$ltfi ffi fi r+l.t!;t#:;:'. ,ffi: iff jffijjff l1;1u,"nr.,.-,h;Gffi uJ:[; frf :i:*[.{;ffiiifi
*:ry]i',;^:,:**i.:. I T,[TJ'.;*? ?ff d#if,::1lf,H "f,. ;;;;il::iJ#liiifi
:-,.:il;::f
il""n*"j,9,;;?:j#nfja*J
Horv can we testthis possibility?
j:,lffiTrnXi*ereducationdoesinracrredr "*r'ilhff .ffi1,
j*fu31"*"*l=*-"^*i1:': ;::::*ltln:: :i."ll$".:;*t"Tfl;*:"., ;iHl?il :ilff:.ilT i;fi :ffii::#:lT:{
:; ;:,:l',f
;:r**:L'f;*i**T##.,:ff ;ff d#kl'lJi:#f i#*"::* ir is. whar ,",r0 y,"1. ,ff::JH il:ru:::n""1,* p",".n,ug.o ,r. ^,.nin-gliyou ,"rJiI.
we need to dererminewhether educationincreasesmilitancy by crearing
..";?ffi;:"*i#:'rfifi }:lff:T;"J$ $,",f ::ffi ,"ji?lil"Jj;T",T
I Cross-Tabulations
't3
:i:rent of those with high school education, and fully 53 percent of those with college are militant. Another way of putting tfts t to say-ttrat"a'posrtive association -:-ration :!r\ between education and militancy: as education increases, the probability of mili_ increases. -::r
i , :i , percentage Distribution of Retigiosity by Educational AtGinment, Urban Negroes in the U.S., 1964. EducationalAttainment Religiosity
GrammarSchool
High School
College
.€ry religious
',:: at all religious btal
frornNlarx(1967a, - : -'::r Adapted Table 6).
'-:; .r-f . percent Militant Lfran Negroes in the U,S., 1964.
by Educational Attainment
Educational Attainment Vilitancy i,!ilitant '.3nmilitant Total
GrammarSchool
High School
College
14
Quantitative DataAnalysis: DoingsocialResearch to Testldeas
T'ECHN|CAIP{.}iXTSON TABLE 1.3 5ometrmes your percentages will not totalto exactly100percentdue to roundinger_ ror.Deviations of one percentage point(99 to 101)areacceptable. Largerdeviations probablyindicatecomputational errorand shouldbe carefully checked.
\
Note how the title is constructed.lt stateswhat the table is (a percentagedistribu_ tion),which variables are included(the conventionis to listthe dependentvariable first),what the sampleis (urbanNegroesin the U.S.),and the dateof datacoltectron (1964).Thetableshouldalwayscontainsufficientinformation to enabieone to read it without referringto the text.Thus,the title and variableheadingsshouldbe clear and complete;if thereis insufficient spaceto do this,il shouldbe done in footnotes to the table. In the interpretation of percentagedistributions, comparingthe extremecategoriesand ignoringthe middlecategoriesis usuallysufficient.Thus,we notedthat the proportion "very religious"decreases with education,and the proportion ,,not at all religious,, increases with education.Similarassertions about how the middlecategories(,,some_ what religious"and "not veryreligious.,) varywith educationareawkwardbecausethey may draw from or contributeto categorieson eitherside.Forexample,the percentage "not very religious"amongthosewith a collegeeducationmight be largerjf eitherthe percentage"somewhatreligious"or the percentage,,not at alj religious,,were sma er. Butone shiftwould indicatea morereligiouscollege-educated population,andthe other shift would indicatea lessreligiouscollege-educated population.Hence,the -not very religious"row cannot be interpretedalone,and usuallylittle is said about the Intenor rowsof a table.On the other hand,it is importantto presentthe dataso that the reader canseethat you havenot maskedimportantdetailsand to allowthe readerto reorqan_ izethe table by collapsingcategories (discussed later).
4) In dealingwith scaledvariables,such as religiosity, you shouldnot make much of the relativesizeof the percentages within each distribution;that is, comparisonsshould be madeacrossthe categoriesof the independentvariable,not acrossthe categones ot the dependentvariable.In the presentcase,it is jegitimateto note that those with a grammarschooleducationare more likelyto be very religiousthan are those who are bettereducated,but it is not legitimateto assertthat morethan half thosewrrna grammar schooleducationaresomewhatreligious.The reasonfor this isthat the scaleis only an ordinalscale;the categoriesdo not carryan absolutevalue.How religiousis ,,veryre_ ligious"?All we know is that it is morereligious than ,,somewhat religious.,, In conse_ quence,it is easyto changethe distributionsimplyby combiningcategorjes. Suppose, for example,we summedthe top two rows and calledthe resultingcategory,,reli_ gious." In this case,88 percentof those with grammarschool educatjon would be shownas "religious." Consider how thiswouldchangethe assertions we wouldmake about this sampleif we took the categorylabelsseriously.
Cross-Tabulations15
, ' . : f A t - F Ct t , f T so N T A BL E1 .4 r, When you are presenting severaltablesinvolvingthe samedata,alwayscheckthe consistency of yourtabiesby comparingnumbersacross the lableswhereverpossible. For example,the number of casesin Table 1.4 should be identicalto that in T able' 1 .3 .
BecauseeducatedurbanBlacksareboth lesslikely to be religiousandmorelikely to :s militant than are their lesseducatedcounterparts, it is possiblethat the observedaisobetween religiosity (non)militancy and is determined entirely by their mutual --iadon Jependence on educationandthat thereis no connectionbetweenmiliiancy andreligios:1 amongpeoplewho are equally well educated.If this provestrue, we would say that :ducation.rplains the associationbetweenreligiosityandmilitancy andthat the associa:on is spurious becauseit does not arise from a causal connectionbetween the rar-iables. To testthis possibility,we studytherelationbetweenmilitancy andreligiositywithin :ate-qories of educationby creatinga thee-variablecross-tabulation of miliiancyby rel! by education. such a table can be set up in two different ways. The first is shown -iiosity rr Table1.5,andthe secondin Table 1.6.
Tlt 3 L f ? , 5 percent nnilitant by Retigiosity and Educationat " Attainment, Urban Negroes in the U.S.,1964. GrammarSchool Militancy
High School V SN
College VSN
Jour.er Adaptedfrom Marx ('1967a,Table6). S=somewhat -V=veryreligious; relgious;N=not veryreligious or not at all religious.
16
QuantitativeData Analysis:Doing SocialResearch to Testtdeas
TECI{}iJCAI-PCII,JTSON TABLE 1.5 1) In thissortof table,education js the controlvariable. Thetableis set up to showthe relationship betweenmilitancy and religiosity within categories oi eOuc"tion, tt"t is ,,controlling (synonymously), ,,holdin9 for education,,, edui"tion oi.-n"t ot education " Thecontrorvariabre shouldalwaysbe put on the outside -nrtunt,of thetaburation sothat it changes mostslowly.This{ormatfacilitates readingtfreiaUt"Oec"use it put, the numbers beingcompared in adjacent corumns. (sometimes we wantto studythe relationship of eachof two independent variables to a dependent uuriuOiu, in .uru controlling for the other.In suchcases, "u.t jn we stillmakeonlyonetableandconstruct tt whatever waymadeit easiest to read.lf ourdependent variable isdjchotomous or can betreatedasdichotomous, we setup thetablein theformatof Table16.) 2) Notethatthe ,,notveryreligious,, and ,,notat all religious,, categories werecom_ bined.Thisis oftenreferred to ascollapsjng categories. Collapsin-q is usuay done whentherewouldbe too few cases to producereliableresults for soime .uregon"s.tn the presentcase,aswe knowfromTablej.l or LZ. therearetfrirty_srlx peoplewho arenot at all religious. Dividing themon the basisof educational attajnment woutd producetoo few casesin eachgroup permit to reliabre estimates of the percentmrrrtant.Hence, theywerecombined withtheadjacent group,,,notueryreligious.,. An additional reason for colli
detair makes itdirric,r, r",,h";;;:;ij":ffiln: jiJff:ffi,'ii'"'tJi:#:.j
it helpsto reduce the numberof categories presented. OntheotherhanJ,it categories of theindependent variable djfferjn termsof theirdistribution on tf," Jup"nOunt u"ri abre,combining thecategories wilrmaskimportant distinctions. e fineiarancemust bestruckbetweenclarityandprecision, whichiswhyconstructjng tablesis an art.
From Table I.5, we seetharreligiosity continuesto inhibit militancy evenwhen edu_ cation is conholled, although thedifferences ln p"r""ni_itit_-t-u.ong religiosity cate_ gones tend to be smaller than in Tabte 1.2 where educatim i, i.i (In the next chapter' will discussa procedurefor ""r"ol"d. calculatingthe sir" or,rr"."oo",ion 1e in an associatron resulring from the introducrion_ i. ;i|n*a ytr,ol yanaUfe, ,* Oercentage O:{-:r:""",.)!^"g 11a thosewith Cr.lTrnar schooleducation,f Z p#*, of the very ret! grous and 32 percent of the not religious are militant; the p".centages for thosewithhighschool "orr"rilnorog education i.z+
38and68'Thusweconclude -ai^Jli;Ji;';il*ege thatedu"ution oo", noi' -----rrv!vrr sw! associationbetweenreligiosity andmilitancv. "o-pi#iy "***
educarion are tor theinverse
At this point, we haveto decid.ewhether to continue the searchfor actditionalexplan_ atory variables. our decision usually will be uur"a on u of substantiveand technical considerations.If we have grounds "o-iinltion for believing that some other factor misht
Cross-Tabulations
17
:"'count both for religiosity and militancy, net of education,we probably would want : ' control for lhat factor as well. Note, however,that the power of additionalfactorsto :rplain the associationbetweentwo original variabres(herereligiosity and militancy) '; ill dependon their associationwith previously introducedcontrol variables.To the :\tent that additionalvariablesare highly correlatedwith variablesalreadyintroduced, :e'will havelittle impact on the association.This is an extremelyimportantpoint that -'ill recur in the context of multiple regressionanalysis. Be sure you understandit :oroughly. Considerage. What relation would you expect age to have to religiosity and to :rilitancy?
Pauseto ThinkAbout This Religiosityis likely positivelyassociated with age-that is, olderpeopletend to be more -:lieious and militancy is inverselyassociatedwith age-younger people tend to be ::rrre militant. Hence,we might expectthe associationbetweenreligiosity andmilirancy :: be a spuriousfunctionof age.That is, within agecategories,theremay be no associa_ -:.rnbetweenreligiosityandmilitancy. What,however,of the relationbetweenageand education?In fact, from knowledse =:out the secula.r trendin educationamongBlacks,we would expectyoungerBlacksio t substantiallybettereducatedthan older Blacks.To the extentthis is true.aseand edu:.:rion are likely to havesimilar effectson the associationbetweenreligiosityand mili--ncv Hence,introducingageasa controlvariablein additionto educationis not likely to -:ducethe associationbetweenreligiosityandmilitancyby much,relativeto the effeci of :Cucationalone. Apart from theoreticalandlogical considerations (is a variabletheoreticallyrelevanr, .:d is it going to add anythingro the explanation?),thereis a straightforwardtechnical ::ason for limiting the number of variablesincluded in a single cross_tabulation_we :rr!-kly run out of cases.Most samplesurveysincludea few hundredto a few thousand -.ses. We alreadyhaveseenthat a three-variablecross-tabulation requhedthat we col_ -:rse two of the religiosity categories.A four-variablecross-tabulation of the samedata -. lilely to yield so many smallpercentagebasesas to makethe resultsextremelyunreli.:le. The difficulty in studying more than about three variablesat a time in a cross_ -:bulationprovidesa strongmotivationto use someform of regressionanalysisinstead. { substantialfraction of the chaptersto follow will be devotedto the elaborationof :::ression-basedprocedures. Table 1.5 also enablesus to assessthe effect of educationon militancy,controlling ::r religiosityby comparingcorresponding columnsin eachof the threepanels.Thus,we ,rtethat, amongthosewho are very religious, 17 percentof the grammarschooledu_ :trIedare militant comparcdto 34 percentof the high schooleducatedand 3g percentof :; collegeeducated;amongthosewho are somewhatreligious,the correspondingper_ r:nmgesare 22, 32, and48; and amongthosewho are not religious,they are 32,47, a\d ::. Hence,we concludethat, at any given level of religiosity,the better educatedare -.rre militant.
18
Quantitative DataAnalysis: DoingSocialResearch to Testldeas
TA B L E J . 5. percent uititant by Religiosity and Educationat Attainment, Urban Negroes in th€ U.s., 1964 (Three_Dimen"iir,.l rorrnii). EducationalAttainment Religiosity
GrammarSchool
High School
61)
Source:Table'1.5.
TECI-iN{CALPOINTSON TABLE 1.6 1) Eachpairof entriesgivesthepercentage of peoplewho havea traitandthepercent_ agebase,or denominatotof the ratiofrom whichthe percentage wascomputed. Thus,the entryin the upperJeftcornerindicates that ?7 percentof the 108veryreligrousgrammar-schooleducated peoplein the samplearemilitant.Fromthjstable, we canreconstruct anyof the preceding fivetables(butwith the two leastretigious categories collapsed into one),withinthe limitsof roundingerror.Tryto do thisto confirmthatyou understand the relationships amongthesetables.
This reguires a fairly tedious comparison, however, skipping around the table to , locate the appropriate cells. When the dependent ,-i"Of" t'&"frLt"mous, that is, has onll tw9 response caFgories, a much more succinct taOte tormat rs possible and is prefened' Thble i.6 containsexactly the same information nii"i.i, urr,rr" information is_anangedin a more succinct way. Tableslike Table r.o "r t ro*n u, tr,r"e-dimensional tables-" CompareTables 1.5 and 1.6.,you will see that they contain exacfly the same inforrnation-all the additional numbersin Table t.S *"."iuoJ_f Moreover, Table I.6 rs much easier to read becausewe.can.seethe effect of religi;rity;, militancy, holding constanteducation,simply by reading down the columns, ani th" of educa_ tron on militancy, holding constantreligiosity, simply "aoie" "ff"ct by'readinfacross the rows.
Cross-Tabulations
19
WHAT THISCHAPTERHAS SHOWN In this chapter,we haveseenan initial ideaformulatedinto a researchproblem,an appropriate samplechosen,a surveyconducted,and a set of variablescreatedand combined into scalesto representthe conceptsof interestto the researcher. We then consideredhow to constructa percentagetable that showsthe relationshipbetweentwo variables,with specialattentionto determiningin which directionto percentage tablesusingthe concept of conditionalprobability distributions-the probability distributionover categoriesof the dependent variable computed separately for each category of the independent variable(s).This is the most difficult conceptin the chaptet and one you shouldmake sureyou completelyunderstand. The other importantconceptyou need to understandfully is the idea of statistical controls,also known as controlling for or holding constantconfoundingvariables,to determinewhetherrelationshipshold within categoriesof the controlvariable(s).Finally, rve consideredvarious technicalissuesregardingthe constructionand presentationof ubles. The aim of the gameis to constructattractive,easyto readtables. In the next chapter,we continueour discussionof cross-tabulations, consideringvarious waysof analyzingtableswith morethantwo variablesand,moregenerally,the logic of multivariateanalvsis.
to AS
is DN lal
oe .6 a-
CHAPT ER
MOREON TABLES WHATTHISCHAPTER ISABOUT ln this chapter we expand our understandingof how to deal with cross-tabulations,both substantivelyand technically. First we continue our considerationof the logir of elaborarion, that is, the introduction of additional variablesto an analysis; second,we consider a special situation known as a suppressoreffect, when the influences of two independent variablesoffset eachother; third, we consider how variables combine to produceparticular effects, drawing a distinctionbetween additive and interaction effects;fourth, we see how to assessthe effect of a single independentvariable in a multivariate percentagetable while conholling for the effects of the other independentvariables via direct standardizafion; and flnally we considerthe distinctionbetvteen experimentsandstatistical controls.
11 1Z
QuantitativeData Analysis:Doing SocialResearch to Testldeas
THE LOGICOF ELABORATION In traditional treatmentsof survey researchmethods(for example,Lazarsfeld 1955: Zeisel 1985),it was customaryto make a distinctionbetweentwo situationsin which a third variablecompletelyor partiallyaccountsfor the associationbetweentwo other variables:spariors associations andassociations that can be accountedfor by an interveninB variableor variables.The distinctionbetweenthe two is that when a control variable(Z r is temporallyor causallyprior to an independentvariable(X) anddependentvariable(I). and when the control variablecompleteryor partryexplainsthe associationbetween the independentanddependentvariable,we infer that thereis no causalconnectionor onlv a weak causalconnectionbetweenthe independentand dependentvariables.Howeuer. whenthe controlvariableintervenestemporallyor causallybetweenthe independent and dependentvariables,we would not claim that thereis no causalrelationshipbetween the independentand dependentvariablesbut ratherthat the interveningvariabL explains, or helps explain,how the independentvariableexertsits effect on the dependentvariable. In the previouschapterwe consideredspuriousassociations. In this chapterwe revisir spunousassoctations andalso considerthe effectof interveningvariables.
SpuriousAssociation Considerthe threevariables,X, { andZ. Supposethat you had observedan association betweenX and I and suspected that it might be completelyexplainedby the dependence of both X and Y on Z. (For a substantiveexample,recallihe hypothesisin the previous chapter that the negativerelation between religiosity and miiitancy was due to the
Moreon Tables 23
IA
ri18 Z) '), rc t, d E
)r e,
ir
dspendenceof both on education-Blacks with more education were both less religious md more militant.) Such a hypothesismight be diagrammedas shown in Figure 2.1. Causaldiagramsof this sort are usedfor purposesof explication throughout the book. Tbey are extensively usedin path analysls, which is a way of representingand algebrai;ally manipulating structural equation models that was widely used in the 1970sbut is bss frequently encounterednow (seeadditional discussionof structural equation models .md path analysisin Chapter Sixteen). My use of such models is purely heuristic. Nonefreless, I usethem in such a way asto be conceptually complete. Hence, the pathsfrom x bX(px.)andfromytoy(lDyy)indicatethatotherfactorsbesidesZinfluenceXandI. Now, if the associationbetweenX and I within categoriesof Z were very small or moedstent, we would regard the associationbetween X and Y as entirely explained by 6eir mutual dependenceon Z. However,this generally doesnot happen;recall, for examde. that the negativeassociationbetweenreligiosify and militancy did not disappearwhen edrcation was held constant.We ordinarily doi not restict ourselvesto an all-or-nothing hlpothesis of spuriousness-except in the exceptionalcasewhere we have a very skong drory requiring that a particular relation be completely spurious;rather, we ask what the associationis betweenX and I controlling for Z (and what the associationis betw eenZ and tscontrolling for X). The logic of our analysiscan be diagramedas shownil Figure 2.2. To statethe samepoitt differendy, rather than assumingthat the causal comection betweenX ard yis zero and determining whether our assumptionis correct, we esfimate Se relation betweenX and lholding constantZ and determineits size-which, of couse, may be zero, in which caseFigure 2.1 and Figure 2.2 are identical. X <1 - x
Y+ Y
I
FIGURI 2.1 , the obs"*"d Association Between X andy tsEntirelyspurious and Goesto Zero WhenZ ls Controlled. Xi-x
.,
z
II I
\
I
Y+Y
FIGURt 2.2, rheOOn*ed Association Between X andY tspafttySpuious:the Effectof X on Yls Reduced WhenZ ls Controlled(Z AffecbX and BothZ andX Affect y).
24
QuantitativeData Analysis:Doing SocialResearch to Testldeas
Interuening Variahles Now let us considerthe interveningvariablecase.Supposewe think two variables,X and L are associatedonly becauseX causesZ and Z causesZ An examplemight be the relation betweena father's occupation,son's education,and son's income. Supposewe expect the two-variable associationbetweenX and f-sometimes called the zBro-orderassociation. shortfor zero-orderpartial association,that is, no partial association-to be positive,but think thatthis is dueentirelyto the fact thatthe father'soccupationalstatusinfluencestle son'seducation and that the son's educationinfluencesthe son's income; we think there is no direct hfluence of the father'soccupationalstatuson the son'sincome,only the indirect influence throughthe son'seducation.This sortof claim can be diagrammedasshovn in Figure 2.3. But, as before, unless we have a very strong theory that dependson there being no direct connectionbetweenX and I, we probably would inspect the data to determinethe influence of X on f, holding constant the intervening vaiable Z, and would also determine the influence of Z on I, holding constantthe antecedentvariable X. This can be diagrammedas shown in Figure 2.4 If the net, or partial, associationbetweenX and I provesto be zero,we would conclude that a chain model of the kind describedin Figure 2.3 describesthe data.Otherwise. we would simply assessthe strengthand natureof both associations,betweenX and land betweenZ ard f (and, for completeness,Ihe zero-order associationbetweenX and Z. Notice the similarity betweenFigure 2.2 and Figure 2.4. With respectto the ultimate dependentvariable, f, the two models are identical. The only difference has to do with the specification that Z causesX or that X causesZ. Tttere is still another possibility: X and Z causeI, but no claim is maderegarding the causalrelation betweenX and Z. This canbe diagrammedas shownin Figure2.5.
,r'
',
'/.
z
Ft6r.,RE 2.3.The ObservedAssociationBetweenX and Y ls EntirelyExplained by the lntervening Variable Z and Goesto Zero When Z ls Controlled-
/
\
Ff Gf.JRg 2"4, ne observedAssociation Between x andy ls parttyExptained by the lnterveningVariableZ: the Effectof X on Y ls ReducedWhenZ is Controlled (XAffectsZ, and BothX andZ Affect y).
Moreon Tables 25
Z
FIGURE 2.5, eoth xanA z AffectV but theretsno AssumptionRegarding tu CausalOrdering of X and Z. In almost all of the analyseswe undertake-including cross-tabulationsof the kind c te concemedwith at present,multivariate models il al ordinary least squaresregresin t-anework, and logJinear and logistic analogsto regressionfor categorical depenrzliables-the models,or theories,represented by Figures2.2,2.4, and2.5 willbe r$rically indistinguishable with respect to the dependentvariable, Y. The distinction mns them thus must rest with the ideas of the researcher,not with the data. From the m+oinl of data manipulation, all three models require assessingthe net effect of each dtro variableson a third variable, that is, the effect of eachindependentvariable holding :msta-ot the other independentvariable. Obviously, the sameideas can be generalizedto :inrari6a3 ilyslyilg more than three variables.
SUPPRESSOR VARIABLES (he final idea needsto be discussedhere, the notion of suppressorvariablas. Thus far, r€ bavedealt with sifuationsin which we suspectedthat an observedassociationbetween tm rariables was due to the effect of a third, either as an antecedentor an intervening qiable. Situations can arise, however, in which there appears to be no association hcr-een two variables when, in fact, there is a causal connection. This happenswhen re other variable is related to the two variables in such a way that it suppressesthe fterted zero-order association-specifically, when one independentvariable has oppo* effects on another independentvariable and on the dependentvariable, and the two *?endent variables have opposite effects on the dependentvariable. Such situations :a be diagrammedas shown in Figure 2.6. For example, supposeyou are interestedin the relations among education,income, rl fertility. On theoretical grounds,you might expectthe following: educationwill havea !tr[ft e effect on income; holding constantincome, educationwill have a negativeeffect '[ fertility (the idea being that educatedpeople want to do more for their children and cgrrd children asmore expensivethal do poorly educaiedpeople;henceat any given level rCimome, they have fewer children); holding constanteducation,the higher the income, fu higler the number of children (the idea being that children are generally regardedas ,Lsirable so that at any given level of the perceivedcost of children, those with more to md that is, with higher income, will havemore children). Theserelationship are repreoed ir Figure 2.6, where X : level of education, Z : income, and I : number of
26
DataAnalysis: Quantitative DoingSocialResearch to Testldeas
),' ".,.1 \l\t
- r :- '
\i
I
Y+Y
Ff GtrR€ 2.6. rhe sireof thezero-order AssociationBetweenxandyf:nd BetweenZ and Y) ls SuppressedWhen the Effectsof X on Z and y have Opposite Sign, and the EffecB of X and Z on y have Opposite Sign. children. The interesting thing about this diagram is that it implies that the gross, or zero-order,relationshipsbetweenx and r andbetweenZ and r wili be smaller thal the nel or first-order partial, relationshipsandmight evenbe zero, dependingo' therelative sizeoi the associationsamongthe three variables.To seehow this happenf consider the relation_ ship betweeneducation and fertility. we have posited that eiucated people tend to have more income,and at any given level of education,higher_incomepeopletend to havemore children. Hence, so far, the relation betweeneducationand fertility would be expectedto be positive. But we alsohavepositedthat at any given income level, better_educadd people tend to havefewer children. So we havea positive causalpath and a negative causaliath at work at once,andthe effect of eachis to offsetor suppresi the other effect, so that the zeroorder relationship betweeneducationand fertility is reduced.
ADDITIVE AND INTERACTION EFFECTS we now considerinteractioneffects,sii)ationsin which the effect of onevariable on another is contingenton the value of a third variable.To seethis clearly, considerTable 2. 1. This table showsthat in 1965 educational attainmenthad no effecr on acceptanceof abortion amongCatholicsbut that amongprotestants,the greaterthe education, the greater the percentageacceptingabortion. Thus, Catholics and p.ot"rturrt, with gth grade iducation or less were about equally likely to believe that legal abortion should permiaed be under specified circumstancesbut, among those with more education, protestants were subslanjal]1-lore likely to acceptabortion than were Catholics.Among the college edu_ cated,the difference betweenthe religious groups is fully twenty points: about 31 percent of Catholics and 51 percentof hotestants believed that ;bortion should be permittid. This kind of result is calredan interaction effect. Rerigionand educational attainment mteract to produce a result different from what each would produce alone. That is, the relationship between education and acceptanceof abortion differs tbr Catholics and hotestants, andth€ relationshipbetweenreligion andacceptanceof abortion differs by edu_ cation' Situationsin which the relationshipbetweentwo variablesdepends on the value of a third, as it doeshere, are known as interactions.In the older survey analysisliterature (for example,Lazarsfeld 1955; Zeisel 1985), interactionsare sometimescalled specifitations. Religion specffesthe relationshipbetweeneducationandbeliefs aboutabortion: acceptance of abortionincreaseswith educationamonghotestants but not amonsCatholics.
More on Tabl es
27
:j:.i .i 'l . Percentagewho BelieveL€gal Abortions should Be Possible by Religionand Education,U.5.1965 UnderSpecifiedCircumstances, (N = 1,368;Cell Frequenciesin Parentheses). EducationalAttainment Religion
8th Grade or Less
someHigh School
29o/o (287)
(2s0)
High School Graduate
somecollege or More
'and ri te
Protestant
oss, or tle net, sizeof .lationto have -emore rted to people pathat le Zero-
36"/o
430/o
5 1 '/ o
(22s)
(1966). i:-rr.erRossi ',:ae:NonChrist ansornltted.
another ance of sreater educamftted N Were se edupercent Ed. Lrnment is. the cs and bl edulue of a ,lle (for :ations. sPAnCe
Where we do not have interactioneffectswe have qdditive effects(ot no effects). Suppose,for example,that insteadof the numbersin Table 2.1, we had the numbers in Table2.2. 'hown What would this show?We could saytwo things:(1) The effectof religionon accep-;mceof abortion is the sameat all levels of education.That is, the differencebetweenthe who would permit abortionis l0 percentat each of Catholicsand Protestants -rcentage of abonionis the samefor (2) education on acceptance The effect of --\'el of education. between the percentagewho would Catholicsand hotestants. For example,the difference abortionamongthosewith somehigh schooleducationandthosewho arehigh school -rmit SimilzLrly, thedifferencebetween is 10percentfor both CatholicsandProtestants. rraduates those with a high schooleducationand pemit abortion among percentage who would -:re :nong thosewith at leastsomecollegeis 20 percentfor both CatholicsandProtestants.
28
to Testldeas QuantitativeData Analysis:Doing SocialResearch
TAtsLf 2,2. nercentageacceptingabortion by Religionand Education (HypotheticalData). 8th Grade or Less
Some High School
High School Graduate
Some College or More
The reason this table is additive is that the effects of each variable add together to producethe final result. It is as if the probability of any individual in the sampleaccepting abortion is at least .3 (so we could add .3 to every cell in the table); the probability of a Protestantaccepting abortion is .1 greater than the probability of a Catholic accepting abortion (so we could add .1 to all the cells containingProtestants);the probability of someonewith sornehigh schoolacceptingabortion is .05 greaterthan the probability of someonewith an 8th gradeeducationdoing so (so we would add .05 to the cells for those with somehigh school); the probability of thosewho are high school graduatesaccepting abortion is . 15 geater than the probability of those with an 8th grade educationdoing so (so we would add .15 to the ce1lsfor those with high school degrees);and the probability of those with somecollege accepting abortion is .35 higher than the probability of those with an 8th grade education doing so (so we would add .35 to the cells for those with at least somecollege). This would produce the results we seeinTable 2.2 (after we convert proportions to percentagesby multiplying eachnumber by 100). By contrast,it is not possible to add up the effect of eachvariable in a table containhg interactions becausethe effect of each variable dependson the value of the other independentvariable or variables. Many relationships of interest to social scientists involve interactions----especially with gender and to some extent with race; but it is also true that many relationships are additive. Adequate theoretical work has not yet been done to allow us to specify very well in advancewhich relationships we would expect to be additive and which relationshipswe would expectto involveinteractions. Later you will seemore sophisticatedways to distinguish additive effects from interactions and to deal with various kinds of interactions via los-linear analvsis and resression analysis.
DIRECT STAN DARDIZATION Often we want to assessthe relationship betweentwo variables controlling for additional variables. Although we have seenhow to assesspartial relationships-that is, relationships between two variables within categories of one or several control variables-it would be helpfui to have a way of constructing a single table that shows the average
Moreon Tables 29 reIationship betweentwo variablesnct of, that is, controlling for, the effectsof other variables.Direct standardization provides a way of doing this. Note that this technique has other names,for example, covariate adjustment. Howeve\ the techniqueis most widely usedin demographicresearch,so I usethe term by which it is known in demography,direcl ttandordization.It is important to understandthat, eventhough the sameterm is used, this procedurehas no relationship to standardizingvariables to create a common metric. We sill considerthis subjectin ChapterFive.
Example 1: Religiosity by Militanqr Among U.S.Urban Blacks The procedureis most easily explainedin the contextof a concreteexample.Thus we revisit the analysisshownin Tables1.2 through 1.6 of ChapterOne (slightly modified). Recall that we were interestedin whether the relationship between militancy and religiosity amongBlacks in the United Statescould be explainedby the fact that better-educated Blackstendto be both lessreligiousandmoremilitant. Becauseeducationdoesnot completely explain tlle associationbetweenmilitancy and religiosity,it would be useful to have a way of showing the associationremaining after the effect of education has been rcmoved. We can do this by getting an adjusted percentagemilitant for each religiosity ,-ategory which we do by computing a weighted averageof the percent militant across iducation categorieswithin each religion category but with the weights taken from the overall frequency distribution of education in the sample. (Alternatively, becausethey are mathematically identical, ws can compute the weighted srm, using as weights the ?roportion of casesin each category.)By doing this, we construct a hypothetical table >howingwhat the relationship betweenreligiosity and militancy would be if all religios1r-!goups had the samedistribution of education. It is in this precise sensethat we can sav we are showing the associationbetweenreligiosity and militancy net of the effect of education.As noted earlier, this procedureis known asdirect standardizationor covariate ,lCjustment. Note that the weights need not be constructed from the overall distribution in the table. Any other set of weights could be applied as well. For example, if we wanted to assessthe associationbetweenreligiosity and militancy on the assumptionthat Blacks had the samedistribution of educationas Whites, we would treat Whites as the stand.d.rd, topulation and use the White distribution across educational categories (derived from someextemalsource)asthe weights.We will seetwo examplesof this strategya bit later in the chapter. Now let us constructa militancy-by-religiositytable adjusted,or standardized,for education,to seehow the procedureworks.We do this from the datain Table 1.6.First, $e derivethe standarddistribution,the overall distributionof education.Becausethere are993 casesin the table(= 108 +... * 49), andthereare 353 1= 193 +201 + 44) peoplewith a grammarschooleducation,the proportionwith a grammarschooleducation is .356 (:353/993). Similarly, the proportionwith a high schooleducationis .508, and the proportionwith a collegeeducationis .137.Theseare our weights.Then to get the adjusted,or standardized,percentmilitant among the very religious, we take the n eightedsum of the percentmilitant acrossthe threeeducationgroupsthat subdivide fte "very religious" category(that is, the figuresin the top row of the table): 17Voa.356
30
QuantitativeData Analysis:Doing SocialResearch to Testldeas
TAB Le 2.3.
percentlvtitirantby Retigiosity, and p€rcentMilitanr
by Religiosity Adjusting (Standardizing) for Religiosity Differences in Educational Attainment, Urban Negroes in the U.S., 1964 (N = 993).
PercentMilitant
PercentMilitant Adiustedfor Education
Percentage spread
+ 34Va*.508+ 38Voa .137= 29Va.To get the adjustedpercentmilitant amongthe .,somewhat religious,"we apply the sameweightsto the percentages in the secondrow in the table:227o+.356+ 32Vo*.508+ 48%a.137= 31Vo. Finally,to get the adjustedpercentmilrtantamongthe "not very or not at all religious,"we do the samefor the third row of the table,which yields45 percent.We canthencomparethesepercentages to the corresponding percentages for the zero-orderrelationshipbetweenreligiosityandmilitancy (thatis, not controllingfor education).The comparisonis shownin Table2.3. (The Stata-do_ file usedto carry out the computations,using the command-dstdize- and the -Iog- file that showsthe results,are availableas downloadablefiles from the publisher,JosseyBass/lViley(wwwjosseybass.com/go/quantitativedataanalysis) asare similar files for the remainingworkedexamplesin the chapter.Becausewe havenot yet beguncomputing,it probablyis bestto notethe availabilityofthis materialandretum to it laterunlessvou are alreadyfamiliar with Stata.)
STATA -Do- FILESAND -Loc-
FILES Insrata, -do-iircsare
commands,and - 1oq- filesrecordthe resultsof executing-do- files.As you will seein Chapter Four,the management of dataanalysis is complexand is muchfacjlitated by the creationof -ao- files,whichare efficientand alsoprovidea permanentrecordof whar you naveoone to produceeach tabulationor coefficient.Anyonewho hastried to replicatean analysis performedseveral yearsor evenseveral monthsearlierwill appreciate the valueof havinqan exactrecordof the computationsusedto generateeach result.
Moreon Tables 31
N I
t0) I ,2)
Whenpresentingdataof this sort,it is sometimes usefulto comparethe rangein the :ercentagepositive(in this case,the percent militant) acrosscategoriesof the indepen_ lent variable,wirh and wirhout conft;ls. rn Tabb ti,;; ;" ;;;r" the differencein -hepercentmilitant betweenthe leastandmos-treligiou, rwenty_one points '.rhereas,when educationis controlled, "ut"go;r'r. the differJncet.;;;; ro srxteen polnts, a l-1 percentrcduction (= I - 16/2.1).ln ,o." ,.or., tt say that education "erplains" abour a quarrer "r,;;; of the relarionship^betweenreffirit| in"o w" n""o :o be cautiousaboutmaking computations of thi, .o.t unjonty -rt,un"y. tt"_ when they ':re helpful.in making the analysis_ "_ffoy clear.no. ii io"'rri, ir*" much senseto ""u,npr", a "spread"or "range" in the percentages iithe relatio;shi; betweenreligiosity 'ompute 3flimilitancy is not monotonic(that ir, if th. p!.""ntug" Jili""ia."'", increase,or ar reastnot decrease, asreligiositydeclines). "",
i
t' omen the :milf the ondat is, - file file sey: rhe g. it i ale
plEE_qT_ tN EARLTER STANDARDTZATTON
}.f,*nS l-':':ffiffil:f"i:::i:i N ;*::u,lxli:lifi
to a "weighted netpercentaqe difference,, or ,,weighted netpercentage spread.,, ThereaJly usefulpartof the procedure is the computation of adjusted, or staidarorzeO, rates.The subsequent computation of percentage differences or percent"g",p*uJr-i, onry,or"tlrnu, useful, asa wayof summarizing theeffectof control varjables.
Example2: BeliefThatHumansEvolvedfrom Animals(Direct Standard_ ization with Two or More Control Variables) Sometimeswe want to adjust,or standardize, our databy more than onecontrol variable 3i.a time.to€et a summaryof the effect of some variabieon _oii", \Jt/i,"ntwo or more orhervariablesareheld constant-Consider'ror u.."ptun"" of the scientificthe.rn of evolurion.In 1993, 1994. and 2000, ""u-pt", ttre N
32
DataAnalysis: DoingSocialResearch to Testldeas Quantitative
TABLE 2.4. lercentageDistributionof Beliets Regardingthe ScientificView ot Evolution(U.S.Adults, 1993, 1994, and 2OOO).
ly not true
Perhapsthe recent increasein the proportion of the population that adheresto fundamentalist religious beliefs, especially fundamentalist Protestantviews in which the Bible is taken as literally true, accountsfor this outcome. To seewhether this is so, in Table 2.5 I cross-tabulatedacceptanceof the scientific view of evolution (measuredby endorsement of the statementthat descentfrom other animals is "definitely true") by religious denomination, making a distinction between"fundamentalist" and "denominational" Protestants. (For want of better information, I simply dichotomized Protestantdenominationson the basis of the proportion of their members in the sample who believe that "The Bible is the acfual word of God and is to be taken literally, word for word." Denominations for which at least 50 percent of respondentsgave this response-"other" Protestantsand all Baptists except membersof the "American Baptist Church in the U.S.A." and "Baptists, don't know which"-were coded as fundamentalist; all other Protestantdenominations were coded as DenominationalProtestants.)Unfornrnately,the samedistinction, between religious subgroupswith andwithout a literal belief in theholy scriphres of their faith, cannot be madefor non-Protestants given the way the datawere origimlly codedin the GSS. Although there are substantial differences among religious groups in their acceptance of the scienfific view of evolution, the fundamentalist-denominationalspht among Protestantsdoes not seemto be central to the explanation becausethere is only a 4 percent difference betweenthe fwo groups. Interestingly, non-Christians appea.rto be much more willing than Christians to acceptan evolutionary perspective,and Catholics appear to be more willing than Protestantsto do so. Given thesepattems, it could well be that the observedreligious differences are, at least in part, spurious. In particular, educational differences among religious groupsJewsare particularly well educatedand fundamentalistProtestantsare particularly poorly
Moreon Tables 33 -i-,
.i 2,5, fercentage Ac(€pting the ScientificView of Evotution by leligious Denomination (N = 3,663). PercentageAcceptingthe Evolution of Humansfrom Animals as "De{initelv True"
I1.8
Catholics
17.8
(858)
?J]erChristians
5.6
(18)
h'6 ulmenlible is ble 2.5 €ment :nomismnts, on the iible is rns for ald all lPtlsts, urtrons etween cannot accepamong 4 perr much appear are, at )uPSpoorly
(1,222)
Denominational Protestants
I:ll,.,..i...:,....lll*1r,:,l,..'..l ..',:,:',,,. :.:l.lli*,.,
C$er religion
23.6
(123)
tS religion
32.5
(391)
r:;riated-might partly accountfor religiousdifferencesin acceptance of the scientific '--:';'..Similarly, age differencesamong religious groups-the young are particularly -i:11 to rejectreligion-might providepart of the explanationas well. To considerthesepossibilities,we needto determine,first, whetheracceptance ofthe explanationof humanevolutionvariesby ageandeducationand,if so, whether ---;ntific =-:giousgroupsdiffer with respectto their ageandeducation.Tables2.6 and2.7 provide :e necessary informationregardingthe first question,andTables2.8 and2.9 providethe :,-rrespondinginformationregardingthe secondquestion. l- nsurprisingly,endorsemenlof the statementthat humansevolvedfrom other animals L. -definitely true" increasessharply with education,as we seein Table 2.6, ranging from : of thosewith no more than a high schooleducationto 36 percentof thosewith -rcent r-r-graduate education.It is also true that younger people are more likely to endorsethe (seeTable2.7): 18percentof explanationof evolutionthanareolderrespondents -ientific :r-:e under agefifty, comparedto 7 percentof those seventyand over, say that it is "defi=',il) true" that humansevolved from other animals. religiousgroup, -\s expected,Table2.8 showsthat Jewsare by far the best-educated ::loued by other non-Christiangroups,and that FundamentalistProtestantsand Other Crisdans arethe leastwell educated. AIso asexpected,Table2.9 showsthat thosewith:r-{ religiontendto be young.However,membersof "other" religiousgroupsalsotend::sproporlionately-to be young,perhapsbecausethey aremainly immigrants.
34
QuantitativeData Analysis:Doing SocialResearch to Testldeas
?,q*,-a .i..*. eercentageAcceptingrhe Scientific View of Evolution by Level of Education, Percentage
Somecollege
l&XLe
11.9
2.?,
eercentage Acceptins
the Scientific View of Evolution by Age. Percentage
50-69
13.5
(889)
Theseresultssuggestthat differencesamongreligiousgroupswith respectto ageand educationmight, indeed,explainpart of the observeddifferencein acceptance of the sci_ enlificview of evolution. To seeto what extent ageandeducationaldifferencesamongreligious groups account for religious group differencesin acceptanceof evolution, we can directly standardizethe religion/evolution-beliefs relationship for education and age. we do rhis by deterrnining the joint distribution of the entire samplewith respectto age and education and then use theproportionin eachage-by-education categoryasweightswith which to compute,sep_ aratelyfor eachreligious group, the weightedaverageof the age-by-education_specific percentagesacceptinga scientificview of evolution.By doing this, we treat eachreli_ giousgroup asif it had exactlythe samejoint distributionwith respectto ageandeduca_ (ionasdid theentiresample.Thisprocedure rhusadjuslsrhepercentage of iach religious group that endorsesthe scientificperspectiveon evolutionto removethe effect of religiousgroup differencesin thejoint distributionof ageandeducation.
lff Si-{ 2.*, Religion.
eercentageDistributionof EducationalAttainment by
High School Some College Postor Less College Graduate Graduate Total
N
7.1 Denominational Protestants 4 7.6
26.5
15.2
10.6
OthefChristians
61.1
16.7
16.7
s.6
100.0
(18)
1 5 .7
2 1.7
31.3
31.3
1OO.O
(83)
{123)
JCWS
Ctherreiigion
3 6 .6
25.2
19.5
18.7
100.0
Total
47.6
25.6
15.3
11.6
t00.1 (3,663)
T-
': L F 3 . *,
md
Protestants
:cI-
unt the ing use
rercentag€ Distribution of Age by Religion. 18-49
50-69
7O+
Total
59.8
25.O
15.1
99.9
N
catholics', eo,1 ': 'ts.:er ,',,,..,ll:';|;i:i'.,;.t.;iirat,,,,,,:i:,'.,,,. 3iher Christians
8 8 .9
11.1
0.0
99.9
(18)
83.7
13.8
2.4
99_9
(123)
11.0
100.1
Jew5
ific :lica)us rli-
f,iherreligion
36
DataAnalysis: Quantitative DoingSocialResearch to Testldeas
To get the necessaryweights,we simply cross{abulateageby educationandexpress , the numberof peoplein eachcell of ttre taUteas a proportioi ofihe total. Thesepropor_ tions are shownin Table2.10. We then tabulatethe percentageacceptingthe scientific position on evolution by reli_ . glon, age,and education.Thesepercentages are shownin Table2.11.Note that many of thesepercentages arebasedon very few cases.This meansthat they are nol very precrse, in the sensethat they are subject to large sampling variability. We ctuld collapse the eOucation and age categoriesstill further, but that would ignore substantial within_category heterogeneity.As always, there is a balanceto be struc[between sampling precision and substantivesensibility or-in terminology we will adopt later_betw eenreliability and validity . the presentcase,I might havebeenbetter advisedto take a more conservative -rn approach, especiallybecausethe cell_specific percentages bouncearounda lot (exactlyas we wouldexpect given the large degreeof sampling variability), whrch makesthe differ_ ences in the resurting standardizedpercentagessomewhatless ctear cut. on the other hand,the weights are very small for the cells basedon few cases,which minimizes their contribution to the overall percentages. Finally, to get the adjusted,or standardized,coefficients, we sum the weighted per_ centages,wherethe weightsarethe proportionsin Table2.10. For example,the adjusteO, or dircctly standardized,percentageof Fundamentalistprotestants who acceptthe evolutionary viewpoint as ,.definitively true,, is, within rounding error, 9.7 :5.7*.274 + 3.8*.184+ 15.7*.110 + 29.3+.080 + 4.9*.126+ 3.3*.056+ 25.O*.032 + 40.9*.029 + 3.3+.076+ 7.7*.015+ 10.0*.012+ 16.7*.007 standardizedpercentagesare derived in the sameway. .l hey are . _Tl" :"ld"i$ shown inTable.2.l2, with the observedpercentages repeatedfrom Table2.5 to make compari_ sonseasler. TAtsLf
2.10,
roint probabitityrDisrribution of Educarionand Age. 18-49
50-69
70+
Total
| / \ ll I I !1.r..
.'
| |
ts€rlcrrlcuE AlrcFlitts
a h € t G i € r l i t i G v i € w H , G u € l ll l l r l l
kt F€ i l g l 'n
ig!
a ta d 5 Er l Fr i .r i tl .g i
l|| I'drrrrllrrrrr)
Fundamentalist Protestants
Denominational Protestants
Catholic
Other Christians
Jewish
Other
None
I0.01 (2)
128.61 (14)
11. 5 (26)
29.3 (82)
Age 18-49
Somecollege
3.8 (183)
10.' !
(208)
20.1 (159)
22.7 (22)
[0.0] (4)
6.8
20.o
121.41
(6)
(r4)
3.3 (60)
9.0 (78)
(441
(1)
collegegraduare
25.o Q4)
21.3 (47)
20.0 (2s)
(0i
t2o.Ol (s)
I25.Ol (4)
Post-graduate education
40.9 (22\
20.0
32.O (25)
(0)
[37.5] (8)
[2s.0]
Somecollege
t0.01
12s.ol (4)
(4\
l4t.7) (12)
166.71 (12)
(Continued)
TA B L F 2. '1 'l . p.rcentage Accepting the Scientific View of Evolution by Religion, Age, and Sex (Percentage Basesin Parentheses)'(Contmued) Fundamentalist Protestants
Denominational Protestants
Other Christians
Age 70 or more
l7.71 (13)
[0.0] (1)
[100.0] (2) basedon fewer than twenty cases(shownin squarebrackets)shouldbe interpretedwith caution Note: percentages
Moreon Tables
39
t
it ::.1,3. oUserveaProportion Acceptingthe scientific view of Evolution, and Proportion Standardized for Education and Age.
Percentage Accepting Scientific View of Evolutionas "Definitely True"
Percentage AcceptingScientific View, Standardized by Age and Education
:JndamentalistProtestants l:'rominationalProtestants
(968)
12_2
(1,222) (858)
-ainolrc5 : --er Christians
N
2.1
-9,r5
(r8) (83) (123)
{o religion
-\s you can see, despitethe associationbetweenreligious group affiliation and, --:rectively, ageandeducation,andthe associationof ageandeducationwith acceptance :: .:rrevolutionaryaccountof humanorigins, standardizingfor thesevariableshas rela- 1:-\ little impacton religiousgroupdifferencesin acceptance of the claim that humans :'. r.\ ed from otheranimals.The oneexceptionis the non-religious,whosesupportfor a ';::atific view of evolution appearsto be due, in part, to their relatively young age. l,:spite minor shifts in the expecteddirection for FundamentalistProtestantsand for -':;. andthosew th otherreligions,the dominantpattemis oneofreligious groupdiffer:--:e\ in acceptance of an evolutionaryview of the origins of mankindthat arenot a sim:-: :ellectionofreligious differencesin ageandeducationbut presumablyreflect,instead, :: lheologicaldifferencesthat distinguishreligiouscategories.
Example3: OccupationalStatusby Racein SouthAfrica l; '.1let us consideranotherexample:the extentto which racial differencesin occupational .jnment in SouthAfrica can be explainedby racial differencesin education(the data are ::t rhe Suney of EconomicOppoftunityandAchievementin Sculr A/n-ca,conductedin the --=.,, 1990sfTreiman,lrwin, andLu 2006]:the Stata-do- and -1og- files for the worked =--,.:rpleareavailableasdownloadablefiles; for informationon the datasetandhow to obtain
40
DataAnalysis: DoingsocialResearch to Testldeas Quantitative
it, seeAppendix A). From the left-handpanelof Table2.13, it is evidentthat therea.restrong differencesin occupationalaftainmentby race.Non-Whites,especiallyBlacks, are substantially lesslikely to be managerial,professional,or technicalworken than areWhites and are substantiallymore likely to be semiskilledor unskilled manual workers.Moreover,Blacks are far more likely to be unemployedthan are membersof any other group. It is also well known that substantialracial differencesexist in educationalattainmentin SouthAfrica, with Whitesby far the besteducated,followed,in order,by Asians(who in SouthAfrica aremafu y descendants of peoplebroughtasindenturedworkersfrom theIndian subcontinent),Coloureds (mixed-racepersons),andBlacks (thesearetheracial caiegoriesconventionallyusedin South Africa); andalsothatin SouthAfrica, aselsewhere,occupationalattainmentdependsto a considerabledegreeon educationalattainment(Ireiman, McKeever,and Fodor 1996).Under thesecircumstances,we might suspectthat racial differencesin occupationalattainmentcan be largely explainedby racial differencesin educationalattainment.Indeed,this is what Treiman,McKeever,andFodor (1996)found usingthe IntemationalSocioeconomicStatusIndex (ISEI) (Gaueboom, de Graaf, and Treiman 1992; GaruBboomand Treiman 1996) as an ildex of occupationalattainment.However,it also is possiblethat accessto certaintypesof occupations,such as professionaland technicalpositions,dependsheavily upon education, whereasaccessto others,suchasmanagerialpositions,may be deniedon the basisof raceto thosewho areeducationallyqualified. To determine to what extent, and for which occupation categories,racial differences in accesscan be explainedby racial differencesin education,I adjusted(directly standardized)the relationship betweenrace and occupationalstatusby education.Here I used the White distribution of education, computed ftom the weighted data, as the standard distribution to determine what occupational distributions for each of the non-White groupsmight be expectedwere they able 1oupgade their levels of educationalattainment so that they had the samedistributionsacrossschoolinglevelsas did Whites. The resultsare shownin panelB of Table2.13.They are quite instructive.Bringing the other racial groups to the While distribution of education(and assumingthat doing so would not affect the relationship between education and occupational attainment within each group), racial differences in the likelihood of being a professional would entirely disappear.Indeed,Blacks would be slightly more likely than membersof the other groups to becomeprofessionals.By contrast,the percentageof eachrace group in the managerial category would remain essentially unchanged,suggesting that it is not education but rather norms about who is permitted to supervisewhom that accountfor the racial disparity in this category.The remaining large changesapply to only one or two of the three non-White groups:Asians would not be very substantially affected exceptfor a reduction in the proportion semiskilled; Coloureds would increasethe proportion in technical jobs andreducethe proportionin semiskilledand unskilledmanualjobs and farm labor; and Blacks would increase the propoftion in clerical jobs and reduce the proportion in all man[al categories. IJ all four racial groups had the same educational distribution as Whites, the dissirnilarity (measuredby A; seeChapter Three) between the occupational distributionsof Whites andAsianswould be reducedby about30 percent(fuom29-2to 20.5)aswould thedissimilarityin the occupationaldistributionsof WhitesandColoureds (from 37.9 to 26.5),whereasthe dissimilarityin the occupationaldistributionsof Whites
More on Tables 3 Srong {bstanand are Blacks -.o well :a- with mainly lourcds r South ) a conUnder ,'nt can at Treit Index ta s an ,pes of cation, |ace to
i4
: -: . , Percentage Distribution of Occupational croups by Ra€e,South African rqE 20-69, Early 199Os (Percentages Shown Without Controls and also Directly for Racial Differences in Educational Attainment;. N = 4.0O4).
WithoutControls
Adjusted for Education Black
White
Asian
Coloured
Black
13.7
7.0
3.3
13.2
13.6
11.9
16.5
7.2
13.4
5.8
7.2
13.0
9.1
8.5
3.5
2.2
9.4
2.5
2_6
14.4
18.6
18.8
19.3
8.2
13.0
9.7
6.2
16.6
20.1
100.0
99.1
99.9
100.0
100.0
20.5
26.5
46.1
tences i stanI used mdard White DINCNI
n-glng ing so A.ithin lrllely rcups gerial n but lsparthJee lclion ljo b s ': and ir all )n as ional )-f to ureds hites
r. -r.n Whites(A). -
100.2
99.9
100.0
29.2
37.9
52.4
::::-::on isth eeduc at ionaldls t r ibut ionof t heWh i t e m a e p o p u l a t i o cno m p u t e d f r o r nt h e s u r v e d y a t aw e i g h t e d - : - ::nsusdistrbut onsof reqon bv urbanversusruralresidence. :::'occu pa tondat at odet ailedoc c upat ons ha d n o t b e e n c o m p l e t e d w h e n t h s t a b e w a s p r e p a r eIdh,a v e i n :, i : ,a:egory"occupaton unknown." - -:_:. = 1/2the sumof the absolute va uesof the dlfferences betweenthe perceniaoe of Whitesand the percent' _ = . al groupin ea(hoccLrpation categorySeeChapterThreefor furtherexpost ol']cf ih s ndex
42
to Testldeas QuantitativeData Analysis:Doing SocialResearch
andBlackswould be reducedonly about 12 percent(from 52.4 to 46.i). The substantiaremainingdissimilarityin the occupationaldistributionsof the four race groupsnet o: educationsuggeststhat Treiman,McKeever,and Fodor's (1996)conclusionthat education largelyexplainsoccupational.ttatrsdifferencesbetweenracegroupsin SouthAfrica doesnot tell the whole story.
in China Example4: Levelof Literacyby Urban VersusRural Residence Now considera final example-the relationshipamongeducation,urbanresidence,ani degreeof literacy in the People'sRepublic of China. In a 1996nationalsampleof the were askedto identify tet adult population(Treiman,Walder,andLi 1996),respondents properties (see the of this data set and ho$ A regarding Appendix Chinesecharacters is inter?retedas indicating correct identifications to obtain accessto it). The numberof the degreeof literacy(Treiman2007a).Obviously,literacywould be expectedto increase with education.Moreover,I would expectlhe urban populationto scorebetter on the characterrecognitiontask just becauseurban respondentstend to get more schooling than do rural respondents. The questionof interesthere is whethereducationaldifferencesbetweenthe rural and urbanpopulationentirelyexplainthe observedmeandiffercorectly identified,which is 1.8(asshownin Table2.14t encein thenumberof characters the urbanandrural meansby assumTo determinethis, I adjusted(directlystandardized) ing that both populationshavethe samedistributionof education-the distributionfo: the entireadult populationof China,computedfrom the weighteddata.Note that in this that are standardizedbut rather means.The procedureis exampleit is not percentages identicalin both cases,althoughifthis is doneby computer(usingStata),a specialadjustment needsto be madeto the datato overcomea limitation in the Statacommand-the requirement that the numerators of the "rates" to be standardized (what Stata call-. -charvar-) be integers.To seehow to do this, consultthe Stata-do- and-1og- filesfo; this example,which areincludedin the setof downloadablefiles for this chapter. fAmLf ?,14. rvl..,t Number of chinese charactersKnown (out of 1o), for Urban and Rural ResidentsAge 20-69, China 1996 (Means Shown Without Controls and Also Directly Standardized for Urban-RuralDifferences in the Distribution ot Education;.N = 6,O81).
Ruralresidents
Without Controls
Adiustedfor Education
2.0
2.4
(3,002)
'The standardpopulatonis the entre populatlonof Chinaage 20-69, computedfrom the sutueydata we ghted to reflectd fferentialsamprng ratesfor the ruraland urban populationsand to correctfor vafiaweremissinq wereomitted. s ze.N ne casesfor whichdataon education tionsln household
Moreon Tables 43 hntial let of duca\frica
na t, and of the fy ten I how )ating I€ASC
n the nling liffer[ffer, 14\
sumn for n this me is djust-the calls x for
t, ut
The results are quite straightforward and require little comment. When education is standardized,the urban-ruralgapin the meannumberof characterscorrectly identified is reducedfrom2.8tol.6.Thus,about43percent(=1-1.6/2.8)oftheurban-ruraldifferencein vocabularyknowledge is explained by rural-urban differencesin the level of edu.-ationalattainment. Although the four examples presented here all standardizefor education, this is purely coincidental. Many other usesof direct standardizationare imaginable. For example. it probably would be possible to explain higher crime rates among early twentiethcentury immigrants to the United Statesthan among natives simply by standardizingfor age and sex. Immigants were disproportionately young males, and young males are Lnown to have higher crime rates than any other age-sexcombination.
A FINALNOTEON STAT]STICAL CONTROISVERSUSEXPERIMENTS Ia describingthe logic of cross-tabulations, I havebeendescribingthe logic of nonexperimental data analysis in general. True experiments are relatively uncommon in social research,although they are widely used in psychological research and increasingly in microeconomics(for a very nice example of the latter, seeThomas and others [2004]). A mre experimentis a situation in which the objects of the experimentare randomly divided into two or more groups, and one group is exposedto some treatment while the other gloup is not, or severalgroups are exposedto different treatments.If the groups then diffEr in someoutcome variable, the differences can be attributed to the differencesin treatments.In such caseswe can unambiguouslyestablishthat the treatmentcausedtJre Jifference in outcomes(although we may not know the exact mechanisminvolved). (Of .-ourse,this claim holds only when differences between the experimental and control are not inadvertentlyintroducedby the investigatorsas a consequence of design _groups darvsor of failure to rigorously adhereto the randomized trial design. For a classic dis.rrssionof such problems,see Campbell and Stanley [1966] or a shorterversion by Campbell[1957]that containsthe core ofthe Campbelland Stanleymaterial.) When experimentsare undeftakenin fields such as chemistry sampling is not ordinarily a considerationbecauseit can be confidently assumedthat any batch of a chemical Eill behavelike any other batch of the same chemical; only when things go wrong do .-hemiststend to question that assumption.In the social and behavioral and many of the biologicalsciences,by contrast,it cannotbe assumedthat one subjectis just like another illbject. Hence,in experimentsin thesefields, subjectsare randomlyassignedto treatnent groups.In this way,it becomespossibleto assesswhethergroup differencesin out.-omesare larger than would be likely to occur by chancebecauseof sampling variability. Il- so. we can say, subject only to the uncertainty of statistical inference, that the differ€lce in treatmentscausedthe differencein outcomes. In the socialsciences,randomassignmentof subjectsto treatmentgroupsis oftenm fact usually-impossible for severalreasons.First, both ethicalandpracticalconsider.:donslimit the kind of experimentationthat can be done on human subjects.For example. it would be neitherethicalnor practicallypossibleto determinewhetherone sort of
44
to Testldeas DoingSocialResearch DataAnalysis: Quantitative
schoolingwas pedagogicallysuperior to anotherby randomly assigningchildren ii' different schools and severalyears later determining their level of educational achievement. In addition, many phenomenaof interest to social scientistsare simply not expe+ mentally manipulable,evenin principle. The propensity for in-group solidarity to increl'. in wartime,for example,is not somethingthat can be experimentallyconfirmed,nor ca the proposition that social stratiflcation is more pronounced in sedentary agriculturzi societies. societiesthanin hunter-gatherer Occasionally,"natural experiments" can be analyzed.Natural experirnentsare situations in which different individuals are exposedto different circumstances,and it can bc reasonablyassumedthat the circumstanceto which individualsareexposedis essentialll random. A very nice example of such an analysis is the test by Almond (2006) of tbe "fetal origins hypothesis." He showed convincingly that individuals in utero during the few monthsin which the 1918flu pandemicwasragingsufferedreducededucationz" attainment,increasedrates of physical disability, and lower income in midlife relative rc those in utero in the few months preceding and following the epidemic. Becausetherei! no basisfor expectingthe exactmonth of conceptionto be correlatedwith vulnerabilig to the flu virus, the conditions of a natural experiment were well satisfied in this elegar analysis.Naturalexperimentshavebecomeincreasinglypopularin economicsasthe limitations of variousstatisticalfixes to correctfor "sample seLectionbias" have becom more evident.We will retum to this issuein the final chapter (For additional examplesct naturalexperimentsthat arewell worth reading,seeCampbellandRoss[1968],Berelscr [1979],Sloanandothers[1988],andthe paperscited in ChapterSixteen.) Given the limited possibilitiesfor experimentationin the social sciences,we resort to e variety of statistical controls of the sort discussedhere and later Theseproceduressharc a common logic: they are all designedto hold constant somevariable or variables so dl.{ the net effect of a siven variable on a given outcome can be assessed.
?,
FIX AND A USEFUL OF MATCHING THEWEAKNESS
\\ -
by matchingcomparison attemptto simulaterandomassignment surveyanalysts Sometimes practice unsatisfacwas inherently form, this In its original groupson somesetof variables. tory When attempting to match on all potentiallyrelevantfactors, it is difficult to avoid are usedln the match,it is no matterhow manyvariables runningout of cases.l\,4oreover, facgroups on somenonmatched differ possible and control that the experimental always with matching combining Howevef, outcome with the experimental tor that is correlated statisticalcontrolscan be a useful strategy,especiallywhen the adequacyof the match is and Rubin1983) Forrecenttreatments score"(Rosenbaum via a "propensity summarized (1997), Beckerand lchino(2002),Abadieand propensity see Smith score matching, of (2006), (2004), (2006), and Beckerand Caliendo(2007) Halaby Brandand Brand others in scorematchingis alsodiscussed applicationPropensity Harding(2002)is an instructive ChaDterSixteen.
Moreon Tables 45 hen to chieveEXPen-
rcrease lor can ltural : srruacan be ntially of the during uional tive to hereis ability legant plimecome esof relson rttoa share ;o that
Comparedto experiments,statisticalcontrols have two fundamental limitations, s hich makeit impossibleto definitivelyproveany causaltheory(although definitivediszrool is possible).First, no matter how many control variabieswe mtroduce, we can neverbe surethat the remainingnet relationshipis a true causalrelationship and not the spuriousresultof someyet-to-be-introduced variable. Second,although we speakoI holding constant somevariable, or set of variables, . $hat we usually do in practiceis simpty reducethe within-group variability for these variables.This is particularlyobviouswhenwe aredealingwith cross-tabulations because *e generallydivide the sampleinto a small setof categories.In what sense,for example, ;an we be said to "hold educationconstant"when our categoriesconslst of thosewith lessthan a high schooleducation,thosewith somesort of iigh scnoot experience,and rhosewith some sort of collegeexperience? Although the within_category variability in educationalattainment obviously is smaner than the total variability in tire sampreas a s hole, it is still substantiar.Hence,if two other variabresboth dependon educational rnainment,theyarelikely to be correlatedwithin educationalcategories asgrossasthese, rs,well as acrosseducationalcategories. As you will seein more detail later,usinginter_ ral or ratio variables in a regressionframework will not solve the problem but merely u'ansformit. Although the within-category variability generally will be reduced, the very narsimony in the expression of relationships between variabres thar regresslon procelures permit will generallyresultin somedistortionof the true comprexities of suchrelatonships-discontinuities, nonlinearities,and so on, only some of which can be .rpresentedsuccinctly. Our only salvationis adequatetheory.Becausewe can seldomdefinitively establish --ausalrelationshipsby referenceto data,we needto build up a body of theorythat con_ :i-srsof a setofplausible,mutuallyconsistent,empiricallyverifiedpropositions. Although re cannotdefinitivelyprovecausalrelations,we candetermine whither our dataarecan_ tsrent with our theories;if so, we can say that the propositionis tentatively empirically rerified.we arein a strongerpositionwhenit comesto disproof. rf ourd.ataarc inconsis:cnr with our theory, that usually is suffcient grounds for rejecting the rheory, although z 3 need to be sensitiveto the possibility that there are omitted variablesthat would :iange our conclusionsif they wereincludedin our cross{abulation or model.In short, :..\maintaina theory it is necessarybut not suffictentthat thedatabe aspredictedby the Becauseconsistencyis necessaryto maintainthe theory,inconsrstency is suffi_ ro -rory. --'3nr requireus to reject it-provided we can be confidentthat we havenot omitted :rportant variables. (On the other hand, asAlfred North Whitehead is supposedto have :3id. neverlet datastandin the way of a good theory.If the theoryis sufficiently strong, ,;!-rumight want to questionthe data.I will havemore to sayaboui this later,in a discui_ ilon of concaptsandindicators.)
TI/HATTHISCHAPTERHAS SHOWN L this chapterwe have consideredthe logic of multivariatestatisticalanalysis and its Eplication to cross{abulationsinvolving threeor more variabres.The notion of an inter-L-iioneffect-a situationin which the effectof oneindependentvariabledependson the
46
DataAnalysis: DoingSocialResearch Quantitative to Testldeas
value or level of one or more other independentvariables-was introduced.This is a verr importantidea in statisticalanalysis,and so you shouldbe sure that you understandr thorougbly. We also consideredsuppressoreffects, situations in which the effect of oE independentvariable offsets the effect of another independentvariable becausethe tqo effects have opposite signs. In such situations, the failure to include both variables in the model can lead to an understatementof the true relationships between the included variable and the dependentvariable. we then tumed to direct standardization (sometirnes called covariateadjustment),a procedurefor purging a relationship of the effect of a par_ ticular variable or variables. Direct standardizationcan be thought of as a procedurefcr creating "counterfactual" or "what if' relationships-for example, what would be tbc relationship between religiosity and militancy if we adjusted for the fact that well educatedBlacks in the 1960stendedto be both more religious and less militant than lesswell educatedBlacks. Having discussedthe logic of direct standardization, we considered severaltechnical aspectsof the procedureto seehow to standardizedata startins not onh frorn tables but also from individual records;to standardizepercentagedisrriuo-tion.;,nd to standardizemeans.we concludedby considering the limitations of statistical controK m contrast to randomized experirnents. In the following chapter,we complete our initial discussionof cross-tabulationtables by considering how to extract new information from published tables; then note the ooe clrcumstancein which it makes senseto percentagea table ,,backwards',;touch for thc first but not for the last time on how to handle missing data; consider cross-tabulation tables in which the cell entries are means;presenta measureof the similarify of percenragedistributions, the Index of Dissimilarity (A); and end with somecommentsabouthos to write about cross-tabulations.
CHAPT ER
STILLMOREON TABLES WHATTHISCHAPTER ISABOUT ID this. chapter we wrap up our discussion of cross_tabulations for now. Alter spending $me time leaming to love the computer_a very brief time, actually_and thentelvin! i o th€ mysteriesof regressionequations,we will retum to cross-talulations and discuss for making inferences about relations embodied in them via logJinear *...1:*. irullvsls_ -We begin this chapterwith a discussionof how to extract new inlbrmation from pub, . h9red tables; then note the one circumstancein which it makes sensero percentagea rable "backwards"; touch for the first but not for the last time on how to handle missing dam: consider cross-tabulationtables in which the cell entries are means;presenta mea_ sre ofthe similarity of percentagedistributions,the Index of Dissimilarity (A); and end r-ith somecomnents about how to write about cross_tabulations.
48
QuantitativeDataAnarysis: DoingsociarResearch to Testrdear
REORGANIZING TABTES TO EXTRACT NEWINFORMATION
Oflenwhenworkjngwithpublish^eddara. reading research papers. thardarahadbeenpresented andsoon.we wish differenrly. so."r;,o.:, ,;ffi;;"",r#i,i"r,,"" i, presenred ro
:Jffj:,n:ffiilT:r;J;.,..:I[T",ff*'J# "oo*"0 ffi,3il|:'.T:;ti,"]i;li CollapsingDimensions
rerarionship q:oss berween acceprance #?ff: lil ilTfi: 'il'il'illt ll i:only orabonion a tablesuchas Table2.I ln itup,", rwo. rio"*
couldyou *r*i,rr.',*"
[_,xTti:nHy,:,:'#[l$L:,i.:fJJ:i::trJ thepercentage frequencies; iabr".ir i"ati"i : r p"."'*i.i'bo "jf "#jaDle
:
: Tl ^1i]*
" fi .',';*','.ff',T1!::f i ;ffi,fi:::n;il{*nl3:i"",".".11".T:f ;=,*'":
;L?ur::JilTiln :n*"H:;H[tr,il#::!f""titfu i,*l*"y.'i y
::i,:r^.j,",t "
;ql:,fr,::",ff :"t, Hfii]ff l!,i:;jruf,*:;
-"iifi fr:';,1t"'#'r:tilf ,uooron. ,11,1zortrorp'or*,rll,ulffi rhe weishr€d il:f il:H""lffi:itrff1,., jp"1lT..,,;:J'il:i#Jjlro-mpuLing ",,"r*
'jLfjtrj #I;fxq#jfi ,1*-i*,*#;i.lll;:,*n;qifi compuungthe full tableof frequenciesis, firsr,
tharir provi.", ,
,O*J-'*O
"n
the accuracy
ffi*i*-X;.L:T.Jyi;'J,'.'j:H,",J:l:,?B:ceorAbortion EduGation
Source_ Table2.1.
Catholic
Protestant
StillMoreon Tabtes 49
IL we wish resentedto 6 opposed re.
of !'our computationsand, second,that it permits other tabulationsto be constructed,for .sample, the zero-orderrelation betweeneducationand acceptanceof abortion. Although many other examplescould be given, they all follow the same logic. you $ould get in the habit of manipulatingtablesto extract information from them. Not only is ir a useful skill but it also gives you a better understandingof how tablesare constructed.
CollapsingCategoriesto ReprcsentNew Concepts rf abortion Two. How s, thinking ? The proa table of se,formed od by addthe 't€ther rn be per'Catholics : weighted separately $eragesto
%x90)+ raltage of ; accuracy
k
Sometimeswe want to view a variable in a mannerentirely different from that envisioned uy'_. the original investigator, in which case we may want to reorder the categories.We rheady have seenone example of this, in our discussionof how to treat .,no answer" in o r considerationof nominal variables in Chapter One. "No answer,,may be thought of .tsa neutral responseand henceas lying betweenthe least positive and the least negative rsponse; or "no answer" might be thought of as not on the continuum at all, and hence -tESttreatedas missing data. Another examplecan be drawn fiom the U.S. Congress.In the late 1970s,theNew york Tinles,lhe WashingtanPost, and similar rags took to calling conservativeDemocrats.,boll reevils" and liberal Republicans"gypsy moths" (fads come and go; you never hear these nms anymore).Supposewe wereconductinga studyof membersof the U.S. Houseof Representativesandinitially classifiedeverymemberinto one ofthe following four categories: 1. StandardRepublicans 2. Gypsymoths 3. Boll weevils 4. StandardDemocrats This four-category classification can be collapsed into three distinct two-category rlassifications,eachof which representsa different theoretical construct.If we were interesredin studying party politics and wantedto know which parq, controlled the House, we rould combine category 1 with category2, and combine category3 with category4: StandardRepublicans Gypsy moths
Republicans
Boll weevils StandardDemocrats
Democrats
If we wereinterestedin distinguishingbetweenliberalsandconservatives, we would .-ombinecategory 1 with category 3 and combine category2 with category4: 110 :-:
StandardRepublicans Boll Weevils G)?sy moths StandardDemocrats
)
coo.".uutiu",
Liberals
50
Quantitative Data Analysis:Doing SocialResearchto Testldeas
tirerestedin studyingpartyloyalg andwantedto know whatproportion ^]t_:-:^y:T areparty loyalists,we would combinecategory ot congressmen ^" I with category4 and combinecategory2 with category3:
StandardRepublicans StandardDemocrats
Party loyalists
Boll weevils Gypsy moths
Cross-overs
The point ofall this is that nothing,is sacrosancjabout the way a variable is originally constructed.you can and should recortevariables freely to get the bert ."p."."ntuion o,f the conceptyou areinterestedin studvins. A very important corollary of,this piint is that when you are designing or executing a data.colleclioneffort, you should alwaysconserve as ,ir""fr-a""if as possible.In the early days of survey research,the technorlgy of data maniputution researchers to pack as many variablesas possibleonto one "n"ouruged IBM iard; hence highly aggregated classificationswere adoptedto savespace(and the tedium of maffitation). The technol_ ogy haschanged.Todaythereis-with oneexception_no."u.oirio, ,o p."r".ve asmuch detail as possible in the initiar coding of your v'ariaures. lrrre exc-eptronis that you need to design your data-collectioninstrumentin a way that minimizes respondent,intervrewer, and coder enor. For example, in a survey with data collectlon done by face_
jlj:^tlj::::::a
lenel!1andcomplicated
r"r,"-" f*l
variaure
is likely to rncrease "oaing lntervrewererror) you neverknow when youwill geta newideathatwill require recodingoneor severalvariables;andif you lackimagnufron,in" not oserof the same *t *j. Everyexperienced survey analyst ha?t""J-gr"", t-.,."tion on counr_ l:|a occasions -1t less because detailthr
j,:jifr:,,:*#J:flI 0"," *u,not co'upiloll*'"Hirffi ffiTilJ.1 ::ll._",:1-q: a1tea-sycomputeroperation;disaggregating variablesis impossible, ls
:i::Bur.rcs wthout going back to the original questionnaireand usJary
at least
not then either.
WHENTO PERCENTAGE A TABTE -BACKWARDSThere is one exception to the rule that tables should be percentagedso that the categories of the dependentvariable add to 100 percent. This is in the sample is not representative of the population ,.at risk,, of falling into"u;;;;*" tt" uJoo, categoriesof the dependentvariable' Sometimes samplesare stratifi;d on trr" a"p"no"o, variable rather than the independent variables or variables; tnut ir, ,o."ti_o iti"y _" on th" basis of their value on the dependentvariable. Various "fror"n hard+o_findiopulations are typi_ cally sampledin this way: convictedcriminals, university stuOenti,pofitcat activlsts, cancerpatrents,and so on.
--
StillMoreon Tables 5'! )pornon \' -l and
-
: ll-?, SocialOrigins of Nobel PrizeWinners (1901-1972)and other U.s.Elites(and,for Comparison,the Occupationsof EmployedMales 19(x)-1920). Father'sOccupation Professional
Other
Total%
. . 1q :.. i '-1q0% l 28
18
100y.
15
57
2a
1000/o
24
35
41
100%
',:bel laureates
iginally ation of ecutmg . ln the searchregated echnolt5much )u need : inter1 faceL.lielyto require Ie SAME
:::Tators Employed males
1900 1910 1920 (1977,64). ,-:e AdaptedfromZuckerman
LCOUnt-
xitially nber of at least
e_gones : is not of the : rather on the re typr:tr\,rsts,
For example,Table3.2 showsthe social origins of variousAmericanelites.In this ::ie the tableis percentaged to showthe distributionof fathers'occupationsfor eachof a :-:mber of elite groups,and also for the U.S. labor force as a whole for selectedyears :- ughly corresponding to whenthe fatherswerein the labor force.The point of the table :.. of course,to show that elites come from elite origins: much higher percentagesof :e nembers of theseelites are from professionalor managerialorigins than would be :rpected if their fathers'occupationscorrespondedto the distributionof professionals in this direction,contraryto the ,:d managersin the labor force.The tableis percentaged probability percentages the conditional rule that express of someoutcomegiven -:ual lrme causalor antecedent condition,becauseit is constructedfrom informationobtained samplesof elites(plus somegenerallaborforce data),andthereforeis not represen-rrm ::rile of the social origins of the population.It would not be sensibleto use data from : representative sampleof the populationto study the likelihood that the children of becomeSupremeCouft justices,Nobel laureates.and so on, becausewe ::Lr1'essionals ;.-ruldvirtuallv neverfind anv caseswith theseoutcomesunlesswe obtaineddata
52
Quantitative DataAnalysis: DoingSocialResearch to Testldeas
irom the entire population*the outcomesare simply too rare. Thus, m suchcases,we rely on response.-basetl samples,andpercentagethe ,, ,rr"* in" distriburionof the independentvariablefor eachresponsecategory_in"urc the presentcase,the socialorigins of variouselitescomparedto the generalpopulation.
CROSS.TABULATIONS IN WHTCH THEDEPENDENT VARTABLE ISREPRESENTED BYA MEAN When the dependentvariableis an intervalor ratio variable,it often is useful to display the meansof the dependentvariablewithin categori". fo"""l;;;;;oss_ctassification of va.n"bles.forexample,supposeyou areinterested in therelarionshipamong il|p:d":, educalion, gender, and eamings,perhapsbecauseyou suspectthat women get smaller r€turnson their educationthan do men.Table3.3 shtws the meanannualincomein 1g7g 1'orfull-time workersby level of educationalanalnment anj genOlf computedfiom the 1980NORC GeneralSocialSutley.
?& * l- t: 3,3. ru".r, Annual thcome in 1979 Among Those working Full Time in 1980, by Education and cendei U,S. Adults (Ca'tegoryrrequencies Shown in parentheses).
Collegegraduate
27,227 (46)
11,789
16,288 (131)
10,324 (10s)
'13,536 (236]'
t 1,135 (246)
16,654
20,4r5 (380)
(3s)
20,s12 ( 81)
\ozo)
Still More on Tables ES,We of the rigins
53
:ali"-tNie AL POtltTS 0N TABLE 3.3 1. Notethat the formatof thistableis identical to that of Table1.6 from ChapterOne, exceptthat percentages are presentedin Table1.6, and meansare presented here. Thetablesarereadin the sameway.
isplay ion of mong naller 1979 n the
2. In thistablelevelsof educational attainmentarepresented in descending order Either descending or ascending orderjs appropriate; the choiceshoulddependon which makesthe discussion easier. L Note that this table jncludesonly 626 cases,out of a total sampleof 1,468.Thjs reflects the factthat manyindividuals do not work full time,particularly women,and alsothat information on educationand incomeis missingfor someindiviouals. Some_ timesit is usefulto catalogthe missingcases,especially whenthereare manymissing casesor whentheirdistribution hassubstantive importance. ln suchcases, a tootnote can be addedto the table or an additionmade at the bottom of the table, for examole. Numberof casesin table No information on income
bl
626 57
No information on education
1
No information on education and incorne
1
Totalworkingfull time
685
Men not workingfull time
235
Women not working full time
549
Totalin full sample
1,469 The reasonthjstabulationshows.1,469when thereare .1,468 casesin the samplejs dueto roundingerror Because of errorsin the execution of a ,,splitballot,,procedure in the 1980 GSS,the data haveto be weightedto be representative of the popula_ tjon (Davis,Smith, and Marsden2OO7).We will considerweighting issuesin ChapterNine. Evenwhen you do not presentthe informationshown in the tabulation,it is wjse to compileit for yourserf,as a checkon your computations.In fact, in the courseot creat_ Ing the preceding accountingof missingcases,I discovered a computingerrorr had madethat resultedin incorrectnumbersin Table3.3 (since corrected). An alternative way to dispraythesedata,which would makethe point ol the tabre moreimmediately evidentto the reader,is to show in the rjghtmostcolumn. temale meansas a percentage of maremeans,ratherthan the totarmeans.Tabre_making is an art, and the ajm of the gameis to makethe message as clearand easyto under_ standas possible.
54
to Testldeas DataAnalysis: DoingSocialResearch Quantitative
InspectingTable 3.3, you seethat in 1980,women eamedmuch lessthan equally well-educatedmen, although for both men and women income tended to increaseas the level of educationincreased.The genderdifferencein incomesis striking: on average, women eamedjust over half of what men did, and the best educatedwomen (those with post-graduatetraining) earnedless on averagethan did the leasl educatedmen (thosewho did not completehigh school). To provide an easily graspedcomparison of male and female averageincomes for each level of education, we can compute tlle ratio of female to male means.Ordinarily, thesewould simply be included in an additional columl in the table or as a substitutefor the total column.
Ed ucati o n a I Atta i n m ent Post-graduate training Collegegraduate Somecollege Highschoolgraduate Lessthan 12 years Total
Mean Female lncome Exprcssedas a Percentage of Male Mean lncome 44 43 68 63 53 55
The computationshere arejust the ratios multiplied by 100, which yield the female meansexpressedaspercentagesof the male means.They show that within educationcategories, women on averageearn between two-fifths and two-thirds what men do. You might be curious whether things have changedsince 1980.To find out, you can construct the sametable from a more recent GSS.
S{jBS'}}IVTIVE T'OTNTSON TABLE 3.3 The ratio of femaleto male incomesshown here(55 percent)is somewhatlowerthan the ratiotypically estimated from censusdata(forexample, Treiman and Hartmann1981,16), which is about 60 percent.The discrepancymay reflect differencesin the definition of fulftime workers. lvlost of the computationsbased on census(or current Population Survey[cPs])data define "full-timeyear-round"workersas those employedat least thirty-five hours in the week precedingthe surveyand employedat least fifty weeks in the previousyear.The G55question,by contrast,askswhether peoplewere working in the previousweek and if so, how many hours,or, if they had a job but were not working in the previous week,how manyhoursthey usuallyworked.lt may be that the G55table
Still More on Tables pally s the ragg, r with : who
)s for arily, te for
55
nc udesa substantial year numberof peoplewho did not work full time in the prevrous andthereforehad lowerincomesthan thoseemployedful time,whereasthesepeople rvouldbe excludedfrom computations basedon censusor CPSdata.Because women :end to havemore unstableemploymenthistories than men, it is probablethat those nciudedin the GSSbut not the censusdefinitionof "full time" would be mainlywomen, ivhichwould lowerthe GSSratiorelativeto ratioscomputedfrom censusor CPSdata. Notethat thereis a certainamountof slipperiness to the analysis usingeitherthe GSs cr the censusdefinitions of full-timeworkers:information on hoursworkedperweekat :he time of the surveyis relatedto incomecomputedfor the previouscalendaryear. Ihere is no helpfor this because is to askabouthoursperweektypically the alternative ,vorkedlastyear,whichis boundto be highlyerrorprone,or to askaboutcurrentsalary cr wage-which is also highlyerrorpronebecauseincomeis highlyvariableoverthe .ourseof the year.Theconvention, whichisthe convention because it isthoughtto yield ihe best data, is to ask about hoursworked in the pastweek but to ask the weeks year. ,vorkedand incomequestions with respectto the pastcalendar Anotherpossible reasonfor the discrepancy betweenthe GSSand censusestimates cf the ratioof femaleto maleincomesis that the G55figuresaresubjectto substantial :amplingerror We will take up statistical inference in surveyanalysis in ChapterNine. The point of this note is to emphasizethat wheneveryour resultsdiffer from those
emale n cat-
feportedby others,especiallythose that are widely cited, it is important to attempt to accountfor the differences asbestyoucan,andto eliminatecandidate explanations that croveto be incorrect. Yourpapersshouldbe filledwith commentsof thissor'l;they give ihe readerconfidence that you havethoughtthroughthe issues and areawareof what s goingon in yourdataand in the literature.
r. You struct
ffierences from lnformation on Missing Data the t6), ro f rcn last €K5
9tn Jn9 rble
\.rle that the catalog of sourcesof missing data presentedin the technical note on T:ble 3.3 can be combinedwith informationin the tableto get an approximateestimate s differencesin labor force participation rates.The row marginal of the table tells us ilr -r rhere are 380 males and 246 females employed full time for whom complete inforrrrrion is available.From the information in the technical note, we seethat there xe 235 n:les and549 femaleswho arenot employedfull time. If we arewilling to ignorethe 59 who areemployedfull time but for whom informationis missingon educationor ;e1-rple rLnme, we can estimatethat 62 (: [380(380 + 235)]+100)percentofthe malesin the ;omple and 3l (: [246/(246 + 549)]+100)percentof the femalesin the samplewere :mployedfull time during the week of the survey.Of course,becausewe havethe data, couldget theseestimatesdirectly and would not haveto ignorethe 59 missingcases. -s 3ur if we had only the publishedtableand the accountingof sourcesof missingdata,we
56
DataAnalysis: Quantitative DoingSocialResearch to Testldeas
could use them to estimate labor force participation rates, even though the table was not prcsentedwith this in mind.
StillAnother Way of Presentingthe SameData Sometimesit is useful to presentstandarddeviationsas well as meansin tables such as Table 3.3. When you needto presentstandarddeviationsas well as means,a useful way to avoid overcrowdingyour tables is to presentseveralpanels,as in Table 3.4. The point of presenting the standarddeviations is both to enable the reader to do statistical inferencecomputationsfrom the data in the table (the standarddeviations are neededto computeconfidenceintervalsfor testsof the sisnificanceof the differ_ encebetweenmeans)and to provide substantiveinformation. For example,it is infor_ matrve to note-from the rightmost column-that the heterogeneity in income is more than three times as great for men with post-graduatetraining as for women with postgraduatetraining-a ratio that is much larger than for any of the other levels of education. This gives us a hint as to why the averageincome of women with post_graduate training is so low-unlike their male counterparts,some of whom get extremely high_ payingjobs, thesewomenappearto be lockedinto a setofjobs with a very narrowrange of incomes.We could takethis further by investigatingthe propertiesof suchjobs_but we will nol do sohere. A seriousshortcomingin the comparisonof meansacrossgroups is that means, unlike medians,are sensitivero outliers*extreme observations.Thus, for example. the inclusion of a few very high-incomepeoplein a samplecan substantialryaffecithe computedmeans.This is equally a problem when the data are codedinto a set of cate_ Eofieswitb a top code for incomes higher than some value, as is the casefor the income measuresusedin the GSS. In 1980the top code for income was $50,000.To comoute a mean,a valuehas to be assignedto eachcategory.This is not much of a problemfor most categories;it is conventional,and reasonablyaccurate,to simply assignthe midpoint of the mnge included.For example,the bottom category,..under $1,000,',would be assigned$500,and so on. But for the top code,any decisionis likely to be arbitrary. One possibility is to use a Paretotransformationto estimatethe meanvalue of the top code (Miller 1966,215220), but this dependson rather strongassumptionsregarding the shape of the distribution. In the analysis shown here I thus, rather arbitrarilv. assigned$62,500to the rop code.Had I assigned,say,$75,000,the male-femaleincome differencesfor well-educatedpeople would have been larger, and the male standard deviationswould havebeenlarger as well. In the caseof skewed(asymtnetrical)distributions where one tail is longer than the other, of which income ii perhapsthe most commonexample,it makesmore senseto computemediansfor descrjptivepurposes, although for analytic purposesmost analystsresort to a transformationof income, usually by taking the natural log of income becausemedians are yery algebraically intractable.Table3.5 is the equivalentof rable 3.3 exceptthat mediansare substituted for means.(Ifan analystwantsan analogto a standarddwiation, the interquartilerange is commonly used.)In this casethe meansand the mediansyietd similar interpretlations, but often this is not the case.
s such useful Ie 3.4. to do ations differinfori more I posteducaaduate ; highi range ,s-but means, ample, :ectthe )f cateincome Jmpute lem lor re mid' g ould birary. the top earding itrarily, rncome randard rdistrrhe most lrposes, income, 'raically tstituted le range :erprem-
58
to Testldeas QuantitativeData Analysis:Doing SocialResearch
TAffiLg 3.5" ueuianannuattncome in
1979 Among Those Working Full Time in 1980. by Education and Genden U,S, Adults (Category Frequencies Shown in Parenthes€s),
ilii.:l... ,l*'*+i,',4:., :l:l1ii!iiii.i:: .:i,.:i, :.t,l,l Collegegraduate
23,750 (46\
11,250 (35)
18,750 (81)
*r r,llil;..,.:':. iti:::i:::.i::j*iqli:ti, Highschoolgraduate
Less than
16,250 (131)
9,000 (105)
11,250 (236)
11,250 (246)
13,750 (6261
': , : i .:.: : . ; ,:..:,t, : .: , ,
: i.t i :::: i Total
16,250 (380)
INDEXOF DISSIMILARITY Thus far we have studiedthe associationbetweentwo or more variablesby comparing percentages, means,or mediansacrosscategoriesof the independentvariableor variables.As we havenotedalready,thereare situationsin which this strategydoesnot yield particularlyinformativeresults.In particular,whenthereare largenumbersof categories in a distribution,comparingthe conditionalpercentages in any onecategoryignoresmost of the information in the table. Supposeyou areinterestedin knowingwhetherthe laborforce is more segregated by sexor by race.You might investigatethis by crosstabulatingoccupationby sexandrace, as in Table3.6.Visually,the tableis of little help-it is not obviouswhetherthe distributions of the two racial groupsor the two gendergroupsare more similar.To decidethis, you can computethe Indexof Dissimilaity (L), glenby
| 1 -Q , l n
(3.1)
Still More on Tables
I Time rryn in
59
rhere P. equalsthe percentageof casesin the ith category of the fust distribution and Q, equalsthe percentageof casesin the ith category of the seconddistribution. This index ;an be interpreted as the percentageof casesin one distribution that would have to be difted among categoriesto make the two distributions identical. If the two distributions ae identical,A will of coursebe 0. If they are completelydissimilar,as would be, for erample, the disribution of students by gender in an all-girls school and an all-boys school,A will be 100. From Table 3.6 we can compute A for each pair of columls. For example, the A fm White males and White females (which gives us the extent of occupational segregadon by sexamongWhites)is computedas42.1 : (15.6 - 16.41+ 114.9- 6.81+ " + lli - 0.91y2.In the presentcase,four of the six comparisonsare of interest:
Occupational segregation by sex among Whites
42.1
Blacks and others
41.3
occupational segregation by race among Men Women
fnnanng ; or vannot yield ategories IES MOSI
€ated by andrace, rdistribucide this,
(3.1)
24.3 18.2
From thesecomputations, we seethat more than 40 percent of White women would bave to change their major occupation group to make the occupational distribution of s-hite females identical to that of White males, and sirnilarly for Black and other romen relativeto Black men (note that the coefficientis symmetrical,so we could as easily discussthe extent of changerequired of males to make their distributions similar lo thoseof females).By contrast,less than one-quarterof Black maleswould haveto ctange major occupation groups to make the Black male distribution identical to the $'hite male distribution, and among women, the corresponding proportion is less than me-fifth. Thus, we conclude that occupational segregationby sex is much grcater than ccupational segregationby race.Although it is not common to report testsof significa.ncefor A, it is possibleto do so. (SeeJohnsonand Farley [1985] andRansom[2000] for discussionsof the samplingdistributionof A.) One important limitation of the Index of Dissimilariry is that it tends to increaseas number of categoriesincreases(A cannotget smaller if the categoriesof a distribution fte re disaggregatedinto a la.rgernumber of categories;it can only get larger or remain mchanged). Hence, comparisonsofAs are legitimate only when they are computedfrom distributions basedon identical categories.For example,it would not be legitimate to use -1asa measureof the degreeof occupationalsexsegregationin different countriesbecause L1-cupationalclassificaiions tend to differ fiom country to country (unless,of course,the distributions were recoded to a st rdard classification, for example, the Intemational *andard Classifcation of Occupatiozs[InternationalLabour Office 1969, 1990]) or *ome aggregationof this classification.
60
QuantitativeDataAnalysis:Doing SocialResearch to Testldeas
f,&,Sl,f 3,*, f.r..rrt.ge Distribution over Major OccupationGroups by Race and Se:c U.S.Labor Force, 1979 (N = 96,945). Blackand Other Men
Managers and administrators
White Women
Blackand Other Women
14.9 6.4
Clericalworkers
6.0
Other serviceworkers
Farmlaborers and supervisors
N (thousands)
16.1
1.5
(so,721)
(s,779)
source:AdaptedfromTreirnan and Hartmann0 981, 26)
.-.-
24.6
StillMoreon Tables 61
WRITING ABOUTCROSS-TABUtAfl ONS b *riting about cross-tabulations,or for that matter,quantitativerelationshipsof any kind, aim of the gane is clarity, not elegance.Youshould try to say enoughabout what the :rble showsto guide the readerthrough it but not so much as to confuseor bore. Strive for :-rlnomy of prose. Hemingway is a good model. Among quantitative social scientists, \adran Keyfitz (who addscharrnto simplicity) andpaul Lazarsfeld(a goodexamplebecause rs nativelanguagewas German,not English, andhe was saidto write his drafts a half dozen nes or more beforebeing satisfiedwith the prose)are worth emulating.Robert Merton is f-rr a quantitativesociologistbut is a good negativerole model an1.way.He is excessively rnate anduseserudition to finessesticky points. Too many social scientistsare simply tur_ Howard Becker's book, Writing for Social Scientists(1936), is a wonderful primer on eiting good social science,but he doesnot pay much aftentionto writing aboutquantitative ::m- However,two recentbooks by JaneMiller (2004, 2005) do this very well, providing rrh useful advice.It would be well worth your time to consultboth of thesetexts,the first --rnhich focuseson cross-tabulationsandthe secondon multivariatemodels.The following .ue :ome specificpointersfor writing aboutthe sort of datawe areconcernedwith here: r
Describe tables mainly in terms of their subsfantive implications. Cite numben only as much as is necessa.ry to makeclear what the table shows,and then statethe conclusionsthe numbersleadyou to. The point of presentingdatais to test ideas,so the datashouldbe discussedin termsof their implicationsfor the ideas(hypotheses) beingtested.Simply citing the numbersis not sufncient.On the otherhand,you need to cite enoughnumbersto guidethereaderthroughthe tablebecausemostreaders_ including most professionalsocial scientists-are more or less illiterate when it comesto readingtables.
r
Strive for simplicity. Try to stateyour argumentand describeyour conclusions in termsyour ancientgrandmotheror your cousinthe appliancesalesmanwould understand.There is no virtue in obscurity. Obscurity andprofundity are not synonyms;obscurityand confusionare, at leastin this context.As our brethrenin the physical sciencasknow, truly elegantexplanationsare almost always simple. Avoid phrases that add no meaning. For example, insteadof ,,We now investi_ gatewhat inferencewe canmakeasto whetherA might be saidto havean effect on 8." write "DoesA affectB?"
a
r
r
Avoid passiveconstructions,"It is found thatX is relatedto y,, tells us no more than '.X is relatedto Y." Avoid 'A scaleof supportfor U.S. foreign policy was constructed."Who constructedit, God?Write ,.I constructeda scaleof support for U.S. foreign policy" or "I usedthe Universityof Michigan Internationalism Scaleto measuresupportfor U.S. foreign policy.',
:
Avoid jargon when it doesnot help. Note thatI did not suggestavoidingjargon altogether.Jargon, the technical terms of a particular discipline or craft, has a clear function----economy.Use jargon terms when they enable you to convey a point in a sentencethat otherwise would require a paragraph.But if ordinary
62
euantitativeDataAnalysis: DoingSocialResearch to Testldeas
;l',ll'JJ#H'[il;L#;.;1;ii;;,*T."",,;fr jtrr;doesnotmakey
'
*':* :' }iJ";F ';{t*el* *#,'r r:#, frlflr +'ru* #::,J.:n:,i..ltff n:i.,1::#:#,,";xTT,E unavoidabre inrabre, jiilFlffl'sa:f,T"lfr,.:"#T,T.are because orren
' ,?U1ffJJ:J.TffJ::#::l:j:ll.,,is pre,entious inasol
jl"'#f i",j n:'fff::i ffi S:: : ::::::";G;;:#:; :,T*l#; .'-'i,,JJT""J:; ro''"u.p t".
ffilJ,ilT';*fl ji** J1',
;: :.T:il.l
";.:tmir:lnri.,*,1*ir#H"# "ffi
'';tp":3.tfffi {"3i;::f"1#ilr*i#-
**txi*t;;,llffi [**t*ht{:l -"*#,:fr,ffTi1i'::l: ,**ffi*,e;l,Nil*t*J 6***1*'5,i;#16*, t
I rl
rt
i
ff -
---'"DLw4vtorean
*..Ii.-".T-:r-: "--u rur wnung is "ot
the wrrr oi, .n the .-,* to .^ your ,. wall next
g"tting -tr,nri" you ool;r:n
word processor,for
t
Don'r get it right, get
I
Write, don't read.
I
Don't let the perfect becomethe enemy of thepossible.
it written.
confoft
Still More on Tables
63
Havethe courageto be simpleminded. Anything worth doing is worth doing superficially (with thanks to John Tukey). The last 10 percentof the work takeshalf the time. The first 10 percentof the work also takeshalf the time. You can't write the seconddraft until you have written the flrst draft. Write honestfirst drafts. (Show your friends your first drafts, not your fifth ftafts passedoff as first drafts. It is much more efflcient to get othersto tell you what is wrong-and what is right-with your prosethan to try to figure it out for yourself.) I
a
Thereis no suchthing as good writing, only goodrewriting. Accept criticism gracefully, even though it feels like rape, castration, or some similar violation of your person;it happensto everybody,ard everybodyfeels the samewav,
WHATTHISCHAPTERHAS SHOWN
I t :
fo rhis chapter we have seen how to extract new information from p[blished tables. Tben we noted the one circumstancein which it makes senseto percentagea table ar".-krlards"-when we analyzedataderivedfrom "response-based" samples,samples m-:rified on the dependentvariable. We saw why it is necessaryto provide information or "-asesin the samplebut excludedfrom a table, and how to do this. We considered D;{ ro construct and interpret cross-tabulationsin which the cell entries are means(and mlard deviations). We learned how to compute the Index of Dissimilarity (A), a meare ofthe similarity of percentagedisftibutions.And we consideredhow to write about lrcs-nbulations. -{Il of our work so far has been basedon paper-and-penciloperations,involving at n''q a hand calculator. In the next chapter we enter the world of modem social research 4 Ieaming how to construct cross-tabulationsfrom data on individuals via computer rrs-are designedfor statisticalanalysis,focusingon the statisticalpackageStata,which .€ qill use in the remainder of this book.
CHAPT ER
ONTHEMANIPULATION OFDATABYCOMPUTER W}IATTHISCHAPTER ISABOUT h this chapter we consider how to manipulate data by computer to produce crossntulations. The same logic of data manipulation will apply when we get to regression mall-sis, so this chapter servesalso as an introduction to statistical analysisby computer. s-e considerhow data files (of the kind that are of interest in this book) are organizedand hq to extract data from them; we consider ways to transform variables to make them rwEsent the conceptsof interest to us; and we again addressthe nagging problem of how rr handlemissins data.
66
Quantitative DataAnarysis: Doing Research to Testrdeas ''ciar
INTRODUCTION Most stadsdcalanalysisby
socia
ffiixir,trrffi il:"i#H:: #;#*ilT*{:i,ll.lFI,T$.rr:,n ,:tffifi:il[l,t:.jl $ilffi ffiry;fl1*ihT:;:*:::1fij":,u:i11ffi j. :.fl J,g:il#jt;ru*:l* H,;:lf i*m**;.Tr.h+l{,"!;,f, ins new command, *.* '"'Tl::,1#fi::t.T:i,]# t"d;Tffi|Iil
#i#T:$i,",'"",;"H};;:}:x#r$iprosra n+::T{lJ-1iTffi academic users. srara israpidry becoming,r,",,i ir,T"rif"&"g1,;iffiiii;$?Xli
scrENcE coMpurER i^?',:l??L*'-I:ttoNsocrAl Kf p,ouuiry-i"';; ."."ng,o.iorosi,t,. # Ji3"ti,:i,i?liJ:i :::l:,::,:,Jn"o" J:;;:: :[::l|Iff:i:i::iiiiil.::l':::. i:;::i::il; :"'n" "'"r*"'''''J::
j:: ::.#:Hu:nl m;::lj:::Ll,:m:#11,.=s=*:::1,:,::.1 *:l wnttenbvcompute,il;,T,'J:"Tt;:T[Tl;#:;ffiHmU:;i
i::ffi:#ilt
iffif.T:te
asintroductions t" *o'1,.'r,,'*" orisinar manuar isno
r"J:"._1;?,T,T:"THt; n:ru*tllld!1l[:]rjfi ;:",;H;:;tr.:,[x.fl ;:::tT:1*1";:::jliyir":r{: r# uo.ptuna.o.pri""t,"'"",,, ii"ttn
universities Assocjal scientists t
lt is notaneasvlanguage Fortunatery, to teachor to rearn. Stata, whicho"n.tll,ltllY"
#ll'd#{::tJ *;;;$,it*n+*5i|i;
evenwlthverylargedatasets(for percent sample example, of th" an,""r"iln-,t-ltll'. a1 lt iscapable of doing most of modern the tt rg, data.""vr,r.ii" *q;ir"d ," aregenerallv simple andstraishtforw"ra dutu,"t, .* il;;on, ano stutu -.Tnsus) il;t1nds
work Appendix 4A,",,r;:lJTl".n;jJfll ,,11i:.:,1?j,".""1.11"1.: Pruvruc5 trpslor carryingout "; ":,,,0,"0 usjngstata. data analysjs I
Onthe Manipulation of Databy Computer
6V
r-: ::fis are availableboth for Unix platforms and for pcs. of tne three.stata is the :1:.;: rearlf identic-alacrossplatforms. There are, of.ourr..'.on1, orher statisticai :-!!-:ges as well. Many of thesepackagesar: exploringbut onty alier you have :;::red the materialin this book. As you -lvorth will Ois.ou.r. ttr. -iugl. ot data analysis by - ':::rter is fairry standard,althoughthe comm.tnd iirr"i, ,o-ewhat from pro_ "_l,nu., - ::.. r!)program.Havingoncemasteredthe basiclogic, it is easyto apply it to otherdata ,:r. rd otherstatisticalpackagecompurer programs.
-IOW DATAFILESARE ORGANIZED .j.].* tuut to think of the organizationof data in a computeris to imaginea mafix : :; ::ich the rows are casesand the.columns(or setsof col;;;.j are ua.iautes.specifi_ :- ' considera data set that contains257 variablesluut +zz cotumnsof data because
J':"fr'#, TffT"ix1lf l;"'?1.,i;ll$g:"'il"ff :-:.1,1qi# T"fh.d,":llJ:
-: hence1,609rows ofdata). For the ,ot" of ."g_O,nr. dataset as con_ ::-,S informationfrom a representative ".-on"r"t"n".S, sample of the U.S. popuiouon.In sucha data rr xe informationmight be organizedasin Eihibit 4.1. lrr manipulatethesedata,we needa map to the dataset,which tells us wherein the r;:::r particularinfomation is locatedand what the infonnation meanr.Sucha map is \:: :,n asa cod.ebooft. In the presentexample,we might huuea cod"book somethinglike ; :: rs shownin Exhibit4.2. ,\rmed with the informationin the codebook,we now know exactlywhat the dataset - ::.ins. It consistsof one recordper re-spondent for eachof 1,609respondents. High_ generallyprovide information about the -::i iharactenstics .also of the on which the data set is basedan
*s
QuantitatjveDataAnalysis:Doing SocialResearch to Testldeas
A Codebook Corr€sponding to Exhibit 4.1. Variable Number 1
Column IA
2
5
3
6-7
Variable Name rdno 5ex
_,] 422
poficV
Variable Label and Code
sexof respondent '1 Male 2 Female Age(exactyear) 99 99 or older
The policiesof.ihe presidentare l Wonderful
20K 3 Not so hot 4 God a\,vful
5 Who knowsandwho cares 6 Noansweror uncodable
computerreatlableandare known asfi1e.r.In the presentexample,the first four columns give the identilicationnumbertbr eachrespondent.Usualrythis is of rittle interestat the data analysisstage.but it is vitary necessaryto keeptrack of the data and is crucial if everwe wantto addadditionaldatato the file-for example,if we haveconducted another surveyof the samerespondents andwant to mergethe datafrom the two surveys,or if we want to supplementinteryiew responseswith informationfrom organizational records. and so on. Column 5 givesthe sexof the respondent,columns6 ani i give the age,and column422 givesthe responseto a questionaboutthe policiesof the president. Usingthe responsecategoriesindicatedin the codebook,we seethat the first respon_ _ dent is a twenty seven-year-old male who thinks the president,spolicies are god awful and that the secondrespondentis a forty-one-year_old femalewho tninks the president,s policies are wonderful.The third respondentis a woman for whom no inlbrmation is availableregardingeitherher ageor her judgmentof presidentialpolicies.perhaps she refusedto answerthesequestionsin the interviewor guuenonserrsical responses, or per_ napstherewas somesort of editing error that destroyedthe informaLton;ln any event,rt is unavailableto the dataanaryst.(Note thatthereis no "n/a" cotiefor sex. It is rareto find a "no answercode" for sex.at reastin interyiewsurveys,becausethe interviewer usually recordsthisinfomation.) Somecodebooksgive thefiequencydistribution(the marginali)
I
I
ut m
tr|r
l]tq
u0u h
lllrlll @
[l
{@n
On the Manipulation of Databy Computer 69 ts each variable. This is a very useful practice, and if you construct a codebook, you $ould include the marginals(the -codebook- commandin Stataaccomplishesthis). Ttreir inclusion permits better initial judgments as to suitable cutting-points for variables :s well as a standardagainstwhich to check your computer output for accuracy.It is very casyto make mistakeswhen specifying computer runs, so you should check eachrun for ronsistencywith previous runs and the marginals. Supposewe wanted to ascertainwhether men and women differ in their support for gesidential policies. To do this, we might cross{abulate the presidential policy question I'r- sex, percentagingthe table so that the judgment of presidential policies is the depenibt variable. Thus we have to instruct the computer where to find each variable, to do 6e cross-tabulation,and to percentagethe table in the appropriate direction. We also hi€ to instruct the computer what to do about the "no answer',categoryin the presidential policy variable. There are two ways to specify how to locate data in a file, and computer programs ,fffer as to whether either or both is permissible. Some programs use instructions that prrnt to paticular columns in the file-for example, "cross-tabulatecoluml422 by colrn 5." More commonly, programsrequire that the analyst first specify where in the data s eachvariableis located and then use variable namesto commandparticular manipulatirx-for example,"The variable SExis in column 5 and the variable po-Lrcyis in colm -122.Cross-tabulatePOLICyby SgX." A variant of this approachis to require a map mbering the variables sequentially and specifying their location, for example: Variable 001 002 003
Columns t4 5
DS l€
422
if ET (e b,
rd F.
d
tross-tabulate UAR257by yAROO3."In most currentprogmms,includingStata,SAS, d SPSS,suchrnapsare createdin the courseof creating ry stemfilesi as part of the prepabn of the file, variable names(ussally restricted to eight characters,although no lon!:lr io in Statabeginning with Version 6.0), wriable labels, andvalue labels (indicattng lb meaning of each responsecategory) are attachedto the file, and variables are then *-ified by name. In instructions to the program, which are known as commands,the rf'st usesthe namesof the variables and neednot be concemedabout their location in & file. For example,the Statacommatd
is
tab policy
E f-
ir d ,-tv jl
sex, col
fre computer to cross-tabulatepO-LfCy (the row variable) by SEX (the column variand computecoluml percentages.Note that in Stata,variable namesare casesensiThus Stata regards sex, sEx, and sex as three different variables. (Although in t! book, variable names appearin ALLCA?S, to make it easier to distinguish variable fiom otherwords in a sentence,in my Statacommandfiles [-do- files-see the -s l3 *r
70
QuantitativeData Analysis:Doing SocialResearch to TestIdeas
lollowingdiscussionl. I alwaysnamefijeswith lowercase namesto avoid extra typing ano rne elror that accomDanies it- )
A Digressionon Card Decksand Card_tmage Computer Files
computersbeganto be usedextensivelyin the social sciencesin the mid-lg60s but did not becomeubiquitousuntil the 1g70s.As a conseq".o"", .ets sr'r of interest cr:at:g use wirh pre_compureranalytic_rec.hnotogy, -urv'iJ,u spe#carf y with machinery Y:Je _f9r that readsIBM punchcards(seeFigure 4.1j. Alrhoughtn"i"gi" o"t" organizationis similar to that usedfor analyri. by "dictated the technology "i severalimportant "ornprt.r, $ff,".:"::r. Whereasthere is in principle no limit to tt nuiiU".-J va.'ables that can be includedin a singlecomputerrecord(although " fmitution, thereare u. to f,ow many vari_ ablesa programcanhandle),an IBM co-ntains eight;;;i;;;. ;"""r.e the machin_ "ard ery for manipulatingIBM cardscould handle ;; ;J ;; ; time lsuch machines "rly unit.record equipmenr,where the record was one caro length), there was ::::::ll "rpacking premrumon a as manyvariablesaspossibleonto a singlecard.
'.: A card dataset consistsof one or more cardsper respondent.For example,to represent all of the datacontainedin our illustrati ve ?57 -variabre,i2z-*iuo,n outu."t *ould require 6-cardsper responde\t (= 4ZZ/}O,rounded up) ,f''"r'LfOS ..r;""dents, or 9,654cards. The information shownfor the iirst respondent might be representedon an IBM card asin Figure4.1,wheretheresponsetopresidentialpo'Jes is coituin"Jio , a+,but other_ wrsethe columls correspondto thosein Exhiiit "orr.n 4.1. An analystwantingto cross_tabulate responsesto presidentialpoliciesby sexwould passthe deck tbrougha counrer_sorter, whicir would pirysicallydivide the deckinto two subdecks readingthe holespunched in u o".ignui.j _by 5 in this case. cards wirh a "1" punch would fill into the "otu#n, "orrrnr, r p*ri"t ir,r,.,*"r,i"l and cardswirh a,,2,, punchwould fall into the 2 pocket Each of thesesubdectr*ouiJ-,rr"n u" passedthrouqh
On the Manipulation of Data by Computer
71
).png
ur did rterest [inery fon is nrtant canbe y vanachinchines re was
epresent i requlre i4 cards. ard as rn ut other:x would into two his case. rttha"2" I though
.'' A .1 . an tBM punchcard. machinea secondtime,andthedistributionof punchesin column64 wouldbe counted -[c displayedfor the analystto copy by hand onto paper.Thesecountswould generate :e bivariate frequency distribution of judgments regarding presidential policy by sex, in the usualway (usinga deskcalculator). r::;h would thenbe percentaged This technology had severalimportatt consequencesfor data organizationand data [,:-1sis. First, it discouragedthe use of statistical methods other than cross-tabulations :rr--auseall it could do wasgeneratethe countsneededasinput to statisticalprocedures-the manipulationstill had to be canied out by hand.Second,it discouragedthe reten_m-::braic :rr{r of detailedinformation; therewas, indeed,a greatpremium on squeezingthe response ::r:gories hto a singlecolumn if at all possiblebecausea two-column variablewas tedious :: ranipulate (it requiredmuch morecard handling becausethe variablehad to be sortedon fe ffst digit, and then eachof the resulting categorieshad to be sortedon the seconddigit) n: producedmore detail than could be usedeffectively in a cross-tabulation.This resulted r ie use of what are known as zone punches,the locations on an IBM card above the called"x" and"y" r:erical columns,which alsowereusedfor "*" and"-" (sometimes (no punch) meaningful category. Thus, fbr examas a :-xhes), and also the use of blanks years in data setsdesignedfor --re-ir would be unlikely for ageto be representedby single re *ith unit record technology; rather, a set of age categorieswould be predesignated. =d. in the interest of getting as many variablesas possibleon a single card-because it rr. impossibleto include in a single tabulationvariableslocatedon different cards-some lc-tsts resortedto putting more than one variableinto a singlecolumn. Considervariables I ad 257 in the preceding example (Exhibit 4.1). Becausethere are only two possible -i.::i,.lnsesto the sexitem and six to the presidentialpolicy item, they could be included in a r.5le column simply by using punches.l-9 for the presidentialpolicy responsecategories. { €\ ice on the counter-sortermachile madeit possibleto suppresssomepunchesand sort r .rrhers.Columnsof this kind were known asmultiple-punclrcdcolumls. ,\11of thesedevicesfor packing as much data as possibleinto a single IBM card :,ved havoc when the shift to data analysisby computer occuned. Becausemost
72
QuantitativeData Analysis:Doing SocratResearch to
Testldeas
weredesignedro recodedatafrom one setof symbotsto another,the ffl!1r11lroSru-s srmpte caseswerc thosein which zonepunches andblant, ,"r.u.io u. _"uningful cate_ much more difficulr problem.arose,t"n *"r" irr"f,ipf._prnched.Such il^.lT " casesusuany requiredextensivespeciarized "*0. computer progru.-in! ,o them into compubr-readableform. "onu"a Even after computersbecamewidely ava able for social research,data set, were often initia.lly prepared in machine_readable fo._ oo mVt usrng a keypunch machine and then read into compurersand transferredto sto.ug""_O', ."aiu ,u"t as computer tape; only.relatively recently have keypunch machinesb*"' *?-r"i"o u, work stations that permit keying data directlv into a.:omputer nt". ft"n"", *uny existing data sets, includingthe NoRC GSSwell into th" tsso., orguJ;;-;;;;;_,*r* records.T.hat in computer sroragemedia -" as a series of eighty columr records li:TI:: :t ":"nred Typicalty.the first rhreeo, for. lll_iifn I.".p-d"."t. rhe respondenr roennncatronnumberand column g0 containstn",."o.0 "oturnnr'#tain nuroilr, o, out tO.This orgazatronof datahasno consequences fo-ranalysis,bur iiil;;h;;" *"y the computer rs rnstructedto readrhedata.The specifi" a"tuitsu*y.t"p"nl;;;;;" p."g."m you use, but you should be aware of this altematrve mode of data organization, rn addition to the specificationof onerongrecordper respondent with whi"r, i,li"gl" *. oiscussion.
THE WAY THINGS
WERE
available, commandfilesalsowere
Before electronic daraenrryterminats became
wrote outhiscommand fire, .", .rJ::il:;:ii;::J#:[
1
: l
?,ilil.:?ju'; J,5il:J;
a separatelBN,4 card (by a keypunchoperatoror' in the caseof undertundedgraduate students,by the analyst).The resulting,,deck,, of lBlvlcardswas then transportedto the university centralcomputinqcenterand either submittedto u .turt o'. Lo directlyinto a caroreaderEventually the commandfile was executed(,,thejob ran,,j.otten after a delay of severalhours,and the printedoutputplus the box of cardswere returnedto the analyst. lf.therewere errors,the entireprocess was repeated.Thistechnologylimited the number of computerrunsto two or three per day,which made'tf,t".r.ofJi"" * any particular
verVttme-consuming proposition bycurrenr standards_but
didat teasthavethe iii.ll1s feature l salutary of allowingmoretjme to think whilewaitjng for the joO,o |.un.
TRANSFORMING DATA As notedseveraltimesin previous,chapters, dataare not alwaysinitrally represented in a form that is suitableto oui ,"r"u
oru,ngr" u*iuuiil;;il,l;l;i:'*T#]riJ3iill;li#'J#j";li*:: "oa..
data transformation.r, and each o
ceduresroraccomilil;;';;;:i;:;#iTfi ::X#it"li'"."n"'ffi:*::U.
brlrtresFaciliryartransformins variable* to u ro.- t,u-t"oriirffi concepts is animporrant skil ;f theqr"",ii"i* 0""1"
I
I
"*pr.rr"s
theoretical
On the Manipulation of Data by Computer he Ierch Ito tre
rh t T
)ns ls, mt rds \aIer se, fue
73
Rxoding Recodingis the term usedfor changing the values of a variable to a different set of val_ rs. Recodinghasmanyuses,someof which we havealreadyseen. one is to collapsecategoriesof a variableinto a smauernumberof catesories.for :rample, whenI createdthe leftmostcolumnof rhble 2.3 from Table1.1.To se-e how this rccedure works, let us considerthis examplein detail. I startedwith a reliqiositv scale of the following categones: --omposed l. 2. L +.
Very religious Somewhatreligious Nol veryreligious Not at all religious
(For the moment,ignore the possibility of missing data.)To combine the last two cate_ gies. I simply changed,or recoded,category4 to category3, which yields a new variable: l. Very religious ?. Somewhatreligious 3. Not religious -\lthough somecomputerprogramspermit a variable to be .,written over,,_that is, to 5e replacedwith a new variable-this is very poor practice. Rather, you should createa ..s containingthe transformedvalues.The reasonfor this shouldbe obvious: 'ariable :[dr to protect againsterror and to permit you to transform a variable more than once in te samecomputer run, you should preservethe original coding of a variable as well as .u' recodedor otherwisetransformedversionsofthe variable.Typically,stadsticarpackrse !-omputerprograms operate line-byline; each line of code operareson the data in rbareverform they appearafterthe previousoperation.Hence,it ii all too easyto trans_ tr-m a variable and then inadvertently transform it again, unlessa new variable is created n rbe courseof the transfomation ,\ second use of recoding is to redefine a variable by creating a new set of ::riesoriesrepresentinga new dimension.you have seenan example of this also, in :sr discussionof property spacein ChapterThree. Recall our classification of U.S. :.]n-gressmen lnto
L StandardRepublicans 2. Gypsymoths na he
J.
+.
Boll weevils StandardDemocrats
AS
ros1cal
To createa classificationaccordingto party membership,we can recode2 to I and 3 r- -1.l,ielding a new variablewith valuesof 1 (: Republican)and 4 (: Democrat).To ::eatea classificationofcongressmenasliberal or conservative, we canrecode2to 4 and, -::,..'1. againyielding a new variablewith valuesof 1 (- conservative) and4 (: liberal).
74
Quantitative DataAnalysis: DoingSocialResearch to Testldeas
Note' howevet that when variables are recoded to dichotomies,
the conventionis .o code
;i"J5-:fl i:l'#trff :ffi":;il$n",H:il;:?T,*y*"*ln
"Republican,"in which l and 2 in the original variabre;;"; r, and 3 and 4 in the original variable are coded 0. As we will seein later chapters,tliJ0_l recoding convention facilitates the use of dichotomous variables in both dLS and logistic regression. A_third useof the recodeoperationi. to ur.ign ."u1" ,"o.", tJ th" .. of u u_iable.For example, we might have a variable "ut"go.r", measuringeducationatattainment, which is initiallycodedasfollows: 1. 2. 3. 4. 5. o. 7. 8. 9. 10.
No schooling 1-4 yearsof elementaryschool 5-7 yearsof elemenrary school 8 yearsof elementaryschool 1-3 yearsof secondaryschool 4 yearsof secondaryschool 1-3 yearsof college 4 yearsof college 5 or moreyearsof college No information
For many purposes,it is useful to tr.eat years of school completed as a ratio variable. By doing so, it is possibleto computethe meannumberof yearsof schoolcompletedby of the popularion, to use years of ."frJ in regression lT::,":-,^ribt:*os equa ons,and so on. To do this, we might recode "o-pf"ted the original u_iu6t" Uy u..igilng it midpoint or another estimate of the years of school .#;;O " ,, rndividuals in each category:
Original Code 1 2 3 4 5 6 7 8 9 10
Recode 0 2.5 6 8 10 12 14 16 18 -1
In making recodesof this sort, it is important justify to your choice of valuesrather than assigningthem arbitrarily.For example, ,.18 years,, the decisioni. ;:G to the
On the Manipulationof Data by Computer
D code ded l. named in the 0nven)n. a vanhich is
75
:ategory"5 or more yearsof college"ratherthan 17 yearsor 19 yearsmust be justified, rx simply asserted. \ote the specialtreatmentof category10,"no information."In carryingout the anal.'ri. we want eitherto excludethis categoryor otherwisegive it specialtreatment.We :rti sive it a specialcode,which we can eitherdefne asmissingdata (seethediscussion .rx;r in the chapter) or otherwise modify. It is convenientto use negativenumbersto flag :nesoriesthat we aregoing to treatasmissingdatabecausedoing so minimizesthe likei,h.od of inadvertently treating them as substantivelymeaningful. (A useful alternative, l-r aYailablein Stata,is to usethe code"." to specifymissingvalueswhen we haveno re:d to distinguishbetweendifferenttypesof missing value,and to use the codes...a,', ---'-. . . ".2" whenwe want to distinguishdifferenttypesof nonresponse-again,seethe of missingdatalaterin the chapter).For example,supposewe recodedthe .,no -r.---ussion .n'..rmation"categoryas 99. If we subsequentlydecidedto analyzethosewith at least iL-secollegeeducation,we might instructthe computerto selectall caseswith yearsof ;nool completedgreaterthan or equal to 14, forgetting that category 99 meansno inforr:iiion- This, of course,would resultin the inclusionin the highesteducationcategoryof f,r-\. fbr whom educationis not known along with the college educated.
TREATINIG MISSING VALUES AS IFTHEYWERENOT?,;I
riable. xed by resslon ing the n each
N :"ffiJ:nffi Till:;t:Ti::'iH:,:!T; :::il:::1it1ililii..,::i:,";""fi rtercourseper month increases with a wifes age-contraryto alJexpectations! Alas,as r scovered by Kahnand Udry(1986,736),shefailedto noticefour outliers,caseserrone:.Jslycoded88 ratherthan 99, the specifiedmissingdata code.When thesefour cases :.e omitted,the positiveeffectof wife'sage disappears. Kahnand Udryalsoomittedfour l:her outliers,promptinga livelyresponse from Jasso(1986)aboutwhat shouldbe regarded .s an outlier We will returnto a discussion of outlierswhen we considerreoression diao-osticsin ChapterTen.
-\ final useof the recodeoperationis to convertdatafrom old surveysthat usezone -hes and blanks into a form that permits numerical manipulation. This typically can :ln t .jone by reading the data in an alphanumericformat and converting them to a floatingr'^nr decimalformat.
Afith meti c Transformati ons
i rather 't o t he
irmetimes we want to transform variablesby performing arithmetic operationson them. i,,.-h ransformations will be particularly important when we get to regressionanalysis :e--auseit is sometimespossibleto representnonlinearrelationshipsby linear equations ntolYing nonlinearvariables.For example,it is well knownthat therelationshipbetween ir:Lrmeand ageis cuwilinear-income increasesup to a cenain age and then declines.
76
QuantitativeDataAnalysis:Doing SocialResearch to
lr?ii*l'"tntn
"an
Testldeas
be represented by constructinga regression equationof thefollowi':a+b(A)+c(12)
(4.1)
thatis, income(= y) is takento be a linear functionof ageandthe squareof age.To esti_ equation, we need to create a new variable, tie .qr_" oi ug". So we simpty l1:,T": AGESQ = 468*46s
(4.2)
and then regressy on AGE
atd.Ac exrensivetransrorm",,.,."o"b,r;tj?#j;j;,r,jTrXl'Ji:T"ff1
3
ffiff;"
operaror or anyof a numberof specializeo f";i;;r,
suchasthesquare
Cont i ngen cy Transform ations A final way to transformvariablesis to use ,,if, specificationsin your commands.,,If, specificationsare an alternative to_recode commanis and are ne"iute in some b""u:r" makeit possibte.to.p""ify -u"tr -ore I?, t:I r"ru,ionrfripsinvolv"o_pl"" "onttngJi"r example, if wewanted todistinguislithose
whowereupwardly
;fr1il1l1J1:l:TFor jobs rhat were,f hd;;;;ljijl|,ii'lilTl?Jil:Tfr3?ff:'f"*ffi ,IffTl specifyingrhe following: if pREs?rcE is greaterthan pnsiriis _op_
se?HEB constructa new variable,MOBILITY, and give-it the,ufu" f; oifr".*]r", grveit the value 0. the synlt of.rhe computer commandrequired ro do this wilt vary dependingon fl]lo]lih ue used,the logic is, as usual,straightforward: lrogram u;;;;;*ru, variable is,eated, scored 1 for those individuats. who _"""p,r-d;; ;;i;juia ,"or"o 0 orherwise (where"upwardmobiliry,' is def,ned ashavinga" dp;,i"r;i;;er prestigethan the occupationof one,sfather). Another kind of continsencvtransformation is to createa variableconsistingof a count of the numberof resp-onses to a specifiedset of other variablesthat meet specific criteria. For example, we misht create a scale of acceptan"" oi uUo.tioo Uy the mmber of ''pro choice',(,,ac-cepting,,) responses,; ;:;;;iqd;;s about"ounting rt,e circumstancesunder which abortion should be permitted. Contingency statementsare used not only to transform variables but also to select subsamples for analysis.For example,ir *" J"." in[r"ri"J,rl"arr,"g fer_ tility, we might want to restrict ( ""mpleted
jffi ':. accomprisheJ in.o-""o,"'u,". j?lTJ;il! ;:"TnJ5'; r3;! ":"n on the subsample. Otherpackages,suchasStata.
doingall the subsequent operationsonly
;",fi::T::,1'
partof eachcommand, arthough ."bi;;
;i;#;,mpre
is possibre in
On the Manipulationof Data by Computer
llow-
(4.1) )estimPlY
ta )\ ovide using quare
i. "If' some rolvmrdly o had Ed by , conlue 0. ng on s crerwrse hn the gofa rccific ng the rcumselect d ferhis is le and Stala, ible in
77
}|issing Data Otten.substantive informalionon certainvariablesis missingfrom a dataset.The sources ri missingdataare nearlyendless.In datasetsderivedfrom interviewswith a sampleof the information may neverhavebeen elicited from the respondent,either in error -ople, .T asa matterof design(somequestionsare "not applicable,"for example,spouse'sedu:arion for the never-married; and sometimesquestions are asked of random subsetsof :espondentsto increasethe length of the questionnairewithout increasingthe respondent rrden-the GSS often doesthis). The respondentmay haverefusedto answercertain :tr€stions,may haverespondedto somequestionsby claimingnot to know the answeror rrt to have an opinion, or may have given logically inconsistent answers(for example, :aponding "never married" to a question on marital statusbut providing an answer to a *n€sdon on "age at first marriage"). Interviewers may have failed to record responsesor =:1 haverecorded them incorrectly. Errors may have been introduced in the processof :reparing data for analysis-as when narrative responsesare inconectly assignedto code =regories by coding clerks or when correctly assignedcodesare incorrectly keyed in the :qrrse of dataentry. Similar problemsplague other sortsof data sets.Bureaucraticrecords m'eoften incomplete and frequently contain inconsistentinformation.
PEOPLE GENERALLY LIKETO RESPOND TO (WELL-E[
R":::"f ),:?.,1T"?",Y-:',,:;fP#:)::"lT"tP
written.By and large,peopleare flatteredthat they are askedtheir opinionsand askedto talkaboutthemselves. Thereisa famousstoryfrom the loreof surveyanalysis aboutthe Indianapolis Fertility Survey, oneof the earliest surveys that askedexplicitly aboutsexualbehavjor. Oneof the analysts went out with considerable trepidation to conducta pretestof the questionnaire, not knowinghow womenwouldrespondto "intimate"questions. As it happened, the interviewwent off without a hitch untilthe veryend,when the interviewer got to the routinedemographic questions and askedthe respondent her age,at whichthe ladydrew herselfup indignantly and said,"Now you'regettingpersonal!" Theexceptionto the generalwillingness to respondis with respectto informationthat peoplefear might put them in jeopardy, suchas income,whichthey suspeclmight find its way to the tax authorities.
ln high-quality surveys,great pains are taken to minimize the extent of error In the -rurse of readying data setsfor analysis,they arecleaned,that is, edited to identify and if rr-\sible correct illegal codes(codesnot correspondingto valid responsecategories)and il-rg:ically impossiblecombinationsof codes.For example,whena respondentwho claims =ver to havebeen manied gives his age at first marriage,sometimesit is possibleto lecide which is thecorrectandwhich theincorrectresponseby inspectingotherresponses by the sameindividual.When this is not possible,the respondentmight be con_air:en -rcted and askedto resolve the inconsistencv.
78
QuantitativeDataAnarysis: DoingsociarResearch to Testrdeas
t,#i;T'r,$::
the.editing. process aswelascorrected. For
\x!ni:':!::!in
:"1*:iff",1,J:,:",?ffj'#. lii:'::twl'i;: ffi#:HTi;'*?"#f
nousewrves, takenonastemporary employ"".oytrr"C"nrur*nu#u,.."o,'""t"d,, returnsin whicha woman's maritarstaturi"". r"i r"L1*"i"Joi',""",*"n ""n.u, *.."."0oa"0 responseto''married."
rhelikelihooa, or"ou,.,", t auiin
i;rtTfl::r*i;ffilitatus
":J ffiff:ffiXi; ltiiii;itJffitril3:h""1 lT.":'3;*{Ti*"fid,Tttr
ladies_isnot supposed to occur,butit does. io* o,"onrtn . ln thecourseof,h" codes are assigned to.thevariou. "di ti., ornon.ou.t-tiu;;;p.^:r:i:::1t:,explicit "u,"go-
jf Lff : *Jfr *':::"Hl*#H:"jJ:#l;xf;p il"i:'t";ffi il#,i"f ll;: ;,::S;#:il,inT:::j.:,;ff
ffi ilF:';'"''otri".io*,Jiu;;;",ffi todisri n;;;;;;#J#iJ:l:liffi g::tgie '"'i"il:ffi ffi :n',;:"'f,"n#l
.,rH.: .:ilfr ::li ffi ff :q;:*r *th:in#ft .ifi i hFT #f t fi r't""i*,np.,r,r".Xo"i"g*ru" ::::TflT,i.TfiX1;lioiLiiil-of,r responses. rr
l..Tf ":""h"o,"_"*",".#lii^*;iilT:""##il-ff l1,,ffiffi ,ffi.,:,$:
caregories ro Repre-sent N;;
c"r*i oetartm thecodingof nonsubstanhve responses.
in the sec_
"nrprer r;il ii rJ'r",lo..ruo, to preserve
Analyzing Surueyswith Missing Data Presumiag that the data are
coded in s-u$
waV as to preserve
all relevant distinctions, 1 ,. o"n'" r'o'tot .ui ffiffiJ:H.':"#Tjf*TlT,l'"t ordecisions *:' "n""il",^' whichresponses -o beregaroel' stroulo assubstanrively
interestinq
y,1,s^Y.YTli":
an6 "4""',. what todo"aioui t"*r'-'.",i"'#T.Tr[T:"r}iii"'''T[]fl::T?,T#on?
example here. Anorher case thatarisesr..qr*ttyin tauui;;;"rrl
,Tfi:,T::"J## t*"'"; qi'*i'-''i".llJiu,r ..,".ore ;'l":ffi"'ffii,:in (mean;T:il+i':, " .rr,i,i,ooiu'go;il'];;Hili,ili.T::f ,:fnT:riii:Tffi[::Hil,:J; I nusrr youarestudying theadulrpopulatio" i]j,"J,li",.rr. your
reler.totheen'ireadultpopulation, tabtesshould notjust to "r*. whi*r ,"Jnrr"t.. The sorutionin casels simplyto create this a residual -.other...and,o in"foO",t In thetablebulnor bother[o discussit. tt is inctuded_ 91tegory. foi,r,. ,*l ;;;""J:_rch. amongolher "f otrrei ror
il1l:."il":fijii"'tra;:,:i;;J:,-,,: T."ure trr"rp""in" n,fri"1r;;ff;:#j*
-,t" A more
ffiiis_burisnot discussed
of risidualcatesories generally "terogeneitv
difficult problem aris more variabres'' *; ffi;;;;nf, :1i1,.:$*::lx'm:jHfrta,."j"ffi #
On the Manipulatlon of Data by Computer
L For h the {lass C N S US
nrted hatin r who rlyrlegoBOnes nedin mple, plicarl. it is ,flexilier, a nomeses.If rssible eselYe rc seceserve
cllons,
o rear garded ) about iypical ) about (meananalyDterest. should in this but not g other ;cussed nerally ' one or [rcation
79
.-r their income.Again, one alternativeis to include a "no answer'.categoryin eachrow .:ld columnof the table.If thereare many missingcases,this is wise.If thereare only a ::\' rnissingcases,the increasedsizeof the tableprobablyis not warranted.In this caseit :: sufficientsimply to reporthow many casesare missing,in a footnoteto the table. When our variablesare continuous,we musteitherexcludemissingvaluesfrom the :nalysisor in someway imputethe values.ChapterEight is entirelydevotedto the treatrent of missingdata. Most statisticalpackageprogramsallow the analystto specifywhich codesare to be :eated as missingvalues(andindeedrequireit in the sensethat any codesnot specified :-. missingvaluesare includedin the computationwhetheryou intend it or not). Typi:rllv. statisticalpackageprogramsarenot completelyconsistentacrossprocedures(comnands) in the way they handlemissingdata,soit is very importantto understandexactly rhat each proceduredoes and to design your analysisaccordingly.In designingany .nalysis, you must know how lhe procedurewill treat eachlogically possiblecode in l our data,includingin particularthosecodesyou designateasmissingvalues;otherwise :ou inevitablywill get into trouble. In the example on educationdiscussedearlier, "no information,' was assigneda -1. When computinga mean,we ordinarilywould declare-1 to be a missing --odeof r:lue for education.In SPSSsyntax,missingvaluesareexplicitlydeclared:,,missingvalues :duc (- 1)"; in Stata,asnotedpreviously,missingvaluesmaybe excludedautomatically by .Lisigningone of several"missing value" codes,or may be explicitly excludedfrom a proce$Ie by limiting the samplewith an y' qualifier: . . . if educ-: - I (that is, if EDuc is not equalto - l). Thesestatementstell the computerto omit all individuals for whom education r. coded- 1 (or assignedthe missingvaluecode)from the computationof the mean.Neglectng to so inform the computerresultsin an incorrect meanbecauseany individuals who are .-odedir the dataashaving 1 yearsof schoolingare includedin the computation.Errors of dis sort are very common,which is why it is imperativeto checkandrecheckthe logic oi vour comrnands.A useful checkis to work throughthe logic of your computercommands ,ine by line fot specifiedvaluesof your original variablesto seehow the computertransforms iem at eachstepin the process.You will makesomesurprisingdiscoveries. Oneof the thingsthat typically happensto novicedataanalystsis that they do some ;omputation and discoverthat their computerprintout showsno casesor a very small ;rumberof cases.Usually this turns out to be the result of a logical enor in the specifi:ation of data transformations.For example,consider an income variable originally ;oded in a set of categoriesrepresentingrangesof income, for example, 1 : under 53.000per yeal 2 : $3,000to $4,999,and so on, bur where 97,98, and99 are usedto specify various kinds of nonresponses. If the analyst recodesthe income categories 10the midpointsof their ranges,for example,recodesI to 1,500,2 to 4,000,and so on, t'ut then forgets this and specifiesas missing valuesall codesgreaterthan or equal to 97. all the caseswill be excludedbecauseall casesfor which incomewasreportedhave beenrecodedto valuesin the thousandsof dollars,that is, greaterthan 97. If you do not rhink this will happento you, wait until you ffy itl It happensto all of us. The trick is to ;atch logically similar, but more subtle,errors before you constructentire theoretical edificesunon them.
80
Quantitative Data Analysis:Doing SocialResearchto Test ldeas
WHATTHISCHAPTER HASSHOWN
fi::ffi:iff ffiff"#HT.: :i,ffilx"::.;:'*;:T ili:i"i'fifJtlTl?'tff
data manipulation and the treatmentof missing datalThe ct up*. ,t o, ,"*", us a founda_ tion that^shouldmake it easy to leam any statlstical packug" p.og;urn_Stuta, which we 'SPSS will use for the remainder of the book, oi any ottrer p;kag?ii"ir'". SeS . In the next chapterwe tum to the gen"rj he". _oA"i r"l f, u g"o,l" inooduction .. via a discussionof bivariatecorrelationandresression.
APPENDIX4.A DOINGANALYSISUSINGSTAIA TIPSON DOINGANALYSISUSTNGSTATA This appendix offers some simple tips that will greatly enhancethe easeand efficiency with which you use Srarafor analysis. In additio'n, ,h; ;;;;; iir,, some parricularly useful commandsthat are easily overlooked.
Do Everythingwith -ao_ Files You should from the outsetdevelopthe habit of carrying out a// your analysisby creating commandfiles, known in Stataparlanceas .._ do_ nt"j, Oologio-lus two major advan_
torepeatyour untilyougetit .i!r,t, _a ii _utJJ t; ;;; :19^:::tj-T1": :asy Keepins analysis oocumentyourl work. a log of your analysisis nit an adequatesubstiiute
(although,of course.you must-create- _1og_ afile io ,uua yo* output) becausea log faithirlly records all of your enors and false s-teps, makir! ii iiti*i a r" ow rhe direct path to successfulexecution and tedious ,o ."p"u, yo* u?rA;;;"." rs an example of part of_oneof my -do- files, shown to suggesta standardformat you might want to adopt.I usethis set of commardsat the begiriring of eactr_ao_ fite f create.The com_ mandsin the file are shownin Courier type,andmy commentsrn squarebrack_ .New ets are shownin Times New Roman type (the standardfont ior the text). capture
1og close [This commandclosesany -1og_ file (seethe next command) it finds open.The -captureprefix to a commandis very useful because it instrucm Stata not to stop if an ,,error,,is encountered_whichwould be the caseif it could not find a - 1og- flle to close.l
1og using
class.1og, replace [This command te]ls stata to keep a file of commandsand the results of the commands,calleda ..- log _ fiIe,,,andto replu"" *y pr"uioo, u"r.io-osof the _1og_ file. The - replace - part of the commandis crucial becauseotherwisewhenyou execute
On the Manipulation of Data by Computer
the -do- fi1e,fix an enor, and try to executeit again,Statawill complainthat a previousversionof the - 1og- file exists.l
I SOme
rgic of Dundaich we
81
*-elimit; [This commandtells Statato end all subsequentcommandswhenevera ";" is encountered.I find this the most convenientway to handlelong lines. The default in Statais to regarda carriageretum (the computercommandthat endsa line) asthe end of the command, which means that, unless the cariage retum is "commented out" (see below), commandsare restrictedto one line. Of course,the line may be very long, extendingwell beyond the width of a page,but this makesyour file difficult to read.l
:
lon vla
-i=:s ion 10.0; [This command tells Stata for which version of Stata the file was created. Stata always permits old - do - files to run on more recent venions of the software, if the versionis specified.l ;iency ularly
eaf,ng dvanasyto ctitute a log direct ple of &ntto comrack-
:-:
more 1; [This command tells Stata not to stop at the end of every page of the output. When executinga -do- file, you want the programto run completelywithout stopping. The way to inspectthe oulputis to readthe log file.l
fThis commandclears any data left over lrom a previous attempt to executethe program or any other Statacommand.Statais good about waming you againstinadvertently destroying data you havecreated.But the fact that Statawams you meansthat you needa way to overridethe waming, which is what this commanddoes.l ---^r.h
dr^^
.l
l
fThis commanddrops any existing programsthat you might havecreatedin a previous executionof the -do- file. Failing to do this causesStatato stop if you have includedany programsin your -do- file.l s=t mem 10 0m;
: The a not r find
com' file.
lThis commandtells Statato reserve100 MB of memory.Spacepermitting,Stata readsall datainto memoryand doesits analysison thesedata,which is why it is so fast.If you specifytoo little memory Statawill complainthat it hasno room to add variablesor cases.l i:LASS. DO (D.lr iniriared 5/L9/99, :=-st revi-sed 2/a/Oe) i [I alwaysnamemy -do- file, and becauseI work often with others,indicatethe author,the initial dateof creation,and the last dateof revision.This is very useful
82
euantitativeDataAnalysis:DoingSocialResearch to Testldeas
in identifying differentversions of thesame _do_ file, which might exist because my coauthorsand I haveboth revised the samefile, o. L""u*" f frur" made a revi_ sronon my office computerand,have forgottento upOu,.-,fr"versronon my home computer, and so on. Note are distinguished'from commands by an asteriskin the first 'o*^ezls "oru-n.lnu' *Thls -dofile creates computations for a paper on literacy in China.; I always include a descriptionof the analysis the _do_ file is carryrng out. Because ove_r31111naea oaner perioa, *rJscriitiln ,sextemery ]-"11":11l :" " rrerprur rn Jogglngmy memory andhelpingme to locatethe correii fi1e..1 use d: \ china\ survey\ data \ china 0 ? - dta ; [This commandIoadsthe datainto memory. The remainderof the _do- file then consists of commands that perform ;;";;;;'in ,ir" ou,u and produce variouscomputations.l "rri;.
_rog close; [ This c om m and c l o : e s t h e - 11o9oo-
word processor.]
6 t c so e ^ that , h . r it i r can Lfile' ^ ^ _ be openedby my editor or
The basic
procedure for c (1)openanew'nreiil;;ilTljil:.ffi ;iil:.*,ffij*:;,*::;.:li!1.,; editor),remembering rhar_do-
ntes_must inctuoJtil (2) inserta front end.of thesortjust outlined i"fr^f "rr"rJl:,0o,, uflruy,lopy ,r"rn 1*t i', nl""l"* Iile to my current nle to minimizetypjng):(3) create a set of conmanas,to ou, the first task; "_ry
jTJTti,:ffihr; li"T,l'1'il:.i""T":'J.'l?"j'#::,-j; ;::#:,rjr# there surely will be an eror most of.th" ti_"1; fSl 6gg;".t
t" thi eOitor;
correct
the 16.y ffiE::"Hili:?lilljff;3'j?":ffi:*iflJ:"Jd':";;i;""'"-u"-n,ein
T::1.l,ry"+';'H:::,;1",'"1i.'#:J::l?',:1
of howyougotrheresu-lts showninrfr"_i""_ ni" _d (2)canbe ll:::,i"*.d .H"n. rerunat maywantto doif, as j1i_ tou rr"pp"i.=, Tl ,oT#r.r"", _ error in rhe "ri.,
iiftl{ii.ililfinT::ti::"J,"##!,'**i::r,i::* ffT."JJii"
you submit a paper for publication_ and get an invitation to ,t;;ie
and resubmit,,the
tion, :r'."il"".p;;";i;;;ri"oli""o.'n""..u.f ff:Tiff,:TJ,"*:HX:""::ff -do- file'rh" uuuituuinf
ota -do- firewiualsogreatl,.rJ.ffJi:;::"""Tt"*vour
On the Manipulation of Databy Computer 83 ECaUSe a rer ii bome f b\ aD
rause elptul
)ild
ln Extensive Checksof your Work
h s e-rtremely easyto make errors___of both a logical and a clerical kind_when doing .sourer-based dataanalysis.The only.way to protectyourself from happily makingui .Ede! aboutresultsproduced in error is to compulsivelycheckyour work. you can do fu .n two ways. Fhst, check the logic of each sit of daia transformation comnands by u.:rliirg through-as a pencil and paper operation-how each value of a variable being :rc-{ibrmedis affectedby eachcommand.second,tabulate or summanzeeachnew vari_ mt atd ac-tuallylook at the output.you will be surprisedhow many errorsyou discover :,a --rkiIlgthesetwo simplesteps!
fulment
ther duce
sto
;CT |oDt
|ent sk: ing md the all I mat he T if Ie Li
Your -do- FileExhaustively
!- shouldmakeextensivenotesin your _do_ file aboutthe purpose ofeach setofcom_ mrls andthe underlyinglogic----especially in the caseof datatranstbrmations. Includ_ -Ds'-ornmentssummarizing the outcome of each set of cornrnandsmakes it clear why I :m' out the next stepof the analysis.The -do- file then becomesa documentsu'ma_ s my entireanalysis.I cannotemphasize stronglyenoughtheimportanceof adequate ,ur:zmentqtion.It is qrpical in our field to work on severalproblems at once and to return r -r problem after months or even years. In addition, ttre eOltorial review processoften ni-- a vgry 16.t 1ime.Ifyou have-notdocumentedyour work, you may havea greatdeal r:ouble rememberingwhy you havedonewhat you have done.lhis is inefficientand :n, Lrehighly embarrassing-as when a journal editor asks you to do some additional ndysis. and you haveno idea why you madeparticularcomputatrons, much lesswhat fu .-hain of reasoning was, and cannot reproduce the previous results. This happens mrch more often than most of us want to admit.
Hude "Side" Computationsin your _d,o- File lb-: is a corollary to the point about exiaustive documentation madein the previous sec_ Lwe do ,,side"computationsin the courseof writing papers to makepoints or .gften ar illustrations to the aext-for example, computing th. .utio'oi t,"o coeificients in a rcie s e havemadeor compudng a correlation coefficient between two variableslisted in rne otherpublication.The way to make your _do_ file a comprehensrve documentof rf rour computationsis to use stata, rather than a hand calculator'or spreadsheet,to do the *,:rli: o1 at minimum,to includeboth the dataandthe resultsascommentsin your _do_ ire- -\[orethanonce,I haveproduceda paperwith a well_documented _do_ file but have r,]ed_to include side computationsin the -do- file, and then havedrscoveredmonths ;rer *rat I had no idea how the side coefficients reportedin the paper were derived. kntn Your -ao- File as a Final Check q: te point you havecompleted a paperand areaboutto submitit for a course,ibr Dost_ ls rn an online paperseries,or for publication,you should make a poinr of "*."iting -r,-cr--do- file in a singlestepand then checkingeverycoefficientin the paper againj b conespondingcoefficientsin your resultinglog file. you likely will be startleotloois;T er how many discrepancies thereare.Because- do - files oftenare developedover an
84
QuantitativeDataAnalysis:DoingSocialResearch to Testldeas
extendedperiod of time and often are executedin pieces, it is extremely easy for incon_ sistenciesto creepin. If you havea -do- file that will run from beginningto end,without interruption, and will produce eyery result you report in the paper,you will havemet the gold standardfor documentation.you also will be a happy camper months or years later when you need to make a minor changethat affects many results.you will discover that the change usually can be made in a matter of minutes-although updating your tablesby handis usuallya much moretediousbusiness.
Make Active Useof the StataManual The only way to become facile at any statistical program, including Stata, is to make a point of continuously improving your skills. Each time you are unsure how to carry out a task, look for a solution in the manual.you will find the improvement in facility very rewarding. After you becomereasonablyfacile at Stata,you should then take advantage of Stata's-net- commands,which link you to the Statausercommunityand the moit up-to-dateapplications.Of course,to usethe -net - commandsyou must be connected to the Intemet.
SOMEPARTICULARLY USEFULSTATA1O.OCOMMANDS Here is a list of key datamanipulationand utility commands.It is to your advantageto study the descriptions of these commandsin the Stata manual_in addition to reading through the User's Guide. The time you spendgaining familiarity with thesecommands-. and with the logic of Stataprocedures,will be more than repaid by improvementsin the efficiency of your work. I haveincluded few of the commandsfor carrying out estimation proceduresbecausethey will be introduced in later chaDters.
append by
cd codebook col l apse
Getsadjustedvaluesfor meansand proportions. Combinestwo data setswith identicalvariablesbut differentobservations. (Seealso-merge-.) Repeats a Statacommandon subsets of data. Capturesreturncode(thatis,allowsStatato continuewhetherthe cond! tion is true or not). Changesdirectory Produces a codebookdescribing the data. Producesaggregatestatistics,suchas means,for subsetsof data. Parlicularly usefulfor makinggraphs.Similarto the ,,a99regate,, command In 5 P5 5 .
compress
counc +del imi t
:---
Compresses variables to makea datasetsmallerbut withoutalteringthe logicalcharacter of anyvariable.Usefulwhenyourdatawill not fit into memory Givesthe numberof observations _count_ satisfying specified conditions. without a suffjx gjvesthe numberof observationsin the data set. Changes the delimitcharacter
On the Manipulation of Databy Computer 85 s-v for inconto end, with*'ill have met nths or yeals $ill discover pdating your
-=:-ibe ic 3:::
.-.j-:
is to make a r to carry out r facility very ke advantage and the most be connected
--:: ce : - : : -a ch
E : e :a ce
--
-'
e
::-=:ect
advantageto m to reading e commands, emenlsin the r]t estimation
::g
b,se rvations.
ra::< G=fe
\thecondi: e : S e a r ch
r'c omma n d fteringthe t flt into
-=ie! ; =:ji
6. -count:-acde :3:ame
ct
Describes the contentsof a data set. Displays file namesin the currentdirectory Substitutes for a handcalculator. Executes commands from a -do- file. Dropsvariablesor observations from the file. Allowsyouto edityourfile cellby cel. Usefulin inspecting the contentof yourfile or correcting errorsin the file. Extensions 10the -generate command. Permitsrecodingof stringvariables to numericvariables. RepeatsStatacommandfor a list of items(variables, values,or other enti ties).Similarto "do repeat"in SPSS powerful. but more RepeatsStatacommandfor a set of consecuuvevarues. Creates or changesthe contentsof a varjable. Obiainsonlinehelp.(Seealso-search, and -ner search-.) Readsdatainto stata.(seealso-inJix- and -insheet .) lnputsdata from the keyboard. Usefulsummaryof numerical particular{y variables, whenyou arenot familiarwith a dataset.Reports the numberof negative, zero,and pos! tivevalues;the numberof integersand nonintegers;the numberof unique values;andthe numberof missingvalues;and produces a smallhistogram. Keepsvariablesor observationsin the file-that is, dropseverythingnot specified. Usefulwhen youwant to createa new file containinga small subsetof variables. Creates or modifiesvalueand variablelabels. Listsvaluesof variables. Createsa log of your session. lVarksobservations (a way of maintaining for inclusion consistency regarding missingvaluesthroughoutan analysis). Mergestwo data selswith correspondingobservationsbut different (Seealso-append-.) variables. lnstalls and managesuser-written additions from the net. Searches the lnternetfor installable commands. Combinesnumerical valueswith labelsso that both aredisplayed. This often is very convenient. Putsnotesinto data set. Reordersvariablesin a data set. Oblainspredictions afteranyestimation command. Preserves data.Usethisbeforea commandthat will alterthe dataset,such as -collapse-. Thenuse-restore to restorethe preserved dataset. Performs Statacommandwithoutshowingintermediate steps. Recodes variables. Renames variables.
86
euantitativeDataAnalysis: DoingsocialResearch to Testldeas
replace
neplacesvaluesof a variablewjth
reshape restore #review
new variablesif specjfied conditionsare
.,'atand vice o.:lJ:I"';ffi:lffiJ:T.'o" versa lil' hevtewsprevious commands.Halr
save search s or t summari ze t abf e ltabulat e update us e
version xi
j;i:iil:::: :Hl:T :Htrt j# ff:::i,"::Y"xi:: ij._
Savesa data set. Searches Statadocumentation for
**"Pa* cu ar' m*l'",;:::;#ii:J"il;: 1;j;4m; {orlconrinuous
;;;ffi ;,;il:i;;Tri6 t'* produces one_ andr*"_*ri "fi
variabjes
1;];1';"""'* :;::j: :;;1i;[,T#it# $IT""j i:11,';,1'i,;,"J ;ffi:iffi;n*#:#r.:it "i"' :"J .#iFHl1:t*1 ". """*"xi:ii;n:;:iJI,:,"ii
5pecifies whkh versio",, ,,"u
"OOi,
ffi ;ij:"expans,on,;#;JTi,:"'rl:"J;:i:T;ffi:
ms are
CH APT ER
d rather b to
aularly
rk for axis use mmano).
INTRODUCTION TO CORRELATION AND R EGR ES S(TOORDt N NA RY LEASTSQUARES) TTIATTHISCHAPTER ISABOUT 3o tar we havebeen dealing with proceduresfor analyzing categoricaldata.We now tum I a powerful body of techniquesthat can be applied when the dependentvariable is an or ratio variable: ordinary least-squaresregression and correlation analysis. In -rtalchapterwe deal with the two-variable case,where we have a dependentvariable and fu e smgle independentvariable, to illustrate the logic. In the following two chapters we G2I q ith multiple regression,which is usedwhen we want to explorethe effectsof sevol independentvariables on a dependentvariable, the typical case in social science gearch.
88
euantitativeDataAnalysis: DoingSocialResearch to Testldeas
INTRODUCTION Supposewe havea setof dataarrayed like Father's Years of Schooling 2 12 4
13 6 6 8 4 8 10
_
this:
yearsof Schooling Respondent's 4 10 8 13 9 4 i3 6 6 11
What can we say about the rclationship
betweenfather,s educatronand respondent,s
much. Visual inspectio, of tfr",.'" :d.l:latr?n?.]{or tr weptot the rwo
i. q"nJrriioro'",r"".
However. variables "."f, in two-dimensional therelationship revealedwhenyou inspecrrheDlot(Figure ,i;;, ;l"';;-r#;f is 5 1),i irr;;;,"ry lvident thatthech'drenof highlyeducated farhersiendto behighly In rhissiruarion. we saythatthefather,sandtheresponO*tt "0"*"J,f,"_r?*s. Arthoushwe canseethattheiather,, "Ou"utioou." p "ri'iii, _*"r"*a. gd;;;;;;;;:;:;irare posrtivery related,we wanrto quanrifythe relationship cor_ ; ;;;;. il; we want a way to
scho.tins frf.yf,,?l;,f :i;i:***^:,::::,:":';:::,Fa,her,syears.f ---
Introduction to Correlation and Regression (OrdinaryLeanSquares)
89
Gcribe the character of the relationstripbetween the father's and respondent,syears of fuiing. How large a differencein the dependentvariable,yearsof schooling,would we qect on averagefor a personwhosefather'sschooling(theindependentvariable)differs by .- unit (one year)?What level of schoolingwould we expect,or predict, on averagefor person,giventhat we know how much schoolinghis or her fatherhas?Second,we want -$ l rav to characterizethestrengthof the co-rclalron,or conelatbz, betweenthe resDondent's .d farher'syearsof schooling.Can we get a preciseprediction of the respondent;slevel of r*r-rion from the father'slevel of educationor only an approximateone?
THE SIZEOF A RELATIONSHIP: QTJANTIFYING IfGRESSIONANALYSIS
Lrespondent's ive. However, elationshipis that the chil&is situation, oted, nsitively coriant a way to
Ihe conventionalald simplest way to describethe characterof the relationship between rro variablesis to put a straight line through the points that ,.best' summarizesthe average daionship between the two variables. Recall from school algebrathat straight lines are 4resented by an equation of the form
Y:a+ b( D
drrc a is the intercept (the valtrc of Y when the value of X is zero) and b is the slope (the imge in yfor eachunit changein X). Figure 5.2 showsthe coefficients a and b for our involving years of education (IJ and father's years of education (X). The figure --nple r e eraphic representationof the equation:
(s.2)
E:3.38 +.687(Er)
0
of Schooling
( s.1)
2
4
6 810 Fatherbyearsof schooling
12
14
Ff GURE 5.2" least-Squa years resRegression LineoftheRelation Between d khooling and Father'sYearsof Schooling-
90
to Testldeas QuantitativeDataAnalysis:DoingSociaiResearch
Here E indicates the expectedntmber of years of school completedby people with eachlevel of father's yearsof schooling(EF)on the assumptionthat the relationshipis lizear, rhat is, that each increasein the father's educationproducesa given increasein the respondent'seducationregardlessof the initial level; 3.38 is tl]tr,intercept,that is, the expectedyearsof schoolingfor peoplewhosefathershad no schoolingat all; and .687 is the slape, that is, the expectedincreasein yearsof schoolingfor eachone-yearincreasein the father's schooling.From this equation,we would predict that thosewhosefathershave 10 yearsof schoolingwould have10.25yearsof schoolingbecause3.38 + 10* -687:10.25. Similarly, we would predict that the children of university graduateswould have2.75 more yearsof schooling,on average,thanthe childrenof high schoolgraduatesbecause.687*(1612) : 2.75. U"U^uring the valueof the dependentvariablein a regressionequationfor given valuesof the independentvariableis known asettaluatingIlrc e
0
2
4
6 810 FatherbyearsoJ schooling
12
14
F,&URE 5,3. teast-Sgua resRegression Lineof the RelationBetween Years of Schoolingand Father's YeaRof Schooling, ShowingHow the "Errorof Prediction"or "Residual"ls Defined.
Introductionto Correlationand Regression(OrdinaryLeast5quares)
WHY USETHE "LEASTSQUARES" CRITERION TO
Dplewith hip is ftnse in the b. the ex687is the asein the s have10 : 10.25. 1.75more _ 687*(16 rfor given efficients is that we re sum of ed in this lhis critei$l person r father's specifled which are is sumof
91
squares"is not the onlyplausible criterionof "bestfit." An intuitively moreappealingcriteion is to minimizethe sum of the absolutedeviatjons of observed valuesfrom expected valJes.Absolutevaluesare mathematically intractable, however, whereassumsof squares have convenientalgebraicproperties,which is probablywhy the inventorsof regressionanalysis rit uponthe criterionof minimizing the sum of squarederrors.Theconsequence is that observations with unusually largedeviations from the typicalpatternof association canstrongly affect regressionestimates;becausethe deviationsare squared,such observationshavethe greatestweight. The presenceof atypicalobservations,known jn this context as high leveragepoints,canthereforeproducequitemisleading results. We will discuss this pointfurther n the upcomingparagraphs and in ChapterTen.
It can be shown, via algebraor calculus, that the following formulas for the slope and uercept satisfy the least squarescriterion:
cov(x,y) _ t(x-txv-t) ",_ var(X) l{x-x)'
= Ntg-.(t&(Dv) Ntx'-(tx,)
(5.3)
sf,
a:Y -b(x):4
f-r
-b
lx
(5.4)
N
ASSESSING THE STRENGTH OF A RELATIONSHIP: €ORRELATION ANALYSIS \n that we have seenhow regressionlines are derived and how they are interpreted,we ed to assesshow good the predictionis. Our criterion for goodnessof predictionor 4;lxlnessofft is the fraction or proportion of the variancein the dependentvariable that =a be attributed to variancein the independentvariable. We define
^
'fz_1_z-' - )
Years
ru
DETERMINETHE BEST-FITTINGLINE? Nore that,,reasr
5 - r y- yr ' l,r v
l t v - lf tu
T-.:l is, l, which is just the squareof the Pearsoncorrelationcoefficient,is equalto 1 fiinus the ratio of the variancearound the regressionline to the variancearound the mean r de dependentvariable.(The Pearsoncorrelationcoefficientis, of course,the correlaa.o coefficient you have encounteredin introductory statisticscourses.It has the
92
Quantitative DataAnarysis: Doings'ciarResearch to Testrdeas
aovantageof ranging from _ I to *1 dependingon whether two variables move
j!li:"j",1'"..,1x'x jfr:ffi,#I ;:T*"1';'*.,T;T::A":J: y#: ;LXtil"T* together
dependentvariable_that is, whe
* p,"ar"i,r,"'"a"i, #",i"T#'+:iii#li:""11y1"1"# iiir'"p
dependent variableis lhe leastsquares predicrion ofeachvair"i_,f,.,u,,o,, I and = thrscaseis illustratedin ra) of I 0: Figure5 4 *fr"" f,""*i.Og" .,r;.,.value of the indepen_
ffil#:i lifrJfJJiTfl"J;:l#,Ti;:1',:ilT""""11J o j;,",.","r"io1,hp u"tw".o
twovariabres .(;T;i_T,:,T?i:::i'"::XilllHfr """*;:ff::H;"iJ::il:j1::.n"t",,
"o,,.rutionu.t,""ni;;;ff
X.i"#trj:,;l:
jlix**j"*: :.:#;*jn*iii:*",*.11;X*:1,,*"1TH
mav beassociared witnu".yorre."nr,"rltffi,:'#,;"* ilJ,Hf,iiH":n.t;"i""J sronprovidesanadequate sumrnary .'.n*"rr"i,.""r, of u ."f u,ionffioni,
Y= 5.00+ 0(X)
0
represents the
22 20 18 16 14 12 10 8 6 4 2 0
Y = 5.76+ 0(X )= 5.76
(c)
5,4, reast-sgua yfI resRegression Lines for Threeconfigurations f f (a)perfect of Data: lndependence. perfect b) correhri,r, iiftn"ct Curvitinear Correlation-a parabolaSymmetncat "* to thex-Axis.
Introductionto Correlationand Regression(OrdinaryLeastSquares)
93
i ;novetogether square.)When ihe meanof the t r anabledoes he meanof the i slandl:0; rf rhe indepen.-.theratio is 0, ni o variables, r erample,the :sobviousthat . * hich reproen corelation Linearregresrepresents the
,-: a '
i -0 2(X) 8 10
-::-:.ter of the relationship. When it fails to do so, additional variables need to be : :, -led in the model. You will see how to do this in the next chaDter. Rerurning to oul example about inrergenerational continuity in educational attain_ \\'e note that t' : .536, which tells us that the variance around the regression line is : :half the size of variance around the mean of the dependent variable, and therefore -:,: -r :.: rbout half of the variance in educational attainment is explained by the correspond_ : -,u-iability in father's education. As social science results go, this is a very high , - eiation.
A USEFUL COMPUTATIONAL FORMULAFORr
rherol ?z
lvifg is a usefulcomputational formulafor the correlation coeffictent, r, which comes -andywhenyou haveto do handcalculations: '" N
ons of 'Jrvilinear
cov(X,Y)
N:Xv (:,xx>y)
94
Quantitative Data Analysis:Doing SocialResearchto Test ldeas
THE RELATIONSHIP BETWEEN CORRELATION AND REGRESSION COEFFICIENTS
Supposewe were to standnrdize our variablesbefore computing the regressionof I on X, by, for eachvariable, subtractingthe mean from the value of eachobservationand dividing by the standard deviation. Doing this produces new variables with mean : 0 and standarddeviation = 1. Then we would have a regressionequation of the form
i: a@)
(s.6
(The convention adoptedhere, which is widely but not universally used, is to represen standardizedvariables by lowercaseLatin symbols and the coefficients of standardize variables by Greek rather than Latin symbols.) There is no intercept becausethe resression line mustnecessarilypasstfuoughthe meanof eachvariable,which for standar&ze variablesis the (0,0) point. we interpret B as indicating the numberof standarddeviations by which we would expecttwo obseruationsto differ on y that differ by one standarddeviation on X. (This follows directly from the fact that for standardizedvariables,the standard deviationis one. Thus, one standarddeviation on x is oneunit on r; and the samefor y and y.) It can be shown,through a simple manipulation of the algebraiccomputationalformulas for the coefflcients,that in the two-variable case,r = p. It is also fue that r is invariant under linear transformations.(A linear transformationis one in which a variable is multiplied [or divided] by a constantand./ora constantis added [or subtracted]. consider two variables,yand I', withY' : a + ,(y ). In thiscase,r_,= r-.,.; So thecorrelationbetween standardizedvariablesand unstandard.izedvariablesii neceisarilv perfect. A convenientpair of formulasfor moving betweenb and B'(which also holds for multiple regression coefficients) is
p:b(&)=,:r(f)
(5.7
a=y _ b(X)
(5.8)
where s, and s, are the the standarddeviations ofX and f, respectively.
FACTORS AFFECTING THE SIZEOF CORRELATION (AND REGRESSTON) COEFFTCTENTS
Now that we seehow to interpret correlation and regressioncoefficients, we needto con_ sider potential troubles-factors that affect the size of coefficients in wavs that mav lead to incorrect interpretation and false inferencesby the unwary.
Outliersand Leveragepoints
As noted, correlation and regressionstatisticsare very sensitiveto observationsthat deviate subsaantiallyfrom the t)?ical pattem. This is a consequence of the least souares criterion-because "errors" (differencesberweenobservedand predictedvalueson rhe
Introduction (OrdinaryLeastSquares) to Correlation and Regression -- 10points, with(13.13) --- 9 points,omitting(13,J 10points, with(13,0) -
'onX, divid0 and
95
a
.9 1 E
-6
(s.6)
!l
f,esent rdized
Egresrdized 'nttons ! devimdard rland formuvariant multibr two ween lds for
(s.7) (5.8)
to conay lead
at devisquares ; on the
o tlGURf
2
,1*"., L.^",l*""Jl
12 14
5,5. rherffectof a singte-oeviant crri guignt"n"r"ge point).
dependentvariable) are squared,the larger the error, the more it will contribute to the wm of squarederrors relative to its absolute size. Thus, conelation coefficients can be xbstantially affected by a few deviant observations, with regression slopes pulled {rongly toward them, producing misleading results. To seethis, consider the following Erample, illustrated in Figure 5.5. Supposethat in our example about intergenerational educationaltransmission,the fourth casehad values(13,0) (shownas a solid circle surroundedby an opencircle) insteadof (13,13)(shownas an opencircle).That is, suppose ftat in the fourth casethe child of a man with thirteen years of schooling had no educarion instead of thirteen years of schooling-perhaps becausethe child was mentally mpaned. The alterationofjust one point, from (13,13)to (13,0),dramaticallychanges de regressionline and misrepresentsthe typical relationship between the father's and rspondent's education, making it appearthat there is no relationship at all (he regresiion equationfor the ten points with (13,0) asthe fourth valueis.6 = 6.74 + .0a91,(E"); ; _ .002). This exampleillustrates the condition under which deviant casesare influential-that ir havehigh "leverage." This is when points are far away from the centerof the multivariaredistribution.Outlierscloseto the centerof the distribution,for example,the (8,13) pointin Figure5.5,havelessinfluencebecause,althoughtheycanpull theregressionline ry or down, they have relatively little effect on the slope. We will consider this distincrironfurther in ChapterTen. The most straightforward solution is to omit the offending case.When this is done, fte regressionline tfuoughthe remainingnine points is very closeto the regressionline drough ten points with (13,13). However,this generally is an undesirablepractice becauseit createsthe temptation to stafi "cleaning up" the data by omitting whatever casestend to fall far from the regression surface. Two better strategies,which will be elaboratedin ChaptersSevenandTen, are (1) to think carefully about whether the outliers
96
DataAnalysis: Quantitative DoingSocialResearch to Testldeas
might have been generatedby a different processfrom the remainder of the data and. when you suspectthat possibility,to explicitly model the process;or (2) to use a robust regressionprocedure that downweights large outliers. Fortunately, the damage done by outliers diminishesassamplesizesincrease.However,evenwith large samplesexaeme outliers can be distorting-for example,incomes in the millions of d-ollars.one simple way to deal with extremevalues on univariate distributions is to truncate the distribution, foi example,in the UnitedSratesin 2006by specifying$150,000for incomesof 150,000 or $ above(this is what the GSS does;in 2006,just over 2 percentof the GSS sample had rncomesthis high); but this createsits own problems,as we will seenext. A bener way, which you will see in Chapter Fourteen, is to use interval regression(an elaboration of tobit regression)to correctly specify the categoryvalues.
Truncation are sometimestempted to divide their study population into subgroupson the ]+nffst_s basis-of values on the independent or dependentvariitti or on variables substantially correlatedwith the independentor dependentvariable. For example,an analyst who sus_ pects that income depends more heavily on education among those with nonmanual occupationsthan amongthose with manual occupationsmight attempt to test this hypothesisby correlating income with educationseparatelyfor nonmanualand manual workers. This is a bad idea becauseincome is correlated with occupational status; thus, dividing the population on the basis of occupational status will truncate the distribution of the dependentvariable, which, all else equal, will reduce the size of the conelation. More_ over, ifone subgroup,say manual workers, has a smaller variancewith respect to income than doesthe other subgroup,saynonmanualworkers (and this is likely to be true in most societies),the size of the correlation w l be more substantianyreducedfor manual than for nonmanual workers, thus leading the analyst to_misiakenly_believe that the hypothesisis confirmed. To-se9 thirs,consider a highly stylized example, shown as Figure 5.6. To keep the example simple, imagine that all manual workers in the sample have less than seven yearsof schooling and that all nonmanualworkers havemore than sevenyears of school_ ing. Note that in the example, there is exactly the same income retum to an additional year of educationfor nonmanual a:rd manual workers. Note further that eachpoint is an equal distance from the regressionline. Now, supposethe correlation between income and education were computed separatelyfor manual and nonrnanualworkers. The correlation for both groups would be smaller than the correlation computedover the total sample, and the correlation would be smaller for manual than for nonmanual workers. This follows directly from Equation 5.5 because,from the way the example was constructed, the variance around the regression line is identical in ail tl,,ee cases,but the variance around the mean of the dependentvariable is smaller for nonmanualworkers than for the total sampleand smaller for manual workers than for nonmanualworkers. Although, for the sakeof clarity, the exampleis highly stylized, the principle holds generally: whin distributions are truncatedthe correlation tends to be reduced.This, by the way, is the main reason GRE scoresare weak predictors of grades in graduate schtol courses: sraduate
(OrdinaryLeastSquares) and Regression Introduction to Correlation a and, r robust doneby me outple way don, for 0,000or ple had rcr way, ation of
97
20000
15000
10000
5000
0
s on the mntiallY who susnrnanual i hypothworkers. dividing n of the n- Moreo income e ln most nual than that the keep the |an seven rf schoolrlditional nint is an n rncome lhe corretotal samkers.This nstructed, : variance nn for the nough,for when diss the marn ; graduate
0
2
4
6
8
10
12
14
', 1 6
Yearsof schooling
F;G L;iig
5.S,
rruncating DistributionsReducescorrelations.
.hartments do not admit people with low GREs, thereby truncating the distribution of GRE scores.But this doesnot imply thatGRE scoresshouldbe ignoredin the admissions l-cuess, as statistically illiterate professorsargue from time to time.
OFTHEEFFECT OFTRUN-''L A "REALDATA"EXAMPLE CATING THE DISTRIBUTION
Analyzins theu.s.sampre forthePo^.Igl
.al Action:An Eight NationStudy,1973-1976(Batnesand Kaase1979)someyearsago, lwas ouzzed to discoveran extremelylow correlationbetweeneducationand income(lessthan betweenthesetwo variables is on the order .1,whereasin U.5.surveys the typicalcorrelation 3f .3).Furtherinvestigationrevealedthat the low end of both the educationand incomedistripresumably in eitherthe sampling truncated, asa resultof inadequacies cutionswereseverely When the datawere weightedto reproducethe bivariatedistri3r the field work procedures. cution of educationand incomeobservedin the U.5.censusfor 1980(the yearclosestto :he survey),the estimatedcorrelationapproximatedthat typicallyfound in U.5.surveys.
firession Towardthe Mean becauseof a pheof truncationactuallyareworsethanjust suggested, Tbeconsequences menon known as "regressiontoward the mean." When two measurementsare made at ,:iferent points in time, for example, prelest and post-test measurementsin a random;zed experiment or scoreson the GBE, it is typical to observethat those caseswith high rdues on the first observationtend, on average,to havelower valueson the secondobserrarion. and that those caseswith low values on the first observationtend to have hisher
98
Quantitative DataAnalysis: DoingSocialResearch to Testldeas
valueson the secondobservation.That is, both the high and the low valuesmove toward (or "regess toward") the mean. This is true even w-henthere is no change in the trae value betweenthe two measurements. The rcasonfor this is that observedmeasurements consistof two components:a true score and a componentrepresentingerror in measurement of the underlying true score. For example,considerthe GRE. The observedscorefor each individual can be thought of asconsistingofa componentmeasuringthe candidate,s ,,true,,(or underlyingor conitang ability to do the kind of work measuredby the test and a random componentcomprisedof variationsin the exactquestionsaskedin that administration of the test,the candidate's level of energyandmentalacuity,level ofconfidence(Steele 1997),andso on. It thenfol_ lows that thosewho havehigh scoresin any given administration of the test will dispro_ portionatelyinclude thosewho havehigh positiverandom components,and thosewho havelow scoreswill disproportionately includethosewho havelow randomcomponents. Butbecausethe secondcomponent,rrandom,thosewho have high randomcomponents on the first test will tend, on average,to have lower random coniponentson the second test and thosewho havelow random componentson the first test, will tend, on average,to have higher random componentson the secondtest. The resuit is that the correlation betweenthe two testswill be less than perfect and also that the regressioncoefficient relatingthe secondto the first testwill be lessthan 1.0.This is true evenif the meansand standarddeviations of the two tests are identical. An important irnplication of this result is that a researcher who targets fbr special . rnterventiona low-scoringgroup (thosewho did poorly on a practiceGnE, ttrosewitl row gradepolnt averages. andso on) will be boundto conclude,incorrectly,thatthe inter_ ventlonwas successful.Of course,if that sameresearcher chosethe high-scoringgroup for the sameintervention, he or shewould be forced to conclude that the intervention was completelyunsuccessful-indeed,that it was counterproductive. All of this is a simple consequence of analyzinga nonrandomsubsetof the original sample. E-xactlythe samephenomenon-measurement error_has the effect of lowering the correlation betweenseparatephenomena,for example,education and income, the heights of fathersandsons,andso on. This kind of observaionis what leJ FrancrsGalton,oneof the foundersofcorrelationandregressionanarysis,to conclude in the latenineteenthcentury that a naturalphenomenonof intergenerational transmissionwas a ,,reversion,, (or "regression")toward ..mediocrity,'-hence the term ,,regressi,on anatysis,,to describe the linear predictionprocedurediscussedhere.But what-Galton failed to notice is thar there is also, and for exactly the samereason,a tendency for valuesnear the meanto move away from the mean. The result is that the vaiancL of thepredicted (but not the observefl ualuesandthe slopeof the regressionline arereduced in iroportion to the complementof the correlationbetweenthe variables. lFor a book-teigth treatmentof this topic, seeCampbellandKenney[1999].)
Aggregation Studentswho havespentsometime studyingthe behavior of populatronsof individuals usually concludethat we live in a stochasticworld in which nothing is very strongh relatedto anythingelse.For example,in the United States, typically about l0 percentof
Introductionto Correlationand Regression(OrdinaryLeastSquares) 225
: toward l\e true s: a true |e SCOre. oughtof 0nstant) rrisedof rdidate's ften folI disproosewho ponents. rponents : second crage,to rrelation pfficient eansand r special osewith he interrg grouP don was a simple ering the e heights n, oneof :nth cension" (or describe :e is that mean to t not the the comrt of this
dividuals strongly Ercent of
99
175
€ d
125
100
58
60
62
64
66 68 Height(inches)
to
12
74
: i.: : ,:X n $.7 . rne rftect of Aggregation on correlations. '
:re variancein income can be attributedto variancein education(r - .3 + f - .Og). $udents are then puzzled when they discover that seemingly comparable correlations .rmputed over aggregates,for example,the correlationbetwggnmean educationand rean income for the detailedoccupationalcategoriesusedby the U.S. Bureau of the Cinsus,tendto be far larger(in the presentexample,r .7 .=t f - .49).Why is this so? The explanationis simple.when correlationsare computed over averagesor othersumaa''; measures, a greatdealofindividual variabilitytendsto ,,average out.,,In the extreme :".*e. where there are only two aggregatecategories,the correlation between the means :or the two categorieswill necessarilybe 1.0, as you can seein Figure 5.7 (wherethe :rve circle represents the meanheightandweightfor women,andthe largetrianglerep_ the meanheight and weight for men); but the principle holds for more than two -ents :elegories as well.
CORRELATION RATIOS 5.. l-arwe have been discussingcaseswhere we have two interval or ratio variables. Sometimes,howeveqwe want to assessthe strengthof the associationbetweena catesoricalvariableand an intervalor ratio variable.For example,we might be interestedin rhether religiousgroupsdiffer in thefuacceptance of abortion.or we might be interested :tr \\'hetherethnicgroupsdiffer in their averageincome.The obviousway to answerthese +estions is to computethe meanscoreon an abortionattitudesindex for eachrelisious voup or the meanincomefor eachethnicgroup.Bul if we discoverthat the meansJiffer ubstantially enoughto be of interest,we still areleft with the questionof how strongthe =lationshipis. To determinethis we can computean analogto the (squared)correlation .,lefficient,known asthe (squared)conelationratio, rf (etasquared). is definedas t'
100
DataAnalysis: DoingsocialResearch Quantitative to Testldeas ^2 _ | ' ,
= 1-
Varianceqround the subgroupmeans Variancearound the grand mean Within Rroupsum of sauures Total sum of squares
(5.9)
llt4,-t,i r ' \-\-rv
1J
1r \-
it
7 12 -
'
j'
where Iis the dependentvariable, there arej groups,and I caseswithin eachgroup. Thus. I.' is the meanof f for groupj, and I. is the grandmeanof L From Equation5.9,it is evident that ifall the groups havetlle samemean on the dependentvariable, knowing which group a casefalls into explains nothing; the variance around the subgroupmeansequals the variancearoundthe grand mean,and 4, : g. 41 ,1t" other extreme,if the groups differ in their means,and if all caseswithin each group have the samevalue on the dependent variable-that is, there is no within-group variance-then the ratio of the within-group sum of squaresto the total sum of squaresis 0, and 42 : 1. From this we seethat 42, like f , is a proportional reduction in yanance measure, Let us explore the religion and abortion acceptanceexample with some actual dataIn 2006 (ald for rnostyearssince1972)the GSSaskedsevenquestionsaboutthe acceprability of abortion under various circumstances: . . . should [it] be possible for a woman to obtain a legal abortion . . . r r
if there is a strong chanceof seriousdefect in the baby? if she is married and doesnot want any more children?
r
if the woman'sown healthis seriouslyendangered by the pregnancy?
r
if the family has a very low income and cannot afford any more children?
r
if she becamepregnantas a result of rape?
I
if sheis not manied and doesnot want to marry the man?
r
if the womal wants it for any reason?
From theseitemsI constructeda scaleby countingthe positiveresponses, excluding all caseswith any missing data. The scale thus rangesfrom 0 to 7. Table 5.1 shows the mean number of positive responsesby religion. All those who specifled religions other than Protestant, Catholic, or Jewish or said they had no religion were included in the "Other andNone" category.From the table, it is evidentthat Jewsandother non-Christians are much more acceptingof abortion than are Ctu.istians(Protestantsand Catholics). But how important is religion in accountingfor acceptanceof abortion?To seethis, we computeq2 : .070.(The Statacomputationsto createTable5.1 andto obtain areshownin 42 the downloadable-do- and-1og- files for the chapter.)
Introduction to Correlation and Regression (OrdinaryLeastSquares) .l01 TABLF 5,'l , u.rn Number ot positive Responses to an Acceptance d Abortion Scate(Range:0-7), by Religion, U.S.'Aduh;, 2O;.
(5.9)
leligion
MeanNumberof PositiveResponsesStandardDeviation
Catholics
p. Thus, it is evig which s equals p differ pendent n-8roup ri'],like |al data. accept-
2.5
tE* ts Other
2.2
ts' ,:,'
Clearly, religious affiliation does not explain much of the variance in abortion atti_ les. H_owcan this be, giventhe substantialsizeof tn" ,"om"."n""s? The answeris ;aple. Jewsand "Others,,differ substantiallyfrom prot".tunt" unO, Catholics = rheiracceptance of abonion.But thesegroupsarequlte small,especially ".p""ially, Jews. Hence, :c. matterhow deviant they are from th" *".u11 uu".ug", tfrey are u'nfrtefy to have much =ryact; when more than half of the popuiation is incluAed in on. group, as is the case :rre with Protestants,a large fraction oi the vari-"" in uUo.tion *'ceptance rs bound to - --= rr ithin-group variancerather than between_group variance. A seconduseof the correlationratio is to test assumptions of linearity.We will take up in ChapterSeven. -s
A USEFUL COMPUTATIONAL FORMUIAFO]
? formula to compute trom-frequency ?, OynanO orpercentage distributions i:
cluding owsthe $ other I in the ristians :s).But recomlown ln
,::\- llv:-l l i i
o *"0
x i,12 [L>:ti1 / l '
'
5-f
f
77',
wneretherearef groupsand I categoriesof the dependent variable,which in this caseis desig_ natedby X 50 Xi is the scorefor the ith category(of thelh group,aithoughthe caregoryscores are,thesamefor ajl groups),and /, is the numberof cases in the rth .u,"!ory o,nong,uro"r, of the/th group Noticethe difierencefrom Equation5.9, wherethe r refeisto inoividuars rather than to categories of the dependentvarjable.
Kl
102
QuantitativeDataAnarysis: DoingsociarResearch to Testrdeas
WHATTHISCHAPTER HASSHOWN In this chapterwe have considered simple (two_vanable;ordinary
teast_squares (OLS)
H?;ru"'"",'J:ff j *::kl*,.*#.i:l*#li# [..8i":!i;il'""fJ"fi is affectej j br,o"ii"*"i" o,,i"i"iili ll1.':g].:.'io"""{ficients
mn'i* xffis*{#jl_:"_t W'}i.#*:;;'y.;"i* gjtF:?.J"-4ru::;:f,1 ffi:l**i#fi,ltrl1"Ji'ff ;:nnl'*ffi#*1'T;#',""ri*#;#l
(or-s) im. the elation 6cally, to the oughly le then hisan ebuta nltiple r more
CHAPT I iT
INTRODUCTION TO MULTIPLE CORRELATION AND REGRESSION
(onDtNARYLEAST SQUARES)
WHATTHISCHAPTER tSABOUT h this chapterwe consider the central techniquefor dealing with the most b/pical social r..ienceproblem-understanding how some-ontcome is affected by severaldetermining Frriablesthat are correlatedwith eachother. we begin with a conceitual overview of mur=le correlation and regression,and then continu! ,ith u ,ortJ to illustrate Lrll to interpret regressioncoefficients.We then turn to "*arople consideration of the specialprop_ =ties.of categoricalindependentvariables, which U" in"tuj"Jlo multiple regrcssion 3luatronsas a set of dichotomous(.,dummy,') variables, "al one for eachcategoryof the origi_ ril variable(exceptthat to enableestimation of the equation, one categorymust be repre_ :entedonly implicitly). In the courseof our discussionof oummy variiutes,we develip a {rategy for comparing goups that enablesus to determine wheiher whateversocial pro_ -'esswe are investigating operatesin the same way for two or more subsegmentsof the population-males and females, ethnic categories, anOso on. We conctudewith an alter:atrveway ofchoosinga prefenedmodel,the BayesianInformation Coefficient(BIc).
104
QuantitativeData Analysis:Doing SocialResearch to Testldeas
INTRODUCTION For most social sciencepurposes,the two variable regressions we encounteredin the previous.chapter.arenot very interesting,exceptas a baselineagainstwhich to compare modelsinvolving severalindependentvariabies.Sucn moO"t J" ttr" fbcusof this chap_ ter Here we generalizethe two-variable procedureto many variables.That is, we predicr some (interval or ratio) dependentvadable from a ser of iniependent vanables.The logic rs exactly the sameas in the caseof two-variabre regression, excepl that we are estimatrng an equationin many dimensions. Let us first consider the case where we have two independentvariables. Extending the ten-observationexample from the previous chapter, ,rp'p"r"-r"" *i"t ,frat education dependsnot only on the father,s educaiion but also^on th" iru-i". ot ,iUUngs.The argu_ melt.is that the more siblingsone has,the lessattention on. i"""iu.. f.orn one,sparents /all elseequal),and hence,in consequence, the lesswell one doesin schooland, there_ fore, the lesseducationone obtains,on average(for examplesof studiesof sibship_size effectsin rheresearchlirerarure,seeDown"y tlsgsl, N4_uffi i06 , L"[2005], andLu and Treiman [2008]). Suppose,further, that we have informution on utf tn"" uariablesfor our sampleof ten cases: Father's Yearsof Schooling 2 12 4 13 6 6 8 4 8 10
Respondent'sYears of Schooling 4 10 8 13 9 4 13 6 6 11
Number of Siblings 3 3 4 0 2 5 3 4 3 4
Note that the first two columns are simply repeated from the examplein the previous chapter(seepage88). To test our hypothesis that the number of siblings negatively all.ects educational afianment, we would estimatean equation of the form: E : a + b(Eo) + c(S)
(6.1)
(Note that I use generic symbols, for example, X and f, b indicate variablesin equa_ .. tions of a generalform, but nnemonic ,y-toi., io, OS,to indicate variables in equations that refer to speclnc concrete "*r_pt",'U,ir, examples.I find ^it much easier to keeptrack ofwhat is in my equationwhenI use mlemonlc symUotstor varlaUtes.;
|---
(OrdinaryLeastSquares) 105 Introduction to MultipleCorrelation and Regression
d in the preto compare of this chaps we predict es.The logic I are esumats. Extending ut education Es.The arguone'sparents ,l and, thereI sibship-size 0051,andLu lariables for
Numberof Siblings 3 3 4 0 2 5 3 4 3 4
Equationssuch as Equation 6.1 are known as muhiple regressionequations.In rldple regressionequationsthe coefficientsassociatedwith each variable measure ft expecteddifference in the dependentvariable associatedwith a one-unit difference r 6€ given independentvariable, holding constant each of the other independentyarii,t-es.So in thepresentcase,the coefficientassociated with thenumberofsiblings tells us a. erpected difference in educationalattainmentfor eachadditional sibling amongthose rfude fathers have exactly the sameyears of education.Corespondingly, the coefficient rsociated with the father's education tells us the expecteddifference in years of educarn for thosewhosefathers differ by one year in their educationbut who haveexactly the re number of siblings. In the tbree-variablecase(that is, when we have only two indepodent variables), but not when we have more variables, we can construct a geometric that illustrates the sensein which we are holding constq.ntonevariable and -Fesentation simating the net effect of the other. h multiple regression,as in two-variableregression,we use the least-squares critem to find the "best" equation-that is, we find the equation that minimizes the sum of ryared errors of prediction. However, whereasin bivariate regressionwe think in terms r- fte deviation between each observedpoint and a line, in multiple regressionthe anahg is the deviation between each observedpoint and a k-dimensional geometric surface rherE t - I * the number of independentvariables.Thus, where there are two indepen&nr variables, the least-squarescriterion minimizes the sum of squared deviations of a::h observationfrom a olane.as shownin Fisure 6.1.
Dthe previous s educational
(6.1) ables in equas, to indicate nuch easrerto riables.)
012345 Number of siblinqs
Fi G i XA &,1" three-oimensional Representation of the Relationship Between and Respondent's )tnber of Siblings, Father'sYearsof Schooling, Yearsof Schooling OiwotheticalData;N = 10).
106
Quantitative DataAnalysas: DoingSocialResearch to Testldeas
M etric Regressi on Coeffi cie nts
Thecoefficientsassociated with eachindependent variableareknow fcients, or netregression coeffici)nts.(orsomerimes rau o,;;;-;;;;::;t;"::"#ri:;{;, to distinguishthemfrom siindardized ,"i"frr;;;;;,";;;;',;;Z;",r""wi'learn later).In thepresentcase,theestirnat"O " , ."gr"r.ion l;' "quati; E : 6.26+ .564(E _ .640(s) ") This equationtells us that a person
who had no siblings and whosetather
morc
(6.2)
had no edu-
[lF{,"#l!i,n'"","in:""ffi ry:fr.::,'"...:;,,",,### ::illiiki:r"]h***i,Til3:rTT
:itii,"#l!:i*1?rffi todifferintieirow"."h",ri;;;l;.;-;;;
;:Hf;"*:j:*".
oi"iar y"- 1p.".i."ry.
Note that the coefficient associated with the father,s education rn Equation 6.2 is smallerthan the correspondintct
#i;1.:'ffi1,_:':*iffill"X IT:,;"::;;i;il#:il:fl,':,!Tl,j.?'ff observed
m ract.-.503 in rhisexarn'le). rrrus.in equation ;.i.;;;fi. thefather's educarion on rheresnondenr., .dil;;li;Ji
nT 3ffii Hl#"*',H::l'l'r
effecrof ,iJir* *u, poortyedu_
{d;:;;;"d"'ilri'ies.tendtoso,ess
thisassociation andgives theeffeciorthe ru*,... t::9"tt"llingfor)thenumber "Jo"utiT;;;ii;fift::":T1or of siblings Theimptication .i,rrir'."rriij.ll1:,ol:-t11t
;i;;:"";Tl,ffiT#Jilijl:T;il:l#il1,[ij.,5 1"e.,"1,9!tJ"#;ffi
rn the equationwill be biased_that is, *ltt ou"r.t t" * u;;";;;" between
thegivenindependent variabl"Fqr;G;;;;;H;1""?;*0,,o t:fj-ut variableis uncorrelatedrvitri,r," illl,jlllft. xnown as specfficationerror or omitted variable bias. """"iri-iiL
*"
relation "ausat
thelimirins equation). Thisis
Someanatystspresenra ,*l:r^:_r^ y:*rll!t!"rno." multiple regression changes in thesizeo.fspecin"-"oefn"ieoir..".ulting "o_pt"t" 3^"_OllTl.9h":s fromtheinclul sron ot additionalvariabresThisis a s"mur" rou,"gy unc". oo-e'*-p"J"i'" the analystwanrsto considerhow the ,t eo erect of ,, "onoitroo: modifiedby rhe inclusionof anothervariable(or variables). onJ6r;;;;;;;tb;", rr,"i ri-_'" _"i.li analogous the searchfor spuriousor intervening ro "ro."r, rer"tirrrtf, ii crraprers 1r." and. Two the "i"r*ir?irl, Three), analystmight wani to investigate il;;;;;rlar relationship is or partlyexplained. by another ru"o'r.no. .*u.pr.."iiil", ,. observed ::lll::4 Jourhemers rha areresstoreranr of sociardeviants However'theanalystmaywarr to assess ,rrun*. p*.'[^ riuingou,rio. theSoutithepossibilitythatttrisreLionstripis (or taryely)spurious' entiretv arisinerromthe.facr thais"";;";;il";. Iess we'educared andlessurbanthanothers,ind thatedu"ution _o *U- *rli"i.J i"o.."u." ,olerance. In it would be appropriare io pres"nt trvo _od"f___oo"-.lg."rrrog,or"r_"" * :T._h"T.:residence Joutnem anda second.egreisingtot"ruo"" on iou-tfrJrriierioen"",education
(OrdinaryLeanSquares) 107 rntroduction to MultipleCorrelation and Regression
€?rtj.
x-e
tuels be x€ :l;... lis D'. ls. of
&ress tbe lss. de led loD in,s s rs lon
:lu0€n the ;t o iro )r s hat rrh. €l) Ied -ln ro n |on.
ml size-of-place-and then to discussthe reduction in the size of the coefficient rs.\ociatedwith Southernresidencethat occurs when educationand size-of-placeare rided to the equation. However, absentspecific hypothesesregarding spurious or medime effects,there is no point in estimatingsuccessiveequations(exceptfor models nsolling setsof dummy variables,discussedin the next section,or variablesthat alter imtional forms, discussedin the next chapter); rather, all relevant variables should be nluded in a single regressionequation.However,evenin this casethe analystshould resent a table of zero-order(two-variable) correlation coefficients betweenpairs of variri.ies. plus meansand standarddeviations for all interval and continuous variables and trE';entagedistributions for all categorical variables.Thesedescriptive statistics help the roler to understandthe properties of the variables being analyzed.In addition, as noted 3.rrlier,the zero-order correlations provide a baselinefor assessingthe size of net effects Tren othervariablesare controlled.
Tating the Significance of Individual Coefficients h :: conventionalto compute and report the standarderror of the coefficient of eachindemdent variable-although, as you will soon see,standarderrors have limited utility in :r caseof dummy variables or interaction terms. The convention is to interpret coeffi:renB at least twice the size of their standarderror as statisticallysignificant.This :onl'ention arises from the fact that the sampling distribution of regressioncoefficients :..ilows a l-distribution and that, with 60 d.f. (where the degreesof freedom is computed x -\ - k - 1, with ft the numberof independentvariables),r : 2.00 definesthe 95 per::nt confidence interval around the value b : 0. It is important to understandthat the :-{atistics indicate the significance of eachcoefficient net of the effect of ali other coeffi;rcnts in the model. Thus, when severalhighly correlated variables are included in the nrdel, it is possible that no one of them is significantly different from zero, although as a _:roupthey are significant(seealsothe following boxedcommenton multicollinearity). Some aralysts estimate regressionmodels involving severalindependentvariables, imp the variables with nonsignificant coefficients (this is known as trimming the regresrion equation), and reestimatethe model, on the ground that to leave coefficients in the nrdel that havenonsignificanteffectsbiasesthe estimatesof the other variables.How::|er. other analystsargue that the best estimate of the dependentvariable is obtained by -n^--ludingall possible predictors, even those for which the difference ftom zero cannot 5e established with high confldence.The latter shategyis preferablebecauseit provides a€ bestpoint estimatebasedon a setof variablesthatthe analysthasan apriori basisfor $specting aflect the outcome.
Standard ized Coeffi cie nts ,\ questionthat naturally ariseswhen there are multiple determinantsof some dependent ruiable is which determinanthasthe greatestimpact.We cannotdircctly comparethe coefn.'-ientsassociatedwith eachindependentvariable becausethey typically are expressedin lifferent metrics.Is the consequence of a differenceof one year of schoolingcompleted ofa differenceof onesibling?Although $ thefathergreateror smallerthan theconsequence 6e questioncan, of course,be answered-as we saw earlier, the cost of each additional
108
to Testldeas Research DoingSocial DataAnalysis: Quantitative
MULTICOLLINEARITY
correlated' variables arehighlv whenindependent
a condition known as multrto//,nea,ty,regressioncoefficientstend to have large standard of errorsand to be ratherunstable,in the sensethat quitesmallchangesin the distribution (1991 1 1; notes As Fox , the coefficients size of produce in the largechanges the dala can variable,./' an independent error o{ seealsoFox 1gg7, 337-366\,the inflationin the standard is given by 1\1 - Ri),where Rf is the coefficientof determination due to multicollinearity, of variableion the remaining with the regression (discussed laterin thischapler)associated and can be computedin factor inflation variance the independentvariables;this is known as (SeeFoxand Stataby usingthe -estat vif- commandafterthe -regress- command suchasa setof dummy variables, to setsof independent MonetteI19921for a generalization in chaptersevenof thisbook,in and itssquare;seealsothe discussion variables or a variable ") Transformations. the sectionon "Nonlinear to be for multicollinearity must be quitehighlycorrelated variables clearly.the independent quadrupled' and an importantproblem Forexample'i! Rl:75, the errorvariancewill be R;'s as largeas .75 are quite uncommon, the standarderrorwill thus be doubled.Because in mainlyarisingin situations sciences, problem social in the a is not often multicollinearity model a single in are included concept measures of the sameunderlying which alternative and most commonlywhen aggregateddata, suchas propertiesof occupations,cities,or nainto solutionis to combinethe measures a reasonable In suchsituations, tions,areanalyzed. a multiple-itemscale(seeChapterEleven). Someanalystsattempt to minimizemulticollinearityby employingwhat is known asstepwse in which variablesare selectedinto (or out of) a modelone at a time, in the order regression, that producesthe greatestincrement(or the smallestdecrement)in the sizeof the R'?Such methodsare generallymisguided,both becausethey are completelyathoreticaland because the order in which variablesare selecledcan be quite arbitrary,given the previouslynoted arehighlycorrelated' whenvariables coefficients ln regression instability
sibling is somewhatgreater than the gain from each year of the fatler's education-the answerdoesnot tell us which variable has the strongereffect on the dependentvanable becausethe variance in the number of siblings is much smaller than the variancein the father's years of schooling. If it is not obvious why the size of the valiance mattels considerthe effect of educationandincome on the valueof the car a persondrives.suppose that for a samDleof U.S. adults,we estimatesuchan equationand obtain the following:
500(E) v - rs,ooo+.s1r;-
(6.3)
We would hardly want to conclude flom this that the effect of education is 1'00 times as larse as the effect of income, or to measureincome in unis of $100 and then to f
I
(OrdinaryLeastSquares) 109 Introduction to MultipleCorrelation and Regression fted, dard nof ,1 1; *e,L mon nrn9 ed In ia n d mmy x, In
bbe , and mon, ns in tooel r nai Into
,u,/ise order Such tause roted
tion-the lent varirriance in e matters, i Suppose Dwing: (6.3) l is 1,000 trd then to
$clude that the effect of educationis 10 times that of income.Actually, the equation nlicates that a year of educationreducesthe (expected)valueof a person'scar by $500, of income,whereasa $1,000incrementin incomeincreasesthe (expected)valueof a -t luson's car by $500,net of education.ln this precisesense,a year of educationexactly d'=ts $1,000in income.However,a more generalway to compareregressioncoeffiis to transformtheminto a commonmetric. -ntsThe conventionalway this is doneis to expressthe relationshipbetweenthe depenieirt and independent variables in terms of standardized variables-that is, variables rrnsformed by subtracting the mean and dividing by the standard deviation. Because uh variablesall havestandarddeviation: 1, the regressioncoefficientsassociated with *andardized variables indicate the number of standard deviations of difference on the ft?erdent variable expectedfor a one standarddeviation difference on the independent r:riable, net of the effects of all other independentvariables. In the presentexample,the i{uation relating the standardizedcoefflcients-that is, the standardizedcounterpafi to E4uation6.2-is j-.601(et)-.260(s)
(6.4)
R.eminder:As noted in the previous chapter,there is no intercept becausestandardized rsiables all havemean = 0 and a regressionsurfacemust passthrough the mean of each r:riable.) From inspeciionof the coefficientsin Equation 6.4, we concludethat the irher's educationhas a greatereffect on educationalattainmentthan doesthe number of nalngs-a greatereffect in the precise sensethat a one standarddeviation difference in ir father's years of schooling implies an expecteddifference of .60 of a standarddevia:.-'n in the respondent'syears of schooling, whereasa one standarddeviation difference n rhe number of siblings implies only a -.26 standarddeviation expecteddifference in yearsof schooling ile respondenl'b Note that in practice we do not ordinarily standardizethe variables and recompute ::e regressionequationbut rather instruct the software to report standardizedcoefficients usuallyin additionto metric coefficients).Becausestandardizedcoefficientsoften are f,!'t reported,particularly in the economicsliterature, we also can make use of the relation 3 ,: bo\r/s")-ahat is, the fact that the standardizedcoefficientrelating independent r3riableX to dependentvariableyis equalto the metriccoefficientmultipliedby the ratio lf the standarddeviations of the independentand dependentvariables-to convert metric -",.Standardized coefficients(or vice-versa).(RecallEquation5.7 and5.8.) regressioncoefficients.The conThereis somecontroversyregardingstandardized ientional wisdom in sociologyand other social sciencesis that they are useful for the Fvrposejust described-to assessthe relativeeffect size of eachof a set of independent rrriables in determining someoutcome-but that they are inappropriatefor assessingthe relativeeffectsizeof a givenvariablein differentpopulations,preciselybecausethe standardizedcoefficients will differ if the relative standarddeviationsdiffer in the populations
110
Quantitative DataAnalysrs: DoingSocialResearch to Testldeas
standardized regressioncoefficielt in the two_variable case.)For example,supposerre wanted to compare the effect of the number of siuring. on among Blacks anti ir U. States.Suppose,turther, ,f," ,f,.-."oi" "iu"iiion ."glsron coelficient relaF Yj:: T" "fted to the tng yearsof schooling numberof siblingsis iaentlcatior-slacks and whites, thar the standarddeviation of yearsof scho"ri"g r"t"nr""t. rdentical, but that the standarddeviation of number of siblings iJlarger -a-fr-ri"Js for Blacks thai"for whites. under the= cfcumstancesthe standardizedcoefficient relating the nu-u". or siblings to years of
qsobelargerfor Btacrstnanrorivnii". iair?irom ooectlyfrom :::t]rg.,r?rtq the mathematicar relationbetween
the standardized andmetri.i"g."Joo .o"ffi"ients shoul in Equations5.2 and 5.g).Would we really want to con.tua""tfruilt nu-ber of siblings has a strongereffect for Blacks than fot urrtr". " in a","t-iJijil. ,nu"t ."r,ooling thel get if the "cosr" (in termsof vearsof schooling) of eachuJJi iorJ riuring rs identicalfor probablynot. Ho*"n"" ,i"r" *" it 3.1"1:lr,--o*tl"r? ii". *"-p", Hargins1976r who arguethat it would be meaningfulto "* ,ir" say that .iU.nip _uit".s more fbr Black preciselybecausethereis more variibility in rhe sibshif siz"rlfslu"t tu- r".. Additional light may be shed on-this poin, Uy'"o_parln! the interpretationof standardizedand unstandardized-coefficients .i,hi; ;-;i;dr":^mple. In an analysis ofeducationalattainrnentin a 1962US. nationatrepreslri"ii"",""*pr", n"verly Duncaa (1965,60, 65) showedthat the cost of coming f.o_ u nonirrtu"tfu.ily was very high_ a year of schooling, net of a rarge numi"r of othe. f;";. lbout ;;."r"r, the standard_ ized coefficientrelatingeducationto family intactnesswa, ."l"ii""fy *"*, .09,far trom the largeststandardized coefficient.ito." "fout ,t iro 1"."i1, o, reconciled? The fact is.thatthereis nothing inconsistentabout "_ them.The"r" m"t i. inocates that for the relativelyfew personsfrom non_intact families (these*" "o"E"rent auiujio_ 1962),the cosr was very substantial'But the standardized coefficieni indr"ut". tt uiru,o'y intactnesswas not a very important determinantof variance in educationaL"ilirir*,, p.""i."ly because only a relativelysma' fractionofthe sample wasfrom non-intactrannities. civen thenear f*rily
inrachess variabti, it r,*oty of thevariabilin ::i::T:-f "f F.aflainment. rn educalional "oura "*fiuiimluch
K!
VARTANCE IFHTApI$"^n-EqAt?llg__rHE oF DICHOTOMOUS VANIAELTS variabre. Asyou the standarddeviationof suchvari_ ''irrreca,,,", ",",1f.ii,"t"*.,,,1"fi:;l:T:'"il:::i:::lT::: (whichevu|" .u,usofis,o uvr
T: H* Yll..fl"f-t'"l,,positive,, ,{:.fl--:l^tly:, themore thedisrribution,
I vr
)uLl|
vdtf
oerinea). el l neo/. rnut Inat t5, i,,
thatii, thefurtherrrdeparrs from thesma-skewed erthestandard deviation and hence the smaler rrroflcr (t_ tne ure >ld standl .l^f,i^tl,,ll:l l"n:tive, ::*:1^.::tl':,":,
.r
i!
vr yo r
!r
Iu l l
Because for dichoromous variables the sizeof standardrzed r r u s u lcoeffjcients uc | l r Ltet t15
of themerric coefficient burarsoon theproportion of the ::::?::.T,.:l fi,,positive" ll":o"attribute, jt
::T,-::lt-n,]n" coefficients for suchvariables.
4-
ir rn*r" to,"tl ilJ;;i;;ffi;; seneraly
(OrdinaryLeast5quares) '111 Introduction to MultipleCorrelation and Regression Ee we ks and I relats, that hat the r these :ars of om the shown iblings rg they ical for r 1976) Blacks tion of malysis )uncan highrndard.09,far d? The that for fte cost esswas because thenear riability
)F IOUS
Yarift is, hom andBnts It n e lized
Cefficient of Determination (R2) Id!.g well doesEquation 6.2 explain the variancein educationalattainment?We determine trr r-ia an exact analogy to l, known as R2,or the coefficient of determination, which us the proportion of variancein the dependentvariable explainedby the entire set of -dlrs nlEpendent variables.Just as for f, R2 : 1 - the ratio of the error variance(the variance
A FORMULAFORCOMPUTINGR' FROMCORRELA-?, TIONS A convenient formulafor computing R, froma matrixof correlations ,"d Iq 5iandardized regression coefficients is
Rtr,, .r*:Dr,,,Fu, Thatis,B'?canbe computedasthe sum of the productsof the correlations betweeneachof :he independent variables and the dependentvariableand the corresponding standardized r F r l r ac< i.,n.^ a ff i.ia n r <
ADJUSTED
R'z
whenthenumber of variables included ina modet istaroe reta-?zI
iiveto the numberof casesin the sample,the explained variance is necessally laJg"b""."ur" $ ihe amountof information usedin the explanation approaches the amountof Information to be explained. To correctfor this.mostcomputerprogramsreportthe "AdjustedR," as well asthe ordinaryR'?. Theformulafor AdjustedR'zis
n,_r_ rr_ n ,l ,y l ,rl rrJ whereAiis the numberof casesand k isthe numberof independent variables. lt is clearthat ask approaches N, R;. getssmall;indeed.it canbecomenegative. Theproblemof overfitting the dataonlyariseswhen samples are quitesmall;but in suchcasesthe AdjustedR, should be taken seriously. However,the ordinaryR'?shouldbe usedin testsof the signlficanceof the incrementin R'z(discussed laterin the chapter,in the section"A Strategyfor Comparisons AcrossGroups").
a .t .t
I tZ
euantitative DataAnalysis: Doing SocialResearch to Testldeas
gmsffi*ff-*l;ffi
ffwm# c |l
Il
I
*gu$*'s'**m*$m
a
& il
C
rt ';::::::,i;:,:::::::7::;:,:,,;:;;,:,",!,!1,:,!i:ii1;JJ? ru! :,1. p, ex :"r; ";::::;:;::ni^::xr*_ ana,. n.r,he f!i;;;:1:J:: r:c, I fl
'i:,::!vr;w:t:::i;L!,:;:i':ii"*,xx: qr
tr j1ii:."::,,u,",'-u,i)uu",J"':::::::::::l! uod ;,! "i!i!!li!l?;il'"',!ff ::r:::::!:"il:::;:;:";,;,,;;y ;;3:P;;:,:;:::;f Gc
stalus arlribures ro." iilii"'#iffi::"',;;;;;,;:..j,:::,;XT'1.];::HlT,';,j,:f:#,i"j!iJ::::Hg "o"''uJ.. .".'oi".t .],,'jl']#J[il.::*o Fodor Iee6, ani t^r::!:ro ,::, of Estimate (RootMsE)
IU6!t llllr f
Mtm fiutul ot r iiq-r
#H::,ffili,ffi1'"ffi *,:"xrx:hl:-::::,:ljffiT.di"l1ffffi ,
n
nu0[: mlh
ltutD]][|
Introduction to MultipleCorrelation and
Regression (OrdinaryLeastSquares) 113
tx preseF f or pendent itsjoint tion 6.2 m eduAcross ix now asethe ready I slarus uales" Iauser ment, of the t were rding think I edu)anln ttaine not Blau I
:
(6.5) r bereiy'is thenumberofcases, k
*l;u;ry,nnr.*:x*h:tf.q*n",x'"i.fi1,".;:"T,1
ri.iifil:l:JsTx;::ml':*,*ri] [T*?]}"":Tff F,*.l'"T:T"fl jjj"gl ffi,;:fr; s*HTtrJ#T".,H:,n::Hly"i:Tlt,iT;:::,ffi ..,-pr",,rsp".",i"i#J#:1i"F:1llT.j:dT,fl :;a#:;ffi J*:Ttr"lT
:triff"it;ffi:il::t$;r:1.;il,*'stohlewithiir.si";'il;,ih"regressionsurrace isthatthe'r.e.e. isnotsensitive totherelative size
r ,r3ixl:iltJ,t#f#Tff"il::2
;:il#".:tlx#;l*:f Tffi;flt j:'*#,Tffi 3Jlil"#:f :tHffii{; A-WO-RKED EXAMPTE: THEDETERMINANTS OFLITERACY IN CHINA Let.us_workthroughthepresent
:j*#g*#iX,;:'ffr#X*1'i:'{itiqff i;,::"T:']"J;r",'#:;?JJi,:l ll,:f;i."li:"rif :*:::*nf,*j:,,,1"",S:il1llf I :"fr:ijFi$'tfil -3",T,:.S:*ffi:ii"il#,TJ,iffl:T"'ii:ml,'"',1;:l bedownloaded fromthecourseweb site).A surveyof thepoputution lg96 or tr," f-lT
ji:;l-'*;.i:*::l#,#*iil#$h*I.*'.:"trq;x.: '{;fli sc-ioo-r'iog -" H"J"fniil::llXltfl#l'::':ase inw",t".nution.. infacr,measured interms ofthemrmber ; "h,';;;;;;g,,)"4'd]:1]i!"#:r;:,:$T withaddition-ar
ting ally and
I,::?:,."":,#;;;;;;;lT::dj/*iffi #:$i,:#$Til"_",".1T:::[
:,#;,i;:",,.*'..J::l}if j:t# :d{Tiin::i3lJff ilJ"ff #..lTi,."1il i g n *. pr iy'in.'r.** anda ...1; *, :X, ;:liffi
:t^:',1*r
:i'i, wtren,t. ramitr r".oJ"il", *ri;X:;t
of
l:
T:.'j't*
measu
",J readingwasimponant re rowhich in the
,iliffi:::ll.fi ,jJHT:tl *#1T:":{i:fi ryTi",:*:1$XilllJJl:iilf jffi[::,:: [":T##'.T:.
ffi
:xJ:n*k*.1:#yr,:1,nfu:ffi:
114
euantitative DataAnalysis : DoingSocialResearch to Testldeas
;:xTlr..?lJ::f#f"ffJ:;T*,:::,*.libraries aremore rikery toexrsr andtocontain
.*fi**$Nn****r
ffi*,mffiffi*
ii#trp,;* $$$$"}i#*ffihlrf
h'*fr iffi fr *"i*jiilt*tti*"*inltffi'f i;:Tfti,id",T"},..;;,.x",f;Jm S;1:;:#i'"",T"'.ffi
ru*#;Hj:,#ffiJ;,J,[.;,# #},[#r;,rn #Tn.li
Nf":#:{t*i*?iiil.i,ii;i"r:f *y.1,tr3r!,,,.,A "fi,n l,:.m r::,l,..;:rt::"riiiliffii[Ti, *:;l] *:l in tt'. o",t ;ffi#Tffi:fff i1lil^:*" ouine ro,"",-u,Jl'uuo"' "0",t "*ry,uo npm#:: il:'#;fu ff;:il' il#*ftp;i,*il"1 :
.,l":x I:Hil:ffi:":*l} i{"""J:##: :::r:h##T: }ff I
(OrdinaryLeastSquares) 115 Introduction to MultipleCorrelation and Regression :onuln rteracy ccuparequire med in jobs. inantthan of esover side of leamed hin the quiring n-suishheva aYerage iearsof nts);18 percent pondent )ndents. r. I also ns were eswhen rnberof vearsof
.eole ra y s TT]Aii on
oout here 'cent na .s of ;grks
-
' l. I 6..1 . M".rr", StandardDeviations,and CorrelationsAmong Variables Affecting Knowledge of Chinese Characters,Employed Chinese Adults Age 20-69, 1995 (N = 4,802), M
EF
.397
.400
.331.
,z+/
.4tJ
.341
.216
.514
.368
.030
.327
E: tathersyearsof schooling \i: Nonmanual occupationb
,.,r Ny'ale
'.1ean
030
3 .6 0
6.47
3.O1
.177
.180
.558
.227
-:rtems, in ncreasrngorderof difficulty,areyiwan (ten thousand),x/rgmng (full name),iiargshi(grain), -.'thu \fundon), diaozhu(catue),slrue (wreakhavocoTwanton massacre), qimao chuarmlu (erroneous), r::rgenarian),chl-chu(wa k s owly),and taot/e(g utton). ,:'ables N, U, and M are dichotomies, scoredT fof thosein the categoryand scored0 for thosenot in aategory. -_ 3scae isthe meanof standardized -_: scores for fivevariables measuring the behavior o{ parents whenthe '-:3ondentswere agefourteen:the numberof booksin the home,the presence of ch drensmagazines - r^e home,the frequencywith whlch parentsreada newspapetthe frequencywith wh ch parentsread ::-cus nonfc(ion,andthe presence oJ an atas nthehome. f informatlon was missing for an item,thai a:- was excludedfrom the average. The resuting scae was transformed to a 0 I metric that is, the :..1,t ,co'e ,s0 and Lheh qhestsLores I
Table6.2 confirmsthe importanceof yearsof schoolingbecausethe standard:zedcoefficientsfor yearsof schoolingin both modelsarefar largerthanthe standardized :crefficients for anyothervariable.Eachadditionalyearofschoolingproducesan expected rcrease of about.4 in the numberof charactersconectly identified,net of all otherfac:ors. This means,for example,that a universitygraduate(sixteenyearsof schooling) .r.ould be expectedto identify abouttwo morecharactersthanwould an otherwisesimilar . ocationalor technicalschoolgraduate(elevenyearsof schooling).
"t*$j:
il *.r1. Determinants of the Number of chinese characters correcfly ldentified on a Ten-ltemTest EmployedChineseAdults Age 2(H9, 1996(Standard Errors in Parentheses).. Variable
Model 1
Model2
.030 (.006)
.009 (.007)
Metric regression coeff i(ients
EFrFather'syearsof schooling
.255
.177
(.0s3)
(.054)
_o49
.015
C Levelof culturalcapital(rangeO_1)
5.e.e. Standardized regression .oefficients
FFrFathe13yearso{ schooling
i!
fl
tr
1 lt t!
rtl
C Levelof culturalcapital(range0,1)
I
tr aresignificant "Ailvariables at or beyond the.001levelexceptfor father'seducationin Model2 (p = .195).
I
€
ntroduction to MultipleCorrelation (OrdinaryLeart5quares) 117 and Regression
:,t-lill\illA!- P0if'\rTON TABLE 6.2
lz
Notethat both modelsin Table6.2 are basedon exactlythe samecases,the numberof casesshownin Table6.1.A comrnonerroranalysts makeis to presentsuccessive models basedon differentcases-allthe casesfor which completeinformat/onis available for the variables includedin that model.Thisis ill advisedbecause it makesit impossible to determine whetherdifferences in the coefficients for successive modelsaredueto the inclusionof additionalvariables or are due to variationin the samples. Moreover, formal comparisons of the incrementin explained varianceresulting from the inciusion of addi(presented tiona{variables in the next section)are not correctunlessthe moqetsare basedon the sarnecases.Statahasa command, . whichmakesit easyto ensure that all modelsbeingcomparedarebasedon the samecases.
I I
I t t)
I I
I I
l)
F,r I
|)
It.
I ,:' l/
r ::. I, r.' .: a
.::
i
l .r
'' l :,.:
t
I ..::
t: : ,
I i:: I ,,i I . 1 9 5 ).
Model I predictsthenumberof characters identifiedfrom all variablesexcept,.cultural In this model all coefficients are significantat the .001level.Net of otherfactors. --apital." iose with nonmanualoccupationsscoreabouta quarterof a point higher than manual a orkers,thosefrom urbanorigins scoreabouta quarlerof a point higherthan thosefrom rral origins,andmalesscoremorethana third of a point higherthanfemales.Clearly,all iese effectsarerealbut, with theexceptionofeducation,aremodestin size.Interestingly, ie father'syearsof schoolingsignificantlyincreasesknowledgeof characters,net of all otherfactors,althoughthe effect is very small (he expecteddifferencebetweenthose $ith themost-educated andleast-educated fathersis only abouthalfa character-precisely .5-l : .030*l8). Together,the factorsin Model 1 explainmorethantwo-thirdsof the variancein vocabularyknowledge,which is a very strongrelationship.Also, the standard errorof estimatefor Model 1, 1.25,tells us that95 percentof the actualvocabularyscores Iie within 2.45 points (-!'1-96*1.25)of the regressionsurface.It is instructiveto note how largethe error is. Evenwith a very high R, by socialsciencestandards, the casesare distributedover nearlyhalf the rangeof the dependentvariable.This suggeststhe needto exerciseconsiderable cautionin interpretingregressionestimates. The intercept,.579, is interpretedas the expectedvocabularyscorefor those with a score of zero on each of the independentvariables-that is, for rural origin females working at manualjobs without any schoolingwhosefathershad no schooling.This is not a very meaningfulvalue.Althoughin Chinatherearepeoplewho fit this description, in manynationsa personwith 0 scoreson all variableswould be beyondthe rangeof the obseNeddata.To achievea meaningfulintercept,it often is useful to reexpressthe continuousindependentvariablesasdeviationsfrom their mean.If this is done.the interceDt is then interpretable as the expectedvalue on the dependentvariable for people who are at the meanwith respectto eachof the continuousvariables(and,of course,havescores of 0 with respectto eachdichotomousvariable).In the presentcasesucha reexpression would give us the expectedvocabularyscore-in this case3.30-for rural femalesworkins
1 18
Quantitative DataAnalysis: DoingSocialResearch to Testldeas
at manual jobs (the 0 values on each of the dichotomous variables) who have average "of educationand whosefathershave averageeducation.Note that such a reexpression the independentvariableshasno effect on the regressioncoefficients, the standari errors,tbr .1R2, or the standarderror of estimate.Only the inrercept is affected. Model 2 includes "cultural capital" as an addiiional factor. The associatedcoefficient indicatesthat, net of all other factors,peopleraisedin households with the highest cultural capital, that is, maximally involved with reading, score almost a full polnr higher in their knowledge of vocaburarythan do people raise-Jin householdsminimalrv involved with reading. Although the explained varlLce is .igrifi";,it i;;;;;;; (i" the next section we considerhow to assessthe significance-of the rncrementin Rr). tlte-increase is hardly important from a substantivJ point of view. What is importanr is that the introductionof "cultural capital" reducesthe effect of father,seducationto nonsignificalce.This makesclear the reasonwhy, net of the respondent,sown education, knowledgeof vocaburaryis enhancedby the father'seducation: householdswitb educatedfatherstend to be more involved in readingthan other households.After the "cultural capital" of the householdis takeninto account,the father'seducationhas no additionaleffect on vocabularyskill. The "cultural capitarl'variable alsoreducesthe size of the "urban origin" effect, which indicates that parr of the advantage of urban origins is the tendencyof urban householdsto be more involved with reading than are otherwise similar rural households.None of the other coefficients is much affected by the introduction of cultural capital.
GraphicRepresentationof Results Sometimes,for easeof exposition, it is useful to graph the net relationship implied by the model between a given independentvariable and the dependent variaOle.this is easy m do. The trick here is to simplify the estimation equati; by substitutlng the means, or other appropriate values, for the remaining indelendent u*iubl". the one of interest ajld collecting them into the constant. This yields the "*""pt expected value on tre dependentvariableat eachlevel of the independentvariable, holding constantall other independentvariables at the specified values. The same procedure can be extendedto show separategraphs for each category of a categorical variable_for example, if we were interested in how the relationship between tlracy scores and years of schooling implied by Model 2 differed for males and females.For continuous variables the meanis a good choice of the value to substituteinto the equation.For dichotomousvariables we could substituteeither the mean or some suitable ;alue_for example,nonmanualworkers from urban origins. Of course,for dichotomousvariables, the meanis just the propor_ tion that is "posjtirze"with respectto the variable.Thus, if we substitutemeansfor qlcnotomousvanables,we are not evaluating the equationfor any actualperson_after all, one cannot be 18 percent urban or 56 percent male; rather, we are eva.luatingwhat are,in somesense,the typical circumstances of the population. To seehow the procedure works, Iet us evaluatetle equation in two ways: for nonmanual workers from urban origins, and for the mean values of these variables. In each case, we evaluate the equation separatelyfor males and females to create graphs thal
lntroduction to MultipleCorrelation (OrdinaryLeastSquares) 'l'rg and Regression have average expressionof hd errors,the
fu.'s separatelines for males and females. Considering first an equation evaluatedfor rumanud workers from urban origins, we have, for females i
[ciated coefrirh the highst a fuIl point lds minimally increased(in ementin R'?), t is important i educationto 5 own educameholdswith Ids. After the cation has no ducesthe size urban origins are otherwise , the introduc-
mplied by the lhis is easy to lhe means, or pt the one of value on the stant all other e extendedto rample,if we ; of schooling ssthe mean is I variables we manualworklst the proporfie means for person-after aluating what vays:for nonables.In each te graphs that
a+btE)+clEt)-d(N\
re(Ut+ ItMtJ
gtc)
: .546+ .393(E)+.009(3.07) +.21(1) +.177(1)+ .385(0)+ .866(.227)
(6.6)
:1.158 +.393(E) nl tbr males i - a + b(Et 1 ctEt|+ dtNt+ ?(u t + ftM )+ gta) +.38s(1)+ .866(.227) - .s46+ .393(E)+.009(3.07)+.21 (1) + .177(1) :1.543 + .393(E\
(6.7)
Having arrived at a pair of bivariate equations,differing only by a constant (= .385, t coefficientassociatedwith "male"), we can simply graph the equations.Figure 6.2 rir-rqs the graph, which makes clear the relative magnitude of the education and gender decn net of all other determinantsof vocabulary knowledge in China. Clearly, educann is far more important than gendet although within levels of educationthereis a small frderence favoring males. Now, supposethat instead of evaluating the equation for nonmanual workers from ulan origins, we evaluatedlhe equationat the meansof eachof the independentvariables :rcept, of course,educationandgender,becausewe want to displaythe effectsof these ro variables).Our equationfor femalesis then i - a + b(Et I c(Et t+ d(Nt+ e(U| | ftM)+ gla) - .546+.393(E)+.009(3.07)+.21(.171) +.r77(.18O)+ .385(0)+ .866(.227) :.839+.393(E) (6.8) ld for malesis i - a + b(EtL aEr't+ dN t- a[J )+ f\M )+ g(al = .546+ .393(E)+.009(3.07)+.21(.177)+ .r77(.180)+.385(l)+.866(.227) : 1.224+ .393(E)
(6.9)
Note that the only differencesbetweenEquations6.6 through6.7 andEquations6.8 Arough 6.9 are in the interceptsand also that the difference in the interceptsbetweeneach
120
QuantitativeDataAnalysis:Doing SocialResearch to Testldeas
t ffi q-
g
@ll
re {c .d * -&-
p !f
I
E
J f,r dz
x I
q
Yearsof schoolcompleted
f;€tinf 6,?: rxp".rea ruumber of chinesecharacterstdentified(Out of Ten) by Yearsof Schoolingand Gender,Urban Origin ChineseAdults Age20 to 69 in 1996with Nonmanual Occupationsand with yearsof Father'sSchoolingand Level of Cultural Capital Setat Their Means (N = 4,802). /votei Thefemale linedoe5notextend beyond 16because therearenofemares inthesampre with post-graduate education.
f@rl
ne iMli
dl pair ofequationsis identical.Thus,a graphofEquations6.g through6.9 would be almost identicalto Figure6.2 exceptthat both lines would be shifteddown.For this reason I do not botherto showa graphof Equations6.8 through6.9.Whetherto substitutemeans or otherspecificvalueswhen evaluatingan equationis a matterofjudgment that shouldbe decidedby the analyst'ssubstantiveconcems.
|[iF
r
a[]: MI 1m!@
owI
DUMMYVARIABLES often situationsarisein which we want to analyzethe roreof categoricalvariables, such asreligiousaffiliation,maritalstatus,or political party membership,in determiningsome outcome.Moreover,typically we want to combine categoricalvariableswith inferval variables,to study the effect of eachcontrollingfor the other.Thus, we need a way to includecategoricalvariableswithin a regressionframework. To seehow this is done,let us revisit the problem we consideredin the final sec_ tion of chapter Five, on correlationratios.Recallthat we wereinterestedin the relation betweenreligiousaffiliationandacceptance of abortion,andwe analyzedthis by estimating the meannumberof positive(accepting)responsesto a seven-itemscalefbr each of four religiousgroups(Protestants, catholics, Jews,and thosewith other or no relision)
rp qflu@lltrhdL
nmuo dtea {@ rfrnlfir|If,r
mr@e" fio@
b
(OrdinaryLeastSquares) ",21 fntroduction to MultipleCorrelation and Regression ftom the 2006 GeneralSocialSunrey(GSS)data.Here we explorea similar substantive goblem, but this time using data from the 1974GSS,becausethe resultsfor that year rE particularly clear-cut and hence more suitable for exposition of the method. (As an aercise, you might want to carry out a similar analysisusingthe 2006data).We startby €r$'erting the religious denomination variable into a set of four dichotomous variables, c for eachreligiousgroup,with eachvariablescored1 for personswith that religion nf scored0 otherwise.That is, we definea set of new variables(seethe downloadable - ic - or - 1og - file): R, : 1 if the respondentis Protestant,and - 0 otherwise R, : 1 if the respondentis Catholic,and : 0 otherwise R, : 1 if the respondentis Jewish,and : 0 otherwise R, : 1 if the respondenthas anotherreligion, no religion, or failed to respond, and : 0 otherwise 8
Variables of this kind are known as dichotomous or dummy variables. Using these ruiables, we can estimatea multiple regressionequation of the form:
tTen) n '-evel lewith
alrnost bnldo Fansor ould be
es,such ng some interval I way to inal secrelation estimatr eachof religion)
A : o +fi,n
= o + b2R2 + b3R3 + b4R4
(6.10)
stere A is the numberof"pro-choice" responses-thatis, positiveresponses to questions rbout the circumstancesunder which legal abortions should be permitted (in 1974 six nch questionswere asked,so the scalerangesfrom 0 to 6), and the R. are as specifiedin de precedingparagraph. Note that it is necessaryto omit one category from the regressionequation to avoid r linear dependency(the situation in which any one independent variable is an exact fonction of other independentvariables); becauseof the way dummy variables are congucted, with each individual scored 1 on one dummy variable and 0 on all the remaining variablesin the set, knowing the value on all but one of the dummy variables allows fErfect prediction of the value of the remaining dummy variable. In such situations OLS equationscannotbe estimated.Any categorymay be omitted, but because,aswe will see, fre coefficients of the dummy variables included in the equation are interpreted as deviarions from the value for rhe omitted, or reference,category it is best to choosethe referce category on substantivegrounds-the category against which the analyst wants to contast other categories.The only exceptionto the substantivecriterion is that very small categoriesshould not be chosenas the omitted category becausedoing so may create a nrar-lineardependencyamongthe remainingcategories,which could result in unstable numerical estimatesof the coefficients. EstimatingEquation6.10,we have
a ::.l s -.::1 n ,;+ 1.6( &)+.88( &) ;R' :.045
(6.11)
122
QuantitativeDataAnalysis:DoingSocialResearch to Testldeas
Now, let us derive the predicted valuesfor each category: For Protestants:
A= a+ b"(o)+ br(0)+ Do(0)= a :3.93
(6.12)
A = a + br(I)+ br(o)+ bo(o) = a + br: 3.98-.33 : 3.65
(6.13)
A = a + br(o)+ br(l)+ bo(O) = a + br: 3.98+ 1.61: 5.59
(6.14)
For Catholics:
For Jews:
For OtherandNone: A= a + br(o)+ br(o)+ bnl)= a + bo: 3.98+.88:4.86
(6.151
From Equations6.12throueh6.15,it is evid€nt thattheintercept,d, glvestheexpected value for the omitted, or referenlce,category and that the coefficients assocratedwith each ofthe dummy variables,the b,, give tbe-difference inthe"rp"ii"Jrir" u",ween thar caregory and the omitted, or refeieicr
expectedscoreor3.n*",,r,"-J"i""iX',i,s;f; J,L?:ffi::"J:1H"";Hffj:ffi fr acceptablefor abo[t four of the six conrtitions. Cutt o'"r, ty"orrt
u'st,havean expected scoreof 3.65, .33 less than protestarts.Jews on averageenOoJ nearty all six items (precisely,5.59), 1.6r rnore rhan prorestants. Finally,;; ;"-^t;;; of the sample,the residualcategory"other and None,"fa's midway beiweern ,"r,"o" u.o Lewsin their averagelevel of acceptanceof abortion.
Ql
N
|NCLUDE rHE ENflREsAMpLE }gF.ty_ygrl lHolr_L.p l! YOUR ANALYSIS
o,,;;;;"-,,;;J^""""
catesoryisa
catcharrresiduar caiegory andisthusratheruninteresting, it isdesirabre to incrude suchcategories Intheanarysis ratherthanrestricting theanarysis to thosewith ,,inrerpretabre,, rerigions. The reason for thisisthatwe ordjnarily wantto generalize to an entirepopulation, not a subset of the popuration with definablecharacteristics. rf we omit the residuar categoryfrom the analysis, ourestimates of theaverage population characteristics arelikelyto be biased, and, whatisworse,biased in unk
arso be ::"H[1f#ffi :J l:"J.Ti]::ffi;1""".mav biased. see rhe discu,,,"" ",
fntrodudionto MultipleCorrelation (OrdinaryLeastSquares) 123 and Regression
(6.12)
(6.13)
(6.14)
(6.15) expected vith each that catI havean abortion expected iix items nple, the s in their
'LE atchpnes ;.The ubset n the and, 50 be
Note that the R, is identical to the correlation ratio, 4r, that we encounteredin the pevious chapter Moreovel the prcdictedvalueson the abonion attitudesscalearejust 6e meansfor each religious group shown in Table 5.1. This follows from the fact that, rbsentany additionalinformation,the meanis the least-squares predictionof the valueof .a observation. Thus,the "least-squares" estimatesfor eachreligiouscategoryarejustthe r:bgroup means.So far we seemto haveno more than a complicatedapproachto estimat_ ine subgroupmeansand correlation ratios. The real value of dummy variablesis when they are used in combination with rrtier variablesto test the effect of group membershipon the dependentvariablenet of ie effectsof other variablesand also to assessthe effect of group membershipon the relationshipbetweenothervariablesand the dependentvariable(andthe effect of other variableson the relationshipbetweengroup membershipandthe dependentvariable)tat is, to assessinteractionsbetweenthe group categoriesand other variables.To see tis- let us continuewith our example.Supposewe are interestedin assessingthe effect .rt educationon acceptanceof abortion.Supposethat in addition we want to assessthe Sassibilitythat religious groups differ in their acceptanceof abortion and, moreover, n the relation betweeneducationand abortionacceptance-with Catholicstending to rpose abortionregardlessof their education,Jewstending to acceptabortionregardie-<s of their education,andthe remainingtwo groupsbecomingmore acceptingastheir slucation increases.To test theseclaims,we eslimatethreesuccessivelvmore comoliJaredregressionequations:
A : a+ b E -4 ,4:,/- r AfF- r \- - p
a e : a" + b"E + Lc,' R,+ --1\c,R,E
(6.16) (6.r7)
(6.18)
The first model(Equation6.16)positsan effectof educationbut no effectof religion. This model assumesthat all religious groupsare alike in their acceptanceof abortion. The mond model(Equation6.17)positsan across-the-board, or constant,differencebetween rligious groups in their acceptanceof abortion but assumesthat the relation between slucationandacceptance of abortionis the samefor all religiousgroups.The third model rEquation6.18)positsan interactionbetweeneducationandreligion in the acceptance of .&ortion, ot to put if differently, assumesthat the religious groups differ in the way edu;arion affects abortion acceptance.(The conventional way to representan interaction in r regressionframework is to construct a variable that is the product of the two for more] rariables among which an interaction is posited-although other nonlinear functional ic:ms are sometimesDosited.)
124
QuantitativeData Analysis:Doing SocialResearch to Testldeas
A STRATEGY FORCOMPARISONS ACROSSGROUPS Our first taskis to decideamongthe modelsrepresented by Equations6.16through6.1g. In this situation'wherewe areassessing whethergroupsdiffer with respectto somesocial process,we would generallypreferthe most parsimoniousmodel (except when we hare a strongtheoreticalreasonfor positingdifferencesbetweengroupsor, asnoted in the section on Metric RegressionCoefficientsearlierin the chapter,when we suspect the possi bility of omittedvariablebias).That is, in generalwe shouldprefer a more complicated model only if it doesa signiflcantlybetterjob of explainingvariability in our dependenr variable,acceptanceof abortion.We decide on the preferredmodel by comparingtbe varianceexplainedby eachmodel.If a more complicatedmodel explainsa significantll largeramountof variancein the dependentvariable,we acceptthat model;if ii doesnoi we acceptthe simpler model. (This is the classical,or frequentist,approach. The neu sectionprovidesan altemativeapproachto modelassessmeni basedon Bayesiannotion: a comparisonof BICs.) we begin by comparingthe first and third models.That is, we contrasta model thar asslmesthat thereare no religiousdifferencesin acceptanceof abortionbut only edu_ cationaldifferenceswith a model that assumesthat the relation betweeneducation and acceptance of abortiondiffers acrossreligiousgroups.To assessthe significanceof the differencein R2,we computean F-rano:
(4-nilr* ( 1- 4) /( N- k- 1)
(6.19,
whgre is the varianceexplainedby the largermodel (here,Equation6.lg); R; is the vananceexplainedby the smallermodel (here,Equation6.16);Nis the numb". oi,"ur.., k is the total numberof independentvariablesin the largermodel;rn is the differencein the numberof independentvariablesbetweenthe largerand smallermodel; the numera_ tor degreesof freedom : m; and the denominatordegreesof freedom : 1y'_ _ k 1. In our numericalexamDlewe have
(.097-.053)/6 : 11.96 (1-.097)/(1.48r-7 -1)
(6.20t
with 6 and 1,473degreesof freedom.To determinewhetherthis F_rafiois significant,we find thep-value correspondingto the numericalvalueof the r'-ratio with the specified numerator anddenominatordegreesoffreedom. If ourp-value is smallerthan somecritical value(.05 is *ject the null hlpothesis (Model l) in favor of the altemativehypothesis :_":":"I^":1U I. (Model 3). In the presentcasethat is what we are led to do becauseF(6 : ,.,,rr, 11.d6,which irnpiiesp < .0000).
Firoductionto MultipleCorrelation (OrdinaryLeastSquares) 125 and Regression
GETTING p-VALUES VIA STATA untir rairry n
:";LL:m:m:ii:ll"l,ru:n:ru[H':]#i"1",:; Jiil""lfJK[
and is now somethingof an ord-fashioned approach.stata providesa set of buirt-instatis-ry tables,includinga table of probabilities :rcal associatedwith specificF-ratios.The probability =cra given F-ratiocan be computedby executingthe command,_display fprob (df_], jf_2, F) - , where df_l is the numerator degrees of fteedom, df_2 is the denominator legreesof freedom,and F is the calculatedF-ratio).
USINGSTATA TO COMPARE THEGOODNESS.OF.FIT -^rheF-testfortn"'".r"ru*r-r*r,"*
OF REGRESSIONMODELS
Q!
ent to the wald test that the coefficientsfor the set of variablesthat are includedthe lurg"r. EII 'nodel but not in the smallermodel are not significantlydifferentfrom zero. Thussoftware :hat implements the Wald test as a post-estimation command(for example,_test_ and -testparm- in Stata)canbe usedto carryout the F-test.lt alsocanbe shownthat when a ;inglevariableis addedto a regression equation,the t-ratiofor the additionar variabre equars :he squareroot of the F-ratiofor the incrementin R, and the t- and F-ratioshaveidentical crobability distributions. Thus,when two equationsdifferby a singlevariable,they can be contrastedsimplyby inspectingthe significanceof the t-ratio,which is routrnervorovadedas cart of the regressionoutput.
Having determined that we cannot posit a single model of the relation between lircation and abortionacceptance for all religiousgroups,we next investigatewhether r .' necessaryto posit religious group differences in the relation between education and rinnion acceptanceor whether there are simply across-the-boarddifferencesbetweenthe -reii-siousgroups in their acceptanceof abortion but a similar relation betweeneducation ab-onionacceptancefor all groups; that is, we ask whether both the slopesand inter_ -rl ::ps differ acrossreligious groups or whether only the intercepts differ? To answerthis .:cesdon,we contrastthe R2for Model 3 (Equation6.1g) and Model 2 (Equation6.17), :simating an F-ratio usingEquation6.19.For our currentnumericalexample,we get
(.097-.089)/3 (t - .o97)/(1,481-7-1)
(6.21)
rith 3 and 1,473degreesof freedom.BecauseF3.,n r, - 4.35,whichimpliesp : .0046,we qrect thenull hypothesisthatthe relationshipbeiweeneducationandabortionacceDtance
't:*
r^r tv [\
I
QuantitativeDataAnalysis:Doing SociaJResearch to Testtdeas
(1890_j962)wasa Britjsh stdtistician wtn a stronginterest in biology(hewasa founder,w,th Sewa Wfight_see the biosketch o: Wrightin chaptersixteen_and l.B.s.Hald"n",ot tt eoretoaipoj.rlarion genetrcs). He was respon, siblefof majoradvances in experimental design, introaudng ih;io-t,onof rundo, urrignment o, cases to different treatments andshowjng ho* to ,re of vaijance, whrchheinventecl_the F-distribution "nulysr:, is nam€dafterF.her-to utt"t, tt . .ontrioutioi otlacn ot reverat racto*in dete._ mininganoutcome' a procedure thatgreatry enhanced thepoweroiexperrmentar designs. Hearsc invenied theconcept oflhe maximum iikerihood andmademajorciontributions to statisticar procedurcsforassessing sma'sampres Histextstat^f/Lal Method,fo, ner"urcn work"rs,firstpubrishec in 1925'wasverywideJy used, espe'iairy asa handbook forthedesijnandanarysis of experimenrs andranthroughfoufteened|t|ons, tnetatest published in 1970 Fisher wasbornjn London,thesonof an urt O"at"tunOuraioneer.Hewasa precociotrs s.u.ent,wrnningthe NeerdMedar(a cornpetitive essayin mathematics) at Harrowschoore: the ageof sixteen. (Because of hispooreyesight, n" *rr'iri"*, ," mathematics withoutthe aidof paperandpen,whjch
#
asopposed tou,ins urs"boi.d;uu",loi;,T_::::1,"";H:.[1T:",rJ"il::ff:n
mathematical resultswithoul
ics atcambridse, rr.";r;;'"'"rHt"?,"":1,::r}:ffi:,,11:;t::'i::ff'ru;*:l|::
entrst in thearmyduringWorldWartbut was rejected becauie of rrrspooreyesrgnt, andthe. spentseverar yearsteachingmalhematics in secondary school.at tne enciof ttrewar,he wa: ofiereda positionat the Galt(
*
but because o{hssril;J; ;:,f::l,:]"-fi :*:Jiilffi::liT::,T,ll :,.i:n:i culturalexperimental il: station(RothamsteO, *n*" n" o",nn appointedprofes_
t
sorof Eugenics at university "rn.,rud"r*u co,ege Londonin '1933and thento the Baltourchair of Genetic,. jn 1943.After r at Cambridge
his rire as asenior,","";;,iiilnl,iil.J#;"n:,/;'L,ii.lrlilii illlffir"::::Organjzation in Adelaide, jmportunt Australia. Fishers .ontriOrfions
lo oorngenetjcs andst;_ rrstrcs areemphasized bythe remarkof theweJl-known statjstici"n, , i"on.rC I Savage (1976): occasionally meetgeneticists who askmewhetherit istrue,nu,af]" i** n"n"ocrstR.A. Fishewasd'soan,-noortdnt slatislictan
;
I
:
:j5#:1""i"::ii,llt,_?:::.-""f.
burrhat.rhe groups difrerin rheiracross_the br-.,
ffi::liJ;T::.?::'::Ti:Y::l'.:xii:"*'i""r'ipo't"i''i'i'ii,.'*ili'li nr r,,,, u", r,.a,,-, i"",il. f;;;il;.:il,li,iillJllI::l#." ;::l.,ljl1.1,,, of religion educution drd .ho.ion ilcLeprrnl.e j"i i',::l:j::l::' li'''tron\hrp bcr\r. .rirr.r,,acrossreligious groups.Thus,rn sum,our:: Ierredmo.letis nna+h.i ""."* -..^,.- .. -.lt":tt
rrrrsrul duecr it'orrton attlr,. and that the effect of education vartes by religion (and. necessarily as well, that the ei:, ol relision varies variec by h., education). ^.r,,^-.:^.-.
lt!
introduction to Multiprecorreration and Regression (ordinarvLeastsquares) 127
istician ich of Spon- . Fnt oi . fl-the . ldeter' llealsoproce- blished ments, Dcious nol at ' ut the terrns,.
- i i l. | 6. 3 , Coefficientsof Modelsof Acceptanceof Abortion, U,S.Adult, 1974 (Standard Errors Shown in parentheses);N = 1,481. Model I
:-: Catholic
Model 2
Model 3
-.373 (.r11)
' 1.059
(.4ss)
Model 3'
-.371 (.111)
1.341 (.282) :,: Otheror None
.747 (.184)
.702 (.187)
bdu.. |ematnedto d then . F WAs t Fivei llagrilrofes:netics lars of . l search' d staV6\: "l
i' *F
F.,*6
'ntercept
frsnef ' ' ' J lerl\l o d e3 ' i s i d e n ti c a l to Mo d e r3 e xceptthati nr\rode 3' yearsofschoorng(educatron)rsexpfessedas . revationfrorfthemeanyears of school ng.
he-board between our preanitudes tle eff'ect
The conventional practice is to report the estimated coefficients for each model, not :nerely the preferred model. These are shown in Table 6.3. Let us seehow to interpret each ofthese moders.Model 1 isjust a two-variable regression equation of the sort we encounteredin the previous chapter; nothing further needs to be said here. As we have noted, Model 2 posits the same relationship between education and abortion acceptancefor all religious groups but across-the-boarddifferences between
128
DataAnalysis: DoingSocialResearch to Testldeas Quantitative
religious groupsin the level of acceptanceof abortion amongthosewho havea given level of education.What is meantby an "across-the-board"differenceis clarified by writing our Equation 6.17 separatelyfor eachreligious group. For Protestants,we have
A : a + b (E )
(6.221
A : a I b(E) t c, : (a + c")'t b(E)
(6.23)
A - a I b(E) + c, : (a + cr) *b{E)
(6.241
A: a t b(E)-rco= @+ c.)+ b(E)
(6.25j
For Catholics, we have
For Jews, we have
For Others,we have
From Equations6.22 ttrotgh 6.25 it is evidentthat Model 2 (Equation6.17)implies that the religious groups differ in their interceptsbut not in the slopesrelating education to abortion acceptance.If Model 2 were our preferred model, we could conclude that eachyear of educationresulted, on average,in a .125 increasein abortion acceptancefor peopleof all religions, so that, for example,college graduates(sixteenyearsof schooling) would be expectedto accept abortion for one reasonmore thaa would those of the same religion with only a primary school education (eight years of schooling). And we would expect Jews to agreethat abortion ought to be permitted for 1.3 reasonsmore than hotestants,on average,and Catholics to agree.4 times less on averagethan Protestants.ln short, interpretation of the coefficients for Model 2 is straightforward, and the net effecls of education and of religious group membership can be assessedseparately.However. although the sze of the coefficient for each religious group can be interpreted individually, it generallyis not meaningfulto assessthe significanceof individual coefficients becauseeachcoefficient indicatesthe difference betweenthe expectedvalue for the given category and the expectedvalue for the omitted category net of all other factors. Therefore, a significant t-ratio merely indicates that a coefficient is significantly different ftom the implied coefficient of zero for the omitted category,and which coefficients are shown as significantin one'scomputeroutputis entirelydependentupon the choiceof omitted. or reference,category.Thus, the appropriateprocedureis to assessthe significance of the entire set of dummy variables representinga given categorical variable by computing an F-test of the increment in R2for models including and excluding the set of dummy variablesconespondingto a singleclassification(or equivalently,theWald testthatthe setof coefficientsis jointly : 0).
hroduction to MultipleCorrelation and Regression (OrdinaryLeastSquares) 129 ;iven level vriting out
(6.22)
low To TESTTHES|GNIF|CANCE OFTHEDTFFER_ sronsin which an analystwants to assessthe signifjcanceof the differencebetween two specificcategories of a dummyvariabre crassification. In this case,it is possibre to makeuse of the formula: t : (bi
\6.23)
bj,/ (va(bi) + va(b,) - 2cov(b,\))h
,vhereb, and bj are the lwo coefficientsbejng compared.Most statisticalpackagespermit :he estimationof the variance,covariance matrix of coefficients.Of course,in these daysof :rgh-speedcomputing,it probablyis easierto simplyreestimate the model,redefiningthe referencecategoryStataprovidesan eveneasierway to comparecoefficients,by computing a Wald test that b. : b,.
(6.24)
(6.2s) /) implies cducation :lude that trancefor chooling) Ihe same re would han Protstants. In Et effects llowever, individuefficients the given s. Thererent from re shown iomitted, rceof the Putrngan rmy varithe set of
K
ENCE BETWEENTWO COEFFICIENTSrhere may beocca_
When interaction terms are involved, the requirementsare even more strinsent. lSrrronly must the significanceof all of the associatedcoefficientsbe assessedsimulrmeously, but the coefficients themselvesmust be interpreted together rather than inli'idually. ConsiderModel 3, which includes interaction terms betweeneducation rrl religious group membership.It helps to write out Equation 6.1g separatelyfor *h religious group. hr Protestants. we have
A: a + b(E) : 2.18+.155(E)
(6.26)
fur Catholics,we have
a=a+ b (E )+ c r+ d r(E ) :(a+ c r)+ (b + d r)E - (2.18+ 1.06)+ (.1s5_ .121)E = 3.24+ .034(E)
(6.27)
Fsr Jews,we have
A :a+b(E )ic r. rQ (E ) =(.a*c r)* (b + 4 )E : (2.r8+ 3.20)+ (.155-.140)E - 5.38+ .01s(E)
(6.28)
130
QuantitativeData Analysis:Doing SocialResearch to Testtdeas
tr!t-Eollr
For Others, we have
A=a+b(E)+co+d.(E) : (a 'l c,,)+ (b -l d")E : (2.18+.53)+ (.155+.014)E
(6.29)
:2.71+ .141(E) Again, it is evidentfrom Equations6.26through6.29thatEquation6.lg allowsboth the slopesandthe interceptsto vary betweengroups.The coefficientsassociated with the dummy variables,the c-s,indicatethe differencesin the interceptbetweenthe reference categoryandeachofthe explicitly includedcategorieswhereasthecoefficientsassociated with the interactionterms,the d s, indicatethe differencesin the effect of education(the slope)betweenthe referencecategoryandeachof the explicitly includedcategories. From Equations6.26tfuough6.29 it shouldbe clearthat for equationsof the form of Equation6.18, no overall summaryof rhe effecrof a variable1in rhrscaseeducationor religiousgroup membership)is possiblebut only the effect of eachcombinationof education and religiousgroup membership.Specifically,the coefficient.155in Model 3 of Table6.3 (andin Equation6.23)doesnot refer to the overalleffectofeducationbut rather to the effectof educationamongProtestants; and so on for the othercoefficients. BecauseEquation6.18 is a saturatedmoclel-it includesall possibleinteractions amongthe independentvariables(in the presenrcase.all possibleinteractionsbetween educationandthe religiousgroupcategories)-it is mathematicallyequivalentto estimating separateequationsfor eachreligiousgroup.Equations6.26 through6.29 show this equivalence:the coefficientsresultingfrom rewriting Equation6.1g as Equations6.26 tfuough6.29 and collectingtermsa.reidenticalto the coefficientsobtainedby estimating the equationseparatelyfor eachreligious group (you might want to persuadeyourself of this by carryingout the computationboth ways).The advantage of estimatingEquation 6.18 is that it permitsan explicit testof the hypothesisthat the groupsdiffer, throughthe F-test shownas Equation6.19. Becausethe conversionof Equation6.lg to Equations 6.26 through6.29 is a fairly tedioushandoperation,especiallywhen the numberof vari_ ablesis large,we often estimateequationsof the form of Equation6.1g to obtainthe R: requiredfor the F-test (or the coefficientsrequiredfor the wald test) but then estimate sepa.rate equationsfor eachgroup andreportthem in a separatetable From Table6.3,andevenfrom Equations6.26 through6.29,it is difficult to interprer the relationshipsamong religion, education,and abortionattitudes.With equation;ol this sort,graphingthe relationshipsis often useful.Figure 6.3, which can be constructed in the sameway as Figure 6.2 (seethe downloadable-do, or -1og_ file for details). shows the.levelof abonion acceptanceexpectedfrom educationand religious group membership.Inspectingthe graph,it is evidentthatJewsarehighly acceptingof abortion regardlessof their level of education,that catholics are relativelyunacceptingof abortion regardlessof their level of education,andthat aborlionacceptance variesstronglyb\. educationfor Protestants and"others," with the poorly educatedsimilar to Catholicsand the well educatedsimilar to Jews.
.&..".lErat aE
fuar .lm]]]tfr:|m
ftmqu-t ,- I m@!:m.'r."iit m!fltds--itl!
uos -\c rt &luulEEr x liM
-l ll::rlt Etr
dllwlliJ: :
J:E :
tu r,r_,amf a Tuma:i l0illlllu r{hnD
.!:nm] @re {Mruhrc.. lt! re1{ff M& r&rl'rir G
mryirr irrr liMur
rE-i-r
gn6!M',]i5
rk-,t.t IULS| - rE lDr *ij( , ln
Introduction (OrdinaryLeastSquares) 131 to MultipleCorrelation and Regression
-5
(6.29) 94
wsboth rith the ference ;ociated ion (the ies. form of allon or of edudel 3 of n rather ractions tetween esnmatlow this ns 6.26 imating iourself 4uation rughthe |uatlons of varin the -R'? ;strmate nterprer tions of structed details), s $oup abortion of aborrnglyby fics and
b
-) E
'1
810
12 14 16 Yearsof schoolcompleted
--.-
Protestants Catholics
---r-
Other/none
18
20
FIG URS 6,3. Acceptance of Abortionby Educationand Religious Denomination, U.S.Adults, 1974(N = 1,481). Rexpressing Variables as Deviations from Their Means -{part from graphing the relations among variables,asin Figure 6.3, we can use one ot}er de\-ice to render the coefficients in models containing interaction terms more readily interpretable-we can reexpress the continuous variables as deviations from their means-just as we saw in the earlier example predicting knowledge of Chinese characre.I5.The advantageof doing this here is that the group effects (the main effects of the .irnmy variables for groups) can then be interpreted as indicating the expecteddiffereacesamonggroupswith respectto the dependentvariablefor personswho areat the ,n erage with respectto the interval-level independentvariables or variables. In the present context, this means reexpressingyears of school completed by subFacting the samplemeanfrom eachobservation.(The reexpressedcoefficients are shown in Table6.3 as Model 3'.) The interceptthen gives the expectedvalue on the abortion scaleamong Protestantswith averageeducation (where the mean is computed over the eotire sample,not just Protestants).The coefncients associatedwith eachof the dummy r-ariablesthen give the difference in the expectedlevel of pro-choice sentimentbetween Protestantsand the specified category among personswith averageeducation.Note that rie slope associatedwith years of schooling (which, as noted, gives the effect of schooling for Protestants)is unchanged,as are the coefficients associatedwith the interaction erms; only the group interceptschange.However,the interpretation of the coefficients is gready facilitated: we seethat among those with averageeducation,Protestantsendorse about4 of the 6 abortion items on average,Jewsan additional 1.5 items, "Others" an addidonal .7 items,andCatholicsabout.4 itemsfewer.We also seethat eachadditionalyear of schoolingincreasesthe expectedendorsements of Protestantsby .155, and of those
132
Quantitative Data Analysis:Doing SocialResearchto Testldeas
rtsLni
without religion by about the sameamount becausethe difference in the slopes is onlv '014; by contrast,educationmatterslittle for Jewsand cathoricsbecausethe deviations from the Protestantslope are negativeand almost as large as the hotestant slope.
TestingAdditional Hypotheses:Constraining Coefficients to Zero or to Equatity
n
cEli
-,I. rjrL|
ry:rc:
Inspecting Figure 6.3, we might be led to infer that education has no eftbct on abortion attitudes for Catholics and Jews and the same effect for protestants and ..Others.,,How can we formally test the correctnessof our inference?We can do this by estimating an equation of the form:
A = + | b,R,+ c(ER,.r ERo) " i=1,3,4
di.r
Itr (ih
-r ]415 .qudl
6lFi|.rr'l
a
Efni tr haf,
e*:
(6.30)
ks
where, in this case,Catholics are the omitted category.To see how this equation repre_ sentsthe particularhypothesisof interest,we can again write out Equation6.30 separately for eachreligious group.
[-
hrs I
tu14 ne nl
tu
For Protestants:
A: @+b,)+c(E)
i.f, Til rc@ (6.31)
cdr
ler IT
For Catholics:
nOg-!,{-
[
'$r d frmt
For Jews:
(6.331 For Others:
(s
tur
i- n;
t= (a+ bo)+c(E)
(6.341
is evidentfrom inspectionof Equations6.31tbrough6.34, underthe specification _As of^ Equation 6.30 each religious group differs in the int#ept; the slope retating educa. tion to abortion acceptanceis zero for Catholics ald Jews; and tne stope ls identical frr Protestantsand "Others.,' To tesr whether this constrained specification is an adequare representationof the data, we cannot compute the incremeni in R, for Model 3 relatire to Model 3'becausethe two modelsdo nor standin a hierarchical relationshipto each other: there is no main effect for education in the constrained model. So, what to do? Fortunately,a solution is available
f=
turl
N, ' l!W5.-1 :ef:r
.u,r rd !E
GfuI Fn-lt
(OrdinaryLeastSquares) 133 Introduction to Multiplecorrelationand Regression )nl\ ion'
1lon Io s
i.-10t
?re€pa-
6.i I t
6.32)
6.33)
6.3,1) ration duca:al for 4uate :lative ) each o do?
A BAYESIAN ALTERNATIVE FORCOMPARINGMODELS Re can exploit an alternativeway of contrastingmodels, the BayesianInformation Criterion (BIC ), introducedinto the sociologicalliterature by the statisticianAdrian Rattery for log-linear analysis(1986) and generalizedto a vadety of applicationsin -!: important article in SociologicalMethodology (1995a: see also the critical com:rent by Gelman and Rubin [1995], the appreciativecommentby Hauser[1995], and Raftery's reply to both [1995b], and also the February 1999 issue of Sociological of B1C).In a sense llethods and Resenrcft,which is devotedentirely to an assessment 31C operateson the oppositeprinciple from classicaltestsof significance.It is a like:hood ratio measurethat tells us which model is most likely to be true given the data :or a brief introduction to maximum likelihood estimation,seeAppendix 12.B); clas;:"-al inference, by contrast, tells us how likely it is that the obse ed data could ::r e been generatedby sampling error given that some theoretical model (the null :\ pothesis)is true. B1C has tbree important advantagesover the F-test introducedpreviously.First, :like the F-ratio, B1Ccanbe usedto comparenonhierarchicalmodels.Any two models trurportingto describethe samephenomenoncan be contrasted.Second,B1C builds in :. correctionfor largesampleswhereasif the sampleis largeenoughvirtually any increrent in R2 will be significant,no matter how small and substantivelyunimportant.A -"rger incrementin R'?is requiredto generatea particularBIC value for large samples iran would be requiredfor small samples.Thus, B1C reflectsthe conventionaladvice :..' choosea smallerprobability value when the sampleis large. Third, BIC penalizes ."rge models.That is, if it takesthe introductionof many additionalvariablesto gener:re much of an increasein R2,BIC is more likely than the F-test to lead us to prefer ie simpler model.There are severalspecificways to calculateBIC, dependingon the rarticular statisticbeing analyzed.To compareregressionmodels,we can useRaftery's Eauation26:
Blco: t711n11- + po[n(N)l ^oz;l
(6.35)
nhere Rf is the value of R'?for Model t, pn is the numberof independentvariablesfor \Iodel k, andlr' = the numberof casesbeing analyzed.A negativevalueof B1Cindicates :hata specifiedmodel is morelikely to be true thanthe baselinemodel of no association setweenthe independentvariablesand the dependentvariable.To comparetwo models, rre estimateBIC for eachof them and choosethe model with the more negativeB1C. Raftery(1995a,Table6) givesa rule of thumbfor comparingBlCs: a B1Cdifferenceof 0 to 2 constitutes"weak" evidencefor the superiorityof onemodeloveranother;a differenceof 2 to 6 constitutes"positive" evidence;a differenceof 6 to 10 constitules"strong" eridence;and a differenceof >10 constitutes"very strong"evidence.However,because Raftery'srule of thumbis mostapproB1Ctendsto increaseasthe samplesizeincreases, priatefor relativelysmall samples. To seehow BIC is used,let us computeBIC valuesfor the threemodelsshownin Table6.3. For Model 1. we have
134
K
QuantitativeDataAnalysis:DoingSocialResearch to Testldeas
ALTERNATIVEWAYS TO ESTIMATEgtc
ntrlr,€bqr
Even rora siven
statistic, there are arternative versions of Bic. I prefer Rafterys formuras because they buird in a comparisonto a baselinemodel. Thus, I have wrjtten a small _do_ file, _bicreg. do_, to calculate B/C foliowing Raftery: * BIC REG . DO ( Updat ed ve rsi on
f or
St ata
.t.O
t-I/\\/OI.\
?. 0
*Compute BIC from
saved
results
from
drop
bic
in
-hltt'.Ilrbrsl -ddedd hfi.mIh11
[email protected] qaerci.aritr hniE6cll G$e1ril.
regreasion.
ge n bic = e ( N) * 1n ( 1- e ( 12 ) ) + e 1 6 5 _ *; *f n ( e ( N ) ) *Note.: BfC is the same for all observat.ions. * 1ist Bf C f or any obs er v at ion . list
[Er -Ut adr uli.rgder Fryj:I:E--ir rsl-.r- d fts. tpwx--i*.rE Tbe nce [m
Thus,
I
can
1
rcrr
bic
InvoKe -bicreg-
immediateryfo owing your regressioncommand. However, stata r0.o now offers BiC as a post-estimation statistic. To have Stata calculate B/C wjthout using my -do- file, invoke the command ,estat ic_ immediately followrng your regres_ sion command. The numerical value of each BiC will differ from mine, but the difference
between the for arternative moders wit be identicai regardless of whichversion of B/c '/cs iscalculated.
-{ltr€ff
a sI
:se- Il
-ttrbea.1:
ir:L
ka=<--lti d-Lrsla-*q
rda.ry .-'( 6e i ra:ETllL
t:rc-,t'.1 I
BIC,: 1,481*tn(I - .053)+ t*ln(I,481)= _13.4
(6.36)
f{=
I
=s€fl
ForModel2, wehave BIC,: 1,481+tn(t - .089)+ 4*ln(1,481) =_108.4
I iiai fr
For Model3, we have B1q : 1,481*ln(1 - .097)+ 7*tn(1,48t) =-100.3
t€ ..{.i .E
l Wa-r-r. Il
(6.38)
From a comparisonof the glcs for the three models, we are led to conclude ahatthe data are most consistentwith Model 2, which posits the surn" on abortion attitudesJor all religious groups and an across{he_board"ff""iot "Or"ation difference (that is, a differencethat holds at eachlevel of education)in abortion acceptance for the various religious groups. From the size of the B.IC differences, we conclud^e that the dara .Aery suoiglyfavor Model 2 over Model 1 and ..strongly,' favor Model 2 over Model 3Note that theseresultsare inconsistentwith the resultsse olF,-_r pnilosly rbmugt ,rh a comparison of Rrs via an I'-tesr- What are we to mafre d rls? rs m definitire
aif.
m,rc;r*l *E *:Ed
[ h- i: =*i
Ihe GSS 5 :i: _ia::a
-r: :tr ,T EFi fu f t f i. €: r ETE
(OrdinaryLeastSquares) 135 lntroduction to MultipleCorrelation and Regression answer My advice is, first, go with theory. If you have a theoretical reasonto prefer one modelover the other,choosethat one.This adviceis consistentwith one of Weakliem's .19991criticisms of BIClhat BIC assumesa "unit prior" B1Cis an approximation of the Bayesfactor,which involvesa comparisonof the posteriorlikelihood of models,where -rheposteriorlikelihoodis simply the productof the datalikelihood andthe researcher's prior. The researcherthen choosesthat model with the greatestlikelihood; that is, the model that has the highest probability of being the true model given the researcher'spri,xs and the data" (Winship 1999a,356).If thereis no clearreasonto expecta departure lom the null hypothesis,a "unit prior"-which amountsto saying we havelittle informadon about the likely outcome-is appropriate.But if we havestrong theoretical reasonsto e\pecta relationship,BIC canbe too conservative. In this case,classicalinferencewould :eem to be the preferred tool unlesswe were to modify B1C in ways that go beyond this course.We will discusslikelihoods in ChaptersTwelve ard Thirteen. Absent a strong theory go for parsimony, which is what 81C generally does. In the prcsent case,I would be inclined to prefer Model 3 becauseI think there are good realons to expectCatholicsand Jewsto haveconsistentreactionsto abortionregardlessof deir level of education(Catholicsbecauseabortionis prohibitedby the ChurchandJews because-still in 1974evenif lessso today-the Jewishcommunitywas sociallyliberal, andJewslacking educationtendedto be immigrants who had the valuesof educatedpersons)and to expectProtestantsand Othersto be more acceptingif they arebetter educated 'becauseof the increasingsophisticationthat educationbrings).But if I did not havea srong, coherent,explanation for the religious difference, I would then prefer Model 2. We can, of course,also compute81C for the constrainedmodel derivedfrom the data: BICy,: 1,491*tn 1 - .096) + 4*ln(1,481) : -17L0
(6.36)
(6.37)
(6.38) lrat the n aborr differ:ligious rongly" through lfinitive
qhich is more negative than the BIC for any of Models 1 through 3 and thus "very strongly" suggeststhat, for thesedata, the constrainedmodel is to be preferred.
INDEPE NDENT VALIDATION Note that I said &atfor thesedata lhe constrainedmodel is to be preferred.This is because q e arrived at a new preferred model basedon our inspection of the data rather than from a priori theory. Thus, we are vulnerable to the possibility that we arc simply capitalizing on sampling enor To anive at a definitive preferencefor the constrainedmodel, we need to show that it is the preferred model in an independentdata set. If our sample size pernitted, we would want to carry out all of our exploratory analysis using half of the data and then to reestimateour final model (and its competitors) using the other half of the data.The GSS providesa closeapproximationto this ideal becauseit repeatsidentical questionsin successive surveysconductedusingthe samesamplingprocedures.Thus,it is reasonableto treat adjacentsurveysas independentsamplesdrawn from the samepopulation,at leastfor phenomenanot subjectto short-termfluctuation.The implicationof rhis is that we can carry out all of our exploratory analysisfor one year and then use the yearto validateour conclusions. datafrom the previousor subsequent
't36
QuantitativeDataAnalysis:Doing SocjalResearch to Testldeas
f*-'Ti(
"{
.&; f- t: S . {, Goodness-of-Fitstatistics for Atternative Models of the Relationship Among Religion, Education, and Acceptance of Abortion, U.S.Adultr 1973(N = 1,499).
u]]!];arc _-lu
I t;tg,
;-iirl:lits l!
d.f.
!!
lL
fl:tl! EU::j i '_'-
l!'
lllllllllr iir::
-197.7
l
fl]llllrlg:ifIt
.1405
j]lllllllrr|1- Jl
-:tr :l ili
N4odel 3
-'191.'t
lfi;
1/10:)
Contrasts Model3 vs.Model'l
-41.2
14.52
6; 1491
Model 3 vs. Model 2 Constrained vs. L4odel2
Here we can exploit the GSS in just this way, reestimatingthe four models of pro-choiceattitudesusingdatafrom the 1973GSS.Insofaras we can assumethat abortion attitudesdid not changein the populationbetween 1973 and,19i4. reestimatins the modelsusingthe datafrom 1973constitutesan independenttestof the claim thatthi "constrained"modelis the preferredmodel.Table6.4 showsB1CandR, valuesbasedon the 1993datafor all four modelsandcontrastsbetweenmodelswherevermeaningfuland appropriate.The outcomesare, in fact,just the sameas for 1974..Model 3 is preferred to Model 1 and Model 2 by the criteria of classicalstatisticalinference,whereasby the Blc criterionModel 2 is preferredto Model 3: and by the glc criterionthe constrained model is the most preferred.Thus, we can concludethat our preferencefor the con_ srainedmodel.derivedfrom inrpeclion of rhedara,is r alid.
WHAT THISCHAPTER HAS SHOWN In this chapteryou have learnedhow to carry out multiple regressionand correlation analysisandhow to interprettheresultingcoefficients,consideringa workedexampleon the determinantsof literacy in China.we then focusedon the manipurationof dummr
._ r r't
:
lntroduction to MultipleCorrelation and Regression (OrdinaryLeartSquares) 131 rriables (setsof dichotomousvariablesthat_represent categoricalvariables),including :gecially interactionsbetweendummy variablesand other;ariables, usingas a workei
li.tn,
[,
I
f
F: -.:: t
'
nodelsof ttrat aborstimating n thatthe basedon ngful and preferred as by the nstrained the con-
|rrelation ampleon i dummy
CH APT ER
REGRESSION MULTIPLE TRICKS:TECHNIQUES FORHANDLINGSPECIAL ANALYTICPROBLEMS ISABOUT WHATTHISCHAPTER This chapter presentsvarious "tricks" for dealing in a multiple regression framework The Stata-do- and -1ogrith specificanalyticproblemsfacedby socialresearchers. are available as downloadablefiles. Spein this chapter worked examples fles for all the and independent of both dependent transformations cifically, we consider nonlinear an equation; how to assessthe rzriables; ways to test the equality of coefficients within rsumption of linearity in a relationship, with a trend analysisas a worked example; how to construct andinterpret linear splines asa way of representingabrupt changesin slopes; dtemative ways of expressingdummy variable coefficients; and a procedurefor decomposing the difference betweentwo means.
'|-40
QuantitativeDataAnalysis:Doing SocialResearch to Testldeas
NONLINEARTRANSFORMATIONS often when doing regressionanalysis,we havereasonto suspectthat the rerationship betweenparticularindependentvariablesandthe dependentvariableis nonlinear.Henci. an estimateof the linear relationshipbetweenthe independentand dependentvariables would not properlyrepresenttherelationshipin the sampleunderstudy.you haveseen al exampleof this kind in (c) of Figure5.4 in chapterFive,which showsa perfectparabolic relationshipbetweentwo variablesbut which producesa slope and correrationof zero whenestimatedby a linear regressionequation.Fortunately,thereis a simplesolution to problems of this kind-you can transform one or more variables so that the dependenr variable is a linear function of the independent variables. Here are severarexamolestogetherwith someinterpretivetricks.
CuruilinearRelationships:Age and Income In cross-sectional dataincomecomrnonlyincreaseswith ageup to a point in the middle of the career and then begins to fall. A reasonableway to ripresent this is to estimate atr equation of the form t:a+b(A)+c(A,)
e.t.
wheref= annualincome,A : age,and, A2 : A*A. In the 2004 Generalsociar suruay(GSS),the estimatedvaruesfor this equationare (for people age 20 to 64 with informationon personalincome; : N l,573fthe openendedupperinterval-$ 110,000per yearor more-was recodedto $150,000;theremain_ ing incomeintervalswererecodedto their midpoints): i' = -4gJ3g + 3,777(A)- 35.95(4,); R, : .084
(j .)
which can be represented graphically,as shownin Figure7.1.
ENINCOMEANDAGE ?,-! wr_{yTHERELAT|ONSHIp BETWE N
lS CURVILINEAR
There areseveratpossible exptanarions torthecurvitineariry ofthe
relationship bet\,,r'een incomeandage.of whichthe two majoronesarethe following: .
.
Economists arguethat productivityincreases with age up to a point and then falls; sociologists sometimes makesimilarargumentsbut alsopoint out that variousinstitu_ tionalfactors,suchasthe greaterdifficurty orderworkershavein returningto work after layoffs,resuitin the sameobserved pattern. The cross-sectional observationmay simply be an artifact of a cohort progressionof earnings, with successive cohortsearningmoreat anygivenagethan theirseniors, and the earnings of all workerscontinujngto risethroughoutthe career.
ffii G & m'F ru! fl@[[ rqr fuI
m:I
ffi ltrm
q ffi ilhfr
..D mffi
v,Jltiple Regression Tricks:Techniquesfor HandlingSpecial Analytic problems
141
50,000 L-rili,:
F{e;l;;,
nn,3.
45,000 40.000 35,000
t z::
30.000
iLr: :: tria:l nPl3>-
20,000 I5 ,0 0 0 l 0 ,0 0 0 s,000
rid:-: 0
: .i ; ": . The RelationshipBetween 2OO3Income and Age,U.S. Adults Twenty to Sixty_Fourin 2OO4(N = 1,57 . +p o:= 0a::-
_': '
T:::';:i:.ffi*;ilJ:"#tff T$Hffi:l:*ill? =in d*:i:i:ffi::
ro:.rr550,000 peryear.Withoutthelraph,h";;;, ir":;r because the coefficients the
;;*r"tili"#equation
z.z is oir_
.nr.=pretarion. rtispossibre, .F-.t rnterpretation. It can be"''.;i,::i:nil";11,l.il:;il'j'.r.lf"ilf":1l1i:,1'; shownthat in the equation (.7.3)
F:ere /r : a - b2,/4candF = _b/Zc (\Nith thecoefficients on the right side taken from i::arion 7.1),z is themaximumincome,-and F is the ageat whlcfrtfremarlmum lncome : =:rained.In the presentcase,the numerical esti."";{;;,#;.; I = 50,066- 35.95(52.53- A),;
" R, = .084
(7.4)
Equations7.Z md 7.4, of course,,yield the samegraph becausethey are equivalent But Equation7.4 also_ telli us precisely,#i;; -;ressions. rs ;;;ome 1j50,066 and lrr: rhispeakis attainedbetweenfifty-,*o unOnfry_,-tr.. ,"i. r*" tp*"isely, 52.53). \n equivalenrrransformationis possibl" "i f". adaitionatinde_ "; "q;;;;italirng Consideran equationof the form -.E:dentvat:iables.
Y- a+ b(A)+ c(Ar)+ d(z)
(7.5)
142
Quantitative Data Analysis:Doing So
whereZ is someother independentI ariable.and the remainingvariablesare as before. We could thenrepresentthe relationbenveen.{ and L net of Z, by substitutingthe mean of Z. Z . so lhat Y :
tn +,1 t7 \t
-
ht )t +
-t
a2 |
or, equivalently,
i' : m+ c (F -A )r where,in this case,
m: (a + d e D
b2t4c
(7.E
and F is as before.
Semilog Transformations: lncome A usefultransformationwhenpredictingincomeis the semilogtransformation;thatis, instead. of predictingincome,we predict the natual log of income.This hasthreeadvantages. First, economictheoriesabout what generatesincome tend to make predictionsn termsoflog income.Specifically,humancapitaltheorytakesincomeasdeterminedb1.a rnvestmentprocess(Mincer and Polachekl9T4). Hence, insofar as we take such theorier seriouslyor are interestedin testingthem seriously,we probablyshouldpredictincoE in its log folm. Second,incometendsto be distributedlognormally in the United Statesand o6a advancedindustrialsocieties,so the log of incomeis distributednormally,a convenied property. Third, and mostimportant,when the dependentvariableis in (natural)log form. e metric regressioncoefficientscan be interpretedasindicatingapproximatelythe protrF tional increasein the dependentvariableassociatedwith a one-unitincreasein the iDi* pendentvariable,for b lessthan about0.2.To seethis, considerthe equation
t n (Y )-a + b (X ) Now considertwo individuals who differ by one unit with respectto X: thal xX.= X^+i. Then
ln(Yr)--a+b(Xr\ and
.----::-
l nrl -':i -'tl -
MultipleRegression Tricks: Techniques for HandlingSpecial Analyticproblems 143 So, subtracting, ln(f,) - ln(fr) : (a - a) + b(X, - X..) : b
(7.12)
But we know from the propertiesof logs that h(f,) - h(fr) : ln(Y,/Yr)
('7.13)
ln(YrlYr) : b
(7.r4)
So we have
Then,exponentiatingboth sides(thatis, makingeachan exponentofe), we have
(7.1s)
YrlY, : eb Now let us look at the relationshipof b to e, for variousvaluesof b.
m m es 0e ET
nt be xL-
.9,
l0'
b 0.01 0.05 0.10 0.15 0.20 0.30 0.40 0.50
1 .0 1 1 .0 5 1 .1 1 1.2 2 1 .3 5 1 .4 9 1 .6 5
b - 0.01 - 0.05 0.10 0.15 -0.20 - 0.30 -0.40 - 0.50
€o 0.99 0.95 0.90 0.86 0.82 0.74 o.67 0.61
We seethatfor b lessthanabout10.21, b is a good approximationto the expectedproportional increasein I for a one-unit increasein X. For larger values of b, D underestimatesthe proportional increasein L To see how to interpret such results,considerthe effect of educationand hours workedon ln(income),by sex,usingthe 2004 GSS.We estimatea modelof the form ln(I) = a + b(E) + c(H) + d(M)
(7.16)
where/ : incomein 2003,E : yearsof schoolcompleted,11= hoursworkedper week, and M : l for males and = 0 for females. (Note that although the present analysis is restrictedto peoplewith incomes,it is common to add a small constant,say 1, to the value of the dependentvariable to ensure that zero values are not dropped; such transformed variablesare known as "startedlogs" [Tukey 1977].Seethe discussionof tobit analysisin Chapter14 for an alternativeway of dealingwith zero values.)The estimated equation,basedon 1,459caseswith completedata,is
ln(I) - 7.41+ .125(E)+ .0207(H) + .335(M)t R2=.257
(7.r7)
144
DataAnalysis: DoingSocialResearch to Testldeas Quantitative
This equationtells us that each year of schoolingwould be expectedto increase income by about 12 percent,within gendercategories,amongthose working an equal number of hours per week. Correspondingly,each additional hour worked per week would be expectedto increaseincomeby 2.1 percent,within gendercategories,among thosewith equal education.Finally, among thosewith the sameeducationworking an equal number of hours, men would be expectedto earn about 40 percentmore than women.Here the coefficientunderstates the male advantagebecauseer35= 1.398.This remindsus thal the b may only be directly interpretedasindicatingthe expectedpercentageincreasefor b < 10.21. For largerbs, we shouldactuallycalculaGthe exponent. Negativecoefficientshavethe sameinterpretation.For example,a coefficient of -0.05 indicatesthat a one-unitincreasein the independent variablewould be expectedto yield a 5 percentdecreasein the dependentvariablei that is, the expectedvalue of the dependenr variablewould be 95 percentas large.Also, for b < -0.2, the percentlosswill be smaller thanimplied by the coefficient.So, again,we shouldcomputethe exponentiated value. Note that the equationexpresses a linear relationshipbetweenthe independentvariablesar'dIhe natural log of income,not incomeitself. This is evidentfrom inspectionof a graph of the relationshipbetweeneducationand ln(income),evaluatedseparatelyfor malesand femalesat the meannumberof hoursworkedper week by all workers,males andfemalescombined(42.67).The relationshipis, ofcourse,linear andthe expectedvaluesfor the two sexesdiffer only by a constant,as shownin Figure7.2. However,when we graphthe expectedrelationshipbetweenincomeand education. the relationshipis curvilinearandthe lines areno longerparallel(Figure7.3).
* r.Jdl]lro'ft
ll
-l@ll
ir mm' ll
.g E
fr m [r
IU
q
:nlllullr
;
A o r ir J\ i.'1 i. r . 4
4
a 12 Yearsof schooling
16
20
Expected ln(tncome) by Years of School Completed, IJ.S.Males and Females,2004, with Hours Worked per Week Fixed at the Mean for Both Sexes Combined = 42.7 (N : 1,459).
fllL EI
l-, llrr
vultiple Regression Tricks: Techniques for HandlingSpecial Analyticproblems Ease qual reek xtn_i
145
70,000 60,000 s0,000
6.t Ihri enI-
?
40,000
- 30,000
2
l-C': ld: kn: Ilit
20,000 10,000
tn-
0
to:
for Ie! al-
yearsof
s.hoolirg : c, , ; iL?.3 .Expected lncome by yearsof SchoolCompleted,
u.S.Mates Females, 2004, with Hours Worked per Week Fixedat the Mean for Both Sexes '-=nbined (42.7).
yd
Supposewe have an equationinvolving
a logged dependentvanableand squared *";j:n:H::ff"11*pendent variabres.-H", ; ;; ;;";t th" "o"rn"r.ot,.r ln(Y) = a+b(X)+c(X One way to interpret this equation_isto
L.l,ilL.*tro
- k)2
(7.18)
find the first derivative
of li@ with respect tt forappropriate vatues ofX,.", ;" ;;;;. ;i;.ir r.o* firrty"* "a_ ddnllir =b+2cX_2ck -^=. cJ\ )
(7.19)
p"ffi i:li:s,f """""":,5":3t:'*:*T,i}**",#HTil
same equation because suchvariables tendto behighly correlateo. ,"
.ir.. ."rri*iil ;"J a variable anditssquare, analysts sometimessubtract a constant b"* ,0"","n lt canbeshown r:iir:Trnj, whereb isthestopeof theregression of X, on X, tende(; T x and(X _ b/2)2 onhogonal (seeTreiman andRoos1983,62D.
lll
146
euantitativeDataAnalysrs: DoingSocjalResearch to Testldeas
t
;.",:ffi.ffi i;."t:,;:fl:".#:'.?T":1:,,1TXHTiilTi';? ilffi:,# tf becausethe funclio
j..l;i*;lrTtil#uitil:,, lrrr ;ffi flT:J}::1il *";:Ti,5"tr*T# t[,'y,;,Jl *, ''J!:{:ii;:r#"*::nl:#;ff T.T:,;.".",, ^ttowever.
i!t-
-
."\.)t
-
u - f o \ x t ) +. ( y .
_ t \2
(7.20t
ft rq
and l ntv \ "'\r2J
u f
6iE;="+b(Xl
o(x.l
+ ((x-
_ L\2
(7.21t
+ 1)+ c((Xt+ 1)_ 1r1z
r&
,--:::-. tnlY2l- ln(Yt)= b + 2cXt_ 2ck + c But because
rr,ry],_ inr}r = ntef,t
(1.:1,,
sidesof Equalton 7.23. we have ,2/it
=
e@+2cxr2ck+c)
Thus.Equation7.25 . sives rl increasein X. evaju;,#"i;;; ;f^:xpecred
{ -5,
in".ease
in wesetx equal giu.tth.p'opo*ion;r";;;#1"t7:l 1 so'ir-proponiona.l ro irs I /for twoindiv'o*""i?l'ilH*Tit uoo1",,l. mean onva-riable x.
f,-[
ff
( 7 ) 1t
Then,subtractingEquadon 7.20from E qtation7.22, we have
lr wc exponentiate borh
fr mr
.f for a one-w
jffi #ffi[#tr#: THgri=f"EiEE{s ";
UultipleRegression Tricks: Techniques for HandlingSpecial Anallticproblems 'l47 Nr::,:
lobility
Effects
i:rpose we want to testthe Durkheimianhypothesisthat extremesocialmobility, either rrn ard or downward,leadsto anomie.If we are willing to considerthe effectof upward rc.l downwardmobility as symrnetrical,we might estimatean equationofthe form A : ct+ b(P)+ c(P) + d(P - PF)2
(7.26)
r:ere A = the scoreon an anomiescale,P, : the prestigeof the respondent'sfather,s :csupation,and P : the prestigeof the respondent'soccupation.(Note that this specifi:=on of the hypothesisassumesthat it applies Io intergenerationalmobility, that :c--upational mobility is a good indicatorof socialmobility andprestigea good measure :i.:rcupational status,and that extrememobility shouldbe most heavily weighted-by the difference.In a substantiveanalysis,all of theseassumptions needto bejus---nring :i3d explicitly,not merelypresentedwithoutjustification.)A significantlypositivecoef:crent d indicatesthat anomie increasesas the discrepancybetweenrespondent'sand -:.-\er's occupationalprestigeincreases,controlling for the level of both respondent's r:l tather'sprestige.Thus d indicatesthe effect of mobility per se, controlling for the ::ect of statuslevel. It is necessaryto control for statuslevel becauseanomiemay be -:-Jtedto origin or destinationstatusentirelyapartfrom any effectof mobility. Of course,many othertransformations of variablescanbe usedto representdifferent r\-ial processes. For someexamples,seeGoldberger(1968,Chapter8), Treiman(1970), cd Stoltzenberg(1974, 1975).
TESTING THE EQUALITYOF COEFFICIENTS
._: nr:.: I t-nLr t'-
\rmetimes situationsarise in which we want to determinewhether two coefficients the sameequationare of equalsize.You havealreadyseenan examplein the pre-ithin chapter, -.:ous in the discussionof Equation6.30.Here we consideran additionalexam:.e. Supposewe areinterestedin assessing theeffectofparentaleducationon respondent's :lucation and, in particular,in decidingwhetherthe mother'sor the father'seducation :.1sa strongereffect.The hypothesisthat educationaltransmissionthroughthe mother -i strongerthan throughthe fatherarisesfrom the observationthat mothersspendmore :,.newith their childrenthando fathersandhenceareputativelymoreimportantsocializ-rs agents.The altemativehypothesis,that the father'seducationhas a strongereffect, :erivesfrom the claim that the father'ssocioeconomiccharacteristics largely determine :e family's socioeconomicstatus.Becauseeducationinvolvesopportunitycosts,it may ; ell be that thosewhosefathersare poorly educatedwill be more likely to leaveschool :3rly to switchfrom beinga drainon the family financialresourcesto beingan economic :ontributorto the family. Amed with thesetwo competinghypotheses,we might thenestimatethe regression rf yearsof schoolcompletedon father'sand mother'syearsof schoolcompleted.From --ne1980GSSI estimatedan eouationof the form
E :a+b( E , )+ c (E r)
(7.27)
148
DataAnalysis; Quantitative DoingSocialResearch to Testldeas
l*..r: c,e k
where E : respondent'syears of schooling,E : father's years of schooling, and E" : rnother'syearsof schooling.(I chosethe 1980GSSdatato illustratehow to testthe significance of an apparenttrue difference. The 2004 data yield virtually identical coefficientsfor mother'sandfather'seducation.Assessingcross{emporaltrendsin the relative effects of parental education and the reasonsfor such trends might yield an interesting paper.)EstimatingF,quation7.27, with N = 985, yields E :7 .8 7
I .2 O qtF | + 16qrF r. '-"'\"Fl
R , -.Jl J
(7.28)
This result appearsto supportthe claim that mother,seducationhas a somewhatstronger effect on educationalattainmentthandoesfather'seducation.It is possible.however.that this result arisessimply from samplingvariability. How can we find ouf/ The trick is to force the coefficientsfor mother'sandfather'seducationIo be equalard thento assesswhetherthe R2for the unconsaainedequation(7.28t is significantly larger than theR2for the constrained equation.We constrainthe coefficientsto equalif by estimatingan equationof the form:
E : a + b (E " )
(7.?9)
trr =-. ce fu+Tt-d IIEilD
AI
& ire GSsI .I06,1-J=!f, 5= -::g
Wr-. i'.::U
furi;::-c g ro -EIg:= l:E i,''f
Lb,n:-.-lo ,aot:s-;.r4 mc ::r:il =0
(7.30)
Note that defining a variable as the szm of the years of schooling of the mother and father is equivalent,with respectto testingthe hypothesis,to defininga variableas the mean of the years of schooling of the mother and father. If the mean were soecified. the coefficientwould simply doublein size.In the presentcasethe sum is mori readily interpretablebecauseit retains the metric of the separatemeasuresfor mother and father. Estimatingthe equation,we get E : 7.93 + .236(E"); R2: .317
C;r.rn
ENlXIiff:
where E" : E * 8". Thus, we have
E: a + b(E,) : a + b (E " -lE r) : a + b (E , )+ b (E * )
L:-r-os
(7.31)
Next we comparethe two models.First, we do an F-test of the equality of the coeffi_ cients, which is equivalentto testing the significanceof the increment in R2.This can be donevery easilyin Stataby usingthe - test - command.In fact, we don't evenneedto consfucttheconstrainedmodel.We simplyissuethecomrnand - test paeduc=maeduc _ after estimating the unconstrainedmodel. This yields an F-value of 1.40, which is not significant 1p = .236); note tlat becausewe have a two-tailed test (we have hypotheses expecting either mother or father to have greaterinfluence), the conventionalsignificance level required to reject the null hypothesisis .025. Aa altemative way of comparing the models is, of course,to comparethe BlCs for the two models.To do this we needto esti_ mate the constrainedmodel. The two B1Cs,estimatedin the usual wav. are
rnr=
I :: a
hnr":,
-.:CC
re=:r:if =.r,1 ft-: .Ltr T :I:TDfl mq+r-,:c -_:: ung
5;:--s
rr-r[fs?x mlOreS ]ite S ,m: 3jC r
ry!tr:Elo r n:r=. lgl l-n.'t r_5-: I =:til t nitr r!i1*rF: G5i:r3;
rfrla
::t n
:: -as*
faultiple Regression Tricks:Techniquesfor HandlingSpecialAnalytic probtems
nling. and r to testttre ica] coeffitberelative interesting
(7.28) rtal stroDrel'er, that is to force tether the mstralned eform: (7.29)
Unconstrained:
-355.4
Constrained:
-360.9
149
lD this caseboththe BIC andtheF_testfavortheconstrained modelof no difference. Thisgeneralstrategycanbe appliedto u wio" ua.i"ty oi su*i_ij" p.oof"rnr.
TREND ANAtyStS:TESTTNG THEASSUMPTTON OFLtNEARtTy As rhe GSS hasmatured,it has becomean increasingly valuableresourcefbr the study of ;ross-temporaltrends.Becausemany questions havebeen askedin exacfly the sameway smcethe flrst GSSwasconductedin.1972,it is possible to poot tfr" Outatiom all yearsto fldy a variery of trends.Moreover, if no uiiutiJni i." 0","","a, *," Ou,u ".or._i".po.ut frr all yearscan be treatedasa sampleof the U.S. populati* in ,fr" i ,r"otieth century n generatesufficientcasesto studyrelativelysmall " iubsetsof the population. model (apart from the tim;;;;.; ;i;;;;"d) is thar there is a ._ l: trend :'To"'1.oend inear over time with respectto the outcomeof iiterest. es a first step,it is useful to :otrtrast such a model with a model that posits year_to_y"_ uuri;;;. in the outcome_ rhat Sorokinmany yearsago (1927)described ,.""rfu., as nr"i"rl,ions.,,To do this, we 60mate two models:
Y=a+bT
(7.32)
(7.30)
*her and le as the pecified, ) readily d father.
(7.31) >coeffir can be needto educ r is not otheses fcance ing the to esti-
Y=d'+bT+
\--
z-
(7.33)
s-here ? is a linear representationof time (here, the year of the surveyJ,and the Z' are dummy variablesfor eachyear the survey was conducted; note that two dummy variables mustbe omitted becausethe linear term usesup one degreeof freedom. We then compare de two-models in the uslal via an F+esi of th" ,ignin"_"" ot,t e increment _waV, in R2 and a comparison of BIC valuesA convenientway to Jo the first in Stata is to estimate Equation7.33 and then to test the hypothesis,fr"i af tfr" ,2.il1, zero,vraa Wald test using Stata's - test - command. (Note that equution", "l"a smply a different parameterizationof an equation in which the linear ierm is omitteJand oniy the dummt are included. The coefficients will, of course, Olff".. nui tt p."dicted values, 'ariables R:, and-81Cwill be identical.) If w.econclu.le that " no simpf" fln"ar ,r"nO no ,he data, we mrght then posit either a model with a-smoothcurve by inifoJirrg u ,qr*.a t"rm for Z, or a model that tries to model particular historical events by g.oupiig y"_, ioto historically meaningful groups and identifying each group ltess one') ui'u u'a'orn_y variable, or a splinemodel (seethe section"Linear Sptines,iater in tne inuf".;i""uur" ,he explainedby Equation7.33 is the maximum possible '-y'."-p."."ntution variance ftom of tr-" (measuredin years), the R'?associated with Equation ?33 ;;, ;', a standard against which to assess,in substantiverather than .t i"tty rtatr.ti"ail"r-1, ro* close various
1 50
to Testldeas QuantitativeDataAnalysis:DoingSocialResearch
sociologically motivated constrainedmodels come to fully explaining temporal variation in the dependentvariable. Although, to simplify the exposition, I have not included any variablesin the model other than time, a model actually positedby a researcherqpically would include a number of covariates(otherindependentvariables)andalso,perhaps,interactionsbetweenthecovariatesandthe variablesrepresentingtime. Exactly the samelogic would apply to suchan analysis asto the simpleranalysisjust described;the logic is alsoidentical to the dummy variable approachto the assessment of group differencesdescribedin the previouschapter(although herethe "groups" are yearsor, if warrantedby the analysis,multiyear historical periods).
Prediding Variation in Gender Role Attitudes over nme: A Worked Example Four items on attitudesregardinggender-roleequality were askedin most yearsof the GSS between 1974 and 1998.The four variablesare shownhere with the percentageendorsing the pro-equalityposition,pooledover all yearsin which all four questionswere asked: r
Do you agree or disagreewith this statement?Women should fake care of running their homesand leaverunning the country up to men (74 percentdisagree).
r
Do you approveor disapproveofa married woman earning money in businessor industry if shehas a husbandcapableof supporting her? (77 percent approve).
r
If your party nominated a woman for President, would you vote for her if she werequalifiedfor thejob? (84 percentsayyes).
r
Tell me if you agreeor disagreewith this statement:Most men are better suited emotionallyfor politics than are mostwomen(63 percentdisagee).
To form a gender-equalityscale,I simply summedthe pro-equality responsesfor tbe four items, excluding all people to whom the questionswere not askedand treating other noffesponsesas negativevalues.The point of treating "don't know" and similar responses asnegativevaluesrather than excluding them is to savecases.But this would not be wise if therewerenot substartivegroundsfor doing so-in this case,it seemedreasonableto me to treat "don't know" as somethingother than a clear-cutendorsementof genderequality.
?,I N
l
h
rN SOMEYEARSOFTHEGSS,ONLYA SUBSET OFRESPONDENTS WASASKEDCERTAIN QUESTIONSusersor the GSSneedto be awarethat to increase the numberof itemsthat can be includedin the G55 each year,some items are askedonly of subsetsof the sample.A convenientway to excludepeoplewho were not askedthe questionsis to usethe Stata-rmiss - option under the -egen- commandto countthe numberof missingdataresponses and then to exclude peoplemissingdata on all itemsincludedin a scale.However,in the currentanalysis I excludedall thosewho lackedresponses on any of the four itemsbecausesome,but not all. of the questionswere askedin someyears.
MultipleRegression Tricks: Techniques for HandlingSpecial Analyticproblems 151 u'al variation in the model rde a number enthecovarigrch an analmry variable ner(although lpenods).
s of the GSS geendorsing asked: care of runntdisagree). rbusinessor approve). r her if she
EstimathgequationssuchasEquations7.32and,7-33suggestssignificantnonlinearities in attitudes regarding gender inequality. The increment in R, implies F = 3.54 with 11and,21,448d.f.,which hasa probabilityof lessthan0.0001.Howevel the B1Cfor the lrnear trend model is more negative than the B1C for the annual variability model 'de BlCs are,respectively,-959 and -871), suggestingthat a lineartrendis morelikely siyenthe data.BecauseB1Candclassicalinferenceyield contradictoryresults,a sensible Fxt stepis to graph annualvariations in the meanlevel of support for genderequality, to Jee whether there is any obvious pattem to the nonlinearity. If substantively sensible deviationsfrom linearity are observed,the annual variation model might be accepted,or e new model, aggregatingyears into historically meaningful periods, might be posited ,teeping in mind the dangersof modifying your hypothesesbasedupon inspection of the dan-see the discussionof this issueat the end of ChapterSix), or a smoothcurve or spline function might be fitted to the data. Figure 7.4 showsboth the Iinear trend line and annualvariations in the mean.Inspecting the graph, it appearsthat deviationsfrom lineariq are neither large nor systematic. Given this, I am inclined to accept a linear trend model as the most parsimoniousrepresentationof the data, despitethe F-test results.The lineartrendis, in fact, quite substantial,implying an increaseof 0.81 (= .0338*(19981974))over the quarter of a century for which we have data; this is about 20 percent of 6e range of the scaleand is about two-thirds of the standarddeviation of the scalescores. -\pparcntly, support for gender equality has been increasing modestly but steadily ftroughout the closing years of the twentieth century. From a technical point of view, it may be helpful to comparethe estimatesimplied by rhe two altemative ways of representingdepa.rturesfrom linearity: Equation 7.33 and the
Etter suited nsesfor the tating other |I responses * be wise if ble to me to quality.
+ -
Llneartrend Mean fo. year
6 62
RES. ,sers of t in the way to l under xclu0e ls l e xta ll, of
z
1914 1976 ',19781980 19a2 19a4 1986 1988 1990 1992 1994 1996 1998
Yearof survey
FiGUfl€ 7.&, rrendin AttitudesRegardingGenderEquatity,U.s.Adutts Surveyed in 1974Through1998(LinearTrendandAnnualMeans;N = 21,464).
152
euantitativeDataAnalysrs: DoingSocialResearch to Testldeds
altemativespecificationthat doesnot incrudea linear term for year.when the rinearterm is included,two dummy variabrecategones aredropped,ratherthanone,becausethe lin_ ear terrnusesup one degreeof freedom. However,,ir" t*o pro""J*". produceidentical results. is evidentfrom inspectlon of Table7. I . ^which untortunately. thereis no simp^lecorrespondence betweenthe coelficientsin equa_ trons rhe form of Equation z.j: o"viation, ;;; .of ;;';;i"hons of rhe tinear .ana equatron.If you want to show annual depanuresf.;h;;y:;; needro construcra new variable, which is the difference u.ir""" ,fr" pr"al"i.J J"fi", ,", each year from Eq,tation7.32 and Equation 7.33.^This i..u"ry ui""_oirJf, in Srata using rhe - foreach- or -forvalues_ cornmand. "ufi1o
I
t , |. !
I
LINEARSPLTNES I
Somedmeswe encountersituationsin which we believe that the relationshipbetween tu.o variableschangesabruptly at some point on the distribution of the independentvariabre. so that neither a linear nor a curvilinear representationoi-,i" l"fu,ionrrup is adequate. c_o