Chapter 2: Sample Design and Attrition (con't)

On this page: On separate pages:

Chapter 2 part 1 Chapter 2 part 3

Table of Contents


2.5 Interview Methods

Before each survey period began, the Census Bureau generated lists of respondents to be interviewed and distributed them to 12 regional offices. Current addresses and contact information were generated from data collected during the last interview and through a postal check conducted by Census, and cases were assigned to interviewers who lived in the same geographic area as the respondent. Interviewers then received copies of the questionnaire (or a laptop computer for CAPI interviews) and (if used) respondents' Household Record Cards and flashcard and/or information booklets.

In each survey round, interviewers were responsible for contacting each respondent in their caseload and for using additional local level resources to locate those respondents who had moved since the last interview. Respondents who had moved outside the geographic district of their original interviewer were assigned to another unless there were no personnel nearby. In the latter event, an effort was made to interview the respondent by telephone.

Each respondent to be interviewed was sent various materials designed to encourage continued participation. Advance letters thanking respondents for taking part in the interviews and informing them of the coming survey were mailed prior to each interview period. Fact sheets highlighting recent research findings from each cohort's survey data were also provided. Respondents who had initially refused to participate in a survey were sent letters and some additional materials by the regional offices designed to encourage their continued participation and were once again contacted by local level interviewers to secure the interview.

While the type of survey, personal or telephone, determined the chief mode of contact, an alternate contact method was used for certain respondents. During a personal survey, for example, those respondents who lived long distances from the Census interviewer's base of operation or those for whom the Census supervisor has decided that another contact method was warranted were contacted by telephone. Although survey instruments are written in English only, multilingual interpreters were made available by the regional offices to interviewers who needed them.

Beginning in 1995, respondents in the two women's cohorts were interviewed during the same time period; a single computer-assisted personal interview (CAPI) replaced the separate paper-and-pencil interview (PAPI) instruments used during the previous interviews. While data were collected simultaneously for the two cohorts, they were released separately by cohort. This CAPI interview continued on a biennial basis through 2003.

The average length of an interview varied depending on the type conducted, with personal PAPI interviews lasting 50-60 minutes, telephone PAPI interviews averaging 20-25 minutes, and CAPI interviews lasting about 70 minutes. As a validation check, a percentage of the respondents were contacted following the interviews to ascertain that the interviews had taken place. No stipends were paid to Original Cohort respondents for their participation until 2003. During the 2003 fielding, a special incentive experiment was conducted to see how a subset of respondents responded to being offered money to participate. Variables associated with this incentive experiment are R65017.00, R76056.00-R76060.00, R76105.10, and R76105.20.

Return to top


 

2.6 Eligible Sample & Reasons for Noninterview

In general, respondents selected for interviewing each year were those who participated in the initial survey and who were alive, residing within the United States at the interview date, not members of the Armed Forces, and noninstitutionalized. (Exception: In 2003, an interview was conducted with an institutionalized respondent. See R65097.00-R65124.00.). However, the criteria used to select the eligible sample--respondents whom the Census Bureau attempts to interview in a given round--have varied somewhat over the years.

Beginning in 1969, any respondent who had refused to be interviewed during a previous round was dropped from the eligible sample. Beginning in 1971, respondents were also dropped from the eligible sample if they had not been interviewed in two consecutive surveys for reasons other than death or refusal (for example, respondents who could not be located or contacted during the field period--those with 'Reason for Noninterview' codes of 1, 2, 3, 4, 5, 6, 8, or 11). The User Notes after Table 2.6.3 describe how dropped respondents can be identified. In 1983, the Census Bureau ceased dropping individuals for these two reasons, and in 1985 attempts were made to reinterview some of the dropped individuals. The following selection criteria determined which respondents would be reinterviewed (see Table 2.6.1 for examples of each case):

  1. If the respondent refused to be interviewed in 1972 or earlier, she was not eligible to be reinterviewed. See example respondent 1.
  2. If the respondent missed her second consecutive survey in 1972 or earlier, she was not eligible to be reinterviewed. See example respondent 2.
  3. If the respondent refused an interview in 1973 or later, survey staff attempted to reinterview her in 1985. If the respondent was interviewed in 1985, she rejoined the eligible sample for all subsequent surveys. If she was not interviewed in 1985, she remained ineligible for all subsequent surveys. See example respondent 3.
  4. If the respondent was interviewed in 1971 and subsequently dropped due to two consecutive noninterviews, she was eligible for reinterview in 1985. If the respondent was interviewed in 1985, she rejoined the eligible sample for all subsequent surveys. If she was not interviewed in 1985, she remained ineligible for all subsequent surveys. See example respondent 4.
  5. If the respondent first refused to participate in 1982, she was not eligible to participate in 1983 but rejoined the eligible sample in 1985. She remained in the eligible sample regardless of her interview status in 1985. See example respondent 5 in the table.
  6. If the respondent was not interviewed in 1981 and 1982 for reasons other than death or refusal, she was never dropped from the sample. She remained eligible for all subsequent rounds regardless of prior participation. See example respondent 6.
Table 2.6.1  Selection of Respondents Eligible for 1985 Survey
Example resp. Status 1972 or previous Status 1973-82 Status 1983 Status 1985 Status 1986 and subsequent
1 Refused any 1 survey (rni=9)1 Not eligible (rni=9) Not eligible (rni=9) Not eligible (rni=9) Not eligible (rni=9)
2 Missed 2 consec. surveys (rni=1, 2, 3, 4, 5, 6, 8, 11) Not eligible (rni=12) Not eligible (rni=12) Not eligible (rni=12) Not eligible (rni=12)
3 Had not refused or missed 2 consec. surveys Eligible until refused, then not eligible (rni=9) Eligible until refused, then not eligible (rni=9) Eligible; if not interviewed, then rni=applicable code Eligible if interviewed in 1985
Not eligible if not interviewed
in 1985, rni=9
4 Had not refused or missed 2 consec. surveys Eligible until missed 2 consec. surveys, then not eligible (rni=12) Eligible until missed 2 consec. surveys, then not eligible (rni=12) Eligible; if not interviewed, then rni=applicable code Eligible if interviewed in 1985
Not eligible if not interviewed
in 1985, rni=12
5 Had not refused or missed 2 consec. surveys Refused for first time in 1982 Not eligible (rni=9) Eligible; if not interviewed, then rni=applicable code Eligible regardless of participation in 1985; if not interviewed, then rni=applicable code
6 Had not refused or missed 2 consec. surveys Missed 2nd consec. survey in 1982 Eligible (never dropped) Eligible regardless of prior participation Eligible regardless
of prior participation
1 The reason for noninterview (RNI) codes are defined in Table 2.6.3 below.

Table 2.6.2 below depicts reasons for exclusion from the eligible sample and the years each applied; Tables 2.6.4 and 2.6.5 later in this section present reasons for noninterview across survey years.

Table 2.6.2  Reasons for Exclusion from the Eligible Samples
Out-of-Scope Reason Years Exclusion Reason in Effect
Institutionalized All years. Note: in 2003 interviewers made attempts to interview respondents in institutions.
In the Armed Forces All years
Residing outside the U.S. All years
Deceased All years
Refusal during any one previous interview 1968-83. Some respondents rejoined the eligible sample in 1985 (see Table 2.6.1).
Dropped due to two consecutive noninterviews for reasons
other than refusal, death, or membership in the Armed Forces
1971-83. Some respondents rejoined the eligible sample in 1985 (see Table 2.6.1)
Congressional Refusal1 1985-present
1 Congressional Refusal refers to a congressional representative requesting a respondent not be contacted again for the NLS after a respondent has completed one or more survey rounds.

Each survey year, CHRR has created a cumulative 'Reason for Noninterview' variable for the full sample of respondents. This created variable is a combination of (1) the noninterview reasons provided by Census for the subset of respondents designated as eligible for interview in that survey year and (2) the reason for noninterview assigned during a previous survey to out-of-scope respondents. In 1982, CHRR began releasing an additional variable reflecting the reasons for noninterview for only those respondents with whom interviews were attempted that year (e.g., R07564.00). The number of respondents that Census designated as eligible for interviewing fluctuated by survey year. The eligible sample can be identified by adding together the interviewed respondents and the respondents with a noninterview code in the original 'Reason for Noninterview' variables, those not marked 'Revised Deceased.'

There was concern throughout the survey years that the number of respondents marked 'deceased' might be underreported and that some of the other 'Reason for Noninterview' categories might thus be overreported. In 2003, the Census Bureau, through the cooperation of the Social Security Administration, obtained SSA records for respondents who had shared their Social Security number with Census to verify whether or not respondents were living or deceased. As was previously suspected, a comparison of the SSA data with the survey data shows a substantially higher number of deceased respondents in the more recent surveys. To correct for past survey discrepancies, a revised 'Reason for Noninterview--Revised/Deceased' variable using the SSA data was created for each survey year from 1970 on. These revised variables are R01453.20, R02525.20, R03353.20, R04171.20, R05195.20, R05483.20, R05874.30, R07099.30, R07564.70, R08032.70, R09473.40, R10628.40, R11092.40, R12327.40, R13652.40, R16014.20, R34985.20, R42671.20, R63203.30, and R76154.00. Researchers are urged to use these updated variables rather than the original 'Reason for Noninterview' variables.

Instructions to interviewers on how to code a respondent's reason for noninterview appear within the Interviewer's Reference Manuals (or Field Representative's Manuals). The set of noninterview coding categories present during the initial survey years has been supplemented over the years with additional reasons for noninterview, and the meanings of existing categories have been refined. Table 2.6.3 presents the raw coding categories present on the public data files and specifies the survey years during which each category was utilized.

Table 2.6.3  Conceptual & Raw Coding Categories for the Reason for Noninterview Variables

Conceptual Category Raw Coding Category1 Code & Survey Years
CAN'T LOCATE Unable to locate [contact] R - reason not specified [1] All (1968-2003)
[Unable to locate R] - mover - no good address [4] All
INTERVIEW IMPOSSIBLE [Unable to locate R] - mover - good address given but
interview impossible to obtain (e.g., "moved to Germany"
or "lives too far from PSU - distance too great")2
[2] All
[Unable to locate R] - mover - good address given but
unable to obtain interview after repeated attempts, etc.
[3] All
[Unable to locate R] - nonmover - unable to obtain
interview after repeated attempts, etc.
[5] All
Temporarily absent [6] All
Other [11] All
REFUSAL Refusal [9] All
Congressional refusal3 [14] 1985-2003
OUT OF SCOPE In Armed Forces [7] All
Institutionalized [8] All4
Moved outside U.S. (other than Armed Forces) [13] 1978-2003
DECEASED Deceased [10] All
DROPPED Non-interview for two years, R dropped from sample [12] 1971-2003
1 Specific instructions to Census interviewers on use of these coding categories can be found in the cohort-specific
Interviewer's Reference Manuals.
2 Beginning in the 1979 survey year, the separate "moved outside the U.S." coding category was added as a reason
for noninterview and the "unable to locate" coding category no longer included those respondents who had moved
outside the United States.
3 Congressional refusal refers to a congressional representative requesting a respondent not be contacted again for
the NLS after a respondent has completed one or more survey rounds.
4 In 2003, interviewers sought out respondents in retirement communities, assisted living situations, and nursing homes.

 

User Notes: Researchers can use the 'Reason for Noninterview' variables to identify respondents who were dropped from the eligible sample. Respondents with a code of 12 were dropped due to missing two consecutive interviews for reasons other than death or refusal. It is more difficult to determine which respondents were dropped because they refused an interview in 1982 or earlier, because they are assigned the same code as respondents refusing an interview in later years. To identify these respondents, researchers must examine the 'Reason for Noninterview' variables for the patterns outlined in Table 2.6.1 above. Note that, because respondents are asked to report activities since the date of the last interview, most information from missed interviews was retrieved if the respondent was subsequently interviewed.

The reason for noninterview coding categories depicted in Tables 2.6.4 and 2.6.5 were constructed from the raw coding categories as shown in Table 2.6.3. For example, the conceptual category "can't locate" is the sum of codes "1" and "4." Tables 2.6.4 and 2.6.5 depict the number of respondents not interviewed by survey year, reason, and race.

Table 2.6.4 Reasons for Noninterview: 1969-2003
Survey Year Total Interviewed Total Not Interviewed Reason for Noninterview
Can't Locate Interview Impossible Refusal Out of Scope1 Deceased Dropped2
1969 4930 229 52 68 98 9 2 --
1970 4766 393 93 113 173 7 7 --
1971 4714 445 73 78 227 8 11 48
1972 4625 534 51 67 301 5 17 93
1973 4424 735 92 69 417 4 21 132
1975 4243 916 109 77 531 2 26 171
1977 4108 1051 95 61 644 2 29 220
1978 3902 1257 69 40 824 27 33 264
1980 3801 1358 45 26 910 25 41 311
1982 3650 1509 54 18 1031 28 47 331
1983 3547 1612 37 12 1153 30 49 331
1985 3720 1439 359 115 727 49 58 131
1987 3639 1520 100 47 1016 29 71 257
1988 3508 1651 111 60 1119 22 83 256
1991 3400 1759 180 39 1150 31 104 255
1993 3187 1972 215 108 1248 27 120 254
1995 3019 2140 210 170 1347 18 141 254
1997 3049 2110 274 103 1264 29 187 253
1999 2900 2259 295 89 1366 27 232 250
2001 2806 2353 295 209 1295 29 276 249
2003 2859 2300 176 131 1401 29 315 248
Note: This table is based on R00854.00, R01453.20, R02525.20, R03353.20, R04171.20, R05195.20, R05483.20, R05874.30, R07099.30,
R07564.70, R08032.70, R09473.40, R10628.40, R11092.40, R12327.40, R13652.40, R16014.20, R34985.20, R42671.20, R63203.30,
and R76154.00.
1 Beginning in 1978, "moved outside the U.S." became a separate out-of-scope coding category. Respondents who could not be interviewed during
the 1969-77 interviews because their residence--either within or outside of the U.S.--was too far away were coded within the "interview impossible"
category. Out-of-scope counts for pre-1978 survey years may thus be understated.
2 Respondents who had been noninterviews for two consecutive survey years due to reasons other than refusal or death were eliminated from the
eligible sample beginning with the 1970 interview. After 1982, no additional respondents were dropped based on this rule; in 1985, an attempt was
made to reinterview some dropped individuals. Some individuals previously coded as "dropped from sample" were coded differently in later surveys.
Table 2.6.5  Reasons for Noninterview by Race: 1969-2003
Survey Year Total Interviewed Total Not Interviewed Reason for Noninterview
Can't Locate Interview Impossible Refusal Out of Scope1 Deceased Dropped2
Non-black Black Non-black Black Non-black Black Non-black Black Non-black Black Non-black Black Non-black Black Non-black Black
1969 3530 1400 170 59 33 19 51 17 78 20 7 2 1 1 -- --
1970 3435 1331 265 128 45 48 75 38 137 36 4 3 4 3 -- --
1971 3385 1329 315 130 41 32 57 21 181 46 4 4 6 5 26 22
1972 3328 1297 372 162 21 30 44 23 239 62 1 4 8 9 59 34
1973 3194 1230 506 229 44 48 44 25 325 92 3 1 11 10 79 53
1975 3068 1175 632 284 54 55 48 29 417 114 0 2 15 11 98 73
1977 2974 1134 726 325 48 47 41 20 494 150 0 2 17 12 126 94
1978 2838 1064 862 395 29 40 25 15 617 207 19 8 20 13 152 112
1980 2769 1032 931 427 22 23 11 15 680 230 16 9 23 18 179 132
1982 2659 991 1041 468 31 23 10 8 764 267 19 9 27 20 190 141
1983 2585 962 1115 497 23 14 8 4 848 305 19 11 27 22 190 141
1985 2767 953 933 506 185 174 62 53 544 183 33 16 31 27 78 53
1987 2719 920 981 539 43 57 20 27 723 293 17 12 39 32 139 118
1988 2628 880 1072 579 50 61 28 32 799 320 13 9 43 40 139 117
1991 2552 848 1148 611 82 98 25 14 837 313 17 14 49 55 138 117
1993 2417 770 1283 689 82 133 63 45 924 324 19 8 57 63 138 116
1995 2268 751 1432 708 100 110 112 58 1000 347 11 7 71 70 138 116
1997 2287 762 1413 697 147 127 64 39 946 318 20 9 98 89 138 115
1999 2189 711 1511 748 157 138 60 29 1016 350 19 8 122 110 137 113
2001 2119 687 1581 772 166 129 142 67 970 325 22 7 144 132 137 112
2003 2115 744 1585 715 108 68 74 57 1075 326 20 9 171 144 137 111
Note: This table is based on R00032.00 (race), R00854.00, R01453.20, R02525.20, R03353.20, R04171.20, R05195.20, R05483.20, R05874.30, R07099.30, R07564.70, R08032.70, R09473.40, R10628.40, R11092.40, R12327.40, R13652.40, R16014.20, R34985.20, R42671.20, R63203.30, and R76154.00.
1 Beginning with the 1978 survey, "moved outside the U.S." became a separate out-of-scope coding category. Respondents who could not be interviewed during the 1969-77 interviews because their residence--either within or outside of the U.S.--was too far away were coded within the "interview impossible" category. Out-of-scope counts for pre-1978 survey years thus may be understated.
2 Respondents who had been noninterviews for two consecutive survey years due to reasons other than refusal or death were eliminated from the eligible sample beginning with the 1971 interview. After 1982, no additional respondents were dropped based on this rule; in 1985, an attempt was made to reinterview some dropped individuals. Some individuals previously coded as "dropped from sample" were coded differently in later surveys.