Original Research ARTICLE
Telephone surveys underestimate cigarette smoking among African-Americans
- 1Center for Health Disparities, East Carolina University, Greenville, NC, USA
- 2Department of Psychiatric Medicine, Brody School of Medicine, East Carolina University, Greenville, NC, USA
- 3California Black Health Network, San Diego, CA, USA
- 4Department of Psychology, San Diego State University, San Diego, CA, USA
- 5School of Public Health, University of Memphis, Memphis, TN, USA
Background: This study tested the hypothesis that data from random digit-dial telephone surveys underestimate the prevalence of cigarette smoking among African-American adults.
Method: A novel, community-sampling method was used to obtain a statewide, random sample of N = 2118 California (CA) African-American/Black adults, surveyed door-to-door. This Black community sample was compared to the Blacks in the CA Health Interview Survey (N = 2315), a statewide, random digit-dial telephone survey conducted simultaneously.
Results: Smoking prevalence was significantly higher among community (33%) than among telephone survey (19%) Blacks, even after controlling for sample differences in demographics.
Conclusion: Telephone surveys underestimate smoking among African-Americans and probably underestimate other health risk behaviors as well. Alternative methods are needed to obtain accurate data on African-American health behaviors and on the magnitude of racial disparities in them.
Cigarette smoking contributes to cancers and other chronic diseases (1). To plan and implement strategies to reduce smoking, valid data on its prevalence are needed (1). Random digit-dial telephone surveys (RDDTS) are a common source of such data. Well-known RDDTS include the nationwide Behavioral Risk Factor Surveillance System [BRFSS (2)], the California Health Interview Survey [CHIS (3)], and state-level BRFSS (4); each is a trusted source whose data play a role in identifying health problems and allocating resources to address them. There are four methodological reasons to suspect that these and other RDDTS contain non-representative African-American/Black samples whose smoking rates underestimate Black population prevalence: (1) non-coverage bias, (2) non-response bias, (3) segregation bias, (4) and social-desirability bias.
First, a landline telephone is required to participate in RDDTS, and hence RDDTS exclude phoneless and cell-phone only households (5–8). By so doing, RDDTS inadvertently exclude many Blacks, men, young-adults, and people of low-socioeconomic status (SES) because these groups are more likely to be phoneless/cell-phone only (5–8). Moreover, people without landlines have significantly higher smoking rates. For example, among 2004–2005 and 2007 National Health Interview Survey participants [NHIS, an in-person (household) interview], smoking rates by telephone-status were phoneless = 36.9%, cell-phone-only = 32.9%, landline = 19.7% (5–8). This non-coverage bias raises questions about the accuracy of smoking-prevalence data from Black RDDTS samples (5–8).
Second, response rates to RDDTS are low, i.e., 10–20% (2–5). This raises the possibility of non-response bias, i.e., that the small percentage of people who participate differ systematically from the majority who do not (2–5). Black participation in RDDTS is even lower (9, 10). For example, a recent study of methods for recruiting Blacks to research achieved a 17.5% overall response rate (10), with 15.4% completing the mail survey, 1.9% the internet survey, and only 0.2% completing the telephone survey. Such low participation means that Black RDDTS samples are unlikely to be representative of the population. Moreover, Black RDDTS samples are 60–70% female, and hence may contain too few Black men for reliable population estimates of Black men’s smoking (2–4). Blacks’ high non-response rate (low research participation) is widely understood as a function of distrust of researchers, and dissatisfaction with their failure to improve health in the Black communities they study (11).
Third, Blacks who reside in segregated (mostly Black) neighborhoods are significantly less likely to participate in RDDTS than their non-segregated cohorts (9, 12). Because most (65–70%) of the U.S. Black population resides in segregated neighborhoods (13), their low participation raises questions about the representativeness of Black RDDTS samples (i.e., segregation bias) (9, 12). Moreover, segregated Blacks have significantly higher smoking rates than their non-segregated cohorts due to higher access to tobacco and tobacco-industry sponsorship of music and sporting events in Black neighborhoods (14). Segregated Blacks are similarly underrepresented in household surveys such as the NHIS (9, 12).
Finally, people tend to exhibit socially desirable responding (SDR) in household- and telephone-interview health surveys (15). SDR is the tendency to present oneself in a positive light irrespective of the veracity of that presentation (15). Common socially desirable responses in health surveys are false claims of cancer screening (16), and denial of tobacco and other substance use (17). SDR is highest in household-interviews, next highest in RDDTS, and lowest in anonymous mail surveys (15–17). SDR also is more common among Blacks (18–20). For example, in the Third National Health and Nutrition Examination Survey (NHANES-III, a household survey with biologic measures taken), Black cotinine-determined smokers were four to nine times more likely than Whites to deny smoking (20); 68% of cotinine-determined Black-women smokers denied smoking (self-reported non-smoking). Black SDR increases when actual (in-person) and presumed (internet, computer-assisted interview, RDDTS) Whites ask the questions (21). This social-desirability bias is a well-known threat to the validity of household and telephone health surveys of African-Americans/Blacks (18–21).
These four types of method bias suggest that RDDTS of Blacks acquire random but non-representative samples of mostly female, mostly older, mostly higher-SES, landline-phone owner residents of integrated neighborhoods whose smoking prevalence underestimates Black population prevalence. This implies that a new method may be needed (22, 23) to obtain large, representative samples of Black adults, and acquire the epidemiologic data that are critical to reducing health disparities. As noted, such a method must include phoneless/cell-phone-only Blacks (reduce non-coverage bias); increase Black response rates (reduce non-response bias) by decreasing distrust of researchers and giving back to the Black communities studied; include larger percentages of segregated Blacks (reduce segregation bias) and of Black men; and reduce Blacks’ high SDR (reduce social-desirability bias). Collaborating with Black community organizations and using community-based participatory research (CBPR) approaches are the recommended methods (22, 23), but have not been used to obtain random samples in epidemiologic surveys. This study is the first to use those methods to acquire a statewide, random sample of Blacks, and the first to directly compare such a sample to an RDDTS sample acquired simultaneously.
Materials and Methods
Participants were a random, statewide sample of N = 2118, US-born, self-identified Black adult residents of California (CA), 1214 women (57.3%) and 904 men (42.7%), whose ages ranged from 18 to 95 years (mean = 43.8, SD = 16.2 years).
Community-based sampling (CBS), CBPR approaches, and anonymous-written survey methods were used. CBS is a three-stage, random-probability, household sampling procedure used to assure inclusion of segregated, linguistically isolated, and phoneless/cell-phone only minorities, and hence more representative ethnic-minority samples (12, 24, 25). In Stage 1, census data were used to identify the counties in which the majority of CA Blacks reside. This revealed that most (94%) of the CA Black population resided in seven counties, e.g., Los Angeles (42%), Riverside (10%), Sacramento (10%). Blacks were sampled proportional to county representation: 42% of the sample was obtained in Los Angeles county and 10% in Riverside county (etc.), such that the sample matched the CA Black population. This was achieved by sampling more or fewer census tracts in each county as needed (25).
In Stage 2, 513 census tracts (CTS) within the 7 counties were randomly selected. In Stage 3, equal numbers of low- (20–50% Blacks) and high-segregated (60–92% Blacks) CTS were randomly selected from the 513, and block-groups within those then randomly selected. Every household in the block-groups was sampled door-to-door on weekends, with one adult participant permitted per household. The door-to-door method assured inclusion of the phoneless/cell-phone-only. Further details on the method are provided elsewhere (25).
The CBPR aspect of the study was collaboration with the California Black Health Network (CBHN), a well-known, trusted, community organization that has conducted health promotion programs statewide for CA Blacks since the 1970s. CBHN needed a statewide health-assessment to improve its programs, and so co-sponsored the study. CBHN hired Black surveyors from each community to collect data in that community. Surveyors wore CBHN ID badges, approached all households in the block-groups, introduced themselves as CBHN staff, and stated that the purpose of the survey was to acquire data needed to improve CBHN programs in each Black community. Surveyors handed potential participants an Informed Consent Letter that described the survey, stated this study purpose, and included CBHN phone numbers (in each county) to call. Surveyors then asked if a Black adult resided in the household who might wish to complete the anonymous, CBHN health survey for $10 cash. Using these CBPR approaches, the response rate was 99%, i.e., of those who answered the door, 99% completed and only 1% refused the survey (25).
To further reduce social-desirability bias, the novel approach of distributing an anonymous written survey (similar to mail-surveys) was used instead of interviews. Surveys were left with participants to complete in private, and retrieved 20–30 min later. The study had the approval of the Institutional Review Board of San Diego State University.
The survey asked standard (NHIS, BRFSS) questions about health behavior (diet, exercise) and about tobacco use: have you smoked 100 cigarettes or more in your entire life (yes/no), and do you smoke cigarettes now, even once in a while (yes/no). Telephone status (phoneless, cell-phone-only, landline) and demographic variables also were assessed.
Analyses compare the 2007 community-based (CBS) Black sample (N = 2118) to the Black (N = 2315) and White (N = 31,388) samples in the 2007 CA Health Interview Survey [CHIS (3)]. The CHIS was a statewide, RDDTS of N = 51,048 CA adults conducted simultaneously (2006–2007). Chi-square and ANOVAs were used to compare samples, with follow-up z- and t-tests used for pairwise comparisons of proportions and means, respectively.
Table 1 compares the CBS and RDDTS Black samples on demographics and cigarette smoking. As shown, the CBS sample was more diverse in age, and was younger; 58.4% of CBS versus 77% of RDDTS Blacks were ≥age 40. The CBS sample also contained significantly larger percentages of Black men and of low-income adults. Smoking prevalence among CBS Blacks was 32.6%, and significantly higher than that of RDDTS Blacks (19.1%), for women (CBS = 29.7% vs. RDDTS = 18%) and men (CBS = 37.2% vs. RDDTS = 21.1%).
About 83% of the CBS sample answered questions on their telephone status (n = 1752). Of these, 13% (n = 230) were phoneless or cell-phone only (P/CPO). Table 2 compares CBS P/CPO to CBS-landline and RDDTS Blacks. As shown, P/CPO Blacks (mean age = 37.7) were significantly younger than CBS-landline (mean age = 45.3) and RDDTS Blacks (mean age = 52.3). The P/CPO Black sample also contained a significantly larger percentage of men (56%) than the CBS-landline (40.6%) and RDDTS (34.8%) samples, and had significantly lower incomes: 45.2% of P/CPO Blacks were in the lowest-income group vs. 13.2% of RDDTS Blacks. Smoking prevalence among P/CPO Blacks was 50.2 vs. 29.5% for CBS-landline and 19.1% for RDDTS Blacks.
The differences (Table 1) between the CBS and RDDTS samples on demographic and telephone variables might account for their differences in smoking rates. To examine this, a hierarchical logistic regression predicting smoking among the combined samples was conducted, with demographic and telephone variables entered on Step 1, and Sample on Step 2. As shown in Table 3, demographic and telephone variables contributed to smoking. The odds of smoking were higher for those with low educations and incomes, ages 26–39, men, and the P/CPO. Adding Sample on Step 2 significantly improved model fit (), and revealed that the odds of smoking were higher for CBS than RDDTS Blacks: Even after controlling for demographic and telephone differences between the samples, CBS Blacks remained nearly twice as likely to be smokers than RDDTS Blacks.
Table 4 compares smoking prevalence among CBS Blacks vs. RDDTS Blacks and Whites. As shown, the smoking rate among RDDTS Blacks (19.1%) was significantly higher than that of RDDTS Whites (13%), but the difference was small, i.e., 6% points. Smoking prevalence among CBS Blacks (32.6%) also was significantly higher than that of RDDTS Whites, but the difference was large, i.e., 19.5% points.
This study has four important results. First, an unprecedented 99% participation rate among African-American/Black adults was achieved. Factors that probably contributed to this were CBHN sponsorship of the study; use of an anonymous, written survey, and of Black surveyors from the communities studied; and CBHN’s commitment to return to improve health in those communities. Participants’ comments revealed that the latter was the key: again and again, participants said that they were weary of being “studied,” wanted something to be done, and would participate because CBHN intended to do something for them. That about 15% of participants refused the $10 incentive and instructed us to use it for CBHN health programs is consistent with participant comments. If this explains the high participation rate, then it suggests that one effective way to increase Blacks’ participation in research might be to give something to the communities studied.
Because the response rate was high, over-sampling was not needed; census tracts were sampled once. Consequently, the cost of the study was about $100 per participant (incentive included). This is far less than RDDTS [about $400 per participant in the CHIS3 (3), with no monetary incentive] in which Black households must be telephoned repeatedly to acquire a similar sample size (N = 2118 here, N = 2315 in the CHIS sample).
A second notable finding is that 13% of the sample reported being phoneless/cell-phone only (P/CPO). Although substantial, only 83% of participants answered the telephone-status question. If those who didn’t answer also were P/CPO, then the P/CPO rate among CA Blacks might have been as high as 30%. In any event, smoking rates among P/CPO Blacks – those who cannot participate in RDDTS – were extremely high, 53% among women, 48% among men. This raises serious doubts about the accuracy of RDDTS data on Black smoking prevalence and the nature of gender differences in it.
The third notable finding is that the CBS sample was more representative of the CA Black population (more similar to census data (26)) than the RDDTS sample. As expected, the RDDTS Black sample consisted of mostly older (77% >age 40) women (65%), whereas the CBS sample contained significantly more young adults and Black men. Indeed, men comprise 48.7% of the CA Black population (26), and 42.7% of the CBS sample, but only 34.8% of the RDDTS sample.
Finally, the fourth important finding was that smoking prevalence among CBS Blacks (32.6%) was significantly higher than that of the RDDTS Blacks (19.1%) sampled simultaneously, and remained twice as high after controlling for differences between the samples in income, education, gender, age, and telephone-status. Smoking-prevalence differences were not an artifact of those factors, and hence are probably a function of survey method. This in turn suggests that the RDDTS method significantly underestimates smoking among Blacks, and by implication, may underestimate other health risk behaviors as well. This interpretation is consistent with growing concerns about using RDDTS with low-SES and Black populations (5–9). Thus, we urge caution in using RDDTS data to draw conclusions about smoking (and other health risk behaviors) among Blacks.
Why were smoking rates significantly higher among CBS Blacks even after controlling for sample demographics and telephone-status? One possibility is that segregated Blacks were deliberately included in the CBS sample but not in the RDDTS sample. Smoking rates are significantly higher among segregated Blacks due to higher access to tobacco, greater exposure to targeted tobacco-advertising, and tobacco-industry sponsorship of events in segregated neighborhoods (14, 27). However, multi-level modeling (not shown) found no association between segregation and smoking within the CBS sample. Nonetheless, it is possible that the segregation level of CBS Blacks was higher than that of RDDTS Blacks and contributed to higher smoking among the former. If this is the case, then it highlights the need to include more segregated Blacks in epidemiologic surveys (9, 12), and underscores the non-representativeness of RDDTS Black samples.
An alternative, perhaps more likely explanation for the findings is that there was significantly lower SDR – i.e., denial of smoking – among CBS than among RDDTS Black smokers, for two reasons. First, an anonymous, written survey rather than a telephone or in-person interview survey was used. Ample data indicate that the latter methods elicit higher SDR and higher denial of smoking, among Blacks in particular (15, 17, 18, 20). Second, our surveyors were Blacks, and studies indicate that they elicit lower SDR from Black respondents (18, 21). If low SDR among CBS Blacks explains their higher smoking rate, then it suggests that anonymous, written surveys distributed to Blacks by Blacks may increase the validity of Blacks’ self-reported smoking.
The latter point highlights a problem inherent in all surveys of health behavior, namely, their reliance on self-reports that are subject to SDR, and the possibility that disparities-data based on such reports are attenuated by Blacks’ differentially high SDR. In the larger social context of racial stratification, segregation and discrimination, many Blacks (justifiably) distrust White researchers (11), and so may provide self-protective, socially desirable responses that (ironically) obscure their health behaviors and health needs. This implies that the prevalence of smoking and other health risk behaviors among Black adults, and the magnitude of Black-White health-behavior disparities may be unknown. Moreover, given that SDR is higher in household- than in telephone-interviews (15, 20), we also urge caution in using self-report data from household surveys (e.g., NHANES-III, NHIS) to draw conclusions about the prevalence of smoking and other health behaviors among Blacks (20).
The 33% smoking-prevalence rate found also has implications for understanding Black-White cancer disparities. For the past 25 years, RDDTS and household surveys alike have found that smoking rates are 2–6% points higher among Blacks than Whites (28), a finding replicated here when comparing RDDTS Blacks and Whites (Table 4). This finding is troublesome because the difference is too small to account for large Black-White disparities in smoking-related cancers and diseases, and too small to indicate a need for targeted tobacco-cessation programs for Blacks (28). The data here suggest that the Black-White smoking-prevalence difference might be as large as 19% points, a difference that (if consistent for prior generations) might explain racial disparities in incidence of smoking-related diseases. In any event, the 33% smoking-prevalence rate underscores the need for smoking-cessation programs for CA Blacks, and for increased funding opportunities for those.
These interpretations must be considered in the context of the limitations of this study. One obvious limitation is that we did not measure SDR, and hence only can speculate that it contributed to sample differences in self-reported smoking. Replications that assess SDR are needed to clarify this, but must use SDR scales with caution in light of their lack of cross-cultural measurement equivalence (18). A similar limitation is the lack of segregation data for the RDDTS sample, these unavailable in the CHIS. Hence we only can speculate that possible sample differences in segregation might have contributed to differences in smoking. Likewise, we speculated but did not demonstrate that the differences in smoking for the CBS vs. RDDTS samples generalize to other health risk behaviors among Blacks as well. However, given that the four types of method bias inherent in RDDTS of Blacks remain irrespective of the specific health behavior examined, this speculation is both logical and reasonable. In addition, recent RDDTS health surveys have begun to include cell-phone-only households. This methodological improvement however does not resolve the other three method problems inherent in RDDTS of Blacks. Finally, smoking rates may have changed between this study and the present.
Despite these limitations, the study has several strengths. These include a random, representative, statewide sample of >2,000 Black adults; development of a novel, inexpensive, efficient, health-survey methodology that has the potential to advance research on Blacks; and the first direct demonstration of the troubles inherent in using the RDDTS method with Blacks. Thus, we encourage replication of this study with multiple, self-reported health behaviors and chronic diseases. Such replications have the potential to improve the epidemiologic data on health and health disparities that are critical to developing targeted interventions, and essential to demonstrating the need for them.
Hope Landrine, PhD: (1) conception and design of study; supervision of data collection; data analyses and interpretation; (2) drafting the manuscript, critical revision of the manuscript; (3) final approval of the submitted version. Irma Corral, PhD, MPH: (1) conception and design of study; supervision of data collection; data analyses and interpretation; (2) drafting the manuscript, critical revision of the manuscript; (3) final approval of the submitted version. Denise Adams Simms, MPH: (1) conception and design of study; supervision of data collection; data analyses and interpretation; (2) drafting the manuscript, critical revision of the manuscript; (3) final approval of the submitted version. Scott Roesch, PhD: (1) data analyses and interpretation; supervision of data collection; (2) drafting the manuscript, critical revision of the manuscript; (3) final approval of the submitted version. Latrice C. Pichon, Ph.D., MPH: (1) data analyses and interpretation; data collection; (2) drafting the manuscript, critical revision of the manuscript; (3) final approval of the submitted version. Diane Ake, MPH: MPH: (1) data analyses and interpretation; data collection; (2) drafting the manuscript, critical revision of the manuscript; (3) final approval of the submitted version. Feion Villodas, MS, MPH: MPH: (1) data analyses and interpretation; data collection; (2) drafting the manuscript, critical revision of the manuscript; (3) final approval of the submitted version.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Supported by funds provided by Tobacco-Related Disease Research Program Grant No. 15 AT-1300.
2. Behavioral Risk Factor Surveillance System. Available from: www.cdc.gov/brfss
3. California Health Interview Survey. Available from: www.chis.ucla.edu
4. Georgia Behavioral Risk Factor Surveillance System. Available from: www.oasis.state.ga.us/brfss
5. Blumberg SJ, Luke JV, Cynamon ML. Telephone coverage and health survey estimates: evaluating the need for concern about wireless substitution. Am J Public Health (2006) 96:926–31. doi:10.2105/AJPH.2004.057885
6. Blumberg SJ, Luke JV. Wireless Substitution: Early Release of Estimates from the National Health Interview Survey. (2008). Available from: www.cdc.gov
8. Shebl F, Poppell CE, Zhan M, Dwyer DM, Hopkins AB, Groves C, et al. Measuring health behaviors and landline telephones: potential coverage bias in a low-income, rural population. Public Health Rep (2009) 124:495–502.
10. Satia JA, Galanko JA, Rimer BK. Methods and strategies to recruit African-Americans into cancer prevention surveillance studies. Cancer Epidemiol Biomarkers Prev (2005) 14(3):718–21. doi:10.1158/1055-9965.EPI-04-0132
14. Corral I, Landrine H, Hao Y, Zhao L, Mellerson JL, Cooper DL. Residential segregation, health behavior, and overweight/obesity among a national sample of Black adults. J Health Psychol (2012) 17:371–8. doi:10.1177/1359105311417191
15. Nelson DE, Powell-Griner E, Town M, Kovar MG. A comparison of national estimates from the National Health Interview Survey and the Behavioral Risk Factor Surveillance System. Am J Public Health (2003) 93(8):1335–41. doi:10.2105/AJPH.93.8.1335
16. Johnson TP, O’Rourke DP, Burris JE, Warnecke RB. An investigation of the effects of social desirability on the validity of self-reports of cancer screening behaviors. Med Care (2005) 43:565–73. doi:10.1097/01.mlr.0000163648.26493.70
19. McPhee SJ, Nguyen TT, Shema SJ, Nguyen B, Somkin C, Vo P, et al. Validation of recall of breast and cervical cancer screening by women in an ethnically diverse population. Prev Med (2002) 35:463–73. doi:10.1006/pmed.2002.1096
21. Krysan M, Cooper MP. Race in the live and the virtual interview: racial differences, social desirability, and activation effects in attitude surveys. Soc Psychol Q (2003) 66:364–83. doi:10.2307/1519835
22. Carroll JK, Yancey AK, Spring B, Figueroa-Moseley C, Mohr DC, Mustian KM, et al. What are successful recruitment and retention strategies for underserved populations? Transl Behav Med (2011) 1(2):234–51. doi:10.1007/s13142-011-0034-2
23. Minkler M. Linking science and policy through community- based participatory research to study and address health disparities. Am J Public Health (2010) 100(S1):S81–7. doi:10.2105/AJPH.2009.165720
24. Cabral DN, Napoles-Springer AM, Miike R, McMillan A, Sison JD, Wrensch MR, et al. Population- and community-based recruitment of African Americans and Latinos. Am J Epidemiol (2003) 158:272–9. doi:10.1093/aje/kwg138
26. African-American Population. Available from: www.blackdemographics.com/california
28. Fagan P, Moolchan ER, Lawrence D, Fernander A, Ponder PK, et al. Identifying health disparities across the tobacco continuum. Addiction (2007) 102(Suppl2):5–29. doi:10.1111/j.1360-0443.2007.01952.x
Keywords: smoking, blacks, telephone health surveys, methodology
Citation: Landrine H, Corral I, Simms DA, Roesch SC, Pichon LC, Ake D and Villodas F (2013) Telephone surveys underestimate cigarette smoking among African-Americans. Front. Public Health 1:36. doi: 10.3389/fpubh.2013.00036
Received: 24 July 2013; Accepted: 06 September 2013;
Published online: 25 September 2013.
Edited by:Zhulin He, National Institute of Statistical Science, USA
Reviewed by:Mildred Audrey Pointer, North Carolina Central University, USA
Li Tang, St. Jude Children’s Research Hospital, USA
Copyright: © 2013 Landrine, Corral, Simms, Roesch, Pichon, Ake and Villodas. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Hope Landrine, Center for Health Disparities, East Carolina University, 1800 W. 5th Street, Greenville, NC 27858, USA e-mail: firstname.lastname@example.org