Reliability of Internet- Versus Telephone-Administered Questionnaires in a Diverse Sample of Smokers

University of Toronto

2008

University of Toronto: Research Repository T-Space

104520 bytes; 194383 bytes; 237297 bytes; 125 bytes; text/html; image/jpeg; text/xml; image/gif

1438-8871

Centers for Disease Control and Prevention (CDC). Tobacco use among adults--United States, 2005. MMWR Morb Mortal Wkly Rep Oct 27, 2006. Vol. 55(42) p. 1145-8.; Burns DM, Anderson CM, Johnson M, Major JM, Biener L, Vaughn J, Shanks TG. Cessation and Cessation Measures among Adult Daily Smokers: National and State-Specific Data. In: Population Based Smoking Cessation: Proceedings of a Conference on What Works to Influence Cessation in the General Population. Smoking and Tobacco Control Monograph No. 12 US Department of Health and Human Services; Washington, DC. 2000.; Levy David T, Romano Eduardo, Mumford Elizabeth. The relationship of smoking cessation to sociodemographic characteristics, smoking intensity, and tobacco control policies. Nicotine Tob Res Jun 2005. Vol. 7(3) p. 387-96.; Centers for Disease Control and Prevention (CDC). Annual smoking-attributable mortality, years of potential life lost, and economic costs--United States, 1995-1999. MMWR Morb Mortal Wkly Rep Apr 12, 2002. Vol. 51(14) p. 300-3.; Centers for Disease Control and Prevention (CDC). Annual smoking-attributable mortality, years of potential life lost, and productivity losses--United States, 1997-2001. MMWR Morb Mortal Wkly Rep Jul 1, 2005. Vol. 54(25) p. 625-8.; Centers for Disease Control and Prevention (CDC). Tobacco Use Among US Racial/Ethnic Minority Groups–African Americans, American Indians and Alaska Natives, Asian Americans and Pacific Islanders, and Hispanics: A Report of the Surgeon General US Department of Health and Human Services; Atlanta, GA. 1998.; US Department of Health and Human Services. Expanding the Reach and Impact of Consumer E Health Tools US Department of Health and Human Services, Office of Disease Prevention and Health Promotion; Washington, DC. 2006.; Gibbons Michael C. A historical overview of health disparities and the potential of eHealth solutions. J Med Internet Res 2005. Vol. 7(5) p. e50.; Eng Thomas R. Population health technologies: emerging innovations for the health of the public. Am J Prev Med Apr 2004. Vol. 26(3) p. 237-42.; Ahern David K. Challenges and opportunities of eHealth research. Am J Prev Med May 2007. Vol. 32(5 Suppl) p. S75-82.; US Department of Health and Human Services. Healthy People 2010: Understanding and Improving Health and Objectives for Improving Health. 2nd edition US Government Printing Office; Washington, DC. 2000.; Graham Amanda L, Abrams David B. Reducing the cancer burden of lifestyle factors: opportunities and challenges of the Internet. J Med Internet Res Jul 1, 2005. Vol. 7(3) p. e26.; Madden M. Internet penetration and impact Pew Internet & American Life Project; Washington, DC. 2006.; Fox S. Digital divisions Pew Internet & American Life Project; Washington, DC. 2005.; US Department of Commerce. A Nation Online: How Americans Are Expanding Their Use of the Internet US Department of Commerce, Economics and Statistics Administration, National Telecommunications and Information Administration; Washington, DC. 2002.; Fox S. Health information online Pew Internet & American Life Project; Washington, DC. 2005.; Fox S, Fallows D. Internet health resources: health searches and email have become more commonplace, but there is room for improvement in searches and overall Internet access Pew Internet & American Life Project; Washington, DC. 2003.; Bock B. Web-Assisted Tobacco Interventions (WATI) Initiative: Where we are, where we’re going, and some challenges along the way. Paper presented at: 13th Annual Meeting of the Society for Research on Nicotine and Tobacco; February 21-24, 2007; Austin, TX. 2007.; Lenert Leslie, Muñoz Ricardo F, Perez John E, Bansod Aditya. Automated e-mail messaging as a tool for improving quit rates in an internet smoking cessation intervention. J Am Med Inform Assoc 2004. Vol. 11(4) p. 235-40.; Lenert Leslie, Muñoz Ricardo F, Stoddard Jackie, Delucchi Kevin, Bansod Aditya, Skoczen Steven, Pérez-Stable Eliseo J. Design and pilot evaluation of an internet smoking cessation program. J Am Med Inform Assoc 2003. Vol. 10(1) p. 16-20.; Feil Edward G, Noell John, Lichtenstein Ed, Boles Shawn M, McKay H Garth. Evaluation of an Internet-based smoking cessation program: lessons learned from a pilot study. Nicotine Tob Res Apr 2003. Vol. 5(2) p. 189-94.; Cobb Nathan K, Graham Amanda L, Bock Beth C, Papandonatos George, Abrams David B. Initial evaluation of a real-world Internet smoking cessation system. Nicotine Tob Res Apr 2005. Vol. 7(2) p. 207-16.; Cheh Julie A, Ribisl Kurt M, Wildemuth Barbara M. An assessment of the quality and usability of smoking cessation information on the Internet. Health Promot Pract Jul 2003. Vol. 4(3) p. 278-87.; Bock Beth, Graham Amanda, Sciamanna Christopher, Krishnamoorthy Jenelle, Whiteley Jessica, Carmona-Barros Rosa, Niaura Raymond, Abrams David. Smoking cessation treatment on the Internet: content, quality, and usability. Nicotine Tob Res Apr 2004. Vol. 6(2) p. 207-19.; Japuntich Sandra J, Zehner Mark E, Smith Stevens S, Jorenby Douglas E, Valdez José A, Fiore Michael C, Baker Timothy B, Gustafson David H. Smoking cessation via the internet: a randomized clinical trial of an internet intervention as adjuvant treatment in a smoking cessation intervention. Nicotine Tob Res Dec 2006. Vol. 8 Suppl 1(1) p. S59-67.; Strecher Victor J, Shiffman Saul, West Robert. Randomized controlled trial of a web-based computer-tailored smoking cessation program as a supplement to nicotine patch therapy. Addiction May 2005. Vol. 100(5) p. 682-8.; Strecher Victor J, Shiffman Saul, West Robert. Moderators and mediators of a web-based computer-tailored smoking cessation program among nicotine patch users. Nicotine Tob Res Dec 2006. Vol. 8 Suppl 1(1) p. S95-101.; Graham Amanda L, Bock Beth C, Cobb Nathan K, Niaura Raymond, Abrams David B. Characteristics of smokers reached and recruited to an internet smoking cessation trial: a case of denominators. Nicotine Tob Res Dec 2006. Vol. 8 Suppl 1(1) p. S43-8.; Swartz L H G, Noell J W, Schroeder S W, Ary D V. A randomised control study of a fully automated internet based smoking cessation programme. Tob Control Feb 2006. Vol. 15(1) p. 7-12.; Etter Jean-François. Comparing the efficacy of two Internet-based, computer-tailored smoking cessation programs: a randomized trial. J Med Internet Res 2005. Vol. 7(1) p. e2.; Pike K Joanne, Rabius Vance, McAlister Alfred, Geiger Angela. American Cancer Society's QuitLink: randomized trial of Internet assistance. Nicotine Tob Res Mar 2007. Vol. 9(3) p. 415-20.; Etter Jean-François, le Houezec Jacques, Landfeldt Björn. Impact of messages on concomitant use of nicotine replacement therapy and cigarettes: a randomized trial on the Internet. Addiction Jul 2003. Vol. 98(7) p. 941-50.; NIH State-of-the-Science Panel. National Institutes of Health State-of-the-Science conference statement: tobacco use: prevention, cessation, and control. Ann Intern Med Dec 5, 2006. Vol. 145(11) p. 839-44.; Institute of Medicine, Committee on Quality of Health Care in America. Crossing the Quality Chasm: A New Health System for the 21st Century National Academies Press; Washington, DC. 2001.; Institute of Medicine, Committee on the National Quality Report on Health Care Delivery. Envisioning the National Health Care Quality Report National Academies Press; Washington, DC. 2001.; Institute of Medicine, Committee on Communication for Behavior Change in the 21st Century. Speaking of Health: Assessing Health Communication Strategies for Diverse Populations National Academies Press; Washington, DC. 2002.; Institute of Medicine. Unequal Treatment: Confronting Racial and Ethnic Disparities in Health Care National Academies Press; Washington, DC. 2002.; Muñoz Ricardo F, Lenert Leslie L, Delucchi Kevin, Stoddard Jacqueline, Perez John E, Penilla Carlos, Pérez-Stable Eliseo J. Toward evidence-based Internet interventions: A Spanish/English Web site for international smoking cessation trials. Nicotine Tob Res Feb 2006. Vol. 8(1) p. 77-87.; Byrne BM, Watkins D. The issue of measurement invariance revisited. J Cross Cult Psychol 2003. Vol. 34(2) p. 155-175.; Myers MB, Calantone RJ, Page TJ Jr, Taylor CR. An application of multiple-group causal models in assessing cross-cultural measurement equivalence. J Int Mark 2000. Vol. 8(4) p. 108-121.; Ramírez Mildred, Ford Marvella E, Stewart Anita L, Teresi Jeanne A. Measurement issues in health disparities research. Health Serv Res Oct 2005. Vol. 40(5 Pt 2) p. 1640-57.; Boeckner Linda S, Pullen Carol H, Walker Susan Noble, Abbott Gerald W Abbott, Block Torin. Use and reliability of the World Wide Web version of the Block Health Habits and History Questionnaire with older rural women. J Nutr Educ Behav 2002. Vol. 34 Suppl 1(Suppl 1) p. S20-4.; Bressani RV, Downs AC. Youth independent living assessment: testing the equivalence of Web and paper/pencil versions of the Ansell-Casey Life Skills Assessment. Comput Human Behav 2002. Vol. 18(4) p. 453.; Ritter Philip, Lorig Kate, Laurent Diana, Matthews Katy. Internet versus mailed questionnaires: a randomized comparison. J Med Internet Res Sep 15, 2004. Vol. 6(3) p. e29.; Vallejo Miguel A, Jordán Carlos M, Díaz Marta I, Comeche María I, Ortega José. Psychological assessment via the internet: a reliability and validity study of online (vs paper-and-pencil) versions of the General Health Questionnaire-28 (GHQ-28) and the Symptoms Check-List-90-Revised (SCL-90-R). J Med Internet Res 2007. Vol. 9(1) p. e2.; Graham Amanda L, Papandonatos George D, Bock Beth C, Cobb Nathan K, Baskin-Sommers Arielle, Niaura Raymond, Abrams David B. Internet- vs. telephone-administered questionnaires in a randomized trial of smoking cessation. Nicotine Tob Res Dec 2006. Vol. 8 Suppl 1(1) p. S49-57.; American Psychological Association (APA). Ethical principles of psychologists and code of conduct. Am Psychol 2002. Vol. 57(12) p. 1060-1073.; Okazaki S, Sue S. Methodological issues in assessment research with ethnic minorities. In: Kazdin AE, editor. Methodological Issues and Strategies in Clinical Research. 2nd edition American Psychological Association; Washington, DC. 1998. p. 263-281.; Office of Management and Budget. Federal Register Notice. Revisions to the Standards for the Classification of Federal Data on Race and Ethnicity. 1997 Oct 30. OMB; Velicer W F, Diclemente C C, Rossi J S, Prochaska J O. Relapse situations and self-efficacy: an integrative model. Addict Behav 1990. Vol. 15(3) p. 271-83.; Coppotelli H C, Orleans C T. Partner support and other determinants of smoking cessation maintenance among women. J Consult Clin Psychol Aug 1985. Vol. 53(4) p. 455-60.; Mermelstein R, Lichtenstein E, McIntyre K. Partner support and relapse in smoking-cessation programs. J Consult Clin Psychol Jun 1983. Vol. 51(3) p. 465-6.; Cohen S, Lichtenstein E. Partner behaviors that support quitting smoking. J Consult Clin Psychol Jun 1990. Vol. 58(3) p. 304-9.; Roski J, Schmid L A, Lando H A. Long-term associations of helpful and harmful spousal behaviors with smoking cessation. Addict Behav 1996. Vol. 21(2) p. 173-85.; McMahon S D, Jason L A. Social support in a worksite smoking intervention. A test of theoretical models. Behav Modif Apr 2000. Vol. 24(2) p. 184-201.; Gruder C L, Mermelstein R J, Kirkendol S, Hedeker D, Wong S C, Schreckengost J, Warnecke R B, Burzette R, Miller T Q. Effects of social support and relapse prevention training as adjuncts to a televised smoking-cessation intervention. J Consult Clin Psychol Feb 1993. Vol. 61(1) p. 113-20.; Cohen S, Lichtenstein E, Prochaska J O, Rossi J S, Gritz E R, Carr C R, Orleans C T, Schoenbach V J, Biener L, Abrams D. Debunking myths about self-quitting. Evidence from 10 prospective studies of persons who attempt to quit smoking by themselves. Am Psychol Nov 1989. Vol. 44(11) p. 1355-65.; Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav Dec 1983. Vol. 24(4) p. 385-96.; Cohen S, Williamson GM. Perceived stress in a probability sample of the United States. In: Spacapan S, Oskamp S, editors. The Social Psychology of Health Sage; Newbury Park, CA. 1988. p. 31-67.; Andresen E M, Malmgren J A, Carter W B, Patrick D L. Screening for depression in well older adults: evaluation of a short form of the CES-D (Center for Epidemiologic Studies Depression Scale). Am J Prev Med 1994. Vol. 10(2) p. 77-84.; Anda R F, Williamson D F, Escobedo L G, Mast E E, Giovino G A, Remington P L. Depression and the dynamics of smoking. A national perspective. JAMA Sep 26, 1990. Vol. 264(12) p. 1541-5.; Niaura R, Britt D M, Borrelli B, Shadel W G, Abrams D B, Goldstein M G. History and symptoms of depression among smokers during a self-initiated quit attempt. Nicotine Tob Res Sep 1999. Vol. 1(3) p. 251-7.; Pomerleau Cynthia S, Zucker Alyssa N, Stewart Abigail J. Patterns of depressive symptomatology in women smokers, ex-smokers, and never-smokers. Addict Behav Apr 2003. Vol. 28(3) p. 575-82.; Lerman C, Audrain J, Orleans C T, Boyd R, Gold K, Main D, Caporaso N. Investigation of mechanisms linking depressed mood to nicotine dependence. Addict Behav 1996. Vol. 21(1) p. 9-19.; Zhu Shu-Hong, Valbø Annelill. Depression and smoking during pregnancy. Addict Behav 2002. Vol. 27(4) p. 649-58.; Munafò Marcus R, Hitsman Brian, Rende Richard, Metcalfe Chris, Niaura Raymond. Effects of progression to cigarette smoking on depressed mood in adolescents: evidence from the National Longitudinal Study of Adolescent Health. Addiction Jan 2008. Vol. 103(1) p. 162-71.; Benjet C, Wagner F A, Borges G G, Medina-Mora M E. The relationship of tobacco smoking with depressive symptomatology in the Third Mexican National Addictions Survey. Psychol Med Jul 2004. Vol. 34(5) p. 881-8.; McClure Jennifer B, Wetter David W, de Moor Carl, Cinciripini Paul M, Gritz Ellen R. The relation between alcohol consumption and smoking abstinence: results from the Working Well Trial. Addict Behav 2002. Vol. 27(3) p. 367-79.; Shiffman S, Hickcox M, Paty J A, Gnys M, Kassel J D, Richards T J. Progression from a smoking lapse to relapse: prediction from abstinence violation effects, nicotine dependence, and lapse characteristics. J Consult Clin Psychol Oct 1996. Vol. 64(5) p. 993-1002.; Centers for Disease Control and Prevention. 2002 Behavioral Risk Factor Surveillance System. 2001 Dec 27.; Brown R L, Leonard T, Saunders L A, Papasouliotis O. A two-item conjoint screen for alcohol and other drug problems. J Am Board Fam Pract 2001. Vol. 14(2) p. 95-106.; Ware J E, Sherbourne C D. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care Jun 1992. Vol. 30(6) p. 473-83.; Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull 1979. Vol. 86(2) p. 420-428.; SAS/STAT Software. Changes and Enhancements SAS Institute, Inc; Cary, NC. 2001.; Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd edition Lawrence Erlbaum; Hillsdale, NJ. 1988.; Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas 1960. Vol. 20(1) p. 37-46.; Cook RJ. Kappa and its dependence on marginal rates. In: Armitage P, Colton T, editors. The Encyclopedia of Biostatistics Wiley; New York. 1998. p. 2166-2168.; Landis J R, Koch G G. The measurement of observer agreement for categorical data. Biometrics Mar 1977. Vol. 33(1) p. 159-74.; Lee JJ, Tu ZN. A better confidence for kappa on measuring agreement between two raters with binary outcomes. J Comput Graph Stat 1994. Vol. 3(3) p. 301-321.; Fleiss JL, Cohen J, Everitt BS. Large sample standard errors of kappa and weighted kappa. Psychol Bull 1969. Vol. 72(5) p. 323-327.; Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 1968. Vol. 70(4) p. 213-220.; Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika 1951. Vol. 16(3) p. 297-333.; van Zyl J M, Neudecker H, Nel D G. On the distribution of the maximum likelihood estimator of Cronbach's alpha. Psychometrika 2000. Vol. 65(3) p. 271-280.; DeNavas-Walt C, Proctor BD, Lee CH. US Census Bureau. Income, Poverty, and Health Insurance Coverage in the United States: 2006 Aug. census.gov; Amanda L Graham, George D Papandonatos. Reliability of Internet- Versus Telephone-Administered Questionnaires in a Diverse Sample of Smokers. J Med Internet Res 2008;10(1):e8; http://hdl.handle.net/1807/16658

10.2196/jmir.987

http://hdl.handle.net/1807/16658
http://dx.doi.org/ 10.2196/jmir.987

© Amanda L Graham, George D Papandonatos. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 26.03.2008. Except where otherwise noted, articles published in the Journal of Medical Internet Research are distributed under the terms of the Creative Commons Attribution License (http://www.creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided 1) the original work is properly cited, including full bibliographic details and the original article URL on www.jmir.org, and 2) this statement is included.

edsbas.FC44DC60