Browse > Article
http://dx.doi.org/10.3961/jpmph.2010.43.5.403

Test-Retest Reliability of a Questionnaire for the Korea Youth Risk Behavior Web-Based Survey  

Bae, Ji-Suk (Department of Preventive Medicine, Catholic University of Daegu School of Medicine)
Joung, Hyo-Jee (Seoul National University School of Public Health)
Kim, Jong-Yeon (Department of Preventive Medicine, Catholic University of Daegu School of Medicine)
Kwon, Kyoung-Nam (Lotte Samkang Co., Ltd.)
Kim, Young-Taek (Korea Centers for Disease Control and Prevention)
Park, Soon-Woo (Department of Preventive Medicine, Catholic University of Daegu School of Medicine)
Publication Information
Journal of Preventive Medicine and Public Health / v.43, no.5, 2010 , pp. 403-410 More about this Journal
Abstract
Objectives: A web-based survey has been administered annually since 2005 throughout Korea to assess the prevalence of adolescent health risk behaviors among middle and high school students. The aim of this study was to evaluate the test-retest reliability of the Korea Youth Risk Behavior Web-based Survey (KYRBWS) questionnaire. Methods: A convenience sample of 2298 middle and high school students participated in self-administered questionnaire surveys twice, approximately two weeks apart, in 2008. The percent agreement, kappa statistics, and prevalence rates at the first and second surveys were computed for the core subset of 39 self-reported health risk behavior indices of the KYRBWS. Results: Among 39 indices, seven indices had kappas $\geq$ 0.81 and all of the indices had kappas $\geq$ 0.41. Based on nonoverlapping 95% confidence intervals, three indices had significantly different prevalence rates between the first and second surveys. In the subgroup analyses by school grade and gender, two indices had significantly different reliability estimates between middle and high school students. There were no significantly different reliability estimates between male and female students, except for one index. Conclusions: This study demonstrated that the reliability estimates for the KYRBWS questionnaire are varied, but generally reliable over time. The indices with low reliability estimates need to be evaluated further in order to determine whether the indices should be modified or deleted from future versions of the KYRBWS.
Keywords
Adolescent; Health surveys; Questionnaires; Reproducibility of results;
Citations & Related Records

Times Cited By SCOPUS : 15
연도 인용수 순위
1 Mokdad AH, Marks JS, Stroup DF, Gerberding JL. Actual causes of death in the United States, 2000. JAMA 2004; 291(10): 1238-1245.   DOI   ScienceOn
2 Booth ML, Okely AD, Chey T, Bauman A. The reliability and validity of the physical activity questions in the WHO health behaviour in schoolchildren (HBSC) survey: a population study. Br J Sports Med 2001; 35(4): 263-267.   DOI   ScienceOn
3 Cicchetti DV, Feinstein AR. High agreement but low kappa: II. Resolving the paradoxes. J Clin Epidemiol 1990; 43(6): 551-558.   DOI   ScienceOn
4 Brener ND, Billy JO, Grady WR. Assessment of factors affecting the validity of self-reported health-risk behavior among adolescents: evidence from the scientific literature. J Adolesc Health 2003; 33(6): 436-457.   DOI   ScienceOn
5 Byrt T, Bishop J, Carlin JB. Bias, prevalence and kappa. J Clin Epidemiol 1993; 46(5): 423-429.   DOI   ScienceOn
6 Turner CF, Lessler JT, Devore JW. Effect of mode of administration and wording and reporting of drug use. In: Turner CF, Lessler JT, Gfroerer JC, editors. Survey Measurement of Drug Use: Methodological Studies. Washington, DC: Government Printing Office; 1992. p. 177-220.
7 Turner CF, Ku L, Rogers SM, Lindberg LD, Pleck JH, Sonenstein FL. Adolescent sexual behavior, drug use, and violence: Increased reporting with computer survey technology. Science 1998; 280(5365): 867-873.   DOI   ScienceOn
8 Kann L, Brener ND, Warren CW, Collins JL, Giovino GA. An assessment of the effect of data collection setting on the prevalence of health-risk behaviors among adolescents. J Adolesc Health 2002; 31(4): 327-335.   DOI   ScienceOn
9 Korean Educational Development Institute. Statistical Yearbook of Education, 2008. Seoul: Korean Educational Development Institute; 2008. (Korean)
10 Feinstein AR, Cicchetti DV. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol 1990; 43(6): 543-549.   DOI   ScienceOn
11 Eaton DK, Kann L, Kinchen S, Shanklin S, Ross J, Hawkins J, et al. Youth risk behavior surveillance--United States, 2007. MMWR Surveill Summ 2008; 57(4): 1-131.
12 Vereecken CA, Maes L. A Belgian study on the reliability and relative validity of the Health Behaviour in School-Aged Children food-frequency questionnaire. Public Health Nutr 2003; 6(6): 581-588.
13 Brener ND, Collins JL, Kann L, Warren CW, Williams BI. Reliability of the Youth Risk Behavior Survey Questionnaire. Am J Epidemiol 1995; 141(6): 575-580.   DOI
14 Brener ND, Kann L, McManus T, Kinchen SA, Sundberg EC, Ross JG. Reliability of the 1999 youth risk behavior survey questionnaire. J Adolesc Health 2002; 31(4): 336-342.   DOI   ScienceOn
15 Zullig KJ, Pun S, Patton JM, Ubbes VA. Reliability of the 2005 middle school Youth Risk Behavior Survey. J Adolesc Health 2006; 39(6): 856-860.   DOI   ScienceOn
16 Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33(1): 159-174.   DOI   ScienceOn
17 Korea Centers for Disease Control and Prevention. Reports on the Korea Youth Risk Behavior Web-based Survey, 2006. Seoul: Korea Centers for Disease Control and Prevention; 2007. (Korean)
18 Korea National Statistical Office. Annual Report on the Cause of Death Statistics, 2007. Daejeon: Korea National Statistical Office; 2008. (Korean)
19 McGue M, Iacono WG, Krueger R. The association of early adolescent problem behavior and adult psychopathology: a multivariate behavioral genetic perspective. Behav Genet 2006; 36(4): 591-602.   DOI   ScienceOn
20 Korea Centers for Disease Control and Prevention. Reports on the Korea Youth Risk Behavior Web-based Survey, 2005. Seoul: Korea Centers for Disease Control and Prevention; 2007. (Korean)
21 Korea Centers for Disease Control and Prevention. Reports on the Korea Youth Risk Behavior Web-based Survey, 2007. Seoul: Korea Centers for Disease Control and Prevention; 2008. (Korean)
22 Health Behaviour in School-aged Children. Health behaviour in school-aged children: a World Health Organization collaborative cross-national study. [cited 2010 May 31]. Available from: URL:http://www.hbsc.org.