J Prev Med Public Health.  2013 Mar;46(2):96-104.

Inappropriate Survey Design Analysis of the Korean National Health and Nutrition Examination Survey May Produce Biased Results

Affiliations
  • 1Department of Occupational and Environmental Medicine, Ulsan University Hospital, University of Ulsan College of Medicine, Ulsan, Korea.
  • 2Department of Food and Nutrition, Hoseo University, Asan, Korea.
  • 3Institue of Environmental & Occupational Medicine, Soonchunhyang University, Asan, Korea.
  • 4Korea Industrial Health Association, Seoul, Korea. bklee@kiha21.or.kr

Abstract


OBJECTIVES
The inherent nature of the Korean National Health and Nutrition Examination Survey (KNHANES) design requires special analysis by incorporating sample weights, stratification, and clustering not used in ordinary statistical procedures.
METHODS
This study investigated the proportion of research papers that have used an appropriate statistical methodology out of the research papers analyzing the KNHANES cited in the PubMed online system from 2007 to 2012. We also compared differences in mean and regression estimates between the ordinary statistical data analyses without sampling weight and design-based data analyses using the KNHANES 2008 to 2010.
RESULTS
Of the 247 research articles cited in PubMed, only 19.8% of all articles used survey design analysis, compared with 80.2% of articles that used ordinary statistical analysis, treating KNHANES data as if it were collected using a simple random sampling method. Means and standard errors differed between the ordinary statistical data analyses and design-based analyses, and the standard errors in the design-based analyses tended to be larger than those in the ordinary statistical data analyses.
CONCLUSIONS
Ignoring complex survey design can result in biased estimates and overstated significance levels. Sample weights, stratification, and clustering of the design must be incorporated into analyses to ensure the development of appropriate estimates and standard errors of these estimates.

Keyword

Korean National Health and Nutrition Examination Survey; Complex survey design; Design-based analysis; Ordinary statistical data analysis; Multi-stage stratified sampling

MeSH Terms

Adult
Aged
Blood Pressure
Bone Density
Cadmium/blood
Creatinine/blood
Female
Hemoglobins/analysis
Humans
Lead/blood
Male
Mercury/blood
Middle Aged
*Nutrition Surveys
PubMed
Republic of Korea
*Research Design
Hemoglobins
Cadmium
Lead
Creatinine
Mercury
Full Text Links
  • JPMPH
Actions
Cited
CITED
export Copy
Close
Share
  • Twitter
  • Facebook
Similar articles
Copyright © 2024 by Korean Association of Medical Journal Editors. All rights reserved.     E-mail: koreamed@kamje.or.kr