Korean J Pain.  2010 Mar;23(1):35-41.

Analysis of Statistical Methods and Errors in the Articles Published in the Korean Journal of Pain

• Yim KH
• Nahm FS
• Han KA
• Park SY

Abstract

BACKGROUND
Statistical analysis is essential in regard to obtaining objective reliability for medical research. However, medical researchers do not have enough statistical knowledge to properly analyze their study data. To help understand and potentially alleviate this problem, we have analyzed the statistical methods and errors of articles published in the Korean Journal of Pain (KJP), with the intention to improve the statistical quality of the journal.
METHODS
All the articles, except case reports and editorials, published from 2004 to 2008 in the KJP were reviewed. The types of applied statistical methods and errors in the articles were evaluated.
RESULTS
One hundred and thirty-nine original articles were reviewed. Inferential statistics and descriptive statistics were used in 119 papers and 20 papers, respectively. Only 20.9% of the papers were free from statistical errors. The most commonly adopted statistical method was the t-test (21.0%) followed by the chi-square test (15.9%). Errors of omission were encountered 101 times in 70 papers. Among the errors of omission, "no statistics used even though statistical methods were required" was the most common (40.6%). The errors of commission were encountered 165 times in 86 papers, among which "parametric inference for nonparametric data" was the most common (33.9%).
CONCLUSION
We found various types of statistical errors in the articles published in the KJP. This suggests that meticulous attention should be given not only in the applying statistical procedures but also in the reviewing process to improve the value of the article.

Keyword

data interpretation; statistical analysis; statistics

MeSH Terms

Intention

Reference

1. Rosenbaum SH. Miller RD, editor. Statistical methods in anesthesia. Miller's anesthesia. 2009. 7th ed. Philadelphia: Elsevier Inc;p. 3075–3086.

2. Ahn YO, Lee HK. Development of a checklist for assessing the methodological and statistical validity of medical articles. Korean J Med Educ. 1991; 3:19–35.

3. Park HC, Choi DH, Ahn SV, Kang JO, Kim ES, Park W, et al. Statistical errors in papers published in the journal of the Korean society for therapeutic radiology and oncology. J Korean Soc Ther Radiol Oncol. 2008; 26:289–294.

4. Park IK, Kang JO, Kim TY, Keum DG. An Evaluation of the statistical techniques used in the 1995-1996 editions of the Korean journal of clinical pathology. Korean J Clin Pathol. 1999; 19:460–464.

5. Yu TY, Jin Y, Jeong TO, Lee JB. Statistical methods in the articles in the journal of the Korean society of emergency medicine published from 1998 to 2002. J Korean Soc Emerg Med. 2003; 14:475–480.

6. Shin MH, Son YI, Cho YS, Kim HY, Ha BS, Kim SI. The use of statistical analysis-In the Korean journal of otolaryngology-Head and Neck Surgery-. Korean J Otolaryngol-Head Neck Surg. 1999; 42:1364–1369.

7. Ko H, Kwak IY, Choe IH, Ham BM, Kim KW. Statistical methods in the articles of the journal of the Korean society of anesthesiologists from 1981 to 1990. Korean J Anesthesiol. 1993; 26:22–27.

8. Song K, Han M, Cheong MY, Lim KS, Kim DK. Clinical research design and biostatistical methods. Korean J Urol. 2005; 46:835–841.

9. Kim BS, Lee YG, Lee TR. Categorical data analysis. 2004. Seoul: Korea National Open University Press;p. 32–35.

10. Song KI, Choi JS. Clinical data analysis by SPSS 15-A practical guide for clinicians. 2008. Seoul: Hannarae publishing Co;p. 31–33. p. 55–61.

11. Ahn JU, Yoo KY. Statistical analysis in medicine and public health. 2006. 2nd ed. Seoul: Hannarae publishing Co;p. 311–378.

12. Hwang K, Lee HJ, Kim YJ, Lee SI. Statistical errors in papers in the journal of Korean society of plastic and reconstructive surgeons (JKPRS). J Korean Soc Plast Reconstr Surg. 2001; 28:302–309.

13. White SJ. Statistical errors in papers in the British journal of psychiatry. Br J Psychiatry. 1979; 135:336–342. PMID: 519116.

14. MacArthur RD, Jackson GG. An evaluation of the use of statistical methodology in the journal of infectious diseases. J Infect Dis. 1984; 149:349–354. PMID: 6715895.

15. Pocock SJ, Hughes MD, Lee RJ. Statistical problems in the reporting of clinical trials. A survey of three medical journals. N Engl J Med. 1987; 317:426–432. PMID: 3614286.

16. Gore SM, Jones IG, Rytter EC. Misuse of statistical methods: critical assessment of articles in BMJ from January to March 1976. Br Med J. 1977; 1:85–87. PMID: 832023.

17. Avram MJ, Shanks CA, Dykes MH, Ronai AK, Stiers WM. Statistical methods in anesthesia articles: an evaluation of two American journals during two six-month periods. Anesth Analg. 1985; 64:607–611. PMID: 4003779.

18. Altman DG, Gore SM, Gardner MJ, Pocock SJ. Statistical guidelines for contributors to medical journals. Br Med J (Clin Res Ed). 1983; 286:1489–1493.

19. Gardner MJ, Machin D, Campbell MJ. Use of check lists in assessing the statistical content of medical studies. Br Med J (Clin Res Ed). 1986; 292:810–812.

20. Reed JF 3rd, Salen P, Bagher P. Methodological and statistical techniques: what do residents really need to know about statistics? J Med Syst. 2003; 27:233–238. PMID: 12705455.