J Korean Acad Nurs.  2015 Oct;45(5):641-649. 10.4040/jkan.2015.45.5.641.

A Review on the Use of Effect Size in Nursing Research

• Kang H
• Yeon K
• Han ST

• KMID: 2363089
• DOI: http://doi.org/10.4040/jkan.2015.45.5.641

Abstract

PURPOSE
The purpose of this study was to introduce the main concepts of statistical testing and effect size and to provide researchers in nursing science with guidance on how to calculate the effect size for the statistical analysis methods mainly used in nursing.
METHODS
For t-test, analysis of variance, correlation analysis, regression analysis which are used frequently in nursing research, the generally accepted definitions of the effect size were explained.
RESULTS
Some formulae for calculating the effect size are described with several examples in nursing research. Furthermore, the authors present the required minimum sample size for each example utilizing G*Power 3 software that is the most widely used program for calculating sample size.
CONCLUSION
It is noted that statistical significance testing and effect size measurement serve different purposes, and the reliance on only one side may be misleading. Some practical guidelines are recommended for combining statistical significance testing and effect size measure in order to make more balanced decisions in quantitative analyses.

Keyword

Effect size; Significance probability; Power of test; Statistical significance; Practical significance

MeSH Terms

*Data Interpretation, Statistical
Humans
Nursing Research/*methods
Research Design
Sample Size
Software

Reference

1. Im SH. A review on the statistical significance and statistical power analysis. J Educ Stud. 2011; 48(1):267–281.

2. Na WB, Park CW. A meta analysis on the effect sizes of marketing experiments in Korea. Korean Mark Rev. 2006; 21(4):189–207.

3. Kwon SD. A review of the significance testing and effect size in empirical research. J Educ Eval. 2005; 18(2):1–16.

4. Peterson RA, Albaum G, Beltramini RF. A meta-analysis of effect sizes in consumer behavior experiments. J Consum Res. 1985; 12(1):97–103. DOI: 10.1086/209039.

5. Sawyer AG, Peter JP. The significance of statistical significance tests in marketing research. J Mark Res. 1983; 20(2):122–133. DOI: 10.2307/3151679.

6. Kang H. Analysis of statistical method applied in the Journal of Korean Academy of Nursing for recent 3 years (1999-2001). J Korean Acad Nurs. 2002; 32(6):929–935.

7. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum Associates;1988.

8. Cooper HM. On the significance of effects and the effects of significance. J Pers Soc Psychol. 1981; 41(5):1013–1018. DOI: 10.1037//0022-3514.41.5.1013.

9. Faul F, Erdfelder E, Lang AG, Buchner A. G^*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007; 39(2):175–191. DOI: 10.3758/BF03193146.

10. Faul F, Erdfelder E, Buchner A, Lang AG. Statistical power analyses using G^*Power 3.1: Tests for correlation and regression analyses. Behav Res Methods. 2009; 41(4):1149–1160. DOI: 10.3758/brm.41.4.1149.

11. Polit DF, Sherman RE. Statistical power in nursing research. Nurs Res. 1990; 39(6):365–369.

12. Lee JW, Park MR, Lee JB, Lee SJ, Park ES, Park YJ. A review on the methods of sample size determination in nursing research. J Korean Acad Womens Health Nurs. 1998; 4(3):375–387.

13. Ko JM, Lee JK. Effects of a coaching program on comprehensive lifestyle modification for women with gestational diabetes mellitus. J Korean Acad Nurs. 2014; 44(6):672–681. DOI: 10.4040/jkan.2014.44.6.672.

14. Wang HJ, Kim IO. Effects of a mobile web-based pregnancy health care educational program for mothers at an advanced maternal age. J Korean Acad Nurs. 2015; 45(3):337–346. DOI: 10.4040/jkan.2015.45.3.337.

15. Han ST, Kang H, Huh MH. PASW statistics: SPSS analysis of variance. Seoul: Hannare Publishing Co.;2009.

16. Lee JA, Kweon YR. Factors affecting social competence in school-aged children according to alcohol consumption by parents'. J Korean Acad Nurs. 2014; 44(5):495–503. DOI: 10.4040/jkan.2014.44.5.495.

17. Park C, Song M, Cho B, Lim J, Song W, Chang H, et al. Effects of a multi-disciplinary approached, empowerment theory based self-management intervention in older adults with chronic illness. J Korean Acad Nurs. 2015; 45(2):192–201. DOI: 10.4040/jkan.2015.45.2.192.

18. Yoo SY. Development and effects of a simulation-based education program for newborn emergency care. J Korean Acad Nurs. 2013; 43(4):468–477. DOI: 10.4040/jkan.2013.43.4.468.

19. Kang H, Han ST, Choi H. SPSS (PASW Statistics) introduction to data analysis. Paju: Freeacademy;2010.

20. Lee H, Cho SH, Kim JH, Kim YK, Choo HI. Influence of self efficacy, social support and sense of community on health-related quality of life for middle-aged and elderly residents living in a rural community. J Korean Acad Nurs. 2014; 44(6):608–616. DOI: 10.4040/jkan.2014.44.6.608.

21. Anderson DR, Burnham KP, Thompson WL. Null hypothesis testing: Problems, prevalence, and an alternative. J Wildl Manage. 2000; 64(4):912–923. DOI: 10.2307/3803199.

22. Breaugh JA. Effect size estimation: Factors to consider and mistakes to avoid. J Manage. 2003; 29(1):79–77. DOI: 10.1016/S0149-2063(02)00221-0.

23. Cohen J. The earth is round (p <.05). Am Psychol. 1994; 49(12):997–1003.

24. American Psychological Association. Publication manual of the American Psychological Association. 5th ed. Washington, DC: American Psychological Association;2001.

25. Thompson B. Foundations of behavioral statistics: An insightbased approach. New York, NY: The Guilford Press;2006.

26. Kim M. Quantitative methods in geography education research: Concept and application of effect size. J Korean Assoc Geogr Environ Educ. 2011; 19(2):205–220.

27. Kim CG, Cho MK. Effects on depression intervention programs of hemodialysis patients in Korea: Meta-analysis. J Korean Data Anal Soc. 2012; 14(5):2513–2528.

28. Jeon HR, Park JS. A meta-analysis about effects of transcutaneous electrical nerve stimulation on postoperative pain. J Korean Data Anal Soc. 2012; 14(2):851–865.

29. Jun JY. A meta-analysis of effects on the warming methods for postoperative patients. J Korean Data Anal Soc. 2009; 11(4):1819–1829.

30. Lee EH. On the introduction and application of effect size for data analysis methods. Asan: Hoseo University;2014. [master' thesis].