Korean J Anesthesiol.  2017 Oct;70(5):511-519. 10.4097/kjae.2017.70.5.511.

Assessment of risk of bias in quasi-randomized controlled trials and randomized controlled trials reported in the Korean Journal of Anesthesiology between 2010 and 2016

Affiliations
  • 1Department of Anesthesiology and Pain Medicine, School of Medicine, Catholic University of Daegu, Daegu, Korea.
  • 2Department of Anesthesiology and Pain Medicine, Yangsan Hospital, Pusan National University School of Medicine, Busan, Korea.
  • 3Department of Anesthesiology and Pain Medicine, Dongguk University Ilsan Hospital, Goyang, Korea.
  • 4Department of Anesthesiology and Pain Medicine, Guro Hospital, Korea University School of Medicine, Seoul, Korea.
  • 5Department of Anesthesiology and Pain Medicine, Sanggye Paik Hospital, Inje University College of Medicine, Seoul, Korea.
  • 6Department of Anesthesiology and Pain Medicine, Chung-Ang University College of Medicine, Seoul, Korea. roman00@naver.com

Abstract

Bias affects the true intervention effect in randomized controlled trials (RCTs), making the results unreliable. We evaluated the risk of bias (ROB) of quasi-RCTs or RCTs reported in the Korean Journal of Anesthesiology (KJA) between 2010 and 2016. Six kinds of bias (selection, performance, detection, attrition, reporting, and other biases) were evaluated by determining low, unclear, or high ROB for eight domains (random sequence generation, allocation concealment, blinding of participants, blinding of personnel, blinding of outcome assessment, incomplete outcome data, selective reporting, and other bias) according to publication year. We identified 296 quasi-RCTs or RCTs. Random sequence generation was performed better than allocation concealment (51.7% vs. 20.9% for the proportion of low ROB, P < 0.001 and P = 0.943 for trend, respectively). Blinding of outcome assessment was superior to blinding of participants and personnel (42.9% vs. 15.5% and 23.0% for the proportion of low ROB, P = 0.026 vs. P = 0.003 and 0.896 for trend, respectively). Handling of incomplete outcome data was performed best with the highest proportion of low ROB (84.8%). Selective reporting had the lowest proportion of low ROB (4.7%). However, the ROB improved year by year (P < 0.001 for trend). Authors and reviewers should consider allocation concealment after random sequence generation, blinding of participants and personnel, and full reporting of results to improve the quality of RCTs submitted hereafter for publication in the KJA.

Keyword

Bias; Publishing; Quality analysis; Randomized controlled trial

MeSH Terms

Anesthesiology*
Bias (Epidemiology)*
Publications

Cited by  3 articles

Multicollinearity and misleading statistical results
Jong Hae Kim
Korean J Anesthesiol. 2019;72(6):558-569.    doi: 10.4097/kja.19087.

Assessment of P values for demographic data in randomized controlled trials
Eun Jin Ahn, Jong Hae Kim, Tae Kyun Kim, Jae Hong Park, Dong Kyu Lee, Sangseok Lee, Junyong In, Hyun Kang
Korean J Anesthesiol. 2019;72(2):130-134.    doi: 10.4097/kja.d.18.00333.

Can we trust the results of scientific papers?
Sangseok Lee
Korean J Anesthesiol. 2017;70(5):491-492.    doi: 10.4097/kjae.2017.70.5.491.

Full Text Links
  • KJAE
Actions
Cited
CITED
export Copy
Close
Share
  • Twitter
  • Facebook
Similar articles
Copyright © 2024 by Korean Association of Medical Journal Editors. All rights reserved.     E-mail: koreamed@kamje.or.kr