J Korean Soc Radiol.  2021 Sep;82(5):1196-1206. 10.3348/jksr.2020.0177.

Construction of a Standard Dataset for Liver Tumors for Testing the Performance and Safety of Artificial Intelligence-Based Clinical Decision Support Systems

  • 1Department of Radiology and Research Institute of Radiological Science, Severance Hospital, Yonsei University College of Medicine, Seoul, Korea
  • 2Department of Radiology, Seoul National University Hospital, Seoul National University College of Medicine, Seoul, Korea
  • 3Department of Radiology and Center for Imaging Science, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea
  • 4Department of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea


To construct a standard dataset of contrast-enhanced CT images of liver tumors to test the performance and safety of artificial intelligence (AI)-based algorithms for clinical decision support systems (CDSSs).
Materials and Methods
A consensus group of medical experts in gastrointestinal radiology from four national tertiary institutions discussed the conditions to be included in a standard dataset. Seventy-five cases of hepatocellular carcinoma, 75 cases of metastasis, and 30–50 cases of benign lesions were retrieved from each institution, and the final dataset consisted of 300 cases of hepatocellular carcinoma, 300 cases of metastasis, and 183 cases of benign lesions. Only pathologically confirmed cases of hepatocellular carcinomas and metastases were enrolled. The medical experts retrieved the medical records of the patients and manually labeled the CT images. The CT images were saved as Digital Imaging and Communications in Medicine (DICOM) files.
The medical experts in gastrointestinal radiology constructed the standard dataset of contrast-enhanced CT images for 783 cases of liver tumors. The performance and safety of the AI algorithm can be evaluated by calculating the sensitivity and specificity for detecting and characterizing the lesions.
The constructed standard dataset can be utilized for evaluating the machine-learningbased AI algorithm for CDSS.


Liver Neoplasms; Aritificial Intelligence; Machine Learning; Deep Learning; Datasets as Topic
Full Text Links
  • JKSR
export Copy
  • Twitter
  • Facebook
Similar articles
Copyright © 2022 by Korean Association of Medical Journal Editors. All rights reserved.     E-mail: koreamed@kamje.or.kr