Healthc Inform Res.  2022 Jul;28(3):188-197. 10.4258/hir.2022.28.3.188.

Clinical Evaluation of Digital Therapeutics: Present and Future

Affiliations
  • 1Department of Clinical Pharmacology and Therapeutics, Seoul National University College of Medicine and Hospital, Seoul, Korea

Abstract


Objectives
Digital therapeutics (DTx) are software-based therapeutic interventions based on clinical evidence. Randomized clinical trials (RCTs) are often the source of clinical evidence, similar to conventional drugs or medical devices. However, novel approaches such as the use of real-world data or digital biomarkers are also utilized. This article aimed to review how DTx products have been clinically evaluated.
Methods
DTx products approved by the US Food and Drug Administration as of 2020 were reviewed and products with sufficient published information were selected. Pivotal clinical trials were analyzed according to the elements of the Consolidated Standards of Reporting Trials (CONSORT) guideline. Case reviews were presented for other clinical evaluation strategies, considering the small number of publications.
Results
Most approved DTx products used RCTs for clinical evaluations. Similar to conventional RCTs, parallel-group designs with statistical hypothesis testing were adopted. However, DTx trials were often not blinded due to practical issues and involved various comparator groups. In addition, DTx products could be readily evaluated in home-based settings and delivered through the internet. Other evaluation approaches included retrospective analyses using insurance claims data or usage data, which enabled long-term evaluations of effectiveness. Digital biomarkers obtained from real-time and continuous log data were also used to improve the objectiveness of endpoints.
Conclusions
RCTs accounted for the majority of DTx evaluations. The designs of DTx trials were comparable to those of drug or device trials, but blinding and comparator elements were often different. Furthermore, the use of real-world data and digital biomarkers are also being tried.

Keyword

Digital Technology; Therapeutics; Randomized Controlled Trial; Wearable Electronic Devices; Biomarkers

Reference

References

1. Patel NA, Butte AJ. Characteristics and challenges of the clinical pipeline of digital therapeutics. NPJ Digit Med. 2020; 3(1):159. https://doi.org/10.1038/s41746-020-00370-8.
Article
2. Hong JS, Wasden C, Han DH. Introduction of digital therapeutics. Comput Methods Programs Biomed. 2021; 209:106319. https://doi.org/10.1016/j.cmpb.2021.106319.
Article
3. Shuren J, Patel B, Gottlieb S. FDA regulation of mobile medical apps. JAMA. 2018; 320(4):337–8. https://doi.org/10.1001/jama.2018.8832.
Article
4. Chung JY. Digital therapeutics and clinical pharmacology. Transl Clin Pharmacol. 2019; 27(1):6–11. https://doi.org/10.12793/tcp.2019.27.1.6.
Article
5. Digital Therapeutics Alliance. DTx product categories [Internet]. Arlington (VA): Digital Therapeutics Alliance;2021. [cited at 2022 Jul 24]. Available from: https://dtxalliance.org/wp-content/uploads/2021/01/DTA_FS_DTx-Product-Categories_010521.pdf.
6. Sverdlov O, van Dam J, Hannesdottir K, Thornton-Wells T. Digital therapeutics: an integral component of digital innovation in drug development. Clin Pharmacol Ther. 2018; 104(1):72–80. https://doi.org/10.1002/cpt.1036.
Article
7. Faris O, Shuren J. An FDA viewpoint on unique considerations for medical-device clinical trials. N Engl J Med. 2017; 376(14):1350–7. https://doi.org/10.1056/NEJMra1512592.
Article
8. Makady A, de Boer A, Hillege H, Klungel O, Goettsch W; (on behalf of GetReal Work Package 1). What is real-world data? a review of definitions based on literature and stakeholder interviews. Value Health. 2017; 20(7):858–65. https://doi.org/10.1016/j.jval.2017.03.008.
Article
9. Carroll JD, Shuren J, Jensen TS, Hernandez J, Holmes D, Marinac-Dabic D, et al. Transcatheter valve therapy registry is a model for medical device innovation and surveillance. Health Aff (Millwood). 2015; 34(2):328–34. https://doi.org/10.1377/hlthaff.2014.1010.
Article
10. Fogel AL, Kvedar JC. Artificial intelligence powers digital medicine. NPJ Digit Med. 2018; 1:5. https://doi.org/10.1038/s41746-017-0012-2.
Article
11. Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. Int J Surg. 2012; 10(1):28–55. https://doi.org/10.1016/j.ijsu.2011.10.001.
Article
12. Lee JS, Ahn S, Lee KH, Kim JH. Korean translation of the CONSORT 2010 Statement: updated guidelines for reporting parallel group randomized trials. Epidemiol Health. 2014; 36:e2014029. https://doi.org/10.4178/epih/e2014029.
Article
13. Campbell AN, Nunes EV, Matthews AG, Stitzer M, Miele GM, Polsky D, et al. Internet-delivered treatment for substance abuse: a multisite randomized controlled trial. Am J Psychiatry. 2014; 171(6):683–90. https://doi.org/10.1176/appi.ajp.2014.13081055.
Article
14. Chaple M, Sacks S, McKendrick K, Marsch LA, Belenko S, Leukefeld C, et al. A comparative study of the therapeutic education system for incarcerated substance-abusing offenders. Prison J. 2016; 96(3):485–508. https://doi.org/10.1177%2F0032885516636858.
Article
15. Christensen DR, Landes RD, Jackson L, Marsch LA, Mancino MJ, Chopra MP, et al. Adding an internet-delivered treatment to an efficacious treatment package for opioid dependence. J Consult Clin Psychol. 2014; 82(6):964–72. https://doi.org/10.1037/a0037496.
Article
16. Christensen H, Batterham PJ, Gosling JA, Ritterband LM, Griffiths KM, Thorndike FP, et al. Effectiveness of an online insomnia program (SHUTi) for prevention of depressive episodes (the GoodNight Study): a randomised controlled trial. Lancet Psychiatry. 2016; 3(4):333–41. https://doi.org/10.1016/s2215-0366(15)00536-2.
Article
17. US National Library of Medicine. Study of efficacy of PEAR-004 in schizophrenia [Internet]. Bethesda (MD): ClinicalTrials.gov;2018. [cited at 2022 Jul 25]. Available from: https://ClinicalTrials.gov/show/NCT03751280.
18. Quinn CC, Shardell MD, Terrin ML, Barr EA, Ballew SH, Gruber-Baldini AL. Cluster-randomized trial of a mobile phone personalized behavioral intervention for blood glucose control. Diabetes Care. 2011; 34(9):1934–42. https://doi.org/10.2337/dc11-0366.
Article
19. Kollins SH, DeLoss DJ, Canadas E, Lutz J, Findling RL, Keefe RS, et al. A novel digital intervention for actively reducing severity of paediatric ADHD (STARS-ADHD): a randomised controlled trial. Lancet Digit Health. 2020; 2(4):e168–78. https://doi.org/10.1016/s2589-7500(20)30017-0.
Article
20. US National Library of Medicine. Traumatic nightmares treated by NightWare (To Arouse Not Awaken) [Internet]. Bethesda (MD): ClinicalTrials.gov;2019. [cited at 2022 Jul 25]. Available from: https://ClinicalTrials.gov/show/NCT04040387.
21. Merchant RK, Inamdar R, Quade RC. Effectiveness of population health management using the propeller health asthma platform: a randomized clinical trial. J Allergy Clin Immunol Pract. 2016; 4(3):455–63. https://doi.org/10.1016/j.jaip.2015.11.022.
Article
22. Chrystyn H, Safioti G, Buck D, Granovsky L, Calderon E, Li T, et al. Real-life inhaler technique in asthma patients using the electronic ProAir Digihaler. Eur Respir J. 2019. 54(Suppl 63):PA4258. https://doi.org/10.1183/13993003.congress-2019.PA4258.
Article
23. Park DE, Shin YJ, Park E, Choi IA, Song WY, Kim J. Designing a voice-bot to promote better mental health: UX design for digital therapeutics on ADHD patients. In : Proceedings of CHI: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems; 2020 Apr 25–30; Honolulu, HI. p. 1–8. https://doi.org/10.1145/3334480.3382948.
Article
24. Khozin S, Coravos A. Decentralized trials in the age of real-world evidence and inclusivity in clinical investigations. Clin Pharmacol Ther. 2019; 106(1):25–7. https://doi.org/10.1002/cpt.1441.
Article
25. Velez FF, Ruetsch C, Maricich Y. Evidence of long-term real-world reduction in healthcare resource utilization following treatment of opioid use disorder with reSETO, a novel prescription digital therapeutic. Expert Rev Pharmacoecon Outcomes Res. 2021; 21(4):519–20. https://doi.org/10.1080/14737167.2021.1939687.
Article
26. Velez FF, Colman S, Kauffman L, Ruetsch C, Anastassopoulos K. Real-world reduction in healthcare resource utilization following treatment of opioid use disorder with reSET-O, a novel prescription digital therapeutic. Expert Rev Pharmacoecon Outcomes Res. 2021; 21(1):69–76. https://doi.org/10.1080/14737167.2021.1840357.
Article
27. Guthrie NL, Berman MA, Edwards KL, Appelbaum KJ, Dey S, Carpenter J, et al. Achieving rapid blood pressure control with digital therapeutics: retrospective cohort and machine learning study. JMIR Cardio. 2019; 3(1):e13030. https://doi.org/10.2196/13030.
Article
28. Nordyke RJ, Appelbaum K, Berman MA. Estimating the impact of novel digital therapeutics in type 2 diabetes and hypertension: health economic analysis. J Med Internet Res. 2019; 21(10):e15814. https://doi.org/10.2196/15814.
Article
29. Berglund Scherwitzl E, Linden Hirschberg A, Scherwitzl R. Identification and prediction of the fertile window using NaturalCycles. Eur J Contracept Reprod Health Care. 2015; 20(5):403–8. https://doi.org/10.3109/13625187.2014.988210.
Article
30. Wiecek E, Torres-Robles A, Cutler RL, Benrimoj SI, Garcia-Cardenas V. Impact of a multicomponent digital therapeutic mobile app on medication adherence in patients with chronic conditions: retrospective analysis. J Med Internet Res. 2020; 22(8):e17834. https://doi.org/10.2196/17834.
Article
31. Muir-Hunter SW, Wittwer JE. Dual-task testing to predict falls in community-dwelling older adults: a systematic review. Physiotherapy. 2016; 102(1):29–40. https://doi.org/10.1016/j.physio.2015.04.011.
Article
32. Palanica A, Docktor MJ, Lieberman M, Fossat Y. The need for artificial intelligence in digital therapeutics. Digit Biomark. 2020; 4(1):21–5. https://doi.org/10.1159/000506861.
Article
33. Kim M, Choi HJ. Digital therapeutics for obesity and eating-related problems. Endocrinol Metab (Seoul). 2021; 36(2):220–8. https://doi.org/10.3803/enm.2021.107.
Article
34. Riva G, Wiederhold BK, Di Lernia D, Chirico A, Riva EFM, Mantovani F, et al. Virtual reality meets artificial intelligence: the emergence of advanced digital therapeutics and digital biomarkers. Annu Rev Cyberther Telemed. 2019; 17:3–7.
35. Borgnis F, Baglio F, Pedroli E, Rossetto F, Riva G, Cipresso P. A simple and effective way to study executive functions by using 360° videos. Front Neurosci. 2021; 15:622095. https://doi.org/10.3389/fnins.2021.622095.
Article
36. Abbadessa G, Brigo F, Clerico M, De Mercanti S, Trojsi F, Tedeschi G, et al. Digital therapeutics in neurology. J Neurol. 2022; 269(3):1209–24. https://doi.org/10.1007/s00415-021-10608-4.
Article
37. Recchia G, Capuano DM, Mistri N, Verna R. Digital therapeutics: what they are, what they will be. Acta Sci Med Sci. 2020; 4(3):1–9. https://doi.org/10.31080/ASMS.2020.04.0575.
Article
Full Text Links
  • HIR
Actions
Cited
CITED
export Copy
Close
Share
  • Twitter
  • Facebook
Similar articles
Copyright © 2024 by Korean Association of Medical Journal Editors. All rights reserved.     E-mail: koreamed@kamje.or.kr