J Korean Med Sci.  2025 Mar;40(9):e20. 10.3346/jkms.2025.40.e20.

Dementia Overdiagnosis in Younger, Higher Educated Individuals Based on MMSE Alone: Analysis Using Deep Learning Technology

• Kim HG
• Bai DS
• Koo BH
• Cheon EJ
• Yun S
• Jo SH
• Gu B

• KMID: 2565797
• DOI: http://doi.org/10.3346/jkms.2025.40.e20

Abstract

Background
Dementia is a multifaceted disorder that affects cognitive function, necessitating accurate diagnosis for effective management and treatment. Although the Mini-Mental State Examination (MMSE) is widely used to assess cognitive impairment, its standalone efficacy is debated. This study examined the effectiveness of the MMSE alone versus in combination with other cognitive assessments in predicting dementia diagnosis, with the aim of refining the diagnostic accuracy for dementia.
Methods
A total of 2,863 participants with subjective cognitive complaints who underwent comprehensive neuropsychological assessments were included. We developed two random forest models: one using only the MMSE and another incorporating additional cognitive tests. These models were evaluated based on their accuracy, precision, recall, F1-score, and area under the receiver operating characteristic curve (AUC) on a 70:30 training-to-testing split.
Results
The MMSE-alone model predicted dementia with an accuracy of 86% and AUC of 0.872. The expanded model demonstrated increased accuracy (88%) and an AUC of 0.934. Notably, 17.46% of the cases were reclassified from dementia to non-dementia category upon including additional tests. Higher educational level and younger age were associated with these shifts.
Conclusion
The findings suggest that although the MMSE is a valuable screening tool, it should not be used in isolation to determine dementia severity. The addition of diverse cognitive assessments can significantly enhance diagnostic precision, particularly in younger and more educated populations. Future diagnostic protocols should integrate multifaceted cognitive evaluations to reflect the complexity of dementia accurately.

Keyword

Dementia; MMSE; Neuropsychology

Figure

• 

  Fig. 1 ROC curve and area under the curve values of the trained random forest classifier.ROC = receiver operating characteristic, AUC = area under the ROC curve.

Reference

1. Rosas AG, Stögmann E, Lehrner J. Neuropsychological prediction of dementia using the neuropsychological test battery Vienna: a retrospective study. Brain Disorders. 2022; 5:100028.

2. Folstein MF, Folstein SE, McHugh PR. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975; 12(3):189–198. PMID: 1202204.

3. Arevalo-Rodriguez I, Smailagic N, Roqué-Figuls M, Ciapponi A, Sanchez-Perez E, Giannakou A, et al. Mini-Mental State Examination (MMSE) for the early detection of dementia in people with mild cognitive impairment (MCI). Cochrane Database Syst Rev. 2021; 7(7):CD010783. PMID: 34313331.

4. Jak AJ, Bondi MW, Delano-Wood L, Wierenga C, Corey-Bloom J, Salmon DP, et al. Quantification of five neuropsychological approaches to defining mild cognitive impairment. Am J Geriatr Psychiatry. 2009; 17(5):368–375. PMID: 19390294.

5. Bondi MW, Edmonds EC, Jak AJ, Clark LR, Delano-Wood L, McDonald CR, et al. Neuropsychological criteria for mild cognitive impairment improves diagnostic precision, biomarker associations, and progression rates. J Alzheimers Dis. 2014; 42(1):275–289. PMID: 24844687.

6. Regier DA, Kuhl EA, Kupfer DJ. The DSM-5: classification and criteria changes. World Psychiatry. 2013; 12(2):92–98. PMID: 23737408.

7. Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, et al. Scikit-learn: machine learning in Python. J Mach Learn Res. 2011; 12(85):2825–2830.

8. Devenney E, Hodges JR. The Mini-Mental State Examination: pitfalls and limitations. Pract Neurol. 2017; 17(1):79–80. PMID: 27903765.

9. Rabin LA, Paré N, Saykin AJ, Brown MJ, Wishart HA, Flashman LA, et al. Differential memory test sensitivity for diagnosing amnestic mild cognitive impairment and predicting conversion to Alzheimer’s disease. Neuropsychol Dev Cogn B Aging Neuropsychol Cogn. 2009; 16(3):357–376. PMID: 19353345.

10. Eckerström C, Olsson E, Bjerke M, Malmgren H, Edman A, Wallin A, et al. A combination of neuropsychological, neuroimaging, and cerebrospinal fluid markers predicts conversion from mild cognitive impairment to dementia. J Alzheimers Dis. 2013; 36(3):421–431. PMID: 23635408.

11. Galton CJ, Erzinçlioglu S, Sahakian BJ, Antoun N, Hodges JR. A comparison of the Addenbrooke’s Cognitive Examination (ACE), conventional neuropsychological assessment, and simple MRI-based medial temporal lobe evaluation in the early diagnosis of Alzheimer’s disease. Cogn Behav Neurol. 2005; 18(3):144–150. PMID: 16175017.

12. Didic M, Felician O, Barbeau EJ, Mancini J, Latger-Florence C, Tramoni E, et al. Impaired visual recognition memory predicts Alzheimer’s disease in amnestic mild cognitive impairment. Dement Geriatr Cogn Disord. 2013; 35(5-6):291–299. PMID: 23572062.

13. Guarch J, Marcos T, Salamero M, Gastó C, Blesa R. Mild cognitive impairment: a risk indicator of later dementia, or a preclinical phase of the disease? Int J Geriatr Psychiatry. 2008; 23(3):257–265. PMID: 17668419.

14. Albert MS, Moss MB, Tanzi R, Jones K. Preclinical prediction of AD using neuropsychological tests. J Int Neuropsychol Soc. 2001; 7(5):631–639. PMID: 11459114.

15. Spering CC, Hobson V, Lucas JA, Menon CV, Hall JR, O’Bryant SE. Diagnostic accuracy of the MMSE in detecting probable and possible Alzheimer’s disease in ethnically diverse highly educated individuals: an analysis of the NACC database. J Gerontol A Biol Sci Med Sci. 2012; 67(8):890–896. PMID: 22396476.