 |
|
Comparison of the Short Test of Mental Status and the Mini-Mental State Examination in Mild Cognitive Impairment
David F. Tang-Wai, MDCM;
David S. Knopman, MD;
Yonas E. Geda, MD;
Steven D. Edland, PhD;
Glenn E. Smith, PhD;
Robert J. Ivnik, PhD;
Eric G. Tangalos, MD;
Bradley F. Boeve, MD;
Ronald C. Petersen, PhD, MD
Arch Neurol. 2003;60:1777-1781.
ABSTRACT
| |
Background The Mini-Mental State Examination (MMSE) is the most widely used brief screening measure of cognition, but it is not sensitive in detecting mild memory or other cognitive impairments. The Short Test of Mental Status (STMS) was specifically developed for use in dementia assessment and was intended to be more sensitive to problems of learning and mental agility that may be seen in mild cognitive impairment (MCI).
Objective To compare the STMS and MMSE for detecting or predicting MCI.
Design Comparison of STMS and MMSE scores at baseline among 4 groups of patients: 788 patients with stable normal cognition, 75 patients with normal cognition at baseline but who developed incident MCI or Alzheimer disease during follow-up, 129 patients with prevalent MCI at baseline, and 235 patients with prevalent mild Alzheimer disease. All patients and control subjects for this study were evaluated through the Mayo Alzheimer's Disease Patient Registry or the Mayo Clinic Alzheimer's Disease Research Center, Rochester, Minn, using a standardized diagnostic approach.
Results The STMS was slightly more sensitive than the MMSE in discriminating between patients with stable normal cognition and patients with prevalent MCI. The STMS was superior to the MMSE in detecting deficits in cognition in individuals who had normal cognition at baseline but later developed incident MCI or Alzheimer disease.
Conclusions Compared with the MMSE, the STMS was better able to document MCI and was more sensitive in detecting deficits in cognition in individuals who had normal cognition at baseline but later developed incident MCI or Alzheimer disease.
INTRODUCTION
MILD COGNITIVE impairment (MCI) has taken on increasing clinical importance because it is a precursor of dementia.1 The Mini-Mental State Examination (MMSE)2 is currently the mainstay of bedside mental status examinations, but it has limitations,3-5 especially for detecting MCI.
The Short Test of Mental Status (STMS)6-7 (Table 1) was developed and validated as a screening bedside mental status test specifically for use in mild dementia. It covers a broad range of cognitive functions and uses a 4-word learning list with a delayed recall of approximately 3 minutes.6 The construction of the recall task in the STMS was intended to make it more sensitive to the problems of learning and recall in MCI and early dementia. In addition, the STMS includes test items that better assess abstract reasoning and mental agility than the MMSE.
|
|
|
|
Table 1. The Short Test of Mental Status
|
|
|
Despite theoretical improvements, we questioned whether the STMS offered any advantages vs the MMSE. We retrospectively compared the STMS and the MMSE to determine if there was a clinically relevant difference between the 2 tests in the assessment of patients with MCI and dementia.
METHODS
SUBJECTS
Patients and control subjects for this study were recruited prospectively through the Mayo Alzheimer's Disease Patient Registry and the Mayo Clinic Alzheimer's Disease Research Center (Rochester, Minn) using a standardized protocol.8-12 Both projects were approved by the Mayo institutional review board. The patients were derived from 2 sources: community patients in Rochester and regional patients referred to the Mayo Clinic Alzheimer's Disease Research Center. The community patients were recruited through the Mayo Clinic Division of Community Internal Medicine. Volunteers with and without cognitive complaints or disorders were recruited.
Each patient was evaluated by either a behavioral neurologist or a behavioral neurology fellow, who obtained a medical history from the patient and corroborating sources and performed a complete neurological examination including the STMS.6-7 The physician also completed the Clinical Dementia Rating Scale (CDR)13 based on both the mental status examination and an interview of the subject or informant. If cognitively impaired, the patient had a laboratory assessment and structural neuroimaging of the brain using either computed tomography or magnetic resonance imaging.
Each patient underwent a 4-hour neuropsychological test, which included the MMSE2 and a battery of standard neuropsychological tests.8-12,14
A consensus meeting was held weekly to review each patient's examination results. The team consisted of nurses, a geriatrician (E.G.T.), 4 behavioral neurologists (Emre Kokmen, MD [deceased], B.F.B., D.S.K., and R.C.P.), and 2 neuropsychologists (G.E.S. and R.J.I.). Subjects were given a consensus evaluation based on all of the current information listed earlier and were evaluated as having normal cognition, MCI, or dementia according to the Diagnostic and Statistical Manual of Mental Disorders, Revised Third Edition.15
The diagnosis of MCI was made if the patient met the following criteria: memory complaint, normal activities of daily living, normal general cognitive function, abnormal memory for age, and no dementia.15 The diagnosis of probable Alzheimer disease (AD) was based on National Institute of Neurological and Communicative Disorders and Stroke—Alzheimer's Disease and Related Disorders Association criteria.16
ANALYSIS
We examined the differences between the MMSE and STMS obtained at the baseline visits. Because the comparison of the MMSE and STMS was not prospectively conceived, the original study design did not maintain strict independence between test scores and clinical diagnoses. The neurologists' diagnoses used the STMS and the patient's medical history and functional assessment, and the neuropsychologists used the MMSE scores and the full psychometric battery. To avoid circularity biases, we sought to isolate the diagnostic groupings from the baseline STMS and MMSE scores. We grouped subjects according to their status at follow-up. Subjects were considered to have stable normal cognition if they remained cognitively healthy during the course of follow-up and for a minimum of 2 subsequent annual evaluations. Subjects with incident MCI had normal cognition at the baseline evaluation but developed MCI or AD at a subsequent follow-up examination. By this strategy, the diagnostic groupings were based on future status; although we used the same instruments and procedures as at baseline, subjects were grouped according to clinical course. As an additional approach to avoid circularity, we performed analyses in which we grouped subjects according to their CDR score. Because the CDR included information obtained from the patient's medical history, the global CDR score assigned to each patient contained additional information not derived from the mental status assessments.
We used t tests for bivariate comparisons. Areas under the receiver operating characteristic curves were compared using a modified Mann-Whitney U test statistic.17 All statistical analyses were performed using either SAS software (SAS Institute Inc, Cary, NC) or S-plus software (Mathsoft Engineering and Education Inc, Seattle, Wash).
RESULTS
The demographic features of the subjects grouped by categories are presented in Table 2. The study group consisted of 788 subjects with stable normal cognition, 75 subjects with normal cognition at baseline but who developed MCI (n = 54) or AD (n = 21) during the follow-up period, 129 patients with prevalent MCI at baseline, and 235 patients with prevalent very mild AD as defined by a CDR score of 0.5 at baseline. There were more women than men in all groups. Subjects with stable normal cognition were slightly younger than the other subjects.
|
|
|
|
Table 2. Demographics of the Sample*
|
|
|
As expected, the mean total scores on both the STMS and the MMSE were higher in the stable normal cognition group compared with the prevalent MCI group and in the MCI group compared with the prevalent mild AD group (Table 1). In paired comparisons of subjects with stable normal cognition vs those with prevalent MCI, stable normal cognition vs AD, and MCI vs AD, the difference in means between groups was highly statistically significant for both the MMSE and the STMS (P< .001 for all comparisons).
Figure 1 depicts the receiver operating characteristic curves of the STMS and the MMSE for discriminating the subjects with prevalent MCI from those with stable normal cognition. The area under the receiver operating characteristic curve was modestly but significantly better for the STMS compared with the MMSE for discriminating between diagnostic groups (stable normal cognition vs prevalent MCI). Table 3 presents the quantitative data for that contrast and for the contrast between groups defined by CDR score (CDR score of 0 vs CDR score of 0.5 to 1.5). For discriminating between prevalent MCI and AD, there was no difference in the performance of the 2 tests. To put the magnitude of the differences between the STMS and the MMSE in perspective, we also conducted an analysis in which we dropped the delayed-recall item from the MMSE. The increase in area under the curve from the full MMSE to the STMS was comparable with the difference in area under the curve from the MMSE with the delayed-recall element deleted compared with the full MMSE (lower rows of Table 3).
|
|
|
Receiver operating characteristic curves for baseline Mini-Mental State Examination and Short Test of Mental Status scores to discriminate individuals with normal cognition who remained cognitively healthy during the course of the study (n = 788) from patients with prevalent MCI (n = 129). The difference between the 2 curves was statistically significant ( 2 = 9.74; P= .002).
|
|
|
|
|
|
|
Table 3. Receiver Operating Characteristic Curve Values*
|
|
|
In our sample, a cutoff score of 24 on the MMSE had very poor sensitivity for detecting MCI, with a high specificity. A cutoff score of 29 had 82% sensitivity but a specificity of only 48%. The STMS exhibited a similar pattern of trade-offs between sensitivity and specificity across a larger range of scores. Sensitivity and specificity did not exceed 80% for either test or any test value.
Finally, we compared the baseline STMS and MMSE scores in subjects with stable normal cognition with those of individuals with normal cognition who developed incident MCI or AD. The mean ± SD follow-up period for the 75 individuals with incident MCI or AD was 5.6 ± 3.1 years. The groups did not differ in MMSE score (P = .30) but differed significantly in STMS score (P<.001) (Table 4 and Table 5). The result was not influenced by age, sex, or education (P = .76 for MMSE and P = .001 for STMS, testing group differences by logistic regression analysis and controlling for age, sex, and education). One half of subjects with incident MCI or AD scored 2 or lower on the STMS recall subtest items at baseline compared with 25% of the clinically stable normal cognition group (P<.001).
|
|
|
|
Table 4. Short Test of Mental Status Baseline Subscores*
|
|
|
|
|
|
|
Table 5. Mini-Mental State Examination Baseline Subscores*
|
|
|
COMMENT
The present analysis showed that the STMS was slightly more effective than the MMSE in differentiating between cognitively healthy individuals and individuals with MCI. In addition, the STMS was superior to the MMSE in detecting deficits in cognition in individuals who had normal cognition but later developed incident MCI or AD. For individuals with dementia, the STMS and the MMSE were indistinguishable.
The differences between the 2 tests were modest, and the most conservative comparison of the STMS and the MMSE would be to say that they were very similar overall in their diagnostic accuracy. However, when the distinction between normal cognition and MCI was at stake, the STMS was better than the MMSE. The additional cognitive test items offered by the STMS revealed impairments in subjects with MCI compared with those who had normal cognition and also showed lower performance in subjects with normal cognition who subsequently developed MCI or AD.
A potential limitation of the analyses was the bias introduced by the availability of the STMS to the neurologists and the MMSE to the neuropsychologists at the time that the baseline diagnoses were formulated. We attempted to minimize these potential biases by using 2 different analytic strategies, both of which showed that the STMS was modestly superior to the MMSE. Another limitation in this data set was that our subjects were relatively well educated. Our results may not generalize to elderly individuals with low educational attainment.
The introduction of calculations, verbal similarities, and fund of information in the STMS was intentional, because it was developed for use with a population with a high school education. In individuals with fewer than 9 years of formal education, there might be fewer differences between the STMS and the MMSE.
The MMSE has been the mainstay of bedside cognitive testing. We propose that the STMS is equally effective and may have some features that make it more informative than the MMSE in persons with MCI. Bedside mental status assessment is only 1 aspect in the evaluation of cognitive impairment. Neither the STMS nor the MMSE can be used alone to diagnose MCI or dementia. Clinical judgment and neuropsychological testing are integral in diagnosing MCI.
AUTHOR INFORMATION
| |
Corresponding author and reprints: David S. Knopman, MD, Department of Neurology, Mayo Clinic, 200 First St SW, Rochester, MN 55905 (e-mail: knopman{at}mayo.edu).
Accepted for publication August 19, 2003.
Author contributions: Study concept and design (Drs Tang-Wai, Knopman, Geda, Smith, Tangalos, Boeve, and Petersen); acquisition of data (Drs Tang-Wai, Knopman, Smith, Ivnik, Tangalos, Boeve, and Petersen); analysis and interpretation of data (Drs Tang-Wai, Knopman, Edland, Boeve, and Petersen); drafting of the manuscript (Drs Tang-Wai, Knopman, Geda, and Petersen); critical revision of the manuscript for important intellectual content (Drs Tang-Wai, Knopman, Edland, Smith, Ivnik, Tangalos, Boeve, and Petersen); statistical expertise (Drs Knopman, Edland, and Smith); obtained funding (Drs Smith and Petersen); administrative, technical, and material support (Drs Ivnik, Tangalos, Boeve, and Petersen); study supervision (Drs Knopman, Boeve, and Petersen).
This study was supported by grants AG 16574 and AG 07216 from the National Institute on Aging, Bethesda, Md.
Portions of this study were presented at the American Academy of Neurology Annual Meeting; April 2, 2003; Honolulu, Hawaii.
We acknowledge the contributions of Kris Johnson, RN, and the nurses, neuropsychometrists, and allied health staff at the Mayo Alzheimer's Disease Research Center and Healthy Aging Project, Rochester, for input and efforts obtaining information used in this article. We would also like to acknowledge Tiffani Slusser, BS; Matt Plevak, BS; and Tera B. Carpenter, BS, for assistance with this project.
This article is dedicated to the memory of Emre Kokmen, MD, the developer of the Short Test of Mental Status.
From the Departments of Neurology (Drs Tang-Wai, Knopman, Boeve, and Petersen), Psychiatry (Dr Geda), Health Sciences Research (Dr Edland), Psychology (Drs Smith and Ivnik), and Internal Medicine (Dr Tangalos) and the Mayo Alzheimer's Disease Research Center (Drs Tang-Wai, Knopman, Geda, Edland, Smith, Ivnik, Tangalos, Boeve, and Petersen), Mayo Clinic, Rochester, Minn.
REFERENCES
1. Petersen RC, Stevens JC, Ganguli M, Tangalos EG, Cummings JL, DeKosky ST. Practice parameter: early detection of dementia: mild cognitive impairment (an evidence-based review): report of the Quality Standards Subcommittee of the American Academy of Neurology. Neurology. 2001;56:1133-1142.
FREE FULL TEXT
2. Folstein MF, Folstein SE, McHugh PR. "Mini-Mental State": a practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12:189-198.
FULL TEXT
|
ISI
| PUBMED
3. Anthony JC, LeResche L, Niaz U, von Korff MR, Folstein MF. Limits of the "mini-mental state" as a screening test for dementia and delirium among hospital patients. Psychol Med. 1982;12:397-408.
ISI
| PUBMED
4. Dick JPR, Guiloff EJ, Stewart A, et al. Mini-Mental State Examination in neurological patients. J Neurol Neurosurg Psychiatry. 1984;47:496-499.
ABSTRACT
5. Tombaugh TN, McIntyre NJ. The Mini-Mental State Examination: a comprehensive review. J Am Geriatr Soc. 1992;40:922-935.
ISI
| PUBMED
6. Kokmen E, Naessens JM, Offord KP. A short test of mental status: description and preliminary results. Mayo Clin Proc. 1987;62:281-288.
ISI
| PUBMED
7. Kokmen E, Smith GE, Petersen RC, Tangalos EG, Ivnik RJ. The Short Test of Mental Status: correlations with standardized psychometric testing. Arch Neurol. 1991;48:725-728.
ABSTRACT
8. Petersen RC, Kokmen E, Tangalos E, Ivnik RJ, Kurland LT. Mayo Clinic Alzheimer's Disease Patient Registry. Aging. 1990;2:408-415.
PUBMED
9. Petersen RC, Smith G, Kokmen E, Ivnik RJ, Tangalos EG. Memory function in normal aging. Neurology. 1992;42:396-401.
FREE FULL TEXT
10. Petersen RC, Smith GE, Ivnik RJ, Kokmen E, Tangalos EG. Memory function in very early Alzheimer's disease. Neurology. 1994;44:867-872.
FREE FULL TEXT
11. Petersen RC, Smith GE, Ivnik RJ, et al. Apolipoprotein E status as a predictor of the development of Alzheimer's disease in memory-impaired individuals. JAMA. 1995;273:1274-1278.
ABSTRACT
12. Petersen RC, Waring SC, Smith GE, Tangalos EG, Thibodeau SN. Predictive value of APOE genotyping in incipient Alzheimer's disease. Ann N Y Acad Sci. 1996;802:58-69.
ABSTRACT
13. Morris JC. The Clinical Dementia Rating (CDR): current version and scoring rules. Neurology. 1993;43:2412-2414.
14. Petersen RC, Smith GE, Waring SC, Ivnik RJ, Tangalos EG, Kokmen E. Mild cognitive impairment: clinical characteristics and outcome. Arch Neurol. 1999;56:303-308.
FREE FULL TEXT
15. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, Revised Third Edition. Washington, DC: American Psychiatric Association; 1987.
16. McKhann G, Drachman D, Folstein M, Katzman R, Price D, Stadlan EM. Clinical diagnosis of Alzheimer's disease: report of the NINCDS-ADRDA work group under the auspices of Department of Health and Human Services Task Force on Alzheimer's Disease. Neurology. 1984;34:939-944.
FREE FULL TEXT
17. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44:837-845.
FULL TEXT
|
ISI
| PUBMED
THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES
|
11C PiB and structural MRI provide complementary information in imaging of Alzheimer's disease and amnestic mild cognitive impairment
Jack et al.
Brain 2008;131:665-680.
ABSTRACT
| FULL TEXT
A review of screening tests for cognitive impairment
Cullen et al.
J. Neurol. Neurosurg. Psychiatry 2007;78:790-799.
ABSTRACT
| FULL TEXT
Frontotemporal dementia and parkinsonism associated with the IVS1+1G->A mutation in progranulin: a clinicopathologic study
Boeve et al.
Brain 2006;129:3103-3114.
ABSTRACT
| FULL TEXT
Handwriting process variables discriminating mild Alzheimer's disease and mild cognitive impairment.
Werner et al.
J. Gerontol. B Psychol. Sci. Soc. Sci. 2006;61:P228-P236.
ABSTRACT
| FULL TEXT
Perspectives on Depression, Mild Cognitive Impairment, and Cognitive Decline
Steffens et al.
Arch Gen Psychiatry 2006;63:130-138.
ABSTRACT
| FULL TEXT
Cognitive status correlates with neuropathologic stage in Parkinson disease
Braak et al.
Neurology 2005;64:1404-1410.
ABSTRACT
| FULL TEXT
Longitudinal characterization of two siblings with frontotemporal dementia and parkinsonism linked to chromosome 17 associated with the S305N tau mutation
Boeve et al.
Brain 2005;128:752-772.
ABSTRACT
| FULL TEXT
|
