About the Author(s)


Mia Rademeyer Email
Department of Psychiatry, School of Medicine, University of Pretoria, South Africa

Pierre Joubert
Department of Psychiatry, School of Medicine, University of Pretoria, South Africa

Citation


Rademeyer M & Joubert P. A comparison between the Mini-Mental State Examination and the Montreal Cognitive Assessment Test in schizophrenia. S Afr J Psychiat. 2016;22(1):a890. http://dx.doi.org/10.4102/sajpsychiatry.v22i1.890

Original Research

A comparison between the Mini-Mental State Examination and the Montreal Cognitive Assessment Test in schizophrenia

Mia Rademeyer, Pierre Joubert

Received: 24 Aug. 2015; Accepted: 07 Dec. 2015; Published: 06 May 2016

Copyright: © 2016. The Author(s). Licensee: AOSIS.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background: Cognitive impairment is a core feature of schizophrenia that also has strong prognostic significance. In most clinical settings comprehensive neuropsychological testing to detect cognitive impairment in schizophrenia patients is not readily available, but because cognitive deficits in schizophrenia are clinically important it would be useful to detect or at least screen for them in a clinical setting. Unfortunately there are no validated, brief screening instruments for the detection of cognitive impairment in schizophrenia. Nevertheless, the Montreal Cognitive Assessment Test (MoCA) and the Mini-Mental State Examination (MMSE) show promise in this regard. The objective of this study was to compare the results of the MMSE and MoCA in a group of outpatient schizophrenia sufferers to contribute to research into the instruments’ potential usefulness as screening tools for cognitive impairment in schizophrenia.

Method: The Afrikaans versions of the MMSE and MoCA were administered to Afrikaans-speaking adult outpatients. Participants had at least seven years of formal education and had been in partial or full remission for at least 3 months. The MMSE and MoCA scores for each participant were matched and compared using the non-parametric Wilcoxon matched pairs test.

Results: The sample consisted of 30 Afrikaans-speaking outpatients with schizophrenia. The mean MMSE score was 27.17 ± 2.64, and the mean MoCA score was 22.53 ± 3.91. There was a statistically significant difference between participants’ performance on the MMSE and MoCA tests (p = 0.000008).

Conclusion: Compared to the MMSE, the MoCA may be a more useful instrument to detect cognitive impairment in patients with schizophrenia. Further studies are required.

Introduction

Cognitive impairment is a core feature of schizophrenia1 that is less amenable to treatment than its two other core features: psychotic symptoms (especially) and negative symptoms.2 Schaefer et al. described substantial, generalised cognitive impairment in schizophrenia across multiple domains.3 The American Psychiatric Association describes deficits in declarative memory, working memory, language function, executive functions, and slower processing speed.4 Cognitive deficits in schizophrenia are significant, because they are common (in up to 75% of patients suffering from schizophrenia5,6) and are strongly associated with clinical7,8 and functional outcomes.9,10,11 The importance of measuring cognitive deficits in schizophrenia is well recognised in that cognitive deficits have become a target for research in clinical trials10,12 and furthermore, in 2002, the National Institute of Mental Health established the Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) initiative to ascertain standards for evaluating outcomes in the treatment of schizophrenia.13 Because cognitive deficits in schizophrenia are of such clinical importance, it would be useful to detect them in a clinical setting.

For the detection of cognitive deficits in schizophrenia the ‘gold standard’ is a comprehensive neuropsychological test battery performed by a trained professional.5,14 Unfortunately, this method is not readily available in most clinical settings and is consequently not routinely used.5,14 A brief screening test for cognitive dysfunction would be the ideal for a busy clinical setting but no such instrument has been specifically validated for schizophrenia15 However, because the cognitive deficits of schizophrenia tend to be global,3 whilst perhaps targeting specific domains more than others,4 the cognitive deficits do not differ much (if at all) from the cognitive domains tested by the Mini-Mental State Examination (MMSE)16 and the Montreal Cognitive Assessment Test (MoCA)17 even though both were developed for detecting dementia and mild cognitive impairment prior to dementia.16,17

The MMSE shows a sensitivity for mild cognitive impairment of only 18% when a cut-off score of 26 out of a possible 30 is taken, whereas the MoCA displayed a sensitivity of 90% for mild cognitive impairment at a cut-off score of 26 out of a possible 30.17,18 When a cut-off score of 24 is used for the MMSE, it correlates significantly with dementia at a sensitivity of 0.92 and specificity of 0.96, whereas at a cut-off score of 25 the MMSE continues to correlate significantly with dementia (not mild cognitive impairment) at a sensitivity of 0.97 and specificity of 0.91, in people aged 60 years and older.18 Thus, present evidence indicates that the MoCA performs better at screening for mild cognitive impairment, which is exactly what it was designed for.17 Although the MMSE is less sensitive than the MoCA for detecting mild cognitive impairment, both tests have a high specificity to do so, namely 87% for the MoCA and between 96 and 100% for the MMSE.17,18 The positive predictive value of the MoCA was 89% and the negative predictive value 91% for mild cognitive impairment.17 Thus, if the score of the MMSE and MoCA fall below 26 it indicates possible mild cognitive impairment, but because the MoCA is more sensitive, it is more useful for detecting mild cognitive impairment as previously shown by Nasreddine et al.17 Because both of these instruments are just screening instruments, further neuropsychological testing would be needed to confirm cognitive impairment in a specific case.

Although the MMSE was initially developed to grade cognitive impairment and to follow the course of cognitive impairment over time, and the MoCA was initially developed for mild cognitive impairment, the MMSE has been widely used since 1975 and the MoCA since 2005 for other indications.16,17 The MoCA has become increasingly popular as a cognitive screening instrument in various clinical settings,19 because a considerable body of research shows it to be superior to the MMSE in detecting milder forms of cognitive impairment in various patient populations, including those with Parkinson’s disease20,21 Huntington’s disease22 frontotemporal dementia23 and many others.24,25,26,27 The superiority of the MoCA to the MMSE for detecting mild cognitive impairment in Parkinson’s disease and frontotemporal dementia was confirmed by a battery of neuropsychological tests.20,21,23 A number of studies also compared MMSE- and MoCA results in schizophrenia sufferers which will be further elaborated on in the discussion of the present study.

Most of the studies comparing MoCA and MMSE scores did not validate their outcomes with a battery of tests as was the case in the Parkinson’s disease study above. Thus, these studies took it (as the present study also does) that the MoCA detects mild cognitive deficits irrespective of diagnosis. According to studies thus far, the MoCA seems to be a more useful cognitive screening instrument in schizophrenia than the MMSE.15,28,29,30 Nonetheless, screening for cognitive deficits is not the same as diagnosing a syndrome of cognitive impairment. Yet, it may be an indication for referral for a further neuropsychological assessment, which may be important in a specific case, for example, work performance.

Both the MMSE and the MoCA have been translated from English into various languages, including Afrikaans.31,32 Although the Afrikaans versions of both the MMSE and MoCA are used in clinical practice to evaluate Afrikaans-speaking patients, neither test has been formally standardised. In everyday practice, the Afrikaans versions of the MMSE and MoCA are used with the assumption that they have been vicariously standardised by the English versions. So, using the Afrikaans versions of the MMSE and MoCA, the objective of this study was to compare the results of the MMSE and MoCA in a group of outpatient schizophrenia sufferers to contribute to research into the instruments’ potential usefulness as screening tools for cognitive impairment in schizophrenia.

To the best of the authors’ knowledge there are few studies comparing results between the MMSE and MoCA in screening for cognitive impairment in schizophrenia. One of them is a South African study by Oosthuizen et al.33 However, the aim of that study was completely different to the aim of the present study.

Methods

This study was approved by the Research Ethics Committee of the Faculty of Health Sciences of the University of Pretoria and the MMSE and MoCA were used with permission. During the study, outpatients of Weskoppies Hospital (WKH) were selected as participants. WKH is a large, governmental, academic, psychiatric hospital in Pretoria. It delivers secondary- and tertiary-level mental health services. Study participants were tested at the outpatient department of WKH and also at two nearby residential facilities.

All participants were adult outpatients suffering from schizophrenia. Participants were selected by convenience sampling whereby every consecutive outpatient suffering from schizophrenia who met the requirements of the study, and who was willing to participate, was included in the study. The requirements for inclusion were: an established DSM-IV TR diagnosis of schizophrenia which had been in remission or partial remission for at least three months; age older than 18 years and younger than 60 years; having the ability to give informed consent; having Afrikaans as first language; and at least seven years of formal schooling. Patients with comorbid medical or psychiatric conditions that could have affected their cognitive performance (such as neurological disorders, major neurocognitive disorder, or substance use disorders) were excluded from the study.

A diagnosis of schizophrenia was established by revision of clinical notes, treating-doctors’ reports, or reports from a facility manager. The reason for selecting outpatients in remission or partial remission was to minimise the effect that disruptive psychotic symptoms may have on test results. The reason for at least seven years of formal education is because it is a requirement for administering the version of the MMSE used in this study.

The first author assessed all participants. The level of education, employment status, living circumstances, marital status, and medication used were recorded. Each participant was assessed with both the MMSE and MoCA. The tests were administered and scored as instructed by the relevant instrument. To avoid measurement error, the MMSE and MoCA were alternated as the first test to be administered to participants. Thus, all odd-numbered participants did the MMSE first and the MoCA second, and all even-numbered participants did the MoCA first and the MMSE second.

The study was planned in consultation with a professional statistician as well as a research consultant from the Department of Information Technology of the University of Pretoria. The MMSE and MoCA scores for each participant were matched and compared using the non-parametric Wilcoxon matched pairs test.34

Results

The Afrikaans versions of the MMSE and MoCA were both administered to 34 Afrikaans-speaking participants. Four participants were later excluded from the study, three because the final diagnosis of the participants turned out to be schizoaffective disorder, and one because of a visual impairment, (which the researchers thought might have unduly impinged on the participant’s performance). Consequently the final statistical analysis was performed on 30 participants who performed both the MMSE and MoCA.

None of the participants suffered from a formal thought disorder that impaired communication. All participants cooperated satisfactorily. Two participants were educated at a special school, but nonetheless acquired seven years of formal training as required by the instructions of the copyright holders of the MMSE. Participants’ demographic data are shown in Table 1, their medication in Table 2, and their test results in Table 3 and Table 4.

TABLE 1: Demographic data (n = 30).
TABLE 2: Participants’ medication (n = 30).
TABLE 3: Raw scores obtained with the MMSE and MoCA for participants 1–15.
TABLE 4: Raw scores obtained with the MMSE and MoCA for participants 16–30.

The statistical results of participants’ MMSE tests were as follows: the mean test score was 27.17 ± 2.64 with a median of 28.00. The statistical results of participants’ MoCA tests were as follows: the mean test score was 22.53 ± 3.91 with a median of 22.50. The differences between participants’ MMSE and MoCA test scores differed significantly on the Wilcoxon matched pairs test (p = 0.000008 with p ≤ 0.05 being significant).34 The statistical results are graphically presented in Figure 1.

FIGURE 1: Comparing the Mini-Mental State Examination and Montreal Cognitive Assessment Test scores.

Discussion

To the best of the authors’ knowledge, this was the first study to compare the scores of the MMSE and MoCA in an Afrikaans-speaking population of schizophrenia patients. The findings of this study were similar to those of previous studies researching other language groups.15,28,29,30 The mean MoCA scores of the present study were significantly lower than the mean MMSE scores found in other studies.15,28,29,30 Collectively, these previous findings suggest that the MoCA may be more useful than the MMSE for detecting possible cognitive deficits in schizophrenia patients. Consequently, the results of the present study are in keeping with those studies. Yet, before attributing the significant differences in performance on the MMSE and MoCA in this study to the psychometric properties of the instruments, other reasons for the difference in scores should be explored.

One reason for differences may be because of when the tests were performed in relation to the other. That is, a participant may score better on the MMSE which is always performed first, because of being sharper at the time, whilst when the same person does the MoCA he or she is more fatigued and thus scores poorer. The same scenario can also have a different outcome, namely that the person warms up by doing the MMSE first and thus becomes sharper by the time the MoCA is performed. This problem was addressed by alternating the test that was performed first. At face value the results indicate (Table 3 and Table 4) that irrespective of which test was performed first, the MoCA score was lower. A next possible reason is a learning effect. That is, a participant did the MMSE or MoCA recently and thus performs better on the one than the other. Interestingly, the MMSE does not show a significant learning effect.16 The MoCA has excellent test-retest reliability17 with very good retest performance even at one month with no significant learning effect.31 Although not specifically investigated, it is highly unlikely that either the MMSE or MoCA were administered to study participants in the one month before the study. That is so because neither the MMSE nor MoCA are performed as part of the busy routine follow-up of schizophrenia outpatients at WKH.

Because neither measurement error, nor practice effect reasonably explains participants’ different performances on the MMSE and MoCA, the psychometric properties of the tests appear to be more valuable explanations for the difference. The reason for the MoCA being more useful than the MMSE is explicable in terms of the cognitive domains they evaluate. The MMSE was developed as a method for grading cognitive impairment, and is used to follow up the course of a patient’s cognitive function over time.36 The MoCA, on the other hand, was developed to screen for mild cognitive impairment. To do so it tests a wider variety of cognitive functions than the MMSE does. Both the MMSE and MoCA test orientation to time and to place (the MMSE being the more challenging). Both the MMSE and MoCA test the following, with the MoCA being the more challenging in each case: verbal memory, construction, naming, concentration, and repetition16,17 The MMSE tests for the following functions which the MoCA does not cover: ideational praxis, reading, and writing; none of which has been reported as impaired in schizophrenia. The MoCA tests the following which the MMSE does not cover: cognitive flexibility, planning, abstraction, working memory, and sustained attention; all of which have been reported as impaired in schizophrenia2,7,14,37 and which are not covered by the MMSE. Thus, schizophrenia patients scoring in the unimpaired range on the MMSE may nonetheless have cognitive deficits, which the MMSE does not detect, but which the MoCA identifies. Taking into account the psychometric properties of the MoCA as mentioned in the introduction, a significantly low score (less than 26) on the MoCA is more than just a speculative indication of possible cognitive impairment. It indicates that the MoCA may seriously be considered as a screening tool for cognitive impairment in schizophrenia, and that it needs proper validation studies.

The authors note the following limitations to the study: there is a disproportionate number of male participants, which is an artifact of the convenience sampling method; no other psychometric tests (including the PANSS and neuropsychological tests) were performed; the sample size was modest; and the Afrikaans versions of the MMSE and MoCA have not been standardised. Although the PANSS was not used, these participants were all stable outpatients, and were not suffering from a formal thought disorder that impaired communication. Although the sample size is modest, it is nonetheless large enough to make statistically significant inferences. Finally, it was not formally established whether the MMSE and/or MoCA were recently administered, but, as previously said, such an event is unlikely to explain the findings.

Conclusion

So far, there is no validated, brief screening instrument for the detection of cognitive impairment in schizophrenia. Previous research indicates that the MoCA may be more useful than the MMSE as a screening instrument for cognitive impairment in schizophrenia. The present study supports this finding. However, the MoCA is only a screening tool, not a diagnostic one. This study, together with previous studies, indicates that the MoCA is a potential screening tool for cognitive impairment in schizophrenia. However, further work is needed to establish the validity of the MoCA compared to the MMSE to detect cognitive impairment in schizophrenia. Further studies are also required to standardise the Afrikaans versions of the MMSE and MoCA.

Acknowledgements

We wish to thank Dr F. Kanfer and Ms J. Sommerville for supporting the researchers with statistics consultations. There was no conflict of interest regarding the research or publication.

Competing interests

The authors declare that they have no financial or personal relationships which may have inappropriately influenced them in writing this article.

Authors’ contributions

M.R. (University of Pretoria) was the principal investigator and was responsible for all data collection and writing the manuscript. P.J. (University of Pretoria) was the co-investigator and assisted with writing the manuscript.

References

  1. Elvevåg B, Goldberg TE. Cognitive impairment in schizophrenia is the core of the disorder. Crit Rev Neurobiol. 2000;12(1):1–21. http://dx.doi.org/10.1615/CritRevNeurobiol.v14.i1.10
  2. Yudofsky SC, Hales RE. The American Psychiatric Publishing Textbook of Neuropsychiatry and Behavioral Neuroscience. 5th ed. American Psychiatric Publishing; 2008:970–971.
  3. Schaefer J, Giangrande E, Weinberger DR, Dickinson D. The global cognitive impairment in schizophrenia: Consistent over decades and around the world. Schizophr Res. 2013;150(1):42–50. http://dx.doi.org/10.1016/j.schres.2013.07.009
  4. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition. American Psychiatric Publishing. Washington DC. 2013.
  5. Moore DJ, Barton WP, Jeste DV. Use of the Mini-Mental State Exam in middle-aged and older outpatients with schizophrenia. Am J Geriat Psychiat. 2004;12(4):412–419. http://dx.doi.org/10.1176/appi.ajgp.12.4.412
  6. Kremen WS, Seidman LJ, Faraone SV, Toomey R, Tsuang MT. The paradox of normal neuropsychological function in schizophrenia. J Abnorm Psychol. 2000;109(4):743–752. http://dx.doi.org/10.1037//0021-843X.109.4.743
  7. Hoff AL, Kremen WS. Neuropsychology in schizophrenia: an update. Curr Opin Psychiatr. 2003;16:149–155. http://dx.doi.org/10.1097/00001504-200303000-00003
  8. Grawe RW, Levander S. Neuropsychological impairments in patients with schizophrenia: stability and prediction of outcome. Acta Psychiatr Scand. 2001;104: Suppl 408:S60–64. http://dx.doi.org/10.1034/j.1600-0447.2001.104s408060.x
  9. Green MF, Kern RS, Braff DL, Mintz J. Neurocognitive deficits and functional outcome in schizophrenia: are we measuring the “right stuff”? Schizophrenia Bull. 2000;26(1):119–136. http://dx.doi.org/10.1093/oxfordjournals.schbul.a033430
  10. Morrison G, O’Carroll R, McCreadie R. Long-term course of cognitive impairment in schizophrenia. Brit J Psychiat. 2006;189:556–557. http://dx.doi.org/10.1192/bjp.bp.105.016113
  11. Green MF, What are the functional consequences of neurocognitive deficits in schizophrenia? Am J Psychiatry. 1996;153(3):321–330.
  12. Green MF, Nuechterlein KH. Should schizophrenia be treated as a neurocognitive disorder? Schizophrenia Bull. 1999;25(2):309–319. http://dx.doi.org/10.1093/oxfordjournals.schbul.a033380
  13. Green MF, Nuechterlein KH, Gold JM, et al. Approaching a consensus cognitive battery for clinical trials in schizophrenia: the NIMH-MATRICS conference to select cognitive domains and test criteria. Biol Psychiat. 2004;56(5)301–307. http://dx.doi.org/10.1016/j.biopsych.2004.06.023
  14. Hurford MI, Marder SR, Keefe RS, Reise SP, Bilder RM. A brief cognitive assessment tool for schizophrenia: construction of a tool for clinicians. Schizophrenia Bull. 2011;37:538–545. http://dx.doi.org/10.1093/schbul/sbp095
  15. Preda A, Adami A, Kemp AS, Nguyen D. MoCA: A screening instrument for the assessment of cognition in schizophrenia. Abstracts from the 13th International Congress on Schizophrenia Research; 2011. Schizophrenia Bull. 37(S1):225–226.
  16. Folstein MF, Folstein SE, McHugh PR. Mini-Mental State: a practical method for grading the cognitive state of patients for the clinician. J Psychiat Res. 1975;12:189–198.
  17. Nasreddine ZS, Phillips NA, Bedirian V, et al. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53:695–699. http://dx.doi.org/10.1111/j.1532-5415.2005.53221.x
  18. Heun R, Papassotiropoulos A, Jennssen F. The validity of psychometric instruments for detection of dementia in the elderly general population. Int J Geriatr Psych. 1998;13:368–380. http://dx.doi.org/10.1002/(SICI)1099-1166(199806)13:6<368::AID-GPS775>3.0.CO;2-9
  19. Musso MW, Cohen AS, Auster TL, McGovern JE. Investigation of the Montreal Cognitive Assessment (MoCA) as a cognitive screener in severe mental illness. Psychiat Res. 2014 (In press). http://dx.doi.org/10.1016/j.psychres.2014.07.078
  20. Hoops S, Nazem S, Siderowf AD, et al. Validity of the MoCA and MMSE in detection of MCI and dementia in Parkinson disease. Neurology. 2009;73:1738–1745. http://dx.doi.org/10.1212/WNL.0b013e3181c34b47
  21. Chou KL, Lenhart A, Koeppe RA, Bohnen NI. Abnormal MoCA and normal range MMSE scores in Parkinson disease without dementia: Cognitive and neurochemical correlates. Parkinsonism Relat D. 2014;20:1076–1080. http://dx.doi.org/10.1016/j.parkreldis.2014.07.008
  22. Videnovic A, Bernard B, Fan W, Jaglin J, Leurgans S, Shannon KM. The Montreal Cognitive Assessment as a screening tool for cognitive dysfunction in Huntington’s disease. Movement Disord. 2010;25(3):402–404. http://dx.doi.org/10.1002/mds.22748
  23. Freitas S, Simões M, Alves L, Duro D, Santana I. Montreal Cognitive Assessment (MoCA): Validation study for frontotemporal dementia. J Geriatr Psychiatry Neurol. 2012;25(3):146–154. http://dx.doi.org/10.1177/0891988712455235
  24. Olson RA, Chhanabhai T, McKenzie M. Feasibility study of the Montreal Cognitive Assessment (MoCA) in patients with brain metastases. Support Care Cancer. 2008;16:1273–1278. http://dx.doi.org/10.1007/s00520-008-0431-3
  25. Gagnon JP, Postuma RB, Joncas S, Desjardins C, Latreille V. The Montreal Cognitive Assessment: A screening tool for mild cognitive impairment in REM sleep behaviour disorder. Movement disord. 2010;25(7):936–940. http://dx.doi.org/10.1002/mds.23079
  26. Pendlebury ST, Cuthbertson FC, Welch SJ, Mehta Z, Rothwell PM. Underestimation of cognitive impairment by Mini-mental State Examination versus the Montreal Cognitive Assessment in patients with transient ischemic attack and stroke. Stroke. 2010;41:1290–1293. http://dx.doi.org/10.1161/STROKEAHA.110.579888
  27. Dong Y, Sharma VK, Chan BP, et al. The Montreal Cognitive Assessment (MoCA) is superior to the Mini-Mental State Examination (MMSE) for the detection of vascular cognitive impairment after acute stroke. J Neurol Sci. 2010;299(1):15–18. http://dx.doi.org/10.1016/j.jns.2010.08.051
  28. Fisekovic S, Memic A, Pasalic A. Correlation between MoCA and MMSE for the assessment of cognition in schizophrenia. Acta Inform Med. 2012;20(3):186–189. http://dx.doi.org/10.5455/aim.2012.20.186-189
  29. Zeng Q, Yang Q, Li R. Comparison of the application of Montel Cognitive Assessment and Mini-Mental State Examination to cognitive function evaluation in the stable patients with schizophrenia. Jilin Medical Journal. 2013(14):006.
  30. Wu C, Dagg P, Molgat C. A pilot study to measure cognitive impairment in patients with severe schizophrenia with the Montreal Cognitive Assessment (MOCA). Schizophr Res. 2014 (In press). http://dx.doi.org/10.1016/j.schres.2014.07.006
  31. The Montreal Cognitive Assessment. [cited 2012 April 2012] Available from: http://www.MoCAtest.org
  32. Robertson B, Allwood CW, Gagiano CA. Textbook of Psychiatry for Southern Africa. Oxford University Press, 2001:339.
  33. Oosthuizen P, Temmingh H, Lewis I, Thornton H. A cross-sectional study investigating the concurrent validity of the Montreal Cognitive Assessment (MoCA) tool with the MMSE in patients with schizophrenia. Proceedings of the SASOP Congress; 2014 Sep 3–7; Durban, South Africa. S Afr J Psych. 2014;20(3):106.
  34. Sheskin DJ. Handbook of parametric and nonparametric statistical procedures. CRC Press; 2003.
  35. The Montreal Cognitive Assessment. [cited on 2015 Feb 02] Available from: http://www.mocatest.org/FAQ.asp
  36. Folstein MF, Lee NR, Helzer JE. The mini-mental state examination. Arc Gen Psychiatry. 1983;40(7):812. http://dx.doi.org/10.1001/archpsyc.1983.01790060110016
  37. Irani F, Kalkstein S, Moberg EA, Moberg PJ. Neuropsychological performance in older patients with schizophrenia: A meta-analysis of cross-sectional and longitudinal studies. Schizophrenia Bull. 2011;37(6):1318–26. http://dx.doi.org/10.1093/schbul/sbq057

 

Crossref Citations

1. Italian Validation of the Screen for Cognitive Impairment in Psychiatry
Martino Belvederi Murri, Federica Folesani, Silvia Costa, Anna Clara Morelli, Valentina Scillitani, Giuseppe Guaiana, Bruno Biancosino, Rosangela Caruso, Maria Giulia Nanni, Luigi Zerbinati, Scot E. Purdon, Luigi Grassi
Community Mental Health Journal  vol: 56  issue: 8  first page: 1411  year: 2020  
doi: 10.1007/s10597-020-00583-x