Review article
Cognitive remediation in schizophrenia: A methodological appraisal of systematic reviews and meta-analyses

https://doi.org/10.1016/j.jpsychires.2016.01.004Get rights and content

Abstract

Objective

Systematic reviews and meta-analyses are a primary source of evidence when evaluating the benefit(s) of cognitive remediation (CR) in schizophrenia. These studies are designed to rigorously synthesize scientific literature; however, cannot be assumed to be of high methodological quality. The aims of this report were to: 1) review the use of systematic reviews and meta-analyses regarding CR in schizophrenia; 2) conduct a systematic methodological appraisal of published reports examining the benefits of this intervention on core outcome domains; and 3) compare the correspondence between methodological and reporting quality.

Method

Electronic databases were searched for relevant articles. Twenty-one reviews met inclusion criteria and were scored according to the AMSTAR checklist-a validated scale of methodological quality. Five meta-analyses were also scored according to PRISMA statement to compare ‘quality of conduct’ with ‘quality of reporting’.

Results

Most systematic reviews and meta-analyses shared strengths and fell within a ‘medium’ level of methodological quality. Nevertheless, there were consistent areas of potential weakness that were not addressed by most reviews. These included the lack of protocol registration, uncertainty regarding independent data extraction and consensus procedures, and the minimal assessment of publication bias. Moreover, quality of conduct may not necessarily parallel quality of reporting, suggesting that consideration of these methods independently may be important.

Conclusions

Reviews concerning CR for schizophrenia are a valuable source of evidence. However, the methodological quality of these reports may require additional consideration. Enhancing quality of conduct is essential for enabling research literature to be interpreted with confidence.

Section snippets

Cognitive remediation in schizophrenia

Cognitive remediation (CR) represents a broad range of learning-based interventions that aim to achieve improvements in cognition and/or the self-management of these abilities (Saperstein and Kurtz, 2013). The ultimate goal of CR is generalization to untrained cognitive skills as well as transfer to real-world psychosocial outcomes (Saperstein and Kurtz, 2013). CR may involve exposure to repetative training exercises (i.e. “drill-and-practice”), strategic discussions about how to manage

Objective

The primary aims of this study were to: 1) review the use of systematic reviews and meta-analyses concerning CR in schizophrenia; and 2) conduct a systematic methodological appraisal of published systematic reviews and meta-analyses that have examined the efficacy (or effectiveness) of this intervention on core outcome domains in schizophrenia using the AMSTAR checklist. It was intended that this would provide direction regarding ways to enhance the quality of future reviews of CR for

Search strategy

The reporting standards and methodological rigor of this report was informed by the PRISMA statement and AMSTAR checklist respectively, where appropriate. A search of systematic review and meta-analysis protocol registries including PROSPERO, the Cochrane Database of Systematic Reviews, and Joanna Briggs Institute Library revealed that no similar studies were underway as of December 2014.

Article searches were conducted using multiple electronic databases including PsychINFO (1806–2015),

Search results

The initial electronic search revealed 361 records; however, only 189 remained after duplicates were removed (n = 172). After title and abstract screening, 24 articles proceeded to full-text review. Seven additional reports were identified after scanning each title in the reference list of these articles. All but two of these additional reports (Bellack, 2004, Rund and Borg, 1999) met the inclusion criteria after abstract screening. Therefore, overall, a total of 29 articles proceeded to

Discussion

The primary aims of this report were to review the use of systematic reviews and meta-analyses concerning CR in schizophrenia, and systematically evaluate the methodological quality of published reviews using the AMSTAR checklist. It was intended that highlighting areas of strength and weakness would help inform future reviews in this area. To our knowledge, this was the first methodological evaluation of reviews in this field. A secondary aim was to compare total scores on the AMSTAR checklist

Role of funding source

We did not receive funding to prepare or produce this article.

Conflicts of interest

We declare that all contributing authors do not have any competing interests or conflicts of interest.

Statement of contribution

All named authors had a key role in the preparation of this manuscript, as briefly described below.

Bryce – Mr Bryce wrote and prepared the majority of the manuscript was heavily involved in developing the concept of this review, and was the first independent reviewer.

Sloan – Ms Sloan was the second independent reviewer of articles.

Lee – Dr Lee mediated the consensus procedure for the review and was involved in editing the manuscript.

Ponsford – Prof Ponsford was involved in concept formation and

Acknowledgments

We thank the authors from each of the articles reviewed for their contribution to the field.

References (67)

  • D. Pieper et al.

    Systematic review found AMSTAR, but not R(evised)-AMSTAR, to have good measurement properties

    J. Clin. Epidemiol.

    (2015)
  • B.J. Shea et al.

    AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews

    J. Clin. Epidemiol.

    (2009)
  • M. Statucka et al.

    Efficacy of social cognition remediation programs targeting facial affect recognition deficits in schizophrenia: a review and consideration of high-risk samples and sex differences

    Psychiatry Res.

    (2013)
  • S. Adie et al.

    Quality of conduct and reporting of meta-analyses of surgical interventions

    Ann. Surg.

    (2015)
  • P.M. Aguiar et al.

    Exploring the quality of systematic reviews on pharmacist interventions in patients with diabetes: an overview

    Ann. Pharmacother.

    (2014)
  • M. Armando et al.

    Psychosocial interventions for very early and early-onset schizophrenia: a review of treatment efficacy

    Curr. Opin. Psychiatry

    (2015)
  • S. Barlati et al.

    Cognitive remediation in the early course of schizophrenia: a critical review

    Curr. Pharm. Des.

    (2012)
  • S. Barlati et al.

    Cognitive remediation in schizophrenia: current status and future perspectives

    Schizophr. Res. Treat.

    (2013)
  • A.S. Bellack

    Skills training for people with severe mental illness

    Psychiatr. Rehabil. J.

    (2004)
  • D.J. Castle

    Where to fo Australian mental health services? promoting self efficacy

    Aust. N. Z. J. Psychiatry

    (2013)
  • M. Cella et al.

    Cognitive Remediation for Negative Symptoms in Schizophrenia: a Network Meta-analysis. PROSPERO

    (2014)
  • W.T. Chien et al.

    Current approaches to treatments for schizophrenia spectrum disorders, part II: psychosocial interventions and patient-focused perspectives in psychiatric care

    J. Neuropsychiatr. Dis. Treat.

    (2013)
  • C.M. Clark

    Psychosocial treatments for schizophrenia

    Clin. Schizophr. Relat. Psychoses

    (2013)
  • S. Davies

    The importance of PROSPERO to the National Institute for Health Research

    Syst. Rev.

    (2012)
  • A. Delaney et al.

    The quality of reports of critical care meta-analyses in the cochrane database of systematic reviews: an independent appraisal

    Crit. Care Med.

    (2007)
  • A. Franco et al.

    Publication bias in the social sciences: unlocking the file drawer

    Science

    (2014)
  • M.F. Green et al.

    Neurocognitive deficits and functional outcome in schizophrenia: are we measuring the right stuff?

    Schizophr. Bull.

    (2000)
  • O. Grynszpan et al.

    Efficacy and specificity of computer-assisted cognitive remediation in schizophrenia: a meta-analytical study

    Psychol. Med.

    (2011)
  • R.L. Hayes et al.

    Cognitive rehabilitation for people with schizophrenia and related conditions

    Cochrane Database Syst. Rev.

    (2000)
  • W.P. Horan et al.

    Social cognition training for individuals with schizophrenia: emerging evidence

    Am. J. Psychiatr. Rehabil.

    (2008)
  • R.S. Keefe et al.

    Neurocognitive effects of antipsychotic medications in patients with chronic schizophrenia in the CATIE trial

    Arch. General Psychiatry

    (2007)
  • L. Krabbendam et al.

    Cognitive rehabilitation in schizophrenia: a quantitative analysis of controlled studies

    Psychopharmacology

    (2003)
  • J. Kung et al.

    From systematic reviews to clinical recommendations for evidence-based health care: validation of revised assessment of multiple systematic reviews (R-AMSTAR) for grading clinical relevance

    Open Dent. J.

    (2010)
  • Cited by (29)

    • The efficacy of computer-based cognitive training for executive dysfunction in schizophrenia

      2019, Psychiatry Research
      Citation Excerpt :

      Secondly, the observed improvement in executive performance can be a result not only of computer-based training itself, but also of non-specific factors, such as the use of electronic devices, interaction with a clinician, or cognitive challenge (Kurtz et al., 2007). Thirdly, a combination of cognitive remediation and pharmacological treatment may have a more positive effect on the functioning of the brain than pharmacological treatment alone (Bryce et al., 2016a; Kluwe-Schiavon et al., 2013). In our study, speed of information processing (in the trail-making and reading tasks) was similar in both clinical groups (SPTG and SPNTG) and showed no improvement with either pharmacological treatment alone or combined with computer-based training.

    • A systematic review of task-based functional neuroimaging studies investigating language, semantic and executive processes in thought disorder

      2018, Neuroscience and Biobehavioral Reviews
      Citation Excerpt :

      The aim of the current systematic review was to provide a more comprehensive qualitative account and synthesis of the research that has investigated TD using task-based functional neuroimaging techniques to target executive, language, or semantic functions, thus reflecting the focus of behavioural investigations into the aetiology of TD. The review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement (Moher et al., 2009) and incorporating some of the recommendations suggested by Bryce et al. (2016). The databases PubMed, Scopus, and Web of Science were used to locate relevant literature, with searches limited to articles published from the 1st of January, 1990 onwards.

    • Integrated cognitive remediation and standard rehabilitation therapy in patients of schizophrenia: persistence after 5 years

      2018, Schizophrenia Research
      Citation Excerpt :

      Cognitive impairments are considered a core feature of schizophrenia (Bryce et al., 2016) and are recognized as the most important predictors of functional outcome and quality of life (Rispaud et al., 2016).

    View all citing articles on Scopus
    View full text