The evaluation of insufficient cognitive effort in schizophrenia in light of low IQ scores
Introduction
Early clinical conceptualizations of schizophrenia (SZ) considered cognitive impairment to be a core feature of the disease (Kraepelin, 1919). Modern empirical studies have confirmed these observations, with meta-analyses of neuropsychological test performance indicating that SZ patients perform on the order of 1.0 standard deviation below that of healthy controls on standardized tests (Dickinson et al., 2007, Fioravanti et al., 2005). However, studies have yet to uncover a neurocognitive profile or pattern of differential deficits that characterizes the majority of people with SZ (Reichenberg and Harvey, 2007). Rather, individuals with SZ have been found to display deficits of similar magnitude across a range of cognitive domains (e.g., attention, working memory, executive functioning), with moderate interrelationships among tests (Dickinson, 2008, Dickinson et al., 2004, Dickinson et al., 2008). These findings have lead some to suggest that SZ is characterized by a “generalized neurocognitive deficit” (Dickinson and Harvey, 2009, Dickinson et al., 2008).
Several biological accounts have been proposed to explain the generalized neurocognitive deficit in SZ, including central nervous system (CNS) (e.g., impaired signal integration across neural networks, gray and white matter abnormalities, NMDA and GABA interneuron receptor dysfunction) (Dickinson and Harvey, 2009) and “general systems” abnormalities (e.g., inflammation, oxidative stress, metabolic dysfunction) (Asevedo et al., 2013, Friedman et al., 2010, Lindenmayer et al., 2012, Ribeiro-Santos et al., 2014). However, psychological explanations of the generalized neurocognitive deficit have received relatively little attention despite the fact that clinicians have long suspected that symptoms of avolition and apathy lead some patients to put forth insufficient effort during neuropsychological testing. The field of clinical neuropsychology has developed and validated several measures designed to detect insufficient effort during neuropsychological testing (Sollman and Berry, 2011, Vickery et al., 2001). When these measures have been applied to study insufficient effort in SZ, inconsistent rates of effort test failure have been observed. The majority of studies have indicated that approximately 15–25% of SZ patients fall below standard clinical cut-offs for low effort (Avery et al., 2009, Back et al., 1996, Duncan, 2005, Egeland et al., 2003, Gierok et al., 2005, Hunt et al., 2014, Moore et al., 2013, Pivovarova et al., 2009, Schroeder and Marshall, 2011) although a few studies report failure rates as high as 60%–72% (Gorissen et al., 2005, Hunt et al., 2014). Several factors may contribute to discrepant rates of effort test failure observed across studies, including inpatient versus outpatient status, level of personal and parental education, symptom severity, the sensitivity and specificity of effort tests administered, and whether the effort test used was embedded or free-standing (see Gorissen et al., 2005, Hunt et al., 2014, Morra et al., 2015, Strauss et al., 2015). Although the proportion of SZ patients failing effort tests may be inconsistent across studies, the ability of effort tests to predict neurocognitive impairment is reliable, with low effort accounting for approximately 25–35% of variance in global neuropsychological test scores (Avery et al., 2009, Gorissen et al., 2005, Morra et al., 2015, Strauss et al., 2015). Thus, there is some evidence that insufficient effort contributes at least to some extent to the generalized neurocognitive deficit that characterizes SZ.
It should also be noted that although falling below clinically derived effort cut-offs is taken as evidence for malingering (i.e., intentionally feigning cognitive impairment) in most clinical contexts (Bush et al., 2005) this is not the most plausible explanation for low effort in SZ. In the majority of studies published to date, neuropsychological evaluations were conducted solely for the purposes of research, not for clinical service or disability determination. Participants therefore had no readily identifiable incentive to put forth suboptimal performance during testing. Instead, the most viable explanation seems to be that individuals with SZ fail effort tests due to motivational impairments that are core to the disease and affect approximately 1/3 of the SZ population (Ahmed et al., 2014, Foussias and Remington, 2010, Strauss et al., 2013)Several studies now support this “motivational” interpretation, reporting that negative symptoms and psychological processes associated with negative symptoms (e.g., defeatist performance beliefs) are associated with effort test failure in SZ (Avery et al., 2009, Gorissen et al., 2005, Morra et al., 2015, Strauss et al., 2015).
In addition to negative symptoms, there are several other plausible moderators of insufficient effort that have received surprisingly little attention to date. Global intellectual functioning, as indexed via intelligence quotient (IQ) scores on standardized tests, is one particularly underexplored factor. Effort test performance has traditionally been thought to be immune to the effects of low IQ (Flaro et al., 2007); however, there is some evidence that IQ may in fact be highly predictive of insufficient effort in neuropsychiatric populations. For example, Dean et al. (2008) found that IQs in the borderline or lower range of intellectual functioning (<80) were associated with elevated rates of effort test failure in a sample of epilepsy patients. IQs in the <80 range are not uncommon in SZ (Aylward et al., 1984); however, it is unclear whether SZ patients with low IQ are at increased likelihood of failing effort testing. Only one study that we know of has evaluated the role of low IQ in effort test performance in SZ, with a correlation of r = −0.35 reported between the RBANS Effort Index and Full-Scale IQ (Morra et al., 2015). Thus, there is some preliminary evidence that low IQ may indeed be an important moderator of insufficient effort in SZ; however, more systematic investigations are needed to test this hypothesis fully.
The aims of the current study were threefold: 1) to evaluate the proportion of SZ patients falling below clinically derived cut-scores on well-validated embedded effort-tests; 2) to determine whether clinically rated positive, negative, and disorganized symptoms of SZ are significant moderators of effort-test performance; 3) to examine the role of low IQ in effort test performance in SZ. Based on prior studies, it was hypothesized that a minority of SZ patients (approximately 15–25%) would fall below established effort cut-off scores (Duncan, 2005, Egeland et al., 2003, Gierok et al., 2005, Hunt et al., 2014, Moore et al., 2013, Schroeder and Marshall, 2011)and that insufficient effort would be predicted by low IQ and greater severity of negative symptoms (Avery et al., 2009, Gorissen et al., 2005, Morra et al., 2015, Strauss et al., 2015). Additionally, consistent with the notion that low effort contributes to the generalized neurocognitive deficit, we predicted that insufficient effort would account for a significant proportion of variance in neuropsychological performance on tests not used to index insufficient effort.
Section snippets
Participants
Participants included 60 individuals meeting DSM-IV-TR criteria for schizophrenia (n = 47) or schizoaffective disorder (n = 13) (SZ) and 30 healthy controls (CN). Individuals with SZ were recruited from an outpatient mental health facility in Nevada. Consensus diagnosis was established via a best-estimate approach, based on multiple psychiatric interviews and a detailed medical history. Diagnosis was later confirmed using the Structured Clinical Interview for the DSM-IV-TR (SCID: First et al.,
Results
Overall, 16.1% of SZ patients and 0% of CN failed both effort indices and 3.3% CN and 32.1% SZ failed one index [χ2 (2,86) = 18.00, p < 0.001]. A total of 35.7% SZ and 3.3% CN fell below the Finger Tapping Effort Index cut-off [χ2 (1,85) = 11.10, p < 0.001], and 28.3% of patients and 0% controls fell below the Reliable Digit Span index cut-off [χ2 (1,89) = 10.48, p < 0.001].
Discussion
Results indicated that 0% CN and 16.1% SZ failed two effort indices, and 3.3% CN and 32.1% SZ failed one index. We recommend that results from patients failing two, rather than only one effort test, be used for the purposes of interpreting the current results. This is because it is ideal to obtain converging evidence across multiple measures, particularly when using embedded effort tests that base insufficient effort determinations on a single score (Bush et al., 2005). Use of multiple
Role of funding source
Research was supported by an internal SITE grant from the University of Nevada Las Vegas to Daniel N. Allen.
Contributors
Daniel Allen and Gregory Strauss designed the study. Data processing was performed by Bern Lee. Statistical analyses and writing of the first draft of the manuscript were performed by Kayla Whearty and Gregory Strauss. All authors contributed to and approved the final manuscript.
Conflict of interest
Authors have no conflicts of interest relevant to the current study.
Acknowledgments
We would like to thank the participants in the study and the staff at Mojave Adult Child and Family Services for facilitating clinical research efforts. We are indebted to Sylvia Ross and Lisa Duke for their assistance with data collection.
References (66)
- et al.
Impact of peripheral levels of chemokines, BDNF and oxidative markers on cognition in individuals with schizophrenia
J Psychiatr Res
(2013) - et al.
The role of effort, cognitive expectancy appraisals and coping style in the maintenance of the negative symptoms of schizophrenia
Psychiatry Res
(2009) - et al.
Symptom validity assessment: practice issues and medical necessity NAN policy & planning committee
Arch Clin Neuropsychol
(2005) - et al.
General and specific cognitive deficits in schizophrenia
Biol Psychiatry
(2004) - et al.
General and specific cognitive deficits in schizophrenia: Goliath defeats David?
Biol Psychiatry
(2008) - et al.
Performance of forensic and non-forensic adult psychiatric inpatients on the Test of Memory Malingering
Arch Clin Neuropsychol
(2005) - et al.
Effort and cognition in schizophrenia patients
Schizophr Res
(2005) - et al.
Relationship between metabolic syndrome and cognition in patients with schizophrenia
Schizophr Res
(2012) - et al.
Predictors of neuropsychological effort test performance in schizophrenia
Schizophr Res
(2015) - et al.
Automatic affective processing impairments in patients with deficit syndrome schizophrenia
Schizophr Res
(2008)
Deconstructing negative symptoms of schizophrenia: avolition-apathy and diminished expression clusters predict clinical presentation and functional outcome
J Psychiatr Res
Impaired facial affect labeling and discrimination in patients with deficit syndrome schizophrenia
Schizophr Res
Negative symptoms and depression predict lower psychological well-being in individuals with schizophrenia
Compr Psychiatry
Detection of inadequate effort on neuropsychological testing: a meta-analytic review of selected procedures
Arch Clin Neuropsychol
Using negative feedback to guide behavior: impairments on the first 4 cards of the Wisconsin Card Sorting Test predict negative symptoms of schizophrenia
Schizophr Res
Are negative symptoms dimensional or categorical? Detection and validation of deficit schizophrenia with taxometric and latent variable mixture models
Schizophr Bull
Scale for the assessment of positive symptoms (SAPS)
Scale for the assessment of negative symptoms
Comparison of the repeatable battery for the assessment of neuropsychological status effort index and stand-alone symptom validity tests in a military sample
Arch Clin Neuropsychol
Sensitivity and specificity of finger tapping test scores for the detection of suspect effort
Clin Neuropsychol
Intelligence in schizophrenia: meta-analysis of the research
Schizophr Bull
Sensitivity and specificity of various digit span scores in the detection of suspect effort
Clin Neuropsychol
The performance of schizophrenics on three cognitive tests of malingering, rey 15-Item memory test, rey dot counting, and hiscock forced-choice method
Assessment
Manual of directions and scoring
The structure of negative symptoms within schizophrenia: implications for assessment
Schizophr Bull
The relationship of IQ to effort test performance
Clin Neuropsychol
California verbal learning test, research edition
Digit symbol coding and general cognitive ability in schizophrenia: worth another look?
Br J Psychiatry J Ment Sci
Systemic hypotheses for generalized cognitive deficits in schizophrenia: a new take on an old problem
Schizophr Bull
Overlooking the obvious: a meta-analytic comparison of digit symbol coding tasks and other cognitive measures in schizophrenia
Arch Gen Psychiatry
Neurocognitive function in schizophrenia with comorbid posttraumatic stress disorder
J Clin Exp Neuropsychol
The impact of cognitive and psychiatric impairment of psychotic disorders on the test of memory malingering (TOMM)
Assessment
Sensitivity and specificity of memory dysfunction in schizophrenia: a comparison with major depression
J Clin Exp Neuropsychol
Cited by (11)
Dispersion of cognitive performance test scores on the MATRICS Consensus Cognitive Battery: A different perspective
2022, Schizophrenia Research: CognitionCitation Excerpt :The rate at which patients with schizophrenia fail to remain consistently engaged in cognitive testing procedures, whatever the reason, may be substantial (Kreis et al., 2020; Morra et al., 2015; Ruiz et al., 2020). Interpretation of such measures are, at best, more complicated in patients with schizophrenia, due to the common, disease-related impairment in the ability to sustain the levels of motivation or attention required to perform optimally, reactions to the stress of recognizing that one is performing poorly to a series of cognitive tests, the potential social or economic motivations to perform less than optimally, and the finding that “effort test” failure may more often relate to demonstrable “real-world” functional limitations (Whearty et al., 2015). In this investigation, however, even if inconsistent engagement in testing procedures contributes to the results, there is no obvious reason to postulate that it would impact one treatment group more than the other.
A Meta-Analysis of Neuropsychological Effort Test Performance in Psychotic Disorders
2020, Neuropsychology ReviewPerformance validity test failure in clinical populations- A systematic review
2020, Journal of Neurology, Neurosurgery and Psychiatry