While many studies have demonstrated a relationship between depression and cognitive deficits, most have neglected to include measurements of performance validity. This study examined the relationship between depression and cognition after accounting for noncredible performance. Participants were veterans referred for outpatient clinical evaluation. The first set of regression analyses (N = 187) included age, sex, and education in Model 1, Beck Depression Inventory-2 (BDI-2) added in Model 2, and pass/failure of Test of Memory Malingering (TOMM) added in Model 3 as predictors of 12 neuropsychological test indices. The second set of analyses (N = 559) mirrored the first but with Major Depressive Disorder (MDD) diagnosis in Models 2 and 3. In the first analyses, after including TOMM in the model, only the relationship between BDI-2 and verbal fluency remained significant, but this did not survive a Bonferroni correction. In the second analyses, after including TOMM and Bonferroni correction, MDD diagnosis was a significant predictor only for CVLT-II Short Delay Free Recall. Therefore, the relationship between depression and cognition may not be driven by frank cognitive impairment, but rather by psychological mechanisms, which has implications for addressing depressed individuals' concerns about their cognitive functioning and suggest the value of providing psychoeducation and reassurance.
IntroductionIt is common to use normative adjustments based on race to maintain accuracy when interpreting cognitive test results during neuropsychological assessment. However, embedded performance validity tests (PVTs) do not adjust for these racial differences and may result in elevated rates of false positives in African American/Black (AA) samples compared to European American/White (EA) samples.MethodsVeterans without Major Neurocognitive Disorder completed an outpatient neuropsychological assessment and were deemed to be performing in a valid manner (e.g., passing both the Test of Memory Malingering Trial 1 (TOMM1) and the Medical Symptom Validity Test (MSVT), (n = 531, EA = 473, AA = 58). Five embedded PVTs were administered to all patients: WAIS-III/IV Processing Speed Index (PSI), Brief Visuospatial Memory Test-Revised: Discrimination Index (BVMT-R), TMT-A (secs), California Verbal Learning Test-II (CVLT-II) Forced Choice, and WAIS-III/IV Digit Span Scaled Score. Individual PVT false positive rates, as well as the rate of failing two or more embedded PVTs, were calculated.ResultsFailure rates of two embedded PVTs (PSI, TMT-A), and the total number of PVTs failed, were higher in the AA sample. The PSI and TMT-A remained significantly impacted by race after accounting for age, education, sex, and presence of Mild Neurocognitive Disorder. There were PVT failure rates greater than 10% (and considered false positives) in both groups (AA: PSI, TMT-A, and BVMT-R, 12-24%; EA: BVMT-R, 17%). Failing 2 or more PVTs (AA = 9%, EA = 4%) was impacted by education and Mild Neurocognitive Disorder but not by race.ConclusionsIndividual (timed) PVTs showed higher false positive rates in the AA sample even after accounting for demographic factors and diagnosis of Mild Neurocognitive Disorder. Requiring failure on 2 or more embedded PVTs reduced false positive rates to acceptable levels across both groups (10% or less) and was not significantly influenced by race.
The present study aimed to investigate demographic differences in performance validity test (PVT) failure in a Veteran sample. Data were extracted retrospectively from neuropsychological evaluations at a southeastern Veterans Affairs (VA) Medical Center. Only male Veterans who were either European American/White (EA) or African American/Black (AA), and for whom complete data were available were included in the study (N = 1271). We investigated whether performance on two frequently used PVTs, the Test of Memory Malingering (TOMM) and the Medical Symptom Validity Test (MSVT), significantly differed by age, education, race, and VA service connection using separate logistic regressions. Veterans with younger age, less education, and VA service-connected disability were significantly more likely to fail both PVTs. Race was not a significant predictor of MSVT failure, but AA patients were significantly more likely than EA patients to fail the TOMM. For all significant demographic predictors in the models, effects were small. In a subsample of patients who were given both PVTs (n = 467), the pattern of differences based on race remained; 46% of AA patients and 36% of EA patients failed the TOMM, while 44% of AA patients and 43% of EA patients failed the MSVT. Performance on the TOMM and MSVT systematically differed based on demographics. Results were not consistent across PVTs, with performance on the TOMM differing between EA and AA patients, but performance on the MSVT did not differ by race. These results suggest that demographic factors may play a small but measurable role in performance on specific PVTs.
Objective: This study examined disability-related factors as predictors of PVT performance in Veterans who underwent neuropsychological evaluation for clinical purposes, not for determination of disability benefits. Method: Participants were 1,438 Veterans who were seen for clinical evaluation in a VA Medical Center's Neuropsychology Clinic. All were administered the TOMM, MSVT, or both. Predictors of PVT performance included (1) whether Veterans were receiving VA disability benefits ("service connection") for psychiatric or neurological conditions at the time of evaluation, and (2) whether Veterans reported on clinical interview that they were in the process of applying for disability benefits. Data were analyzed using binary logistic regression, with PVT performance as the dependent variable in separate analyses for the TOMM and MSVT. Results: Veterans who were already receiving VA disability benefits for psychiatric or neurological conditions were significantly more likely to fail both the TOMM and the MSVT, compared to Veterans who were not receiving benefits for such conditions. Independently of receiving such benefits, Veterans who reported that they were applying for disability benefits were significantly more likely to fail the TOMM and MSVT than were Veterans who denied applying for benefits at the time of evaluation. Conclusions: These findings demonstrate that simply being in the process of applying for disability benefits increases the likelihood of noncredible performance. The presence of external incentives can predict the validity of neuropsychological performance even in clinical, non-forensic settings.
Cognitive impairment is common in veterans with histories of traumatic brain injury (TBI). Cholinergic deficits have been hypothesized as contributors to this impairment. We report the effects of cholinesterase inhibitor rivastigmine transdermal patch treatment in veterans with TBI and post-traumatic memory impairment. Our objective was to evaluate the efficacy and safety of a 9.5 mg/24 h (10 cm(2)) rivastigmine patch in veterans of military conflicts with persistent moderate to severe memory impairment at least 12 weeks after TBI. This randomized, outpatient, double-blind, placebo-controlled 12-week trial with an exploratory double-blind phase of an additional 14 weeks was conducted at 5 VA Medical Centers, among veterans with closed, non-penetrating TBI who met or exceeded modified American Congress of Rehabilitation Medicine criteria for mild TBI with verbal memory deficits, as assessed by the Hopkins Verbal Learning Test, Revised (HVLT-R). Patients were randomized 1:1 to rivastigmine or matching placebo patches after a 1-week single-blind, placebo run-in phase. At randomization, patients received 4.6 mg/24 h rivastigmine patches or matching placebo increased to a 9.5 mg/24 h patch after 4 weeks. The primary efficacy outcome measure was the proportion of participants who had at least a five-word improvement on the HVLT-R Total Recall Index (Trials 1-3). A total of 3671 participants were pre-screened, of whom 257 (7.0%) were screened; 96 (37%) randomized, and 94 included in study analyses. Responder rates were 40.8% (20 of 49) and 51.1% (23 of 45) in the rivastigmine and placebo groups, respectively (p = 0.41). A mixed-effect model including treatment, time, and treatment-by-time interaction indicated no significant difference in treatment effect over time between the groups (p = 0.24). Overall, there were no significant differences in changes for all secondary outcomes between the rivastigmine and placebo groups. The most commonly observed adverse events were application site reactions. This trial provides the largest sample to date of veterans with TBI and post-traumatic memory deficits enrolled in a pharmacological trial. Trial Registration: clinicaltrials.gov Identifier: NCT01670526.
INTRODUCTION:Evidence-based practice in neuropsychology involves the use of validated tests, cutoff scores, and interpretive algorithms to identify clinically significant cognitive deficits. Recently, actuarial neuropsychological criteria (ANP) for identifying mild cognitive impairment were developed, demonstrating improved criterion validity and temporal stability compared to conventional criteria (CNP). However, benefits of the ANP criteria have not been investigated in non-research, clinical settings with varied etiologies, severities, and comorbidities. This study compared the utility of CNP and ANP criteria using data from a memory disorders clinic. METHOD:Data from 500 non-demented older adults evaluated in a Veterans Affairs Medical Center memory disorders clinic were retrospectively analyzed. We applied CNP and ANP criteria to the Repeatable Battery for the Assessment of Neuropsychological Status, compared outcomes to consensus clinical diagnoses, and conducted cluster analyses of scores from each group. RESULTS:The majority (72%) of patients met both the CNP and ANP criteria and both approaches were susceptible to confounding factors such as invalid test data and mood disturbance. However, the CNP approach mislabeled impairment in more patients with non-cognitive disorders and intact cognition. Comparatively, the ANP approach misdiagnosed patients with depression at a third of the rate and those with no diagnosis at nearly half the rate of CNP. Cluster analyses revealed groups with: 1) minimal impairment, 2) amnestic impairment, and 3) multi-domain impairment. The ANP approach yielded subgroups with more distinct neuropsychological profiles. CONCLUSIONS:We replicated previous findings that the CNP approach is over-inclusive, particularly for those determined to have no cognitive disorder by a consensus team. The ANP approach yielded fewer false positives and better diagnostic specificity than the CNP. Despite clear benefits of the ANP vs. CNP, there was substantial overlap in their performance in this heterogeneous sample. These findings highlight the critical role of clinical interpretation when wielding these empirically-derived tools.
Development of the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) was theoretically driven, with the goal of providing an assessment of abilities across five cognitive domains. Since its development, numerous factor analytic studies have failed to provide empirical support for the proposed five-factor structure and, furthermore, have lacked consensus on the internal structure of this instrument. A key limitation of these prior studies is the use of normal or mixed clinical samples, a practice that can obscure distinctions that may be evident in specific homogeneous clinical samples. The current study examined the factor structure of the RBANS in a sample of 107 male Veterans diagnosed with probable Alzheimer's disease (AD). Confirmatory factor analysis of a model reflecting the five Index Scores (Immediate Memory, Visuospatial/Constructional, Language, Attention, and Delayed Memory) found that the proposed five-factor structure fit the data well. These findings suggest that the RBANS does measure five distinct constructs and use of Index Scores is appropriate. Furthermore, the current findings highlight the importance of testing construct validity of neuropsychological assessment instruments in specific homogeneous samples.
OBJECTIVE:This study tested whether patients who were given a handout based on deterrence theory, immediately prior to evaluation, would provide invalid data less frequently than patients who were simply given an informational handout.METHOD:All outpatients seen for clinical evaluation in a VA Neuropsychology Clinic were randomly given one of the two handouts immediately prior to evaluation. The "Intervention" handout emphasized the importance of trying one's hardest, explicitly listed consequences of valid and invalid responding and asked patients to sign and initial it. The "Control" handout provided general information about neuropsychological evaluation. Examiners were blinded to condition. Patients were excluded from analyses if they were diagnosed with major neurocognitive disorder or could not read the handout. Medical Symptom Validity Test (MSVT) was used to determine performance validity.RESULTS:Groups did not differ on age, education, or litigation status. For the entire sample (N = 251), there was no effect of handout on passing versus failing MSVT. However, among patients who were seeking disability benefits at the time of evaluation (n = 70), the Intervention handout was associated with lower frequency of failing MSVT than the Control handout.CONCLUSIONS:This brief, theory-based, cost-free intervention was associated with lower frequency of invalid data among patients seeking disability benefits at the time of clinical evaluation. We suggest methodological modifications that might produce a more potent intervention that could be effective with additional subsets of patients.
Traumatic brain injury (TBI) has been identified as a significant health problem among veterans. Recent research demonstrates the potential interaction and magnification of symptoms of posttraumatic stress disorder (PTSD) and substance use disorders (SUD) in veterans with a history of TBI; however, there is very limited research on the co-occurrence of the three conditions. Veterans (N = 115) with comorbid PTSD and SUD completed a baseline assessment for enrollment into a larger treatment study. As part of that assessment, participants completed a TBI screener as well as self-report measures for pain and physical health, affective symptoms, and substance use. Almost half of the sample (48 %) endorsed a history of a previous head trauma with loss of consciousness (LOC). Participants with and without head trauma with LOC were compared across various measures of functioning. Increased severity of physical health complaints and affective symptoms were reported by the TBI group compared to controls. However, the increases in affective symptoms were relatively small. No group differences were observed for alcohol use. Together, the findings suggest that treatment-seeking veterans with a history of head trauma with LOC may present with roughly equivalent symptoms of PTSD and SUD to those without said history.
This examination of four embedded validity indices for the Repeated Battery for the Assessment of Neuropsychological Status (RBANS) explores the potential utility of integrating cognitive and self-reported depressive measures. Examined indices include the proposed RBANS Performance Validity Index (RBANS PVI) and the Charleston Revised Index of Effort for the RBANS (CRIER). The CRIER represented the novel integration of cognitive test performance and depression self-report information. The sample included 234 patients without dementia who could be identified as having demonstrated either valid or invalid responding, based on standardized criteria. Sensitivity and specificity for invalid responding varied widely, with the CRIER emerging as the best all-around index (sensitivity = 0.84, specificity = 0.90, AUC = 0.94). Findings support the use of embedded response validity indices, and suggest that the integration of cognitive and self-report depression data may optimize detection of invalid responding among older Veterans.
The current study sought to characterize the psychological architecture of individuals who put forth inadequate effort. The Minnesota Multiphasic Personality Inventory, 2nd Edition-Restructured Form was used to identify dimensions of psychological functioning in a mixed outpatient sample of U.S. Veterans referred for neuropsychological evaluation as part of their clinical care. After accounting for external financial incentive and symptom overreporting, results showed that the inadequate effort group (n = 23, mean age = 42.48) scored higher than the adequate effort group (n = 29, mean age = 44.31) on neurologic complaints (NUC) and lower on behavioral/externalizing dysfunction (BXD), antisocial behaviors (RC4), and disconstraint (DISC-r). Lower scores on BXD, RC4, and DISC-r could indicate higher behavioral constraint—a psychological characteristic that has been linked to the pursuit of high-value future rewards. Alternatively, lower scores on these scales could have reflected a self-presentation strategy aimed at minimizing externalizing and RC4 in order to appear more psychological healthy. Implications of each of these interpretations are discussed.
Patients who exert inadequate effort on neuropsychological examination might not receive accurate diagnoses and recommendations, and might not cooperate fully with other aspects of healthcare. This study examined whether inadequate effort is associated with increased healthcare utilization. Of 355 patients seen for routine, clinical neuropsychological examination at a VA Medical Center, 283 (79.7%) showed adequate effort and 72 (20.3%) showed inadequate effort, as determined at time of evaluation using the Word Memory Test and/or Test of Memory Malingering. Utilization data included number of Emergency Department (ED) visits and inpatient hospitalizations in the year following evaluation. Patients who had shown inadequate effort on examination had more Emergency Department visits, more inpatient hospitalizations, and more days of inpatient hospitalization in the year after evaluation, compared to patients who had exerted adequate effort. This finding was not attributable to group differences in age or medical/psychiatric comorbidities. Thus, patients who exerted inadequate effort showed greater healthcare utilization in the year following evaluation. Such patients might use more resources since diagnostic evaluations are inconclusive. Inadequate effort on examination might also serve as a “marker” for more general failure to cooperate fully in one’s healthcare, possibly resulting in greater utilization.
The aim of this study was to evaluate the objective value of neuropsychological evaluation (NPE) through reduction in Emergency Room (ER) visits and hospitalizations. Retrospective analysis examined trends in ER visits and hospitalizations in 440 U.S. veterans who completed NPE between the years of 2003 and 2010. Within-subjects comparisons showed significant decreases in incidence of hospitalization and length of hospitalization in the year after evaluation compared to the year prior. Mean number of hospitalizations declined from 0.31 (SD = 0.64) pre-NPE to 0.22 (SD = 0.59) post-NPE; there were a total of 41 fewer hospitalizations in the year following NPE. Mean length of hospitalization decreased from 1.9 days (SD = 5.6) pre-NPE to 1.06 days (SD = 3.9) post-NPE; there were a total of 368 fewer days of hospitalization post-NPE. This reduction was not attributable to age or time. Incidence of ER visits also decreased from pre-NPE (M = 0.74, SD = 1.3) to post-evaluation (M = 0.69, SD = 1.3), though this was not significant. These findings provide preliminary evidence of the clinical and potential economic value of neuropsychological services within a medical setting. Follow-up studies should examine individual and exam-specific factors that may contribute to reduced utilization.
Objective To compare patients with posttraumatic stress disorder (PTSD) to patients without psychiatric or cognitive disorders on neuropsychological measures of attention. Methods The sample included 19 patients with PTSD and 22 participants with no cognitive or psychiatric diagnosis. All had been referred for clinical neuropsychological evaluation at a VA Medical Center. None were diagnosed with dementia, delirium, or current substance dependence except nicotine or caffeine, and none had a history of stroke or of traumatic brain injury with loss of consciousness. Patients were excluded if they failed to exert adequate effort on testing. Results PTSD patients performed significantly more poorly than patients without psychiatric diagnoses on Digit Span. Conclusion PTSD patients were impaired relative to participants without psychiatric diagnoses on a measure of focused attention. Several factors, including the small sample size, suggest that the results should be considered preliminary.
Assessment of response validity is an integral part of neuropsychological practice. Although many studies have demonstrated the efficacy of stand alone and embedded effort measures in a variety of medical and compensation-seeking contexts, much less is known about the robustness of these measures in elderly populations, particularly in patients with dementia. Although older adults may be viewed as less likely to intentionally feign symptoms for an external gain, there are a variety of other factors that could result in suboptimal effort, including fatigue, lack of interest or cooperation in the testing process, or failure to fully appreciate the implications of the assessment on treatment care and outcome. The current study examined the clinical utility of several stand alone and embedded effort measures including the Repeatable Battery for the Assessment of Neuropsychological Status Effort Index, Trail-Making Test Ratio, Rey 15-Item Test, and the Test of Memory Malingering in a sample of patients with dementia. Results found that the majority of effort indexes demonstrated unacceptably high false-positive error rates with specificity levels as high as 83%. These findings demonstrate the need for caution in interpreting effort measure performance in dementia samples due to the fact that despite their best effort, many patients with dementia fail effort measures and are at risk for being misclassified.
INTRODUCTION:Many veterans live in rural areas distant from Veterans Affairs Medical Centers (VAMCs) and receive primary medical care from community-based outpatient clinics (CBOCs). These veterans often must travel great distances to the nearest VAMC for neuropsychological evaluations, resulting in poor access to care, travel reimbursement costs, fee-basis evaluations of uncontrolled quality, and driving safety concerns. Return trips for feedback compound complications. Accordingly, we initiated a pilot trial of neuropsychological evaluation and feedback via telemedicine (i.e., clinical videoconferencing).SUBJECTS AND METHODS:Participants were veterans referred for neuropsychological evaluation from a rural CBOC 115 miles from the regional VAMC. All veterans were given the choice to undergo evaluation at the CBOC via telemedicine or in-person at the VAMC. Telemedicine equipment allowed presentation of digitized material with simultaneous patient observation. Testing materials were organized in numbered folders and given to veterans by CBOC clerks immediately prior to evaluation. Clerks returned completed materials via facsimile.RESULTS:Fifteen veterans from the rural CBOC were seen for neuropsychological evaluation. Eight chose telemedicine evaluation. Groups based on evaluation modality appeared similar on demographics, referral basis, resulting neuropsychiatric diagnoses, and follow-through on recommendations. No significant technical or clinical difficulties were encountered, and veterans reported satisfaction with telemedicine. All veterans requested feedback via telemedicine.CONCLUSIONS:Neuropsychological evaluation via telemedicine is feasible and appears comparable to in-person evaluation. Experiences are encouraging and consistent with the broader literature on the acceptance of and satisfaction with clinical videoconferencing. Future studies will assess possible psychometric issues in clinical populations.
Geriatric depression has been associated with cognitive impairments, but whether suboptimal effort contributes to these deficits is unknown. This study investigated differences in cognitive functioning between depressed and nondepressed elderly veterans, before and after excluding patients who provided suboptimal effort on testing at a memory disorders clinic. Patients diagnosed with a depressive disorder performed more poorly than nondepressed patients on almost all Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) indices, but these differences became nonstatistically significant after excluding patients who provided suboptimal effort. However, when patients were classified as normal, mildly, or severely depressed based on Geriatric Depression Scale scores, these groups were not significantly different on RBANS indices, regardless of whether patients who provided suboptimal effort were included or excluded from analyses. The findings suggest that cognitive deficits in depression reported in previous research may be attributable to suboptimal effort and that identifying depression via clinical diagnosis or psychometric data may affect this trend.
Research has suggested an adverse effect of anxiety on cognitive functioning, and high defensive individuals may have poorer control of their anxiety than low defensive individuals. Thus, these individuals may be more likely to have a prescription for psychotropic medication. The purpose of this study was to further delineate the effects of anxiety and defensiveness on neuropsychological test performance and psychotropic medication use. Participants were 143 US veterans referred for neuropsychological evaluation. Four groups were established based on median splits on MMPI‐2 approximations of anxiety and defensiveness. Anxiety and defensiveness were unrelated to neuropsychological test performance. Defensive high anxious individuals were more likely than truly high anxious individuals to have anxiolytic and narcotic prescriptions. There was also a trend toward truly low anxious participants being more likely to be prescribed anxiolytics than repressor participants. Thus, defensiveness appears to attenuate the experience of anxiety in individuals who are low, but not high, in self‐reported anxiety.
The clinical utility of embedded indices of effort in the RBANS was examined in a geriatric sample. Patients were classified as providing suspect effort (n = 45) or probable good effort (n = 258) using the TOMM and clinical consensus. Following the methodology of Silverberg and colleagues (2007), selected individual subtests and a summary Effort Index were evaluated. Setting specificity at approximately 85% yielded cut-offs of 15 on List Recognition, 8 on Digit Span, and 3 on the Effort Index. The modest sensitivity (51.1-64.4%) suggests that the indices should be used in conjunction with additional effort measures. In addition, the RBANS Picture Naming subtest was examined and showed modest sensitivity to detect suboptimal effort, but did not show notable incremental validity for detecting suboptimal effort beyond the Effort Index.