PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptNIH Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
 
Mult Scler. Author manuscript; available in PMC Mar 30, 2010.
Published in final edited form as:
PMCID: PMC2847445
NIHMSID: NIHMS186667

Cognitive impairments in relapsing-remitting multiple sclerosis: a meta-analysis

Abstract

There is debate in the literature regarding the magnitude, nature, and influence of cognitive impairment in individuals with relapsing-remitting multiple sclerosis (RRMS), Therefore, we conducted a meta-analysis that quantified the overall magnitude of cognitive impairment in individuals with RRMS and identified the domains of cognition and clinical/demographic variables that were moderators of the overall effect. We included 57 studies with 3891 participants that yielded a total of 755 effect sizes. Overall, there was a moderate decline in cognitive functioning in individuals with RRMS compared with healthy controls. Larger effects were observed in cognitive domains of motor functioning, mood status and memory and learning. Regarding demographic and clinical variables, age and gender were moderators of cognitive impairment in all cognitive domains, whereas neurological disability and disease duration primarily moderated performance on tasks assessing memory and learning.

Keywords: cognition, disease subtype, meta-analysis, relapsing-remitting multiple sclerosis

Introduction

Multiple sclerosis (MS) is the most prevalent chronic disabling neurological disease among adults in the United States. The National Multiple Sclerosis Society estimates that there are approximately 400,000 patients with MS in the United States with an incidence of nearly 200 new patients each week (www.nationalmssociety.org). The majority of people with MS are diagnosed between 20 and 50 years of age, and women are affected two to three times as often as men (www.nationalmssociety.org). MS is more common among people with northern European ancestry than people of African, Asian, and Hispanic backgrounds (www.nationalmssociety.org).

Multiple sclerosis involves progressive and unpredictable episodes of axonal demyelination and transection, resulting in lesions along axons of nerve fibers in the brain, brain stem, spinal cord, and optic nerves. The demyelination and transection of the nerve fibers interferes with the smooth and rapid conduction of electrical potentials along neuronal pathways in the central nervous system (CNS). This interference has been associated with motor, sensory, psychological, visual, bladder, and sexual symptoms commonly experienced by people with MS [1,2]. Although researchers have long been interested in the symptoms associated with MS, the study of cognitive deficits as a symptom of MS is still in its infancy [35]. Indeed, Figure 1 presents a graphical comparison of MS research in general vs. cognition-related MS research based on the number of publications across the period of 1983 through 2007.

Figure 1
A graphical comparison of MS research in the last two decades. Blue line graphs research related to Multiple Sclerosis in general, whereas the pink line represents cognition-related MS research.

As can be seen in the figure, over the years, there has been an increased interest by researchers and clinicians in the study of cognitive deficits associated with MS. Cognitive deficits have been reported in broad domains of memory [610, 98], attention and executive functioning [1115], and verbal fluency [1620]. Indeed, two previous meta-analyses [21,22] have quantitatively examined the nature of neurocognitive deficits in MS. Results from both meta-analysis provided evidence for the presence of significant cognitive impairments in patients with MS. Importantly, one of the meta-analysis did not report differences in cognitive impairment as a function of disease subtype [21], whereas the other meta-analytic review reported that individuals with chronic-progressive MS had greater impairments on tasks of executive control, whereas those with relapsing-remitting multiple sclerosis (RRMS) have significant memory-related dysfunction [22].

To date, researchers have not performed a meta-analysis for quantifying the magnitude and nature of cognitive deficits for individuals with RRMS. We believe that there is significant merit in systematically and quantitatively investigating the nature of cognitive decline in this subtype of MS. RRMS is the most common type of MS [97] and there is still some degree of uncertainty regarding the magnitude and nature of cognitive deficits in those with RRMS. We further note that there has been a sizable increase in the number of published papers on cognitive deficits in RRMS allowing for a better characterization of the magnitude, type, and influences of cognitive deficits in this sub-population of individuals with MS. Such an analysis would underscore the degree of cognitive deficits even in non-progressive types of MS and highlight the importance of therapeutic regimens for mitigating cognitive deficits in those with RRMS.

The primary goal of this study involved extending previous meta-analytic reviews by specifically quantifying the overall magnitude of deficits in cognition associated with RRMS. The secondary goal of this meta-analysis involved identifying types or domains of cognitive impairments in RRMS and the influence of clinical and demographic variables as moderators of cognitive impairment in RRMS. Such an analysis can identify types of cognitive processes that demonstrate the largest degree of cognitive impairment and identify clinical and demographic aspects of individuals with RRMS that are associated with larger cognitive deficits.

Method

Literature search

This meta-analysis was conducted according to the recommendations provided by the Meta-Analysis of Observational Studies group [23]. Two of the investigators (RSP and JL) conducted the literature search using the following online databases: PsychInfo, MEDLINE, Current Contents. We searched across the period from 1983 (the year Poser Criteria were published. Poser, et al. [24]) to July, 2007 using the keywords “multiple sclerosis” in conjunction with “cognition”, “attention”, “executive functioning”, “information processing speed”, “language”, “memory”, “motor functioning”, “fMRI”, “EEG”, and “neuroimaging”, We located a total of 650 studies using those keywords. We further undertook a manual search of pertinent journals: Archives of Clinical Neuropsychology; NeuroImage, Neuropsychologia, Neuropsychology, Multiple Sclerosis, The journal of International Neuropsychological Society, The Clinical Neuropsychologist, Brain and Cognition, Archives of Neurology, The journal of Clinical Neuropsychology, Neuropsychiatry, Neuropsychology and Behavioral Neurology. We identified additional articles from reference lists of previous meta-analyses, review articles and book chapters. Finally, we contacted study authors in an effort to obtain information on additional publications.

Inclusion criteria

Studies were included in the final meta-analysis that met the following criteria: (a) available in the English language; (b) included a healthy control group and a group of individuals with RRMS for whom the neuropsychological results were available independent of other MS types; and (c) results were reported in statistics convertible to effect size g (e.g., M, SD, F, t, chi-square: Roberts, et al. [25]). Statistics of studies that met the above reported criteria were coded based on the classification provided below to compute an overall effect size.

Moderator coding

The coding of moderator variables was undertaken by two of the investigators (RSP and JL). One of the primary moderators was type of cognitive domain. We used the classification system developed in a previous meta-analysis [21] along with referencing to the standard textbooks used in neuropsychological assessments [26,27] for categorizing effects into different cognitive domains. The categorization of cognitive domains adopted in this meta-analysis was done solely for ease of presentation and does not imply that there is universal agreement among researchers on the specific constructs tapped by these measures. The individual results were first assigned to the broad cognitive domain (General Cognitive Ability, Attention and Executive Ability, Language, Memory and Learning, Construction, Perception, Motor functioning) followed by assignment to specific sub-domains within the broader cognitive domain. In addition to the cognitive domains, we coded for the effect of RRMS on mood status, followed by assignment to either the sub-domain of depression or anxiety. For ease of presentation, all tables and figures presented in the paper include the domain of mood status along with other cognitive domains.

In addition, participant characteristics (EDSS level. Duration of MS, age, gender, and education of participants) were coded to examine their role in moderating the impact of MS on cognition. Specifically we coded for the level of neurological disability, assessed usually through the Kurtzke Disability Status Scale (EDSS, [28]). EDSS is a measure of ambulation with scores ranging from 0 (no neurological abnormality) to 10 (death from MS). We used two main categories of classification for the EDSS scores: below 4 or above 4. A cut-off of 4 is usually used in studies to classify participants who can walk with no rest or aid for >500 m [29]. In addition to the level of neurological disability, we also coded for the duration of MS (>10 years or ≤10 years), sex [all female, predominantly female (F:M::2:1), or mixed], age (<30 years, between 30 and 39 years, or more than 40 years) and education of participants (<12 years, or more than 12 years).

Computation of effect sizes and data analyses

We computed effect sizes as Hedges g [30]. This statistic calculates effect size by subtracting the mean of the control group (MControl) from the mean of the RRMS group (MMS) divided by the pooled standard deviation (SDP) such that:

equation M1

The aggregated or overall mean effect size was computed using a random effects model and adjusted for sample size (Hedges adjusted g) using Comprehensive Meta-Analysis, Version 2.0. [31]. The random effects model operates under the assumption that samples are drawn from populations with different effect sizes and the true effect differs between studies (i.e., the true effect within studies might vary based on differences in sample characteristics, the treatment itself, or the outcome measure) [31]. Effect sizes were interpreted using Cohen’s (1992) guidelines [32], such that:

  • Small effects: 0.1–0.3
  • Medium effects: 0.4–0.6
  • Large effects: >0.7

We further used the Comprehensive Meta-analysis software for testing the heterogeneity of the mean effect size, computing the 95% confidence interval (CI) around the mean effect size, and examining categorical moderators of the mean effect size. Heterogeneity was indicated if Q (sum of squares of each effect size about the weighted mean effect size) was statistically significant (p< 0.05). The effect of the categorical moderators was determined by partitioning the variance into that accounted for by the moderator variable (i.e., QB or Q between statistic) and the residual variance (i.e., QW or Q within statistic) [25]. The QB statistic indicates differences between levels of the moderator variable (i.e., index of differences in group means within a categorical moderator variable) such that a significant QB statistic indicates that effect size variability is explained by the categorical variable [31]. Importantly, a significant QW statistic indicates that the categorical moderator variable does not account for all of the effect size variability [31].

Although meta-analyses are considered to be an important improvement over the traditional qualitative reviews, an important limitation is that they aggregate results of available studies such that the included articles may just constitute a subset of all studies that might have been published on the topic [25]. We estimated the possibility of publication bias in our meta-analysis using the funnel plot and Fail-safe k. The funnel plot includes a graphical representation of effect sizes vs. standard errors (based on sample size) and suggests against publication bias (i.e., smaller studies are published if there are larger effect sizes) based on its shape as a funnel where no sections of the funnel are missing or asymmetrical. We further calculated Rosenthal’s fail-safe number (k) [33]. The Fail-safe k indicates that the number of null effects from unpublished or unretrieved studies would be necessary to make the overall effect non-significant (i.e., bring the P-value to be greater than alpha of 0.05).

Results

Participant characteristics

Fifty-seven studies met the inclusion criteria and were included in the meta-analysis. There were 3891 participants in the studies and roughly half had RRMS (2042) and the other half were healthy controls (1849). Demographic characteristics of those with RRMS and the controls along with the clinical characteristics of those with RRMS are given in Table 1. The proportion of males in both the RRMS group and the control sample group is roughly 30% (28.72% for patients and 32.87% for controls). The age and education of those with RRMS was comparable to that of healthy controls (mean age of patients and controls = 38.66 and 38.50 years, respectively).

Table 1
Descriptive characteristics for the RRMS patients and healthy controls

Main effect of RRMS on cognition

The impact of RRMS on overall cognitive functioning was statistically significant and moderate in magnitude (g = −0.585, 95% CI = −0.619, −0.551). The average effect size was heterogeneous under a random effects model [Q(755) = 3083.21, P<0.05]. Further, the obtained effect was robust to publication bias as suggested by the Funnel Plot presented in Figure 2 and 868,413 null effects would be needed to render the current findings non-significant at the 0.05 level.

Figure 2
A funnel plot diagram of the 755 effect sizes calculated In the study.

We further calculated an average effect size per study, presented in Table 2. Of the 57 studies, the P-value only one effect was >0, suggesting that for nearly all studies there was cognitive deterioration seen in those with RRMS compared with healthy controls. The distribution of the 57 effects had slight negative skewness (g1 = −1.27) and leptokurtosis (g2 = 2.39).

Table 2
Average effect size per stud

Effect sizes categorized by cognitive domain

The average effect sizes associated with each of the cognitive domains along with the overall effect size are presented in Figure 3.

Figure 3
Effect sizes of all cognitive domains along with the overall effect size.

With the exception of Motor functioning and Mood Status, most effect sizes were in the moderate range. The QB statistic was statistically significant [QB (8) = 169.93, P<0.05] and indicated that some domains yielded significantly greater effect sizes than others. The effect sizes of “General Cognitive Ability”, “Attention and Executive Ability”, and “Memory and Learning” were significantly higher than the effect sizes associated with “Verbal functions and Language”, and “Concept formation and Reasoning”. The QW statistic was significant for each of the eight cognitive domains and thus, we did additional intra-domain analyses to determine the sources of variability [85].

Table 3 presents a list of all the cognitive domains, the respective sub-domains and the effect sizes for each of these sub-domains. The mean effect sizes were significant for all cognitive domains. With the exception of motor functioning, all cognitive domains were comprised of more than one category and thus, we did additional heterogeneity analyses to examine the additional sources of variability. The QB statistic was significant for the cognitive domains of “General Cognitive Ability”, “Memory”, “Attention and Executive functioning”, “Verbal functions and Language”. These domains will be discussed below. Differences between sub-domains were not statistically significant for “Perception”, “Concept formation and Reasoning”, “Construction”, and “Mood Status”.

Table 3
Effect sizes of all cognitive domains with their respective sub-domains. Also shown are the confidence interval and the overall Q-Statistic

General Cognitive Ability deficits

Effect sizes of tests assessing General Cognitive Ability of those with RRMS suggested moderate differences between patients and healthy controls (g = −0.539, P < 0.05). Consistent with the current literature assessing general cognitive deficits and the classifications used in previous meta-analyses [21,86], we used the following sub-domains to classify measures of general cognitive functioning: intellectual ability, verbal-intellectual ability, non-verbal intellectual ability, and cognitive screening tests. The effect size for verbal intellectual ability was small (g = −0.300, P < 0.05), whereas effect sizes for other domains were in the medium range (Table 3). We also found a significant difference between measures assessing verbal intellectual deficits as opposed to non-verbal intellectual deficits such that MS patients showed greater impairment on tests of non-verbal intellectual ability.

Attention and executive functioning deficits

The impact of MS on the broader domain of attention and executive functioning was significant (g = −0.555, P < 0.05). For this cognitive domain, we used the following categories: processing speed, sustained attention/vigilance, short-term storage capacity, working memory, selective/focused attention, and executive control. Patients with MS showed the greatest cognitive impairment on measures of processing speed and selective/focused attention. Selective/focused attention assessed through measures like Symbol Digit Modalities Test (SDMT), Trail Making, Stroop word and color reading was significantly more impaired than measures of working memory and short-term storage capacity.

Memory and Learning deficits

Tasks assessing the broader domain of Memory and Learning found significant performance differences between patients with RRMS and healthy controls (g = −0.607, P < 0.05). For the domain of memory and learning, the following categories were used: verbal-immediate recall, verbal-delayed recall, verbal recognition, visual immediate recall, visual delayed recall, and visual recognition. Although our classification included visual recognition, there were not enough effect sizes to code for this sub-domain and thus was dropped from the final analyses. With the exception of verbal-delayed recall, effect sizes of all other sub-domains were found to be in the medium range. The effect size of verbal-delayed recall was −0.775 (P< 0.0001) and MS patients showed significantly greater impairment on tests of verbal-delayed recall than on any other measure.

Verbal functions and language deficits

The difference between MS patients and healthy controls on this domain was found to be moderate (g = −0.44, P<0.01). Measures assessing this domain were further divided into: comprehension, verbal expression, discourse, verbal fluency, and verbal academic skills. Measures assessing verbal academic skills were not found to be significantly different between MS patients and healthy controls (g = 0.081, P = ns). Consistent with the literature [21,22], we found that tests assessing verbal fluency skills in MS (g = −0.689, P<0.001) were significantly more impaired than tests assessing Comprehension (g = −0.51, P<0.001), verbal expression (g = −0.341, P<0.01) and discourse (g = −0.278, P<0.01).

Effect sizes categorized by specific tests

In addition to examining the impact of MS on specific cognitive domains, we were interested in the sensitivity of different tests used in the MS literature to assess neuropsychological functioning. Out of the 755 effects examined, the seven most commonly used tests were analyzed. These included the color-word Stroop test, Verbal Fluency, Symbol Digit Modalities Test (SDMT), Paced Auditory Serial Addition Test (PASAT), Wisconsin Card Sorting Test (WCST), Selective Reminding Test, and the N-Back test. The QB statistic was significant, suggesting that some tests used yielded significantly higher effect sizes than others. We found that the Stroop task. Verbal fluency measures and the SDMT had higher effect sizes than the PASAT, WCST and the Selective Reminding test.

Impact of moderator variables on the relationship between RRMS and cognition

Given the heterogeneity in the mean effect of RRMS on cognition, we examined the influence of a number of moderating variables first on the overall mean effect size and then secondly within each of the cognitive domains. Only statistically significant tests of moderators based on the QB statistic are reported below, with the complete list presented in Table 4.

Table 4
Lists clinical and demographic variables that were used as moderator variables in the analyses

We found that the effect of RRMS on cognition differed when studies matched the gender [QB(1) = 6.9, P<0.05] and education [QB(1) = 10.44, P < 0.05] of patients to that of healthy controls. We further found that this relationship was moderated by the age of MS patients such that patients who were 40 years or older showed a significant deterioration of cognitive skills as opposed to younger patients. We also found a main effect of gender such that studies that recruited primarily females demonstrated greater cognitive deficits as opposed to studies using mixed samples [QB(2) = 23.43, P<0.05]. Interestingly, we did not find a main effect of EDSS level, disease duration and education levels on the relationship between MS and cognition.

For these three moderator variables, we did additional analyses to examine the impact of these moderating variables on specific cognitive domains. We found that for all three variables (EDSS level, disease duration and education levels), the QB statistic was significant for the domain of memory and learning. MS patients with an EDSS score of 4 or more performed worse on tasks of memory and learning (g = −0729, P < 0.05) than patients with an EDSS of <4. Similarly, patients with more than 10 years of disease duration performed worse (g = −0.69, P < 0.05) than patients with <10years of education. Moreover, those with <12 years of education (g = −0.674, P < 0.05) performed worse than patients with 12 years of education or more. This suggests that EDSS levels, disease duration and education specifically moderate the relationship between MS and cognition, such that the impact was primarily observed on tasks of memory and learning.

Discussion

The primary goal of this meta-analysis involved the quantification of the overall magnitude of cognitive impairment in persons with RRMS compared with healthy controls. Indeed, one of the main findings was the overall moderate degree of impairment in cognitive functioning in those with RRMS. We further note that the individuals with RRMS demonstrated significant impairments compared with healthy controls across all domains of cognitive function. Our results extend the findings in the extant literature by providing a quantitative metric of the magnitude [8790] of cognitive problems in this population. Such findings further underscore that the degree of cognitive impairment in RRMS is not trivial, but rather moderate in magnitude. This is important as cognitive deficits interfere with everyday functioning and are associated with feelings of depression, low self-esteem and impaired social functioning [9195]. Therefore, there is a clear need for identifying strategies for mitigating cognitive impairment in RRMS.

The cognitive deficits in RRMS differed in magnitude based on the domain of cognitive function. The largest detriments in cognition were observed for motor functioning and mood status, followed by memory and learning, and attention and executive functioning. Motor functioning assessed through the grooved pegboard, finger tapping, nine-hole peg test was severely affected (g = −0.728, P < 0.05) and this is consistent with findings of a previous meta-analysis that included all types of MS [22]. Such a finding is not surprising given the profound motor disturbances that are a defining feature of MS. The domain of mood status further demonstrated large cognitive deficits and the largest effect size was seen for measures of depression (g = −0.701, P < 0.05), although the QB statistic was not significant for this domain and the effect of RRMS on depression was not significantly greater than the effect on anxiety. Such findings are particularly important for interventions designed to reduce cognitive deficits in this population by suggesting that emotional variables may either be influenced and/or influence the cognitive functioning of persons with RRMS. These results underscore the importance of investigating the efficacy of current psychotherapeutic approaches with this population as a target of both emotional and cognitive symptoms (See ref. [96] for such an intervention).

An important goal for future research, as mentioned above will be to design intervention studies that simultaneously target cognitive and emotional symptoms experienced by patients with MS. In order to successfully design such studies, it is important to delineate variables that might affect or moderate the relationship between MS and cognition. In our search for such moderating variables, we found that age and gender of MS participants had a significant bearing on the relationship between MS and cognition. Although, at first we did not find either neurological disability or disease duration to significantly contribute to the variability in effect sizes, domain-specific analyses suggested that MS patients with an EDSS score of 4 or more and a disease duration of more than 10 years performed poorly on tasks of memory and learning. This finding thus suggests that when the effect sizes for different cognitive domains are averaged, neurological disability or disease duration fail to show an impact, however, for the domain of memory and learning, both of these variables impact performance. Given that this particular domain shows the largest effect sizes, the results are interesting in that they suggest that the disability progression in MS is rather divergent. In the meta-analysis of memory impairments in MS [6], such a similar finding was noted for chronic-progressive MS course. This meta-analysis, which examines RRMS patients, provides evidence for the impact of clinical variables on the domain of memory and language.

In this meta-analysis, we were also interested in the sensitivity of the different measures used in the literature to assess declines in cognitive functioning. We found that the classic color-word Stroop task and measures of verbal fluency showed the largest effect sizes (g = −0.785 and g = −0.76, P < 0.05), suggesting that these measures might be more sensitive in detecting cognitive deficits as opposed to other measures. This finding is important as it suggests that these two measures, if included, in the brief neuropsychological batteries developed to assess neurocognitive functioning in patients with MS, would be more efficient at detecting subtle declines in cognitive functioning.

To summarize, the results of the current meta-analytic review suggest that the effects of MS on cognition is both general, such that all cognitive domains show a differential performance effect as well as specific, such that the effects are largest for the domains of mood, motor functioning and memory and learning. We further found evidence for the association between several demographic and clinical variables on selective aspects of cognition.

Acknowledgments

This research was supported by grants from the National Institute on Aging (RO1 AG25667 and RO1 AG25302).

References

*Studies that were used in the actual analysis.

1. Devins GM, Seland TP. Emotional impact of multiple sclerosis: recent findings and suggestions for future research. Psychol Bull. 1987;101:363–375. [PubMed]
2. Lester K, Stepleman L, Hughes M. The association of illness severity, self-reported cognitive impairment, and perceived illness management with depression and anxiety in a multiple sclerosis clinic population. J Behav Med. 2007;30:177–186. [PubMed]
3. Calabrese P. Neuropsychology of multiple sclerosis: an overview. J Neurol. 2006;253(Suppl 1):I/10–I/15. [PubMed]
4. Bobholz JA, Rao SM. Cognitive dysfunction in multiple sclerosis: a review of recent developments. Curr Opin Neurol. 2003;16:283–288. [PubMed]
5. Achiron A, Barak Y. Cognitive changes in early MS: a call for a common framework. J Neurol Sci. 2006;245(Special Issue):47–51. [PubMed]
6. Thornton AE, Naftali R. Memory impairment in multiple sclerosis: a quantitative review. Neuropsychology. 1997;11:357–366. [PubMed]
7* Oliveri RL, Sibilia G, Valentino P, Russo C, Romeo N, Quattrone A. Pulsed methylprednisolone induces a reversible impairment of memory in patients with relapsing-remitting multiple sclerosis. Acta Neurol Scand. 1998;97:366–369. [PubMed]
8. Janculjak D, Mubrin Z, Brzovic Z, et al. Changes in short-term memory processes in patients with multiple sclerosis. Eur J Neurol. 1999;6:663–668. [PubMed]
9* Gaudino EA, Chiaravalloti ND, Deluca J, Diamond BJ. A comparison of memory performance in relapsing-remitting, primary progressive and secondary progressive, multiple sclerosis. Neuropsychiatry Neuropsychol Behav Neurol. 2001;14:32–14. [PubMed]
10* Wishart HA, Saykin AJ, McDonald BC, et al. Brain activation patterns associated with working memory in relapsing-remitting MS. Neurology. 2004;62:234–238. [PubMed]
11. Arnett PA, Rao SM, Hussain M, Swanson SJ, Hammeke TA. Conduction aphasia in multiple sclerosis: a case report with MRI findings. Neurology. 1996;47:576–578. [PubMed]
12* Denney DR, Sworowski LA, Lynch SG. Cognitive impairment in three subtypes of multiple sclerosis. Arch Clin Neuropsychol. 2005;20:967–981. [PubMed]
13* LaPointe LL, Maitland CG, Blanchard AA, Kemker BE, Stierwalt JAG, Heald GR. The effects of auditory distraction on visual cognitive performance in multiple sclerosis. J Neuroophthalmol. 2005;25:92–94. [PubMed]
14. Lengenfelder J, Bryant D, Diamond BJ, Kalmer JH, Moore NB, DeLuca J. Processing speed interacts with working memory efficiency in multiple sclerosis. Arch Clin Neuropsychol. 2006;21:229–238. [PubMed]
15* Rosti E, Hämäläinen P, Koivisto K, Hokkanen L. PASAT in detecting cognitive impairment in relapsing-remitting MS. Appl Neuropsychol. 2007;14:101–112. [PubMed]
16. Foong J, Rozewicz L, Quaghebeur G, et al. Executive function in multiple sclerosis: the role of frontal lobe pathology. Brain. 1997;120:15–26. [PubMed]
17. Nocentini U, Rossini PM, Carlesimo GA, et al. Patterns of cognitive impairment in secondary progressive stable phase of multiple sclerosis: correlations with MRI findings. Eur Neurol. 2001;45:11–18. [PubMed]
18. Beatty WW. Fluency in multiple sclerosis: which measure is best. Mult Scler. 2002;8:261–264. [PubMed]
19. Parry AMM, Scott RB, Palace J, Smith S, Matthews PM. Potentially adaptive functional changes in cognitive processing for patients with multiple sclerosis and their acute modulation by rivastigmine. Brain. 2003;126:2750–2760. [PubMed]
20. Henry JD, Beatty WW. Verbal fluency deficits in multiple sclerosis. Neuropsychologia. 2006;44:1166–1174. [PubMed]
21. Wishart H, Sharpe D. Neuropsychological aspects of multiple sclerosis - a quantitative review. J Clin Exp Neuropsychol. 1997;19:810–824. [PubMed]
22. Zakzanis KK. Distinct neurocognitive profiles in multiple sclerosis subtypes. Arch Clin Neuropsychol. 2000;15:115–136. [PubMed]
23. Stroup DF, Berlin JA, Morton SC, et al. Meta-analysis of obeservational studies in epidemiology: a proposal for reporting. JAMA. 2000;283:2008–2012. [PubMed]
24. Poser CM, Paty DW, Scheinberg L, et al. New diagnostic criteria for multiple sclerosis: guidelines for research protocols. Ann Neurol. 1983;13:227–231. [PubMed]
25. Roberts BW, Kuncel NR, Viechtbauer W, Bogg T. Meta-analysis in personality psychology. In: Robins RW, Fraley RC, Kruger RF, editors. Handbook of Research Methods in Personality Psycology. New York, NY: Guilford Press; 2007.
26. Lezak MD. Neuropsychological assessment. New York: Oxford University Press; 2005.
27. Strauss E, Sherman E, Spreen O. A compendium of neuropsychological tests. Oxford University Press; New York: 2006.
28. Kurtzke JF. Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS) Neurology. 1983;33:1444–1452. [PubMed]
29. Confavreux C, Vukusic S, Adeleine P. Early clinical predictors and progression of irreversible disability in multiple sclerosis: an amnesic process. Brain. 2003;126:770–782. [PubMed]
30. Hedges L. Advances in statistical methods for meta-analysis. In: Yeaton WH, Wortman PM, editors. Issues in data synthesis: new directions for program evaluation. San Francisco: Academic Press; 1984. pp. 25–42.
31. Borenstein M, Hedges L, Higgins J, Rothstein H. Comprehensive meta-analysis. Englewood, NJ: Biostat; 2005.
32. Cohen J. A power primer. Psychol Bull. 1992;112:155–159. [PubMed]
33. Rosenthal R. The “file drawer problem” and tolerance for null results. Psychol Bull. 1979;86:638–641.
34* Andrade VM. Cognitive profile of patients with relapsing remitting multiple sclerosis. Arq Neuropsiquiatr. 1999;57:775–783. [PubMed]
35* Andrade VM, Oliveira MGM, Miranda MC, Oliveira ASB, Oliveira EML, Bueno OFA. Semantic relations and repetition of items enhance the free recall of words by multiple sclerosis patients. J Clin Exp Neuropsychol. 2003;25:1070–1078. [PubMed]
36* Archibald CJ, Fisk JD. Information processing efficiency in patients with multiple sclerosis. J Clin Exp Neuropsychol. 2000;22:686–701. [PubMed]
37* Arnett PA, Rao SM, Grafman J, et al. Executive functions in multiple sclerosis: an analysis of temporal ordering, semantic encoding, and planning abilities. Neuropsychology. 1997;11:535–544. [PubMed]
38* Arnott WL, Jordan FM, Murdoch BE, Lethlean JB. Narrative discourse in multiple sclerosis: an investigation of conceptual structure. Aphasiology. 1997;11:969–991.
39* Barkhof F, Elton M, Lindeboom J, et al. Functional correlates of callosal atrophy in relapsing-remitting multiple sclerosis patients: a preliminary study. J Neurol. 1998;245:153–158. [PubMed]
40* Beatty WW, Goodkin DE, Monson N, Beatty PA. Cognitive disturbances in patients with relapsing-remitting multiple sclerosis. Arch Neurol. 1989;46:1113–1119. [PubMed]
41* Birnboim S, Miller A. Cognitive strategies application of multiple sclerosis patients. Mult Scler. 2004;10:67–73. [PubMed]
42* Blum D, Yonelinas AP, Luks T, et al. Dissociating perceptual and conceptual implicit memory in multiple sclerosis patients. Brain Cogn. 2002;50:51–61. [PubMed]
43* Bobholz JA, Rao SM, Lobeck L, et al. fMRI study of episodic memory in relapsing-remitting MS: correlation with T2 lesion volume. Neurology. 2006;67:1640–1645. [PubMed]
44* Deloire MSA, Salort E, Bonnet MC, et al. Cognitve impairment as marker of diffuse brain abnormalities in early relapsing remitting multiple sclerosis. J Neurol Neurosurg Psychiatry. 2005;76:519–526. [PMC free article] [PubMed]
45* Denney DR, Lynch SG, Parmenter BA, Horne N. Cognitive impairment in relapsing and primary progressive multiple sclerosis: mostly a matter of speed. J Int Neuropsychol Soc. 2004;10:948–956. [PubMed]
46* Drake MA, Carra A, Allegri RF, Luetic G. Differential patterns of memory performance in relapsing-remitting and secondary progressive multiple sclerosis. Neurol India. 2006;54:370–376. [PubMed]
47* Dujardin K, Donze AC, Hautecoeur P. Attention impairment in recently diagnosed multiple sclerosis. Eur J Neurol. 1998;5:61–66. [PubMed]
48* Fisk JD, Archibald CJ. Limitations of the Paced Auditory Serial Addition Test as a measure of working memory in patients with multiple sclerosis. J Int Neuropsychol Soc. 2001;7:363–372. [PubMed]
49* Forn C, Barros-Loscertales A, Escudero J, et al. Cortical reorganization during PASAT task in MS patients with preserved working memory functions. Neuroimage. 2006;31:686–691. [PubMed]
50* Forn C, Barros-Loscertales A, Escudero J, et al. Compensatory activations in patients with multiple sclerosis during preserved performance on the auditory N-back test. Hum Brain Mapp. 2007;28:424–430. [PubMed]
51* Friend KB, Rabin BM, Groninger L, Deluty RH, Bever C, Grattan L. Language functions in patients with multiple sclerosis. Clin Neuropsychol. 1999;13:78–94. [PubMed]
52* Gilad R, Sadeh M, Boaz M, Lampl Y. Visual spatial neglect in multiple sclerosis. Cortex. 2006;42:1138–1142. [PubMed]
53* Gonzalez-Rosa JJ, Vazquez-Marrufo M, Vaquero E, et al. Differential cognitive impairment for diverse forms of multiple sclerosis. BMC Neuroscience. 2006;7:39–49. [PMC free article] [PubMed]
54* Grigsby J, Kaye K, Busenbark D. Alphanumeric-sequencing: a report on a brief measure of information processing used among persons with multiple sclerosis. Percept Mot Skills. 1994;78:883–887. [PubMed]
55* Haase CG, Tinnefeld M, Lienemann M, Ganz RE, Faustmann PM. Depression and cognitive impairment in disability-free early multiple sclerosis. Behav Neurol. 2003;14:39–45. [PubMed]
56* Haase CG, Tinnefeld M, Daum I, Ganz RE, Haupts M, Faustmann PM. Cognitive, but not mood dysfunction develops in multiple sclerosis during 7 years of follow-up. Eur Neurol. 2004;52:92–95. [PubMed]
57* Heaton RK, Nelson LM, Thompson DS, Burks JS, Franklin GM. Neuropsychological findings in relapsing-remitting and chronic-progressive multiple sclerosis. J Consult Clin Psychol. 1985;53:103–110. [PubMed]
58* Huijbregts SCJ, Kalkers NF, De Sonneville LMJ, De Groot V, Reuling IEW, Polman CH. Differences in cognitive impairment of relapsing remitting, secondary, and primary progressive MS. Neurology. 2004;63:335–339. [PubMed]
59* Kolonoff H, Clark C, Oger J, Paty D, Li D. Neuropsychological performance in patients with mild multiple sclerosis. J Nerv Ment Dis. 1991;179:127–131. [PubMed]
60* Kotterba S, Orth M, Eren E, Fangerau T, Sindern E. Assessment of driving performance in patients with relapsing-remitting multiple sclerosis by a driving simulator. Eur Neurol. 2003;50:160–164. [PubMed]
61* Kraus JA, Schutze C, Brokate B, Kroger B, Schwendemann G, Hildebrandt H. Discriminant analysis of the cognitive performance profile of MS patients differentiates their clinical course. J Neurol. 2005:252. [PubMed]
62* Lethlean JB, Murdoch BE. Performance of subjects with multiple sclerosis on tests of high-level language. Aphasiology. 1997;11:39–57.
63* Liguori M, Fera F, Gioia MC, et al. Investigating the role of brain-derived neurotrophic factor in relapsing-remitting multiple sclerosis. Genes Brain Behav. 2007;6:177–183. [PubMed]
64* Ling ND, Selby MJ. Assessment of memory in multiple sclerosis patients using the memory assessment scale. Percept Mot Skills. 1998;86:987–998. [PubMed]
65* Mainero C, Caramia F, Pozzilli C, et al. fMRI evidence of brain reorganization during attention and memory tasks in multiple sclerosis. Neuroimage. 2004;21:858–867. [PubMed]
66* Manson SC, Palace J, Frank JA, Matthews PM. Loss of interhemispheric inhibition in patients with multiple sclerosis is related to corpus callosum atrophy. Exp Brain Res. 2006;174:728–733. [PubMed]
67* Moore AC, MacLeod AK, Barnes D, Langdon DW. Future-directed thinking and depression in relapsing-remitting multiple sclerosis. Br J Health Psychol. 2006;11:663–675. [PubMed]
68* Morgen K, Sammer G, Courtney SM, et al. Evidence for a direct association between cortical atrophy and cognitive impairment in relapsing-remitting MS. Neuroimage. 2006;30:891–898. [PubMed]
69* Nagy H, Bencsik K, Rajda C, et al. The effects of reward and punishment contingencies on decision-making in multiple sclerosis. J Int Neuropsychol Soc. 2006;12:559–565. [PubMed]
70* Olivares T, Nieto A, Sanchez MP, Wollmann T, Hernandez MA, Barroso J. Pattern of neuropsychological impairment in the early phase of relapsing-remitting multiple sclerosis. Mult Scler. 2005;11:191–197. [PubMed]
71* Parmenter BA, Shucard JL, Shucard DW. Information processing deficits in multiple sclerosis; a matter of complexity. J Int Neuropsychol Soc. 2007a;13:417–423. [PubMed]
72* Parmenter BA, Zivadinov R, Kerenyi L, Gavett R, Weinstock-Guttmann B, et al. Validity of the Wisconsin Card Sorting and Delis-Kaplan Executive Function System (DKEFS) sorting tests in multiple sclerosis. J Clin Exp Neuropsychol. 2007;29:215–223. [PubMed]
73* Pelletier J, Suchet L, Witjas T, et al. A longitudinal study of callosal atrophy and interhemispheric dysfunction in relapsing-remitting multiple sclerosis [Reprint] Arch Neurol. 2001;58:105–111. [PubMed]
74* Pozzilli C, Passafiume D, Bernardi S, et al. SPECT, MRI and cognitive functions in multiple sclerosis. J Neurol Neurosurg Psychiatry. 1991;54:110–115. [PMC free article] [PubMed]
75* Randolph JJ, Wishart HA, Saykin AJ, et al. FLAIR lesion volume in multiple sclerosis. J Int Neuropsychol Soc. 2005;11:205–209. [PubMed]
76* Rocca MA, Falini A, Colombo B, Scotti G, Comi G, Filippi M. Adaptive functional changes in the cerebral cortex of patients with nondisabling multiple sclerosis correlate with the extent of brain structural damage. Ann Neurol. 2002;51:330–339. [PubMed]
77* Rosti E, Hamalainen P, Koivisto K, Hokkanen L. The PASAT performance among patients with multiple sclerosis: analysis of responding patterns using different scoring methods. Mult Scler. 2006;12:586–593. [PubMed]
78* Ruggieri RM, Palermo R, Vitello G, Gennuso M, Settipani N, Piccoli F. Cognitive impairment in patients suffering from relapsing-remitting multiple sclerosis with EDSS <= 3.5. Acta Neurol Scand. 2003;108:323–326. [PubMed]
79. Ryan L, Clark CM, Klonoff H, Li D, Paty D. Patterns of cognitive impairment in relapsing-remitting multiple sclerosis and their relationship to neuropathology on magnetic resonance images. Neuropsychology. 1996;10:176–193.
80* Selby MJ, Ling N, Williams JM. Interferon beta 1-b in verbal memory functioning of patients with relapsing-remitting multiple sclerosis. Percept Mot Skills. 1998;86:1099–1106. [PubMed]
81* Stablum F, Meligrana L, Sgaramella T, Bortolon F, Toso V. Endogenous task shift processes in relapsing-remitting multiple sclerosis. Brain Cogn. 2004;56:328–331. [PubMed]
82* Staffen W, Mair A, Zauner H, et al. Cognitive function and fMRI in patients with multiple sclerosis: evidence for compensatory cortical activation during an attention task. Brain. 2002;125:1275–1282. [PubMed]
83* Staffen W, Zauner H, Mair A, et al. Magnetic resonance spectroscopy of memory and frontal brain region in early multiple sclerosis. J Neuropsychiatry Clin Neurosci. 2005;17:357–363. [PubMed]
84* Sweet LH, Rao SM, Primeau M, Durgerian S, Cohen RA. Functional magnetic resonance imaging response to increased verbal working memory demands among patients with multiple sclerosis. Hum Brain Mapp. 2006;27:28–36. [PubMed]
85. Hedges LV, Olkin I. Statistical methods for meta-analysis. Orlando, FL: Academic; 1985.
86. Mathias JL, Wheaton P. Changes in attention and information-processing speed following severe traumatic brain injury: a meta-analytic review. Neuropsychology. 2007;21:212–223. [PubMed]
87. Amato MP, Ponziani G, Pracucci G, Bracco L, Siracusa G, Amaducci L. Cognitive impairment in early-onset multiple sclerosis: pattern, predictors, and impact on everyday life in a 4-year follow-up. Arch Neurol. 1995;52:168–172. [PubMed]
88. Ling S. Driving accident frequency increased in patients with multiple sclerosis. Acta Neurol Scand. 2002;105:169–173. [PubMed]
89. Shawaryn MA, Schultheis MT, Garay E, DeLuca J. Assessing functional status: exploring the relationship between the multiple sclerosis functional composite and driving. Arch Phys Med Rehabil. 2002;83:1123–1129. [PubMed]
90. Schultheis MT, Garay E, DeLuca J. The influence of cognitive impairment on driving performance in multiple sclerosis. Neurology. 2001;56:1089–1094. [PubMed]
91. Baum HM, Rothschild BB. The incidence and prevalence of reported multiple sclerosis. Ann Neurol. 1981;10:420–428. [PubMed]
92. Minden SL, Schiffer RB. Affective disorders in MS: review and recommendations for clinical research. Arch Neurol. 1991;47:98–104. [PubMed]
93. Riether AM. Anxiety in patients with multiple sclerosis. Semin Clin Neuropsychiatry. 1999;4:103–113. [PubMed]
94. Mohr D, Cox D. Multiple sclerosis: empirical literature for the clinical health psychologist. J Clin Psychol. 2001;57:479–499. [PubMed]
95. Patten SB, Beck CA, Williams JVA. Major depression in multiple sclerosis: a population-based perspective. Neurology. 2003;61:1524–1527. [PubMed]
96. Rodgers D, Khoo K, MacEachen M, Oven M, Beatty WW. Cognitive therapy for multiple sclerosis: a preliminary study. Altern Ther Health Med. 1996;2:70–74. [PubMed]
97. Lublin FD, Reingold SC. Defining the clinical course of multiple sclerosis: results of an international study. Neurology. 1996;46:907–910. [PubMed]
98. Minden SL, Moes EJ, Orav J, Kaplan E, Reich P. Memory impairment in multiple sclerosis. J Clin Exp Neuropsychol. 1990;12:566–586. [PubMed]