|Home | About | Journals | Submit | Contact Us | Français|
Background: It might be difficult for clinicians and scientists to identify comprehensively the major research topics given the large number of publications. A bibliometric report that identifies the most-cited articles within the body of the relevant literature may provide insight and guidance for readers toward scientific topics that are considered important for researchers and all relevant workers of academia. To our knowledge, there is a lack of an overall evaluation of the most-cited articles and hence of a comprehensive review of major research topics in neuroscience. The present study was therefore proposed to analyze and characterize the 100 most-cited articles in neuroscience.
Methods: Based on data provided from Web of Science, the 100 most-cited articles relevant to neuroscience were identified and characterized. Information was extracted for each included article to assess for the publication year, journal published, impact factor, adjusted impact factor, citation count (total, normalized, and adjusted), reference list, authorship and article type.
Results: The total citation count for the 100 most-cited articles ranged from 7,326 to 2,138 (mean 3087.0) and the normalized citation count ranged from 0.163 to 0.007 (mean 0.054). The majority of the 100 articles were research articles (67%) and published from 1996 to 2000 (30%). The author and journal with the largest share of these 100 articles were Stephen M. Smith (n = 6) and Science (n = 13) respectively. Among the 100 most-cited articles, 37 were interlinked via citations of one another, and they could be classified into five major topics, four of which were scientific topics, namely neurological disorders, prefrontal cortex/emotion/reward, brain network, and brain mapping. The remaining topic was methodology. Interestingly 41 out of 63 of the rest, non-interlinked articles could also be categorized under the above five topics. Adjusted journal impact factor among these 100 articles did not appear to be associated with the corresponding adjusted citation count.
Conclusion: The current study compiles a comprehensive list and analysis of the 100 most-cited articles relevant to neuroscience that enables the comprehensive identification and recognition of the most important and relevant research topics concerned.
Neuroscience is a broad research field aimed at investigating the relationships among neural structures, functions and behaviors. It comprises many research themes; examples include analytic methods, the acquisition of functional neuroimaging and its physics, computational modeling and analytics, physiology and anatomy, sensorimotor functions, aging and cognitive functions, social neuroscience, and language and learning. With the enormous number of articles published in the field, it might be daunting for clinicians and scientists to identify the major research topics of the field concerned. A bibliometric report that identifies the research hotspots and their contributors may provide updated insight as a first step to further explore the details (Snyder and Raichle, 2012; Kim, H. J. et al., 2016; Yeung et al., 2017a,b).
When citation analysis is properly used, it could objectively evaluate the scientific performances of a selected corpus of literature at a relatively low financial cost (Garfield, 1979). There are several up-to-date publications that report on the 100 most-cited articles in various subfields of neuroscience, such as neurointervention (Kim, E. S. et al., 2016), neuroimaging (Kim, H. J. et al., 2016), neurorehabilitation (Kreutzer et al., 2017) and neurosurgery (Ponce and Lozano, 2010). However, to our knowledge, there is a lack of published papers that provide an overall evaluation of the most-cited neuroscience articles.
The purpose of the present study was therefore to identify the 100 most-cited articles in neuroscience and to analyze their characteristics and inter-citation network.
The choice of data source and the search strategy were adopted from previous reports (Ponce and Lozano, 2010; Kim, E. S. et al., 2016; Kim, H. J. et al., 2016; Kreutzer et al., 2017). The source of data was the Clarivate Analytics-owned, Web-based, multidisciplinary database Web of Science (WoS), which provides the bibliometric data of published scientific articles starting from 1945. In March 2017, we searched in the Science Citation Index Expanded (SCI-E) section of WoS to identify articles with the following string: TS = neuro* OR WC = Clinical Neurology OR WC = Medicine, General & Internal OR WC = Neuroimaging OR WC = Neuroscience OR WC = Radiology, Nuclear medicine & Medical imaging. This string searched for articles that: (1) contain the string “neuro” in the title, abstract, or keywords; or (2) are published in journals that belong to the five selected Journal Citation Report (JCR) categories.
The articles were sorted according to citation count, and their titles and abstracts were evaluated to ensure that they were relevant to neuroscience. No restrictions were placed on the type of research model (in vivo / in vitro), article type (e.g., research article, review, editorial, letter, etc.), or publication language. The articles citing the 100 most-cited articles and the reference lists of the 100 most-cited articles were searched to decrease the chance that relevant neuroscience papers with equal or higher citations were missed.
The 100 most-cited articles were reviewed and the following information extracted: (1) year of publication; (2) title of journal; (3) adjusted journal impact factor (i.e., impact factor per year since publication of that article); (4) total citation count; (5) normalized citation count (i.e., citation count received during the first 10 years after publication divided by neuroscience publication count during that period); (6) adjusted citation count (i.e., citation count per year since publication of that article); (7) reference list; (8) authorship; and (9) article type. Bradford's law of scattering was applied to the data of the 100 most-cited articles to investigate if core articles are responsible for one-third of the total citations that these articles received (Vickery, 1948). Based on Bradford's law, three groups of articles should contribute to the total citation count when it is equally divided into three portions, whereas the number of articles within the groups should be in the ratio of 1:n:n2. In addition, the Highly Cited Researchers 2016 list was searched to identify if any authors of these 100 most-cited articles have “contributed markedly high numbers of top-cited papers over a recent eleven year period, 2004–2014”1 In addition, we identified if any authors of these 100 articles received any major scientific awards (Lasker Award2 or Nobel Prize3.
To reveal if these 100 articles were interlinked (i.e., citing one another), a citation network consisting of these interlinked articles was visualized by using VOSviewer (Van Eck and Waltman, 2009). Each article was represented by a bubble. Two bubbles were connected by a line if either one of them cited the other. In this visualized network, the bubbles were categorized manually according to their topics. Each topic was defined as a discrete theme serving as an umbrella term, under which papers concerning related research work could be grouped together. Bubble size indicated the citation count received within the network.
Because the article citation count influences the journal impact factor, and because a higher impact factor tends to attract academics' attention, we assumed there might be a possibility that a higher adjusted impact factor would lead to a higher adjusted citation count. Here, we calculated adjusted values instead of normalized values because online WoS database and the authors' institutions do not have impact factor data before 1997. Therefore, to investigate the association involving impact factor, it was more meaningful to use adjusted data instead of normalizing them according to statistics from a 10-year period. Pearson's correlation test was applied.
Next, we applied Pearson's correlation test to investigate the association between normalized citation count and years since publication. In the old times there were fewer publications so it was reasonable to expect that the older publications received higher normalized citation count.
Statistical tests were performed with SPSS (Version 23.0, IBM, NY, US), and the test results were significant if p < 0.05. If the test results were insignificant but suggested data clustering in the scatter plot, we would conduct a two-step cluster analysis to evaluate if the involved citation count (adjusted or normalized) could be separated into clusters. Significant results would be further examined with Price's law by applying the best-fitting linear or exponential trend lines to the scatter plot. If the data had a better fit by the exponential line, results would be considered to fulfill Price's law, which predicts an exponential change of an outcome variable (i.e., adjusted or normalized citation count in the current study) over the survey period (López-Muñoz et al., 2014; Yeung et al., 2017b). For illustrative purposes, the data would be plotted against the year of publication (instead of years since publication) together with annual counts of neuroscience publications to examine if both trends followed an exponential growth consistent with the notion of “publish or perish.” The annual counts of neuroscience publications were acquired by searching “neuro*” in the PubMed database.
The 100 most-cited articles were sorted in Table Table11 according to normalized (Rank A) and total (Rank B) citation counts. The total number of citations that the 100 most-cited articles in the neuroscience field have received ranged from 2,138 to 7,326 (mean ± SD: 3087.0 ± 954.5, cumulative total citations = 308,701; Table Table1).1). The 23 highest-ranked (Rank B) articles on the list received one-third of the total citations of these 100 articles, whereas the next and last one-third citations were contributed by the next 34 and 43 articles respectively, indicating that the distribution did not fulfill Bradford's law (Table (Table1).1). The normalized citation counts ranged from 0.007 to 0.163 (mean ± SD: 0.054 ± 0.028, Table Table1).1). In terms of the total citation count (Rank B), the top-ranked article was published by Kurtzke (1983), which reported a scale evaluating neurologic impairment in patients with multiple sclerosis. With regard to the normalized citation count (Rank A), the top-ranked article was published by Nowak et al. (1984), which described the role of magnesium ions in modulating the response of glutamate-activated channels in neurons. The 100 most-cited articles were mainly research articles (n = 67), followed by reviews (n = 29), editorials (n = 2), letters (n = 1) and notes (n = 1).
The 100 most-cited articles were published in 37 journals (Table (Table2).2). The journals that contributed five or more of the 100 most-cited articles included Science, NeuroImage, Neurology, Nature and Proceedings of the National Academy of Sciences of the United States of America. The journals that published the 100 most-cited neuroscience articles with the highest mean normalized citation counts were Lancet, Annual Review of Immunology, Nature, Acta Neuropathologica and Trends in Neurosciences. The 100 articles were published from 1972 to 2009, and the largest proportion of them was published during 1996–2000, followed by 2001–2005 and 1991–1995. Eighty-one of these 100 articles were published within these periods (Table (Table33).
A total of 533 authors contributed to these 100 most-cited articles, and 55 of them were in the latest-available list of Highly Cited Researchers 2016. Ten authors contributed to three or more of the 100 most-cited articles (Table (Table4),4), led by Stephen M. Smith, John Ashburner, and Mark Jenkinson. All of them were still contributing to the academic publication in either 2016 or 2017. Among the 533 authors, we identified two Lasker Award winners, namely Prusiner, Stanley B., and DeLong, Mahlon R. We did not identify any Nobel Prize winner.
Thirty-seven of these 100 most-cited articles were interlinked with 55 citations among them, and the citation network is displayed in Figure Figure1.1. The articles forming the network could be classified into five topics, including four scientific topics: (1) neurological disorders, e.g., Alzheimer's disease, dementia, and Parkinson's disease (red); (2) the prefrontal cortex and associated emotion/ reward (blue); (3) the brain network, including the resting state network (green); and (4) brain mapping (orange). The remaining topic was methodology, e.g., the basis of functional magnetic resonance imaging signals, data analytic, computation, and processing methods (black). It seemed that brain connectivity papers (Figure (Figure1,1, green) were at the center of the citation network surrounded by method (black dot) and brain mapping (orange) papers. Meanwhile the neurological disorders (red) and emotion/reward (blue) papers were at the periphery. It should be noted that the linkages among these five topics were relatively weak (only nine inter-topic citation links, Figure Figure1),1), and there was no cross-topic author. This indicated that the citations were mainly self-connecting within each topic, e.g., within the brain network and methodology groups, respectively. These five topics together accounted for 78 out of the 100 most-cited papers. Among these 78 papers, 52.6% (41/78) of them were not within the citation network.
We examined the remaining 63 articles not connected to the 37-article network by citations, and we discovered that 27 were related to neurological disorders, four were related to the prefrontal cortex and associated emotion/ reward, two were related to brain mapping and eight were related to methodology. Twenty-two articles were related to basic neuroscience. Overall, the articles of the five major topics (n = 78) contributed to 79.6% (neurological disorder: 34.3%, prefrontal cortex/emotion/reward: 9.0%, brain network: 5.3%, brain mapping: 6.3%, and methodology: 24.7%) of the 308,701 total citations that all of the 100 most-cited articles received. There was no cross-topic author among these included articles.
We did not find a significant correlation between the adjusted journal impact factor and the adjusted citation count (r2 = −0.025, p = 0.804, Figure Figure2).2). Two-step clustering analysis found that the data points could be divided into two clusters with a silhouette value of 0.9, indicating that the clustering was distinct. The smaller cluster (cluster 2, triangles, Figure Figure2)2) consisted of 32 articles published in nine journals with relatively higher adjusted impact factors. Among these 32 articles, there were 22 Highly Cited Researchers 2016 authoring 14 papers. The six Highly Cited Researchers who authored at least three of the 100 most-cited neuroscience articles published only two articles in cluster 2. However, the normalized citation counts of articles in this cluster did not seem to differ much from those in the other cluster with a lower normalized impact factor. Also, within each cluster, there was no association detectable between the normalized citation count and the normalized impact factor.
On the contrary, there was a positive correlation between years since publication of the article and the normalized citation count (r2 = 0.373, p < 0.001, Figure Figure3),3), meaning that newer publications had a lower normalized citation count. Such a correlation followed a best-fitting linear trend line (r2 = 0.14) more closely than an exponential one (r2 = 0.06), indicating that it does not fulfill Price's law. Conversely, the annual neuroscience publication counts during the same period experienced exponential growth (r2 = 0.96).
Similar to previous publications (Ponce and Lozano, 2010; Kim, E. S. et al., 2016; Kim, H. J. et al., 2016; Kreutzer et al., 2017), we evaluated the top 100 most-cited neuroscience articles by convenience. From the visualized citation network (Figure (Figure1),1), it could be seen that the articles investigating the brain connectivity (green), particularly the resting state, were relatively published more recently (Raichle et al., 2001; Fox et al., 2005; Fox and Raichle, 2007; Bullmore and Sporns, 2009). This was consistent with the perspectives of Friston (2011) and Snyder and Raichle (2012) that the topic of brain connectivity, particularly during the resting state, has gained popularity and importance. Besides resting state, sensory studies have also employed connectivity analyses (Yeung et al., 2016). Such a research direction, together with basic cellular and molecular neuroscience, should provide extra insight into a better understanding of neurological disorders, which the neuroscience literature has already heavily emphasized. We observed that the topic of neurological disorders contributed six papers to the set of 37 interlinked papers, whereas there were 27 papers in this topic amongst the 63 non-interlinked papers. For the topics of methodology and brain connectivity, these numbers were 17/8 and 5/0 respectively. These five brain connectivity papers with high citation counts were reporting functional connectivity when the brain was at resting state; and thus they were highly relevant to each other and interlinked. Similarly, the majority of methodology papers with high citation counts were related to each other or followed by high-citation papers from other topics, and thus appeared in the interlinked network. However, perhaps the spectrum of neurological disorders was so diverse that a proportion of these highly cited papers were not related to each other and thus not appearing in the interlinked network.
The distribution of the citations that the 100 most-cited articles received did not follow Bradford's law. Instead, it was more evenly distributed among the articles. This implied that the 100 most-cited articles were receiving relatively balanced attention and citation counts instead of having a few articles among them continuing to dominate the neuroscience literature. The top two most-cited articles revealed by the current study were published decades ago, in 1983 and 1991, respectively, but did not rank very high under the normalized citation count (76 and 19, Table Table1).1). On the other hand, the major contributing journals that published half of the 100 most-cited articles, perhaps except two, had long histories, namely Science (since 1880), NeuroImage (since 1993), Neurology (since 1951), Nature (since 1869), Proceedings of the National Academy of Sciences of the United States of America (since 1914) and Annals of Neurology (since 1977). This phenomenon was consistent with other subfield studies (Kim, E. S. et al., 2016; Kim, H. J. et al., 2016). From Figure Figure22 it can be seen that the articles were divided into two clusters by adjusted journal impact factor. The smaller cluster consisted of articles published in high-impact factor journals, such as Cell, Lancet, Science, the Nature group of journals, Annual Review of Neuroscience, and Annual Review of Immunology. However, there was no apparent difference in the adjusted citation counts of articles between the two clusters. Also, in each cluster there was no relationship between the adjusted citation count and the adjusted impact factor. This is consistent to previous reports on cardiovascular research that the journal impact factor is not representative of the citation count of its individual papers (Opthof, 1997; Opthof et al., 2004).
The results from the current study indicated that the periods that contributed to the largest proportion of the 100 articles were 1991–2005, which was later than the period (1976–1995) reported by a similar survey on neurosurgery (Ponce and Lozano, 2010) but was similar to the situations for neurointervention (Kim, E. S. et al., 2016) and neuroimaging (Kim, H. J. et al., 2016). In addition, we observed a significant correlation that the newer most-cited articles received a lower normalized citation count. Though the more recently published articles must have a higher annual citation count than their older counterparts to enter the list of 100 most-cited articles, including neuroscience articles (Lefaivre et al., 2011), the reduction in their normalized citation count could be explained by the exponential growth in neuroscience publications. The implication was that over the years the growth of neuroscience publication count was larger than the growth of citation count. These analyses should have essentially provided more balanced accounts for the citation analysis compared to those evaluations based on the total citation count only, as the articles with both high total and normalized citation counts should be the ones with up-to-date relevance for current and future researchers.
The averaged citation count of the 100 most-cited neuroscience articles was 3,087, which was higher than those reported in clinical/surgical subfields such as neurosurgery (452.6, Ponce and Lozano, 2010), neruointervention (363.5, Kim, E. S. et al., 2016), and neurorehabilitation (317.0, Kreutzer et al., 2017). This difference was consistent with general bibliometric findings that basic science researches often received more citations than did specific clinical researches (Van Eck et al., 2013; Yeung et al., 2017b). It should be noted that there was also opposite information which stated that clinical papers were more frequently cited than basic science papers, at least in the field of cardiovascular research. This implied that the balance between basic and clinical science may vary amongst fields (Opthof, 2011).
Review papers accounted for 29% of the top 100 most-cited articles in the current study, which was considerably higher than the proportion identified by subfield studies, such as 16% in neuroimaging (Kim, H. J. et al., 2016), 16% in neurorehabilitation (Kreutzer et al., 2017), 11% in neurosurgery (Ponce and Lozano, 2010), and even 0% in neurointervention (Kim, E. S. et al., 2016). This could imply that other subfields of neuroscience, such as the basic and cellular neurosciences, have published crucial reviews that received a lot of citations, such as the articles ranked 2, 8, and 27 (Rank A) on the top 100 list of the current study.
Approximately 10% of the authors (55 out of 533) who contributed to the 100 most-cited neuroscience articles were listed as Highly Cited Researchers 2016. Six of the ten authors who contributed to three or more most-cited neuroscience articles were Highly Cited Researchers 2016. The most-cited neuroscience articles of these six authors were mainly published in NeuroImage (33%). Only two of the most-cited neuroscience articles authored by them belonged to cluster 2 in Figure Figure22 (triangles, one in Nature Reviews Neuroscience and one in Science). Within the 37-article citation network, these six Highly Cited Researchers contributed to 13 articles (black solid line, Figure Figure1),1), accounting for nine of the 14 articles in the methodology group (black dot), three of the five articles in the brain network group (green) and one of the six articles in the neurological disorder group (red). These indicated they preferably focused on the methodology and brain network, and they published in NeuroImage.
There are several intrinsic limitations of using citation analysis to evaluate the academic importance of a specific article, author or journal. First, the interpretation of citation count may not be straightforward. For instance, it was impossible to identify inappropriate citations, citations for questioning or rebuttal instead of affirmation, and selective citation behaviors, such as preferably citing articles that were written in English, were available through open access and were published in prestigious journals (Garfield, 1979). In addition, through the “snowball effect,” people tend to cite publications that are already highly cited (Kuhn, 1962; Lefaivre et al., 2011). Second, the search was limited to the WoS database. It did not record citations by textbooks, and there might exist inaccurate or missing data especially regarding very ancient publications. There are other databases, such as Scopus and Google Scholar, but they are weaker at tracking older publications (Ponce and Lozano, 2010). In addition, from the citation network visualized in the current study there were five major topics and there were no cross-topic authors. This might imply that neuroscience research has different niches and it would be worthwhile for future bibliometric studies to further evaluate specific bodies of literature within neuroscience.
We have identified the 100 most-cited articles in neuroscience to assess its driving force over time, and we have revealed that there were five major topics interlinked to one another, namely four scientific topics and one methodology. The list produced in the current study allows clinicians and scientists to quickly grasp important works and findings for their references.
AY conceived the work, acquired and analyzed data, and drafted the work. TG and WL facilitated the acquisition of data and critically revised the work. All authors have approved the final content of the manuscript.
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The authors thank Ms Samantha Kar Yan Li for her statistical assistance.
Funding. This work was substantially supported by a grant from the Research Grants Council of the Hong Kong Special Administrative Region, China (HKU 766212M).