|
1
|
Nilsson RH, Jansson AT, Wurzbacher C, Anslan S, Belford P, Corcoll N, Dombrowski A, Ghobad-Nejhad M, Gustavsson M, Gómez-Martínez D, Kalsoom Khan F, Khomich M, Lennartsdotter C, Lund D, Van Der Merwe B, Mikryukov V, Peterson M, Porter TM, Põlme S, Retter A, Sanchez-Garcia M, Svantesson S, Svedberg P, Vu D, Ryberg M, Abarenkov K, Kristiansson E. 20 years of bibliometric data illustrates a lack of concordance between journal impact factor and fungal species discovery in systematic mycology. MycoKeys 2024; 110:273-285. [PMID: 39610860 PMCID: PMC11603103 DOI: 10.3897/mycokeys.110.136048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2024] [Accepted: 10/18/2024] [Indexed: 11/30/2024] Open
Abstract
Journal impact factors were devised to qualify and compare university library holdings but are frequently repurposed for use in ranking applications, research papers, and even individual applicants in mycology and beyond. The widely held assumption that mycological studies published in journals with high impact factors add more to systematic mycology than studies published in journals without high impact factors nevertheless lacks evidential underpinning. The present study uses the species hypothesis system of the UNITE database for molecular identification of fungi and other eukaryotes to trace the publication history and impact factor of sequences uncovering new fungal species hypotheses. The data show that journal impact factors are poor predictors of discovery potential in systematic mycology. There is no clear relationship between journal impact factor and the discovery of new species hypotheses for the years 2000-2021. On the contrary, we found journals with low, and even no, impact factor to account for substantial parts of the species hypothesis landscape, often discovering new fungal taxa that are only later picked up by journals with high impact factors. Funding agencies and hiring committees that insist on upholding journal impact factors as a central funding and recruitment criterion in systematic mycology should consider using indicators such as research quality, productivity, outreach activities, review services for scientific journals, and teaching ability directly rather than using publication in high impact factor journals as a proxy for these indicators.
Collapse
Affiliation(s)
- R. Henrik Nilsson
- Department of Biological and Environmental Sciences, Gothenburg Global Biodiversity Centre, University of Gothenburg, Box 463, 405 30 Göteborg, Sweden
| | - Arnold Tobias Jansson
- Department of Biological and Environmental Sciences, Gothenburg Global Biodiversity Centre, University of Gothenburg, Box 463, 405 30 Göteborg, Sweden
| | - Christian Wurzbacher
- Chair of Urban Water Systems Engineering, Technical University of Munich, Am Coulombwall 3, 85748 Garching, Germany
| | - Sten Anslan
- Department of Biological and Environmental Science, University of Jyväskylä, Survontie 9, 40014 Jyväskylän yliopisto, Finland
- Institute of Ecology and Earth Sciences, University of Tartu, Liivi 2, 50409 Tartu, Estonia
| | - Pauline Belford
- Department of Biological and Environmental Sciences, Gothenburg Global Biodiversity Centre, University of Gothenburg, Box 463, 405 30 Göteborg, Sweden
| | - Natàlia Corcoll
- Department of Biological and Environmental Sciences, Gothenburg Global Biodiversity Centre, University of Gothenburg, Box 463, 405 30 Göteborg, Sweden
| | - Alexandra Dombrowski
- Department of Biological and Environmental Sciences, Gothenburg Global Biodiversity Centre, University of Gothenburg, Box 463, 405 30 Göteborg, Sweden
| | - Masoomeh Ghobad-Nejhad
- Department of Computer Science and Engineering, Interaction Design, University of Gothenburg, Lindholmsplatsen 1, 41756 Göteborg, Sweden
| | - Mikael Gustavsson
- Department of Biological and Environmental Sciences, Gothenburg Global Biodiversity Centre, University of Gothenburg, Box 463, 405 30 Göteborg, Sweden
| | - Daniela Gómez-Martínez
- Department of Biological and Environmental Sciences, Gothenburg Global Biodiversity Centre, University of Gothenburg, Box 463, 405 30 Göteborg, Sweden
| | - Faheema Kalsoom Khan
- Department of Biological and Environmental Sciences, FRAM Centre for Future Chemical Risk Assessment and Management Strategies, University of Gothenburg, Box 463, 405 30 Göteborg, Sweden
| | - Maryia Khomich
- Department of Biotechnology, Iranian Research Organization for Science and Technology (IROST), P. O. Box 3353-5111, Tehran, Iran
| | - Charlotte Lennartsdotter
- Department of Biological and Environmental Sciences, Gothenburg Global Biodiversity Centre, University of Gothenburg, Box 463, 405 30 Göteborg, Sweden
| | - David Lund
- Systematic Biology, Department of Organismal Biology, Evolutionary Biology Center, Uppsala University, Norbyvägen 18 D, 752 36 Uppsala, Sweden
| | | | - Vladimir Mikryukov
- Institute of Ecology and Earth Sciences, University of Tartu, Liivi 2, 50409 Tartu, Estonia
| | - Marko Peterson
- Institute of Ecology and Earth Sciences, University of Tartu, Liivi 2, 50409 Tartu, Estonia
| | - Teresita M. Porter
- Department of Mathematical Sciences, Chalmers University of Technology and University of Gothenburg, Göteborg, Sweden
| | - Sergei Põlme
- Institute of Ecology and Earth Sciences, University of Tartu, Liivi 2, 50409 Tartu, Estonia
| | - Alice Retter
- Department of Chemical Engineering, Stellenbosch University, Private Bag X1, Stellenbosch, South Africa
- Toronto, Ontario, Canada
| | - Marisol Sanchez-Garcia
- Department of Functional and Evolutionary Ecology, University of Vienna, Djerassiplatz 1, A-1030 Vienna, Austria
| | - Sten Svantesson
- Department of Biological and Environmental Sciences, Gothenburg Global Biodiversity Centre, University of Gothenburg, Box 463, 405 30 Göteborg, Sweden
- Department of Biological and Environmental Sciences, FRAM Centre for Future Chemical Risk Assessment and Management Strategies, University of Gothenburg, Box 463, 405 30 Göteborg, Sweden
| | - Patrik Svedberg
- Department of Biological and Environmental Sciences, Gothenburg Global Biodiversity Centre, University of Gothenburg, Box 463, 405 30 Göteborg, Sweden
| | - Duong Vu
- Leibniz Institute for Freshwater Ecology and Inland Fisheries, IGB, Zur alten Fischerhuette 2, 16775 Neuglobsow, Germany
| | - Martin Ryberg
- Department of Biological and Environmental Sciences, FRAM Centre for Future Chemical Risk Assessment and Management Strategies, University of Gothenburg, Box 463, 405 30 Göteborg, Sweden
| | - Kessy Abarenkov
- Institute of Ecology and Earth Sciences, University of Tartu, Liivi 2, 50409 Tartu, Estonia
| | - Erik Kristiansson
- Systematic Biology, Department of Organismal Biology, Evolutionary Biology Center, Uppsala University, Norbyvägen 18 D, 752 36 Uppsala, Sweden
| |
Collapse
|
|
2
|
Ho YS, Giordano V, Mauffrey C, Giannoudis PV. Trends of impact factor contributors to the Injury Journal: A bibliometric analysis. Injury 2024; 55:111255. [PMID: 38042694 DOI: 10.1016/j.injury.2023.111255] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Revised: 11/21/2023] [Accepted: 11/26/2023] [Indexed: 12/04/2023]
Abstract
PURPOSE This study aims to analyse papers concerning journal impact factors published in the Injury-International Journal of the Care of the Injured between 1997 and 2022. Through this analysis, the research offers valuable insights into the publication performance and contributors to the journal impact factor, encompassing papers, authors, institutions, and countries. METHODS Articles and reviews published in the Injury between 1995 and 2021 were examined using the Science Citation Index Expanded database. The study employed the journal impact factor contributing indicator to compare highly cited and high journal impact factor papers across various aspects, including papers, authors, institutions, and countries. RESULTS A notable correlation exists between prolific authors, institutions, and countries, alongside those who contribute to high journal impact factors. However, a less distinct connection was observed between highly cited papers/authors and high journal impact factor contributors. The Injury serves as a well-regarded international journal. Notably, editorial members of the journal play a substantial role, serving as model editors and contributing significantly to the journal's success. Out of the Top 25 IF contributing papers with the CN of 34 or more the following themes were noted to dominate: bone healing/tissue regeneration (40 %) of papers, covid-19 pandemic (24 %), polytrauma/coagulopathy (12 %) and infection (8 %). CONCLUSIONS Utilizing the journal impact factor to assess research performance at the individual, institutional, or national levels appears not to be the most appropriate method. The results show that highly cited authors did not hold the distinction of being the primary contributors to the IF. Analysis revealed a low significant relationship among the primary contributors to the IF, highly cited papers, and the most influential papers in 2022. A more effective indicator could involve considering the total number of citations a publication receives from its year of publication up to the end of the most recent year.
Collapse
Affiliation(s)
- Yuh-Shan Ho
- Trend Research Centre, Asia University, No. 500, Lioufeng Road, Taichung 41354, Taiwan
| | - Vincenzo Giordano
- Serviço de Ortopedia e Traumatologia Prof. Nova Monteiro, Hospital Municipal Miguel Couto, Rua Mario Ribeiro, 117/2° Andar, Gávea, Rio de Janeiro, RJ 22430‑160, Brazil
| | - Cyril Mauffrey
- Department of orthopedic surgery, physical medicine and rehabilitation, Denver Health Medical Center, University of Colorado, Denver, USA
| | - Peter V Giannoudis
- Trauma & Orthopaedic Surgery, School of Medicine, University of Leeds, UK; NIHR Leeds Biomedical Research Center, Chapel Allerton Hospital, Leeds, UK.
| |
Collapse
|
|
3
|
Peng PC, Coleman FT. Editorial viewpoints of scientific publishing for early-career research scientists. BMC Proc 2024; 18:4. [PMID: 38229056 PMCID: PMC10792771 DOI: 10.1186/s12919-023-00286-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/08/2023] [Indexed: 01/18/2024] Open
Abstract
While the structure and composition of the scientific manuscript is well known within scientific communities, insider knowledge such as the tricks of the trade and editorial viewpoints of scientific publishing are often less known to early-career research scientists. This article focuses on the key aspects of scientific publishing, including tips for success geared towards senior postdocs and junior faculty. It also highlights important considerations for getting manuscripts published in an efficient and successful manner.
Collapse
Affiliation(s)
- Pei-Chen Peng
- Department of Computational Biomedicine, Cedars-Sinai Medical Center, Los Angeles, CA, 90048, USA.
| | | |
Collapse
|
|
4
|
Denissen JJA, Rauthmann JF. A comprehensive scan of psychological disciplines through self-identification on Google Scholar: Relative endorsement, topical coverage, and publication patterns. PLoS One 2024; 19:e0296421. [PMID: 38165965 PMCID: PMC10760704 DOI: 10.1371/journal.pone.0296421] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2020] [Accepted: 12/13/2023] [Indexed: 01/04/2024] Open
Abstract
Psychological researchers often identify with psychological disciplines, such as social or clinical psychology. The current study analyzed Google Scholar profiles from 6,532 international scientists who attracted more than 100 citations in 2019 and self-identified with at least one of 10 common psychological disciplines (psychoanalysis; clinical psychology; (cognitive) neuroscience; developmental psychology; educational psychology; experimental psychology; biological psychology/psychophysiology; mathematical psychology/psychometrics; social psychology; personality psychology). Results indicated that almost half of all psychologists self-identified with either social psychology or cognitive neuroscience. There were 487 topics that were endorsed at least five times, ranging from highly discipline-specific topics to more integrative ones, such as emotion and personality. We also factor-analyzed frequencies of topical endorsement across disciplines and found two factors, which we interpreted as reflecting correlational and experimental research traditions (with social psychology being the largest discipline within the former tradition and cognitive neuroscience being the largest discipline within the latter tradition). Differences in productivity and impact were also found, with researchers identifying with psychometrics being the most productive and researchers identifying with personality psychology, cognitive neuroscience, and multidisciplinary psychology as the most impactful in terms of citation increases per additional output. Recommendations for promoting cross-fertilization across psychological disciplines are formulated.
Collapse
|
|
5
|
Švab I, Klemenc-Ketiš Z, Zupanič S. New Challenges in Scientific Publications: Referencing, Artificial Intelligence and ChatGPT. Zdr Varst 2023; 62:109-112. [PMID: 37327133 PMCID: PMC10263368 DOI: 10.2478/sjph-2023-0015] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2023] [Accepted: 05/03/2023] [Indexed: 06/18/2023] Open
Abstract
The COVID-19 pandemic has led to a surge in scientific publications, some of which have bypassed the usual peer-review processes, leading to an increase in unsupported claims being referenced. Therefore, the need for references in scientific articles is increasingly being questioned. The practice of relying solely on quantitative measures, such as impact factor, is also considered inadequate by many experts. This can lead to researchers choosing research ideas that are likely to generate favourable metrics instead of interesting and important topics. Evaluating the quality and scientific value of articles requires a rethinking of current approaches, with a move away from purely quantitative methods. Artificial intelligence (AI)-based tools are making scientific writing easier and less time-consuming, which is likely to further increase the number of scientific publications, potentially leading to higher quality articles. AI tools for searching, analysing, synthesizing, evaluating and writing scientific literature are increasingly being developed. These tools deeply analyse the content of articles, consider their scientific impact, and prioritize the retrieved literature based on this information, presenting it in simple visual graphs. They also help authors to quickly and easily analyse and synthesize knowledge from the literature, prepare summaries of key information, aid in organizing references, and improve manuscript language. The language model ChatGPT has already greatly changed the way people communicate with computers, bringing it closer to human communication. However, while AI tools are helpful, they must be used carefully and ethically. In summary, AI has already changed the way we write articles, and its use in scientific publishing will continue to enhance and streamline the process.
Collapse
Affiliation(s)
- Igor Švab
- Department of Family Medicine, Medical Faculty, University of Ljubljana, Poljanski nasip 58, 1000Ljubljana, Slovenia
- National Institute of Public Health, Trubarjeva 2, 1000Ljubljana, Slovenia
| | - Zalika Klemenc-Ketiš
- Department of Family Medicine, Medical Faculty, University of Ljubljana, Poljanski nasip 58, 1000Ljubljana, Slovenia
- Department of Family Medicine, Medical Faculty, University of Maribor, Taborska 8, 2000Maribor, Slovenia
- Ljubljana Community Health Centre, Metelkova 9, 1000Ljubljana, Slovenia
| | - Saša Zupanič
- National Institute of Public Health, Trubarjeva 2, 1000Ljubljana, Slovenia
| |
Collapse
|
|
6
|
Short-term incentives of research evaluations: Evidence from the UK Research Excellence Framework. RESEARCH POLICY 2023. [DOI: 10.1016/j.respol.2023.104729] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/22/2023]
|
|
7
|
Jakobsson Støre S, Norell-Clarke A, Jakobsson N. Sleep researchers' rankings of sleep journals. J Sleep Res 2023; 32:e13756. [PMID: 36316796 DOI: 10.1111/jsr.13756] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Accepted: 09/24/2022] [Indexed: 05/10/2023]
Abstract
The impact factor is used to rank the quality of scientific journals but has been criticised for a number of reasons. The aim of the study was to investigate sleep researchers' perceptions of sleep journals to determine whether subjective rankings of journals were in line with the journals' impact factors. Clarivate's Journal Citation Reports website was used to identify journals containing the words 'sleep' or 'dream' in the titles with an impact factor since 2018, resulting in 12 journals. A survey including questions about how the respondent would rank these journals (e.g., three most prestigious journals) was developed. A total of 122 sleep researchers completed the survey. Sleep, Sleep Medicine Reviews and Journal of Sleep Research were ranked as the three most prestigious sleep journals, in line with the impact factors of the journals. For the rest of the journals, the subjective rankings and impact factors did not correspond as much.
Collapse
Affiliation(s)
- Siri Jakobsson Støre
- Department of Social and Psychological Studies, Karlstad University, Karlstad, Sweden
| | - Annika Norell-Clarke
- Department of Social and Psychological Studies, Karlstad University, Karlstad, Sweden
- Faculty of Health Sciences, Kristianstad University, Kristianstad, Sweden
- School of Law, Psychology and Social Work, Örebro University, Örebro, Sweden
| | | |
Collapse
|
|
8
|
Wang JL, Li X, Fan JR, Yan JP, Gong ZM, Zhao Y, Wang DM, Ma L, Ma N, Guo DM, Ma LS. Integrity of the editing and publishing process is the basis for improving an academic journal's Impact Factor. World J Gastroenterol 2022; 28:6168-6202. [PMID: 36483155 PMCID: PMC9724485 DOI: 10.3748/wjg.v28.i43.6168] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/08/2022] [Revised: 10/27/2022] [Accepted: 11/10/2022] [Indexed: 11/16/2022] Open
Abstract
BACKGROUND Journal Impact Factor™ (JIF) is often used to evaluate the relative reputation and quality of academic journals in their respective fields, and can greatly influence the quality and scope of subsequent manuscript submissions. Therefore, many if not all academic journals are interested in increasing their JIF, to improve their academic impact. AIM To determine the importance of the integrity of the editorial and publication process in improving the academic influence of academic journals and the JIF of academic journals. METHODS In this paper, we describe our statistical analysis of bibliometric factors - including the 2021 JIFs released in the Journal Citation Report™ 2022, discipline rankings, received and published articles in 2019-2021, and webpage visits and downloads - for seven journals published by Baishideng Publishing Group (Baishideng) and indexed in Science Citation Index Expanded™; ultimately, we introduce and discuss the editing and publishing processes of Baishideng's journals in their entirety, as they form the basis for our objective of safeguarding and bolstering integrity in academic publication. RESULTS For the seven journals assessed, their 2021 JIFs were basically unchanged from 2020, with the current metric ranging from 5.374 for World Journal of Gastroenterology (WJG) to 1.534 for World Journal of Clinical Cases (WJCC). Further assessments of the journals' bibliometrics from 2019 to 2020, showed that World Journal of Stem Cells has the highest self-citation rate (1.43%) and World Journal of Gastrointestinal Surgery has the lowest (0.21%). Additionally, the total 3012 articles published during this period were cited by more than 20000 articles in approximately 8000 academic journals. Of note, the 1102 articles published in WJG were cited by articles in 3059 journals, among which 171 journals have a JIF of > 10, including internationally renowned academic journals such as CA-A Cancer Journal for Clinicians (2021 JIF 286.130, record count: 1), Lancet (2021 JIF 202.731, record count: 4), Nature Reviews Immunology (2021 JIF 108.555, record count: 2), Nature Reviews Gastroenterology & Hepatology (2021 JIF 73.082, record count: 9), Lancet Gastroenterology & Hepatology (2021 JIF 45.042, record count: 8), Gastroenterology (2021 JIF 33.883, record count: 19), and Gut (2021 JIF 31.793, record count: 21). This suggests that Baishideng's journals have been widely recognized for their academic quality. In the Reference Citation Analysis (RCA) database, all seven Baishideng-published journals obtained a 2022 Journal Article Influence Index (JAII). For example, WJG has a 2022 JAII of 22.048, ranking 18th out of 102 journals in the field of gastroenterology & hepatology in the RCA, with 469909 total citations (6/102) and 21313 total articles (5/102). The numbers of manuscripts received and published in 2021 were both higher than those in 2019-2020. For example, WJCC received a total of 3650 manuscripts in 2021, which is 91.1% higher than those in 2019-2020 (average: 1910 papers/year). In 2021, WJCC published 1296 articles, representing an increase of 105.1% compared to those in 2019-2020 (average: 632 articles/year). The numbers of webpage visits and downloads received by the seven journals have increased year by year. For example, the number of total visits received by WJG in 2019-2021 was 1974052 in 2019, 2317835 in 2020 (increased by 17.4% compared with that in 2019), and 2652555 in 2021 (increased by 4.4% compared with that in 2020). The visitors were from more than 220 countries and regions worldwide, such as the United States, China, and the United Kingdom. Open access (OA) plays a vital role in improving the quality, efficiency, transparency, and integrity of academic journal publishing. From 2019 to 2021, a total of 5543 OA articles were published in the seven journals, of which 2083 (37.6%) were invited and published free-of-charge. During the same period, 1683 articles were published in WJG, and the authors were from more than 70 countries and regions. For the total 5543 articles published in the seven journals from 2019 to 2021, 3903 article quality tracking reports were received after the online publication of these articles. The quality of the articles was further evaluated through the Baishideng's article quality and author evaluation tracking system, with 4655 articles (84.0%) having received author evaluation and feedback, which contributes to tracking metrics for authors' satisfaction with the collective publication processes. From March 25, 2021 to June 28, 2022, the seven journals received a total of 424 reader evaluations and 229 letters from readers; this subsequent reader engagement demonstrates that the popularity of the published articles and the volume of their readership audience were improved through the reader evaluation system. CONCLUSION Ultimately, the findings from our bibliometric assessments indicate that establishing, promoting and actively practicing processes that safeguard and bolster the integrity of the editing and publication process also help to improve the academic influence of academic journals, which itself is the cornerstone for improving JIF.
Collapse
Affiliation(s)
- Jin-Lei Wang
- Baishideng Publishing Group Inc, Pleasanton, CA 94566, United States
| | - Xiang Li
- Baishideng Publishing Group Inc, Pleasanton, CA 94566, United States
| | - Jia-Ru Fan
- Baishideng Publishing Group Inc, Pleasanton, CA 94566, United States
| | - Jia-Ping Yan
- Baishideng Publishing Group Inc, Pleasanton, CA 94566, United States
| | - Ze-Mao Gong
- Baishideng Publishing Group Inc, Pleasanton, CA 94566, United States
| | - Yue Zhao
- Baishideng Publishing Group Inc, Pleasanton, CA 94566, United States
| | - Dong-Mei Wang
- Baishideng Publishing Group Inc, Pleasanton, CA 94566, United States
| | - Li Ma
- Baishideng Publishing Group Inc, Pleasanton, CA 94566, United States
| | - Na Ma
- Baishideng Publishing Group Inc, Pleasanton, CA 94566, United States
| | - Diao-Mei Guo
- Baishideng Publishing Group Inc, Pleasanton, CA 94566, United States
| | - Lian-Sheng Ma
- Baishideng Publishing Group Inc, Pleasanton, CA 94566, United States
| |
Collapse
|
|
9
|
Shlobin NA, Punchak MA, Boyke AE, Beestrum M, Gutzman K, Rosseau G. Language and Geographic Representation of Neurosurgical Journals: A Meta-Science Study. World Neurosurg 2022; 166:171-183. [PMID: 35953039 DOI: 10.1016/j.wneu.2022.08.006] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Revised: 07/31/2022] [Accepted: 08/01/2022] [Indexed: 12/15/2022]
Abstract
OBJECTIVE Medical journals have a role in promoting representation of neurosurgeons who speak primary languages other than English. We sought to characterize the language of publication and geographic origin of neurosurgical journals, delineate associations between impact factor (IF) and language and geographic variables, and describe steps to overcome language barriers to publishing. METHODS Web of Science, Scopus, and Ulrich's Serial Analysis system were searched for neurosurgery journals. The journals were screened for relevance. Language of publication, country and World Health Organization region, World Bank income status and gross domestic product, and citation metrics were extracted. RESULTS Of 867 journals, 74 neurosurgical journals were included. Common publication languages were English (52, 70.3%), Mandarin (5, 6.8%), and Spanish (4, 5.4%). Countries of publication for the greatest number of journals were the United States (23, 31.1%), United Kingdom (8, 10.8%), and China (6, 8.1%). Most journals originated from the Americas region (29, 39.2%), the European region (28, 37.8%), and from high-income countries (n = 54, 73.0%). Median IF was 1.55 (interquartile range [IQR] 0.89-2.40). Journals written in English (1.77 [IQR 1.00-2.87], P = 0.032) and from high-income countries (1.81 [IQR 1.0-2.70], P = 0.046) had highest median IF. When excluding outliers, there was a small but positive correlation between per capita gross domestic product and IF (β = 0.021, P = 0.03, R2 = 0.097). CONCLUSIONS Language concordance represents a substantial barrier to research equity in neurosurgery, limiting dissemination of ideas of merit that currently have inadequate outlets for readership. Initiatives aimed at increasing the accessibility of neurosurgical publishing to underrepresented authors are essential.
Collapse
Affiliation(s)
- Nathan A Shlobin
- Department of Neurological Surgery, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA.
| | - Maria A Punchak
- Department of Neurosurgery, University of Pennsylvania Health System, Philadelphia, Pennsylvania, USA
| | - Andre E Boyke
- Department of Neurosurgery, Mount Sinai Icahn School of Medicine, New York, New York, USA
| | - Molly Beestrum
- Galter Health Sciences Library, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Karen Gutzman
- Galter Health Sciences Library, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Gail Rosseau
- Department of Neurological Surgery, George Washington University School of Medicine and Health Sciences, Washington, District of Columbia, USA
| |
Collapse
|
|
10
|
Torres-Salinas D, Valderrama-Baca P, Arroyo-Machado W. Is there a need for a new journal metric? Correlations between JCR Impact Factor metrics and the Journal Citation Indicator—JCI. J Informetr 2022. [DOI: 10.1016/j.joi.2022.101315] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
|
11
|
Serafy JE. Tilting at twin windmills: On article quotas and journal impact factors. RESEARCH EVALUATION 2022. [DOI: 10.1093/reseval/rvac024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Affiliation(s)
- Joseph E Serafy
- Southeast Fisheries Science Center, National Marine Fisheries Service, NOAA , 75 Virginia Beach Drive , Miami, FL 33149, USA
| |
Collapse
|
|
12
|
Battiston P, Sacco PL, Stanca L. Cover effects on citations uncovered: Evidence from Nature. J Informetr 2022. [DOI: 10.1016/j.joi.2022.101293] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
|
13
|
Fischman G, Amrein-Beardsley A, McBride-Schreiner S. Education research is still the hardest science: a proposal for improving its trustworthiness and usability. F1000Res 2022; 11:230. [PMID: 35919100 PMCID: PMC9294496 DOI: 10.12688/f1000research.109700.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 02/21/2022] [Indexed: 11/20/2022] Open
Abstract
In this essay, we argue that colleges of education, particularly those at research-intensive institutions, favor simplistic notions of scholarly impact and that this trend has concerning implications for the field, for researchers, and for the public at large. After describing the challenges and shortcomings of the current models of research assessment in education, we outline an alternative proposal in which trustworthiness and usability of research would complement traditional metrics of scholarly relevance. This proposal encourages a twofold approach to research assessment that involves (1) a more thorough analysis of the limitations and problems generated by the use of simplistic notions of scholarly impact, and (2) a commitment to the implementation of more equitable systems based on a broader range of assessment measures to assess faculty research contributions.
Collapse
Affiliation(s)
- Gustavo Fischman
- Mary Lou Fulton Teachers College, Arizona State University, Tempe, AZ, 85287-1611, USA
| | | | | |
Collapse
|
|
14
|
O'Shaughnessy SM, Lee JY, Rong LQ, Rahouma M, Wright DN, Demetres M, Kachulis B. Quality of recent clinical practice guidelines in anaesthesia publications using the Appraisal of Guidelines for Research and Evaluation II instrument. Br J Anaesth 2022; 128:655-663. [PMID: 35090727 PMCID: PMC9074794 DOI: 10.1016/j.bja.2021.11.037] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Revised: 10/26/2021] [Accepted: 11/10/2021] [Indexed: 12/15/2022] Open
Abstract
Clinical practice guidelines are a valuable resource aiding medical decision-making based on scientific evidence. In anaesthesia, guidelines are increasing in both number and scope, influencing individual practice and shaping local departmental policy. The aim of this review is to assess the quality of clinical practice guidelines published in high impact anaesthesia journals over the past 5 yr using the internationally validated Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument. A literature search was conducted in Scopus to identify all guidelines published in the top 10 anaesthesia journals as per Clarivate Analytics Impact Factor from 2016 and 2020. Fifty-one guidelines were included for analysis by five independent appraisers using AGREE II. Each guideline was assessed across six domains and 23 items. Individual domain scores were calculated with a threshold agreed via consensus to represent high-quality guidelines. There was a significant increase in overall score over time (P=0.041), driven by Domain 3 (Rigour of Development, P=0.046). The raw overall score for Domain 3, however, was low. The other domains performed as expected based on previous studies, with Domains 1, 4, and 6 achieving high scores and Domains 2 and 5 incurring poor ratings. Most guidelines studied involved international collaboration but emerged from a single professional society. Use of an appraisal tool was stated as high but poorly detailed. The improvement in the overall score of guidelines and rigour of development is promising; however, only seven guidelines met high-quality criteria, suggesting room for improvement for the overall integrity of guidelines in anaesthesia.
Collapse
|
|
15
|
Jung HW, Lim WS, Cesari M, Auyeung TW, Kojima T, Ga H, Cameron ID, Lim JY. Challenges and Opportunities for Academic Journals to Serve the Older Population in Western Pacific Region. Ann Geriatr Med Res 2021; 25:231-236. [PMID: 34818700 PMCID: PMC8749032 DOI: 10.4235/agmr.21.0129] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2021] [Accepted: 11/21/2021] [Indexed: 02/04/2023] Open
Abstract
Annals of Geriatric Medicine and Research held its inaugural international editorial board virtual meeting on September 16, 2021, to brainstorm ideas for sustainable growth. This special article summarizes the key concepts obtained from the webinar proceedings, with further development of ideas from ensuing discussions occurring after the meeting. From the initial discussion points provided by eight editorial board members, including six presenters, email discussions further enriched these ideas to construct the current special article. The key points discussed were: impactful research and impact factors, international and Asian perspectives, and challenges to sustainable growth. The editors noted the existing gap between the impact factor and research impact as a challenge for the growth paths of regional journals. However, they agreed that persevering with impactful research would ultimately translate into parallel and gradual gains in impact, which is, therefore, consistent with the organic growth of the journal. Acknowledging challenges in navigating between unique Asian perspectives and international outlooks, the editors encouraged academic journals to serve as bridges linking international evidence with the richness of local perspectives. For sustainable growth, the editors suggested that journals may be forged into the academic ecosystems of the region, diversify value streams, and establish themselves as reputable brands in disciplines. By combining these discussions, we proposed the “IMPACT” strategy for journals on the growth path in the region, which stands for IMmersive user experience encompassing authors, reviewers, and readers; Pasteur’s quadrant use-inspired research; Asia-Pacific context; Collaborative; and Translation to practice and policy.
Collapse
Affiliation(s)
- Hee-Won Jung
- Division of Geriatrics, Department of Internal Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea
| | - Wee Shiong Lim
- Department of Geriatric Medicine, Institute of Geriatrics and Active Ageing, Tan Tock Seng Hospital, Singapore
| | - Matteo Cesari
- Geriatric Unit, IRCCS Istituti Clinici Maugeri, University of Milan, Milan, Italy
| | - Tung Wai Auyeung
- Jockey Club Institute of Ageing, The Chinese University of Hong Kong, Hong Kong
| | - Taro Kojima
- Department of Geriatric Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Hyuk Ga
- Institute of Geriatric Medicine, Incheon Eun-Hye Hospital, Incheon, Korea
| | - Ian D Cameron
- John Walsh Centre for Rehabilitation Research, Northern Sydney Local Health District and University of Sydney, Kolling Institute, St Leonards, Australia
| | - Jae-Young Lim
- Department of Rehabilitation Medicine, Seoul National University Bundang Hospital, Seongnam, Seoul National University College of Medicine, Seongnam, Korea.,Institute on Aging, Seoul National University, Seoul, Korea
| |
Collapse
|
|
16
|
Krivicich LM, VanHorn T, Gowd A, Beck EC, Paul K, O'Gara TJ. Predictors of Above Average 6-Year Citation Rates in Leading Spine-Specific Medical Journals. Spine (Phila Pa 1976) 2021; 46:1172-1179. [PMID: 34384094 DOI: 10.1097/brs.0000000000003983] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
STUDY DESIGN Cross-sectional. OBJECTIVE To identify predictors of manuscripts achieving 6-year citation rates higher than the mean in spine-specific literature. SUMMARY OF BACKGROUND DATA An article's citation rate demonstrates its contribution to academia and its quality. Predictors of citation rates have not yet been studied in spine-specific medical literature. METHODS Three leading spine-specific journals were identified by a weighted scoring system comparing various journal metrics. Research articles published in 2014 were evaluated from the following journals: Spine, European Spine Journal, and Journal of Neurosurgery: Spine. Article features analyzed included journal of origin, number of words in article title, author count, degree of first author, conflicts of interest, quantity of contributing academic institutions, country of origin, study topic, study design, level of evidence, sample size, reference count, and citation rate. Multivariate logistic regression was used to determine predictors of above average citation rate at 6 years following publication. RESULTS The final analysis included 1091 articles. Spine had a significantly higher citation rate than European Spine Journal (P = 0.0008); however, no significant differences were observed between Spine and Journal of Neurosurgery: Spine. Regression analysis demonstrated that studies originating in North America (OR:1.44, 95% CI:1.01-2.01, P = 0.04), those with 6 ≥ authors (OR:1.72, 95% CI:1.29-2.30, P < 0.001), sample size >100 (P < 0.001), prospective case series (OR: 2.67, 95% CI: 1.24-5.76), and retrospective case series (OR: 1.99, 95% CI: 1.07-3.73) were independent predictors of achieving above average 6-year citation rates. CONCLUSION Spine, European Spine Journal, and Journal of Neurosurgery: Spine had the highest 6-year citation rates of the top 10 orthopedic spine journals, with Spine being significantly higher than European Spine Journal. Studies originating in North America, those with six or more authors, sample sizes > 100, and those that are retrospective or prospective case series are independent predictors of greater citation rates at 6 years in orthopedic spine-specific medical literature.Level of Evidence: 4.
Collapse
Affiliation(s)
| | - Trent VanHorn
- Department of Orthopaedics, Wake Forest School of Medicine, Winston-Salem, NC
| | - Anirudh Gowd
- Department of Orthopaedics, Wake Forest School of Medicine, Winston-Salem, NC
| | - Edward C Beck
- Department of Orthopaedics, Wake Forest School of Medicine, Winston-Salem, NC
| | - Katlynn Paul
- Midwest Orthopaedics at Rush University, Chicago, IL
| | - Tadhg J O'Gara
- Department of Orthopaedics, Wake Forest School of Medicine, Winston-Salem, NC
| |
Collapse
|
|
17
|
Asase A, Mzumara‐Gawa TI, Owino JO, Peterson AT, Saupe E. Replacing “parachute science” with “global science” in ecology and conservation biology. CONSERVATION SCIENCE AND PRACTICE 2021. [DOI: 10.1111/csp2.517] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022] Open
Affiliation(s)
- Alex Asase
- Department of Plant and Environmental Biology University of Ghana Accra Ghana
| | | | - Jesse O. Owino
- Rift Valley Eco‐Region Research Program Kenya Forestry Research Institute Londiani Kenya
| | | | - Erin Saupe
- Department of Earth Sciences University of Oxford Oxford UK
| |
Collapse
|
|
18
|
Teixeira da Silva JA, Dunleavy DJ, Moradzadeh M, Eykens J. A credit-like rating system to determine the legitimacy of scientific journals and publishers. Scientometrics 2021; 126:8589-8616. [PMID: 34421155 PMCID: PMC8370857 DOI: 10.1007/s11192-021-04118-3] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2021] [Accepted: 07/26/2021] [Indexed: 11/03/2022]
Abstract
The predatory nature of a journal is in constant debate because it depends on multiple factors, which keep evolving. The classification of a journal as being predatory, or not, is no longer exclusively associated with its open access status, by inclusion or exclusion on perceived reputable academic indexes and/or on whitelists or blacklists. Inclusion in the latter may itself be determined by a host of criteria, may be riddled with type I errors (e.g., erroneous inclusion of a truly predatory journal in a whitelist) and/or type II errors (e.g., erroneous exclusion of a truly valid scholarly journal in a whitelist). While extreme cases of predatory publishing behavior may be clear cut, with true predatory journals displaying ample predatory properties, journals in non-binary grey zones of predatory criteria are difficult to classify. They may have some legitimate properties, but also some illegitimate ones. In such cases, it might be too extreme to refer to such entities as "predatory". Simply referring to them as "potentially predatory" or "borderline predatory" also does little justice to discern a predatory entity from an unscholarly, low-quality, unprofessional, or exploitative one. Faced with the limitations caused by this gradient of predatory dimensionality, this paper introduces a novel credit-like rating system, based in part on well-known financial credit ratings companies used to assess investment risk and creditworthiness, to assess journal or publisher quality. Cognizant of the weaknesses and criticisms of these rating systems, we suggest their use as a new way to view the scholarly nature of a journal or publisher. When used as a tool to supplement, replace, or reinforce current sets of criteria used for whitelists and blacklists, this system may provide a fresh perspective to gain a better understanding of predatory publishing behavior. Our tool does not propose to offer a definitive solution to this problem.
Collapse
Affiliation(s)
| | - Daniel J. Dunleavy
- Center for Translational Behavioral Science, College of Medicine, Florida State University, 2010 Levy Ave Building B, Tallahassee, FL 32310 USA
| | - Mina Moradzadeh
- Department of Medical Library and Information Science, School of Health Management and Information Sciences, Iran University of Medical Sciences, Tehran, Iran
- Health Services Management Research Center, Institute for Futures Studies in Health, Kerman University of Medical Sciences, Kerman, Iran
| | - Joshua Eykens
- Centre for R&D Monitoring (ECOOM), Faculty of Social Sciences, University of Antwerp, Antwerp, Belgium
| |
Collapse
|
|
19
|
Expected Scopes of Health Emergency and Disaster Risk Management (Health EDRM): Report on the Expert Workshop at the Annual Conference for the Japanese Association for Disaster Medicine 2020. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:ijerph18094447. [PMID: 33922145 PMCID: PMC8122730 DOI: 10.3390/ijerph18094447] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Revised: 04/15/2021] [Accepted: 04/16/2021] [Indexed: 11/16/2022]
Abstract
The World Health Organization (WHO) and its partners established the WHO Thematic Platform for Health Emergency and Disaster Risk Management Research Network (HEALTH EDRM RN) in 2016 to respond to the increasing burden of recent health emergencies and disasters. The mission of the HEALTH EDRM RN, whose secretariat is located at the WHO Kobe Centre (WKC), is to promote global research collaboration and strengthen research activities to inform policies and programs by generating new evidence to manage health risks associated with all types of emergencies and disasters. With the strong support and involvement of all WHO regional offices, the HEALTH EDRM RN now works with more than 200 global experts and partners to pursue its mission. The first Core Group Meetings of the HEALTH EDRM RN were held on 17-18 October 2019, and concluded with the HEALTH EDRM RN-activity priorities to (1) promote operational research to better meet the needs of emergency- and disaster-exposed individuals and communities and efforts to translate science to policies and programs and (2) strengthen the research capacity of the Health EDRM community. In collaboration with the Japanese Association for Disaster Medicine, the WKC held a workshop on 21 February 2020, in which 20 Japanese experts from different research fields participated to further discuss these two points. This paper summarizes the discussion at the workshop.
Collapse
|
|
20
|
Guo X, Li X, Yu Y. Publication delay adjusted impact factor: The effect of publication delay of articles on journal impact factor. J Informetr 2021. [DOI: 10.1016/j.joi.2020.101100] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
|
21
|
Kiesslich T, Beyreis M, Zimmermann G, Traweger A. Citation inequality and the Journal Impact Factor: median, mean, (does it) matter? Scientometrics 2020. [DOI: 10.1007/s11192-020-03812-y] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
AbstractSkewed citation distribution is a major limitation of the Journal Impact Factor (JIF) representing an outlier-sensitive mean citation value per journal The present study focuses primarily on this phenomenon in the medical literature by investigating a total of n = 982 journals from two medical categories of the Journal Citation Report (JCR). In addition, the three highest-ranking journals from each JCR category were included in order to extend the analyses to non-medical journals. For the journals in these cohorts, the citation data (2018) of articles published in 2016 and 2017 classified as citable items (CI) were analysed using various descriptive approaches including e.g. the skewness, the Gini coefficient, and, the percentage of CI contributing 50% or 90% of the journal’s citations. All of these measures clearly indicated an unequal, skewed distribution with highly-cited articles as outliers. The %CI contributing 50% or 90% of the journal’s citations was in agreement with previously published studies with median values of 13–18% CI or 44–60% CI generating 50 or 90% of the journal’s citations, respectively. Replacing the mean citation values (corresponding to the JIF) with the median to represent the central tendency of the citation distributions resulted in markedly lower numerical values ranging from − 30 to − 50%. Up to 39% of journals showed a median citation number of zero in one medical journal category. For the two medical cohorts, median-based journal ranking was similar to mean-based ranking although the number of possible rank positions was reduced to 13. Correlation of mean citations with the measures of citation inequality indicated that the unequal distribution of citations per journal is more prominent and, thus, relevant for journals with lower citation rates. By using various indicators in parallel and the hitherto probably largest journal sample, the present study provides comprehensive up-to-date results on the prevalence, extent and consequences of citation inequality across medical and all-category journals listed in the JCR.
Collapse
|
|
22
|
Reategui E, Pires A, Carniato M, Franco SRK. Evaluation of Brazilian research output in education: confronting international and national contexts. Scientometrics 2020. [DOI: 10.1007/s11192-020-03617-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
|
23
|
Moutsopoulos HΜ, Chrousos GP. The "Distinguished" Physician-Scientist: Is a single bibliometric index sufficient for distinction? Clin Immunol 2020; 219:108546. [PMID: 32730866 DOI: 10.1016/j.clim.2020.108546] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2020] [Accepted: 07/21/2020] [Indexed: 11/25/2022]
Affiliation(s)
- Haralampos Μ Moutsopoulos
- Medical School, National and Kapodistrian University of Athens, Athens, Greece; Member, Academy of Athens, Greece
| | - George P Chrousos
- Medical School, National and Kapodistrian University of Athens, Athens, Greece; Member, US National Academy of Medicine, USA.
| |
Collapse
|
|
24
|
Fan PF, Yang L, Liu Y, Lee TM. Build up conservation research capacity in China for biodiversity governance. Nat Ecol Evol 2020; 4:1162-1167. [PMID: 32690907 DOI: 10.1038/s41559-020-1253-z] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2019] [Accepted: 06/23/2020] [Indexed: 11/09/2022]
Abstract
To achieve the grand vision of 'Ecological Civilization' and to build a more sustainable Belt and Road Initiative, China's conservation policies must be underpinned by research. However, recent institutional and vertebrate conservation scientists' publication data suggest that China has a growing conservation research capacity deficit. China lacks a pipeline for the training and development of conservation scientists locally and abroad. The network of active conservation scientists is rapidly shrinking and institutions are exhibiting signs of academic inbreeding. Career advancement policies are perversely incentivized away from practical conservation research, thereby constraining capacity building. Comparative data indicate that China severely lags behind the United States and United Kingdom in research quality and capacity. We outline possible recommendations that include developing a different performance evaluation system, promoting training and international exchanges, encouraging interdisciplinary collaboration, and fostering international collaborative networks for China-based conservation scientists. For global biodiversity governance, China must act to make up for considerable shortfalls in conservation research capacity and research collaborative networks.
Collapse
Affiliation(s)
- Peng-Fei Fan
- School of Life Sciences, Sun Yat-sen University, Guangzhou, China. .,School of Ecology, Sun Yat-sen University, Shenzhen, China.
| | - Li Yang
- School of Life Sciences, Sun Yat-sen University, Guangzhou, China.
| | - Yang Liu
- School of Ecology, Sun Yat-sen University, Shenzhen, China. .,State Key Laboratory of Biological Control, Sun Yat-sen University, Guangzhou, China.
| | - Tien Ming Lee
- School of Life Sciences, Sun Yat-sen University, Guangzhou, China. .,School of Ecology, Sun Yat-sen University, Shenzhen, China. .,State Key Laboratory of Biological Control, Sun Yat-sen University, Guangzhou, China.
| |
Collapse
|
|
25
|
Academia Europaea Position Paper on Translational Medicine: The Cycle Model for Translating Scientific Results into Community Benefits. J Clin Med 2020; 9:jcm9051532. [PMID: 32438747 PMCID: PMC7290380 DOI: 10.3390/jcm9051532] [Citation(s) in RCA: 93] [Impact Index Per Article: 18.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2020] [Revised: 05/14/2020] [Accepted: 05/15/2020] [Indexed: 01/07/2023] Open
Abstract
Introduction: Translational science has gained prominence in medicine, but there is still much work to be done before scientific results are used optimally and incorporated into everyday health practice. As the main focus is still on generating new scientific data with financial resources primarily available for that purpose, other activities that are necessary in the transition from research to community benefit are considered less needy. The European Statistical Office of the European Commission has recently reported that 1.7 million people under 75 years of age died in Europe in 2016, with around 1.2 million of those deaths being avoidable through effective primary prevention and public health intervention. Therefore, Academia Europaea, one of the five Pan-European networks that form SAPEA (Science Advice for Policy by European Academies), a key element of the European Commission’s Scientific Advice Mechanism (SAM), has launched a project to develop a model to facilitate and accelerate the utilisation of scientific knowledge for public and community benefit. Methods: During the process, leaders in the field, including prominent basic and clinical researchers, editors-in-chief of high-impact journals publishing translational research articles, translational medicine (TM) centre leaders, media representatives, academics and university leaders, developed the TM cycle, a new model that we believe could significantly advance the development of TM. Results: This model focuses equally on the acquisition of new scientific results healthcare, understandable and digestible summation of results, and their communication to all participants. We have also renewed the definition in TM, identified challenges and recommended solutions. Conclusion: The authors, including senior officers of Academia Europaea, produced this document to serve as a basis for revising thinking on TM with the end result of enabling more efficient and cost-effective healthcare.
Collapse
|
|
26
|
Cotton M. Extending a hand of greeting to Latin America. Trop Doct 2020; 50:1-2. [DOI: 10.1177/0049475519895333] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
|
27
|
Chapman CA, Bicca-Marques JC, Calvignac-Spencer S, Fan P, Fashing PJ, Gogarten J, Guo S, Hemingway CA, Leendertz F, Li B, Matsuda I, Hou R, Serio-Silva JC, Chr Stenseth N. Games academics play and their consequences: how authorship, h-index and journal impact factors are shaping the future of academia. Proc Biol Sci 2019; 286:20192047. [PMID: 31797732 PMCID: PMC6939250 DOI: 10.1098/rspb.2019.2047] [Citation(s) in RCA: 37] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Research is a highly competitive profession where evaluation plays a central role; journals are ranked and individuals are evaluated based on their publication number, the number of times they are cited and their h-index. Yet such evaluations are often done in inappropriate ways that are damaging to individual careers, particularly for young scholars, and to the profession. Furthermore, as with all indices, people can play games to better their scores. This has resulted in the incentive structure of science increasingly mimicking economic principles, but rather than a monetary gain, the incentive is a higher score. To ensure a diversity of cultural perspectives and individual experiences, we gathered a team of academics in the fields of ecology and evolution from around the world and at different career stages. We first examine how authorship, h-index of individuals and journal impact factors are being used and abused. Second, we speculate on the consequences of the continued use of these metrics with the hope of sparking discussions that will help our fields move in a positive direction. We would like to see changes in the incentive systems, rewarding quality research and guaranteeing transparency. Senior faculty should establish the ethical standards, mentoring practices and institutional evaluation criteria to create the needed changes.
Collapse
Affiliation(s)
- Colin A Chapman
- Department of Anthropology, Center for the Advanced Study of Human Paleobiology, The George Washington University, Washington, DC 20037, USA.,Department of Anthropology, McGill University, Montreal, Quebec, Canada H3A 2A7.,School of Life Sciences, University of KwaZulu-Natal, Scottsville, Pietermaritzburg, South Africa.,Shaanxi Key Laboratory for Animal Conservation, Northwest University, Xi'an, People's Republic of China
| | - Júlio César Bicca-Marques
- Escola de Ciências, Pontifícia Universidade Católica do Rio Grande do Sul, Porto Alegre, Rio Grande do Sul, Brazil
| | | | - Pengfei Fan
- School of Life Sciences, Sun Yat-Sen University, Guangzhou, 510275 Guangdong, People's Republic of China
| | - Peter J Fashing
- Department of Anthropology and Environmental Studies Program, California State University Fullerton, Fullerton, CA 92834, USA.,Centre for Ecological and Evolutionary Synthesis (CEES), Department of Biosciences, University of Oslo, P.O. Box 1066, Blindern, 0316 Oslo, Norway
| | - Jan Gogarten
- Viral Evolution, Robert Koch Institute, Seestraße 10, 13353 Berlin, Germany.,Epidemiology of Highly Pathogenic Microorganisms, Robert Koch Institute, Seestraße 10, 13353 Berlin, Germany
| | - Songtao Guo
- Shaanxi Key Laboratory for Animal Conservation, Northwest University, Xi'an, People's Republic of China
| | - Claire A Hemingway
- Office of International Science and Engineering at National Science Foundation, Virginia, USA
| | - Fabian Leendertz
- Epidemiology of Highly Pathogenic Microorganisms, Robert Koch Institute, Seestraße 10, 13353 Berlin, Germany
| | - Baoguo Li
- Shaanxi Key Laboratory for Animal Conservation, Northwest University, Xi'an, People's Republic of China
| | - Ikki Matsuda
- Chubu University Academy of Emerging Sciences, 1200 Matsumoto-cho, Kasugai-shi, Aichi 487-8501, Japan
| | - Rong Hou
- Department of Anthropology, McGill University, Montreal, Quebec, Canada H3A 2A7.,Shaanxi Key Laboratory for Animal Conservation, Northwest University, Xi'an, People's Republic of China
| | | | - Nils Chr Stenseth
- Centre for Ecological and Evolutionary Synthesis (CEES), Department of Biosciences, University of Oslo, P.O. Box 1066, Blindern, 0316 Oslo, Norway
| |
Collapse
|
|
28
|
Size matters! Association between journal size and longitudinal variability of the Journal Impact Factor. PLoS One 2019; 14:e0225360. [PMID: 31756241 PMCID: PMC6874322 DOI: 10.1371/journal.pone.0225360] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2019] [Accepted: 11/02/2019] [Indexed: 01/08/2023] Open
Abstract
Analyses of the Journal Impact Factor (JIF) have grown to be a major topic in scientometric literature. Despite widespread and justified critique concerning the JIF and its application, the size of a journal as a predictor for its longitudinal variability–or stability–on a long-term level has not yet comprehensively been analyzed. This study aims to provide robust evidence for an association between JIF variability and the size of journals, expressed by the number of published articles (citable items). For this purpose, the complete set of journals included in the Incite Journal Citation Reports (JCR) with an JIF in the 2017 JCR edition (n = 8750) were analyzed for the association between journal size and longitudinal JIF dynamics. Our results, based on n = 4792 journals with a complete JIF data set over the timespan of 12 annual JIF changes show that larger journals publishing more citable items experience smaller annual changes of the JIF than smaller journals, yet with this association being reversed for journals with a very large number of total cites. Consequently and in accordance with the genuine intention of the JIF to serve as a basis for decisions on journal subscriptions, evaluation of current changes of the JIF have to be accompanied by consideration of the journal’s size in order to be accurate and sensible.
Collapse
|
|
29
|
Yeung AWK. Interdisciplinary and international citations have contributed to the rise of outstanding dental journals. J Prosthodont Res 2019; 63:383-386. [DOI: 10.1016/j.jpor.2019.03.004] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2019] [Revised: 03/05/2019] [Accepted: 03/15/2019] [Indexed: 11/26/2022]
|
|
30
|
Martelli DR, Oliveira MCL, Pinheiro SV, Santos ML, Dias V, Silva ACSE, Martelli-Júnior H, Oliveira EA. Profile and scientific output of researchers recipients of CNPq productivity grant in the field of medicine. ACTA ACUST UNITED AC 2019; 65:682-690. [PMID: 31166446 DOI: 10.1590/1806-9282.65.5.682] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2018] [Accepted: 10/02/2018] [Indexed: 11/21/2022]
Abstract
BACKGROUND. This study aimed to evaluate the scientific production of researchers in the field of Medicine who receive a productivity grant from the CNPq. METHODS The curriculum Lattes of 542 researchers with active grants from 2012 to 2014 were included in the analysis. Grants categories/levels were stratified into three groups according to the CNPq database (1A-B, 1C-D, and 2). RESULTS. There was a predominance of grants in category 2. During their academic career, Medicine researchers published 76512 articles, with a median of 119 articles per researcher (IQ, interquartile range, 77 to 174). Among the 76512 articles, 36584 (47.8%) were indexed in the Web of Science (WoS database). Researchers in Medicine were cited 643159 times in the WoS database, with a median of 754 citations (IQ, 356 to 1447). There were significant differences among the categories of grants concerning the number of citations in WoS (P <0.001). There was a significant difference in the number of times researchers were cited according to the specialty included in Medicine area. (P < 0.001). CONCLUSION. Strategies to improve the scientific output qualitatively possibly can be enhanced by the knowledge of the profile of researchers in the field of Medicine.
Collapse
Affiliation(s)
- Daniella Reis Martelli
- Health Science/Primary Care Postgraduate Program, State University of Montes Claros (Unimontes), Campus Universitário Professor Darcy Ribeiro, Montes Claros, MG, Brasil
| | - Maria Christina Lopes Oliveira
- Departament of Pediatrics, School of Medicine, Federal University of Minas Gerais (UFMG), Avenida Professor Alfredo Balena 190; Belo Horizonte, MG, Brasil
| | - Sergio Veloso Pinheiro
- Departament of Pediatrics, School of Medicine, Federal University of Minas Gerais (UFMG), Avenida Professor Alfredo Balena 190; Belo Horizonte, MG, Brasil
| | - Maria Luiza Santos
- Health Science/Primary Care Postgraduate Program, State University of Montes Claros (Unimontes), Campus Universitário Professor Darcy Ribeiro, Montes Claros, MG, Brasil
| | - Veronica Dias
- Health Science/Primary Care Postgraduate Program, State University of Montes Claros (Unimontes), Campus Universitário Professor Darcy Ribeiro, Montes Claros, MG, Brasil
| | - Ana Cristina Simões E Silva
- Departament of Pediatrics, School of Medicine, Federal University of Minas Gerais (UFMG), Avenida Professor Alfredo Balena 190; Belo Horizonte, MG, Brasil
| | - Hercílio Martelli-Júnior
- Health Science/Primary Care Postgraduate Program, State University of Montes Claros (Unimontes), Campus Universitário Professor Darcy Ribeiro, Montes Claros, MG, Brasil
| | - Eduardo Araujo Oliveira
- Departament of Pediatrics, School of Medicine, Federal University of Minas Gerais (UFMG), Avenida Professor Alfredo Balena 190; Belo Horizonte, MG, Brasil
| |
Collapse
|
|
31
|
Alperin JP, Muñoz Nieves C, Schimanski LA, Fischman GE, Niles MT, McKiernan EC. How significant are the public dimensions of faculty work in review, promotion and tenure documents? eLife 2019; 8:42254. [PMID: 30747708 PMCID: PMC6391063 DOI: 10.7554/elife.42254] [Citation(s) in RCA: 55] [Impact Index Per Article: 9.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2018] [Accepted: 02/11/2019] [Indexed: 02/02/2023] Open
Abstract
Much of the work done by faculty at both public and private universities has significant public dimensions: it is often paid for by public funds; it is often aimed at serving the public good; and it is often subject to public evaluation. To understand how the public dimensions of faculty work are valued, we analyzed review, promotion, and tenure documents from a representative sample of 129 universities in the US and Canada. Terms and concepts related to public and community are mentioned in a large portion of documents, but mostly in ways that relate to service, which is an undervalued aspect of academic careers. Moreover, the documents make significant mention of traditional research outputs and citation-based metrics: however, such outputs and metrics reward faculty work targeted to academics, and often disregard the public dimensions. Institutions that seek to embody their public mission could therefore work towards changing how faculty work is assessed and incentivized.
Collapse
Affiliation(s)
- Juan P Alperin
- School of Publishing, Simon Fraser University, Vancouver, Canada.,Scholarly Communications Lab, Simon Fraser University, Vancouver, Canada
| | - Carol Muñoz Nieves
- Scholarly Communications Lab, Simon Fraser University, Vancouver, Canada
| | | | - Gustavo E Fischman
- Mary Lou Fulton Teachers College, Arizona State University, Tempe, United States
| | - Meredith T Niles
- Department of Nutrition and Food Sciences & Food Systems Program, University of Vermont, Burlington, United States
| | - Erin C McKiernan
- Departamento de Física, Universidad Nacional Autónoma de México, Mexico City, Mexico
| |
Collapse
|
|
32
|
Alperin JP, Muñoz Nieves C, Schimanski LA, Fischman GE, Niles MT, McKiernan EC. How significant are the public dimensions of faculty work in review, promotion and tenure documents? eLife 2019; 8:42254. [PMID: 30747708 DOI: 10.7554/elife.42254.001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2018] [Accepted: 02/11/2019] [Indexed: 05/28/2023] Open
Abstract
Much of the work done by faculty at both public and private universities has significant public dimensions: it is often paid for by public funds; it is often aimed at serving the public good; and it is often subject to public evaluation. To understand how the public dimensions of faculty work are valued, we analyzed review, promotion, and tenure documents from a representative sample of 129 universities in the US and Canada. Terms and concepts related to public and community are mentioned in a large portion of documents, but mostly in ways that relate to service, which is an undervalued aspect of academic careers. Moreover, the documents make significant mention of traditional research outputs and citation-based metrics: however, such outputs and metrics reward faculty work targeted to academics, and often disregard the public dimensions. Institutions that seek to embody their public mission could therefore work towards changing how faculty work is assessed and incentivized.
Collapse
Affiliation(s)
- Juan P Alperin
- School of Publishing, Simon Fraser University, Vancouver, Canada
- Scholarly Communications Lab, Simon Fraser University, Vancouver, Canada
| | - Carol Muñoz Nieves
- Scholarly Communications Lab, Simon Fraser University, Vancouver, Canada
| | | | - Gustavo E Fischman
- Mary Lou Fulton Teachers College, Arizona State University, Tempe, United States
| | - Meredith T Niles
- Department of Nutrition and Food Sciences & Food Systems Program, University of Vermont, Burlington, United States
| | - Erin C McKiernan
- Departamento de Física, Universidad Nacional Autónoma de México, Mexico City, Mexico
| |
Collapse
|
|
33
|
Recent developments in scholarly publishing to improve research practices in the life sciences. Emerg Top Life Sci 2018; 2:775-778. [PMID: 33530668 PMCID: PMC7289060 DOI: 10.1042/etls20180172] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2018] [Revised: 11/28/2018] [Accepted: 11/29/2018] [Indexed: 11/17/2022]
Abstract
We outline recent developments in scholarly publishing that we think will improve the working environment and career prospects for life scientists. Most prominently, we discuss two key developments. (1) Life scientists are now embracing a preprint culture leading to rapid dissemination of research findings. (2) We outline steps to overcome the reproducibility crisis. We also briefly describe other innovations in scholarly publishing, along with changes to open access mandates from funding agencies.
Collapse
|
|
34
|
Abstract
The use of the journal impact factor (JIF) as a measure for the quality of individual manuscripts and the merits of scientists has faced significant criticism in recent years. We add to the current criticism in arguing that such an application of the JIF in policy and decision making in academia is based on false beliefs and unwarranted inferences. To approach the problem, we use principles of deductive and inductive reasoning to illustrate the fallacies that are inherent to using journal-based metrics for evaluating the work of scientists. In doing so, we elaborate that if we judge scientific quality based on the JIF or other journal-based metrics we are either guided by invalid or weak arguments or in fact consider our uncertainty about the quality of the work and not the quality itself.
Collapse
Affiliation(s)
- Frieder M Paulus
- Department of Psychiatry and Psychotherapy, Social Neuroscience Lab, University of Lübeck, Lübeck, Germany
| | - Nicole Cruz
- Department of Psychological Sciences, Birkbeck, University of London, London, United Kingdom.,Laboratoire CHArt, École Pratique des Hautes Études, Paris, France
| | - Sören Krach
- Department of Psychiatry and Psychotherapy, Social Neuroscience Lab, University of Lübeck, Lübeck, Germany
| |
Collapse
|
|
35
|
Affiliation(s)
- D K Meyerholz
- 1 Department of Pathology, Roy J. and Lucille A. Carver College of Medicine, Iowa City, IA, USA
| | - H A Flaherty
- 2 Department of Veterinary Pathology, Iowa State University, Ames, IA, USA
| |
Collapse
|
|
36
|
Qu Y, Zhang C, Hu Z, Li S, Kong C, Ning Y, Shang Y, Bai C. The 100 most influential publications in asthma from 1960 to 2017: A bibliometric analysis. Respir Med 2018; 137:206-212. [PMID: 29605206 DOI: 10.1016/j.rmed.2018.03.014] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/20/2018] [Revised: 02/28/2018] [Accepted: 03/12/2018] [Indexed: 01/01/2023]
Abstract
BACKGROUND The area of asthma medicine has produced a large volume of important clinical and scientific papers that can be found in those most influential journals. The purpose of our study was to identify the 100 most cited papers in asthma research and to analyze their characteristics. METHODS We used the Institute for Scientific Information Web of Knowledge Database to identify the most frequently cited articles published from 1960 to December 2017. Original articles and reviews were included in the study. The 100 top-cited articles were then analyzed with regard to number of citations, publication year, journals, institution, research type and field, authors and countries of authors of publications. RESULTS The 100 top-cited articles in asthma were published between 1960 and 2011 with a median of 933 citations per article (range, 701-2947). The number of citations per article was greatest for articles published in the 1990s. The United States of America contributed most of the classic articles, followed by England. The leading institutions were Imperial College London, McMaster University, Erasmus University Rotterdam. The 100 top-cited articles were published in twenty-five journals, led by The New England Journal of Medicine (21 articles), followed by American Journal of Respiratory and Critical Care Medicine (19 articles), Lancet (11 articles), respectively. Among the 100 classics, 50% articles were clinical research articles. CONCLUSIONS Our study provides a historical perspective on the progress of research on asthma. Studies conducted in well-developed European countries and North America, published in high-impact journals had the highest citations.
Collapse
Affiliation(s)
- Yulan Qu
- Department of Respiratory and Critical Care Medicine, Changhai Hospital, Second Military Medical University, Shanghai 200433, PR China
| | - Chen Zhang
- Department of Orthopedics, Changhai Hospital, Second Military Medical University, Shanghai 200433, PR China
| | - Zhenli Hu
- Department of Respiratory and Critical Care Medicine, Changhai Hospital, Second Military Medical University, Shanghai 200433, PR China
| | - Sha Li
- Department of Respiratory and Critical Care Medicine, Changhai Hospital, Second Military Medical University, Shanghai 200433, PR China
| | - Chen Kong
- Department of Respiratory and Critical Care Medicine, Changhai Hospital, Second Military Medical University, Shanghai 200433, PR China
| | - Yunye Ning
- Department of Respiratory and Critical Care Medicine, Changhai Hospital, Second Military Medical University, Shanghai 200433, PR China
| | - Yan Shang
- Department of Respiratory and Critical Care Medicine, Changhai Hospital, Second Military Medical University, Shanghai 200433, PR China.
| | - Chong Bai
- Department of Respiratory and Critical Care Medicine, Changhai Hospital, Second Military Medical University, Shanghai 200433, PR China.
| |
Collapse
|
|
37
|
Valderrama P, Escabias M, Jiménez-Contreras E, Rodríguez-Archilla A, Valderrama MJ. Proposal of a stochastic model to determine the bibliometric variables influencing the quality of a journal: application to the field of Dentistry. Scientometrics 2018. [DOI: 10.1007/s11192-018-2707-9] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
|
|
38
|
Li K, Rollins J, Yan E. Web of Science use in published research and review papers 1997-2017: a selective, dynamic, cross-domain, content-based analysis. Scientometrics 2017; 115:1-20. [PMID: 29527070 PMCID: PMC5838136 DOI: 10.1007/s11192-017-2622-5] [Citation(s) in RCA: 172] [Impact Index Per Article: 21.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2017] [Indexed: 11/25/2022]
Abstract
Clarivate Analytics's Web of Science (WoS) is the world's leading scientific citation search and analytical information platform. It is used as both a research tool supporting a broad array of scientific tasks across diverse knowledge domains as well as a dataset for large-scale data-intensive studies. WoS has been used in thousands of published academic studies over the past 20 years. It is also the most enduring commercial legacy of Eugene Garfield. Despite the central position WoS holds in contemporary research, the quantitative impact of WoS has not been previously examined by rigorous scientific studies. To better understand how this key piece of Eugene Garfield's heritage has contributed to science, we investigated the ways in which WoS (and associated products and features) is mentioned in a sample of 19,478 English-language research and review papers published between 1997 and 2017, as indexed in WoS databases. We offered descriptive analyses of the distribution of the papers across countries, institutions and knowledge domains. We also used natural language processingtechniques to identify the verbs and nouns in the abstracts of these papers that are grammatically connected to WoS-related phrases. This is the first study to empirically investigate the documentation of the use of the WoS platform in published academic papers in both scientometric and linguistic terms.
Collapse
Affiliation(s)
- Kai Li
- Drexel University, 30N 33rd St., Philadelphia, PA 19104 USA
| | - Jason Rollins
- Clarivate Analytics, 50 California St., San Francisco, CA 94111 USA
| | - Erjia Yan
- Drexel University, 30N 33rd St., Philadelphia, PA 19104 USA
| |
Collapse
|
|
39
|
Leclerc C, Bourassa B, Macé C. Dérives de la recherche et détresse psychologique chez les universitaires. PERSPECTIVES INTERDISCIPLINAIRES SUR LE TRAVAIL ET LA SANTÉ 2017. [DOI: 10.4000/pistes.5155] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
|
|
40
|
|
|
41
|
Shi D, Rousseau R, Yang L, Li J. A journal's impact factor is influenced by changes in publication delays of citing journals. J Assoc Inf Sci Technol 2016. [DOI: 10.1002/asi.23706] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
- Dongbo Shi
- School of International and Public Affairs; Shanghai Jiao Tong University; Shanghai China
| | - Ronald Rousseau
- University of Antwerp (UA); IBW 2000 Antwerp Belgium
- Department of Mathematics; KU Leuven; Leuven Belgium
| | - Liu Yang
- Department of Information Resource Management; Zhejiang University; Hangzhou China
| | - Jiang Li
- Department of Information Resource Management; Zhejiang University; Hangzhou China
| |
Collapse
|
|
42
|
Frixione E, Ruiz-Zamarripa L, Hernández G. Assessing Individual Intellectual Output in Scientific Research: Mexico's National System for Evaluating Scholars Performance in the Humanities and the Behavioral Sciences. PLoS One 2016; 11:e0155732. [PMID: 27195701 PMCID: PMC4873153 DOI: 10.1371/journal.pone.0155732] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2015] [Accepted: 05/03/2016] [Indexed: 11/19/2022] Open
Abstract
Assessing the research of individual scholars is currently a matter of serious concern and worldwide debate. In order to gauge the long-term efficacy and efficiency of this practice, we carried out a limited survey of the operation and outcome of Mexico’s 30-year old National System of Investigators or SNI, the country’s main instrument for stimulating competitive research in science and technology. A statistical random sample of researchers listed in the area of Humanities and Behavioral Sciences—one of SNI’s first and better consolidated academic divisions comprising a wide range of research disciplines, from philosophy to pedagogy to archaeology to experimental brain research—was screened comparing individual ranks or "Levels of distinction" to actual compliance with the SNI’s own evaluation criteria, as reflected in major public databases of scholarly production. The same analysis was applied to members of a recent Review Committee, integrated by top-level researchers belonging to that general area of knowledge, who have been in charge of assessing and ranking their colleagues. Our results for both sets of scholars show wide disparity of individual productivity within the same SNI Level, according to all key indicators officially required (books issued by prestigious publishers, research articles appeared in indexed journals, and formation of new scientists), as well as in impact estimated by numbers of citations. Statistical calculation from the data indicates that 36% of members in the Review Committee and 53% of researchers in the random sample do not satisfy the official criteria requested for their appointed SNI Levels. The findings are discussed in terms of possible methodological errors in our study, of relevance for the SNI at large in relation to independent appraisals, of the cost-benefit balance of the organization as a research policy tool, and of possible alternatives for its thorough restructuring. As it currently stands SNI is not a model for efficient and effectual national systems of research assessment.
Collapse
Affiliation(s)
- Eugenio Frixione
- Department of Cell Biology, Center for Research and Advanced Studies IPN (Cinvestav), Mexico City, Mexico
- Section of Methodology and Theory of Science, Center for Research and Advanced Studies IPN (Cinvestav), Mexico City, Mexico
- * E-mail:
| | - Lourdes Ruiz-Zamarripa
- Department of Cell Biology, Center for Research and Advanced Studies IPN (Cinvestav), Mexico City, Mexico
| | - Gerardo Hernández
- Section of Methodology and Theory of Science, Center for Research and Advanced Studies IPN (Cinvestav), Mexico City, Mexico
| |
Collapse
|
|
43
|
Tan LSL, Chan AH, Zheng T. Topic-adjusted visibility metric for scientific articles. Ann Appl Stat 2016. [DOI: 10.1214/15-aoas887] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
|
44
|
|
|
45
|
Lawrence PA. The Last 50 Years: Mismeasurement and Mismanagement Are Impeding Scientific Research. Curr Top Dev Biol 2016; 116:617-31. [PMID: 26970645 DOI: 10.1016/bs.ctdb.2015.12.013] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
In the last 50 years, there have been many changes to the substance, conduct, and style of research. Many of these changes have proved disastrous to the life of scientists and to science itself. As a consequence, the near-romantic spirit of adventure and exploration that inspired young scientists of my own and earlier generations has become tarnished. Now, many of us feel beleaguered by bureaucrats and by politicians: they affect our lives profoundly, apparently without an understanding of the way discoveries are made or of the nature of science itself. The core purposes of universities, teaching and research, are being eroded by excessive administration. The number and locations of our publications are counted up like beans and the outcomes are used to rank us, one against another; a process of evaluation that has recast the purposes of publication. Applying for grants takes far too much time from a young scientist's life.
Collapse
Affiliation(s)
- Peter A Lawrence
- Department of Zoology, University of Cambridge, Cambridge, United Kingdom.
| |
Collapse
|
|
46
|
Paulus FM, Rademacher L, Schäfer TAJ, Müller-Pinzler L, Krach S. Journal Impact Factor Shapes Scientists' Reward Signal in the Prospect of Publication. PLoS One 2015; 10:e0142537. [PMID: 26555725 PMCID: PMC4640843 DOI: 10.1371/journal.pone.0142537] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2015] [Accepted: 10/22/2015] [Indexed: 11/18/2022] Open
Abstract
The incentive structure of a scientist's life is increasingly mimicking economic principles. While intensely criticized, the journal impact factor (JIF) has taken a role as the new currency for scientists. Successful goal-directed behavior in academia thus requires knowledge about the JIF. Using functional neuroimaging we examined how the JIF, as a powerful incentive in academia, has shaped the behavior of scientists and the reward signal in the striatum. We demonstrate that the reward signal in the nucleus accumbens increases with higher JIF during the anticipation of a publication and found a positive correlation with the personal publication record (pJIF) supporting the notion that scientists have incorporated the predominant reward principle of the scientific community in their reward system. The implications of this behavioral adaptation within the ecological niche of the scientist's habitat remain unknown, but may also have effects which were not intended by the community.
Collapse
Affiliation(s)
- Frieder Michel Paulus
- Social Neuroscience Lab, Department of Psychiatry and Psychotherapy, University of Lübeck, Lübeck, Germany
- * E-mail: (SK); (FMP)
| | - Lena Rademacher
- Social Neuroscience Lab, Department of Psychiatry and Psychotherapy, University of Lübeck, Lübeck, Germany
| | | | - Laura Müller-Pinzler
- Social Neuroscience Lab, Department of Psychiatry and Psychotherapy, University of Lübeck, Lübeck, Germany
| | - Sören Krach
- Social Neuroscience Lab, Department of Psychiatry and Psychotherapy, University of Lübeck, Lübeck, Germany
- * E-mail: (SK); (FMP)
| |
Collapse
|
|
47
|
Steiner FM, Pautasso M, Zettel H, Moder K, Arthofer W, Schlick-Steiner BC. A Falsification of the Citation Impediment in the Taxonomic Literature. Syst Biol 2015; 64:860-8. [PMID: 25944475 PMCID: PMC4538880 DOI: 10.1093/sysbio/syv026] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2014] [Accepted: 04/27/2015] [Indexed: 02/07/2023] Open
Abstract
Current science evaluation still relies on citation performance, despite criticisms of purely bibliometric research assessments. Biological taxonomy suffers from a drain of knowledge and manpower, with poor citation performance commonly held as one reason for this impediment. But is there really such a citation impediment in taxonomy? We compared the citation numbers of 306 taxonomic and 2291 non-taxonomic research articles (2009-2012) on mosses, orchids, ciliates, ants, and snakes, using Web of Science (WoS) and correcting for journal visibility. For three of the five taxa, significant differences were absent in citation numbers between taxonomic and non-taxonomic papers. This was also true for all taxa combined, although taxonomic papers received more citations than non-taxonomic ones. Our results show that, contrary to common belief, taxonomic contributions do not generally reduce a journal's citation performance and might even increase it. The scope of many journals rarely featuring taxonomy would allow editors to encourage a larger number of taxonomic submissions. Moreover, between 1993 and 2012, taxonomic publications accumulated faster than those from all biological fields. However, less than half of the taxonomic studies were published in journals in WoS. Thus, editors of highly visible journals inviting taxonomic contributions could benefit from taxonomy's strong momentum. The taxonomic output could increase even more than at its current growth rate if: (i) taxonomists currently publishing on other topics returned to taxonomy and (ii) non-taxonomists identifying the need for taxonomic acts started publishing these, possibly in collaboration with taxonomists. Finally, considering the high number of taxonomic papers attracted by the journal Zootaxa, we expect that the taxonomic community would indeed use increased chances of publishing in WoS indexed journals. We conclude that taxonomy's standing in the present citation-focused scientific landscape could easily improve-if the community becomes aware that there is no citation impediment in taxonomy.
Collapse
Affiliation(s)
- Florian M Steiner
- Molecular Ecology Group, Institute of Ecology, University of Innsbruck, Technikerstr. 25, 6020 Innsbruck, Austria
| | - Marco Pautasso
- Forest Pathology and Dendrology, Institute of Integrative Biology, ETHZ, Universitätstr. 16, 8092 Zurich, Switzerland Animal and Plant Health Unit, European Food Safety Authority, via Carlo Magno 1a, 43126 Parma, Italy
| | - Herbert Zettel
- 2nd Zoological Department, Natural History Museum Vienna, Burgring 7, 1010 Vienna, Austria
| | - Karl Moder
- Institute of Applied Statistics and Computing, University of Natural Resources and Life Sciences, Peter Jordan-Str. 82, 1180 Vienna, Austria
| | - Wolfgang Arthofer
- Molecular Ecology Group, Institute of Ecology, University of Innsbruck, Technikerstr. 25, 6020 Innsbruck, Austria
| | - Birgit C Schlick-Steiner
- Molecular Ecology Group, Institute of Ecology, University of Innsbruck, Technikerstr. 25, 6020 Innsbruck, Austria
| |
Collapse
|
|
48
|
Moed HF, Halevi G. Multidimensional assessment of scholarly research impact. J Assoc Inf Sci Technol 2015. [DOI: 10.1002/asi.23314] [Citation(s) in RCA: 80] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Affiliation(s)
- Henk F. Moed
- Informetric Research Group; Elsevier; Radarweg 29 1043 NX Amsterdam The Netherlands
| | - Gali Halevi
- Informetric Research Group; Elsevier; 360 Park Ave. South New York NY 10011 USA
| |
Collapse
|
|
49
|
Oliveira MCLA, Martelli DR, Quirino IG, Colosimo EA, Silva ACSE, Martelli Júnior H, Oliveira EAD. Profile and scientific production of the Brazilian Council for Scientific and Technological Development (CNPq) researchers in the field of Hematology/Oncology. Rev Assoc Med Bras (1992) 2015; 60:542-7. [PMID: 25650854 DOI: 10.1590/1806-9282.60.06.012] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2014] [Accepted: 04/12/2014] [Indexed: 11/22/2022] Open
Abstract
OBJECTIVE several studies have examined the academic production of the researchers at the CNPq, in several areas of knowledge. The aim of this study was to evaluate the scientific production of researchers in Hematology/Oncology who hold scientific productivity grants from the Brazilian Council for Scientific and Technological Development. METHODS the Academic CVs of 28 researchers in Hematology/Oncology with active grants in the three-year period from 2006 to 2008 were included in the analysis. The variables of interest were: institution, researchers' time after doctorate, tutoring of undergraduate students, masters and PhD degree, scientific production and its impact. RESULTS from a total of 411 researchers in Medicine, 28 (7%) were identified as being in the area of Hematology/Oncology. There was a slight predominance of males (53.6%) and grant holders in category 1. Three Brazilian states are responsible for approximately 90% of the researchers: São Paulo (21,75%), Rio de Janeiro (3,11%), and Minas Gerais (2, 7%). During their academic careers, the researchers published 2,655 articles, with a median of 87 articles per researcher (IQR = 52 to 122). 65 and 78% of this total were indexed on the Web of Science and Scopus databases, respectively. The researchers received 14,247 citations on the WoS database with a median of 385 citations per researcher. The average number of citations per article was 8.2. CONCLUSION in this investigation, it was noted that researchers in the field of Hematology/Oncology have a relevant scientific output from the point of view of quantity and quality compared to other medical specialties.
Collapse
|
|
50
|
Mansour AM, Mollayess GE, Habib R, Arabi A, Medawar WA. Bibliometric trends in ophthalmology 1997-2009. Indian J Ophthalmol 2015; 63:54-58. [PMID: 25686064 PMCID: PMC4363959 DOI: 10.4103/0301-4738.151471] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2013] [Accepted: 01/18/2014] [Indexed: 11/23/2022] Open
Abstract
AIMS To track citation patterns in ophthalmic journals and contrast them with major medical and surgical journals from 1997 to 2009. In addition, we want to familiarize the ophthalmic community with bibliometrics indices. MATERIALS AND METHODS Data retrieved from Institute for Scientific Information and related websites include 2-year journal impact factor JIF, 5-year impact, Eigenfactor score, H-factor, Article Influence score, and SCImago factor. RESULTS JIF rose steadily around 10% annually in ophthalmic journals, and likewise for major medical and surgical journals. JIF correlated with recent bibliometric indicators like 5-year impact, H index, and SCImago factor but not with Eigenfactor. Ophthalmic journals publishing reviews, basic science, or large volume on broad range of topics ranked at the top for JIF, while subspecialty journals tended to have low JIF. JIF of subspecialty journal Retina rose from 0.740 (rank 23) in 2000 to 3.088 in 2007 (rank 6). CONCLUSIONS JIF tends to rise annually by 10% in medical, surgical, and ophthalmic fields. Journals publishing reviews, basic science, or large volume on broad range of topics rank at the top for JIF. The rapid rise of JIF for Retina unlike other subspecialties that stayed status quo is multifactorial: Change in editorial policies (introduction of review articles and omission of case reports) and technological advances in the retinal field.
Collapse
Affiliation(s)
- Ahmad M Mansour
- Department of Ophthalmology, American University of Beirut, and Rafic Hariri University Hospital, Beirut, Lebanon
| | - Georges El Mollayess
- Department of Ophthalmology, American University of Beirut, and Rafic Hariri University Hospital, Beirut, Lebanon
| | - Robert Habib
- Division of Outcomes Research, American University of Beirut, and Rafic Hariri University Hospital, Beirut, Lebanon
| | - Asma Arabi
- Department of Internal Medicine, American University of Beirut, and Rafic Hariri University Hospital, Beirut, Lebanon
| | - Walid A Medawar
- Department of Internal Medicine, American University of Beirut, and Rafic Hariri University Hospital, Beirut, Lebanon
| |
Collapse
|