Keywords
Gender
Research Assessment
Altmetrics
How to Cite
Abstract
One of the main problems in Chilean research evaluation lies in the excessive reliance on quantitative metrics, such as citations and journal impact factors, which overlook real impact in social sciences, arts, and humanities, as well as interdisciplinary and social contributions not captured by Web of Science or Scopus. This study analyzes the perception of researchers through a survey sent to 3 500 authors of articles published between 2015 and 2019 in the Social Sciences Citation Index and the Arts and Humanities Citation Index, obtaining 418 responses (11.9 % response rate). The results reveal variable knowledge of bibliometric indicators by gender and discipline, their frequent use in academic promotions and evaluations made by the Agencia Nacional de Investigación y Desarrollo [Chilean National Agency for Research and Development] (ANID), and low awareness of altmetrics across all areas. We conclude that traditional metrics underestimate non-conventional impacts and recommend the integration of qualitative and altmetric evaluations for a more equitable assessment of scientific funding.
References
Abramo, Giovanni, y Ciriaco Andrea D’Angelo. 2011. “Evaluating Research: From Informed Peer Review to Bibliometrics”. Scientometrics 87 (3): 499-514. http://doi.org/10.1007/s11192-011-0352-7
ANID (Agencia Nacional de Investigación y Desarrollo del Gobierno de Chile). 2024a. Bases del Concurso de Proyectos Fondecyt Regular 2025. Res. Exenta nro. 44. Agencia Nacional de Investigación y Desarrollo, 14 de mayo de 2024. https://s3.amazonaws.com/documentos.anid.cl/proyecto-investigacion/2025/regular/postulacion/Bases-Concursales_TQl8zlrfxqvbhbojzBFdsipelI0YQf7.pdf
ANID (Agencia Nacional de Investigación y Desarrollo del Gobierno de Chile). 2024b. Bases Concurso de Proyectos Núcleos Milenio 2024. Exenta nro. 98. Agencia Nacional de Investigación y Desarrollo, 15 de noviembre de 2023. https://s3.amazonaws.com/documentos.anid.cl/centros/concursos/2024/Nucleos-MilenioCNyE/Res-bases_SxWcF4LzE5rF8sH2lC6QaE4RvT7yU8.pdf
Archambault, Éric, y Vincent Larivière. 2009. “History of the Journal Impact Factor: Contingencies and Consequences”. Scientometrics 79 (3): 635-49. http://doi.org/10.1007/s11192-007-2036-x
Bi, Henry H. 2023. “Four Problems of the H‐Index for Assessing the Research Productivity and Impact of Individual Authors”. Scientometrics 128 (5): 2677-9 http://doi.org/10.1007/s11192-022-04323-8
Brambor, Thomas, William Roberts Clark y Matt Golder. 2006. “Understanding Interaction Models: Improving Empirical Analyses”. Political Analysis 14 (1): 63-82. https://doi.org/10.1093/pan/mpi014
Chapman, Colin A., Júlio César Bicca-Marques, Sébastien Calvignac-Spencer, Pengei Fan, Peter J. Fashing, Jan Gogarten, Guo Songtao, et al. 2019. “Games Academics Play and their Consequences: How Authorship, H-Index and Journal Impact Factors Are Shaping the Future of Academia”. Proceedings of the Royal Society B: Biological Sciences 286 (1916), 20192047. http://doi.org/10.1098/rspb.2019.2047
Cho, Jane. 2021. “Altmetrics Analysis of Highly Cited Academic Papers in the Field of Library and Information Science”. Scientometrics 126 (9): 7623-35. http://doi.org/10.1007/s11192-021-04084-w
CNED (Consejo Nacional de Educación). s. f. “Bases de datos”. Índices. Consultado el 22 de septiembre de 2025. https://cned.cl/institucional/bases-de-datos/
Delgado-Quirós, Lorena, y José Luis Ortega. 2024. “Completeness Degree of Publication Metadata in Eight Free-Access Scholarly Databases”. Quantitative Science Studies 5 (1): 31-49. http://doi.org/10.1162/qss_a_00286
DORA (Declaration on Research Assessment). s. f. “San Francisco Declaration on Research Assessment”. The Declaration. Consultado el 17 de diciembre de 2025. https://sfdora.org/read/
Fang, Zhichao, y Rodrigo Costas. 2020. “Studying the Accumulation Velocity of Altmetric Data Tracked by Altmetric.com”. Scientometrics 123 (2): 1077-1101. https://doi.org/10.1007/s11192-020-03405-9
Funes, Paula D., Gisela Spengler y Débora M. Kligmann. 2024. “Trayectoria digital de la revista Arqueología (Universidad de Buenos Aires): análisis de altmetrics durante el periodo 2018-2022”. Información, Cultura y Sociedad 50: 9-28. http://doi.org/10.34096/ics.i50.13320
Garfield, Eugene. 2006. “The History and Meaning of the Journal Impact Factor”. Journal of the American Medical Association 295 (1): 90-93. http://doi.org/10.1001/jama.295.1.90
Gelman, Andrew, y Jennifer Hill. 2006. Data Analysis Using Regression and Multilevel/Hierarchical Models. Cambridge University Press.
Hicks, Diana, Paul Wouters, Ludo Waltman, Sarah de Rijcke e Ismael Rafols. 2015. “Bibliometrics: The Leiden Manifesto for Research Metrics”. Nature 520 (7548): 429-31. http://doi.org/10.1038/520429a
Hirsch, Jorge E. 2005. “An Index to Quantify an Individual’s Scientific Research Output”. Proceedings of the National Academy of Sciences 102 (46): 16569-72. http://doi.org/10.1073/pnas.0507655102
Kiesslich, Tobias, Marlena Beyreis, Georg Zimmermann y Andreas Traweger. 2021. “Citation Inequality and the Journal Impact Factor: Median, Mean, (Does It) Matter?”. Scientometrics 126 (2): 1249-69. http://doi.org/10.1007/s11192-020-03812-y
Krauskopf, Erwin. 2020. “Are We at a Turning Point in Journal Assessment? An Introduction to Altmetrics”. Austral Journal of Veterinary Sciences 52 (3): 71-77. http://doi.org/10.4067/S0719-81322020000300071
Kumaran, Maha, y Chau Ha. 2017. “Knowledge of Journal Impact Factors among Nursing Faculty: A Cross-Sectional Study”. Journal of the Medical Library Association 105 (2): 140-44. http://doi.org/10.5195/jmla.2017.207
Kuschel, Katherina, y Erica Salvaj. 2018. “Opening the ‘Black Box’. Factors Affecting Women’s Journey to Top Management Positions: A Framework Applied to Chile”. Administrative Sciences 8 (4), 63. https://doi.org/10.3390/admsci8040063
Leydesdorff, Loet, y Staša Milojević. 2015. “The Citation Impact of German Sociology Journals: Some Problems with the Use of Scientometric Indicators in Journal and Research Evaluations”. Soziale Welt 66 (2): 193-204. http://doi.org/10.5771/0038-6073-2015-2-193
Long, J. Scott, y Jeremy Freese. 2014. Regression Models for Categorical Dependent Variables Using Stata, 3.ª ed. Stata Press.
McCullagh, Peter, y John A. Nelder. 1989. Generalized Linear Models, 2.ª ed. Chapman and Hall.
McKiernan, Erin C., Lesley A. Schimanski, Carol Muñoz Nieves, Lisa Matthias, Meredith T. Niles y Juan P. Alperin. 2019. “Use of the Journal Impact Factor in Academic Review, Promotion, and Tenure Evaluations”. eLife 8, e47338. https://doi.org/10.7554/eLife.47338
Moed, Henk F., y Gali Halevi. 2015. “Multidimensional Assessment of Scholarly Research Impact”. Journal of the Association for Information Science and Technology 66 (10): 1988-2002. http://doi.org/10.1002/asi.23314
Nielsen, Mathias Wullum, y Jens Peter Andersen. 2021. “Global Citation Inequality Is on the Rise”. Proceedings of the National Academy of Sciences 118 (7), e2012208118. http://doi.org/10.1073/pnas.2012208118
Pontika, Nancy, Thomas Klebel, Antonia Correia, Hannah Metzler, Petr Knoth y Tony Ross-Hellauer. 2022. “Indicators of Research Quality, Quantity, Openness, and Responsibility in Institutional Review, Promotion, and Tenure Policies Across Seven Countries”. Quantitative Science Studies 3 (4): 888-911. https://doi.org/10.1162/qss_a_00224
Priem, Jason, Paul Groth y Dario Taraborelli. 2012. “The Altmetrics Collection”. PLoS ONE 7 (11), e48753. https://doi.org/10.1371/journal.pone.0048753
Rice, Danielle B., Hana Raffoul, John P. A. Ioannidis y David Moher. 2020. “Academic Criteria for Promotion and Tenure in Biomedical Sciences Faculties: Cross Sectional Analysis of International Sample of Universities”. BMJ 369, e2081. http://doi.org/10.1136/bmj.m2081
Siler, Kyle, y Vincent Larivière. 2022. “Who Games Metrics and Rankings? Institutional Niches and Journal Impact Factor Inflation”. Research Policy 51 (10), e104608. http://doi.org/10.1016/j.respol.2022.104608
Spatti, Ana Carolina, Paulo Roberto Cintra, Adriana Bin y Ronaldo Ferreira Araújo. 2021. “Métricas alternativas para avaliação da produção científica latino-americana: um estudo da rede SciELO”. Informação & Informação 26 (2): 596-624. https://doi.org/10.5433/1981-8920.2021v26n2p596
Sud, Pardeep, y Mike Thelwall. 2014. “Evaluating Altmetrics”. Scientometrics 98 (2): 1131-43. http://doi.org/10.1007/s11192-013-1117-2
Svartefoss, Silje Marie, Jens Jungblut, Dag W. Aksnes, Kristoffer Kolltveit y Thed van Leeuwen. 2024. “Explaining Research Performance: Investigating the Importance of Motivation”. SN Social Sciences 4 (6), 105. http://doi.org/10.1007/s43545-024-00895-9
Thomas, Hernan, Lucas Becerra y Florencia Trentini. 2019. “La evaluación académica basada en indicadores bibliométricos como sistema socio-técnico. Micro y macropolítica de la jerarquización de productos y actividades científicas y tecnológicas”. Redes. Revista de Estudios Sociales de la Ciencia y la Tecnología 25 (49): 254-337. https://doi.org/10.48160/18517072re49.79
Torres-Salinas, Daniel, Domingo Docampo, Wenceslao Arroyo-Machado y Nicolas Robinson-Garcia. 2024. “The Many Publics of Science: Using Altmetrics to Identify Common Communication Channels by Scientific Field”. Scientometrics 129 (7): 3705-23. http://doi.org/10.1007/s11192-024-05077-1
Unzurrunzaga, Carolina, Carolina Monti, Gaston Zalba y Juan Pablo Alperin. 2024. “Acceso abierto en Argentina. Una propuesta para el monitoreo de las publicaciones científicas con OpenAlex”. Información, Cultura y Sociedad 50: 29-48. http://doi.org/10.34096/ics.i50.13373
Weingart, Peter. 2005. “Impact of Bibliometrics upon the Science System: Inadvertent Consequences?”. Scientometrics 62 (1): 117-31. http://doi.org/10.1007/s11192-005-0007-7
Woolston, Chris. 2021. “Impact Factor Abandoned by Dutch University in Hiring and Promotion Decisions”. Nature 595 (7867): 462. http://doi.org/10.1038/d41586-021-01759-5
Yang, Siluo, Mengxue Zheng, Yonghao Yu y Dietmar Wolfram. 2021. “Are Altmetric.com Scores Effective for Research Impact Evaluation in the Social Sciences and Humanities?”. Journal of Informetrics 15 (1), e101120. http://doi.org/10.1016/j.joi.2020.101120
Authors:
- They must sent the publication authorization letter to Investigación Bibliotecológica: archivonomía, bibliotecología e información.
- They can share the submission with the scientific community in the following ways:
- As teaching support material
- As the basis for lectures in academic conferences
- Self-archiving in academic repositories.
- Dissemination in academic networks.
- Posting to author’s blogs and personal websites
These allowances shall remain in effect as long as the conditions of use of the contents of the journal are duly observed pursuant to the Creative Commons:Attribution-NonCommercial-NoDerivatives 4.0 license that it holds. DOI links for download the full text of published papers are provided for the last three uses.
Self-archiving policy
For self-archiving, authors must comply with the following
a) Acknowledge the copyright held by the journal Investigación Bibliotecológica: archivonomía, bibliotecología e información.
b) Establish a link to the original version of the paper on the journal page, using, for example, the DOI.
c) Disseminate the final version published in the journal.
Licensing of contents
The journal Investigación Bibliotecológica: archivonomía, bibliotecología e información allows access and use of its contents pursuant to the Creative Commons license: Attribution- Non-commercial-NoDerivatives 4.0.
Investigación Bibliotecológica: archivonomía, bibliotecología e información by Universidad Nacional Autónoma de México is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 Internacional License.
Creado a partir de la obra en http://rev-ib.unam.mx/ib.
This means that contents can only be read and shared as long as the authorship of the work is acknowledged and cited. The work shall not be exploited for commercial ends nor shall it been modified.
Limitation of liability
The journal is not liable for academic fraud or plagiarism committed by authors, nor for the intellectual criteria they employ. Similarly, the journal shall not be liable for the services offered through third party hyperlinks contained in papers submitted by authors.
In support of this position, the journal provides the Author’s Duties notice at the following link: Responsibilities of authors.
The director or editor of the journal shall notify authors in the event it migrates the contents of the journal’s official website to a distinct IP or domain.