Keywords
Automated Evaluation
Educational Resources
How to Cite
Abstract
The rapid expansion of digital education has generated an accessibility gap, rendering manual resource evaluation insufficient and unfeasible given the current volume of information. This article presents a systematic literature review aimed at identifying and analyzing existing automated tools for digital accessibility evaluation. The methodology consisted of a structured ten-step systematic literature review and included studies published between 2010 and 2025 across various databases; 37 final articles were selected after applying quality criteria. Main results indicate a predominance of traditional web tools such as WAVE, yet reveal a growing trend towards artificial intelligence-based solutions. As conclusion, despite technological advancements, there is a significant shortage of evaluators for digital documents and an urgent need for tools that surpass basic technical validation so that they comprehend in-context content.
References
Abdulreda, Hawraa, Iyad Abu Doush y Zainab AlMeraj. 2025. “E-government Mobile Web Accessibility Challenges Facing People with Visual Impairments: A Multi-Method Evaluation”. En Proceedings of the 11th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-Exclusion (DSAI ’24), editado por Leontios Hadjileontiadis, Habiba Al Safar, João Barroso y Hugo Paredes, 124-32. Association for Computing Machinery. https://doi.org/10.1145/3696593.3696651
Abu Doush, Iyad, Faisal Alkhateeb, Eslam Al Maghayreh y Mohammed Azmi Al-Betar. 2013. “The Design of RIA Accessibility Evaluation Tool”. Advances in Engineering Software 57: 1-7. https://doi.org/10.1016/j.advengsoft.2012.11.004
Acevedo-Zapata, Sandra, Ricardo Arrubla Sánchez y José Antonio Torres Ortiz. 2023. “Accesibilidad web en la virtualidad: análisis del tejido cultural de internet y lenguaje digital”. Hallazgos 20 (39): 216-34. https://doi.org/10.15332/2422409X.7928
Acosta-Vargas, Patricia, Gloria Acosta-Vargas, Belén Salvador-Acosta y Janio Jadán-Guerrero. 2024. “Addressing Web Accessibility Challenges with Generative Artificial Intelligence Tools for Inclusive Education”. En 2024 Tenth International Conference on eDemocracy & eGovernment (ICEDEG), coordinado por Matthes Fleck, 1-7. Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ICEDEG61611.2024.10702085
Acosta-Vargas, Patricia, Sergio Luján-Mora, Tania Acosta y Luis Salvador-Ullauri. 2017. “Accesibilidad de documentos PDF en repositorios educativos de Latinoamérica”. En ATICA2017 / Tecnología. Accesibilidad. Educar en la sociedad red, editado por Luis Bengochea Martínez, Nilber Javier Mosquera Perea, Elena Campo Montalvo y José Ramón Hilera González, 239-46. Universidad de Alcalá.
Adobe. s. f. “PDF/UA: cómo crear PDF accesibles”. Adobe Acrobat Resources. Consultado el 6 de marzo de 2025. https://www.adobe.com/es/acrobat/resources/document-files/pdf-types/pdf-ua.html
Akram, Muhammad, Ghassan Ahmed Ali, Adel Sulaiman y Mahmood ul Hassan. 2023. “Accessibility Evaluation of Arabic University Websites for Compliance with Success Criteria of WCAG 1.0 and WCAG 2.0”. Universal Access in the Information Society 22 (4): 1199-1214. https://doi.org/10.1007/s10209-022-00921-8
Aljedaani, Wajdi, Sandeep Kumar Rudhravaram, Akhila Chintham, Abdulrahman Habib y Marcelo M. Eler. 2024. “A11yPDF: Bridging the Gap to Inclusive PDFs”. En Proceedings of the 21st International Web for All Conference (W4A ’24), coordinado por Scott Hollier y Ruchi Permvattana, 37-38. Association for Computing Machinery. https://doi.org/10.1145/3677846.3677859
Ara, Jinat, y Cecilia Sik-Lanyi. 2025. “Automated Evaluation of Accessibility Issues of Webpage Content: Tool and Evaluation”. Scientific Reports 15, 9516. https://doi.org/10.1038/s41598-025-92192-5
Avila, Cecilia, Silvia Baldiris, Ramon Fabregat y Sabine Graf. 2017. “ATCE: an Analytics Tool to Trace the Creation and Evaluation of Inclusive and Accessible Open Educational Resources”. En Proceedings of the Seventh International Learning Analytics & Knowledge Conference (LAK ’17), coordinado por Alyssa Wise, Phillip H. Winne y Grace Lynch, 183-87. Association for Computing Machinery. https://doi.org/10.1145/3027385.3027413
Bates, Anthony William. 2019. Teaching in a Digital Age / Guidelines for Designing Teaching and Learning, 2.ª ed. BCcampus.
Bertossi, Valeria, Lucila Romero y Milagros Gutiérrez. 2022. “Sistema recomendador para desarrollar objetos de aprendizaje para ingenierías bajo el enfoque por competencias: análisis y diseño”. En X Congreso Nacional de Ingeniería Informática y Sistemas de Información (CoNaIISI), coordinado por Augusto Nasrallah, 391-402. Facultad Regional Concepción del Uruguay, Universidad Tecnológica Nacional de la Argentina. http://hdl.handle.net/20.500.12272/10057
Castañeda, Linda, y Neil Selwyn. 2018. “More than Tools? Making Sense of the Ongoing Digitizations of Higher Education”. International Journal of Educational Technology in Higher Education 15, 22. https://doi.org/10.1186/s41239-018-0109-y
Chatterjee, Amreeta, Lara Letaw, Rosalinda Garcia, Doshna Umma Reddy, Rudrajit Choudhuri, Sabyatha Sathish Kumar, Patricia Morreale, Anita Sarma y Margaret Burnett. 2022. “Inclusivity Bugs in Online Courseware: A Field Study”. En Proceedings of the 2022 ACM Conference on International Computing Education Research (ICER ’22), vol. 1, editado por Jan Vahrenhold, Kathi Fisler, Matthias Hauswirth y Diana Franklin, 356-72. Association for Computing Machinery. https://doi.org/10.1145/3501385.3543973
Chiou, Paul T., Robert Winn, Ali S. Alotaibi y William G. J. Halfond. 2024. “Automatically Detecting Reflow Accessibility Issues in Responsive Web Pages”. En Proceedings of the IEEE / ACM 46th International Conference on Software Engineering (ICSE ’24), coordinado por Ana Paiva y Rui Abreu, 1-13. Association for Computing Machinery. https://doi.org/10.1145/3597503.3639229
Costa, José P., Radka Nacheva, Sofia Coelho y Oliva M. D. Martins. 2025. “AI-Driven Solutions for Enhancing Digital Accessibility in Higher Education”. En 59th Amsterdam International Congress on Research in Science, Technology, Social Sciences & Education (STSSE-25), coordinado por Ali Saberi Mehr, Gordon Moffat y Omar Alananzeh, 1-3. Eminent Association of Pioneers. https://doi.org/10.17758/EARES21.DiR0325104
Dias, João, Diana Carvalho, Hugo Paredes, Paulo Martins, Tânia Rocha y João Barroso. 2022a. “Automated Evaluation Tools for Web and Mobile Accessibility: A Systematic Literature Review”. En Innovations in Bio-inspired Computing and Applications / Proceedings of the 12th International Conference on Innovations in Bio-Inspired Computing and Applications (IBICA 2021), editado por Ajith Abraham, Ana Maria Madureira, Arturas Kaklauskas, Niketa Gandhi, Anu Bajaj, Azah Kamilah Muda, Dalia Kriksciuniene y João Carlos Ferreira, 447-56. Springer. https://doi.org/10.1007/978-3-030-96299-9_43
Dias, João, Diana Carvalho, Tânia Rocha y João Barroso. 2022b. “Automated Evaluation Tools for Web and Mobile Accessibility: Proposal of a New Adaptive Interface Tool”. Procedia Computer Science 204: 297-304. https://doi.org/10.1016/j.procs.2022.08.036
Fakrudeen, Mohammed. 2025. “Evaluation of the Accessibility and Usability of University Websites: A Comparative Study of the Gulf Region”. Universal Access in the Information Society 24 (2): 1883-98. https://doi.org/10.1007/s10209-024-01160-9
Fernandes, Nádia, Ana Sofia Batista, Daniel Costa, Carlos Duarte y Luís Carriço. 2013. “Three Web Accessibility Evaluation Perspectives for RIA”. En Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility (W4A ’13), coordinado por Giorgio Brajnik y Paola Salomoni, 1-9. Association for Computing Machinery. https://doi.org/10.1145/2461121.2461122
García Aretio, Lorenzo. 2020. “Bosque semántico: ¿educación/enseñanza/aprendizaje a distancia, virtual, en línea, digital, eLearning…?”. RIED. Revista Iberoamericana de Educación a Distancia 23 (1): 9-28. https://doi.org/10.5944/ried.23.1.25495
García Peñalvo, Francisco José. 2017. “Revisión sistemática de literatura para artículos”. Diapositivas presentadas en un seminario impartido en el Tecnológico de Monterrey, México, 25 de enero de 2017. http://repositorio.grial.eu/handle/grial/756
He, Ziyao, Syed Fatiul Huq y Sam Malek. 2025. “Enhancing Web Accessibility: Automated Detection of Issues with Generative AI”. Proceedings of the Association for Computing Machinery on Software Engineering 2 (FSE): 2264-87. https://doi.org/10.1145/3729371
Iniesto, Francisco, y Covadonga Rodrigo. 2024. “The Use of WCAG and Automatic Tools by Computer Science Students: A Case Study Evaluating MOOC Accessibility”. Journal of Universal Computer Science 30 (1): 85-105. https://doi.org/10.3897/jucs.101704
Ismail, Abid, y K. S. Kuppusamy. 2018. “Accessibility of Indian Universities’ Homepages: An Exploratory Study”. Journal of King Saud University - Computer and Information Sciences 30 (2): 268-78. https://doi.org/10.1016/j.jksuci.2016.06.006
Ismail, Abid, y K. S. Kuppusamy. 2022. “Web Accessibility Investigation and Identification of Major Issues of Higher Education Websites with Statistical Measures: A Case Study of College Websites”. Journal of King Saud University - Computer and Information Sciences 34 (3): 901-11. https://doi.org/10.1016/j.jksuci.2019.03.011
Johnson, Peter, y Mariana Lilley. 2022. “Software Prototype for the Ensemble of Automated Accessibility Evaluation Tools”. En HCI International 2022 Posters / 24th International Conference on Human-Computer Interaction (HCII 2022), vol. 1, editado por Constantine Stephanidis, Margherita Antona y Stavroula Ntoa, 532-39. Springer. https://doi.org/10.1007/978-3-031-06417-3_71
Kous, K., S. Kuhar, M. Pusnik y B. Sumak. 2019. “Comparative Analysis of Faculties’ Websites Accessibility Based on an Automatic Evaluation”. En 2019 42nd International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), editado por Marko Koricic, Zeljko Butkovic, Karolj Skala, Zeljka Car, Marina Cicin-Sain, Snjezana Babic, Vlado Sruk et al., 1498-502. Institute of Electrical and Electronics Engineers. https://doi.org/10.23919/MIPRO.2019.8757202
Kumar, Anukriti, Tanushree Padath y Lucy Lu Wang. 2025. “Benchmarking PDF Accessibility Evaluation: A Dataset and Framework for Assessing Automated and LLM-Based Approaches for Accessibility Testing”. En Proceedings of the 27th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ’25), editado por Shaun Kane, Kristen Shinohara, Cynthia Bennett y Martez Mott, art. 64. Association for Computing Machinery. https://doi.org/10.1145/3663547.3746380
Kumar, Anukriti, y Lucy Lu Wang. 2024. “Uncovering the New Accessibility Crisis inScholarly PDFs: Publishing Model and Platform Changes Contribute to Declining Scholarly Document Accessibility in the Last Decade”. En Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ’24), editado por David Flatla, Faustina Hwang, Tiago Guerreiro y Robin Brewer, art. 36. Association for Computing Machinery. https://doi.org/10.1145/3663548.3675634
Lampropoulos, Georgios. 2023. “Recommender Systems in Education: A Literature Review and Bibliometric Analysis”. Advances in Mobile Learning Educational Research 3 (2): 829-50. https://doi.org/10.25082/AMLER.2023.02.011
Lopes, Rui, Daniel Gomes y Luís Carriço. 2010. “Web Not for All: A Large Scale Study of Web Accessibility”. En Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A ’10), coordinado por Chieko Asakawa y Hironobu Takagi, art. 10. Association for Computing Machinery. https://doi.org/10.1145/1805986.1806001
Mandava, Sarath Krishna. 2024. “AI-Powered Accessibility: Using Machine Learning to Detect and Correct Accessibility Gaps in Web Interfaces”. Frontiers in Health Informatics 13 (3): 9196-214. https://healthinformaticsjournal.com/index.php/IJMI/article/view/880
Nganji, Julius T. 2018. “Supporting the Information Journey of Students with Disabilities Through Accessible Learning Materials”. Information and Learning Sciences 119 (12): 721-32. https://doi.org/10.1108/ILS-07-2018-0062
Nguyen, Thai. 2024. “Evaluating Automated Accessibility Checker Tools”. Tesis de licenciatura, Western Washington University. https://cedar.wwu.edu/wwu_honors/805
Niom, Telcia, y Frank Lin. 2022. “Accessibility of COVID-19 Websites of Asian Countries: An Evaluation Using Automated Tools”. SN Computer Science 3, 498. https://doi.org/10.1007/s42979-022-01412-6
Padilla Zambrano, Jennifer Pamela, Rosa Magaly Zambrano Mala, Hellen Raquel López Coronel y Michelle Lucía Catagua Vélez. 2025. “La educación inclusiva en la era digital: desafíos y oportunidades para estudiantes con discapacidades”. Reincisol 4 (7): 2274-98. https://doi.org/10.59282/reincisol.V4(7)2274-2298
Ramos Aguiar, Luis Roberto, y Francisco Javier Álvarez Rodríguez. 2024. “Digital Content for Libraries Considering Extended Reality, Physical Interaction Disabilities, Universal Design for Learning, and User-Centered Design: A Systematic Review”. Investigación Bibliotecológica: archivonomía, bibliotecología e información 38 (99): 109-27. http://dx.doi.org/10.22201/iibi.24488321xe.2024.99.58872
Rodríguez Vázquez, Silvia. 2016. “Measuring the Impact of Automated Evaluation Tools on Alternative Text Quality: A Web Translation Study”. En Proceedings of the 13th International Web for All Conference (W4A ’16), coordinado por Greg Gay y Tiago Guerreiro, art. 32. Association for Computing Machinery. https://doi.org/10.1145/2899475.2899484
Sato, Mariana H. K., Felippe F. da Silva, Aline M. M. M. Amaral, Gislaine C. L. Leal, Guilherme C. Guerino y Renato Balancieri. 2025. “Assessing Accessibility in MOOCs: A Comparison of Moodle and Coursera for Users with Hearing Impairments, Visual Impairments, and the Elderly”. En Anais do XXXIII Workshop sobre Educação em Computação (WEI 2025), coordinado por Luiz Bittencourt, Mariza Ferro y Angela Peres, 722-33. SBC. https://doi.org/10.5753/wei.2025.8486
Vigo, Markel, Justin Brown y Vivienne Conway. 2013. “Benchmarking Web Accessibility Evaluation Tools: Measuring the Harm of Sole Reliance on Automated Tests”. En Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility (W4A ’13), coordinado por Giorgio Brajnik y Paola Salomoni, art. 1. Association for Computing Machinery. https://doi.org/10.1145/2461121.2461124
World Wide Web Consortium. 2026. “Web Content Accessibility Guidelines 2 Overview”. Standards/Guidelines, Web Accessibility Initiative. Última modificación el 26 de mayo de 2026. https://www.w3.org/WAI/standards-guidelines/wcag/
Yussubaliyeva, Madina, Zhadyra Konurbayeva, Jolanta Słoniec y Alfonso Infante Moro. 2025. “Digital Accessibility of Higher Education Websites: A Bibliometric Mapping of the Research Literature (2015-2024)”. Asian Journal of University Education 21 (3): 677-94. https://doi.org/10.24191/ajue.v21i3.46
Zapata-Ros, Miguel. 2018. “La universidad inteligente”. Revista de Educación a Distancia (RED) (57), e327431. https://revistas.um.es/red/article/view/327431
Zulfiqar, Shaban, Safa Arooj, Umar Hayat, Suleman Shahid y Asim Karim. 2020. “Automated Generation of Accessible PDF”. En Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ’20), editado por Tiago Guerreiro, Hugo Nicolau y Karyn Moffatt, art. 91. Association for Computing Machinery. https://doi.org/10.1145/3373625.3418045
Authors:
- They must sent the publication authorization letter to Investigación Bibliotecológica: archivonomía, bibliotecología e información.
- They can share the submission with the scientific community in the following ways:
- As teaching support material
- As the basis for lectures in academic conferences
- Self-archiving in academic repositories.
- Dissemination in academic networks.
- Posting to author’s blogs and personal websites
These allowances shall remain in effect as long as the conditions of use of the contents of the journal are duly observed pursuant to the Creative Commons:Attribution-NonCommercial-NoDerivatives 4.0 license that it holds. DOI links for download the full text of published papers are provided for the last three uses.
Self-archiving policy
For self-archiving, authors must comply with the following
a) Acknowledge the copyright held by the journal Investigación Bibliotecológica: archivonomía, bibliotecología e información.
b) Establish a link to the original version of the paper on the journal page, using, for example, the DOI.
c) Disseminate the final version published in the journal.
Licensing of contents
The journal Investigación Bibliotecológica: archivonomía, bibliotecología e información allows access and use of its contents pursuant to the Creative Commons license: Attribution- Non-commercial-NoDerivatives 4.0.
Investigación Bibliotecológica: archivonomía, bibliotecología e información by Universidad Nacional Autónoma de México is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 Internacional License.
Creado a partir de la obra en http://rev-ib.unam.mx/ib.
This means that contents can only be read and shared as long as the authorship of the work is acknowledged and cited. The work shall not be exploited for commercial ends nor shall it been modified.
Limitation of liability
The journal is not liable for academic fraud or plagiarism committed by authors, nor for the intellectual criteria they employ. Similarly, the journal shall not be liable for the services offered through third party hyperlinks contained in papers submitted by authors.
In support of this position, the journal provides the Author’s Duties notice at the following link: Responsibilities of authors.
The director or editor of the journal shall notify authors in the event it migrates the contents of the journal’s official website to a distinct IP or domain.