The Inclusivity Level of the Iranian Research Institute for Information Science and Technology (IranDoc) Systems, Focusing on WCAG 2.2 Indicators and the Experience of Users with Visual Impairments

Najafgholinejad, Azam

doi:10.22034/jipm.2025.2043239.1807

The Inclusivity Level of the Iranian Research Institute for Information Science and Technology (IranDoc) Systems, Focusing on WCAG 2.2 Indicators and the Experience of Users with Visual Impairments

Document Type : Original Article

Author

Azam Najafgholinejad

PhD in knowledge and information science; Assistant Professor; Data Science, Information, and Artificial Intelligence Research Group; National Library and Archives of I.R. Iran; Tehran

10.22034/jipm.2025.2043239.1807

Abstract

Interaction with web data and information and communication technologies plays a vital role in developing the information society and improving the quality of life for people with disabilities. Despite digital advancements, accessibility and usability gaps persist for visually impaired users. This study examines the compliance of Iran’s Institute for Scientific Information and Documentation (IranDoc) systems with international accessibility standards (WCAG 2.2) and evaluates the real user experience of blind and low-vision individuals. The findings aim to enhance inclusivity, educational equity, and the quality of digital services for this community, providing valuable insights for improving accessible scientific platforms in Iran.
This study adopts a quantitatively-driven approach to evaluate the accessibility and usability of the Iranian Research Institute for Information Science and Technology’s systems for users with visual impairments. Two primary methods were utilized: first, a technical assessment using the automated tool Accessibility Insights alongside an inspection based on the latest extracted indicators from the World Wide Web Consortium (W3C) Web Content Accessibility Guidelines (WCAG) 2.2 (edition 2023), focusing on priorities A and AA with a fuzzy evaluation approach; second, usability testing with real blind and low-vision users through task-based scenarios designed for each system and detailed observation of user interactions. Quantitative data—including task completion times, success rates, and pre- and post-test questionnaires—were statistically analyzed. Usability test data were further enriched through behavioral observations of 24 visually impaired participants (totaling 48 sessions), NVDA screen reader audio feedback, and HTML code analysis. User performance was measured by task success rate, time to complete tasks, satisfaction ratings, and the extent of assistance required. Purposeful and snowball sampling techniques were employed to recruit experienced users to effectively identify structural barriers to accessibility and usability. All user interactions were conducted online with full process recording. This multifaceted methodology integrates technical evaluations with end-user experience, thereby enhancing the validity and comprehensiveness of the findings.
The results of the technical evaluation using automated tools revealed that these systems paid limited attention to the contrast between text and background. Key accessibility elements—such as text alternatives for non-text content, labeling of form elements, link labels and names, and button labels—require further review and adjustment. Moreover, the findings indicated that none of the systems were fully compliant with WCAG 2.2 guidelines. Among the evaluated platforms, the Pishineh system demonstrated the highest level of compliance with accessibility criteria, achieving 71% at Level A and 77% at Level AA, making it the most accessible system. In contrast, the Ganj system exhibited the lowest compliance rate at Level AA (50%), while the remaining platforms showed varying degrees of accessibility across different levels. Despite partial adherence to many criteria at Levels A and AA, several key standards were not met at all. These included: lack of mechanisms for easily skipping repetitive content blocks, absence of clear textual content for page titles, failure to identify and describe user-generated errors, and inadequate provision of descriptive and logically ordered labels and headings. Usability testing data further revealed that task completion within the systems ranged from moderate to easy. The relatively high average scores indicate a generally favorable usability status among the IranDoc systems.
This study, through a systematic examination of screen reader users’ interactions with the Iranian Research Institute for Information Science and Technology (IranDoc) systems and an analysis of their compliance with the latest WCAG 2.2 indicators, has made a significant contribution to improving the accessibility and usability of these systems for users with visual impairments. The findings reveal that, despite some progress, there remains a need for fundamental reforms in user interface design, including enhanced color contrast, provision of comprehensive text alternatives, and optimization of semantic content structure and task workflows. Additionally, the development of accessible guides and documentation, as well as the implementation of key navigation features such as skip links, are essential for enhancing the user experience of this group. By employing a multifaceted methodology and engaging active participation from blind and low-vision users, this research provides a practical and reliable framework for evaluating and improving specialized Persian-language systems. The results can serve as a model for similar platforms in research and educational domains, offering a foundation for the development of more inclusive and equitable systems for scientific information access. Thus, this study represents an important step toward enhancing the quality of digital services for vulnerable users and achieving equity in access to scientific information.

Keywords

Inclusive Organization

Accessibility

Usability

Visually Impaired

Blind Users

WCAG 2.2 Indicators

IranDoc

Subjects

User Experience (UX) and User Interface (UI)

فهرست منابع

آیین‌نامه اجرایی ماده (3) قانون حمایت از حقوق معلولان. 1398. بازیابی‌شده از: https://rc.majlis.ir/fa/law/print_version/1385205 (دسترسی در 20/6/1401)

ادیب، یوسف، و احد عظیمی آقبلاغ. 1399. واکاوی محدودیت‌های تحصیلی دانشجویان نابینا و کم‌بینا: یک پژوهش کیفی. روان‌شناسی افراد استثنایی 10 (40): 99-132. doi: 10.22054/jpe.2021.56797.2251

ساختار کلی شیوه‌نامۀ WCAG و معرفی سطوح مطابقتA ،AA ،AAA. 1400. ترجمه امید‌هاشمی، ویراستاری آرتا مکبری و حسین شرفی. شیوه‌نامه فارسی دسترس‌پذیری محتوای وب. بازیابی‌شده از: https://pwcag.ir/inclusive/ (دسترسی در 8/12/1401)

صالحی‌مزده، فاطمه، نسترن زنجانی، و زهرا عسگری‌نژاد امیری. 1400. نقش هوش مصنوعی در تعامل نابینایان با دنیای دیجیتال. سومین کنفرانس ملی پژوهش‌های نوین در مهندسی و علوم کاربردی. دانشگاه آیت ا... العظمی بروجردی.

صدیقی، زینب. 1395. بررسی مؤلفه‌های رابط کاربر کتابخانه‌های دیجیتال از نظر ارائه خدمات به نابینایان و ناشنوایان و ارائه الگوی پیشنهادی. رساله دکتری دانشگاه آزاد اسلامی، واحد همدان.

صیامیان، حسن، محمد حسن‌زاده، فاطمه نوشین‌فرد، و نجلا حریری. 1393. بررسی میزان استفاده نابینایان ایران از فناوری اطلاعات و ارتباطات جهت تأمین نیازهای اطلاعاتی. فصلنامه فناوری اطلاعات و ارتباطات در علوم تربیتی‌ 4 (4 (پیاپی 16)): 5-21.‎

عبد نیکویی‌پور، الهام. 1389. تعامل انسان-کامپیوتر مبتنی ‌بر عامل برای نابینایان. ‌پایان‌نامه کارشناسی‌ارشد دانشگاه صنعتی امیرکبیر (پلی‌تکنیک).

گرت، جسی جیمز. 2011. المان‌های تجربه کاربری طراحی کاربرمحور در وب و فراتر از آن. مترجمان: الهام راسخ و همکاران. 1395. تهران: ناقوس.

معینی، سهیل. 1398. نشست تخصصی چالش‌های نشریات نابینایان و کم‌بینایان. وزارت فرهنگ و ارشاد اسلامی، دفتر مطالعات و برنامه‌ریزی رسانه.

مکبری، آرتا. 1400. دسترس‌پذیری چیست و چرا تولید محصول فراگیر (Inclusive) مهم است؟ شیوه‌نامۀ فارسی دسترس‌پذیری محتوای وب نسخۀ ۲.۲. بازیابی‌شده از: https://pwcag.ir/inclusive/ (دسترسی در 22/8/1402)

نجفقلی‌نژاد، اعظم. 1402. دسترس‌پذیری و کاربردپذیری رابط کاربری نظام‌های بازیابی اطلاعات کتابخانه‌ای بر اساس تجربه کاربران با آسیب بینایی و ارائه الگو. طرح پژوهش مؤظف معاونت پژوهش و منابع دیجیتال سازمان اسناد و کتابخانه ملی ایران.

نظری، مینا. 1399. نقش هوش مصنوعی فناوری‌های نوین ارتباطی در توسعه سواد رسانه‌ای نابینایان. فصلنامه رسانه 31 (2): 67-82.‎

References:

Abdnikoyipour, E. 2010 .Agent-based Human-Computer Interaction for the Visually-Iimpaired Users. Master’s Thesis of Amirkabir University of Technology (Polytechnic). [In Persian]

Adib, Y. and A. Azimi Aqbolagh, A. 2020. An Analysis of the Academic Limitations of Blind and visually impaired students: A Qualitative Research. Psychology of Exceptional Individuals 10 (40): 99-132. [In Persian]

Alahmadi, T., and S. Drew. 2017. Accessibility evaluation of top-ranking university websites in world, Oceania, and Arab categories for home, admission, and course description webpages. Journal of Open, Flexible and Distance Learning 21 (1): 7-24.

Babu, R., and R. Singh. 2009. Evaluation of web accessibility and usability from blind user’s perspective: the context of online assessment. In Proceedings of the Fifteenth Americas Conference on Information Systems (AMCIS 2009) (Paper 623). San Francisco, CA. Retrieved from https://aisel.aisnet.org/amcis2009/623 (accessed Oct. 12, 2025).

Comeaux, D., and A. Schmetzke. 2013. Accessibility of academic library web sites in North America: Current status and trends (2002‐2012). Library hi tech 31 (1): 8-33.

Conway, V., J. Brown, S. Hollier, and C. Nicholl. 2012. Website accessibility: A comparative analysis of Australian national and state/territory library websites. The Australian Library Journal 61 (3): 170-188.

Executive Regulations of Article 3 of the Law on Protection of the Rights of Persons with Disabilities. 2019. https://rc.majlis.ir/fa/law/print_version/1385205 (accessed Sep. 11, 2022). [In Persian]

Fakrudeen, M. 2024. Evaluation of the accessibility and usability of university websites: a comparative study of the Gulf region. Universal Access in the Information Society 24 (2): 1883-1898: 1-16.

Ferdous, J., H. N. Lee, S. Jayarathna, and V. Ashok. 2023. Enabling Efficient Web Data-Record Interaction for People with Visual Impairments via Proxy Interfaces. ACM Transactions on Interactive Intelligent Systems 13 (3): 1-27.

Fichten, C. S., V. Ferraro, J. V. Asuncion, C. Chwojka, M. Barile, M. N. Nguyen, ... and J. Wolforth. 2009. Disabilities and e-learning problems and solutions: An exploratory study. Journal of Educational Technology & Society 12 (4): 241-256.

Foley, A. 2011. Exploring the design, development and use of websites through accessibility and usability studies. Journal of Educational Multimedia and Hypermedia 20 (4): 361-385.

Garrett, J. J. 2011. The elements of user experience: user-centered design for the Web and beyond. Translated by Elham Rasekh, Mohsen Lotfalipour, Meysam Hadigheh, and Mohsen Faghihi (2016). Tehran: Nagoos. [In Persian]

ISO/TS 20282-2. 2013. Usability of consumer products and products for public use. https://www.iso.org/standard/62733.html (accessed Aug. 29, 2021)

Kulikauskienė, K., and L. Liukinevičienė. 2020. The theoretical model of an inclusive library for people with disabilities and its practical implementation. Izzivi prihodnosti 2: 79-101.

Kutlutürk, L. 2022. ENGELLİ AKADEMİSYENLER BAĞLAMINDA AKADEMİK ATAMA/YÜKSELTME KRİTERLERİ İÇİN KULLANILAN WEB SİTELERİNİN ERİŞİLEBİLİRLİĞİNİN DEĞERLENDİRİLMESİ. Uluslararası Toplumsal Bilimler Dergisi 6 (2): 1-17.

Lazar, J., A. Olalere, & B. Wentz. 2012. Investigating the accessibility and usability of job application web sites for blind users. Journal of Usability Studies 7 (2): 68-87.

Moeini, S. 2019. Specialized meeting on the challenges of publications for the blind and visually impaired. Ministry of Culture and Islamic Guidance, Office for Media Studies and Planning. [In Persian]

Mokaberi, A. 2021. What is accessibility and why is creating inclusive products important? Persian Web Content Accessibility Guidelines (Version 2.2). https://pwcag.ir/inclusive/ (accessed November 13, 2023) [In Persian]

Mulliken, A. 2019. Eighteen blind library users’ experiences with library websites and search tools in US academic libraries: A qualitative study. http://dspace.fudutsinma.edu.ng/xmlui/handle/123456789/1672 (accessed Oct. 5, 2022)

Najafgholinejad, A. 2023. Accessibility and usability of user interfaces of library information retrieval systems Based on the experiences of users with visual impairments and a proposed model. Research project commissioned by the Research and Digital Resources Deputy, National Library and Archives of Iran. [In Persian]

Nazari, M. 2020. The role played by the artificial intelligence and modern technologies in promotion of media literacy of the blind. Rasaneh 31 (2): 67-82. [In Persian]

Pitts, J. E., L. C. Bonella, J. M. Coleman, and A. Wathen. (Eds.). 2019. Library services for online patrons: A manual for facilitating access, learning, and engagement. California: Libraries Unlimited.

Rojas, H., R. Renteria, E. Acosta, H. Arévalo, and M. Pilares. 2020. Application of accessibility guidelines in a virtual museum. In 2020 3rd International Conference of Inclusive Technology and Education (CONTIE) (pp. 73-79). IEEE.

Salehi-Mazdeh, F., N. Zanjani, & Z. Asgarinezhad Amiri. 2021. The role of artificial intelligence in the interaction of visually impaired people with the digital world. In Proceedings of the 3rd National Conference on New Research in Engineering and Applied Sciences, Ayatollah Borujerdi University, Borujerd, Iran. [In Persian]

Shera, A., M. W. Iqbal, S. K. Shahzad, M. Gul, N. A Mian, M. R. Naqvi, and B. A. Khan. 2021. Blind and visually impaired user interface to solve accessibility problems. Intelligent Automation and Soft Computing 30 (1): 285-301.

Siamian, H., M. Hassanzadeh, F. Noshinfard, & N. Hariri. 2014. Investigating the extent of information and communication technology use by blind people in Iran to meet their information needs. Information and Communication Technology in Educational Sciences 4 (4 [16]): 5–21. [In Persian]

Swierenga, S. J., J. Sung, G. L. Pierce, D. B. and Propst. 2011. Website design and usability assessment implications from a usability study with visually impaired users. In Universal Access in Human-Computer Interaction. Users Diversity: 6th International Conference, UAHCI 2011, Held as Part of HCI International 2011, Orlando, FL, USA, July 9-14, 2011, Proceedings, Part II 6 (pp. 382-389).

The general structure of the WCAG guideline and an introduction to conformity levels A, AA, AAA. 2021. Persian Web Content Accessibility Guideline (Trans. Omid Hashemi; Eds. Arta Mokaberi & Hossein Sharafi). https://pwcag.ir/inclusive/ (accessed Feb. 27, 2023). [In Persian]

The WebAIM Million. 2023. https://webaim.org/projects/million/ (accessed Mar. 1, 2022)

UN Flagship Report on Disability and Development. 2018. Realization of the Sustainable Development Goals by, For and with Persons with Disabilities. https://www.ohchr.org/sites/default/files/Documents/HRBodies/CRPD/UN2018FlagshipReportDisability.pdf (accessed Oct. 8, 2022)

Web Content Accessibility Guidelines (WCAG) 2.2. 2023. W3C Recommendation. https://www.w3.org/TR/WCAG22/ (accessed Nov. 1, 2023)

World Summit on the Information Society (WSIS). 2013. WSIS+10 Review and Strategic Directions for Building Inclusive Knowledge Societies for Persons with Disabilities. Published by United Nations Educational, Scientific and Cultural Organization (UNESCO). https://g3ict.org/publication/wsis-10-review-and-strategic-directions-for-building-inclusive-knowledge-societies-for-persons-with-disabilities (accessed Oct. 18, 2022)

Xie, I., R. Babu, T. H. Lee, M. D. Castillo, S. You, and A. M. Hanlon. 2020. Enhancing usability of digital libraries: Designing help features to support blind and visually impaired users. Information Processing & Management 57 (3): 102110.

Xie, I., S. Wang, H. S. Lee, and T. H. Lee. 2023. Designing Digital Libraries to Support Blind and Visually Impaired Users: A methodological reflection on a large-scale project. Qualitative and Quantitative Methods in Libraries 12 (4): 529-547.

Yoon, K., R. Dols, L. Hulscher, and T. Newberry. 2016. An exploratory study of library website accessibility for visually impaired users. Library & Information Science Research 38 (3): 250-258.

Zare, S., S. Rahmatizadeh, and S. Valizadeh-Haghi. 2021. Academic Medical Libraries and Accessibility Challenges: The Conformance of the Websites with the WCAG2 1. DESIDOC Journal of Library and Information Technology, 41 (2): 102-107.