Interaction with web data and information and communication technologies plays a vital role in developing the information society and improving the quality of life for people with disabilities. Despite digital advancements, accessibility and usability gaps persist for visually impaired users. This study examines the compliance of Iran’s Institute for Scientific Information and Documentation (IranDoc) systems with international accessibility standards (WCAG 2.2) and evaluates the real user experience of blind and low-vision individuals. The findings aim to enhance inclusivity, educational equity, and the quality of digital services for this community, providing valuable insights for improving accessible scientific platforms in Iran.
This study adopts a quantitatively-driven approach to evaluate the accessibility and usability of the Iranian Research Institute for Information Science and Technology’s systems for users with visual impairments. Two primary methods were utilized: first, a technical assessment using the automated tool Accessibility Insights alongside an inspection based on the latest extracted indicators from the World Wide Web Consortium (W3C) Web Content Accessibility Guidelines (WCAG) 2.2 (edition 2023), focusing on priorities A and AA with a fuzzy evaluation approach; second, usability testing with real blind and low-vision users through task-based scenarios designed for each system and detailed observation of user interactions. Quantitative data—including task completion times, success rates, and pre- and post-test questionnaires—were statistically analyzed. Usability test data were further enriched through behavioral observations of 24 visually impaired participants (totaling 48 sessions), NVDA screen reader audio feedback, and HTML code analysis. User performance was measured by task success rate, time to complete tasks, satisfaction ratings, and the extent of assistance required. Purposeful and snowball sampling techniques were employed to recruit experienced users to effectively identify structural barriers to accessibility and usability. All user interactions were conducted online with full process recording. This multifaceted methodology integrates technical evaluations with end-user experience, thereby enhancing the validity and comprehensiveness of the findings.
The results of the technical evaluation using automated tools revealed that these systems paid limited attention to the contrast between text and background. Key accessibility elements—such as text alternatives for non-text content, labeling of form elements, link labels and names, and button labels—require further review and adjustment. Moreover, the findings indicated that none of the systems were fully compliant with WCAG 2.2 guidelines. Among the evaluated platforms, the Pishineh system demonstrated the highest level of compliance with accessibility criteria, achieving 71% at Level A and 77% at Level AA, making it the most accessible system. In contrast, the Ganj system exhibited the lowest compliance rate at Level AA (50%), while the remaining platforms showed varying degrees of accessibility across different levels. Despite partial adherence to many criteria at Levels A and AA, several key standards were not met at all. These included: lack of mechanisms for easily skipping repetitive content blocks, absence of clear textual content for page titles, failure to identify and describe user-generated errors, and inadequate provision of descriptive and logically ordered labels and headings. Usability testing data further revealed that task completion within the systems ranged from moderate to easy. The relatively high average scores indicate a generally favorable usability status among the IranDoc systems.
This study, through a systematic examination of screen reader users’ interactions with the Iranian Research Institute for Information Science and Technology (IranDoc) systems and an analysis of their compliance with the latest WCAG 2.2 indicators, has made a significant contribution to improving the accessibility and usability of these systems for users with visual impairments. The findings reveal that, despite some progress, there remains a need for fundamental reforms in user interface design, including enhanced color contrast, provision of comprehensive text alternatives, and optimization of semantic content structure and task workflows. Additionally, the development of accessible guides and documentation, as well as the implementation of key navigation features such as skip links, are essential for enhancing the user experience of this group. By employing a multifaceted methodology and engaging active participation from blind and low-vision users, this research provides a practical and reliable framework for evaluating and improving specialized Persian-language systems. The results can serve as a model for similar platforms in research and educational domains, offering a foundation for the development of more inclusive and equitable systems for scientific information access. Thus, this study represents an important step toward enhancing the quality of digital services for vulnerable users and achieving equity in access to scientific information.