Introduction and Purpose: The primary objective of this study was to evaluate the level of User Interface (UI) usability in mental health management systems and compare their performance based on Nielsen’s 10 Usability Heuristics. These principles delineate critical aspects of user-system interaction, directly influencing ease of use, error reduction, and increased user satisfaction and trust within sensitive clinical environments.
Methodology: This descriptive-cross-sectional study was conducted in the summer of 1404 (2025). The research population included mental health-focused health management systems. Through targeted sampling at national and international levels, four systems were ultimately selected: one domestic (Bioarc) and three international ones (SimplePractice, Jane, and ICANote). The evaluation employed a heuristic evaluation method using a checklist based on Nielsen's 10 principles (Cronbach's\alpha = 0.974). The evaluation team consisted of three experts (Information Science specialist, Psychiatrist, and UX expert), who independently analyzed the data using a 5-point Likert scale. Descriptive statistics, Kruskal-Wallis H Test, and Mann-Whitney U Test were used for data analysis and group comparisons, respectively.
Findings: The evaluation results demonstrated that the overall usability level of the four assessed systems varied between 3.48 and 4.54, with this difference being statistically significant (Sig. = 0.041).Highest Rank: ICANote achieved the highest usability score with a mean of 4.54.Second Rank: SimplePractice followed closely with a mean of 4.50. These two systems exhibited superior performance in key heuristics such as Aesthetic and Minimalist Design, Consistency and Standards, and Help and Documentation.Third Rank: Jane scored an acceptable mean of 4.16.Lowest Rank: Bioarc ranked last with a mean of 3.48, indicating significant deficiencies, particularly in Flexibility and Efficiency of Use and Help and Documentation, requiring substantial revision.The Kruskal-Wallis test confirmed a significant difference in five core heuristics: Match between System and the Real World (Sig. = 0.015), Consistency and Standards (Sig. = 0.025), Recognition rather than Recall (Sig. = 0.038), Aesthetic and Minimalist Design (Sig. = 0.046), and Help and Documentation (Sig. = 0.037). The post-hoc Mann-Whitney test indicated that the Bioarc system was the primary source of these differences, showing a lower usability level compared to the other three. The lowest overall scores were observed in the Flexibility and Efficiency of Use and Help Users Recognize and Recover from Errors heuristics, highlighting a need for improved customized pathways and intelligent error support.
Conclusion: Usability levels in mental health management systems are not uniform, and the observed differences carry significant operational implications. Deficiencies in crucial heuristics, such as in the domestic system (Bioarc), can lead to increased user errors, decreased efficiency, and resistance to system adoption. ICANote and SimplePractice, by better adhering to user-centered design principles, provide a more effective and efficient experience for mental health professionals, setting a valuable standard for the development and localization of domestic systems.