Designing a Model for Evaluating Iranian University Websites: Using Fuzzy VIKOR Approach

Authors

Abstract

Academic websites are one of the most important criteria to measure university websites worldwide. In this paper a model based on multi-criteria decision-making for measuring university website’s evaluation indicators is introduced. The proposed model has six main dimensions including “usability”, “content”, “functionality”, “student services”, “efficiency” and “reliability” along with fourteen indicators including “understandability”, “coverage”, “accuracy”, “clarity”, “university identity”, “educational information”, “navigability”, “student-centeredness”, “control”, “student web-based support”, “maintenance”, “accessibility”, “speed” and “link error”. In the next step, due to the inherent ambiguity in these concepts of indicators, a combination of fuzzy set method with the VIKOR ranking method has been used to weigh and rank indicators and metrics. In VIKOR method, an attempt is made to select the closest answer to the ideal option. Finally, a detailed evaluation model has been developed to measure academic websites’ quality. Then, by applying the proposed model on the website of top ten universities in Iran, the results are reviewed. According to these results, the “accuracy” index is the most important, and the “link error” indicator is the least important among all indicators. These results also show that there is no significant correlation between “fuzzy-VIKOR” method, “webometrics” method, and “web assessment index” method. The results of this study help university website designers become aware of weaknesses of web designs and use it to strengthen academic websites.

Keywords


  1. Abdel-Basset, Mohamed, Yongquan Zhou, Mai Mohamed, and Victor Chang. 2018. A Group Decision Making Framework Based on Neutrosophic VIKOR Approach for E-Government Website Evaluation. Journal of Intelligent and Fuzzy Systems 34 (6): 13-24. [DOI:10.3233/JIFS-171952]
  2. Abdel-Basset, Mohamed, Yongquan Zhou, Mai Mohamed, and Victor Chang. 2018. A Group Decision Making Framework Based on Neutrosophic VIKOR Approach for E-Government Website Evaluation. Journal of Intelligent and Fuzzy Systems 34 (6): 13-24. [DOI:10.3233/JIFS-171952]
  3. Acosta-Vargas, Patricia, Mario González, and Sergio Luján-Mora. 2020. Dataset for Evaluating the Accessibility of the Websites of Selected Latin American Universities. Data in Brief 28: 1-6. [DOI:10.1016/j.dib.2019.105013]
  4. Acosta-Vargas, Patricia, Mario González, and Sergio Luján-Mora. 2020. Dataset for Evaluating the Accessibility of the Websites of Selected Latin American Universities. Data in Brief 28: 1-6. [DOI:10.1016/j.dib.2019.105013]
  5. Afful-Dadzie, Eric, Stephen Nabareseh, and Zuzana Komínková Oplatková. 2014. Fuzzy VIKOR approach: Evaluating quality of internet health information. Computer Science and Information Systems 2: 183-190. [DOI:10.15439/2014F203]
  6. Afful-Dadzie, Eric, Stephen Nabareseh, and Zuzana Komínková Oplatková. 2014. Fuzzy VIKOR approach: Evaluating quality of internet health information. Computer Science and Information Systems 2: 183-190. [DOI:10.15439/2014F203]
  7. Ahmed, Noushad. 2017. Content Evaluation of Select Websites of Department of Library and Information Science in North India. Library Philosophy and Practice 1578: 1-16.
  8. Ahmed, Noushad. 2017. Content Evaluation of Select Websites of Department of Library and Information Science in North India. Library Philosophy and Practice 1578: 1-16.
  9. Al-Omar, Khalid. 2016. Credibility Evaluation of Online Distance Education Websites. International Journal of Advanced Computer Science and Applications 7 (12): 56-62. [DOI:10.14569/IJACSA.2016.071246]
  10. Al-Omar, Khalid. 2016. Credibility Evaluation of Online Distance Education Websites. International Journal of Advanced Computer Science and Applications 7 (12): 56-62. [DOI:10.14569/IJACSA.2016.071246]
  11. Al-Qallaf, Charlene L., and Alaa Ridha. 2019. A Comprehensive Analysis of Academic Library Websites: Design, Navigation, Content, Services, and Web 2.0 Tools. International Information and Library Review 51 (2): 93-106. [DOI:10.1080/10572317.2018.1467166]
  12. Al-Qallaf, Charlene L., and Alaa Ridha. 2019. A Comprehensive Analysis of Academic Library Websites: Design, Navigation, Content, Services, and Web 2.0 Tools. International Information and Library Review 51 (2): 93-106. [DOI:10.1080/10572317.2018.1467166]
  13. Aydin, Serhat, and Cengiz Kahraman. 2012. Evaluation of E-Commerce Website Quality Using Fuzzy Multi-Criteria Decision Making Approach. IAENG International Journal of Computer Science 39 (1): 64-70.
  14. Aydin, Serhat, and Cengiz Kahraman. 2012. Evaluation of E-Commerce Website Quality Using Fuzzy Multi-Criteria Decision Making Approach. IAENG International Journal of Computer Science 39 (1): 64-70.
  15. Bag, Surajit. 2016. Fuzzy VIKOR Approach for Selection of Big Data Analyst in Procurement Management 10 (1), a230: 1-6. [DOI:10.4102/jtscm.v10i1.230]
  16. Bag, Surajit. 2016. Fuzzy VIKOR Approach for Selection of Big Data Analyst in Procurement Management 10 (1), a230: 1-6. [DOI:10.4102/jtscm.v10i1.230]
  17. Basher, Hanan T., Dawn Mary Kristine C. Gacus, Rachell P. Mingo, and Aloha May H. Ambe. 2014. A User-Centered Evaluation of a University Website. Journal of Industrial and Intelligent Information 2 (3): 10-16. [DOI:10.12720/jiii.2.3.210-216]
  18. Basher, Hanan T., Dawn Mary Kristine C. Gacus, Rachell P. Mingo, and Aloha May H. Ambe. 2014. A User-Centered Evaluation of a University Website. Journal of Industrial and Intelligent Information 2 (3): 10-16. [DOI:10.12720/jiii.2.3.210-216]
  19. Bhalaji, R. K. A., S. Bathrinath, & S. Saravanasankar. 2020. A Fuzzy VIKOR method to analyze the risks in lean manufacturing implementation. Materials Today: Proceedings, xxxx. [DOI:10.1016/j.matpr.2020.05.123]
  20. Bhalaji, R. K. A., S. Bathrinath, & S. Saravanasankar. 2020. A Fuzzy VIKOR method to analyze the risks in lean manufacturing implementation. Materials Today: Proceedings, xxxx. [DOI:10.1016/j.matpr.2020.05.123]
  21. Ćelić, Jasmin, Aleksandar Cuculić, and Sanjin Valčić. 2016. A Comparative Analysis of Maritime Universities Websites. Journal of Maritime & Transportation Science 51 (1): 47-60. [DOI:10.18048/2016.51.10]
  22. Ćelić, Jasmin, Aleksandar Cuculić, and Sanjin Valčić. 2016. A Comparative Analysis of Maritime Universities Websites. Journal of Maritime & Transportation Science 51 (1): 47-60. [DOI:10.18048/2016.51.10]
  23. Chu, Mei-Tai, Joseph Shyu, Gwo-Hshiung Tzeng, and Rajiv Khosla. 2007. Comparison among three analytical methods for knowledge communities group-decision analysis. Expert Systems with Applications 33: 1011-1024. [DOI:10.1016/j.eswa.2006.08.026]
  24. Chu, Mei-Tai, Joseph Shyu, Gwo-Hshiung Tzeng, and Rajiv Khosla. 2007. Comparison among three analytical methods for knowledge communities group-decision analysis. Expert Systems with Applications 33: 1011-1024. [DOI:10.1016/j.eswa.2006.08.026]
  25. Cimino, Serena, and Francesco Micali. 2008. Web Q-Model : A New Approach to the Quality. Proceedings of The 26th Annual CHI Conference on Human Factors in Computing Systems ?: 1-6.
  26. Cimino, Serena, and Francesco Micali. 2008. Web Q-Model : A New Approach to the Quality. Proceedings of The 26th Annual CHI Conference on Human Factors in Computing Systems ?: 1-6.
  27. Devi, Kalpana, and Aman Kumar Sharma. 2016. Framework for Evaluation of Academic Website. International Journal of Computer Techniques 3 (2): 234-239.
  28. Devi, Kalpana, and Aman Kumar Sharma. 2016. Framework for Evaluation of Academic Website. International Journal of Computer Techniques 3 (2): 234-239.
  29. Fung, Reese Hoi Yin, Dickson K. W. Chiu, Eddie H. T. Ko, Kevin K. W. Ho, and Patrick Lo. 2016. Heuristic Usability Evaluation of University of Hong Kong Libraries' Mobile Website. Journal of Academic Librarianship 42 (5): 81-94. [DOI:10.1016/j.acalib.2016.06.004]
  30. Fung, Reese Hoi Yin, Dickson K. W. Chiu, Eddie H. T. Ko, Kevin K. W. Ho, and Patrick Lo. 2016. Heuristic Usability Evaluation of University of Hong Kong Libraries' Mobile Website. Journal of Academic Librarianship 42 (5): 81-94. [DOI:10.1016/j.acalib.2016.06.004]
  31. Gharibeniazi, Monireh, Masumeh Karbala Aghaei Kamran, and Amir Ghaebi. 2015. Iranian State University Websites. International Journal of Information Science and Management 13 (1): 71-85.
  32. Gharibeniazi, Monireh, Masumeh Karbala Aghaei Kamran, and Amir Ghaebi. 2015. Iranian State University Websites. International Journal of Information Science and Management 13 (1): 71-85.
  33. Hadullo, Kennedy, Robert Oboko, and Elijah Omwenga. 2017. A Model for Evaluating E-Learning Systems Quality in Higher Education in Developing Countries. International Journal of Education and Development Using Information and Communication Technology 13 (2): 185-204.
  34. Hadullo, Kennedy, Robert Oboko, and Elijah Omwenga. 2017. A Model for Evaluating E-Learning Systems Quality in Higher Education in Developing Countries. International Journal of Education and Development Using Information and Communication Technology 13 (2): 185-204.
  35. Hasan, Layla. 2014. Evaluating the Usability of Educational Websites Based on Students' Preferences of Design Characteristics. International Arab Journal of E-Technology 3 (3): 79-93.
  36. Hasan, Layla. 2014. Evaluating the Usability of Educational Websites Based on Students' Preferences of Design Characteristics. International Arab Journal of E-Technology 3 (3): 79-93.
  37. Ikram, M., Zhang, Q., & R. Sroufe. 2020. Developing integrated management systems using an AHP-Fuzzy VIKOR approach. Business Strategy and the Environment 29 (6): 2265-2283. [DOI:10.1002/bse.2501]
  38. Ikram, M., Zhang, Q., & R. Sroufe. 2020. Developing integrated management systems using an AHP-Fuzzy VIKOR approach. Business Strategy and the Environment 29 (6): 2265-2283. [DOI:10.1002/bse.2501]
  39. Ismail, Abid, and K. S. Kuppusamy. 2019. Web Accessibility Investigation and Identification of Major Issues of Higher Education Websites with Statistical Measures: A Case Study of College Websites. Journal of King Saud University - Computer and Information Sciences. [DOI:10.1016/j.jksuci.2019.03.011]
  40. Ismail, Abid, and K. S. Kuppusamy. 2019. Web Accessibility Investigation and Identification of Major Issues of Higher Education Websites with Statistical Measures: A Case Study of College Websites. Journal of King Saud University - Computer and Information Sciences. [DOI:10.1016/j.jksuci.2019.03.011]
  41. Kaur, S., Kaur, K., & P. Kaur. 2016. An Empirical Performance Evaluation of Universities Website. International Journal of Computer Applications 146 (15): 10-16. [DOI:10.5120/ijca2016910922]
  42. Kaur, S., Kaur, K., & P. Kaur. 2016. An Empirical Performance Evaluation of Universities Website. International Journal of Computer Applications 146 (15): 10-16. [DOI:10.5120/ijca2016910922]
  43. Jati, Handaru, and Dhanapal Durai Dominic. 2017. A New Approach of Indonesian University Webometrics Ranking Using Entropy and PROMETHEE II. 4th Information Systems International Conference 444-451. Bali, Indonesia. [DOI:10.1016/j.procs.2017.12.176]
  44. Jati, Handaru, and Dhanapal Durai Dominic. 2017. A New Approach of Indonesian University Webometrics Ranking Using Entropy and PROMETHEE II. 4th Information Systems International Conference 444-451. Bali, Indonesia. [DOI:10.1016/j.procs.2017.12.176]
  45. Lee-Geiller, Seulki, and Taejun (David) Lee. 2019. Using Government Websites to Enhance Democratic E-Governance: A Conceptual Model for Evaluation. Government Information Quarterly 36 (2): 20-25. [DOI:10.1016/j.giq.2019.01.003]
  46. Lee-Geiller, Seulki, and Taejun (David) Lee. 2019. Using Government Websites to Enhance Democratic E-Governance: A Conceptual Model for Evaluation. Government Information Quarterly 36 (2): 20-25. [DOI:10.1016/j.giq.2019.01.003]
  47. Losonczi, György. 2011. University Website Ranking: Webometrics v. GPR. http://www.webometrics.info/en/Objetive: 1-18.
  48. Losonczi, György. 2011. University Website Ranking: Webometrics v. GPR. http://www.webometrics.info/en/Objetive: 1-18.
  49. Marincas, Delia Adriana, and Sidonia Otilia Vultur. 2007. Web Site Projects Evaluation - a Case Study. Journal of Applied Quantitative Method 2 (3): 289-301.
  50. Marincas, Delia Adriana, and Sidonia Otilia Vultur. 2007. Web Site Projects Evaluation - a Case Study. Journal of Applied Quantitative Method 2 (3): 289-301.
  51. Meleo-Erwin, Zoë, Betty Kollia, Joe Fera, Alyssa Jahren, and Corey Basch. 2020. Online Support Information for Students with Disabilities in Colleges and Universities during the COVID-19 Pandemic. Disability and Health 14 (1): 1-20. [DOI:10.1016/j.dhjo.2020.101013]
  52. Meleo-Erwin, Zoë, Betty Kollia, Joe Fera, Alyssa Jahren, and Corey Basch. 2020. Online Support Information for Students with Disabilities in Colleges and Universities during the COVID-19 Pandemic. Disability and Health 14 (1): 1-20. [DOI:10.1016/j.dhjo.2020.101013]
  53. Menzi-Çetin, Nihal, Ecenaz Alemdağ, Hakan Tüzün, and Merve Yıldız. 2017. Evaluation of a University Website's Usability for Visually Impaired Students. Universal Access in the Information Society 16 (1): 51-60. [DOI:10.1007/s10209-015-0430-3]
  54. Menzi-Çetin, Nihal, Ecenaz Alemdağ, Hakan Tüzün, and Merve Yıldız. 2017. Evaluation of a University Website's Usability for Visually Impaired Students. Universal Access in the Information Society 16 (1): 51-60. [DOI:10.1007/s10209-015-0430-3]
  55. Mich, Luisa, Mariangela Franch, and Gabriella Cilione. 2003. Evaluating and Designing Website Quality. Journal of Web Engineering 2 (1&2): 105-127.
  56. Mich, Luisa, Mariangela Franch, and Gabriella Cilione. 2003. Evaluating and Designing Website Quality. Journal of Web Engineering 2 (1&2): 105-127.
  57. Olaleye, Sunday Adewale, Ismaila Temitayo Sanusi, Dandison Ukpabi, and Okunoye. 2018. Evaluation of Nigeria Universities Websites Quality: a Comparative Analysis. Library Philosophy and Practice 1717: 1-14. [DOI:10.4018/IJESMA.2018100101]
  58. Olaleye, Sunday Adewale, Ismaila Temitayo Sanusi, Dandison Ukpabi, and Okunoye. 2018. Evaluation of Nigeria Universities Websites Quality: a Comparative Analysis. Library Philosophy and Practice 1717: 1-14. [DOI:10.4018/IJESMA.2018100101]
  59. Opricovic, Serafim, and Gwo-Hshiung Tzeng. 2007. Extended VIKOR method in comparison with outranking methods, Faculty of Civil Engineering. European Journal of Operational Research 178 (2): 514-529. [DOI:10.1016/j.ejor.2006.01.020]
  60. Opricovic, Serafim, and Gwo-Hshiung Tzeng. 2007. Extended VIKOR method in comparison with outranking methods, Faculty of Civil Engineering. European Journal of Operational Research 178 (2): 514-529. [DOI:10.1016/j.ejor.2006.01.020]
  61. Parvez, S. 2020. Application of fuzzy vikor and cluster analysis for performance evaluation of original equipment manufacturers. Materials Today: Proceedings, 1411-1416. [DOI:10.1016/j.matpr.2020.02.785]
  62. Parvez, S. 2020. Application of fuzzy vikor and cluster analysis for performance evaluation of original equipment manufacturers. Materials Today: Proceedings, 1411-1416. [DOI:10.1016/j.matpr.2020.02.785]
  63. Patricia, A. 2020. College Students' Use and Acceptance of Emergency Online Learning Due to COVID-19. International Journal of Educational Research Open 1: 1-13. [DOI:10.1016/j.ijedro.2020.100011]
  64. Patricia, A. 2020. College Students' Use and Acceptance of Emergency Online Learning Due to COVID-19. International Journal of Educational Research Open 1: 1-13. [DOI:10.1016/j.ijedro.2020.100011]
  65. Shekarian, Ehsan, Salwa Abdul-rashid, and Ezutah Olugu. 2018. An Integrated Fuzzy VIKOR Method for Performance Management in Healthcare. In M. Tavana, K. Szabat, & K. Puranam (Ed.), Organizational Productivity and Performance Measurements Using Predictive Modeling and Analytics (pp. 40-61). IGI Global. [DOI:10.4018/978-1-5225-0654-6.ch003]
  66. Shekarian, Ehsan, Salwa Abdul-rashid, and Ezutah Olugu. 2018. An Integrated Fuzzy VIKOR Method for Performance Management in Healthcare. In M. Tavana, K. Szabat, & K. Puranam (Ed.), Organizational Productivity and Performance Measurements Using Predictive Modeling and Analytics (pp. 40-61). IGI Global. [DOI:10.4018/978-1-5225-0654-6.ch003]
  67. Sherafat, Abolfazl and Sayyed Mohammad Reza Davoodi. 2018. Designing a New Model for Organizational Websites Evaluation. International Journal of Information Science and Management 16 (1): 49-69.
  68. Sherafat, Abolfazl and Sayyed Mohammad Reza Davoodi. 2018. Designing a New Model for Organizational Websites Evaluation. International Journal of Information Science and Management 16 (1): 49-69.
  69. Tavana, Madjid, Ehsan Momeni, Nahid Rezaeiniya, Seyed Mostafa Mirhedayatian, and Hamidreza Rezaeiniya. 2013. A novel hybrid social media platform selection model using fuzzy ANP and COPRAS-G. Expert Systems with Applications 50: 5694-5702. [DOI:10.1016/j.eswa.2013.05.015]
  70. Tavana, Madjid, Ehsan Momeni, Nahid Rezaeiniya, Seyed Mostafa Mirhedayatian, and Hamidreza Rezaeiniya. 2013. A novel hybrid social media platform selection model using fuzzy ANP and COPRAS-G. Expert Systems with Applications 50: 5694-5702. [DOI:10.1016/j.eswa.2013.05.015]
  71. Triacca, Luca, Davide Bolchini, Luca Botturi, and Alessandro Inversini. 2004. MiLE: Systematic Usability Evaluation for E-learning Web Applications. . Aace Journal. 12 (4): 1-8
  72. Triacca, Luca, Davide Bolchini, Luca Botturi, and Alessandro Inversini. 2004. MiLE: Systematic Usability Evaluation for E-learning Web Applications. . Aace Journal. 12 (4): 1-8
  73. Webometric. 2020. http://www.webometrics.info/en/Asia/Iran%20%28Islamic%20Republic%20of%29 (accessed Nov. 2020)
  74. Webometric. 2020. http://www.webometrics.info/en/Asia/Iran%20%28Islamic%20Republic%20of%29 (accessed Nov. 2020)
  75. Yong, Deng. 2006. Plant location selection based on fuzzy TOPSIS. Int J Adv Manuf Technol 28: 839-844. [DOI:10.1007/s00170-004-2436-5]
  76. Yong, Deng. 2006. Plant location selection based on fuzzy TOPSIS. Int J Adv Manuf Technol 28: 839-844. [DOI:10.1007/s00170-004-2436-5]
  77. Zhang, Ping, and Gisela von Dran. 2001. Expectations and Rankings of Website Quality Features: Results of Two Studies. Proceedings of the 34th Hawaii International Conference on System Sciences Hawaii, USA. 1-10.
  78. Zhang, Ping, and Gisela von Dran. 2001. Expectations and Rankings of Website Quality Features: Results of Two Studies. Proceedings of the 34th Hawaii International Conference on System Sciences Hawaii, USA. 1-10.