Iranian Journal of Information Processing and Management

Iranian Journal of Information Processing and Management

Assessing Research Impact Based on Altmetrics Case Study: Iranian Scientific Products in Social Sciences and Computer Science Indexed in Scopus

Author
Mehri Sedighi
10.52547/jipm.36.3.679
Abstract
This study is an applied research.The main aim of this research is to evaluate the impact of the selected Iranian Scientific Products in two areas of social science and computer science indexed in Scopus using alternative indicators (Altmetrics).  The research community consists of the articles of the Iranian researchers in the subject areas of computer science and social sciences indexed at the Scopus Database in 2014-2018. Some of the most important Altmetric service providers such as Altmetrics Explorer and Plum Analytics have been used to assess the presence of the research outputs in the social media and their impact assessment. Also, the relationship between variables such as scientific collaboration of researchers, open access journals and the quality of research journals with altmetric activity has been investigated through appropriate correlation tests. The findings of data analysis showed that in the field of social sciences, the extent of the presence of the articles of the Iranian researchers in the social media is about 12% and in the field of computer science is only about 4% of the total retrieved articles. The most important social media publishing the Iranian articles in each of the two subject areas are Mendeley, Twitter and Facebook. Due to the low level of correlation coefficient between the two variables of scientific collaboration of researchers and the altmetric activity, it seems that the increase in the number of authors in the two thematic areas does not have a significant effect on the altmetric score of these articles. The results of the correlation test showed a significant and weak statistical relation between journal openness and the altmetric scores in the social sciences. While in the field of computer science there was no significant statistical relation between these two variables. Also, due to the correlation between the two variables of the quality of the journals published the studied articles and their altmetric activity in both areas of the study, it can be concluded that the published articles in the journals with higher quality indicators have higher altmetric scores and are more likely to be present in social media.The results of these studies show that using altmetric indicators, one can evaluate the impact of research in different subject areas and compare them. Science and technology Policy makers can consider the presence of articles in social media and altmetric indices in scientific policyalong with traditional research evaluation indicators
Keywords
Reseaech impact
Altmetrics
Scopus
Social Media
Social science
computer science
  1. احسانی، وحید، موسی اعظمی، سید محمدباقر نجفی، و فرامز سهیلی. 1395. اثربخشی پژوهش‌های علمیِ داخلی بر شاخص‌های توسعه‌ای ایران. پژوهشنامه پردازش و مدیریت اطّلاعات ۳۲ (۲): ۳۱۹-۳۴۷.
  2. احسانی، وحید، موسی اعظمی، سید محمدباقر نجفی، و فرامز سهیلی. 1395. اثربخشی پژوهش‌های علمیِ داخلی بر شاخص‌های توسعه‌ای ایران. پژوهشنامه پردازش و مدیریت اطّلاعات ۳۲ (۲): ۳۱۹-۳۴۷.
  3. پاشایی‌زاد، حسین، غلامرضا فدایی عراقی، عباس حری، و حمیدرضا حسن‌آبادی. 1390. بررسی تأثیر استنادی مقاله‌های مجلات علمی- پژوهشی فارسی‌زبان ایران. تحقیقات اطلاع‌رسانی و کتابخانه‌های عمومی 17 (2): 263-284.
  4. پاشایی‌زاد، حسین، غلامرضا فدایی عراقی، عباس حری، و حمیدرضا حسن‌آبادی. 1390. بررسی تأثیر استنادی مقاله‌های مجلات علمی- پژوهشی فارسی‌زبان ایران. تحقیقات اطلاع‌رسانی و کتابخانه‌های عمومی 17 (2): 263-284.
  5. ستوده، هاجر، زهرا مزارعی، و مهدیه میرزابیگی. 1394. بررسی رابطه میان شاخص‌های استنادی و نشان‌های سایتی و لایک: نمونه مورد مطالعه مقالات حوزه علم اطلاعات و کتابداری در سال‌های 2004-2012. پژوهشنامه پردازش و مدیریت اطلاعات 30 (4): 939-963.
  6. ستوده، هاجر، زهرا مزارعی، و مهدیه میرزابیگی. 1394. بررسی رابطه میان شاخص‌های استنادی و نشان‌های سایتی و لایک: نمونه مورد مطالعه مقالات حوزه علم اطلاعات و کتابداری در سال‌های 2004-2012. پژوهشنامه پردازش و مدیریت اطلاعات 30 (4): 939-963.
  7. شمس، علی، هوشنگ ایروانی، احمد رضوان‌فر، و خلیل کلانتری، خلیل. 1387. تحلیل عاملی مسائل و مشکلات پژوهش‌های کشاورزی در کشور. فصلنامه فناوری‌های نوین کشاورزی 2 (2): 87-102.
  8. شمس، علی، هوشنگ ایروانی، احمد رضوان‌فر، و خلیل کلانتری، خلیل. 1387. تحلیل عاملی مسائل و مشکلات پژوهش‌های کشاورزی در کشور. فصلنامه فناوری‌های نوین کشاورزی 2 (2): 87-102.
  9. عرفان‌منش، محمدامین. 1395. حضور مقاله‌های ایرانی علم اطلاعات و کتابداری در رسانه‌های اجتماعی: مطالعه آلتمتریک. پژوهشنامه پردازش و مدیریت اطلاعات ۳۲ (۲): ۳۴۹-۳۷۳.
  10. عرفان‌منش، محمدامین. 1395. حضور مقاله‌های ایرانی علم اطلاعات و کتابداری در رسانه‌های اجتماعی: مطالعه آلتمتریک. پژوهشنامه پردازش و مدیریت اطلاعات ۳۲ (۲): ۳۴۹-۳۷۳.
  11. عرفان‌منش، محمدامین. 1397. رابطه میان شاخص‌های فعالیت آلتمتریک و کیفیت مجله‌های علم اطلاعات و کتابداری در اسکوپوس. مطالعات ملی کتابداری و سازمان‌دهی اطلاعات 29 (2): 7-26.
  12. عرفان‌منش، محمدامین. 1397. رابطه میان شاخص‌های فعالیت آلتمتریک و کیفیت مجله‌های علم اطلاعات و کتابداری در اسکوپوس. مطالعات ملی کتابداری و سازمان‌دهی اطلاعات 29 (2): 7-26.
  13. گلتاجی، مرضیه، و عبدالرسول جوکار. 1396. وجود بروندادهای علمی حوزه انفورماتیک پزشکی در رسانه‌های اجتماعی: مطالعه آلتمتریک. مدیریت اطلاعات سلامت 14 (۲): 71-77.
  14. گلتاجی، مرضیه، و عبدالرسول جوکار. 1396. وجود بروندادهای علمی حوزه انفورماتیک پزشکی در رسانه‌های اجتماعی: مطالعه آلتمتریک. مدیریت اطلاعات سلامت 14 (۲): 71-77.
  15. گلشنی، مهدی. 1393. تب مقاله‌نویسی آفت است. سرآمد 9: 72-77.
  16. گلشنی، مهدی. 1393. تب مقاله‌نویسی آفت است. سرآمد 9: 72-77.
  17. Ale Ebrahim, N., H. Salehi, M. A. Embi, F. Habibi, H. Gholizadeh, and S. M. Motahar. 2014. Visibility and citation impact. International Education Studies 7 (4): 120-125. [DOI:10.5539/ies.v7n4p120]
  18. Ale Ebrahim, N., H. Salehi, M. A. Embi, F. Habibi, H. Gholizadeh, and S. M. Motahar. 2014. Visibility and citation impact. International Education Studies 7 (4): 120-125. [DOI:10.5539/ies.v7n4p120]
  19. Bar-Ilan, J. 2012. JASIST@mendeley. Presented at the ACM Web Science Conference Workshop on Altmetrics. Evanston, IL. Retrieved from http://altmetrics.org/altmetrics12/bar-ilan. (accessed May 10, 2018).
  20. Bar-Ilan, J. 2012. JASIST@mendeley. Presented at the ACM Web Science Conference Workshop on Altmetrics. Evanston, IL. Retrieved from http://altmetrics.org/altmetrics12/bar-ilan. (accessed May 10, 2018).
  21. Bong, Y. B., & N. Ale Ebrahim. 2017. The Rise of Alternative Metrics (Altmetrics) for Research Impact Measurement. Asia Research News. Retrieved from v1 http://www.researchsea.com/html/article.php/aid/10563/cid/60 (Accessed May 10, 2017). [DOI:10.6084 /m9.figshare.4814215.]
  22. Bong, Y. B., & N. Ale Ebrahim. 2017. The Rise of Alternative Metrics (Altmetrics) for Research Impact Measurement. Asia Research News. Retrieved from v1 http://www.researchsea.com/html/article.php/aid/10563/cid/60 (Accessed May 10, 2017). [DOI:10.6084 /m9.figshare.4814215.]
  23. Bornmann, L. (2014). Validity of altmetrics data for measuring societal impact: A study using data from Altmetric and F1000 Prime. Journal of Informetrics 8 (4): 935-950. [DOI:10.1016/j.joi.2014.09.007]
  24. Bornmann, L. (2014). Validity of altmetrics data for measuring societal impact: A study using data from Altmetric and F1000 Prime. Journal of Informetrics 8 (4): 935-950. [DOI:10.1016/j.joi.2014.09.007]
  25. Buschman, M., and A. Michalek. 2013. Are Alternative Metrics Still Alternative? Bulletin of the American Society for Information Science and Technology 39 (4): 35-39. [DOI:10.1002/bult.2013.1720390411]
  26. Buschman, M., and A. Michalek. 2013. Are Alternative Metrics Still Alternative? Bulletin of the American Society for Information Science and Technology 39 (4): 35-39. [DOI:10.1002/bult.2013.1720390411]
  27. Costas, R., Z. Zahedi, and P. Wouters. (2014). Do altmetics correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective. Journal of the Association for Information Science and Technology. Available from: http://arxiv.org/ abs/ 66 (10): 2003-2019. [DOI:10.1002/asi.23309]
  28. Costas, R., Z. Zahedi, and P. Wouters. (2014). Do altmetics correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective. Journal of the Association for Information Science and Technology. Available from: http://arxiv.org/ abs/ 66 (10): 2003-2019. [DOI:10.1002/asi.23309]
  29. Das, A. K., and S. Mishra. (2014). Genesis of Altmetrics or Article-level Metrics for Measuring Efficacy of Scholarly Communications: Current Perspectives. Scientometric Research 3 (2): 82-92. [DOI:10.4103/2320-0057.145622]
  30. Das, A. K., and S. Mishra. (2014). Genesis of Altmetrics or Article-level Metrics for Measuring Efficacy of Scholarly Communications: Current Perspectives. Scientometric Research 3 (2): 82-92. [DOI:10.4103/2320-0057.145622]
  31. Eysenbach, G. 2006. Citation advantage of open access articles. PLoS biology 4 (5): 692. [DOI:10.1371/journal.pbio.0040157]
  32. Eysenbach, G. 2006. Citation advantage of open access articles. PLoS biology 4 (5): 692. [DOI:10.1371/journal.pbio.0040157]
  33. Harnad, S., & T. Brody. 2004. Comparing the impact of Open Access (OA) vs. Non-OA articles in the same journals. D-Lib Magazine 10 (6). Retrieved from: http://www.dlib.org/dlib/june04/harnad/06harnad.html. (accessed Dec. 29 2017).
  34. Harnad, S., & T. Brody. 2004. Comparing the impact of Open Access (OA) vs. Non-OA articles in the same journals. D-Lib Magazine 10 (6). Retrieved from: http://www.dlib.org/dlib/june04/harnad/06harnad.html. (accessed Dec. 29 2017).
  35. Haustein S, R. Costas, & V. Larivière. 2015. Characterizing social media metrics of scholarly papers: the effect of document properties and collaboration patterns. PLoS ONE 10 (5): e0120495. [DOI:10.1371/journal.pone.0120495]
  36. Haustein S, R. Costas, & V. Larivière. 2015. Characterizing social media metrics of scholarly papers: the effect of document properties and collaboration patterns. PLoS ONE 10 (5): e0120495. [DOI:10.1371/journal.pone.0120495]
  37. Haustein, S., I. Peters, C. R. Sugimoto, M. Thelwall, & V. Larivière. 2014. Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature. Journal of the Association for Information Science & Technology 65 (4): 656-669. [DOI:10.1002/asi.23101]
  38. Haustein, S., I. Peters, C. R. Sugimoto, M. Thelwall, & V. Larivière. 2014. Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature. Journal of the Association for Information Science & Technology 65 (4): 656-669. [DOI:10.1002/asi.23101]
  39. Holmberg, K. J. 2015. Altmetrics for information professionals: past, present and future. Oxford, UK: Chandos Publishing. [DOI:10.1016/B978-0-08-100273-5.00002-8]
  40. Holmberg, K. J. 2015. Altmetrics for information professionals: past, present and future. Oxford, UK: Chandos Publishing. [DOI:10.1016/B978-0-08-100273-5.00002-8]
  41. Lahikainen, Johanna. 2016. Altmetrics in Social Sciences and Humanities: Possibilities, Challenges, and Experiences. Paper presented at: IFLA WLIC 2016 - Columbus, OH. Connections. Collaboration. Community in Session 136 - Social Science Libraries with Asia and Oceania.
  42. Lahikainen, Johanna. 2016. Altmetrics in Social Sciences and Humanities: Possibilities, Challenges, and Experiences. Paper presented at: IFLA WLIC 2016 - Columbus, OH. Connections. Collaboration. Community in Session 136 - Social Science Libraries with Asia and Oceania.
  43. Mohammadi, E., & M. Thelwall. 2914. Mendeley readership altmetrics for the social sciences and humanities: Research evaluation and knowledge flows. Journal of the Association for Information Science & Technology 65 (8): 1627-1638. [DOI:10.1002/asi.23071]
  44. Mohammadi, E., & M. Thelwall. 2914. Mendeley readership altmetrics for the social sciences and humanities: Research evaluation and knowledge flows. Journal of the Association for Information Science & Technology 65 (8): 1627-1638. [DOI:10.1002/asi.23071]
  45. Neylon, C. & S. Wu. (2009). Article-level metrics and the evolution of scientific impact. PLoS biology 7 (11): e.1000242. [DOI:10.1371/journal.pbio.1000242]
  46. Neylon, C. & S. Wu. (2009). Article-level metrics and the evolution of scientific impact. PLoS biology 7 (11): e.1000242. [DOI:10.1371/journal.pbio.1000242]
  47. Nuredini, K. & I. Peters. 2016. Enriching the knowledge of altmetrics studies by exploring social media metrics for Economic and Business Studies journals. In Proceedings of the 21st International Conference on Science and Technology Indicators, València (Spain).
  48. Nuredini, K. & I. Peters. 2016. Enriching the knowledge of altmetrics studies by exploring social media metrics for Economic and Business Studies journals. In Proceedings of the 21st International Conference on Science and Technology Indicators, València (Spain).
  49. Penfield, T., M. J. Baker, R. Scoble, and M. C. Wykes. 2014. Assessment, evaluations, and definitions of research impact: A review. Research Evaluation 23 (1): 21-32. [DOI:10.1093/reseval/rvt021]
  50. Penfield, T., M. J. Baker, R. Scoble, and M. C. Wykes. 2014. Assessment, evaluations, and definitions of research impact: A review. Research Evaluation 23 (1): 21-32. [DOI:10.1093/reseval/rvt021]
  51. Robinson-García, N., D. Torres-Salinas, Z. Zahedi, & R. Costas. 2014. New data, new possibilities: exploring the insides of Altmetric.com. El profesional de la información 23 (4): 359-366. [DOI:10.3145/epi.2014.jul.03]
  52. Robinson-García, N., D. Torres-Salinas, Z. Zahedi, & R. Costas. 2014. New data, new possibilities: exploring the insides of Altmetric.com. El profesional de la información 23 (4): 359-366. [DOI:10.3145/epi.2014.jul.03]
  53. Rowlands, I., D. Nicholas, B. Russell, N. Canty, & A. Watkinson. 2011. Social media use in the research workflow. Learned Publishing 24 (3): 183-195. [DOI:10.1087/20110306]
  54. Rowlands, I., D. Nicholas, B. Russell, N. Canty, & A. Watkinson. 2011. Social media use in the research workflow. Learned Publishing 24 (3): 183-195. [DOI:10.1087/20110306]
  55. Sud, P., and M. Thelwall. 2014. Evaluating altmetrics. Scientometrics 98 (2): 1131-1143. [DOI:10.1007/s11192-013-1117-2]
  56. Sud, P., and M. Thelwall. 2014. Evaluating altmetrics. Scientometrics 98 (2): 1131-1143. [DOI:10.1007/s11192-013-1117-2]
  57. Tammaro, A. M. 2014. Altmetrics in the humanities: perceptions of Italian scholars. Libraries in the Digital Age (LIDA) Proceedings. Available on: http://ozk.unizd.hr/proceedings/index.php/lida/article/view/167 (accessed Sep. 15, 2018).
  58. Tammaro, A. M. 2014. Altmetrics in the humanities: perceptions of Italian scholars. Libraries in the Digital Age (LIDA) Proceedings. Available on: http://ozk.unizd.hr/proceedings/index.php/lida/article/view/167 (accessed Sep. 15, 2018).
  59. Thelwall, M., & K. Kousha. 2013. ResearchGate Disseminating, Communicating and Measuring Scholarship? Available at: http://cba.scit.wlv.ac.uk/~cm 1993/papers/ResearchGate.pdf (accessed June 20, 2017).
  60. Thelwall, M., & K. Kousha. 2013. ResearchGate Disseminating, Communicating and Measuring Scholarship? Available at: http://cba.scit.wlv.ac.uk/~cm 1993/papers/ResearchGate.pdf (accessed June 20, 2017).
  61. Thelwall, M., S. Haustein, V. Larivière, & C. R. Sugimoto. 2013. Do altmetrics work? Twitter and ten other social web services. PloS one 8 (5): e.64841. [DOI:10.1371/journal.pone.0064841]
  62. Thelwall, M., S. Haustein, V. Larivière, & C. R. Sugimoto. 2013. Do altmetrics work? Twitter and ten other social web services. PloS one 8 (5): e.64841. [DOI:10.1371/journal.pone.0064841]
  63. Wykes T, S. Lipczynska, & M. Guha 2013. The h-index, the citation rating, impact factors and the aspiring researcher. J Ment Health 22 (6): 467-473. [DOI:10.3109/09638237.2013.850153]
  64. Wykes T, S. Lipczynska, & M. Guha 2013. The h-index, the citation rating, impact factors and the aspiring researcher. J Ment Health 22 (6): 467-473. [DOI:10.3109/09638237.2013.850153]
  65. Zahedi, Z., R. Costas, & P. Wouters. 2014. How well developed are altmetrics? A cross-disciplinary analysis of the presence of 'alternative metrics' in scientific publications. Scientometrics 101 (2): 1491-1513 [DOI:10.1007/s11192-014-1264-0]
  66. Zahedi, Z., R. Costas, & P. Wouters. 2014. How well developed are altmetrics? A cross-disciplinary analysis of the presence of 'alternative metrics' in scientific publications. Scientometrics 101 (2): 1491-1513 [DOI:10.1007/s11192-014-1264-0]

  • Receive Date 10 December 2022