In recent years, the comprehensive evaluation method that integrates quantitative evaluation and peer review has obtained massive recognition and attention. The Five-metrics provides the theoretical framework and methodological guidance for the comprehensive evaluation method. This study aims to clarify the situation and development of researchers and research hotspots and methodologies in the field. The study classifies the research progress in the field of Five-metrics and evaluation in this most recent decade. This study implements visual, social network, and content analyses. In addition, the study summarizes the research status and the development trend of Five-metrics and evaluation in the recent 10 years (2010-2020) in China from the perspectives of authors, institutions, journals, and keywords. Results show, but are not limited to, the following: authors in the fields were stable and live long lives; scientific research collaboration was mainly in a format of teacher-student collaboration; journals were still in the stage of sustainable development; core institutions take leading roles; relevant research focuses on webometrics, altmetrics, bibliometrics, science evaluation, academic influence, and peer review. Moreover, results show that: 1) research fields have been diversified, and research objects have been differentiated; 2) understanding/cognition has been comprehensive, and indicators have been precise; 3) evaluation systems have been integrated, and methodologies have been diversified.
References
[1]
Song, Y. and Qiu, J. (2019) The Evolution from “Three-Metrices” to “Five-Metrices”. Library Tribune, 39, 1-7.
[2]
Zhao, R. and Wei, M. (2017) Research Evolution of Five Metrology in China. Journal of Modern Information, 37, 155-159.
[3]
Liu, M., Zhang, X. and Yan, Y. (2016) Research on Method of Determining Scope of Word Set in Co-Word Analysis Based on Word Frequency, Number of Words, Cumulative Word Frequency in Proportion. Library and Information Service, 60, 135-142.
[4]
Yu, L., Wan, X. and Ju, C. (2019) Research on the Correction of Impact Factor Excessive Self-Citation in Academic Journals: Natural Impact Factor. Information Studies: Theory & Application, 42, 62-68.
[5]
Liu, A., Ge, J. and Yu, L. (2017) Two New Bibliometric Indicators: Cumulative Factor and Next Year Factor. Information Studies: Theory & Application, 40, 47-50.
[6]
Weng, J., Sun, C. and Lin, P. (2019) Correlation of Red Point Factor and Journal Evaluation Indicators: Taking Medical Comprehensive Journals for Examples. Chinese Journal of Scientific and Technical Periodicals, 30, 545-550.
[7]
Xu, X. (2018) Empirical Research on Half-Life Period of Journals Based on Downloads. Journal of Intelligence, 33, 117-121.
[8]
Yu, L., Wang, Z. and Zhang, Z. (2018) Comprehensive Amendment and Research on H Index: Htop Index. Journal of the China Society for Scientific and Technical Information, 37, 1188-1192.
[9]
Zhu, Y. and Zhu, H. (2012) Research and Demonstration of a New Academic Evaluation Index. Journal of Southwest Minzu University (Humanities and Social Science), 33, 230-233.
[10]
Liu, Y. and Yang, Y. (2014) Empirical Study of l-Sequence: The Basic h-Index Sequence for Cumulative Publications with Consideration of the Yearly Citation Performance. Journal of Informetrics, 8, 478-485. https://doi.org/10.1016/j.joi.2014.03.002
[11]
Liu, C. (2016) Article-Level Metrics: Development Process, Characteristics, Indicators and Application. Library Journal, 35, 63-69.
[12]
Li, X. and Li, Q. (2017) A Complementary Perspective for Traditional Bibliometrics and Scientific Evaluation: Full Time Span RPYS. Documentation, Information & Knowledge, 4, 89-99.
[13]
Cao, M. and Min, Y. (2011) Impact Assessment of Educational Websites in China. Open Education Research, 17, 104-110.
[14]
Ji, W., Qu, J. and Zeng, J. (2012) Study on Evaluation of Web Influence of the Major International Environmental Non-Government Organizations. Journal of Intelligence, 31, 129-133.
[15]
Ge, S. and Yang, X. (2018) Research on the Influence of University Rankings Based on Webometrics. Higher Education Exploration, 1, 28-37.
[16]
Xie, Z. (2019) Assessing the Attractions of MOOCs from the Perspective of Scientometrics. IEEE Access, 7, 136409-136418. https://doi.org/10.1109/ACCESS.2019.2942835
[17]
Liu, C. (2012) Scientometrics in the Web 2.0 Environment: Altmetrics. Library and Information Service, 56, 52-56.
[18]
Qiu, J. and Yu, H. (2013) The Putting forward Process and Research Progress of Altmetrics. Library and Information Service, 57, 5-12.
[19]
Liu, C. (2013) Study on the Altmetric Indicators of Paper Impact Based on PLOS API. Library and Information Service, 57, 89-95.
[20]
Wang, W. and Liu, C. (2017) Study on the Differences of the Evaluation Model of Academic Papers Impact between Different Domains. Library and Information Service, 61, 108-116.
[21]
Liu, X. and Song, W. (2016) Analysis on the Usability of Altmetrics Indicators Based on PLOS ALM. Library and Information Service, 60, 93-101.
[22]
You, Q. and Tang, S. (2014) Study on Correlation of Different Article-Level Metrics. Library and Information Service, 58, 79-84.
[23]
Zhang, Y. and Lang, L. (2018) Usability Analysis of Journal Evaluation by Using Mendeley Reader Counts. Journal of Intelligence, 37, 142-146.
[24]
Liu, C. (2015) Altmetrics: From Theoretical Hypothesis, Term Coined to Connotation Refining. Library and Information Service, 59, 82-89.
[25]
Liu, C. (2016) The Practice of Altmetrics Applied to Scientific Research Evaluation and Management: Controversy, Comment and Review. Science of Science and Management of S. & T, 37, 13-22.
[26]
Han, Y. (2016) The Aggregation Path Orientation of Scientific and Technological Evaluation under the Revival Context of Informal Communication. Journal of Library Science in China, 42, 64-74.
[27]
Yi, S. and Yu, B. (2019) A Correlation Research of Altmetrics and Bibliometric Indicators Based on Domestic Literature Management Platform. Journal of Intelligence, 38, 193-198.
[28]
Yang, R. and Liang, Y. (2015) A Comparative Study on the University Scientific Research Evaluation Methods at Home and Abroad. Journal of Intelligence, 34, 107-110.
[29]
Chen, S., Yu, H. and Zou, W. (2013) Research on Academic Impact Evaluation of Key Disciplines of University. Journal of Intelligence, 32, 81-85.
[30]
Ma, Y. and Huang, J. (2016) Realization of Application of iAuthor on Research Evaluation of Institutions. Journal of Library Science in China, 42, 97-108.
[31]
Wang, F. and Yang, C. (2016) Academic Influence Comprehensive Evaluation under the Multidimensional Informetrics Perspective: Status Quo and Prospect. Information and Documentation Services, 2, 23-28.
[32]
Li, Y., Yu, C. and Wang, W. (2012) On the Discovery and Evaluation of Universities Leading Talents—Exploration of Library Subject Service Practice. Journal of Modern Information, 32, 34-38.
[33]
Qu, H. and Wang, F. (2016) On the Method of Author’s Academic Influence Evaluation Based on Knowledge Association Network. Journal of Intelligence, 35, 190-195.
[34]
Yan, S., Chen, R. and Ji, J. (2016) Multi-Dimension Combinational Model for Appraising Innovation Ability of Research Teams. Journal of the China Society for Scientific and Technical Information, 35, 1072-1080.
[35]
Lv, R. and Chang, H. (2017) Research on Academic Influence of Scientist Academic Pedigree Based on Bibliomerics. Information Studies: Theory & Application, 40, 76-78.
[36]
Li, S. and Ye, Y. (2016) A Synthetic Comparative Study of Academic and Altmetric Indicators Acting on Single Publication. Library & Information, 1, 85-94.
[37]
Wang, X., Fang, Z. and Wang, H. (2015) Study on the Continuous, Dynamic and Comprehensive Article-Level Evaluation System. Science of Science and Management of S. & T, 36, 37-48.
[38]
Zhao, R. and Wang, X. (2019) Influence Evaluation of Academic Journals from the Perspective of Multidimensional Informetrics: Taking International LIS Journals as Examples. Chinese Journal of Scientific and Technical Periodicals, 30, 773-781.
[39]
Cao, J. (2017) The Practice of Real-Time Evaluation System of Academic Influence Based on Even Distribution and Altmetrics. Information Studies: Theory & Application, 40, 71-75.
[40]
Liu, C. (2012) Influence Evaluation Method of Scientific Papers Based on Soft Peer Review—F1000 Factor. Chinese Journal of Scientific and Technical Periodicals, 23, 383-386.
[41]
Song, L., Wang, J. and Wang, S. (2014) Observation of F1000, Mendeley and Traditional Bibliometric Indicators from the Perspective of Scientific Assessment. Journal of Library Science in China, 40, 48-54.
[42]
Song, L. and Wang, J. (2018) An Empirical Study of Scientific Evaluation Based on the Correlation between CNCI and Peer Review. Library and Information Service, 62, 122-128.
[43]
Wan, H., Tan, Z. and Zhang, F. (2017) Research on Method to Assist the Decision-Making of Project Evaluation through Peer Review—Based on BP Artificial Neural Network Model with Bayesian Regularization Correction. Journal of Intelligence, 36, 192-199.
