Library and Information Service >
Correction for the Defect of Impact Factor Based on the Distributing Character of Citations: An Empirical Study of Positional Indicators Used in Journal Evaluation
Received date: 2016-02-29
Revised date: 2016-04-02
Online published: 2016-05-05
[Purpose/significance] The paper aims to probe into the roles of citation position indicators used in journal evaluation, and to define the best suitable time window for citation position indicator[BFQ].[BF] [Method/process] kinds of qualified ophthalmology journals were selected from Web of Science database in this study. The different positional indicators in 2014 were calculated for each journal, including 2-year, 5-year, 8-year and 10-year citation time window h-index (h2, h5, h8 and h10), and accumulative h-index (a-h2, a-h5, a-h8 and a-h10), and the corresponding 2014 indicators of journal citation’s Percentage Rank position(PRP), including Top 1%, Top 5%, Top 10%, Top 25% Top 50%, and accumulative PRP(a-PRP) index (a-Top 1%, a-Top 5%, a-Top 10%, a-Top 25% and a-Top 50%). The correlation level of impact factor, positional indicators in different citation time window with questionnaire score were analyzed, and the effects of different positional indicators for journal evaluation were detected. [Result/conclusion] The results show that reasonable position indicators are better than impact factor and 5-year impact factor in journal impact assessment, the accumulative citations position indicators generally better than the annual indicators, h index of 2-year citation time window than that of other citation time window. The a-h2, h2 of 5-year citation time window, and a-Top 50%, Top 50% of 5-year and 8-year citation time window have more desirable effect in journal evaluation compared with the impact factor and 5-year impact factor.
Liu Xueli , Zhou Jing , Gai Shuangshuang , Sheng Lina , Fu Zhongjing , Dong Jianjun , Fang Hongling . Correction for the Defect of Impact Factor Based on the Distributing Character of Citations: An Empirical Study of Positional Indicators Used in Journal Evaluation[J]. Library and Information Service, 2016 , 60(9) : 99 -105,115 . DOI: 10.13266/j.issn.0252-3116.2016.09.014
[1] GARFIELD E. Citation indexes for science: a new dimension in documentation through association of ideas[J]. Science, 1955, 122(3159):103-111.
[2] PÉREZ-HORNERO P, ARIAS-NICOLÉS J P, PULGARÁN A. An annual JCR impact factor calculation based on Bayesian credibility formulas[J]. Journal of informetrics, 2013, 7(1):1-9.
[3] CAMPANARIO J M. Large increases and decreases in journal impact factors in only one year: the effect of journal self-citations[J]. Journal of American Society of Information and Science and Technology, 2011, 62(2):230-235.
[4] CAMPANARIO J M, COSLADO M A. Benford's law and citations, articles and impact factors of scientific journals[J]. Scientometrics, 2011, 88(2):421-432.
[5] SERVAES J. On impact factors and research assessment. at the start of volume 31 of telematics and informatics[J]. Telematics and informatics, 2014, 31(1):1-2.
[6] MARKS M S, MARSH M, SCHROER T A, et al. Misuse of journal impact factors in scientific assessment[J]. Traffic, 2013, 14(6):611-612.
[7] LIU X L, GAI S S, ZHANG S L, et al. An analysis of peer-reviewed scores and impact factors with different citation time windows: a case study of 28 ophthalmologic journals[J]. PLOS ONE, 2015,10(8): e0135583.
[8] LEYDESDORFF L. Alternatives to the journal impact factor: I3 and the top-10% (or top-25%?) of the most-highly cited papers[J].Scientometrics, 2012, 92(2):355-365.
[9] HADDOW G, GENONI P. Citation analysis and peer ranking of Australian social science journals[J]. Scientometrics, 2010,85(2):471-487.
[10] 俞立平.历史影响因子:一个新的学术期刊存量评价指标[J].图书情报工作,2015,59(2):89-92.
[11] 杜志波,汤先忻.期刊累计影响因子的设计及应用[J].中国科技期刊研究,2007,18(3):428-431.
[12] BOYACK K W. Mapping knowledge domains: characterizing PNAS[J].Proceedings of the National Academy of Sciences of the United States of America,2004,101(S1): 5192-5199.
[13] HIRSCH J E. An index to quantify an individual's scientific research output[J]. Proceedings of the National Academy of Sciences of the United States of America, 2005,102(46): 16569-16572.
[14] EGGHE L, ROUSSEAU R. The Hirsch index of a shifted Lotka function and its relation with the impact factor[J]. Journal of the American Society for Information Science and Technology,2012, 63(5):1048-1053.
[15] EGGHE L. A rationale for the hirsch-index rank-order distribution and a comparison with the impact factor rank-order distribution[J]. Journal of the American Society for Information Science and Technology, 2009, 60(10):2142-2144.
[16] BADOR P, LAFOUGE T. Comparative analysis between impact factor and h-index for pharmacology and psychiatry journals[J]. Scientometrics, 2010, 84(1):65-79.
[17] LEYDESDORFF L, BORNMANN L. Integrated impact indicators compared with impact factors: an alternative research design with policy implications[J]. Journal of the American Society for Information Science and Technology, 2011, 62(11):2133-2146.
[18] WEALE A R,BAILEY M,LEAR P A. The level of non-citation of articles within a journal as a measure of quality: a comparison to the impact factor[J].BMC medical research methodology, 2004,4(1):14-21.
[19] 刘雪立,方红玲,周志新,等.科技期刊反向评价指标-零被引论文率及其与其文献计量学指标的关系[J].中国科技期刊研究,2011,22(4) :525-528.
[20] CAMPANARIO J M. Analysis of the distribution of cited journals according to their positions in the h-core of citing journal listed in Journal Citation Reports[J]. Journal of informetrics, 2014, 8(3): 534-545.
[21] VANCLAY J K.Factors affecting citation rates in environmental science[J].Journal of informetrics, 2013,7(2) :265-271.
[22] BORNMANN L,MUTZ R. Further steps towards an ideal method of measuring citation performance:the avoidance of citation averages in field-normalization[J]. Journal of informetrics, 2011,5(1) :228-230.
[23] National Science Board. Science and Engineering Indicators:2010[EB/OL].[2016-04-14]. http://www.nsf.gov/statistics/seind10/pdf/seind10.pdf.
[24] VINKLER P.The use of the percentage rank position index for comparative evaluation of journals[J]. Journal of informetrics, 2014,8(2):340-348.
[25] HINTZE J L,Nelson R D. Violin plots: a box plot-density trace synergism[J]. The American statistician,1998,52(2):181-184.
[26] 郑芳,周群,陈仕吉,等.基于百分位数指标的个人科研绩效评价研究[J].科研管理,2013,34(S1):189-194.
[27] 周群,左文革,陈仕吉. 基于百分位数的文献计量指标研究综述[J].现代图书情报技术,2013(S1):82-88.
[28] HARMAD S. Validating research performance metrics against peer rankings[J]. Ethics in science and environmental politics, 2008,8(1) : 103-107.
[29] 刘雪立,盖双双,周晶.基于文献类型矫正的影响因子及其实证研究[J]. 中国科技期刊研究,2016,27(3):309-315.
[30] GLÄNZEL W, SCHLEMMER B, THIJS B. Better late than never? On the chance to become highly cited only beyond the standard bibliometric time horizon[J]. Scientometrics, 2003, 58(3): 571-586.
[31] 刘雪立,盖双双,张诗乐,等.不同引证时间窗口影响因子的比较研究-以SCI数据库眼科学期刊为例[J]. 中国科技期刊研究,2014,25(12):1509-1512.
[32] 王梅英,刘雪立,王璞.h指数在期刊评价中的地位和作用[J].中国科技期刊研究,2012,23(3):387-390.
[33] BRAUN T, GLÄNZEL W, SCHUBERT A. A Hirsch-type index for journals[J]. Scientometrics, 2006, 69(1):169-173.
[34] 王梅英,刘雪立,王璞.h-指数及其扩展指标在期刊评价中的应用[J].情报杂志,2012,31(3):60-64.
[35] GARFIELD E. The history and meaning of the journal impact factor[J]. Journal of the American Medical Association, 2006, 295(1):90-93.
/
| 〈 |
|
〉 |
