Journal PR8 Index:A New Indicator for the Evaluation of Journals Across Fields and the Empirical Studies

  • Liu Xueli ,
  • Wei Yahui ,
  • Sheng Lina ,
  • Wang Yan ,
  • Fu Zhongjing ,
  • Zheng Chengming ,
  • Dong Jianjun ,
  • Miao Xinzhi
Expand
  • 1. Periodicals Publishing House, Xinxiang Medical University, Xinxiang 453003;
    2. Management Institute, Xinxiang Medical University, Xinxiang 453003

Received date: 2017-02-05

  Revised date: 2017-05-02

  Online published: 2017-06-05

Abstract

[Purpose/significance] Based on the 8 classes percentile rank (PR8) method for articles, a new index for evaluation of journals in difference disciplines was established:the journal index for PR8 (JIPR8), and the evaluation effect of JIPR8 in different disciplines journals was tested. [Method/process] The 301 journals of 8 disciplines from the database of Journal Citation Reports were selected as study objects and JIPR8 of each journal was calculated and compared with other indicators of journal evaluation. The sensitivity and stability of JIPR8 in the evaluation for the journals in different disciplines were tested, and the relationship between JIPR8 and other journal indicators were defined. [Result/conclusion] Among all the selected indexes, the variation degree of JIPR8 was the lowest among 301 journals, which indicated that the stability of JIPR8 was the best, and the difference among the different subgroups (Q1, Q2, Q3 and Q4) was obvious, second only to journal impact factor percentile (JIFP), which shows that it has a good distinction between excellent and general journals. It is concluded that JIPR8 is a very good index for evaluating journals between subjects.

Cite this article

Liu Xueli , Wei Yahui , Sheng Lina , Wang Yan , Fu Zhongjing , Zheng Chengming , Dong Jianjun , Miao Xinzhi . Journal PR8 Index:A New Indicator for the Evaluation of Journals Across Fields and the Empirical Studies[J]. Library and Information Service, 2017 , 61(11) : 116 -123 . DOI: 10.13266/j.issn.0252-3116.2017.11.014

References

[1] GARFIELD E. Citation indexes for science:a new dimension in documentation through association of ideas[J]. Science, 1955,122(3159):103-111.
[2] PÉREZ-HORNERO P, ARIAS-NICOLÁS J P, PULGARÍN A A, et al. An annual JCR impact factor calculation based on Bayesian credibility formulas[J]. Journal of informetrics, 2013,7(1):1-9.
[3] FINARDI U. Correlation between journal impact factor and citation performance:An experimental study[J]. Journal of informetrics, 2013,7(2):357-370.
[4] SERVAES J. On impact factors and research assessment. At the start of volume 31 of telematics and informatics[J]. Telematics and informatics, 2014,31(1):1-2.
[5] CAMPANARIO J M, COSLADO M A. Benford's law and citations, articles and impact factors of scientific journals[J]. Scientometrics, 2011,88(2):421-432.
[6] BRODY S. Impact factor:imperfect but not yet replaceable[J]. Scientometrics, 2013,96(1):255-257.
[7] 俞立平.历史影响因子:一个新的学术期刊存量评价指标[J].图书情报工作,2015,59(2):89-92.
[8] LIU X L, GAI S S, ZHANG S L, et al. An analysis of peer-reviewed scores and impact factors with different citation time windows:a case study of 28 ophthalmologic journals[J]. PLoS ONE, 2015, 10(8):e0135583.
[9] 杜志波,汤先忻.期刊累计影响因子的设计及应用[J].中国科技期刊研究,2007,18(3):428-431.
[10] 刘雪立.期刊累积影响因子与年度影响因子的比较研究[J]. 中国科技期刊研究, 2016,27(7):774-778.
[11] LIU X L, GAI S S, ZHOU J. Journal impact factor:Do the numerator and denominator need correction?[J]. PLoS ONE, 2016, 11(3):e0151414.
[12] 刘雪立,周晶,盖双双,等.基于被引频次分布特征的影响因子缺陷矫正——位置指标应用于期刊评价的实证研究[J].图书情报工作,2016,60(9):99-105,115.
[13] PYO S, LEE W, LEE J. A novel journal evaluation metric that adjusts the impact factors across different subject categories[J]. Industrial engineering and management systems, 2016,15(1):99-109.
[14] BRADSHAW C J A, BROOK B W. How to rank journals[J]. PLoS ONE, 2016,11(3):e0149852.
[15] 蒋悟生. JCR与期刊分区——以生物学期刊为例[J]. 农业图书情报学刊,2010,22(10):8-12.
[16] TAYYAB S, BOYCE A N. Impact factor versus Q1 class of journals in World University Rankings[J]. Current science, 2013, 104(4):417-419.
[17] 俞立平.影响因子百分位指标的特点研究[J].图书情报工作,2016,60(10):103-107.
[18] Journal impact factor percentile[EB/OL].[2017-01-30]. http://ipscience-help.thomsonreuters.com/incitesLiveJCR/glossaryAZgroup/g8/9586-TRS.html.
[19] SEN B K. Documentation note normalized impact factor[J]. Journal of documentation, 1992,48(3):318-325.
[20] PUDOVKIN A I, GARFIELD E. Rank-normalized impact factor:a way to compare journal performance across subject categories[C] //Medford:Information Today Inc., 2004:507-515.
[21] MOED H F. Measuring contextual citation impact of scientific journals[J]. Journal of informetrics, 2010, 4(3):265-277.
[22] BORNMANN L, MUTZ R. Further steps towards an ideal method of measuring citation performance:the avoidance of citation (ratio) averages in field-normalization[J]. Journal of informetrics, 2011,5(1):228-230.
[23] LEYDESDORFF L, BORNMANN L. Percentile ranks and the integrated impact indicator (I3)[J]. Journal of the American Society for Information Science and Technology,2012,63(9):1901-1902.
[24] VINKLER P. Comparative rank assessment of journal articles[J]. Journal of informetrics, 2013,7(3):712-717.
[25] LEYDESDORFF L. Alternatives to the journal impact factor:I3 and the top-10% (or top-25%?) of the most-highly cited papers[J]. Scientometrics, 2012,92(2):355-365.
[26] LEYDESDORFF L, RADICCHI F, BORNMANN L, et al. Fieldnormalized impact factors (IFs):a comparison of rescaling and fractionally counted IFs[J]. Journal of the american society for information science and technology, 2013,64(11):2299-2309.
[27] VINKLER P. The use of the percentage rank position index for comparative evaluation of journals[J]. Journal of informetrics, 2014,8(2):340-348.
[28] 张学梅,李华. 跨学科领域期刊评价指标PRP指数及其改进研究[J]. 情报理论与实践,2016,39(2):50-53.
[29] SUNDARAM M, HODLER J, ROSENTHAL D I. On the relevance of the impact factor and other factors[J]. Skeletal radiology, 2012, 41(2):125-126.
[30] 杜志波,汤先忻. 标准化影响因子在不同学科期刊比较中的应用[J]. 编辑学报,2007,19(2):158-160.
[31] 李华,张学梅,刘文芝. PRP指标:一种跨学科期刊评价方法及与期刊H指数之比较[J].情报杂志,2015,34(8):60-64,109.
[32] DERAKHSHAN N, LUSZCZYNSKA A. Impact factor on the rise[J]. Anxiety stress and coping, 2012, 25(1):1-2.
[33] 俞立平,李守伟. 标准特征因子的特点与应用分析[J]. 中国科技期刊研究,2016,27(9):990-993.
[34] 陈福佑,杨立英,丁洁兰. 不同学科期刊学术影响力比较的方法与实证研究[J]. 图书情报工作,2013,57(23):85-89,94.
[35] 王璞,刘雪立,刘睿远,等. SNIP、SJR及其修正指标SNIP2、SJR2在期刊评价中的应用[J]. 中国科技期刊研究,2014,25(6):833-838.
[36] 陈仕吉,史丽文,李冬梅,等. 论文被引频次标准化述评[J]. 现代图书情报技术,2012(4):54-60.
Outlines

/