Journal impact factor: Mathematical and statistical properties

A. M. Elizarov   ; V. V. Pislyakov

Učënye zapiski Kazanskogo universiteta. Seriâ Fiziko-matematičeskie nauki, Uchenye Zapiski Kazanskogo Universiteta. Seriya Fiziko-Matematicheskie Nauki, Tome 166 (2024) no. 4, pp. 485-498

Résumé

Using a commonly agreed definition of the journal impact factor, its various applications in the mathematical modeling of scientific research were investigated. Special attention was paid to the impact factor’s properties related to the disciplinary structure of science, the limitations of source data in existing databases, statistical reliability, the relevance of document types, and the effect of outliers. The potential bias resulting from journal self-citation practices was discussed.

Détail

Keywords: bibliometric indicators, impact factor, Web of Science, journal self-citation.
Mots-clés : Journal Citation Reports

Bibliographie

[1] ExLibris. Ulrichsweb: General FAQ, , 2018 https://knowledge.exlibrisgroup.com/Ulrichs/Product_Documentation/'>https://knowledge.exlibrisgroup.com/Ulrich's/Product_Documentation/

[2] Curcic D., Number of Academic Papers Published Per Year, , 2023 https://wordsrated.com/number-of-academic-papers-published-per-year/

[3] Moskaleva O., Pislyakov V., Sterligov I., Akoev M., Shabanova S., “Russian Index of Science Citation: Overview and review”, Scientometrics, 116:1 (2018), 449–462 | DOI

[4] Pislyakov V.V., Impact factor, The Great Russian Encyclopedia: A Science and Education Website (In Russian)

[5] Garfield E., “Citation indexes for science. A new dimension in documentation through association of ideas”, Science, 122:3159 (1955), 108–111 | DOI

[6] Garfield E., Sher I.H., “New factors in the evaluation of scientific literature through citation indexing”, Am. Doc., 14:3 (1963), 195–201 | DOI

[7] Gross P.L.K., Gross E.M., “College libraries and chemical education”, Science, 66:1713 (1927), 385–389 | DOI

[8] Hackh I., “The periodicals useful in the dental library”, Bull. Med. Libr. Assoc., 25:1–2, Sept. (1936), 109–112

[9] Raisig L.M., “Mathematical evaluation of the scientific serial”, Science, 131:3411 (1960), 1417–1419 | DOI

[10] Pislyakov V.V. Bibliometric indicators in the Clarivate databases, Handbook for Scientometrics: Science and Technology Development Indicators, 2 ed., eds. Akoev M.A., Markusova V.A., Moskaleva O.V., Pislyakov V.V., Izd. Ural. Univ., Yekaterinburg, 2021, 177–220 (In Russian) | DOI

[11] Zibareva I.V., Pislyakov V.V., Teplova T.N., Nefedov O.M., “Bibliometric analysis of the journal Uspekhi Khimii (Russian Chemical Reviews)”, Herald Russ. Acad. Sci., 78:3 (2008), 247–256 (In Russian) | DOI

[12] Archambault É., Larivière V., “History of the journal impact factor: Contingencies and consequences”, Scientometrics, 79:3 (2009), 635–649 | DOI

[13] Glänzel W., Moed H.F., “Journal impact measures in bibliometric research”, Scientometrics, 53:2 (2002), 171–193 | DOI

[14] Garfield E., Sher I.H., Genetics Citation Index: Experimental Citation Indexes to Genetics with Special Emphasis on Human Genetics, Inst. Sci. Inf., Philadelphia, PA, 1963, xxvii+864 pp.

[15] Pudovkin A.I., Garfield E., “Rank normalization of impact factors will resolve Vanclay's dilemma with TRIF”, Scientometrics, 92:2 (2012), 409–412 | DOI

[16] Schubert A., Glänzel W., “Statistical reliability of comparisons based on the citation impact of scientific publications”, Scientometrics, 5:1 (1983), 59–73 | DOI

[17] Greenwood D.C., “Reliability of journal impact factor rankings”, BMC Med. Res. Methodol., 7 (2007), 48 | DOI

[18] Bornmann L., “Confidence intervals for Journal Impact Factors”, Scientometrics, 111:3 (2017), 1869–1871 | DOI

[19] Stern D.I., “Uncertainty measures for economics journal impact factors”, J. Econ. Lit., 51:1 (2013), 173–189 | DOI

[20] Vanclay J.K., Impact factor: Outdated artefact or stepping-stone to journal certification?, Scientometrics, 92:2 (2012), 211–238 | DOI

[21] Zitt M., “The journal impact factor: Angel, devil, or scapegoat? A comment on J.K. Vanclay's article 2011”, Scientometrics, 92:2 (2012), 485–503 | DOI

[22] Bar-Ilan J., “Journal report card”, Scientometrics, 92:2 (2012), 249–260 | DOI

[23] Journal Citation Reports$^{\text{TM}}$ Reference Guide, Clarivate, , 2023 https://clarivate.com/wp-content/uploads/dlm_uploads/2023/08/JCR-Reference-Guide-2023-August-update-1.pdf

[24] Yablonsky A.I., Models and Methods for the Study of Science, Editorial URSS, M., 2001, 398 pp. (In Russian)

[25] McVeigh M.E., Mann S.J., “The journal impact factor denominator: Defining citable (counted) items”, JAMA, 302:10 (2009), 1107–1109 | DOI

[26] Miranda R., Garcia-Carpintero E., “Overcitation and overrepresentation of review papers in the most cited papers”, J. Inform., 12:4 (2018), 1015–1030 | DOI

[27] Aksnes D.W., “Characteristics of highly cited papers”, Res. Eval., 12:3 (2003), 159–170 | DOI

[28] Smith R., “Journal accused of manipulating impact factor”, BMJ., 314 (1997), 461 | DOI

[29] Macdonald S., “The gaming of citation and authorship in academic journals: a warning from medicine”, Soc. Sci. Inf., 61:4, 457–480 | DOI

[30] Pislyakov V.V., “Self-citation and its impact on research evaluation: Literature review. Part II”, Nauchn.Tekh. Bibl., 2022, no. 3, 85–104 (In Russian) | DOI