Acceso abierto

Citation distributions and research evaluations: The impossibility of formulating a universal indicator

Alonso Rodríguez-Navarro

Alonso Rodríguez-Navarro

Department of Biotechnology-Plant Biology, Polytechnic University of MadridMadrid, Spain
Perfil de Orcid
Buscar este autor en
Sciendo|Google Scholar
Rodríguez-Navarro, Alonso
  
19 nov 2024
Citation distributions and research evaluations: The impossibility of formulating a universal indicator's Cover Image
Acerca de este artículo
Artículo anterior
Artículo siguiente
Cite
Descargar portada
Categoría del artículo: Research Papers
Publicado en línea: 19 nov 2024
Páginas: 24 - 48
Recibido: 16 jul 2024
Aceptado: 21 oct 2024
DOI: https://doi.org/10.2478/jdis-2024-0032
Palabras clave
© 2024 Alonso Rodríguez-Navarro, published by Sciendo
This work is licensed under the Creative Commons Attribution 4.0 International License.

Figure 1.

Normal probability plots of the log-transformed number of citations plus 1 of publications in the topics of semiconductors (a) and lithium batteries (b).
Normal probability plots of the log-transformed number of citations plus 1 of publications in the topics of semiconductors (a) and lithium batteries (b).

Figure 2.

Double rank plots (a, c) and citation distributions (b, d) of publications from Spain and Singapore in graphene (a, b) and the USA and Germany in solar cells (c, d). Square symbols in (a) and (c) represent the position of papers in the top percentiles: 1, 3, 5, 10, 30, 50, and 100, from bottom to top.
Double rank plots (a, c) and citation distributions (b, d) of publications from Spain and Singapore in graphene (a, b) and the USA and Germany in solar cells (c, d). Square symbols in (a) and (c) represent the position of papers in the top percentiles: 1, 3, 5, 10, 30, 50, and 100, from bottom to top.

Figure 3.

Double rank plots (a) and citation distribution (b) of publications from India and Japan on graphene. Square symbols in (a) represent the position of papers in the top percentiles: 3, 5, 10, 30, 50, and 100, from bottom to top. In (b), the number of papers from India (3,794) was scaled down to the number of papers from Japan (1,788).
Double rank plots (a) and citation distribution (b) of publications from India and Japan on graphene. Square symbols in (a) represent the position of papers in the top percentiles: 3, 5, 10, 30, 50, and 100, from bottom to top. In (b), the number of papers from India (3,794) was scaled down to the number of papers from Japan (1,788).

Figure 4.

Publications on graphene in journals Nature Communications (a, c, e) and RSC Advances (b, d, f). Double rank plots (a, b), citation distributions (c, d), and normal probability plots (e, f). In (a) and (b), square symbols represent the position of papers in the top percentiles: 1, 3, 5, 10, 30, 50, and 100, from bottom to top. Histograms in (c) and (d) include world publications, which have been scaled down to the number of publications in the journals: from 82,757 to 5,127 and 558, respectively.
Publications on graphene in journals Nature Communications (a, c, e) and RSC Advances (b, d, f). Double rank plots (a, b), citation distributions (c, d), and normal probability plots (e, f). In (a) and (b), square symbols represent the position of papers in the top percentiles: 1, 3, 5, 10, 30, 50, and 100, from bottom to top. Histograms in (c) and (d) include world publications, which have been scaled down to the number of publications in the journals: from 82,757 to 5,127 and 558, respectively.

Figure 5.

Publications on graphene in journals Advanced Matter, Nanoscale, Electrochimica Acta, and RSC Advances. Double rank plots (a, c) and citation distributions (b, d). In (a) and (c), square symbols represent the position of papers in the top percentiles: 1 3, 5, 10, 30, 50, and 100, from bottom to top. In panel c, Ptop 1% is not marked.
Publications on graphene in journals Advanced Matter, Nanoscale, Electrochimica Acta, and RSC Advances. Double rank plots (a, c) and citation distributions (b, d). In (a) and (c), square symbols represent the position of papers in the top percentiles: 1 3, 5, 10, 30, 50, and 100, from bottom to top. In panel c, Ptop 1% is not marked.

Figure 6.

Double rank plots of publications in graphene (a) and semiconductors (b) in the journals ACS Applied Materials and Interfaces and Scientific Reports. Square symbols represent the position of papers in the top percentiles: 1, 3, 5, 10, 30, 50, and 100, from bottom to top.
Double rank plots of publications in graphene (a) and semiconductors (b) in the journals ACS Applied Materials and Interfaces and Scientific Reports. Square symbols represent the position of papers in the top percentiles: 1, 3, 5, 10, 30, 50, and 100, from bottom to top.

Basic description of publications on graphene from selected countries, including percentile ratios_

Country Pa P0b(%) MNCc Ptop 10%/P Ptop 5%/Ptop 50% Ptop 3%/Ptop 30% Ptop 1%/Ptop 10%
China 35,493 3.6 31.8 0.104 0.102 0.098 0.088
EU 7,555 7.1 22.3 0.059 0.080 0.088 0.107
USA 5,784 5.1 42.1 0.127 0.166 0.194 0.221
South Korea 4,701 5.2 24.1 0.078 0.069 0.065 0.054
India 3,794 3.1 21.1 0.049 0.034 0.023
Japan 1,788 10.3 17.0 0.041 0.094 0.108 0.095
Germany 843 4.2 21.4 0.064 0.097 0.102
Singapore 683 2.3 47.8 0.182 0.175 0.163 0.121
UK 666 2.7 27.1 0.083 0.078 0.095
Italy 664 3.6 18.1 0.039 0.039
Spain 657 2.3 22.4 0.055 0.055 0.053
Australia 552 2.0 47.9 0.199 0.209 0.213 0.155
Canada 514 3.7 29.5 0.097 0.088 0.092
France 410 5.9 21.4 0.066 0.067
Switzerland 136 6.6 26.4 0.088 0.127
Netherlands 132 2.3 34.0 0.136 0.131

Proportion of uncited papers in the same journals of publications in the research topics of lithium batteries and solar cells_

Journal Lithium batteries Solar cells
Pa P0b(%) P P0(%)
Advanced Materials 274 0.00 653 0.00
Journal of the American Chemical Society 159 0.00 486 0.00
Advanced Energy Materials 432 0.00 665 0.00
Nano Letters 313 0.00 458 0.22
Applied Energy 193 0.00 453 0.22
Nano Energy 479 0.00 440 0.45
Scientific Reports 410 0.00 805 0.62
Journal of Materials Chemistry A 2,095 0.14 1,681 0.71
ACS Applied Materials & Interfaces 1,416 0.14 1,799 1.11
Chemistry of Materials 529 0.19 549 0.36
Journal of Physical Chemistry C 624 0.48 1,549 2.52
Journal of Power Sources 2,813 0.50 501 1.80
Chemical Communications 352 0.57 434 0.92
Physical Chemistry Chemical Physics 514 0.58 927 1.73
Electrochimica Acta 2,382 0.67 689 3.48
Journal of Alloys and Compounds 839 1.07 644 3.11
RSC Advances 1,634 2.14 1,941 3.66
Journal of the Electrochemical Society 1,339 2.39 206 8.74
Journal of Materials Science: Materials in Electronics 122 3.28 705 11.21
Materials Letters 411 3.41 424 6.60

Basic description of publications on solar cells from selected countries, including percentile ratios_

Country Pa P0b(%) MNCc Ptop 10%/P Ptop 5%/Ptop 50% Ptop 3%/Ptop 30% Ptop 1%/Ptop 10%
China 12,806 7.7 18.8 0.086 0.085 0.083 0.064
EU 8,170 5.8 18.4 0.082 0.066 0.056 0.048
USA 5,471 4.6 32.6 0.146 0.141 0.139 0.141
South Korea 4,188 13.9 17.8 0.066 0.077 0.087 0.104
India 3,118 5.8 14.1 0.051 0.040 0.035
Japan 2,727 12.3 13.8 0.059 0.079 0.095 0.093
Germany 1,829 6.4 17.4 0.078 0.080 0.076 0.063
Italy 1,161 4.0 20.5 0.091 0.053 0.034
UK 890 4.3 43.1 0.179 0.176 0.204 0.208
Australia 803 4.7 24.0 0.130 0.102 0.081
Spain 794 5.3 19.1 0.081 0.060 0.051
France 673 5.9 15.0 0.062 0.044 0.048
Canada 546 6.0 24.8 0.106 0.084 0.083
Singapore 363 4.7 27.1 0.132 0.129 0.140 0.167
Switzerland 345 3.5 49.3 0.209 0.251 0.248 0.167
Netherlands 304 3.3 21.1 0.099 0.083 0.063

Basic description of journal publications in four research topics, including goodness-of-fit to lognormal distribution_

Topic Journal JIFa Pb P0c(%) MNCd KSfP-value
Semiconductors Journal of the American Chemical Society 14.7 437 0 85.8 > 0.15
Semiconductors Advanced Materials 25.8 396 0 78.7 > 0.15
Semiconductors Angewandte Chemie-International Edition 13.0 262 0.4 77.0 > 0.15
Semiconductors ACS Nano 14.6 584 0.3 59.7 > 0.15
Semiconductors ACS Applied Materials & Interfaces 8.5 1,120 1.1 28.6 0.01
Semiconductors Scientific Reports 4.0 1,101 1.1 20.1 < 0.01
Solar Cells Journal of the American Chemical Society 14.7 486 0 121.0 0.05
Solar Cells Advanced Materials 25.8 653 0 103.9 < 0.01
Solar Cells Nano Letters 12.3 460 0.2 73.5 > 0.15
Solar Cells Advanced Energy Materials 24.9 665 0 52.4 > 0.15
Solar Cells Applied Energy 8.4 453 0.2 40.4 < 0.01
Solar Cells Scientific Reports 4.0 805 0.6 26.9 < 0.01
Stem cells Science 41.1 112 0 190.8 > 0.15
Stem cells Nature 43.1 279 0 180.5 0.01
Stem Cells Cell 36.2 167 0 168.3 > 0.15
Stem cells Nature Communications 11.9 691 0 51.6 > 0.15
Stem cells Blood 16.6 673 0.1 46.9 0.08
Stem cells Development 5.8 483 0.4 29.0 0.02
Lithium batteries Advanced Materials 25.8 274 0 149.1 > 0.15
Lithium batteries Journal of the American Chemical Society 14.7 159 0 139.8 > 0.15
Lithium batteries Advanced Energy Materials 24.9 434 0 93.9 < 0.01
Lithium batteries Nano Letters 12.3 313 0 91.5 > 0.15
Lithium batteries Nano Energy 15.6 479 0 63.5 < 0.01
Lithium batteries Scientific Reports 4.0 410 0 33.7 0.14

Percentile ratios of publications from countries on the research topics of graphene and solar cells_

Country Graphene Solar cells
Ptop 50%/Ptop 100% Ptop 5%/Ptop 10% Ptop 50%/Ptop 100% Ptop 5%/Ptop 10%
Australia 0.59 0.62 0.56 0.44
Canada 0.49 0.44 0.57 0.45
China 0.51 0.50 0.48 0.47
EU 0.36 0.49 0.51 0.41
Germany 0.38 0.57 0.55 0.49
India 0.48 0.33 0.46 0.36
Japan 0.24 0.55 0.33 0.45
Singapore 0.63 0.60 0.58 0.56
South Korea 0.46 0.41 0.38 0.44
UK 0.50 0.47 0.58 0.57
USA 0.47 0.62 0.58 0.56

Number of papers and proportion of uncited papers in the selected research topics_

Topic Number MNCa Uncited (%)
Semiconductors 58,393 18.4 10.8
Steel 69,128 13.8 8.9
Concrete 34,126 17.1 7.9
Solar cells 61,202 22.3 7.6
Combustion 38,403 16.7 5.9
Immunity 42,586 21.8 4.4
Stem cells 86,647 20.9 4.3
Graphene 82,757 29.9 3.8
Dementia 39,767 22.6 3.2
Lithium batteries 32,318 32.4 3.1

Basic description of journal publications and percentile ratios in the research topic of graphene_

Journal JIFa Pb P0c(%) MNCd Ptop10%/P Ptop5%/Ptop50% Ptop3%/Ptop30% Ptop1%/Ptop10%
Advanced Materials 25.8 809 0.25 129.3 0.604 0.462 0.361 0.249
Nature Communications 12.1 558 0.00 129.1 0.529 0.409 0.347 0.268
Journal of the American Chemical Society 14.7 285 0.00 122.2 0.519 0.386 0.330 0.277
Advanced Functional Materials 16.8 626 0.00 91.8 0.450 0.309 0.259 0.160
ACS Nano 14.6 1,115 0.09 82.6 0.383 0.284 0.249 0.164
Nano Letters 11.2 956 0.21 64.8 0.306 0.227 0.189 0.106
ACS Applied Materials & Interfaces 8.8 2,837 0.14 49.0 0.231 0.129 0.088 0.038
ACS Sustainable Chemistry & Engineering 7.6 346 0.29 47.8 0.223 0.124 0.066 0.013
Journal of Materials Chemistry A 11.3 2,646 0.11 43.5 0.190 0.087 0.053 0.026
Nanoscale 6.9 1,933 0.52 34.2 0.130 0.077 0.050
Journal of Power Sources 8.2 1,024 0.39 33.6 0.113 0.038 0.032
Carbon 8.8 2,339 1.20 30.9 0.111 0.081 0.066
Scientific Reports 4.0 2,008 0.90 29.4 0.092 0.056 0.048
2D Materials 5.5 414 0.72 27.8 0.075 0.048
Electrochimica Acta 6.2 2,217 0.13 24.9 0.042 0.016 0.012
Journal of Physical Chemistry C 4.2 1,310 1.83 22.2 0.059 0.039 0.030
Physical review B 3.6 2,027 3.90 15.3 0.033 0.049 0.047
RSC Advances 3.1 5,127 2.05 15.7 0.017 0.010
Applied Physics Letters 3.6 1,188 3.70 14.1 0.016 0.017
Journal of Applied Physics 2.3 682 6.01 9.4 0.007
Idioma:
Inglés
Calendario de la edición:
4 veces al año
Temas de la revista:
Informática, Tecnologías de la información, Gestión de proyectos, Bases de datos y minería de datos
RSS Feed de revista