<abstract xmlns="http://www.w3.org/1999/xhtml">

<sec>
<h3>Purpose</h3>
<p>Accurately assigning the document type of review articles in citation index databases like Web of Science(WoS) and Scopus is important. This study aims to investigate the document type assignation of review articles in Web of Science, Scopus and Publisher’s websites on a large scale.</p>
</sec>
<sec>
<h3>Design/methodology/approach</h3>
<p>27,616 papers from 160 journals from 10 review journal series indexed in SCI are analyzed. The document types of these papers labeled on journals’ websites, and assigned by WoS and Scopus are retrieved and compared to determine the assigning accuracy and identify the possible reasons for wrongly assigning. For the document type labeled on the website, we further differentiate them into explicit review and implicit review based on whether the website directly indicates it is a review or not.</p>
</sec>
<sec>
<h3>Findings</h3>
<p>Overall, WoS and Scopus performed similarly, with an average precision of about 99% and recall of about 80%. However, there were some differences between WoS and Scopus across different journal series and within the same journal series. The assigning accuracy of WoS and Scopus for implicit reviews dropped significantly, especially for Scopus.</p>
</sec>
<sec>
<h3>Research limitations</h3>
<p>The document types we used as the gold standard were based on the journal websites’ labeling which were not manually validated one by one. We only studied the labeling performance for review articles published during 2017-2018 in review journals. Whether this conclusion can be extended to review articles published in non-review journals and most current situation is not very clear.</p>
</sec>
<sec>
<h3>Practical implications</h3>
<p>This study provides a reference for the accuracy of document type assigning of review articles in WoS and Scopus, and the identified pattern for assigning implicit reviews may be helpful to better labeling on websites, WoS and Scopus.</p>
</sec>
<sec>
<h3>Originality/value</h3>
<p>This study investigated the assigning accuracy of document type of reviews and identified the some patterns of wrong assignments.</p>
</sec>
</abstract>

Purpose
Accurately assigning the document type of review articles in citation index databases like Web of Science(WoS) and Scopus is important. This study aims to investigate the document type assignation of review articles in Web of Science, Scopus and Publisher’s websites on a large scale.


Design/methodology/approach
27,616 papers from 160 journals from 10 review journal series indexed in SCI are analyzed. The document types of these papers labeled on journals’ websites, and assigned by WoS and Scopus are retrieved and compared to determine the assigning accuracy and identify the possible reasons for wrongly assigning. For the document type labeled on the website, we further differentiate them into explicit review and implicit review based on whether the website directly indicates it is a review or not.


Findings
Overall, WoS and Scopus performed similarly, with an average precision of about 99% and recall of about 80%. However, there were some differences between WoS and Scopus across different journal series and within the same journal series. The assigning accuracy of WoS and Scopus for implicit reviews dropped significantly, especially for Scopus.


Research limitations
The document types we used as the gold standard were based on the journal websites’ labeling which were not manually validated one by one. We only studied the labeling performance for review articles published during 2017-2018 in review journals. Whether this conclusion can be extended to review articles published in non-review journals and most current situation is not very clear.


Practical implications
This study provides a reference for the accuracy of document type assigning of review articles in WoS and Scopus, and the identified pattern for assigning implicit reviews may be helpful to better labeling on websites, WoS and Scopus.


Originality/value
This study investigated the assigning accuracy of document type of reviews and identified the some patterns of wrong assignments.

An explorative study on document type assignment of review articles in Web of Science, Scopus and journals’ websites

Journal of Data and Information Science

This work is licensed under the Creative Commons Attribution 4.0 International License.

Purpose
Accurately assigning the document type of review articles in citation index databases like Web of Science(WoS) and Scopus is important. This study aims...

An explorative study on document type assignment of review articles in Web of Science, Scopus and journals’ websites

Article Category: Research Papers

Published Online: Feb 06, 2024

Page range: 11 - 36

Received: Jan 01, 2024

Accepted: Jan 29, 2024

DOI: https://doi.org/10.2478/jdis-2024-0003

Keywords
Document type, Web of Science, Scopus, Review article

© 2024 Manman Zhu et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

An explorative study on document type assignment of review articles in Web of Science, Scopus and journals’ websites

Article Category: Research Papers

Published Online: Feb 06, 2024

Page range: 11 - 36

Received: Jan 01, 2024

Accepted: Jan 29, 2024

DOI: https://doi.org/10.2478/jdis-2024-0003

KeywordsDocument type, Web of Science, Scopus, Review article

© 2024 Manman Zhu et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Keywords
Document type, Web of Science, Scopus, Review article