<abstract>
<title style='display:none'>Abstract</title>
<sec><title style='display:none'>Purpose</title>
Patent classification is one of the areas in Intellectual Property Analytics (IPA), and a growing use case since the number of patent applications has been increasing worldwide. We propose using machine learning algorithms to classify Portuguese patents and evaluate the performance of transfer learning methodologies to solve this task.
</sec>
<sec><title style='display:none'>Design/methodology/approach</title>
We applied three different approaches in this paper. First, we used a dataset available by INPI to explore traditional machine learning algorithms and ensemble methods. After preprocessing data by applying TF-IDF, FastText and Doc2Vec, the models were evaluated by cross-validation in 5 folds. In a second approach, we used two different Neural Networks architectures, a Convolutional Neural Network (CNN) and a bi-directional Long Short-Term Memory (BiLSTM). Finally, we used pre-trained BERT, DistilBERT, and ULMFiT models in the third approach.
</sec>
<sec><title style='display:none'>Findings</title>
BERTTimbau, a BERT architecture model pre-trained on a large Portuguese corpus, presented the best results for the task, even though with a performance of only 4% superior to a LinearSVC model using TF-IDF feature engineering.
</sec>
<sec><title style='display:none'>Research limitations</title>
The dataset was highly imbalanced, as usual in patent applications, so the classes with the lowest samples were expected to present the worst performance. That result happened in some cases, especially in classes with less than 60 training samples.
</sec>
<sec><title style='display:none'>Practical implications</title>
Patent classification is challenging because of the hierarchical classification system, the context overlap, and the underrepresentation of the classes. However, the final model presented an acceptable performance given the size of the dataset and the task complexity. This model can support the decision and improve the time by proposing a category in the second level of ICP, which is one of the critical phases of the grant patent process.
</sec>
<sec><title style='display:none'>Originality/value</title>
To our knowledge, the proposed models were never implemented for Portuguese patent classification.
</sec>
</abstract>

A Use Case of Patent Classification Using Deep Learning with Transfer Learning

<abstract>
<title style='display:none'>Abstract</title>
<sec><title style='display:none'>Purpose</title>Digital literacy and related fields have received interests from scholars and practitioners for more than 20 years; nonetheless, academic communities need to systematically review how the fields have developed. This study aims to investigate the research trends of digital literacy and related concepts since the year of 2000, especially in education.</sec>
<sec><title style='display:none'>Design/methodology/approach</title>The current study analyzes keywords, co-authorship, and cited publications in digital literacy through the scientometric method. The journal articles have been retrieved from the WoS (Web of Science) using four keywords: “Digital literacy,” “ICT literacy,” “information literacy,” and “media literacy.” Further, keywords, publications, and co-authorship are examined and further classified into clusters for more in-depth investigation.</sec>
<sec><title style='display:none'>Findings</title>Digital literacy is a multidisciplinary field that widely embraces literacy, ICT, the Internet, computer skill proficiency, science, nursing, health, and language education. The participants, or study subjects, in digital literacy research range from primary students to professionals, and the co-authorship clusters are distinctive by countries in America and Europe.</sec>
<sec><title style='display:none'>Research limitations</title>This paper analyzes one fixed chunk of a dataset obtained by searching for all four keywords at once. Further studies will retrieve the data from diverse disciplines and will trace the change of the leading research themes by time spans.</sec>
<sec><title style='display:none'>Practical implications</title>To shed light on the findings, using customized digital literacy curriculums and technology is critical for learners at different ages to nurture digital literacy according to their learning aims. They need to cultivate their understanding of the social impact of exploiting technology and computational thinking. To increase the originality of digital literacy-related studies, researchers from different countries and cultures may collaborate to investigate a broader range of digital literacy environments.</sec>
<sec><title style='display:none'>Originality/value</title>The present study reviews research trends in digital literacy and related areas by performing a scientometric study to analyze multidimensional aspects in the fields, including keywords, journal titles, co-authorship, and cited publications.</sec>
</abstract>

A Scientometric Study of Digital Literacy, ICT Literacy, Information Literacy, and Media Literacy

<abstract>
<title style='display:none'>Abstract</title>
It is imperative that all stakeholders within the research ecosystem take responsibility to improve research integrity and reliability of published research. Based on the unique experiences of a specialist publishing ethics and research integrity team within a major publisher, this article provides insights into the observed trends of misconduct and how those have evolved over time, and addresses key actions needed to improve the interface between researchers, funders, institutions and publishers to collectively improve research integrity on a global scale.
</abstract>

Perspectives from a publishing ethics and research integrity team for required improvements

<abstract><title style='display:none'>Abstract</title><sec id="j_jdis-2017-0006_s_006_w2aab2b8c32b1b7b1aab1c15b1Aa"><title style='display:none'>Purpose</title>We present a systematic review of the literature concerning major aspects of science mapping to serve two primary purposes: First, to demonstrate the use of a science mapping approach to perform the review so that researchers may apply the procedure to the review of a scientific domain of their own interest, and second, to identify major areas of research activities concerning science mapping, intellectual milestones in the development of key specialties, evolutionary stages of major specialties involved, and the dynamics of transitions from one specialty to another.</sec><sec id="j_jdis-2017-0006_s_007_w2aab2b8c32b1b7b1aab1c15b2Aa"><title style='display:none'>Design/methodology/approach</title>We first introduce a theoretical framework of the evolution of a scientific specialty. Then we demonstrate a generic search strategy that can be used to construct a representative dataset of bibliographic records of a domain of research. Next, progressively synthesized co-citation networks are constructed and visualized to aid visual analytic studies of the domain’s structural and dynamic patterns and trends. Finally, trajectories of citations made by particular types of authors and articles are presented to illustrate the predictive potential of the analytic approach.</sec><sec id="j_jdis-2017-0006_s_008_w2aab2b8c32b1b7b1aab1c15b3Aa"><title style='display:none'>Findings</title>The evolution of the science mapping research involves the development of a number of interrelated specialties. Four major specialties are discussed in detail in terms of four evolutionary stages: conceptualization, tool construction, application, and codification. Underlying connections between major specialties are also explored. The predictive analysis demonstrates citations trajectories of potentially transformative contributions.</sec><sec id="j_jdis-2017-0006_s_009_w2aab2b8c32b1b7b1aab1c15b4Aa"><title style='display:none'>Research limitations</title>The systematic review is primarily guided by citation patterns in the dataset retrieved from the literature. The scope of the data is limited by the source of the retrieval, i.e. the Web of Science, and the composite query used. An iterative query refinement is possible if one would like to improve the data quality, although the current approach serves our purpose adequately. More in-depth analyses of each specialty would be more revealing by incorporating additional methods such as citation context analysis and studies of other aspects of scholarly publications.</sec><sec id="j_jdis-2017-0006_s_010_w2aab2b8c32b1b7b1aab1c15b5Aa"><title style='display:none'>Practical implications</title>The underlying analytic process of science mapping serves many practical needs, notably bibliometric mapping, knowledge domain visualization, and visualization of scientific literature. In order to master such a complex process of science mapping, researchers often need to develop a diverse set of skills and knowledge that may span multiple disciplines. The approach demonstrated in this article provides a generic method for conducting a systematic review.</sec><sec id="j_jdis-2017-0006_s_011_w2aab2b8c32b1b7b1aab1c15b6Aa"><title style='display:none'>Originality/value</title>Incorporating the evolutionary stages of a specialty into the visual analytic study of a research domain is innovative. It provides a systematic methodology for researchers to achieve a good understanding of how scientific fields evolve, to recognize potentially insightful patterns from visually encoded signs, and to synthesize various information so as to capture the state of the art of the domain.</sec></abstract>

Science Mapping: A Systematic Review of the Literature

Large language models and scientific publishing

<abstract>
<title style='display:none'>Abstract</title>
<sec><title style='display:none'>Purpose</title>
This study aims to construct new models and methods of academic genealogy research based on bibliometrics.
</sec>
<sec><title style='display:none'>Design/methodology/approach</title>
This study proposes an academic influence scale for academic genealogy, and introduces the <italic>w</italic> index for bibliometric scaling of the academic genealogy. We then construct a two-dimensional (academic fecundity versus academic influence) evaluation system of academic genealogy, and validate it on the academic genealogy of a famous Chinese geologist.
</sec>
<sec><title style='display:none'>Findings</title>
The two-dimensional evaluation system can characterize the development and evolution of the academic genealogy, compare the academic influences of different genealogies, and evaluate individuals’ contributions to the inheritance and evolution of the academic genealogy. Individual academic influence is mainly indicated by the <italic>w</italic> index (the improved <italic>h</italic> index), which overcomes the situation of repeated measurements and distortion of results in the academic genealogy.
</sec>
<sec><title style='display:none'>Practical implications</title>
The two-dimensional evaluation system for the academic genealogy can better demonstrate the reproduction and the academic inheritance ability of a genealogy.
</sec>
<sec><title style='display:none'>Research limitations</title>
It is not comprehensive to only use the <italic>w</italic> index to characterize academic influence. It should also include scholars’ academic awards and academic part-timers and so on. In future work, we will integrate scholars’ academic awards and academic part-timers into the <italic>w</italic> index for a comprehensive reflection of scholars’ individual academic influences.
</sec>
<sec><title style='display:none'>Originality/value</title>
This study constructs new models and methods of academic genealogy research based on bibliometrics, which improves the quantitative assessment of academic genealogy and enriches its research and evaluation methods.
</sec>
</abstract>

Bibliometric-based Study of Scientist Academic Genealogy

<abstract>
<title style='display:none'>Abstract</title>
<sec>
<title style='display:none'>Purpose</title>
The transformative impact of disruptive technologies on the restructuring of the times has attracted widespread global attention. This study aims to analyze the characteristics and shortcomings of China’s artificial intelligence (AI) disruptive technology policy, and to put forward suggestions for optimizing China’s AI disruptive technology policy.
</sec>
<sec>
<title style='display:none'>Design/methodology/approach</title>
Develop a three-dimensional analytical framework for “policy tools-policy actors-policy themes” and apply policy tools, social network analysis, and LDA topic model to conduct a comprehensive analysis of the utilization of policy tools, cooperative relationships among policy actors, and the trends in policy theme settings within China’s innovative AI technology policy.
</sec>
<sec>
<title style='display:none'>Findings</title>
We find that the collaborative relationship among the policy actors of AI disruptive technology in China is insufficiently close. Marginal subjects exhibit low participation in the cooperation network and overly rely on central subjects, forming a “center-periphery” network structure. Policy tool usage is predominantly focused on supply and environmental types, with a severe inadequacy in demand-side policy tool utilization. Policy themes are diverse, encompassing topics such as “Intelligent Services” “Talent Cultivation” “Information Security” and “Technological Innovation”, which will remain focal points. Under the themes of “Intelligent Services” and “Intelligent Governance”, policy tool usage is relatively balanced, with close collaboration among policy entities. However, the theme of “AI Theoretical System” lacks a comprehensive understanding of tool usage and necessitates enhanced cooperation with other policy entities.
</sec>
<sec>
<title style='display:none'>Research limitations</title>
The data sources and experimental scope are subject to certain limitations, potentially introducing biases and imperfections into the research results, necessitating further validation and refinement.
</sec>
<sec>
<title style='display:none'>Practical implications</title>
The study introduces a three-dimensional analysis framework for disruptive technology policy texts, which is significant for formulating and enhancing disruptive technology policies.
</sec>
<sec>
<title style='display:none'>Originality/value</title>
This study utilizes text mining and content analysis techniques to quantitatively analyze disruptive technology policy texts. It systematically evaluates China’s AI policies quantitatively, focusing on policy tools, policy actors, policy themes. The study uncovers the characteristics and deficiencies of current AI policies, offering recommendations for formulating and enhancing disruptive technology policies.
</sec>
</abstract>

A quantitative study of disruptive technology policy texts: An example of China’s artificial intelligence policy

<abstract>
<title style='display:none'>Abstract</title>
<sec>
<title style='display:none'>Purpose</title>
This study aims to evaluate the accuracy of authorship attributions in scientific publications, focusing on the fairness and precision of individual contributions within academic works.
</sec>
<sec>
<title style='display:none'>Design/methodology/approach</title>
The study analyzes 81,823 publications from the journal <italic>PLOS ONE</italic>, covering the period from January 2018 to June 2023. It examines the authorship attributions within these publications to try and determine the prevalence of inappropriate authorship. It also investigates the demographic and professional profiles of affected authors, exploring trends and potential factors contributing to inaccuracies in authorship.
</sec>
<sec>
<title style='display:none'>Findings</title>
Surprisingly, 9.14% of articles feature at least one author with inappropriate authorship, affecting over 14,000 individuals (2.56% of the sample). Inappropriate authorship is more concentrated in Asia, Africa, and specific European countries like Italy. Established researchers with significant publication records and those affiliated with companies or nonprofits show higher instances of potential monetary authorship.
</sec>
<sec>
<title style='display:none'>Research limitations</title>
Our findings are based on contributions as declared by the authors, which implies a degree of trust in their transparency. However, this reliance on self-reporting may introduce biases or inaccuracies into the dataset. Further research could employ additional verification methods to enhance the reliability of the findings.
</sec>
<sec>
<title style='display:none'>Practical implications</title>
These findings have significant implications for journal publishers, highlighting the necessity for robust control mechanisms to ensure the integrity of authorship attributions. Moreover, researchers must exercise discernment in determining when to acknowledge a contributor and when to include them in the author list. Addressing these issues is crucial for maintaining the credibility and fairness of academic publications.
</sec>
<sec>
<title style='display:none'>Originality/value</title>
This study contributes to an understanding of critical issues within academic authorship, shedding light on the prevalence and impact of inappropriate authorship attributions. By calling for a nuanced approach to ensure accurate credit is given where it is due, the study underscores the importance of upholding ethical standards in scholarly publishing.
</sec>
</abstract>

Beyond authorship: Analyzing contributions in <italic>PLOS ONE</italic> and the challenges of appropriate attribution

<abstract>
<title style='display:none'>Abstract</title>
<sec>
<title style='display:none'>Purpose</title>
The goal of this study is a comparative analysis of the relation between funding (a main driver for scientific research) and citations in papers of Nobel Laureates in physics, chemistry and medicine over 2019-2020 and the same relation in these research fields as a whole.
</sec>
<sec>
<title style='display:none'>Design/Methodology/Approach</title>
This study utilizes a power law model to explore the relationship between research funding and citations of related papers. The study here analyzes 3,539 recorded documents by Nobel Laureates in physics, chemistry and medicine and a broader dataset of 183,016 documents related to the fields of physics, medicine, and chemistry recorded in the Web of Science database.
</sec>
<sec>
<title style='display:none'>Findings</title>
Results reveal that in chemistry and medicine, funded researches published in papers of Nobel Laureates have higher citations than unfunded studies published in articles; vice versa high citations of Nobel Laureates in physics are for unfunded studies published in papers. Instead, when overall data of publications and citations in physics, chemistry and medicine are analyzed, all papers based on funded researches show higher citations than unfunded ones.
</sec>
<sec>
<title style='display:none'>Originality/Value</title>
Results clarify the driving role of research funding for science diffusion that are systematized in general properties: a) articles concerning funded researches receive more citations than (un)funded studies published in papers of physics, chemistry and medicine sciences, generating a high Matthew effect (a higher growth of citations with the increase in the number of papers); b) research funding increases the citations of articles in fields oriented to applied research (e.g., chemistry and medicine) more than fields oriented towards basic research (e.g., physics).
</sec>
<sec>
<title style='display:none'>Practical Implications</title>
The results here explain some characteristics of scientific development and diffusion, highlighting the critical role of research funding in fostering citations and the expansion of scientific knowledge. This finding can support decisionmaking of policymakers and R&amp;D managers to improve the effectiveness in allocating financial resources in science policies to generate a higher positive scientific and societal impact.
</sec>
</abstract>

Research funding and citations in papers of Nobel Laureates in Physics, Chemistry and Medicine, 2019-2020

<abstract>
<title style='display:none'>Abstract</title>
Research data infrastructures form the cornerstone in both cyber and physical spaces, driving the progression of the data-intensive scientific research paradigm. This opinion paper presents an overview of global research data infrastructure, drawing insights from national roadmaps and strategic documents related to research data infrastructure. It emphasizes the pivotal role of research data infrastructures by delineating four new missions aimed at positioning them at the core of the current scientific research and communication ecosystem. The four new missions of research data infrastructures are: (1) as a pioneer, to transcend the disciplinary border and address complex, cutting-edge scientific and social challenges with problem- and data-oriented insights; (2) as an architect, to establish a digital, intelligent, flexible research and knowledge services environment; (3) as a platform, to foster the high-end academic communication; (4) as a coordinator, to balance scientific openness with ethics needs.
</abstract>

New roles of research data infrastructure in research paradigm evolution

<abstract>
<title style='display:none'>Abstract</title>
<sec>
<title style='display:none'>Purpose</title>
The notable increase in retraction papers has attracted considerable attention from diverse stakeholders. Various sources are now offering information related to research integrity, including concerns voiced on social media, disclosed lists of paper mills, and retraction notices accessible through journal websites. However, despite the availability of such resources, there remains a lack of a unified platform to consolidate this information, thereby hindering efficient searching and cross-referencing. Thus, it is imperative to develop a comprehensive platform for retracted papers and related concerns. This article aims to introduce “Amend,” a platform designed to integrate information on research integrity from diverse sources.
</sec>
<sec>
<title style='display:none'>Design/methodology/approach</title>
The Amend platform consolidates concerns and lists of problematic articles sourced from social media platforms (e.g., PubPeer, For Better Science), retraction notices from journal websites, and citation databases (e.g., Web of Science, CrossRef). Moreover, Amend includes investigation and punishment announcements released by administrative agencies (e.g., NSFC, MOE, MOST, CAS). Each related paper is marked and can be traced back to its information source via a provided link. Furthermore, the Amend database incorporates various attributes of retracted articles, including citation topics, funding details, open access status, and more. The reasons for retraction are identified and classified as either academic misconduct or honest errors, with detailed subcategories provided for further clarity.
</sec>
<sec>
<title style='display:none'>Findings</title>
Within the Amend platform, a total of 32,515 retracted papers indexed in SCI, SSCI, and ESCI between 1980 and 2023 were identified. Of these, 26,620 (81.87%) were associated with academic misconduct. The retraction rate stands at 6.64 per 10,000 articles. Notably, the retraction rate for non-gold open access articles significantly differs from that for gold open access articles, with this disparity progressively widening over the years. Furthermore, the reasons for retractions have shifted from traditional individual behaviors like falsification, fabrication, plagiarism, and duplication to more organized large-scale fraudulent practices, including Paper Mills, Fake Peer-review, and Artificial Intelligence Generated Content (AIGC).
</sec>
<sec>
<title style='display:none'>Research limitations</title>
The Amend platform may not fully capture all retracted and concerning papers, thereby impacting its comprehensiveness. Additionally, inaccuracies in retraction notices may lead to errors in tagged reasons.
</sec>
<sec>
<title style='display:none'>Practical implications</title>
Amend provides an integrated platform for stakeholders to enhance monitoring, analysis, and research on academic misconduct issues. Ultimately, the Amend database can contribute to upholding scientific integrity.
</sec>
<sec>
<title style='display:none'>Originality/value</title>
This study introduces a globally integrated platform for retracted and concerning papers, along with a preliminary analysis of the evolutionary trends in retracted papers.
</sec>
</abstract>

Amend: an integrated platform of retracted papers and concerned papers

<abstract>
<title style='display:none'>Abstract</title>
<sec>
<title style='display:none'>Purpose</title>
Recently, global science has shown an increasing open trend, however, the characteristics of research integrity of open access (OA) publications have rarely been studied. The aim of this study is to compare the characteristics of retracted articles across different OA levels and discover whether OA level influences the characteristics of retracted articles.
</sec>
<sec>
<title style='display:none'>Design/methodology/approach</title>
The research conducted an analysis of 6,005 retracted publications between 2001 and 2020 from the Web of Science and Retraction Watch databases. These publications were categorized based on their OA levels, including Gold OA, Green OA, and non-OA. The study explored retraction rates, time lags and reasons within these categories.
</sec>
<sec>
<title style='display:none'>Findings</title>
The findings of this research revealed distinct patterns in retraction rates among different OA levels. Publications with Gold OA demonstrated the highest retraction rate, followed by Green OA and non-OA. A comparison of retraction reasons between Gold OA and non-OA categories indicated similar proportions, while Green OA exhibited a higher proportion due to falsification and manipulation issues, along with a lower occurrence of plagiarism and authorship issues. The retraction time lag was shortest for Gold OA, followed by non-OA, and longest for Green OA. The prolonged retraction time for Green OA could be attributed to an atypical distribution of retraction reasons.
</sec>
<sec>
<title style='display:none'>Research limitations</title>
There is no exploration of a wider range of OA levels, such as Hybrid OA and Bronze OA.
</sec>
<sec>
<title style='display:none'>Practical implications</title>
The outcomes of this study suggest the need for increased attention to research integrity within the OA publications. The occurrences of falsification, manipulation, and ethical concerns within Green OA publications warrant attention from the scientific community.
</sec>
<sec>
<title style='display:none'>Originality/value</title>
This study contributes to the understanding of research integrity in the realm of OA publications, shedding light on retraction patterns and reasons across different OA levels.
</sec>
</abstract>

A comparative study on characteristics of retracted publications across different open access levels

<abstract><title style='display:none'>Abstract</title><sec id="j_jdis-2019-0001_s_006_w2aab3b7b1b1b6b1aab1c17b1Aa"><title style='display:none' id="d4944091e3411_w2aab3b7b1b1b6b1aab1c17b1aAa">Purpose</title>The purpose of this study is to assess the coverage of the scientific literature in Scopus and Web of Science from the perspective of research evaluation.</sec><sec id="j_jdis-2019-0001_s_007_w2aab3b7b1b1b6b1aab1c17b2Aa"><title style='display:none' id="d4944091e3419_w2aab3b7b1b1b6b1aab1c17b2aAa">Design/methodology/approach</title>The academic communities of Norway have agreed on certain criteria for what should be included as original research publications in research evaluation and funding contexts. These criteria have been applied since 2004 in a comprehensive bibliographic database called the Norwegian Science Index (NSI). The relative coverages of Scopus and Web of Science are compared with regard to publication type, field of research and language.</sec><sec id="j_jdis-2019-0001_s_008_w2aab3b7b1b1b6b1aab1c17b3Aa"><title style='display:none' id="d4944091e3427_w2aab3b7b1b1b6b1aab1c17b3aAa">Findings</title>Our results show that Scopus covers 72 percent of the total Norwegian scientific and scholarly publication output in 2015 and 2016, while the corresponding figure for Web of Science Core Collection is 69 percent. The coverages are most comprehensive in medicine and health (89 and 87 percent) and in the natural sciences and technology (85 and 84 percent). The social sciences (48 percent in Scopus and 40 percent in Web of Science Core Collection) and particularly the humanities (27 and 23 percent) are much less covered in the two international data sources.</sec><sec id="j_jdis-2019-0001_s_009_w2aab3b7b1b1b6b1aab1c17b4Aa"><title style='display:none' id="d4944091e3435_w2aab3b7b1b1b6b1aab1c17b4aAa">Research limitation</title>Comparing with data from only one country is a limitation of the study, but the criteria used to define a country’s scientific output as well as the identification of patterns of field-dependent partial representations in Scopus and Web of Science should be recognizable and useful also for other countries.</sec><sec id="j_jdis-2019-0001_s_010_w2aab3b7b1b1b6b1aab1c17b5Aa"><title style='display:none' id="d4944091e3444_w2aab3b7b1b1b6b1aab1c17b5aAa">Originality/value</title>The novelty of this study is the criteria-based approach to studying coverage problems in the two data sources.</sec></abstract>

A Criteria-based Assessment of the Coverage of Scopus and Web of Science

<abstract><title style='display:none'>Abstract</title>The “Norwegian Model” attempts to comprehensively cover all the peer-reviewed scholarly literatures in all areas of research in one single weighted indicator. Thereby, scientific production is made comparable across departments and faculties within and between research institutions, and the indicator may serve institutional evaluation and funding. This article describes the motivation for creating the model in Norway, how it was designed, organized and implemented, as well as the effects and experiences with the model. The article ends with an overview of a new type of bibliometric studies that are based on the type of comprehensive national publication data that the Norwegian Model provides.</abstract>

The Norwegian Model in Norway

<abstract><title style='display:none'>Abstract</title><sec id="j_jdis-2017-0002_s_007_w2aab2b8b7b1b7b1aab1c15b1Aa"><title style='display:none'>Purpose</title>First, to review the state-of-the-art in patent citation analysis, particularly characteristics of patent citations to scientific literature (scientific non-patent references, SNPRs). Second, to present a novel mapping approach to identify technology-relevant research based on the papers cited by and referring to the SNPRs.</sec><sec id="j_jdis-2017-0002_s_008_w2aab2b8b7b1b7b1aab1c15b2Aa"><title style='display:none'>Design/methodology/approach</title>In the review part we discuss the context of SNPRs such as the time lags between scientific achievements and inventions. Also patent-to-patent citation is addressed particularly because this type of patent citation analysis is a major element in the assessment of the economic value of patents. We also review the research on the role of universities and researchers in technological development, with important issues such as universities as sources of technological knowledge and inventor-author relations. We conclude the review part of this paper with an overview of recent research on mapping and network analysis of the science and technology interface and of technological progress in interaction with science. In the second part we apply new techniques for the direct visualization of the cited and citing relations of SNPRs, the mapping of the landscape around SNPRs by bibliographic coupling and co-citation analysis, and the mapping of the conceptual environment of SNPRs by keyword co-occurrence analysis.</sec><sec id="j_jdis-2017-0002_s_009_w2aab2b8b7b1b7b1aab1c15b3Aa"><title style='display:none'>Findings</title>We discuss several properties of SNPRs. Only a small minority of publications covered by the Web of Science or Scopus are cited by patents, about 3%–4%. However, for publications based on university-industry collaboration the number of SNPRs is considerably higher, around 15%. The proposed mapping methodology based on a “second order SNPR approach” enables a better assessment of the technological relevance of research.</sec><sec id="j_jdis-2017-0002_s_010_w2aab2b8b7b1b7b1aab1c15b4Aa"><title style='display:none'>Research limitations</title>The main limitation is that a more advanced merging of patent and publication data, in particular unification of author and inventor names, in still a necessity.</sec><sec id="j_jdis-2017-0002_s_011_w2aab2b8b7b1b7b1aab1c15b5Aa"><title style='display:none'>Practical implications</title>The proposed mapping methodology enables the creation of a database of technology-relevant papers (TRPs). In a bibliometric assessment the publications of research groups, research programs or institutes can be matched with the TRPs and thus the extent to which the work of groups, programs or institutes are relevant for technological development can be measured.</sec><sec id="j_jdis-2017-0002_s_012_w2aab2b8b7b1b7b1aab1c15b6Aa"><title style='display:none'>Originality/value</title>The review part examines a wide range of findings in the research of patent citation analysis. The mapping approach to identify a broad range of technology-relevant papers is novel and offers new opportunities in research evaluation practices.</sec></abstract>

Patent Citations Analysis and Its Value in Research Evaluation: A Review and a New Approach to Map Technology-relevant Research

<abstract><title style='display:none'>Abstract</title><sec id="j_jdis-2017-0015_s_005_w2aab3b8c26b1b7b1aab1c15b1Aa"><title style='display:none'>Purpose</title>The purpose of this study is to modernize previous work on science overlay maps by updating the underlying citation matrix, generating new clusters of scientific disciplines, enhancing visualizations, and providing more accessible means for analysts to generate their own maps.</sec><sec id="j_jdis-2017-0015_s_006_w2aab3b8c26b1b7b1aab1c15b2Aa"><title style='display:none'>Design/methodology/approach</title>We use the combined set of 2015 <italic>Journal Citation Reports</italic> for the Science Citation Index (<italic>n</italic> of journals = 8,778) and the Social Sciences Citation Index (<italic>n</italic> = 3,212) for a total of 11,365 journals. The set of Web of Science Categories in the Science Citation Index and the Social Sciences Citation Index increased from 224 in 2010 to 227 in 2015. Using dedicated software, a matrix of 227 × 227 cells is generated on the basis of whole-number citation counting. We normalize this matrix using the cosine function. We first develop the citing-side, cosine-normalized map using 2015 data and VOSviewer visualization with default parameter values. A routine for making overlays on the basis of the map (“wc15.exe”) is available at <ext-link ext-link-type="uri" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://www.leydesdorff.net/wc15/index.htm">http://www.leydesdorff.net/wc15/index.htm</ext-link>.</sec><sec id="j_jdis-2017-0015_s_007_w2aab3b8c26b1b7b1aab1c15b3Aa"><title style='display:none'>Findings</title>Findings appear in the form of visuals throughout the manuscript. In <xref ref-type="fig" rid="j_jdis-2017-0015_fig_001_w2aab3b8c26b1b7b1ab1b1b2b9aAa">Figures 1</xref>–<xref ref-type="fig" rid="j_jdis-2017-0015_fig_009_w2aab3b8c26b1b7b1ab1b2c16aAa">9</xref> we provide basemaps of science and science overlay maps for a number of companies, universities, and technologies.</sec><sec id="j_jdis-2017-0015_s_008_w2aab3b8c26b1b7b1aab1c15b4Aa"><title style='display:none'>Research limitations</title>As Web of Science Categories change and/or are updated so is the need to update the routine we provide. Also, to apply the routine we provide users need access to the Web of Science.</sec><sec id="j_jdis-2017-0015_s_009_w2aab3b8c26b1b7b1aab1c15b5Aa"><title style='display:none'>Practical implications</title>Visualization of science overlay maps is now more accurate and true to the 2015 <italic>Journal Citation Reports</italic> than was the case with the previous version of the routine advanced in our paper.</sec><sec id="j_jdis-2017-0015_s_010_w2aab3b8c26b1b7b1aab1c15b6Aa"><title style='display:none'>Originality/value</title>The routine we advance allows users to visualize science overlay maps in VOSviewer using data from more recent <italic>Journal Citation Reports</italic>.</sec></abstract>

United Kingdom of Great Britain and Northern Ireland

Visualization of Disciplinary Profiles: Enhanced Science Overlay Maps

Editorial and Peer Review Process

Instructions for Authors

Publication Ethics Statement

Publication Agreement