<abstract xmlns="http://www.w3.org/1999/xhtml">

<sec><h3>Purpose</h3>
<p>In recent decades, with the availability of large-scale scientific corpus datasets, difference-in-difference (DID) is increasingly used in the science of science and bibliometrics studies. DID method outputs the unbiased estimation on condition that several hypotheses hold, especially the common trend assumption. In this paper, we gave a systematic demonstration of DID in the science of science, and the potential ways to improve the accuracy of DID method.</p>
</sec>
<sec><h3>Design/methodology/approach</h3>
<p>At first, we reviewed the statistical assumptions, the model specification, and the application procedures of DID method. Second, to improve the necessary assumptions before conducting DID regression and the accuracy of estimation, we introduced some matching techniques serving as the pre-selecting step for DID design by matching control individuals who are equivalent to those treated ones on observational variables before the intervention. Lastly, we performed a case study to estimate the effects of prizewinning on the scientific performance of Nobel laureates, by comparing the yearly citation impact after the prizewinning year between Nobel laureates and their prizewinning-work coauthors.</p>
</sec>
<sec><h3>Findings</h3>
<p>We introduced the procedures to conduct a DID estimation and demonstrated the effectiveness to use matching method to improve the results. As a case study, we found that there are no significant increases in citations for Nobel laureates compared to their prizewinning coauthors.</p>
</sec>
<sec><h3>Research limitations</h3>
<p>This study ignored the rigorous mathematical deduction parts of DID, while focused on the practical parts.</p>
</sec>
<sec><h3>Practical implications</h3>
<p>This work gives experimental practice and potential guidelines to use DID method in science of science and bibliometrics studies.</p>
</sec>
<sec><h3>Originality/value</h3>
<p>This study gains insights into the usage of econometric tools in science of science.</p>
</sec>
</abstract>

Purpose
In recent decades, with the availability of large-scale scientific corpus datasets, difference-in-difference (DID) is increasingly used in the science of science and bibliometrics studies. DID method outputs the unbiased estimation on condition that several hypotheses hold, especially the common trend assumption. In this paper, we gave a systematic demonstration of DID in the science of science, and the potential ways to improve the accuracy of DID method.

Design/methodology/approach
At first, we reviewed the statistical assumptions, the model specification, and the application procedures of DID method. Second, to improve the necessary assumptions before conducting DID regression and the accuracy of estimation, we introduced some matching techniques serving as the pre-selecting step for DID design by matching control individuals who are equivalent to those treated ones on observational variables before the intervention. Lastly, we performed a case study to estimate the effects of prizewinning on the scientific performance of Nobel laureates, by comparing the yearly citation impact after the prizewinning year between Nobel laureates and their prizewinning-work coauthors.

Findings
We introduced the procedures to conduct a DID estimation and demonstrated the effectiveness to use matching method to improve the results. As a case study, we found that there are no significant increases in citations for Nobel laureates compared to their prizewinning coauthors.

Research limitations
This study ignored the rigorous mathematical deduction parts of DID, while focused on the practical parts.

Practical implications
This work gives experimental practice and potential guidelines to use DID method in science of science and bibliometrics studies.

Originality/value
This study gains insights into the usage of econometric tools in science of science.

Practical operation and theoretical basis of difference-in-difference regression in science of science: The comparative trial on the scientific performance of Nobel laureates versus their coauthors

Department of Statistics and Data Science

Southern University of Science and Technology

Journal of Data and Information Science

This work is licensed under the Creative Commons Attribution 4.0 International License.

Purpose
In recent decades, with the availability of large-scale scientific corpus datasets, difference-in-difference (DID) is increasingly used in the science...

Practical operation and theoretical basis of difference-in-difference regression in science of science: The comparative trial on the scientific performance of Nobel laureates versus their coauthors

Article Category: Research Paper

Published Online: Mar 05, 2023

Page range: 29 - 46

Received: Dec 30, 2022

Accepted: Jan 04, 2023

DOI: https://doi.org/10.2478/jdis-2023-0003

Keywords
Science of Science, Bibliometrics, Difference-in-Difference, CEM, PSM, Nobel Prize

© 2023 Yurui Huang et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Practical operation and theoretical basis of difference-in-difference regression in science of science: The comparative trial on the scientific performance of Nobel laureates versus their coauthors

Article Category: Research Paper

Published Online: Mar 05, 2023

Page range: 29 - 46

Received: Dec 30, 2022

Accepted: Jan 04, 2023

DOI: https://doi.org/10.2478/jdis-2023-0003

KeywordsScience of Science, Bibliometrics, Difference-in-Difference, CEM, PSM, Nobel Prize

© 2023 Yurui Huang et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Keywords
Science of Science, Bibliometrics, Difference-in-Difference, CEM, PSM, Nobel Prize