<abstract xmlns="http://www.w3.org/1999/xhtml"><sec id="j_jdis-2018-0002_s_007_w2aab3b7b2b1b6b1aab1c18b1Aa"><h3>Purpose</h3><p>One of the main indicators of scientific production is the number of papers published in scholarly journals. Turkey ranks 18th place in the world based on the number of scholarly publications. The objective of this paper is to find out if the monetary support program initiated in 1993 by the Turkish Scientific and Technological Research Council (TÜBİTAK) to incentivize researchers and increase the number, impact, and quality of international publications has been effective in doing so.</p></sec><sec id="j_jdis-2018-0002_s_008_w2aab3b7b2b1b6b1aab1c18b2Aa"><h3>Design/methodology/approach</h3><p>We analyzed some 390,000 publications with Turkish affiliations listed in the Web of Science (WoS) database between 1976 and 2015 along with about 157,000 supported ones between 1997 and 2015. We used the interrupted time series (ITS) analysis technique (also known as “quasi-experimental time series analysis” or “intervention analysis”) to test if TÜBİTAK’s support program helped increase the number of publications. We defined ARIMA (1,1,0) model for ITS data and observed the impact of TÜBİTAK’s support program in 1994, 1997, and 2003 (after one, four and 10 years of its start, respectively). The majority of publications (93%) were full papers (articles), which were used as the experimental group while other types of contributions functioned as the control group. We also carried out a multiple regression analysis.</p></sec><sec id="j_jdis-2018-0002_s_009_w2aab3b7b2b1b6b1aab1c18b3Aa"><h3>Findings</h3><p>TÜBİTAK’s support program has had negligible effect on the increase of the number of papers with Turkish affiliations. Yet, the number of other types of contributions continued to increase even though they were not well supported, suggesting that TÜBİTAK’s support program is probably not the main factor causing the increase in the number of papers with Turkish affiliations.</p></sec><sec id="j_jdis-2018-0002_s_010_w2aab3b7b2b1b6b1aab1c18b4Aa"><h3>Research limitations</h3><p>Interrupted time series analysis shows if the “intervention” has had any significant effect on the dependent variable but it does not explain what caused the increase in the number of papers if it was not the intervention. Moreover, except the “intervention”, other “event(s)” that might affect the time series data (e.g., increase in the number of research personnel over the years) should not occur during the period of analysis, a prerequisite that is beyond the control of the researcher.</p></sec><sec id="j_jdis-2018-0002_s_011_w2aab3b7b2b1b6b1aab1c18b5Aa"><h3>Practical implications</h3><p>TÜBİTAK’s “cash-for-publication” program did not seem to have direct impact on the increase of the number of papers published by Turkish authors, suggesting that small amounts of payments are not much of an incentive for authors to publish more. It might perhaps be a better strategy to concentrate limited resources on a few high impact projects rather than to disperse them to thousands of authors as “micropayments.”</p></sec><sec id="j_jdis-2018-0002_s_012_w2aab3b7b2b1b6b1aab1c18b6Aa"><h3>Originality/value</h3><p>Based on 25 years’ worth of payments data, this is perhaps one of the first large-scale studies showing that “cash-for-publication” policies or “piece rates” paid to researchers tend to have little or no effect on the increase of researchers’ productivity. The main finding of this paper has some implications for countries wherein publication subsidies are used as an incentive to increase the number and quality of papers published in international journals. They should be prepared to consider reviewing their existing support programs (based usually on bibliometric measures such as journal impact factors) and revising their reward policies.</p></sec></abstract>

PurposeOne of the main indicators of scientific production is the number of papers published in scholarly journals. Turkey ranks 18th place in the world based on the number of scholarly publications. The objective of this paper is to find out if the monetary support program initiated in 1993 by the Turkish Scientific and Technological Research Council (TÜBİTAK) to incentivize researchers and increase the number, impact, and quality of international publications has been effective in doing so.Design/methodology/approachWe analyzed some 390,000 publications with Turkish affiliations listed in the Web of Science (WoS) database between 1976 and 2015 along with about 157,000 supported ones between 1997 and 2015. We used the interrupted time series (ITS) analysis technique (also known as “quasi-experimental time series analysis” or “intervention analysis”) to test if TÜBİTAK’s support program helped increase the number of publications. We defined ARIMA (1,1,0) model for ITS data and observed the impact of TÜBİTAK’s support program in 1994, 1997, and 2003 (after one, four and 10 years of its start, respectively). The majority of publications (93%) were full papers (articles), which were used as the experimental group while other types of contributions functioned as the control group. We also carried out a multiple regression analysis.FindingsTÜBİTAK’s support program has had negligible effect on the increase of the number of papers with Turkish affiliations. Yet, the number of other types of contributions continued to increase even though they were not well supported, suggesting that TÜBİTAK’s support program is probably not the main factor causing the increase in the number of papers with Turkish affiliations.Research limitationsInterrupted time series analysis shows if the “intervention” has had any significant effect on the dependent variable but it does not explain what caused the increase in the number of papers if it was not the intervention. Moreover, except the “intervention”, other “event(s)” that might affect the time series data (e.g., increase in the number of research personnel over the years) should not occur during the period of analysis, a prerequisite that is beyond the control of the researcher.Practical implicationsTÜBİTAK’s “cash-for-publication” program did not seem to have direct impact on the increase of the number of papers published by Turkish authors, suggesting that small amounts of payments are not much of an incentive for authors to publish more. It might perhaps be a better strategy to concentrate limited resources on a few high impact projects rather than to disperse them to thousands of authors as “micropayments.”Originality/valueBased on 25 years’ worth of payments data, this is perhaps one of the first large-scale studies showing that “cash-for-publication” policies or “piece rates” paid to researchers tend to have little or no effect on the increase of researchers’ productivity. The main finding of this paper has some implications for countries wherein publication subsidies are used as an incentive to increase the number and quality of papers published in international journals. They should be prepared to consider reviewing their existing support programs (based usually on bibliometric measures such as journal impact factors) and revising their reward policies.

Does Monetary Support Increase the Number of Scientific Papers? An Interrupted Time Series Analysis

Journal of Data and Information Science

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

PurposeOne of the main indicators of scientific production is the number of papers published in scholarly journals. Turkey ranks 18th place in the world based...

Does Monetary Support Increase the Number of Scientific Papers? An Interrupted Time Series Analysis

Article Category: Research Paper

Published Online: Mar 13, 2018

Page range: 19 - 39

Received: Nov 05, 2017

Accepted: Jan 10, 2018

DOI: https://doi.org/10.2478/jdis-2018-0002

Keywords
Performance-based research funding systems, Publication subsidies, Publication support programs, Interrupted time series analysis

© 2018 Walter de Gruyter GmbH, Berlin/Boston

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Does Monetary Support Increase the Number of Scientific Papers? An Interrupted Time Series Analysis

Article Category: Research Paper

Published Online: Mar 13, 2018

Page range: 19 - 39

Received: Nov 05, 2017

Accepted: Jan 10, 2018

DOI: https://doi.org/10.2478/jdis-2018-0002

KeywordsPerformance-based research funding systems, Publication subsidies, Publication support programs, Interrupted time series analysis

© 2018 Walter de Gruyter GmbH, Berlin/Boston

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Keywords
Performance-based research funding systems, Publication subsidies, Publication support programs, Interrupted time series analysis