<abstract xmlns="http://www.w3.org/1999/xhtml">

<sec><h3>Context</h3><p>It is crucial to understand how reproducible the measurement results in the scientific publications are, as reproducibility is one of the cornerstones of engineering.</p></sec>
<sec><h3>Objective</h3><p>The goal of this study is to investigate the scientific publications presented at the premier technical debt conferences by understanding how reproducible the reported findings are.</p></sec>
<sec><h3>Method</h3><p>We conducted a systematic literature review of 135 unique papers published at the “International Workshop on Managing Technical Debt” and the “International Conference on Managing Technical Debt”, the premier scientific conference series on technical debt.</p></sec>
<sec><h3>Results</h3><p>Only 44 of the investigated 135 papers presented numerical evidence and only 5 papers listed the tools, the availability of the tools, and the version of the tools used. For the rest of the papers additional information would have been needed for the potential reproducibility. One of the published papers even referred to a pornographic site as a source of a toolset for empirical research.</p></sec>
</abstract>

ContextIt is crucial to understand how reproducible the measurement results in the scientific publications are, as reproducibility is one of the cornerstones of engineering.
ObjectiveThe goal of this study is to investigate the scientific publications presented at the premier technical debt conferences by understanding how reproducible the reported findings are.
MethodWe conducted a systematic literature review of 135 unique papers published at the “International Workshop on Managing Technical Debt” and the “International Conference on Managing Technical Debt”, the premier scientific conference series on technical debt.
ResultsOnly 44 of the investigated 135 papers presented numerical evidence and only 5 papers listed the tools, the availability of the tools, and the version of the tools used. For the rest of the papers additional information would have been needed for the potential reproducibility. One of the published papers even referred to a pornographic site as a source of a toolset for empirical research.

Reproducibility in the technical debt domain

Acta Universitatis Sapientiae, Informatica

This work is licensed under the Creative Commons Attribution 4.0 International License.

{"article-title":"Reproducibility in the technical debt domain"}

ContextIt is crucial to understand how reproducible the measurement results in the scientific publications are, as reproducibility is one of the cornerstones...

Reproducibility in the technical debt domain

Published Online: Feb 02, 2022

Page range: 335 - 360

Received: Oct 28, 2021

Accepted: Dec 14, 2021

DOI: https://doi.org/10.2478/ausi-2021-0016

© 2021 Kristóf Szabados et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.