<abstract xmlns="http://www.w3.org/1999/xhtml">

<bold>Background:</bold> The bootstrap can be alternative to cross-validation as a training/test set splitting method since it minimizes the computing time in classification problems in comparison to the tenfold cross-validation.
<bold>Objectives:</bold> Тhis research investigates what proportion should be used to split the dataset into the training and the testing set so that the bootstrap might be competitive in terms of accuracy to other resampling methods.
<bold>Methods/Approach:</bold> Different train/test split proportions are used with the following resampling methods: the bootstrap, the leave-one-out cross-validation, the tenfold cross-validation, and the random repeated train/test split to test their performance on several classification methods. The classification methods used include the logistic regression, the decision tree, and the k-nearest neighbours.
<bold>Results:</bold> The findings suggest that using a different structure of the test set (e.g. 30/70, 20/80) can further optimize the performance of the bootstrap when applied to the logistic regression and the decision tree. For the k-nearest neighbour, the tenfold cross-validation with a 70/30 train/test splitting ratio is recommended.
<bold>Conclusions:</bold> Depending on the characteristics and the preliminary transformations of the variables, the bootstrap can improve the accuracy of the classification problem.
</abstract>

Background: The bootstrap can be alternative to cross-validation as a training/test set splitting method since it minimizes the computing time in classification problems in comparison to the tenfold cross-validation.
Objectives: Тhis research investigates what proportion should be used to split the dataset into the training and the testing set so that the bootstrap might be competitive in terms of accuracy to other resampling methods.
Methods/Approach: Different train/test split proportions are used with the following resampling methods: the bootstrap, the leave-one-out cross-validation, the tenfold cross-validation, and the random repeated train/test split to test their performance on several classification methods. The classification methods used include the logistic regression, the decision tree, and the k-nearest neighbours.
Results: The findings suggest that using a different structure of the test set (e.g. 30/70, 20/80) can further optimize the performance of the bootstrap when applied to the logistic regression and the decision tree. For the k-nearest neighbour, the tenfold cross-validation with a 70/30 train/test splitting ratio is recommended.
Conclusions: Depending on the characteristics and the preliminary transformations of the variables, the bootstrap can improve the accuracy of the classification problem.

The Proportion for Splitting Data into Training and Test Set for the Bootstrap in Classification Problems

Faculty of Economics and Business Administration

Business Systems Research Journal

This work is licensed under the Creative Commons Attribution 4.0 International License.

Background: The bootstrap can be alternative to cross-validation as a training/test set splitting method since it minimizes the computing time in...

The Proportion for Splitting Data into Training and Test Set for the Bootstrap in Classification Problems

Published Online: Jun 04, 2021

Page range: 228 - 242

Received: Aug 12, 2020

Accepted: Mar 15, 2021

DOI: https://doi.org/10.2478/bsrj-2021-0015

Keywords
the bootstrap, classification, cross-validation, repeated train/test splitting

© 2021 Borislava Vrigazova, published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

The Proportion for Splitting Data into Training and Test Set for the Bootstrap in Classification Problems

Published Online: Jun 04, 2021

Page range: 228 - 242

Received: Aug 12, 2020

Accepted: Mar 15, 2021

DOI: https://doi.org/10.2478/bsrj-2021-0015

Keywordsthe bootstrap, classification, cross-validation, repeated train/test splitting

© 2021 Borislava Vrigazova, published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Keywords
the bootstrap, classification, cross-validation, repeated train/test splitting