<abstract xmlns="http://www.w3.org/1999/xhtml"><p>The class imbalance problem, one of the common data irregularities, causes the development of under-represented models. To resolve this issue, the present study proposes a new cluster-based MapReduce design, entitled Distributed Cluster-based Resampling for Imbalanced Big Data (DIBID). The design aims at modifying the existing dataset to increase the classification success. Within the study, DIBID has been implemented on public datasets under two strategies. The first strategy has been designed to present the success of the model on data sets with different imbalanced ratios. The second strategy has been designed to compare the success of the model with other imbalanced big data solutions in the literature. According to the results, DIBID outperformed other imbalanced big data solutions in the literature and increased area under the curve values between 10 % and 24 % through the case study.</p></abstract>

The class imbalance problem, one of the common data irregularities, causes the development of under-represented models. To resolve this issue, the present study proposes a new cluster-based MapReduce design, entitled Distributed Cluster-based Resampling for Imbalanced Big Data (DIBID). The design aims at modifying the existing dataset to increase the classification success. Within the study, DIBID has been implemented on public datasets under two strategies. The first strategy has been designed to present the success of the model on data sets with different imbalanced ratios. The second strategy has been designed to compare the success of the model with other imbalanced big data solutions in the literature. According to the results, DIBID outperformed other imbalanced big data solutions in the literature and increased area under the curve values between 10 % and 24 % through the case study.

A New Big Data Model Using Distributed Cluster-Based Resampling for Class-Imbalance Problem

Applied Computer Systems

This work is licensed under the Creative Commons Attribution 4.0 Public License.

The class imbalance problem, one of the common data irregularities, causes the development of under-represented models. To resolve this issue, the present...

A New Big Data Model Using Distributed Cluster-Based Resampling for Class-Imbalance Problem

Publié en ligne: 20 févr. 2020

Pages: 104 - 110

DOI: https://doi.org/10.2478/acss-2019-0013

Mots clés
Big data, cluster-based resampling, imbalanced big data classification, imbalanced data

© 2019 Duygu Sinanc Terzi et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 Public License.

A New Big Data Model Using Distributed Cluster-Based Resampling for Class-Imbalance Problem

Publié en ligne: 20 févr. 2020

Pages: 104 - 110

DOI: https://doi.org/10.2478/acss-2019-0013

Mots clésBig data, cluster-based resampling, imbalanced big data classification, imbalanced data

© 2019 Duygu Sinanc Terzi et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 Public License.

Mots clés
Big data, cluster-based resampling, imbalanced big data classification, imbalanced data