<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>As the scale of data becomes larger and larger, clustering processing, a key step in data mining, has important practical significance. Aiming at the problems of time consumption and high clustering errors when the current clustering algorithms deal with massive and dynamic big data, an incremental clustering algorithm is proposed by taking big data as the research object. By exploring the attribute characteristics of big data, four characteristics such as scale, diversity, high speed and value are summarised. For large-scale data streams that have multiple attributes and are acquired one by one, optimise the setting method of the K-means clustering algorithm category centre point, combine the K-means clustering algorithm and the Kalman filter algorithm and measure the distance between data point pairs. Instead of Mahalanobis distance, an incremental clustering algorithm suitable for big data is constructed. Five data sets are selected to carry out example analysis. The results of the algorithm are verified by the algorithm. The proposed algorithm has obvious advantages in the incremental clustering effect of big data. At the same time, it also has efficient and stable computing performance, which meets the expected design requirements and goals.</p>
</abstract>

As the scale of data becomes larger and larger, clustering processing, a key step in data mining, has important practical significance. Aiming at the problems of time consumption and high clustering errors when the current clustering algorithms deal with massive and dynamic big data, an incremental clustering algorithm is proposed by taking big data as the research object. By exploring the attribute characteristics of big data, four characteristics such as scale, diversity, high speed and value are summarised. For large-scale data streams that have multiple attributes and are acquired one by one, optimise the setting method of the K-means clustering algorithm category centre point, combine the K-means clustering algorithm and the Kalman filter algorithm and measure the distance between data point pairs. Instead of Mahalanobis distance, an incremental clustering algorithm suitable for big data is constructed. Five data sets are selected to carry out example analysis. The results of the algorithm are verified by the algorithm. The proposed algorithm has obvious advantages in the incremental clustering effect of big data. At the same time, it also has efficient and stable computing performance, which meets the expected design requirements and goals.

Research on incremental clustering algorithm for big data

Applied Mathematics and Nonlinear Sciences

This work is licensed under the Creative Commons Attribution 4.0 International License.

{"article-title":"Research on incremental clustering algorithm for big data"}

As the scale of data becomes larger and larger, clustering processing, a key step in data mining, has important practical significance. Aiming at the problems...

Research on incremental clustering algorithm for big data

Publié en ligne: 23 déc. 2022

Pages: 169 - 180

Reçu: 30 mai 2022

Accepté: 16 juin 2022

DOI: https://doi.org/10.2478/amns.2021.2.00256

Mots clés
big data, incremental, clustering algorithm, K-means clustering algorithm, Kalman filter algorithm

© 2023 Xiaoqing Yang, published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Research on incremental clustering algorithm for big data

Publié en ligne: 23 déc. 2022

Pages: 169 - 180

Reçu: 30 mai 2022

Accepté: 16 juin 2022

DOI: https://doi.org/10.2478/amns.2021.2.00256

Mots clésbig data, incremental, clustering algorithm, K-means clustering algorithm, Kalman filter algorithm

© 2023 Xiaoqing Yang, published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Mots clés
big data, incremental, clustering algorithm, K-means clustering algorithm, Kalman filter algorithm