Fuzzy-Based Kernelized Clustering Algorithms for Handling Big Data Using Apache Spark

Abstract

In this paper, we propose a novel Kernelized Scalable Random Sampling with Iterative Optimization Fuzzy c-Means (KSRSIO-FCM) and a Kernelized Scalable Literal Fuzzy c-Means (KSLFCM) clustering algorithms for big data framework. The evolution of kernelized clustering algorithms led us to deal with the nonlinear separable problems by applying kernel Radial Basis Functions (RBF) which map the input data space nonlinearly into a high-dimensional feature space. The experimental result shows that the KSRSIO-FCM algorithm achieves significant improvement in terms of F-score, Adjusted Rand Index (ARI), and Normalized Mutual Information (NMI) for Big Data. Experimentation is performed on well-known IRIS datasets to show the effectiveness of proposed KSRSIO-FCM in comparison with KSLFCM. The KSRSIO-FCM implemented on Apache Spark shows better potential for Big Data clustering. © 2021, The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.