GF-CLUST: A Nature-Inspired Algorithm for Automatic Text Clustering

Authors

  • Athraa Jasim Mohammed University of Technology, Baghdad, Iraq
  • Yuhanis Yusof Universiti Utara Malaysia, Malaysia
  • Husniza Husni Universiti Utara Malaysia, Malaysia

DOI:

https://doi.org/10.32890/jict2016.15.1.3

Keywords:

Firefly algorithm, text clustering, divisive clustering, dynamic clustering

Abstract

Text clustering is a task of grouping similar documents into a cluster while assigning the dissimilar ones in other clusters. A well-known clustering method which is the K-means algorithm is extensively employed in many disciplines. However, there is a big challenge to determine the number of clusters using K-means. This paper presents a new clustering algorithm, termed Gravity Firefly Clustering (GF-CLUST) that utilizes Firefly Algorithm for dynamic document clustering. The GF-CLUST features the ability of identifying the appropriate number of clusters for a given text collection, which is a challenging problem in document clustering. It determines documents having strong force as centers and creates clusters based on cosine similarity measurement. This is followed by selecting potential clusters and merging small clusters to them. Experiments on various document datasets, such as 20Newgroups, Reuters-21578 and TREC collection are conducted to evaluate the performance of the proposed GF-CLUST. The results of purity, F-measure and Entropy of GF-CLUST outperform the ones produced by existing clustering techniques, such as K-means, Particle Swarm Optimization (PSO) and Practical General Stochastic Clustering Method (pGSCM). Furthermore, the number of obtained clusters in GF-CLUST is near to the actual number of clusters as compared to pGSCM.

 

References

20NewsgroupsDataSet. (2006). Retrieved from http://www.cs.cmu.edu/afs/ cs.cmu.edu/project/theo-4/text-learning/www/datasets.html.

Aggarwal, C. C., & Reddy, C. K. (2014). Data clustering Algorithm and applications. CRC Press, Taylor and Francis Group.

Aliguliyev, R. M. (2009). Clustering of document collection-A weighted approach. Elsevier, Expert Systems with Applications, 36(4), 7904–7916. Retrieved from doi: 10.1016/j.eswa.2008.11.017

Apostolopoulos, T., & Vlachos, A. (2011). Application of the firefly algorithm for solving the economic emissions load dispatch problem. International Journal of Combinatorics, 201, 23. Retrieved from doi:10.1155/2011/523806

Banati, H., & Bajaj, M. (2013). Performance analysis of Firefly algorithm for data clustering. Int. J. Swarm Intelligence, 1(1), 19–35.

Beasley, D., Bull, D. R., & Martin, R. R. (1993). An overview of genetic algorithms : Part 1, fundamentals. University Computing, 15(2), 58–69.

Bonabeau, E., Dorigo, M., & Theraulaz, G. (1999). Swarm intelligence: From Natural to artificial systems. New York, NY: Oxford University Press, Santa Fe Institute Studies in the Sciences of Complexity.

Boussaïd, I., Lepagnot, J., & Siarry, P. (2013). A survey on optimization metaheuristics. Elsevier,Information Sciences, 237, 82–117.

Cui, X., Gao, J., & Potok, T. E. (2006). A flocking based algorithm for document clustering analysis. Journal of Systems Architecture, 52(8-9), 505–515. Journal of ICT, 15, No. 1 (June) 2016, pp: 57–

Cui, X., Potok, T. E., & Palathingal, P. (2005). Document clustering using particle swarm optimization. In Proceedings 2005 IEEE Swarm Intelligence Symposium, SIS 2005. (pp. 185–191). IEEEXplore. Retrieved from doi:10.1109/SIS.2005.1501621

Deneubourg, J. L., Goss, S., Franks, N., Sendova-Franks, A., Detrain, C., & Chrétien, L. (1991). The dynamics of collective sorting: robot-like ants and ant-like robots. In Proceedings of the First International Conference on Simulation of Adaptive Behavior on from Animals to Animats (pp. http://jict.uum.edu.my 356–363). MIT Press Cambridge, MA, USA.

Fogel, D. B. (1994). Asympototic convergence properties of gentic algorithms and evaluationary programming. Cybernetics and Systems, 25(3), 389–407.

Forsati, R., Mahdavi, M., Shamsfard, M., & Meybodi, M. R. (2013). Efficient stochastic algorithms for document clustering. Elsevier, Information Sciences, 220, 269–291. Retrieved from doi: 10.1016/j.ins.2012.07.025

Gil-Garicia, R., & Pons-Porrata, A. (2010). Dynamic hierarchical algorithms for document clustering. Elsevier, Pattern Recognition Letters, 31(6), 469–477. Retrieved from doi: 10.1016/j.patrec.2009.11.011

Glover, F. (1986). Future paths for integer programming and links to artificial intelligence. Computers and Operations Research, 13(No.5), 533–549.

Hassanzadeh, T., Vojodi, H., & Moghadam, A. M. E. (2011). An Image segmentation approach based on maximum variance intra-cluster method and Firefly algorithm. In Seventh International Conference on Natural Computation (ICNC) (Vol. 3, pp. 1817–1821). Shanghai: IEEE Explore. Retrieved from doi:10.1109/ICNC.2011.6022379

Hatamlou, A., Abdullah, S., & Nezamabadi-pour, H. (2012). A combined approach for clustering based on K-means and gravitational search algorithms. Elsevier, Swarm and Evolutionary Computation, 6, 47–52. Retrieved from doi: 10.1016/j.swevo.2012.02.003

Jain, A. K. (2010). Data clustering: 50 years beyond K-means. Elsevier, Pattern Recognition Letters, 31(8), 651–666. Retrieved from doi: 10.1016/j.patrec.2009.09.011 Journal of ICT, 15, No. 1 (June) 2016, pp: 57–

Kashef, R., & Kamel, M. (2010). Cooperative clustering. Elsevier, Pattern Recognition, 43(6), 2315–2329. Retrieved from doi: 10.1016/j. patcog.2009.12.018

Kashef, R., & Kamel, M. S. (2009). Enhanced bisecting k-means clustering using intermediate cooperation. Elsevier, Pattern Recognition, 42(11), 2557–2569.

Kennedy, J., & Eberhart, R. (1995). Particle swarm optimization. Proceedings http://jict.uum.edu.my of IEEE International Conference on Neural Networks IV. Perth, WA: IEEE. Retrieved from doi:10.1109/ICNN.1995.488968

Kirkpatrick, S., Gelatt, C. D., & Vecchi, M. P. (1983). Optimization by simulated annealing. New Series, 220(No. 4598), 671–680.

Kuo, R. J., & Zulvia, F. E. (2013). automatic clustering using an improved particle swarm optimization. Journal of Industrial and Intelligent Information, 1(1), 46–51.

Lewis, D. (1999). The reuters-21578 text categorization test collection. Retrieved from Available online at :http://kdd.ics.uci.edu/database/ reuters21578/reuters21578.html

Luo, C., Li, Y., & Chung, S. M. (2009). Text document clustering based on neighbors. Elsevier, Data & Knowledge Engineering, 68(11), 1271–1288. Retrieved from doi: 10.1016/j.datak.2009.06.007

Mahmuddin, M. (2008). Optimisation using Bees algorithm on unlabelled data problems. Manufactoring engineering centre. Cardiff: Cardif University, UK.

Manning, C. D., Raghavan, P., & Schütze, H. (2008). Introduction to Information Retrieval (1st ed.). New York, USA: Cambridge University Press.

Mohammed, A. J., Yusof, Y., & Husni, H. (2014). A Newton’s universal gravitation inspired Firefly algorithm for document clustering. Proceedings of Advanced in Computer Science and its Applications, v. 279, Lecture Notes in Electrical Engineering, Jeong, H.Y., Yen, N. Y., Park, J.J. (Jong Hyuk), Springer Berlin Heidelberg, pp. 1259-1264. Journal of ICT, 15, No. 1 (June) 2016, pp: 57–

Mohammed, A. J., Yusof, Y., & Husni, H. (2014). Weight-based Firefly algorithm for document clustering. Proceedings of the First International Conference on Advanced Data and Information Engineering (DaEng-2013), v. 285, Lecture Notes in Electrical Engineering, Herawan, T., Deris, M. M., Abawajy, J., Springer Berlin Heidelberg, pp. 259-266.

Murugesan, K., & Zhang, J. (2011). Hybrid hierarchical clustering : An expermintal analysis (p. 26). University of Kentucky. http://jict.uum.edu.my

Mustaffa, Z., Yusof, Y., & Kamaruddin, S. (2013). Enhanced Abc-Lssvm for Energy fuel price prediction. Journal of Information and Communication Technology, 12, 73–101. Retrieved from http://www.jict.uum.edu.my/ index.php

Picarougne, F., Azzag, H., Venturini, G., & Guinot, C. (2007). A new approach of data clustering using a flock of agents. Evolutionary Computation, 15(3), 345–367. Cambridge: MIT Press.

Rashedi, E., Nezamabadi-pour, H., & Saryazdi, S. (2009). GSA: A gravitational search algorithm. Elsevier, Information Sciences, 179(13), 2232–2248.

Rothlauf, F. (2011). Design of modern heuristics principles and application. Springer-Verlag Berlin Heidelberg. Retrieved from doi:10.1007/978-3-450-72962-4

Sayed, A., Hacid, H., & Zighed, D. (2009). Exploring validity indices for clustering textual data. In Mining Complex Data, 165, 281–300.

Senthilnath, J., Omkar, S. N., & Mani, V. (2011). Clustering using Firefly algorithm: Performance study. Elsevier, Swarm and Evolutionary Computation, 1(3), 164–171. Retrieved from doi: 10.1016/j. swevo.2011.06.003

Tan, S. C. (2012). Simplifying and improving swarm based clustering. In IEEE Congress on Evolutionary Computation (CEC) (pp. 1–8). Brisbane, QLD: IEEE.

Tan, S. C., Ting, K. M., & Teng, S. W. (2011a). A general stochastic clustering method for automatic cluster discovery. Elsevier, Pattern Recognition, 44(10-11), 2786–2799. Journal of ICT, 15, No. 1 (June) 2016, pp: 57–

Tan, S. C., Ting, K. M., & Teng, S. W. (2011b). Simplifying and improving ant-based clustering. In Procedia Computer Science (pp. 46–55).

Tang, R., Fong, S., Yang, X. S., & Deb, S. (2012). Integrating nature-inspired optimization algorithms to K-means clustering. In Seventh International Conference on Digital Information Management (ICDIM), 2012 (pp. 116–123). Macau: IEEE. Retrieved from doi:10.1109/ ICDIM.2012.6360145

TREC. (1999). Text REtrieval Conference (TREC). Retrieved from http://http://jict.uum.edu.my trec.nist.gov

Yang, X. S. (2010). Nature-inspired metaheuristic algorithms (2nd ed). United Kingdom: Luniver press.

Yujian, L., & Liye, X. (2010). Unweighted multiple group method with arithmetic mean. In IEEE Fifth International Conference on Bio-Inspired Computing: Theories and Applications (BIC-TA) (pp. 830–834). Changsha: IEEE. Retrieved from doi:10.1109/BICTA.2010.5645232

Zhong, J., Liu, L., & Li, Z. (2010). A novel clustering algorithm based on gravity and cluster merging. Advanced Data Mining and Applications, 6440, 302–309. Retrieved from doi:10.1007/978-3-642-17316-5_30

Downloads

Published

25-05-2016

Issue

Vol. 15 No. 1 (2016): Journal of Information and Communication Technology (JICT) Vol. 15, No.1 June 2016

Section

Articles

How to Cite

Mohammed, A. J., Yusof, Y., & Husni, H. (2016). GF-CLUST: A Nature-Inspired Algorithm for Automatic Text Clustering. Journal of Information and Communication Technology, 15(1), 57-81. https://doi.org/10.32890/jict2016.15.1.3

Research impact

Harvested 2026-09-06
14 citations, from OpenAlex — the highest of the sources checked

Counts differ between services because each indexes a different body of literature. None of them is the whole picture.

Identifiers DOI 10.32890/jict2016.15.1.3 OpenAlex W2595912114

Most read articles by the same author(s)

<< < 1 2