Skip to main content
SpringerLink
Log in

Improvements in Flock-Based Collaborative Clustering Algorithms

  • Chapter
Computational Intelligence

Part of the book series: Intelligent Systems Reference Library ((ISRL,volume 1))

Abstract

Inspiration from nature has driven many creative solutions to challenging real life problems. Many optimization methods, in particular clustering algorithms, have been inspired by such natural phenomena as neural systems and networks, natural evolution, the immune system, and lately swarms and colonies. In this paper, we make a brief survey of swarm intelligence clustering algorithms and focus on the flocks of agents-based clustering and data visualization algorithm, (FClust). A few limitations of FClust are then discussed with proposed improvements.We thus propose the FClust-annealing algorithm that decreases the number of iterations needed to converge and improves the quality of resulting clusters. We also propose a (K-means+ FClust) hybrid algorithm which decreases the complexity of FClust from quadratic to linear, with further improvements in the cluster quality. Experiments on both artificial and real data illustrate the workings of FClust and the advantages of our proposed variants.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Abraham, A., Das, S., Roy, S.: Swarm Intelligence Algorithms for Data Clustering. In: Soft Computing for Knowledge Discovery and Data Mining, pp. 279–313. Springer, US (2008)

    Chapter  Google Scholar 

  2. Abraham, A., Das, S., Roy, S.: Swarm Intelligence Algorithms for Data Clustering. In: Soft Computing for Knowledge Discovery and Data Mining, pp. 279–313. Springer, US (2008)

    Chapter  Google Scholar 

  3. Azzag, H., Monmarche, N., Slimane, M., Venturini, G.: Anttree: a new model for clustering with artificial ants. In: The 2003 Congress on Evolutionary Computation CEC 2003, vol. 4, pp. 2642–2647 (2003)

    Google Scholar 

  4. Couzin, I.D., Krause, J.E.N.S., James, R., Ruxton, G.D., Franks, N.R.: Collective memory and spatial sorting in animal groups. Journal of Theoretical Biology 218(1), 1–11 (2002)

    Article  MathSciNet  Google Scholar 

  5. Cui, X., Potok, T.E.: Document clustering analysis based on hybrid pso+kmeans algorithm. Journal of Computer Sciences (Special Issue), 27–33 (2005)

    Google Scholar 

  6. Cui, X., Potok, T.E.: A distributed agent implementation of multiple species flocking model for document partitioning clustering. In: Klusch, M., Rovatsos, M., Payne, T.R. (eds.) CIA 2006. LNCS, vol. 4149, pp. 124–137. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  7. Cui, X., Potok, T.E., Palathingal, P.: Document clustering using particle swarm optimization. In: IEEE Swarm Intelligence Symposium (2005)

    Google Scholar 

  8. Dhillon, I.S., Modha, D.S.: Concept decompositions for large sparse text data using clustering. Machine Learning 42(1-2), 143–175 (2001)

    Article  MATH  Google Scholar 

  9. Handl, J., Knowles, J., Dorigo, M.: On the performance of ant-based clustering. In: Proceedings of the Third International Conference on Hybrid Intelligent Systems (2003)

    Google Scholar 

  10. Handl, J., Knowles, J., Dorigo, M.: Strategies for the increased robustness of ant-based clustering. In: Di Marzo Serugendo, G., Karageorgos, A., Rana, O.F., Zambonelli, F. (eds.) ESOA 2003. LNCS, vol. 2977, pp. 90–104. Springer, Heidelberg (2004)

    Google Scholar 

  11. Handl, J., Meyer, B.: Ant-based and swarm-based clustering. Swarm Intelligence 1(2), 95–113 (2007)

    Article  Google Scholar 

  12. Heppner, F., Grenander, U.: A stochastic nonlinear model for coordinated bird flocks. In: Krasner, S. (ed.) The Ubiquity of Chaos, pp. 233–238. AAAS, Washington (1990)

    Google Scholar 

  13. Jain, A.K., Dubes, R.C.: Algorithms for Clustering Data. Prentice Hall, Englewood Cliffs (1988)

    MATH  Google Scholar 

  14. Jain, A.K., Murthy, M., Flynn, P.: Data clustering: A review. ACM Computing Reviews (1999)

    Google Scholar 

  15. Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings of the IEEE International Conference on Neural Networks, vol. 4, pp. 1942–1948 (1995)

    Google Scholar 

  16. Kennedy, J., Eberhart, R., Shi, Y.: Swarm Intelligence. Morgan Kaufmann Publishers Inc, San Francisco (2001)

    Google Scholar 

  17. Labroche, N., Monmarche, N., Venturini, G.: A new clustering algorithm based on the chemical recognition system of ants. In: Proceedings of the 15th European Conference on Artificial Intelligence (2002)

    Google Scholar 

  18. Labroche, N., Monmarche, N., Venturini, G.: Antclust: Ant clustering and web usage mining. In: Cantú-Paz, E., et al. (eds.) GECCO 2003. LNCS, vol. 2723, pp. 25–36. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  19. Labroche, N., Monmarche, N., Venturini, G.: Web sessions clustering with artificial ants colonies. In: WWW 2003, The Twelfth International World Wide Web Conference, Budapest, Hungary (2003)

    Google Scholar 

  20. Lumer, E.D., Faieta, B.: Diversity and adaptation in populations of clustering ants. In: Proceedings of the third international conference on Simulation of adaptive behavior: from animals to animats 3, pp. 501–508. MIT Press, Cambridge (1994)

    Google Scholar 

  21. MacQueen, J.: Some methods for classification and analysis of multivariate observations. In: Cam, L.M.L., Neyman, J. (eds.) Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 281–297. University of California Press (1967)

    Google Scholar 

  22. van der Merwe, D.W., Engelbrecht, A.P.: Data clustering using particle swarm optimization. In: Proceedings of IEEE Congress on Evolutionary Computation 2003 (CEC 2003), vol. 1, pp. 215–220 (2003)

    Google Scholar 

  23. Millonas, M.M.: Swarms, phase transition, and collective intelligence. In: Langton, C.G. (ed.) Artificial life III. Addison Wesley, Reading (1994)

    Google Scholar 

  24. Nasraoui, O., Krishnapuram, R., Frigui, H., Joshi, A.: Extracting web user profiles using relational competitive fuzzy clustering. International Journal on Artificial Intelligence Tools 9(4), 509–526 (2000)

    Article  Google Scholar 

  25. Nasraoui, O., Krishnapuram, R., Joshi, A.: Mining web access logs using a relational clustering algorithm based on a robust estimator. In: Proc. of the Eighth International World Wide Web Conference, Toronto, pp. 40–41 (1999)

    Google Scholar 

  26. Nasraoui, O., Krishnapuram, R., Joshi, A.: Relational clustering based on a new robust estimator with application to web mining. In: Proceedings of the North American Fuzzy Information Society, New York City, pp. 705–709 (1999)

    Google Scholar 

  27. Omran, M., Engelbrecht, A.P., Salman, A.: Particle swarm optimization method for image clustering. International Journal of Pattern Recognition and Artificial Intelligence 19(3), 297–322 (2005)

    Article  Google Scholar 

  28. Omran, M., Salman, A., Engelbrecht, A.P.: Image classification using particle swarm optimization. In: Conference on Simulated Evolution and Learning, vol. 1, pp. 370–374 (2002)

    Google Scholar 

  29. Picarougne, F., Azzag, H., Venturini, G., Guinot, C.: On data clustering with a flock of artificial agents. In: Proceedings of the 16th IEEE International Conference on Tools with Artificial Intelligence, ICTAI 2004 (2004)

    Google Scholar 

  30. Picarougne, F., Azzag, H., Venturini, G., Guinot, C.: A new approach of data clustering using a flock of agents. Evolutionary Computation 15(3), 345–367 (2007)

    Article  Google Scholar 

  31. Proctor, G., Winter, C.: Information flocking: Data visualisation in virtual worlds using emergent behaviours. In: Heudin, J.-C. (ed.) VW 1998. LNCS, vol. 1434, pp. 168–176. Springer, Heidelberg (1998)

    Chapter  Google Scholar 

  32. Reynolds, C.W.: Flocks, herds, and schools: A distributed behavioral model. Computer Graphics 21(4), 25–34 (1987)

    Article  MathSciNet  Google Scholar 

  33. Saka, E., Nasraoui, O.: Simultaneous clustering and visualization of web usage data using swarm-based intelligence. In: Proceedings of the 20th IEEE International Conference on Tools with Artificial Intelligence, ICTAI 2008 (2008)

    Google Scholar 

  34. Vizine, A.L., de Castro, L.N., Hruschka, E.R., Gudwin, R.R.: Towards improving clustering ants: an adaptive ant clustering algorithm. Informatica 29, 143–154 (2005)

    MATH  Google Scholar 

  35. Weiss, G. (ed.): Multiagent Systems: A Modern Approach To Distributed Artificial Intelligence. The MIT Press, Cambridge (2000)

    Google Scholar 

  36. White, T., Pagurek, B.: Towards multi-swarm problem solving in networks. In: Demazeau, Y. (ed.) Proceedings of the 3rd International Conference on Multi-Agent Systems (ICMAS 1998). IEEE Press, Paris (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Knowledge Discovery and Web Mining Lab, University of Louisville, KY, USA

    Esin Saka & Olfa Nasraoui

Authors
  1. Esin Saka
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Olfa Nasraoui
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Computer Science, Cardiff University , 5 The Parade,Roath, CF24 3AA, Cardiff, UK

    Christine L. Mumford

  2. University of South Australia Adelaide , Mawson Lakes Campus, South Australia, Australia

    Lakhmi C. Jain

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Saka, E., Nasraoui, O. (2009). Improvements in Flock-Based Collaborative Clustering Algorithms. In: Mumford, C.L., Jain, L.C. (eds) Computational Intelligence. Intelligent Systems Reference Library, vol 1. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01799-5_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-01799-5_20

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-01798-8

  • Online ISBN: 978-3-642-01799-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation