Vitorino Ramos: Web Usage Mining using Artificial Ant-based Clustering and Genetic Programming

48. Ajith Abraham, Vitorino Ramos, Web Usage Mining using Artificial Ant Colony Clustering and Genetic Programming, in CEC´03 - Congress on Evolutionary Computation, IEEE Press, ISBN 078-0378-04-0, pp. 1384-1391, Canberra, Australia, 8-12 Dec. 2003.

PDF file: paper (458 Kb)

Abstract: The rapid e-commerce growth has made both business community and customers face a new situation. Due to intense competition on one hand and the customer's option to choose from several alternatives business community has realized the necessity of intelligent marketing strategies and relationship management. Web usage mining attempts to discover useful knowledge from the secondary data obtained from the interactions of the users with the Web. Web usage mining has become very critical for effective Web site management, creating adaptive Web sites, business and support services, personalization, network traffic flow analysis and so on. The study of ant colonies behavior and their self-organizing capabilities is of interest to knowledge retrieval/management and decision support systems sciences, because it provides models of distributed adaptive organization, which are useful to solve difficult optimization, classification, and distributed control problems, among others. In this paper, we propose an ant clustering algorithm to discover Web usage patterns (data clusters) and a linear genetic programming approach to analyze the visitor trends. Empirical results clearly shows that ant colony clustering performs well when compared to a self-organizing map (for clustering Web usage patterns) even though the performance accuracy is not that efficient when comparared to evolutionary-fuzzy clustering (i-miner) approach.

Keywords: Ant-based Clustering, Web Usage Mining, Ant Systems, Stigmergy, Data-Mining, Linear Genetic Programming.

Cited by:

º Vandecruys, O., Martens, D., Baesens, B., Mues, C., De Backer, M., Haesen, R., "Mining software repositories for comprehensible software fault prediction models", in Journal of Systems and Software, 81 (5) pp. 823-839, 2008.

º Yong-Hua Song, Haiyan Lu, Kwang Y. Lee, I. K. Yu, "Fundamentals of Ant Colony Search Algorithms", in Modern Heuristic Optimization Techniques, Kwang Y. Lee, Mohamed A. El-Sharkawi (Eds.), ISBN: 9780471457114, IEEE Press, Jan. 2008.

º A. Abraham and C. Grosan, "Engineering Evolutionary Intelligent Systems: Methodologies, Architectures and Reviews", Springer-Verlag, Studies in Computational Intelligence (SCI) 82, pp. 1-22, 2008.

º Bin Zhang, Yi-Dan Su, "An Ant Colony Clustering Algorithm Based on Directional Similarity: ACCADS", in Computer and Modernization Journal, n. 3, pp. 86-89, China, 2008.

º Julia Handl and Bernd Meyer, "Ant-based and Swarm-based clustering", in Swarm Intelligence Journal, 1(2):95-113, Springer, 2007.

º Paola Britos, Damián Martinelli, Hernán Merlino, Ramón García-Martínez, "Web Usage Mining Using Self Organized Maps", in IJCSNS International Journal of Computer Science and Network Security, VOL.7 No.6, pp. 45-50, June 2007.

º David Martens, Manu De Backer, Raf Haesen, Jan Vanthienen, Monique Snoeck and Bart Baesens, "Classification with Ant Colony Optimization", in IEEE Transactions on Evolutionary Computation, Vol. 11, nº 5, pp. 651-665, October 2007.

º Hiroshi Tamaki, Ken-ichi Fukui, Masayuki Numao, and Satoshi Kurihara, "Acquisition of Sensor-Network Topology Based on Multi-Agent Pheromonal Coordination", Workshop on Heterogeneous Agent Systems and Complex Networks in European Conference on Complex Systems (ECCS), 2007.

º Pellegrini P. and Moretti E., "A Computational Analysis on a Hybrid Approach: Quick-and-dirty Ant Colony Optimization", to appear on Applied Mathematical Sciences, 2007.

º Abdul-Wahid, S. Andonie, R. Lemley, J. Schwing, J. Widger, J., "Adaptive Distributed Database Replication Through Colonies of Pogo Ants", in Parallel and Distributed Processing Symposium, 2007. IPDPS 2007. IEEE International, ISBN: 1-4244-0910-1, pp. 1-8, Long Beach, CA, 26-30 March 2007.

º Braden Box, "Ad Placement on the Internet Using Ant-Based Algorithms", Honours project (supervision: Tony White), Carleton University, Canada, 2007.

º Pavol Navrat, Martin Kovacik, "Web Search Engine as a Bee Hive", IEEE/WIC/ACM International Conference on Web Intelligence (WI 2006 Main Conference Proceedings) (WI'06), pp. 694-701, 2006.

º Vijaykumar, V., Chandrasekar, R. and Srinivasan, T., "An Obstacle Avoidance Strategy to Ant Colony Optimization Algorithm for Classification in Event Logs", in 2006 IEEE Conference on Cybernetics and Intelligent Systems, pp. 1-6, June 2006.

º Fei, B., Eloff, J., Olivier, M., Venter, H., "Analysis of Web Proxy Logs", in IFIP Int. Fed. for Information Processing, 222, pp. 247-258, 2006.

º Shen Jie, Lin Ying, Chen Zhimin, "Incremental Web Usage Mining Based on Active Ant Colony Clustering", in Wuhan Univ. Journal of Natural Sciences, Vol.11, No.5, pp. 1081-1085, 2006.

º Emine Tug, Merve Sakiroglu and Ahmet Arslana, "Automatic discovery of the sequential accesses from web log data files via a genetic algorithm", in Knowledge-Based Systems Journal, Volume 19, Issue 3, pp. 180-186, July 2006.

º S. Abdul-Walid, R. Andonie, J. Lemley, J. Schwing, and J. Widger, "Event-Driven Load Balancing of Partially Replicated Objects through a Swarm of Mobile Agents", in CI´'06 - Computational Intelligence Conf., San Francisco, CA, USA, Nov. 2006.

º Chang-Chun Lin, "Optimal Web Site Reorganization considering Information overload and Search Depth", in European Journal of Operational Research, Volume 173, Issue 3, pp. 839-848, 16 Sept. 2006.

º Junzhong Ji, Fan Chen, Chunnian Liu, "A New Method for Classifying Customer Purchasing Power", in Advances in Intelligent IT - Active Media Technology, Yuefeng Li, Mark Looi, Ning Zhong (Eds.), Frontiers in Artificial Intelligence and Applications, IOS Press, pp. 413-416, 2006.

º Mohamed Rida Abdessemed, "Proposition d'une Méthode de Classification dans un Environnement de Robotique Collective", Thése de Doctorat, Université de Batna, Algerie, Juin 2006.

º Martinelli, D., Merlino, H., Britos, P., García-Martínez, R., "Identificación de Hábitos de Uso de Sitios Web Utilizando SOM", Reportes Técnicos en Ingeniería del Software, 8(1): 17-24, ISSN 1667-5002, 2006.

º Crina Grosan, Ajith abraham, Monica Chis, "Swarm Intelligence in Data Mining", in Swarm Intelligence in Data Mining, A. Abraham, C. Grosan, V. Ramos (Eds.), Studies in Computational Intelligence (series), Vol. 34, pp. 1-20, Springer, Germany, Set. 2006.

º Gülüzar Kekec, Nejat Yumusak, Numan Celebi, "Data Mining and Clustering with Ant Colony Optimization", in Proceedings of 5th International Symposium on Intelligent Manufacturing Systems, May 29-31, pp. 1178-1190, 2006.

º D. Djordjevic, Q. Zhang, K. Chandramouli, T. Piatrik, S. Sav, J. Jose, J. Urban, G. Anadiotis, "State of the Art on User Relevance Feedback and Biologically Inspired Systems", in K-Space EU Project - Information Society Technologies (FP6-0270026), ID4.4 Report, Queen Mary Univ. of London (QMUL, UK), Dublin City Univ. (DCU, Ireland), Glasgow Univ. (GU, UK), Centrum voor Wiskunde en Informatica (WCI, Netherlands), 98 pages, 8 July 2006.

º Riadh Ben Messaoud, "Couplage de l’analyse en ligne et de la fouille de données pour l’exploration, l’agrégation et l’explication des données complexes", These Doctorat, Université Lumière (Lyon 2), École Doctorale de Sciences Cognitives, 248 pp., Nov. 2006.

º David Martens, Manu de Backer, Raf Haesen, Bart Baesens, Tom Holvoet, "Ants Constructing Rule-based Classifiers", in Swarm Intelligence in Data Mining, A. Abraham, C. Grosan, V. Ramos (Eds.), Studies in Computational Intelligence (series), Vol. 34, pp. 21-43, Springer, Germany, Set. 2006.

º Michelle Galea, Qiang Shen, "Simultaneous Ant Colony Optimization Algorithms for Learning Linguistic Fuzzy Rules", in Swarm Intelligence in Data Mining, A. Abraham, C. Grosan, V. Ramos (Eds.), Studies in Computational Intelligence (series), Vol. 34, pp. 75-99, Springer, Germany, Set. 2006.

º Chi-Ho Tsang, Sam Kwong, "Ant Colony Clustering and Feature Extraction for Anomaly Intrusion Detection", in Swarm Intelligence in Data Mining, A. Abraham, C. Grosan, V. Ramos (Eds.), Studies in Computational Intelligence (series), Vol. 34, pp. 102-123, Springer, Germany, Set. 2006.

º Hanene Azzag, Christiane Guinot, Gilles Venturini, "Data and Text Mining with Hierarchical Clustering Ants", in Swarm Intelligence in Data Mining, A. Abraham, C. Grosan, V. Ramos (Eds.), Studies in Computational Intelligence (series), Vol. 34, pp. 153-187, Springer, Germany, Set. 2006.

º Ouadfel Salima, "Contributions à la Segmentation d’images basées sur la résolution collective par colonies de fourmis artificielles", Thèse Doctorat en Informatique, Université Hadj Lakhdar de Batna, Faculté des Sciences de l’Ingénieur, Algérie, Juillet 2006.

º Jhon Alexis Sanabria Garzón, "Minería Web utilizando Lógica Difusa: Importancia, Estado del Arte", in Seminario de investigacion I, Maestria en Ingenieria de Sistemas y Computacion, Universidad Nacional de Colombia, 2006.

º Eleni Christodoulou, Theodore Dalamagas, and Timos Sellis, "NaviMoz: Mining Navigational Patterns in Portal Catalogs", in Proceedings of the EDBT´06 (Int. Conf. on Extending Database Technology) - Workshop on Pattern Representation and Management (PaRMa'06), 30 Mar, Munich, Germany, 2006.

º Kim, Kyung-Joong; Cho, Sung-Bae, "A Comprehensive Overview of the Applications of Artificial Life", in Artificial Life, MIT Press, Volume 12, Number 1, pp. 153-182(30), Jan. 2006.

º A. Abraham, He Guo, and Hongbo Liu, "Swarm Intelligence: Foundations, Perspectives and Applications", in Swarm Intelligence in Data Mining, A. Abraham, C. Grosan, V. Ramos (Eds.), Studies in Computational Intelligence (series), approx. 300 pages (hardcover), Springer, Germany, 2006.

º Rafael Santos, "Princípios e Aplicações de Mineração de Dados", Ministério da Ciência e Tecnologia, Brochura do programa de Pós-Graduação em Computação Aplicada do Instituto Nacional de Pesquisas Espaciais, Brasil, 2006.

º Sanabria Garzón Jhon Alexis, "Inteligencia de Enjambre y Lógica Difusa Aplicada a la Minería Web: Importancia, Estado del Arte", Web Mining survey, Colombia, 2006.

º Juan D. Velásquez, "Mining web data: Techniques for understanding the user behavior in the Web", in TIS 2006, Talleres de Ingeniería de Sistemas (Taller de Inteligencia de Negocios), Departamento de Ingeniería Industrial, Facultad de Ciencias Físicas y Matemáticas, Universidad de Chile, Chile, Junio 2006.

º "Mining user Navigation Pattern using Incremental Ant Colony Clustering", in Journal of Computer Applications, Vol.25 No.7 P.1654-1657,1660, 2005.

º Davide Anguita and Bogdan Gabrys (Eds.), "Survey on Nature-inspired Data Technologies", Nature-inspired Data Technologies NiDT survey, Nature Inspired Smart Information Systems (NISIS org.), 11 Nov. 2005.

º Kwang Y. Lee, John G. Vlachogiannis, "Optimization of Power Systems based on Ant Colony System Algorithms: An Overview", in Proc. of the 13th Int. Conf. on Intelligent Systems Application to Power Systems 05, pp. 22-35, Nov. 2005.

º Carl-Erik J. Herheim, "Swarm Intelligence and Automatic Development of Algorithms Through Evolution", Master Thesis in Informatics, Østfold University College, Norway, Sept. 2005.

º Merkle, D., Middendorf, M., Scheidler, A., "Decentralized Packet Clustering in Router-based Networks", in International Journal of Foundations of Computer Science, Vol. 16, Issue 2, pp. 321-341, April 2005.

º Hu, X., Wang, T., Li, D., "A new approach of color quantization based on ant colony clustering algorithm", in International Conference on Information Technology: Coding and Computing, ITCC, Volume 1, pp. 102-108, 2005.

º Miguel Azócar, Gustavo Valdés, "Comparación entre Algoritmos de hormigas v/s AG frente a un problema de elección de trayectoria óptima", in Seminario Computadores II (Prof. Tomás Arredondo Vidal), Departamento de Electrónica - UTFSM, Univ. Federico Santa Maria, Valparaíso, Chile, May 2005.

º Sun Ya-ming, Wang Chen-li, Zhang Zhi-sheng and Liu Shang-wei, "Clustering Analysis of Power System Load Series based on Ant Colony Optimization Algorithm", Proc. of the Chinese Society for Electrical Engineering, Vol.25 No.18 P.40-45, China, 2005.

º Fabien Picarougne, Gilles Venturini, Christiane Guinot, "Expérimentations de méthodes parallèles de recherche d’information sur internet", Journée sur les systèmes d’information élaborée, île Rousse 2005.

º Shang Liu, Zhi-Tong Dou, Fei Li and Ya-Lou Huang, "A new ant colony clustering algorithm based on DBSCAN", in Machine Learning and Cybernetics, 2004. Proceedings of 2004 International Conference on Machine Learning and Cybernetics, vol. 3, pp. 1491- 1496, 26-29 Aug. 2004.

º A. Vizine, L.N. de Castro, E.R. Hruschka, R.R. Gudwin, "Towards Improving Clustering Ants: An Adaptive Clustering Algorithm", Informatica Journal, Vol. 29, 2005.

º Hu Xinrong, Wang Tianzhen, Li Dehua, "A New Approach of Color Image Quantization", in Journal of Communication and Computers, Volume 2, No.3 (Serial No.4), p. 72, ISSN1548-7709, USA, March 2005.

º Renato Reder Cazangi, Fernando J. Von Zuben, Maurício F. Figueiredo, "Autonomous navigation system applied to collective robotics with ant-inspired communication", in GECCO-05, Proc. of the 2005 Conference on Genetic and Evolutionary Computation, pp. 121-128, ISBN:1-59593-010-8, ACM Press, Washington DC, USA, 2005.

º José L. O. Priego, "Análisis de sesiones de la web del Cindoc: una aproximación a la minería de uso web", Revista El Profesional del Información, V.14, n.3, ISSN 1386-6710, Spain, Mayo-Junio 2005.

º Darren Ming-Shan Kao, "Web Mining - A New Improved Version of Hybrid Prototype", Internal Tech Report, Department of Computer Science, University of Calgary, Canada, 2005.

º Ajith Abraham, Natural Computation for Business Intelligence from Web Usage Mining, 7th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC'05), Timisoara, Romania, IEEE CS Press, 2005.

º Miguel Azócar, Gustavo Valdés, "Modelamiento de la utilización de la Web empleando colonias de hormigas y Programación Genética", in Seminario Computadores II (Prof. Tomás Arredondo Vidal), Departamento de Electrónica - UTFSM, Univ. Federico Santa Maria, Valparaíso, Chile, May 2005.

º Alaine Margarete Guimarães, "Aplicação de computação evolucionária na mineração de dados físico-químicos da água e do solo", 145 pp, Tese (Doutorado em Agronomia / Energia na Agricultura) - Faculdade de Ciências Agronômicas, Universidade Estadual Paulista, Botucatu. 2005.

º N. Holden, Alex A. Freitas, "Web Page Classification with an Ant Colony Algorithm", in PPSN VIII, 8th Int. Conf. on Parallel Problem Solving fron Nature, Birmingham, UK, Sept. 18-22, Springer Verlag, LNCS, 2004.

º Daniel Merkle, Martin Middendorf, Alexander Scheidler, "Decentralized Packet Clustering in Networks", 18th International Parallel and Distributed Processing Symposium (IPDPS'04) - Workshop 6, IEEE, Santa Fe, New Mexico, USA, April 26-30, 2004.

º Merloti, P.E., "Optimization Algorithms Inspired by Biological Ants and Swarm Behavior", San Diego State University, Artificial Intelligence Technical Report, CS550, San Diego, June 2004.

º Gilles Verley, Nicolas Monmarché, "Compétition de Colonies de Fourmis pour l'Apprentissage Supervisé: CompetAnts", in SFC 05 - 12èmes Rencontres de la Société Francophone de Classification, Montréal, Canada, 30 Mai - 1 Juin 2005.

º Damian Martinelli, "Identificación de Hábitos de Uso de Sitios WEB Utilizando Redes Neuronales", Tesis Mestrado (Master Thesis), Facultad de Ingeniería. Universidad de Buenos Aires, Argentina, 2005.

º Maynard Exum,"Self-Organized Data Clustering with the help of Swarm Agents", Database Systems CS541 Class presentation (Instructor: Dr. Amin A. Abdulghani), Rutgers University, Departm. of Computer Science, New Jersey, USA, 2005.

º H. Azzag, F. Picarougne, C. Guinot, G. Venturini, "Un survol des algorithmes biomimétiques pour la classification", Classification et fouille de donnée, p. 13-24, RNTI-C-1, Cépaduès, 2004.

º Ming Shan Kao, "Analysis of the Hybrid Approach to Web Usage Mining", Project Proposal, Department of Computer Science - University of Calgary, Calgary, Canada, 2004.

º Ajith Abraham, "Evolutionary Computation in Intelligent Network Management", in Evolutionary Computing in Data Mining, Ashish Ghosh and Lakhmi Jain (Eds.), Studies in Fuzziness and Soft Computing, Springer Verlag Germany, 2004.

º Nicholas Holden, "Web Page Classification with Ant Colony Algorithms", C0620 Research Project Reports 2003/04, Comp. Science Dept., Kent University, UK, 2004.

º Nicolai Marquardt, "Swarm-Intelligence: Modelle und Anwendungen", Seminar: VR-Technologien, Prof. Dr. B. Fröhlich, Bauhaus-Universität Weimar, Jan. 2004.

º Nicolai Marquardt, "Intelligenz von Schwärmen: Grundlagen, Simulations-Modelle und Anwendungen", Bauhaus-Universität Weimar, Jan. 2004.

º Naresh Barsagade, "Web Usage Mining and Pattern Discovery: A Survey Paper", Computer Science and Engineering Dept. CSE Tech Report 8331, SMU Southern Methodist University, Dallas, Texas, USA, Dec. 8, 2003.

º Christodoulou Eleni, "Data Mining on Users' Navigations through Portal Catalogs", Master Thesis (in Greek), in NTUA - National Technical University of Athens, Knowledge and DataBase Systems Laboratory, School of Computer and Electrical Engineering, Athens, Greece, 2005.

º Hernán Merlino, "Ambiente de Integración de Herramientas para Exploración de Datos Centrados en la WEB", in Tesis de Magister en Ingeniería del Software, ITBA Instituto Tecnológico de Buenos Aires, Buenos Aires, Argentina, Noviembre 2005.

56. Varying the Population Size of Artificial Foraging Swarms on Time Varying Landscapes.

63. Social Cognitive Maps, Swarm Collective Perception and Distributed Search on Dynamic Landscapes.

70. Computational Chemotaxis in Ants and Bacteria over Dynamic Environments.

69. Binary Ant Algorithm.

37. On the Implicit and on the Artificial - Morphogenesis and Emergent Aesthetics in Autonomous Collective Systems.