Abstract: Search engines are the instruments for website navigation and search, because the Internet is big and has expanded greatly. By continuously downloading web pages for processing, search engines provide search facilities and maintain indices for web documents. Online crawling is the term for this process of downloading web pages. This paper proposes solution to network traffic problem in migrating parallel web crawler. The primary benefit of a parallel web crawler is that it does local analysis at the data's residence rather than inside the web search engine repository. As a result, network load and traffic are greatly reduced, which enhances the performance, efficacy, and efficiency of the crawling process. Another benefit of moving to a parallel crawler is that as the web gets bigger, it becomes important to parallelize crawling operations in order to retrieve web pages more quickly. A web crawler will produce pages of excellent quality. When the crawling process moves to a host or server with a specific domain, it begins downloading pages from that domain. Incremental crawling will maintain the quality of downloaded pages and keep the pages in the local database updated. Java is used to implement the crawler. The model that was put into practice supports all aspects of a three-tier, real-time architecture. An implementation of a parallel web crawler migration is shown in this paper. The method for efficient parallel web migration detects changes in the content and structure using neural network-based change detection techniques in parallel web migration. This will produce high-quality pages and detection for changes will always download new pages. Either of the following strategies is used to carry out the crawling process: either crawlers are given generous permission to speak with one another, or they are not given permission to communicate with one another at all. Both strategies increase network traffic. Here, a fuzzy logic-based system that predicts the load at a specific node and the path of network traffic is presented and implemented in MATLAB using the fuzzy logic toolbox.

Mohammed Faizan Farooqui, Mohammad Muqeem, Sultan Ahmad, Jabeen Nazeer and Hikmat A. M. Abdeljaber, “A Fuzzy Logic based Solution for Network Traffic Problems in Migrating Parallel Crawlers” International Journal of Advanced Computer Science and Applications(IJACSA), 14(2), 2023. http://dx.doi.org/10.14569/IJACSA.2023.0140252

@article{Farooqui2023,
title = {A Fuzzy Logic based Solution for Network Traffic Problems in Migrating Parallel Crawlers},
journal = {International Journal of Advanced Computer Science and Applications},
doi = {10.14569/IJACSA.2023.0140252},
url = {http://dx.doi.org/10.14569/IJACSA.2023.0140252},
year = {2023},
publisher = {The Science and Information Organization},
volume = {14},
number = {2},
author = {Mohammed Faizan Farooqui and Mohammad Muqeem and Sultan Ahmad and Jabeen Nazeer and Hikmat A. M. Abdeljaber}
}