Facebook pixel tracking

The Science and Information (SAI) Organization publishes open-access peer-reviewed journals in computer science and artificial intelligence.

Contact Info
Email info@thesai.org
Website thesai.org
Follow Us
Contact Info
Email info@thesai.org
Follow Us
Research Article | Open Access |

Mutual Exclusion Principle for Multithreaded Web Crawlers

Author 1: Kartik Kumar Perisetla
International Journal of Advanced Computer Science and Applications (IJACSA) · Vol. 3, No. 9 · Published 2012

DOI: https://doi.org/10.14569/IJACSA.2012.030925

Download PDF Cite Call for Papers

Abstract

This paper describes mutual exclusion principle for multithreaded web crawlers. The existing web crawlers use data structures to hold frontier set in local address space. This space could be used to run more crawler threads for faster operation. All crawler threads fetch the URL to crawl from the centralized frontier. The mutual exclusion principle is used to provide access to frontier for each crawler thread in synchronized manner to avoid deadlock. The approach to utilize the waiting time on mutual exclusion lock in efficient manner has been discussed in detail.

Keywords

Web Crawlers Mutual Exclusion principle Multithreading Mutex locks.

How to Cite this Article

Perisetla, K. K. (2012). Mutual Exclusion Principle for Multithreaded Web Crawlers. International Journal of Advanced Computer Science and Applications, 3(9). https://doi.org/10.14569/IJACSA.2012.030925

Perisetla, Kartik Kumar. "Mutual Exclusion Principle for Multithreaded Web Crawlers." International Journal of Advanced Computer Science and Applications, vol. 3, no. 9, 2012, https://doi.org/10.14569/IJACSA.2012.030925.

@article{Perisetla2012,
  title     = {Mutual Exclusion Principle for Multithreaded Web Crawlers},
  journal   = {International Journal of Advanced Computer Science and Applications},
  volume    = {3},
  number    = {9},
  year      = {2012},
  publisher = {The Science and Information Organization},
  author    = {Kartik Kumar Perisetla},
  doi       = {10.14569/IJACSA.2012.030925},
  url       = {https://doi.org/10.14569/IJACSA.2012.030925}
}

Open Access — licensed under a Creative Commons Attribution 4.0 International License. Unrestricted use, distribution, and reproduction in any medium, even commercially, as long as the original work is properly cited.

Back to Issue
IJACSA Journal Cover

IJACSA