Future of Information and Communication Conference (FICC) 2023
2-3 March 2023
Publication Links
IJACSA
Special Issues
Future of Information and Communication Conference (FICC)
Computing Conference
Intelligent Systems Conference (IntelliSys)
Future Technologies Conference (FTC)
Copyright Statement: This is an open access article licensed under a Creative Commons Attribution 4.0 International License, which permits unrestricted use, distribution, and reproduction in any medium, even commercially as long as the original work is properly cited.
Digital Object Identifier (DOI) : 10.14569/IJACSA.2023.0140407
Article Published in International Journal of Advanced Computer Science and Applications(IJACSA), Volume 14 Issue 4, 2023.
Abstract: Data analysis is very important for the success of any business today. It helps to optimize business processes, analyze users’ behavior, demands etc. There are powerful data analytics tools, such as the ones of the Hadoop ecosystem, but they require multiple high-performance servers to run and high-qualified experts to install, configure and support them. In most cases, small companies and start-ups could not afford such expenses. However, they can use them as web services, on demand, and pay much lower fees per request. To do that, companies should somehow share their data with an existing, already deployed, Hadoop cluster. The most common way of uploading their files to the Hadoop’s Distributed File System (HDFS) is through the WebHDFS API (Application Programming Interface) that allows remote access to HDFS. For that reason, the API’s throughput is very important for the efficient integration of a company’s data to the Hadoop cluster. This paper performs a series of experimental analyses aiming to determine the WebHDFS API’s throughput, if it is a bottleneck in integration of a company’s data to existing Hadoop infrastructure and to detect all possible factors that influence the speed of data transmission between the clients’ software and the Hadoop’ file system.
Yordan Kalmukov and Milko Marinov, “Experimental Analysis of WebHDFS API Throughput” International Journal of Advanced Computer Science and Applications(IJACSA), 14(4), 2023. http://dx.doi.org/10.14569/IJACSA.2023.0140407
@article{Kalmukov2023,
title = {Experimental Analysis of WebHDFS API Throughput},
journal = {International Journal of Advanced Computer Science and Applications},
doi = {10.14569/IJACSA.2023.0140407},
url = {http://dx.doi.org/10.14569/IJACSA.2023.0140407},
year = {2023},
publisher = {The Science and Information Organization},
volume = {14},
number = {4},
author = {Yordan Kalmukov and Milko Marinov}
}