Automated Extraction of Large Scale Scanned Document Images using Google Vision OCR in Apache Hadoop Environment

This Digitalization of documents is now being done in all fields to reduce paper usage. The availability of modern technology in the form of scanners and cameras supports the growth of multimedia data, especially documents stored in the form of image files. Searching a particular text in a large-scale scanned document images is a difficult task if the document is in the form of images where the text has not been extracted. In this research, text extraction method of large-scale scanned document images using Google Vision OCR on the Hadoop architecture is proposed. The object of research is student thesis documents, which includes the cover page, the approval page, and abstract. All documents are stored in the university's digital library. Extraction process begins with preparing the input folder that contains image documents (in JPEG format) in HDFS Apache Hadoop and followed by reading the image document. The image document is then extracted using Google Vision OCR in order to obtain text document (in TXT format) and the result is saved to output folder in Hadoop Distributed File System (HDFS). The same process is repeated for the entire documents in the folder. Test results have shown that the proposed methods was able to extract all test documents successfully. The recognition process achieved 100% accuracy and the extraction time is twice as fast as manual extraction. Google Vision OCR also shows better extraction performance compared to other OCR tools. The proposed automated extraction systems can recognize text in a large-scale image document accurately and can be operated in a real-time environment.

@article{Arief2018,
  title     = {Automated Extraction of Large Scale Scanned Document Images using Google Vision OCR in Apache Hadoop Environment},
  journal   = {International Journal of Advanced Computer Science and Applications},
  volume    = {9},
  number    = {11},
  year      = {2018},
  publisher = {The Science and Information Organization},
  author    = {Rifiana Arief and Achmad Benny Mutiara and Tubagus Maulana Kusuma and Hustinawaty},
  doi       = {10.14569/IJACSA.2018.091117},
  url       = {https://doi.org/10.14569/IJACSA.2018.091117}
}