Facebook pixel tracking

The Science and Information (SAI) Organization publishes open-access peer-reviewed journals in computer science and artificial intelligence.

Contact Info
Email info@thesai.org
Website thesai.org
Follow Us
Contact Info
Email info@thesai.org
Follow Us
Research Article | Open Access |

Dynamic Programming Method Applied in Vietnamese Word Segmentation Based on Mutual Information among Syllables

Author 1: Nguyen Thi Uyen Author 2: Tran Xuan Sang
International Journal of Advanced Research in Artificial Intelligence (IJARAI) · Vol. 3, No. 9 · Published 2014

DOI: 10.14569/IJARAI.2014.030904

Download PDF Cite

Abstract

Vietnamese word segmentation is an important step in Vietnamese natural language processing such as text categorization, text summary, and automated machine translation. The problem with Vietnamese word segmentation is complicated because Vietnamese words are not always separated by a space. One word can include one or more syllables depending on the context. This paper proposes a method for Vietnamese word segmentation based on the mutual information among the syllables combined with dynamic programming. With this method, we can achieve an accuracy rate of about 90% with a raw text corpus.

Keywords

Vietnamese word segmentation dynamic programming mutual information Vietnamese syllables

How to Cite this Article

Uyen, N. T., & Sang, T. X. (2014). Dynamic Programming Method Applied in Vietnamese Word Segmentation Based on Mutual Information among Syllables. International Journal of Advanced Research in Artificial Intelligence, 3(9). https://doi.org/10.14569/IJARAI.2014.030904

Uyen, Nguyen Thi, and Tran Xuan Sang. "Dynamic Programming Method Applied in Vietnamese Word Segmentation Based on Mutual Information among Syllables." International Journal of Advanced Research in Artificial Intelligence, vol. 3, no. 9, 2014, https://doi.org/10.14569/IJARAI.2014.030904.

@article{Uyen2014,
  title     = {Dynamic Programming Method Applied in Vietnamese Word Segmentation Based on Mutual Information among Syllables},
  journal   = {International Journal of Advanced Research in Artificial Intelligence},
  volume    = {3},
  number    = {9},
  year      = {2014},
  publisher = {The Science and Information Organization},
  author    = {Nguyen Thi Uyen and Tran Xuan Sang},
  doi       = {10.14569/IJARAI.2014.030904},
  url       = {https://doi.org/10.14569/IJARAI.2014.030904}
}

Open Access — licensed under a Creative Commons Attribution 4.0 International License. Unrestricted use, distribution, and reproduction in any medium, even commercially, as long as the original work is properly cited.

Back to Issue
IJARAI Journal Cover