Future of Information and Communication Conference (FICC) 2025
28-29 April 2025
Publication Links
IJACSA
Special Issues
Future of Information and Communication Conference (FICC)
Computing Conference
Intelligent Systems Conference (IntelliSys)
Future Technologies Conference (FTC)
International Journal of Advanced Computer Science and Applications(IJACSA), Volume 15 Issue 6, 2024.
Abstract: Aiming at the problems that current text matching methods are difficult to accurately capture the fine-grained ranking information between texts and the insufficient information interaction between different negative examples, a text matching model combining ranking information and negative example smoothing strategy is proposed. Firstly, it ensures the consistency of the ranking of two sentence representations of the input text obtained after different Dropout masks through Jensen-Shannon Divergence. Secondly, it utilizes the pre-trained SimCSE as the teacher model to obtain coarse-grained ranking information and distills this information into the student model through the ListNet sorting algorithm to obtain fine-grained ranking information. Finally, the negative examples are augmented by a negative example smoothing strategy, which effectively solves the problem of insufficient information interaction between negative examples without increasing the batch size. Experimental results on the standard semantic text similarity task show that the proposed model achieves a significant improvement in the Spearman correlation coefficient evaluation metrics compared with existing state-of-the-art methods, proving its effectiveness.
Xiaodong Cai, Lifang Dong, Yeyang Huang and Mingyao Chen, “Text Matching Model Combining Ranking Information and Negative Example Smoothing Strategies” International Journal of Advanced Computer Science and Applications(IJACSA), 15(6), 2024. http://dx.doi.org/10.14569/IJACSA.2024.0150679
@article{Cai2024,
title = {Text Matching Model Combining Ranking Information and Negative Example Smoothing Strategies},
journal = {International Journal of Advanced Computer Science and Applications},
doi = {10.14569/IJACSA.2024.0150679},
url = {http://dx.doi.org/10.14569/IJACSA.2024.0150679},
year = {2024},
publisher = {The Science and Information Organization},
volume = {15},
number = {6},
author = {Xiaodong Cai and Lifang Dong and Yeyang Huang and Mingyao Chen}
}
Copyright Statement: This is an open access article licensed under a Creative Commons Attribution 4.0 International License, which permits unrestricted use, distribution, and reproduction in any medium, even commercially as long as the original work is properly cited.