Investigate the use of Anchor-Text and of Query-Document Similarity Scores to Predict the Performance of Search Engine

Query difficulty prediction aims to estimate, in advance, whether the answers returned by search engines in response to a query are likely to be useful. This paper proposes new predictors based upon the similarity between the query and answer documents, as calculated by the three different models. It examined the use of anchor text-based document surrogates, and how their similarity to queries can be used to estimate query difficulty. It evaluated the performance of the predictors based on 1) the correlation between the average precision (AP), 2) the precision at 10 (P@10) of the full text retrieved results, 3) a similarity score of anchor text, and 4) a similarity score of full-text, using the WT10g data collection of web data. Experimental evaluation of our research shows that five of our proposed predictors demonstrate reliable and consistent performance across a variety of different retrieval models.

@article{Almalawi2017,
  title     = {Investigate the use of Anchor-Text and of Query-Document Similarity Scores to Predict the Performance of Search Engine},
  journal   = {International Journal of Advanced Computer Science and Applications},
  volume    = {8},
  number    = {11},
  year      = {2017},
  publisher = {The Science and Information Organization},
  author    = {Abdulmohsen Almalawi and Rayed AlGhamdi and Adel Fahad},
  doi       = {10.14569/IJACSA.2017.081140},
  url       = {https://doi.org/10.14569/IJACSA.2017.081140}
}