|
|
- 2018
融合pointwise及深度学习方法的篇章排序
|
Abstract:
摘要： 智能问答是让信息获取变得更加智能和便捷的重要途径,其中面向智能问答的篇章排序,对于准确把握用户查询意图,提升用户体验及答案反馈精度都有着十分重要意义。使用深度学习技术来捕获问题及篇章的语义信息,并以此构建到标签的映射模型,然后用训练好的模型来预测新的问题与篇章间的相关度,最后利用预测得到的篇章和问题的相关度指标来对同一问题对应的多个答案篇章进行排序。实验表明该方法在DCG@3指标上可以达到3.979,DCG@5达到5.396。
Abstract: Intelligent question answering is an important way to make information acquisition more intelligent and convenient. Intelligent Q&A oriented passage ranking is very important for accurately grasping the user's query intention, improving the user experience and the accuracy of feedback. We use deep learning techniques to capture semantic information about query and passages, and build the mapping model to the tag. Then the training model is used to predict the correlation between new query and the passage. Finally, we use the predicted correlation index of the passages and the query to sort the multiple answers of the same question. The experimental results show that our method can reach 3.979 on DCG@3 and 5.396 for DCG@5
| [1] | FU Jian, QIU Xipeng, HUANG Xuanjing. Convolutional deep neural networks for document-based question answering[C] // International Conference on Computer Processing of Oriental Languages. Springer International Publishing. Berlin: Springer, Cham, 2016: 790-797. |
| [2] | SRIVASTAVA N, HINTON G E, KRIZHEVSKY A, et al. Dropout: a simple way to prevent neural networks from overfitting[J]. Journal of Machine Learning Research, 2014, 15(1):1929-1958. |
| [3] | NIE Yuanping, HAN Yi, HUANG Jiuming, et al. Attention-based encoder-decoder model for answer selection in question answering[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(4):535-544. |
| [4] | TAY Y, PHAN M C, TUAN L A, et al. Learning to rank question answer pairs with holographic dual LSTM architecture[C] // In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. Tokyo: ACM 2017, 695-704. |
| [5] | OTHMAN N, FAIZ R. A multi-lingual approach to improve passage retrieval for automatic question answering[C] // International Conference on Applications of Natural Language to Information Systems. Berlin: Springer International Publishing, 2016: 127-139. |
| [6] | RAFFEL C, ELLIS D P W. Feed-forward networks with attention can solve some long-term memory problems[J]. arXiv, 2016(2016):1-6. |
| [7] | HERBRICH R, GRAEPEL T, OBERMAYER K. Support vector learning for ordinal regression[C] // Artificial Neural Networks, 1999. ICANN 99. Ninth International Conference on. Ottawa: 2002: 97-102. |
| [8] | TYMOSHENKO K, BONADIMAN D, MOSCHITTI A. Learning to rank non-factoid answers: Comment selection in web forums[C] // Proceedings of the 25th ACM International on Conference on Information and Knowledge Management. USA: ACM, 2016: 2049-2052. |
| [9] | WANG Bingning, LIU Kang, ZHAO Jun. Inner attention based recurrent neural networks for answer selection[C] // Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. Berlin: ACL, 2016: 1288-1297. |
| [10] | QIN Tao, ZHANG Xudong, TSAI Mingfeng, et al. Query-level loss functions for information retrieval[J]. Information Processing & Management, 2008, 44(2):838-855. |
| [11] | ALMARWANI N, DIAB M. GW_QA at SemEval-2017 Task 3: question answer re-ranking on arabic fora[C] // Proceedings of the 11th International Workshop on Semantic Evaluation(SemEval-2017). Vancouver: ACL, 2017: 344-348. |
| [12] | YU Lei, HERMANN K M, BLUNSOM P, et al. Deep learning for answer sentence selection[J]. Computer Science, 2014, 2014:1-10 |
| [13] | NALLAPATI R. Discriminative models for information retrieval[C] // Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval. USA: ACM, 2004: 64-71. |
| [14] | CAO Zhe, QIN Tao, LIU Tieyan, et al. Learning to rank: from pairwise approach to listwise approach[C] // Proceedings of the 24th international conference on Machine learning. Corvallis: ICML, 2007: 129-136. |
| [15] | ARAKI J, CALLAN J. An annotation similarity model in passage ranking for historical fact validation[C] // Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval. USA: ACM, 2014: 1111-1114. |
| [16] | SEVERYN A, MOSCHITTI A. Learning to rank short text pairs with convolutional deep neural networks[C] // Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval. USA: ACM, 2015: 373-382. |
| [17] | ZHOU Xiaoqiang, HU Baotian, CHEN Qingcai, et al. Answer sequence learning with neural networks for answer selection in community question answering[J]. In Proceedings of the ACL-IJCNLP. Beijing: ACL, 2015: 713-718. |
| [18] | SEVERYN A, MOSCHITTI A. Modeling relational information in question-answer pairs with convolutional neural networks[J]. USA, ARXIV, 2016, 2016: 1-10. |
| [19] | DERIU J M, CIELIEBAK M. SwissAlps at SemEval-2017 task 3: Attention-based convolutional neural network for community question answering[C] // Proceedings of the 11th International Workshop on Semantic Evaluation. Vancouver, Canada, SemEval. 2017, 17: 334-338. |
