[Home ] [Archive]   [ فارسی ]  
:: Volume 33, Issue 4 (summer 2018) ::
2018, 33(4): 1767-1792 Back to browse issues page
A probabilistic model to determine the coherence of texts in interactive question answering systems
Mohammad Mehdi Hosseini , Morteza Zahedi
PhD Candidate in Computer Engineering Shahrood University of Technology
Abstract:   (941 Views)
Evaluation plays an important role in interactive question answering systems like many computational linguistics fields. The coherence between the questions and the answers exchanged between the user and the system is one of the important criteria in evaluating these systems. In this paper, a new approach to determine the degree of coherence of generated text by the IQA systems is presented. The proposed model, is a probabilistic model in which for feature extraction, the similarity between different N-grams is derived based on four defined criteria. Then using a prediction of the best density function among the 18 functions considered for each feature, a model for determining the coherence is selected. The results of implementation on two databases provided by several interactive question answering systems indicate that the proposed probabilistic model is highly adapted and its accuracy in determining the degree of coherence in the conversation text has been made. The Kolmogorov-Smirnov, Anderson, Darling and Cramer van Meys trials were used to matching or non-matching probability density function. According to the presented results, the probability density factor with the least error was the best performance in determining the coherence of each conversation.
Keywords: Matematical Modeling, Coherence of text, Intearctive Question answering Systems (IQAs), N-gram, Statistical similarity.
Full-Text [PDF 2451 kb]   (179 Downloads)    
Type of Study: Research | Subject: Information Technology
Received: 2017/02/10 | Accepted: 2017/12/2 | Published: 2018/01/20
Send email to the article author

Add your comments about this article
Your username or Email:


XML   Persian Abstract   Print

Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:

Hosseini M M, Zahedi M. A probabilistic model to determine the coherence of texts in interactive question answering systems. Journal of Information Processing and Management. 2018; 33 (4) :1767-1792
URL: http://jipm.irandoc.ac.ir/article-1-3516-en.html

Volume 33, Issue 4 (summer 2018) Back to browse issues page
پژوهشنامه پردازش و مدیریت اطلاعات Journal of Information processing and Management
Persian site map - English site map - Created in 0.28 seconds with 30 queries by YEKTAWEB 3749