Dialogue Act Recognition Using Visual Information
International Conference on Document Analysis and Recognition - ICDAR 2021 (2021)
Abstract
Automatic dialogue management including dialogue act (DA) recognition is usually focused on dialogues in the audio signal. However, some dialogues are also available in a written form and their automatic analysis is also very important. The main goal of this paper thus consists in the dialogue act recognition from printed documents. For visual DA recognition, we propose a novel deep model that combines two recurrent neural networks. The approach is evaluated on a newly created dataset containing printed dialogues from the English VERBMOBIL corpus. We have shown that visual information does not have any positive impact on DA recognition using good quality images where the OCR result is excellent. We have also demonstrated that visual information can significantly improve the DA recognition score on low-quality images with erroneous OCR. To the best of our knowledge, this is the first attempt focused on DA recognition from visual data.
Authors
BibTex
@InProceedings{10.1007/978-3-030-86331-9_51, author="Mart{\'i}nek, Ji{\v{r}}{\'i} and Kr{\'a}l, Pavel and Lenc, Ladislav", editor="Llad{\'o}s, Josep and Lopresti, Daniel and Uchida, Seiichi", title="Dialogue Act Recognition Using Visual Information", booktitle="Document Analysis and Recognition -- ICDAR 2021", year="2021", publisher="Springer International Publishing", address="Cham", pages="793--807", abstract="Automatic dialogue management including dialogue act (DA) recognition is usually focused on dialogues in the audio signal. However, some dialogues are also available in a written form and their automatic analysis is also very important.", isbn="978-3-030-86331-9" }
