ViMRC - VLSP 2021: Context-Aware Answer Extraction in Vietnamese Question Answering

Abstract

MRC is challenging the natural language processing fields; machines automatically have to answer questions based on specific passages for this task. In recent years, machine reading comprehension (MRC) has received much attention; many articles have been written about this task. However, most of those articles only develop models in two main languages, English and Chinese. In this article, we propose to apply a new model to the task of reading comprehension in Vietnamese. Specifically, we use BLANC (BLock AttentioN for Context prediction) on pre-trained baseline models to solve the Machine reading comprehension (MRC) task on Vietnamese. We have achieved good results when using BLANC on the baseline model. Specifically, with the MRC task at the VLSP share-task 2021, we scored 76.877% of F1-score on the private test and ranked 2nd in the total. This shows that BLANC works very well in MRC tasks and further enhances the Vietnamese MRC development.