Question answering (QA) Transformer-based models might become efficient in inclusive education. For example, one can test and tune such models with small closed-domain datasets before the implementation of a new system in an inclusive organization. However, studies in the sociomedical domain show that such models can be unpredictable. They can mislead a user or evoke aversive emotional states. The paper addresses the problem of investigating safety-first QA models that would generate user-friendly outputs. The study aims to analyze the performance of SOTA Transformer-based QA models on a custom dataset collected by the author of the paper. The dataset contains 1 134 question-answer pairs about autism spectrum disorders (ASD) in Russian. The study presents the validation and evaluation of extractive and generative QA models. The author used transfer learning techniques to investigate domain-specific QA properties and suggest solutions that might provide higher QA efficiency in the inclusion. The study shows that although generative QA models can misrepresent facts and generate false tokens, they might bring diversity in the system outputs and make the automated QA more user-friendly for younger people. Although extractive QA is more reliable, according to the metric scores presented in this study, such models might be less efficient than generative ones. The principal conclusion of the study is that a combination of generative and extractive approaches might lead to higher efficiency in building QA systems for inclusion. However, the performance of such combined systems in the inclusion is yet to be investigated.
Original languageEnglish
Title of host publicationDigital Transformation and Global Society - 6th International Conference, DTGS 2021, Revised Selected Papers
Subtitle of host publication6th International Conference, DTGS 2021, St. Petersburg, Russia, June 23–25, 2021
EditorsDaniel A. Alexandrov, Andrei V. Chugunov, Yury Kabanov, Olessia Koltsova, Ilya Musabirov, Sergei Pashakhin, Alexander V. Boukhanovsky, Andrei V. Chugunov
Place of Publication Cham
PublisherSpringer Nature
Pages122-133
Number of pages12
ISBN (Electronic)978-3-030-93715-7
ISBN (Print)978-3-030-93714-0
DOIs
StatePublished - 2022
Event6th International Conference on Digital Transformation and Global Society, DTGS 2021 - Saint Petesburg, Virtual, Online, Russian Federation
Duration: 23 Jun 202125 Jun 2021
Conference number: 6
http://dtgs-conference.org
http://dtgs-conference.org/

Publication series

NameCommunications in Computer and Information Science
Volume1503 CCIS
ISSN (Print)1865-0929
ISSN (Electronic)1865-0937

Conference

Conference6th International Conference on Digital Transformation and Global Society, DTGS 2021
Abbreviated titleDTGS 2021
Country/TerritoryRussian Federation
CityVirtual, Online
Period23/06/2125/06/21
Internet address

    Research areas

  • Question answering, Dialogue system, Transformer

    Scopus subject areas

  • Mathematics(all)
  • Computer Science(all)

ID: 84764141