Multi-Stage Transfer Learning for Technical Support Domain Question Answering
Rong Zhang
2020 Presentation
in
Expo Workshop: DAQA – Domain Adaptation and Question Answering
in
Expo Workshop: DAQA – Domain Adaptation and Question Answering
Abstract
This talk presents our research work on three transfer learning approaches Including domain-specific LM pre-training with vocabulary extension, QA model Pre-training with synthetic examples, and QA model pre-training with labeled data augmentation. These approaches are applied incrementally on the Roberta large LM and adapt it to the TechQA task in technical support domain. Substantial improvements of QA performance are observed from leaderboard testing result.
Video
Chat is not available.
Successful Page Load