Timezone: »

BNS: Building Network Structures Dynamically for Continual Learning
Qi Qin · Wenpeng Hu · Han Peng · Dongyan Zhao · Bing Liu

Tue Dec 07 08:30 AM -- 10:00 AM (PST) @

Continual learning (CL) of a sequence of tasks is often accompanied with the catastrophic forgetting(CF) problem. Existing research has achieved remarkable results in overcoming CF, especially for task continual learning. However, limited work has been done to achieve another important goal of CL,knowledge transfer.In this paper, we propose a technique (called BNS) to do both. The novelty of BNS is that it dynamically builds a network to learn each new task to overcome CF and to transfer knowledge across tasks at the same time. Experimental results show that when the tasks are different (with little shared knowledge), BNS can already outperform the state-of-the-art baselines. When the tasks are similar and have shared knowledge, BNS outperforms the baselines substantially by a large margin due to its knowledge transfer capability.

Author Information

Qi Qin (Peking University)
Wenpeng Hu (Peking University)
Han Peng (Peking University)
Dongyan Zhao (Peking University)
Bing Liu (Peking University)

More from the Same Authors