Timezone: »

 
Poster
Learning from Bad Data via Generation
Tianyu Guo · Chang Xu · Boxin Shi · Chao Xu · Dacheng Tao

Tue Dec 10 10:45 AM -- 12:45 PM (PST) @ East Exhibition Hall B + C #12
in Algorithms -- Adversarial Learning »

Bad training data would challenge the learning model from understanding the underlying data-generating scheme, which then increases the difficulty in achieving satisfactory performance on unseen test data. We suppose the real data distribution lies in a distribution set supported by the empirical distribution of bad data. A worst-case formulation can be developed over this distribution set, and then be interpreted as a generation task in an adversarial manner. The connections and differences between GANs and our framework have been thoroughly discussed. We further theoretically show the influence of this generation task on learning from bad data and reveal its connection with a data-dependent regularization. Given different distance measures (\eg, Wasserstein distance or JS divergence) of distributions, we can derive different objective functions for the problem. Experimental results on different kinds of bad training data demonstrate the necessity and effectiveness of the proposed method.

Keywords: Adversarial Networks · Classification · Algorithms · Deep Learning
[ Paper]  [ Poster] 

Author Information

Tianyu Guo (Peking University)
Chang Xu (University of Sydney)
Boxin Shi (Peking University)
Chao Xu (Peking University)
Dacheng Tao (University of Sydney)

More from the Same Authors