Timezone: »

 
Poster
Multiple Descent: Design Your Own Generalization Curve
Lin Chen · Yifei Min · Mikhail Belkin · Amin Karbasi

Wed Dec 08 04:30 PM -- 06:00 PM (PST) @ Virtual
in Poster Session 4 »

This paper explores the generalization loss of linear regression in variably parameterized families of models, both under-parameterized and over-parameterized. We show that the generalization curve can have an arbitrary number of peaks, and moreover, the locations of those peaks can be explicitly controlled. Our results highlight the fact that both the classical U-shaped generalization curve and the recently observed double descent curve are not intrinsic properties of the model family. Instead, their emergence is due to the interaction between the properties of the data and the inductive biases of learning algorithms.

Keywords:

Author Information

Lin Chen (University of California, Berkeley)
Yifei Min (Yale University)
Mikhail Belkin (Ohio State University)
Amin Karbasi (Yale University)

More from the Same Authors