Skip to yearly menu bar Skip to main content


Poster

Data Amplification: A Unified and Competitive Approach to Property Estimation

Yi Hao · Alon Orlitsky · Ananda Theertha Suresh · Yihong Wu

Room 210 #58

Keywords: [ Information Theory ] [ Theory ]


Abstract:

Estimating properties of discrete distributions is a fundamental problem in statistical learning. We design the first unified, linear-time, competitive, property estimator that for a wide class of properties and for all underlying distributions uses just 2n samples to achieve the performance attained by the empirical estimator with n\sqrt{\log n} samples. This provides off-the-shelf, distribution-independent, ``amplification'' of the amount of data available relative to common-practice estimators.

We illustrate the estimator's practical advantages by comparing it to existing estimators for a wide variety of properties and distributions. In most cases, its performance with n samples is even as good as that of the empirical estimator with n\log n samples, and for essentially all properties, its performance is comparable to that of the best existing estimator designed specifically for that property.

Live content is unavailable. Log in and register to view live content