Timezone: »
There is currently a large gap in performance between the statistically rigorous methods like linear regression or additive splines and the powerful deep methods using neural networks. Previous works attempting to close this gap have failed to fully consider the exponentially growing number of feature combinations which deep networks consider automatically during training. In this work, we develop a tractable selection algorithm to efficiently identify the necessary feature combinations by leveraging techniques in feature interaction detection.Our proposed Sparse Interaction Additive Networks (SIAN) construct a bridge from these simple and interpretable models to a fully connected neural network. SIAN achieves competitive performance against state-of-the-art methods across multiple large-scale tabular datasets and consistently finds an optimal tradeoff between the modeling capacity of neural networks and the generalizability of simpler methods.
Author Information
James Enouen (University of Southern California)
Yan Liu (University of Southern California)
More from the Same Authors
-
2022 : A Synthetic Limit Order Book Dataset for Benchmarking Forecasting Algorithms under Distributional Shift »
Defu Cao · Yousef El-Laham · Loc Trinh · Svitlana Vyetrenko · Yan Liu -
2023 Poster: Hierarchical Gaussian Mixture based Task Generative Model for Robust Meta-Learning »
Yizhou Zhang · Jingchao Ni · Wei Cheng · Zhengzhang Chen · Liang Tong · Haifeng Chen · Yan Liu -
2022 Poster: Counterfactual Neural Temporal Point Process for Estimating Causal Influence of Misinformation on Social Media »
Yizhou Zhang · Defu Cao · Yan Liu -
2021 Poster: VigDet: Knowledge Informed Neural Temporal Point Process for Coordination Detection on Social Media »
Yizhou Zhang · Karishma Sharma · Yan Liu -
2020 Poster: Multi-agent Trajectory Prediction with Fuzzy Query Attention »
Nitin Kamra · Hao Zhu · Dweep Trivedi · Ming Zhang · Yan Liu -
2020 Poster: How does This Interaction Affect Me? Interpretable Attribution for Feature Interactions »
Michael Tsang · Sirisha Rambhatla · Yan Liu -
2019 Workshop: Learning with Temporal Point Processes »
Manuel Rodriguez · Le Song · Isabel Valera · Yan Liu · Abir De · Hongyuan Zha -
2018 Poster: Neural Interaction Transparency (NIT): Disentangling Learned Interactions for Improved Interpretability »
Michael Tsang · Hanpeng Liu · Sanjay Purushotham · Pavankumar Murali · Yan Liu -
2017 : Posters 1 »
J.P. Lewis · Housam Khalifa Bashier Babiker · Zhongang Qi · Laura Rieger · Ning Xie · Filip Dabek · Koushik Nagasubramanian · Bolei Zhou · Dieuwke Hupkes · CHUN-HAO CHANG · Pamela K Douglas · Enea Ceolini · Derek Doran · Yan Liu · Fuxin Li · Randolph Goebel -
2016 Workshop: Learning with Tensors: Why Now and How? »
Anima Anandkumar · Rong Ge · Yan Liu · Maximilian Nickel · Qi (Rose) Yu -
2016 Poster: SPALS: Fast Alternating Least Squares via Implicit Leverage Scores Sampling »
Dehua Cheng · Richard Peng · Yan Liu · Kimis Perros -
2016 Poster: Learning Influence Functions from Incomplete Observations »
Xinran He · Ke Xu · David Kempe · Yan Liu -
2014 Poster: Fast Multivariate Spatio-temporal Analysis via Low Rank Tensor Learning »
Mohammad Taha Bahadori · Qi (Rose) Yu · Yan Liu -
2014 Spotlight: Fast Multivariate Spatio-temporal Analysis via Low Rank Tensor Learning »
Mohammad Taha Bahadori · Qi (Rose) Yu · Yan Liu