firstbacksecondback
45 Results
|
Poster
|
Thu 16:30 |
Selective Attention: Enhancing Transformer through Principled Context Control Xuechen Zhang · Xiangyu Chang · Mingchen Li · Amit Roy-Chowdhury · Jiasi Chen · Samet Oymak |
|
|
Poster
|
Wed 11:00 |
Understanding the Differences in Foundation Models: Attention, State Space Models, and Recurrent Neural Networks Jerome Sieber · Carmen Amo Alonso · Alexandre Didier · Melanie Zeilinger · Antonio Orvieto |
|
|
Poster
|
Fri 16:30 |
FactorizePhys: Matrix Factorization for Multidimensional Attention in Remote Physiological Sensing Jitesh Joshi · Sos Agaian · Youngjun Cho |
|
|
Poster
|
Wed 16:30 |
Unraveling the Gradient Descent Dynamics of Transformers Bingqing Song · Boran Han · Shuai Zhang · Jie Ding · Mingyi Hong |
|
|
Poster
|
Thu 11:00 |
SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention Robert Csordas · Piotr Piękos · Kazuki Irie · Jürgen Schmidhuber |
|
|
Poster
|
Fri 11:00 |
Cluster-Learngene: Inheriting Adaptive Clusters for Vision Transformers Qiufeng Wang · Xu Yang · Fu Feng · Jingq Wang · Xin Geng |
|
|
Poster
|
Thu 11:00 |
In-Context Learning with Transformers: Softmax Attention Adapts to Function Lipschitzness Liam Collins · Advait Parulekar · Aryan Mokhtari · Sujay Sanghavi · Sanjay Shakkottai |
|
|
Poster
|
Faster Neighborhood Attention: Reducing the O(n^2) Cost of Self Attention at the Threadblock Level Ali Hassani · Wen-Mei Hwu · Humphrey Shi |
||
|
Poster
|
Fri 16:30 |
Parallelizing Linear Transformers with the Delta Rule over Sequence Length Songlin Yang · Bailin Wang · Yu Zhang · Yikang Shen · Yoon Kim |
|
|
Poster
|
Fri 11:00 |
An In-depth Investigation of Sparse Rate Reduction in Transformer-like Models Yunzhe Hu · Difan Zou · Dong Xu |
|
|
Workshop
|
Optimizing Attention with Mirror Descent: Generalized Max-Margin Token Selection Aaron Alvarado Kristanto Julistiono · Davoud Ataee Tarzanagh · Navid Azizan |
||
|
Poster
|
Fri 11:00 |
Real-time Core-Periphery Guided ViT with Smart Data Layout Selection on Mobile Devices Zhihao Shu · Xiaowei Yu · Zihao Wu · Wenqi Jia · Yinchen Shi · Miao Yin · Tianming Liu · Dajiang Zhu · Wei Niu |