Skip to yearly menu bar Skip to main content


Search All 2024 Events
 

6 Results

<<   <   Page 1 of 1   >>   >
Poster
Fri 11:00 An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding
Tong Wu · Yanpeng Zhao · Zilong Zheng
Poster
Wed 11:00 Algebraic Positional Encodings
Konstantinos Kogkalidis · Jean-Philippe Bernardy · Vikas Garg
Poster
Fri 11:00 Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding
Zhenyu Zhang · Runjin Chen · Shiwei Liu · Zhewei Yao · Olatunji Ruwase · Beidi Chen · Xiaoxia Wu · Zhangyang &quot;Atlas&quot; Wang
Workshop
Range-aware Positional Encoding via High-order Pretraining: Theory and Practice
Viet Nguyen · Nhat Ngo · Truong Son Hy
Poster
Thu 16:30 Mesa-Extrapolation: A Weave Position Encoding Method for Enhanced Extrapolation in LLMs
Xin Ma · Yang Liu · Jingjing Liu · Xiaoxu Ma
Poster
Wed 11:00 DAPE: Data-Adaptive Positional Encoding for Length Extrapolation
Chuanyang Zheng · Yihang Gao · Han Shi · Minbin Huang · Jingyao Li · Jing Xiong · Xiaozhe Ren · Michael Ng · Xin Jiang · Zhenguo Li · Yu Li