Timezone: »

Streaming Radiance Fields for 3D Video Synthesis
Lingzhi LI · Zhen Shen · Zhongshu Wang · Li Shen · Ping Tan

Tue Dec 06 05:00 PM -- 07:00 PM (PST) @
We present an explicit-grid based method for efficiently reconstructing streaming radiance fields for novel view synthesis of real world dynamic scenes. Instead of training a single model that combines all the frames, we formulate the dynamic modeling problem with an incremental learning paradigm in which per-frame model difference is trained to complement the adaption of a base model on the current frame. By exploiting the simple yet effective tuning strategy with narrow bands, the proposed method realizes a feasible framework for handling video sequences on-the-fly with high training efficiency. The storage overhead induced by using explicit grid representations can be significantly reduced through the use of model difference based compression. We also introduce an efficient strategy to further accelerate model optimization for each frame. Experiments on challenging video sequences demonstrate that our approach is capable of achieving a training speed of 15 seconds per-frame with competitive rendering quality, which attains $1000 \times$ speedup over the state-of-the-art implicit methods.

Author Information

Lingzhi LI (Alibaba Group)
Zhen Shen (Alibaba Group)
Zhongshu Wang (Alibaba Group)
Li Shen (University of Oxford)
Ping Tan (Simon Fraser University)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors

  • 2023 Poster: Deep Fractional Fourier Transform »
    Hu Yu · Jie Huang · Lingzhi LI · man zhou · Feng Zhao
  • 2022 Spotlight: Lightning Talks 2B-2 »
    Chenjian Gao · Rui Ding · Lingzhi LI · Fan Yang · Xingting Yao · Jianxin Li · Bing Su · Zhen Shen · Tongda Xu · Shuai Zhang · Ji-Rong Wen · Lin Guo · Fanrong Li · Kehua Guo · Zhongshu Wang · Zhi Chen · Xiangyuan Zhu · Zitao Mo · Dailan He · Hui Xiong · Yan Wang · Zheng Wu · Wenbing Tao · Jian Cheng · Haoyi Zhou · Li Shen · Ping Tan · Liwei Wang · Hongwei Qin
  • 2022 Poster: DART: Articulated Hand Model with Diverse Accessories and Rich Textures »
    Daiheng Gao · Yuliang Xiu · Kailin Li · Lixin Yang · Feng Wang · Peng Zhang · Bang Zhang · Cewu Lu · Ping Tan