Timezone: »

 
Poster
Diverse Sequential Subset Selection for Supervised Video Summarization
Boqing Gong · Wei-Lun Chao · Kristen Grauman · Fei Sha

Tue Dec 09 04:00 PM -- 08:59 PM (PST) @ Level 2, room 210D
in Poster Session »

Video summarization is a challenging problem with great application potential. Whereas prior approaches, largely unsupervised in nature, focus on sampling useful frames and assembling them as summaries, we consider video summarization as a supervised subset selection problem. Our idea is to teach the system to learn from human-created summaries how to select informative and diverse subsets, so as to best meet evaluation metrics derived from human-perceived quality. To this end, we propose the sequential determinantal point process (seqDPP), a probabilistic model for diverse sequential subset selection. Our novel seqDPP heeds the inherent sequential structures in video data, thus overcoming the deficiency of the standard DPP, which treats video frames as randomly permutable items. Meanwhile, seqDPP retains the power of modeling diverse subsets, essential for summarization. Our extensive results of summarizing videos from 3 datasets demonstrate the superior performance of our method, compared to not only existing unsupervised methods but also naive applications of the standard DPP model.

[ PDF] 

Author Information

Boqing Gong (University of Southern California (USC))
Wei-Lun Chao (Ohio State University (OSU))
Kristen Grauman (University of Texas at Austin)
Fei Sha (University of Southern California (USC))

More from the Same Authors