PubMed · 16238060
Rate-distortion optimal video summary generation.
Abstract
The need for video summarization originates primarily from a viewing time constraint. A shorter version of the original video sequence is desirable in a number of applications. Clearly, a shorter version is also necessary in applications where storage, communication bandwidth, and/or power are limited. The summarization process inevitably introduces distortion. The amount of summarization distortion is related to its "conciseness," or the number of frames available in the summary. If there are m frames in the original sequence and n frames in the summary, we define the summarization rate as m/n, to characterize this "conciseness". We also develop a new summarization distortion metric and formulate the summarization problem as a rate-distortion optimization problem. Optimal algorithms based on dynamic programming are presented and compared experimentally with heuristic algorithms. Practical constraints, like the maximum number of frames that can be skipped, are also considered in the formulation and solution of the problem.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Zhu Li, Guido M Schuster, Aggelos K Katsaggelos, Bhavan Gandhi. 2005. Rate-distortion optimal video summary generation.. https://doi.org/10.1109/tip.2005.854477
Cite the original work for its findings. Save a collection to share your selection of sources.