This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Maintaining Temporal Coherence in Video Retargeting Using Mosaic-Guided Scaling
Mosaic-guided scaling methodFrame-level energy maps
○ Represent the visual importance of a pixel in each video frame
Initial local scaling maps○ Determine how to scale a pixel in frame
resizing
Shot-level panoramic mosaic
2012/01/10
8
Method Frame-level energy map
2012/01/10
9
Method
Energy fusion functionCombine the gradient energy and the
PQSM-based saliency map
2012/01/10
10
Method
Initial local scaling mapsUses an energy-based frame resizing
approach
2012/01/10
11
Method
Shot-level panoramic mosaic A panoramic mosaic is generated by
using three stepsFeature points detectionCamera motion estimationFrame registration
2012/01/10
12
Method
Mosaic-Guided video retargetingGlobal scaling mapGlobal map constraintSpatial coherence constraintsIterative optimization procedureFrame resizing based on local maps
2012/01/10
13
Method
Global scaling mapTo synchronize the scaling of a corresponding pixel
in different frames of the shot
2012/01/10
14
Method
The maximum scaling factor
2012/01/10
15
Method
Global map constraintThe first-round local scaling maps are
extracted by
The first-round local scaling maps are set as
2012/01/10
16
Method To ensure the temporal coherence
Use the first-round maps to constrain the iterated local scaling maps ○ by introducing the following distortion cost