ERICSSON RESEARCH Media Lab 1 Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne JPEG2000 JPEG2000 The next generation still The next generation still image coding system image coding system Touradj Ebrahimi*, Charilaos Christopoulos** *Ecole Polytechnique Federale de Lausanne, Switzerland **MediaLab, Ericsson Research, Stockholm, Sweden
JPEG2000. The next generation still image coding system. Touradj Ebrahimi*, Charilaos Christopoulos* *. *Ecole Polytechnique Federale d e Lausanne, Switzerland * * MediaLab, Ericsson Research, Stockholm, Sweden. Standards Organizations. International Organization for Standardization (ISO) - PowerPoint PPT Presentation
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
ERICSSON RESEARCH Media Lab
1Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
JPEG2000JPEG2000The next generation still The next generation still
image coding systemimage coding system
Touradj Ebrahimi*, Charilaos Christopoulos**
*Ecole Polytechnique Federale de Lausanne, Switzerland
**MediaLab, Ericsson Research, Stockholm, Sweden
2Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
Standards Organizations• International Organization for Standardization
(ISO)– 75 Member Nations– 150+ Technical Committees– 600+ Subcommittees– 1500+ Working Groups
• International Electrotechnical Commission (IEC)– 41 Member Nations– 80+ Technical Committees– 100+ Subcommittees– 700+ Working Groups
T
3Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
ISO / IEC TerminologyISO / IEC Terminology• ISO: International Standardization Organization• IEC: International Electrotechnical Committee• ISO/IEC JTC1: Joint Technical Committee• SC29: Information Technologies
– WG1: still images, JPEG and JBIG• Joint Photographic Experts Group and Joint
– Feb 96 (Geneva) started with original proposal– Nov 96 (Palo Alto) test method agreed– Mar 97 (Dijon) call for proposals – Jul 97 (Sapporo) requirements analysis started – Nov 97 (Sydney) algorithm competition & selection– VM 1 (Mar 98), VM 2 (Aug 98), split to VM 3A and 3B
Nov 98. Converged to VM4 and WD in Mar 99– Promotion to CD, FCD, FDIS as well as creation of
different parts
• Current status: VM 8, FDIS
13Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
JPEG2000 contributorsJPEG2000 contributors• 21 countries / 80-100 meeting attendees
– EUROPE • Ericsson, Nokia, Philips, Canon, Motorola, IMEC, EPFL,
NTNU, Technical University of Denmark, VUB, Technical University of Berlin
32Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
More in depth comparisons More in depth comparisons between between JPEG2000JPEG2000 versus other versus other
standardsstandards• « JPEG 2000 still image coding versus other standards », D.
Santa-Cruz, T. Ebrahimi, J. Askelöf, M. Larsson and Ch. Christopoulos, in Proc. of SPIE, Vol. 4115
• « A study of JPEG 2000 still image coding versus other standards », D. Santa-Cruz, T. Ebrahimi, in Proc. of the X European Signal Processing Conference (EUSIPCO), Tampere, Finland, September 5-8, 2000
• « An analytical study of JPEG 2000 functionalities », D. Santa-Cruz, T. Ebrahimi, in Proc. of the IEEE International Conference on Image Processing (ICIP), Vancouver, Canada, September 10-13, 2000
33Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
JPEG2000JPEG2000
Algorithm descriptionAlgorithm description
C
34Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
64Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
65Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
66Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
67Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
68Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
69Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
Example:Example:Progressive by qualityProgressive by quality
• Image: Woman• Bitrates: 0.125 bpp
0.25 bpp0.5 bpp1.0 bpp2.0 bpp
70Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
0.125 bpp
71Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
0.25 bpp
72Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
0.5 bpp
73Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
1.0 bpp
74Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
2.0 bpp
75Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
Region Of Interest codingRegion Of Interest coding• Allows certain parts of an image to
be coded or decoded in better quality
• Static: The ROI is decided and coded once for all
en the encoder side
• Dynamic: The ROI can be decided and decoded on
the fly from a same bitstream
C
76Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
ROI: Some visual resultsROI: Some visual results
No ROI
69:1 overall compression ratio
Rectangular ROI
77Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
Regions Of Interest
78Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
Regions Of Interest
79Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
Regions Of Interest
80Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
ROI coding: mask ROI coding: mask computationcomputation
81Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
Region Of Interest codingRegion Of Interest coding• BASIC IDEA:
Calculate wavelet transform of whole image/time
calculate ROI mask == set of coefficients that are needed for up to lossless ROI coding
Encoding is progressive by accuracy and resolution
• NOTE: ROI mask need NOT be transmitted to decoder (location and shape of ROI needs however)
82Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
Creation of ROI maskCreation of ROI mask
• The ROI masks are acquired by looking at the inverse transform
• For each pixel (X) that is in the ROI, the low and high frequency coefficients (L:s and H:s) that are needed to reconstruct the pixel, are included in the ROI mask
n-1 n n+1
Low High
n-1 n n+1
X:s
2n 2n+1
Inverse transform of the 5-3 filter
83Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
ROI Scaling based methodROI Scaling based method
Coefficient values
ROI Coefficients
Highest BG coeff value is found
84Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
ROI MaxShift methodROI MaxShift method
ROI Coefficients
Coefficient values
After shifting, all the ROI coefficients are larger than the largest BG coefficient
85Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
93Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
1.0 bpp
94Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
3.0 bpp
95Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
4.0 bpp
96Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
ROI Maxshift mode: what ROI Maxshift mode: what is the gain?is the gain?
– Support for arbitrary shaped ROI’s with minimal complexity
– No need to send shape information– No need for shape encoder and decoder– No need for ROI mask at decoder side– Decoder as simple as non-ROI capable decoder– Can decide in which subband the ROI will begin
– therefore it can give similar results to the general scaling method
97Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab ROI coding: what do we ROI coding: what do we
pay?pay?Lossless image coding with Lossless image coding with
ROIROIGold: Rectangular ROI
0,99
0,995
1
1,005
1,01
1,015
1,02
No ROI
S=2
S=4
Maxshift
98Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab ROI coding: what do we ROI coding: what do we
pay?pay?Lossless image coding with Lossless image coding with ROIROI Target - approx. 25% circular ROI - Relative sizes
0,94
0,96
0,98
1
1,02
1,04
1,06
1,08
1,1
No ROI
S=2
S=4
Max shift
99Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
Block transform codingBlock transform coding
• Tiling– Allow random access to portions of an
image
• Single-Sample Overlap Discrete Wavelet Transform (SSODWT) Exploit overlapping in order to reduce
blockiness In part II
T
100Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
120Signal Processing Laboratory Swiss Federal Institute of Technology, Lausanne
ERICSSON RESEARCH Media Lab
AcknowledgementsAcknowledgements• Mr. Joel Askelöf, Ericsson• Mr. Nicolas Aspert, EPFL• Dr. Eiji Atsumi, Mitsubishi, Japan• Mr. Martin Boliek, Ricoh• Dr. A. Chien, Eastman Kodak Company, USA• Dr. Troy Chinen, Fuji• Mr. Raphael Grosbois, EPFL• Prof. Faouzi Kossentini, UBC• Mr. Mathias Larsson, Ericsson• Dr. Daniel Lee, HP Labs• Dr. Eric Majani, CRF• Prof. Michael Marcellin, Univ. of Arizona• Prof. Andrew Perkis, NTNU• Dr. Majid Rabbani, Eastman Kodak Company• Mr. Diego Santa Cruz, EPFL• Prof. Athanasios Skodras, Univ. Of Padras• Dr. David Taubman, HP Labs & Univ. New South Wales• and many others ...