Top Banner
Chapter 4: Sampling and Quantization A First Course in Digital Communications Ha H. Nguyen and E. Shwedyk February 2009 A First Course in Digital Communications 1/42
42
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

A First Course in Digital CommunicationsHa H. Nguyen and E. Shwedyk

February 2009

A First Course in Digital Communications 1/42

Page 2: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Introduction

Though many message sources are inherently digital in nature,two of the most common message sources, audio and video,are analog, i.e., they produce continuous time signals.

To make analog messages amenable for digital transmissionsampling, quantization and encoding are required.

Sampling: How many samples per second are needed toexactly represent the signal and how to reconstruct the analogmessage from the samples?Quantization: To represent the sample value by a digitalsymbol chosen from a finite set. What is the choice of adiscrete set of amplitudes to represent the continuous range ofpossible amplitudes and how to measure the distortion due toquantization?Encoding: Map the quantized signal sample into a string ofdigital, typically binary, symbols.

A First Course in Digital Communications 2/42

Page 3: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Ideal (or Impulse) Sampling

�∞

−∞=−=

nsnTtts )()( δ

�∞

−∞=−=

nsss nTtnTmtm )()()( δ)(tm ���

Ts is the period of the impulse train, also referred to as thesampling period.

The inverse of the sampling period, fs = 1/Ts, is called thesampling frequency or sampling rate.

It is intuitive that the higher the sampling rate is, the moreaccurate the representation of m(t) by ms(t) is.

What is the minimum sampling rate for the sampled versionms(t) to exactly represent the original analog signal m(t)?

A First Course in Digital Communications 3/42

Page 4: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Illustration of Ideal Sampling������ �� �� ��� )( fM

)0(M

�������� ��� ��� ��� � ���� � !"#$%!&� ! �#$%!�&'� ! (� !)*+,-+.- /*0 12345 676 1 891 89:1 8 :1 8;<=>?@@ ABCDEF )( fM s

sTM )0(

G?BHIJA First Course in Digital Communications 4/42

Page 5: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Spectrum of the Sampled Waveform

ms(t) = m(t)s(t) ↔ Ms(f) = M(f) ∗ S(f)

Ms(f) = M(f) ∗

[1

Ts

∞∑

n=−∞

δ(f − nfs)

]

︸ ︷︷ ︸S(f)

=1

Ts

∞∑

n=−∞

M(f − nfs).

If the bandwidth of m(t) is limited to W Hertz, m(t) can becompletely recovered from ms(t) by an ideal lowpass filter ofbandwidth W if fs ≥ 2W .

When fs < 2W (under-sampling), the copies of M(f) overlapand it is not possible to recover m(t) by filtering ⇒ aliasing.

A First Course in Digital Communications 5/42

Page 6: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Reconstruction of m(t)

Ms(f) = F{ms(t)} =

∞∑

n=−∞

m(nTs)F{δ(t − nTs)} =

∞∑

n=−∞

m(nTs)exp(−j2πnfTs)

M(f) =Ms(f)

fs

=1

fs

∞∑

n=−∞

m(nTs)exp(−j2πnfTs), −W ≤ f ≤ W.

m(t) = F−1{M(f)} =

∫∞

−∞

M(f)exp(j2πft)df

=

∫ W

−W

1

fs

∞∑

n=−∞

m(nTs)exp(−j2πnfTs)exp(j2πft)df

=1

fs

∞∑

n=−∞

m(nTs)

∫ W

−W

exp[j2πf(t − nTs)]df

=∞∑

n=−∞

m(nTs)sin[2πW (t − nTs)]

πfs(t − nTs)=

∞∑

n=−∞

m( n

2W

)sinc(2Wt − n)

A First Course in Digital Communications 6/42

Page 7: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Sampling Theorem

Theorem

A signal having no frequency components above W Hertz is

completely described by specifying the values of the signal at

periodic time instants that are separated by at most 1/2Wseconds.

fs ≥ 2W is known as the Nyquist criterion, the sampling ratefs = 2W is called the Nyquist rate and its reciprocal calledthe Nyquist interval.

Ideal sampling is not practical ⇒ Need practical samplingmethods.

A First Course in Digital Communications 7/42

Page 8: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Bandlimited Interpolation

−5 −4 −3 −2 −1 0 1 2 3 4 5

0

0.5

1x(

t)

Example of Band−limited Signal Reconstruction (Interpolation)

−5 −4 −3 −2 −1 0 1 2 3 4 5

0

0.5

1

x[n]

=x(

nTs)

−5 −4 −3 −2 −1 0 1 2 3 4 5

0

0.5

1

Normalized time (t/Ts)

x r(t)

A First Course in Digital Communications 8/42

Page 9: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Natural Sampling

K∞

−∞=

−=n

snTthtp )()(

L∞

−∞=−=

nss nTthtmtm )()()()(tm

MNOIn the above, h(t) = 1 for 0 ≤ t ≤ τ and h(t) = 0 otherwise.

The pulse train p(t) is also known as the gating waveform.

Natural sampling requires only an on/off gate.

A First Course in Digital Communications 9/42

Page 10: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Illustration of Natural SamplingPQRSQTSU VWXYZ [\[ )( fM

)0(M] ^_`^a`b cτ defef ghijk g lmnoplqg lqrg l sg l( )0D

)( fP

( )1D ( )2Dtuvwxvyx zu{ |}~�� ��� | ��| ���| � �| �������� ������ )( fM s�A First Course in Digital Communications 10/42

Page 11: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Signal Reconstruction in Natural Sampling

Write the periodic pulse train p(t) in a Fourier series as:

p(t) =∞∑

n=−∞

Dnexp(j2πnfst), Dn =τ

Tssinc

(nτ

Ts

)e−jπnτ/Ts .

The sampled waveform and its Fourier transform are

ms(t) = m(t)

∞∑

n=−∞

Dnexp(j2πnfst).

Ms(f) =

∞∑

n=−∞

DnF{m(t)exp(j2πnfst)} =

∞∑

n=−∞

DnM(f − nfs).

The original signal m(t) can still be reconstructed using a lowpassfilter as long as the Nyquist criterion is satisfied.

A First Course in Digital Communications 11/42

Page 12: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Flat-Top Sampling

Flat-top sampling is the most popular sampling method andinvolves two simple operations: sample and hold.���� �� �����

τ ����� ��∞

−∞=

−=n

snTtts )()( δ

�∞

−∞=

−n

ss nTtnTm )()( δ)(tm

)(th

t

�� τ �∞

−∞=−=

nsss nTthnTmtm )()()( ¡¢

A First Course in Digital Communications 12/42

Page 13: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Spectrum of ms(t) in Flat-Top Sampling

ms(t) =

[m(t)

∞∑

n=−∞

δ(t − nTs)

]∗ h(t).

Ms(f) = F

{m(t)

∞∑

n=−∞

δ(t − nTs)

}F{h(t)} =

1

Ts

H(f)

∞∑

n=−∞

M(f − nfs),

where H(f) = F{h(t)} = τsinc(fτ)exp(−jπfτ).£¤¥¦§ ¨©¨ )( fM ª«¬­® ¯°¯ ª ±²ª ±²³ª ± ³ª ±)( fM s

«´µ¶·¸ ¹·º»¸¼½¾­¿ÀÁÂà )( fH

τ1τ1− ÄÅÆÇÈ ÉÊÉ Ä ËÌÄ ËÌÍÄ Ë ÍÄ ËÎÏÐÑÒÓÓ ÔÕÖ×ØÙ)( fM s

ÅÚÖÒ×Ì×ÏÑ ÓÒÛÑÖÕÜÝÇÞA First Course in Digital Communications 13/42

Page 14: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Equalization

Not possible to reconstruct m(t) using an lowpass filter, evenwhen the Nyquist criterion is satisfied.

The distortion due to H(f) can be corrected by connecting anequalizer in cascade with the lowpass reconstruction filter.

Ideally, the amplitude response of the equalizer is

|Heq| =Ts

|H(f)|=

Ts

τsinc(fτ)

f

ßàWW−

sinc( )s

eq

TH

fτ τ=

)(tms )(tm

áâãäåæçèéãçêäå ëêìçâè íîéïìêðâèñòóA First Course in Digital Communications 14/42

Page 15: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Pulse Modulation

In pulse modulation, some parameter of a pulse train is variedin accordance with the sample values of a message signal.Pulse-amplitude modulation (PAM): amplitudes of regularlyspaced pulses are varied.

PAM transmission does not improve the noise performanceover baseband modulation, but allows multiplexing, i.e.,sharing the same transmission media by different sources.The multiplexing advantage offered by PAM comes at theexpense of a larger transmission bandwidth.

Pulse-width modulation (PWM): widths of the individualpulses are varied.

Pulse-position modulation (PPM): position of a pulse relativeto its original time of occurrence is varied.

Pulse modulation techniques are still analog modulation. Fordigital communications of an analog source, quantization ofsampled values is needed.

A First Course in Digital Communications 15/42

Page 16: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

PWM & PPM Waveforms with a Sinusoidal Message

0 0.2 0.4 0.6 0.8 1−1

−0.5

0

0.5

1

t

m(t

)

(a)

0 0.2 0.4 0.6 0.8 10

0.5

1

1.5

2

t

(b)

0 0.2 0.4 0.6 0.8 10

0.5

1

1.5

2

t

(c)

0 0.2 0.4 0.6 0.8 10

0.5

1

1.5

2

t

(d)

A First Course in Digital Communications 16/42

Page 17: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Quantization ôõö÷øùú ûüõýþÿ�ùú �ý���ùú���� { })( snTm { })(ˆ snTm � � � Quantization is to transform m(nTs) into a discrete amplitudem(nTs) taken from a finite set.

If the spacing between two adjacent amplitude levels issufficiently small, then m(nTs) can be made practicallyindistinguishable from m(nTs).

There is always a loss of information associated with thequantization process, no matter how fine one may choose thefinite set of the amplitudes ⇒ Not possible to completely

recover the sampled signal from the quantized signal.

A First Course in Digital Communications 17/42

Page 18: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Memoryless Quantization � �������������� � ������� � ������� �������)( snTm )(ˆ snTm

lD 1+lD1−lD2+lD

1−lT lT 1+lT)( snTm

)(ˆ snTm

Quantization of current sample value is independent ofearlier/later samples.

The lth interval is determined by the decision levels (alsocalled the threshold levels) Dl and Dl+1:

Il : {Dl < m ≤ Dl+1}, l = 1, . . . , L.

Signal amplitudes in Il are all represented by one amplitudeTl ∈ Il (target level or reconstruction level).

A First Course in Digital Communications 18/42

Page 19: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Uniform Quantizer

Step-size is the same and the target level is in the middle ofthe interval: Tl =

Dl+Dl+1

2 .

Midtread and midrise input/output characteristics:

)( snTm

)(ˆ snTm

7D5D1D 6D

7T

1T

6T ���� !"#"!$� �� !"#"!

2D 3D

4D

8D

2T

3T

5T

%&' ∆

)( snTm

)(ˆ snTm

7D1D 6D

7T

1T

6T ()*+, -./.-0+,*+, -./.-

2D 3D

4D

8D

2T

3T

9D

8T

123∆

A First Course in Digital Communications 19/42

Page 20: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Input and Output of A Midrise Uniform Quantizer456789:;< =>? (sec)t

0sT 2 sT 3 sT 4 sT 5 sT

sT−2 sT−3 sT−

5 sT−

ˆ ( )m t

( )m t@<A8B8CD 7<E<7FGHI<9 7<E<7 maxm

maxm−

A First Course in Digital Communications 20/42

Page 21: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Illustration of Quantization Error

−5 −4 −3 −2 −1 0 1 2 3 4 5

−1

−0.8

−0.6

−0.4

−0.2

0

0.2

0.4

0.6

0.8

1N

orm

aliz

ed a

mpl

itude

(vo

lts/

mm

ax)

−5 −4 −3 −2 −1 0 1 2 3 4 5

0

Nor

mal

ized

err

or

t/ Ts

A First Course in Digital Communications 21/42

Page 22: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Signal-to-Quantization Noise Ratio (SNRq)

Model the input as a zero-mean random variable m with somepdf fm(m).

Assume the amplitude range of m is −mmax ≤ m ≤ mmax ⇒the quantization step-size is ∆ = 2mmax

L .

Let q = m − m be the quantization error, then−∆/2 ≤ q ≤ ∆/2.

If ∆ is sufficiently small (L is sufficiently large), q isapproximately uniform over [−∆/2,∆/2]:

fq(q) =

{1∆ , −∆

2 < q ≤ ∆2

0, otherwise.

The mean of q is zero, while its variance is:

σ2q

=

∫ ∆/2

−∆/2q2fq(q)dq =

∫ ∆/2

−∆/2q2

(1

)dq =

∆2

12=

m2max

3L2.

A First Course in Digital Communications 22/42

Page 23: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

With L = 2R, where R is the number of bits needed torepresent each target level, then σ2

q= m2

max

3×22R

The average message power is σ2m

=∫mmax

−mmaxm2fm(m)dm.

The signal-to-quantization noise ratio is

SNRq =

(3σ2

m

m2max

)22R =

3 × 22R

F 2.

F is called the crest factor of the message, defined as,

F =Peak value of the signal

RMS value of the signal=

mmax

σm

.

SNRq increases exponentially with the number of bits persample R and decreases with the square of the message’screst factor.

A First Course in Digital Communications 23/42

Page 24: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Expressed in decibels, SNRq is

10 log10 SNRq = 6.02R + 10 log10

(σ2m

m2max

)+ 4.77

= 6.02R − 20 log10 F + 4.77

An additional 6-dB improvement in SNRq is obtained for each

bit added to represent the continuous signal sample (6-dBrule).

A First Course in Digital Communications 24/42

Page 25: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Optimal Quantizer

Uniform quantizer is not optimal in terms of minimizing thesignal-to-quantization noise ratio.

In general, the decision levels are constrained to satisfy:

D1 = −mmax,DL+1 = mmax,Dl ≤ Dl+1, for l = 1, 2, . . . L.

The average quantization noise power is

Nq =

L∑

l=1

∫ Dl+1

Dl

(m − Tl)2fm(m)dm.

To obtain the optimal quantizer that maximizes the SNRq,one needs to find the set of 2L − 1 variables{D2,D3, . . . ,DL, T1, T2, . . . , TL} to minimize Nq.

A First Course in Digital Communications 25/42

Page 26: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Differentiate Nq with respect to Dj and set the result to 0:

∂Nq

∂Dj= fm(Dj)

[(Dj − Tj−1)

2 − (Dj − Tj)2]

= 0, j = 2, 3, . . . L.

Doptl =

Tl−1 + Tl

2, l = 2, 3, . . . L.

⇒ The decision levels are the midpoints of the target values!

Differentiate Nq with respect to Tj and set the result to 0:

∂Nq

∂Tj= −2

∫ Dj+1

Dj

(m − Tj)fm(m)dm = 0, j = 1, 2, . . . L.

T optl =

∫ Dl+1

Dlmfm(m)dm

∫ Dl+1

Dlfm(m)dm

, l = 1, 2, . . . , L.

⇒ The target value for a quantization region should bechosen to be the centroid of that region.

A First Course in Digital Communications 26/42

Page 27: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Example of Optimal Quantizer Design (Problem 4.6)

0 1

1/3

1D 2T

1T

1D−

1

(volts)m

( ) (1/volts)f mm

14− 1

41−

T1 =

∫ D1

0 mfm(m)dm∫ D1

0fm(m)dm

=

∫ 1/40 mdm + 1

3

∫ D1

1/4mdm

14

+(D1 − 1

4

)13

=1 + 8D2

1

8 + 16D1(1)

T2 =

∫ 1D1

mfm(m)dm∫ 1D1

fm(m)dm=

1 − D21

2(1 − D1)=

1 + D1

2, D1 =

T1 + T2

2(2)

∴ 2D1 =1 + 8D2

1

8 + 16D1+

1 + D1

2⇒ 4D2

1 + D1 −5

4= 0 ⇒ D1 = 0.4478 (3)

T1 = 0.1717; T2 = 0.7239. (4)

A First Course in Digital Communications 27/42

Page 28: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Lloyd-Max Conditions and Iterative Algorithm

Doptl =

Tl−1 + Tl

2, (5) T opt

l =

∫ Dl+1

Dlmfm(m)dm

∫ Dl+1

Dlfm(m)dm

. (6)

l = 2, 3, . . . L

1 Start by specifying an arbitrary set of decision levels (forexample the set that results in equal-length regions) and thenfind the target values using (6).

2 Determine the new decision levels using (5).

3 The two steps are iterated until the parameters do not changesignificantly from one step to the next.

The optimal quantizer needs to know pdf fm(m) and is designedfor a specific mmax ⇒ Prefer quantization methods that are robustto source statistics and changes in the signal’s power level.

A First Course in Digital Communications 28/42

Page 29: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Robust Quantizers

When the message signal is uniformly distributed, the optimalquantizer is a uniform quantizer ⇒ As long as the distributionof the message signal is close to uniform, the uniformquantizer works fine.

For a voice signal, there exists a higher probability for smalleramplitudes and a lower probability for larger amplitudes ⇒ itis more efficient to design a quantizer with more quantizationregions at lower amplitudes and less quantization regions atlarger amplitudes (i.e., nonuniform quantization).

Robust method for performing nonuniform quantization is touse compander=compressor+ expander.JKLMNOPPKNQRST UVWXKNLYZ[V\W]ONS ^ ^ ^ _O`KVP\NZ`\WKVXWa\ON bcM[VdONQefRST

A First Course in Digital Communications 29/42

Page 30: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

µ-law and A-law Companders

y = ymaxln [1 + µ (|m|/mmax)]

ln(1 + µ)sgn(m), (µ-law)

y =

ymaxA(|m|/mmax)

1+lnAsgn(m), 0 <

|m|mmax

≤ 1A

ymax1+ln[A(|m|/mmax)]

1+lnAsgn(m), 1

A <|m|

mmax< 1

, (A-law)

0 0.5 10

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

Input m/mmax

Out

put y

/ym

ax

0 0.5 10

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

Input m/mmax

Out

put y

/ym

ax

µ=0

µ=1

µ=10

µ=255

A=10

A=1

A=87.6

A=250

(a) (b)

A First Course in Digital Communications 30/42

Page 31: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

SNRq of Non-Uniform Quantizers

maxy

maxm

y

m

)(mgy =

lml∆

dm

dy

maxm−

maxy−

0

ly

When L ≫ 1 , ∆ and ∆l are small ⇒ fm(m) is a constant fm(ml) over∆l and ml is at the midpoint of the lth quantization region.

Nq =

L∑

l=1

∫ ml+∆

l

2

ml−∆

l

2

(m − ml)2fm(m)dm

∼=

L∑

l=1

fm(ml)

∫ ml+∆

l

2

ml−∆

l

2

(m − ml)2dm =

L∑

l=1

∆3l

12fm(ml).

A First Course in Digital Communications 31/42

Page 32: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

maxy

maxm

y

m

)(mgy =

lml∆

dm

dy

maxm−

maxy−

0

ly

∆l

=dg(m)

dm

∣∣∣∣m=ml

⇒ Nq =∆2

12

L∑

l=1

fm(ml)(dg(m)dm

∣∣∣m=ml

)2 ∆l.

Since L ≫ 1, approximate the summation by an integral to obtain

Nq =∆2

12

∫ mmax

−mmax

fm(m)(

dg(m)dm

)2 dm =y2max

3L2

∫ mmax

−mmax

fm(m)(

dg(m)dm

)2 dm.

A First Course in Digital Communications 32/42

Page 33: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

SNRq of µ-law Compander

dg(m)

dm=

ymax

ln(1 + µ)

µ(1/mmax)

1 + µ(|m|/mmax).

Nq =y2max

3L2

ln2(1 + µ)

y2max

mmax

)2

∫ mmax

−mmax

[1 + µ

(|m|

mmax

)]2

fm(m)dm

=m2

max

3L2

ln2(1 + µ)

µ2

∫ mmax

−mmax

[1 + 2µ

(|m|

mmax

)+ µ2

(|m|

mmax

)2]

fm(m)dm.

Since∫mmax

−mmaxfm(m)dm = 1,

∫mmax

−mmaxm2fm(m)dm = σ2

mand∫mmax

−mmax|m|fm(m)dm = E{|m|}, then

Nq =m2

max

3L2

ln2(1 + µ)

µ2

[1 + 2µ

E{|m|}

mmax+ µ2 σ2

m

m2max

].

A First Course in Digital Communications 33/42

Page 34: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

SNRq =σ2m

Nq=

3L2µ2

ln2(1 + µ)

(σ2m

/m2max)

1 + 2µ(E{|m|}/mmax) + µ2(σ2m

/m2max)

.

Define σ2n = σ2

m

m2max

, then E{|m|}σm

σm

mmax= E{|m|}

σm

σn. Therefore,

SNRq(σ2n) =

3L2µ2

ln2(1 + µ)

σ2n

1 + 2µσnE{|m|}

σm

+ µ2σ2n

.

If µ ≫ 1 then the dependence of SNRq on the message’scharacteristics is very small and SNRq can be approximated as

SNRq =3L2

ln2(1 + µ).

For practical values of µ = 255 and L = 256, SNRq = 38.1dB.

A First Course in Digital Communications 34/42

Page 35: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

8-bit Quantizer for the Gaussian-Distributed Message

−90 −80 −70 −60 −50 −40 −30 −20 −10 0−40

−30

−20

−10

0

10

20

30

40

50

60

Relative signal level 20log10

(σm

/mmax

) (dB)

SN

R q (dB

)µ−law compander

µ=255

Uniform quantization(no compading)

One sacrifices performance for larger input power levels to obtain a

performance that remains robust over a wide range of input levels.

A First Course in Digital Communications 35/42

Page 36: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

SNRq with 8-bit µ-law quantizer (L = 256, µ = 255)

−100 −80 −60 −40 −20 0−20

−10

0

10

20

30

40

Normalized signal power 10log10

(σn2) (dB)

SN

R q (dB

)

GaussianLaplacianGammaUniform

Insensitive to variations in input signal power and also insensitive to the

actual pdf model – Both desirable properties.

A First Course in Digital Communications 36/42

Page 37: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Differential Quantizers

Most message signals (e.g., voice or video) exhibit a highdegree of correlation between successive samples.Redundancy can be exploited to obtain a better SNRq for agiven L, or conversely for a specified SNRq the number oflevels L can be reduced:

1 Use the previous sample values to predict the next samplevalue and then transmit the difference.

2 Quantize and transmit the prediction error,e[n] = m[n] − m[n]. ghijklmnoponqlrksotiuvwnq xpyz {|l}jiw

+

~l��nonjkliww��hijklmnq |l}jiw�ponqlrklsj nooso[ ]nm [ ]ne ˆ[ ]ne

[ ]nm�

If |emax| = |mmax − kmmax| = |1− k|mmax is less than mmax thenthe quantization noise power is reduced!

A First Course in Digital Communications 37/42

Page 38: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Linear Predictor�����1−z 1−z . . .

1−z

1w 2w pw1−pw� . . .

. . .

� � ����������[ ]nm

[ 1]n −m [ 2]n −m [ 1]n p− +m [ ]n p−m

[ ]nm�

Select {wi} to minimize the variance of prediction error:

σ2e

= E

(m[n] −

p∑

i=1

wim[n − i]

)2 = E{m2[n]} −

2

p∑

i=1

wiE{m[n]m[n − i]} +

p∑

i=1

p∑

j=1

wiwjE{m[n − i]m[n − j]}.

A First Course in Digital Communications 38/42

Page 39: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Normal Equations (or the Yule-Walker Equations)

With Rm(k) = E{m[n]m[n + k]} the autocorrelation of {m[n]},

σ2e

= Rm(0) − 2

p∑

i=1

wiRm(i) +

p∑

i=1

p∑

j=1

wiwjRm(i − j).

Take the partial derivative of σ2e

with respect to each coefficient wi

and set the results to zero to yield:

Rm(0) Rm(1) Rm(2) · · · Rm(p − 1)Rm(−1) Rm(0) Rm(1) · · · Rm(p − 2)Rm(−2) Rm(−1) Rm(0) · · · Rm(p − 3)

......

.... . .

...Rm(−p + 1) Rm(−p + 2) Rm(−p + 3) · · · Rm(0)

·

w1

w2

w3

...wp

=

Rm(1)Rm(2)Rm(3)

...Rm(p)

.

A First Course in Digital Communications 39/42

Page 40: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Reconstruction of m[n] from the Differential SamplesIgnore the quantization error and look at the reconstruction ofm[n] from the differential samples e[n].

e[n] = m[n] −

p∑

i=1

wim[n − i].

e(z−1) = m(z−1) −

p∑

i=1

wiz−i

m(z−1) = m(z−1) − m(z−1)

p∑

i=1

wiz−i

= m(z−1) − m(z−1)H(z−1) ⇒ m(z−1) =1

1 − H(z−1)e(z−1).

+

( )1H z−

+−

�( )1H z−−

≡ +

�[ ]ne [ ]nm

[ ]nm�( )1z−e ( )1z−m

( )1z−m�

A First Course in Digital Communications 40/42

Page 41: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Under quantization noise error, use DPCM to eliminate the effectof previous quantization noise samples.��������� �� ¡¢��£��¢� �¡�¤�¥¦§�¢ ¨£©ª «¬�­��§

+−

+

+

®£¯ª ¬�­��§¨�« ° °[ ]nm

[ ]ne ˆ[ ]ne

[ ]nm±

ˆ [ ]nm²³´µ¶³· ¸·³¶¹´ºµ· »³´µ¼½º·¾´º³¶¸¿À ½¹Á¼ÂÃ++ÄÅƲ¸ÇÀ ½¹Á¼Âà Ȉ[ ]ne ˆ [ ]nm

[ ]nmÉ

m[n] = m[n] + e[n] = m[n] + (e[n] − q[n])

= (m[n] + e[n]) − q[n] = m[n] − q[n].

A First Course in Digital Communications 41/42

Page 42: A First Course in Digital Communications 2

Chapter 4: Sampling and Quantization

Pulse-Code Modulation (PCM)

A PCM signal is obtained from the quantized PAM signal byencoding each quantized sample to a digital codeword.

In binary PCM each quantized sample is digitally encoded intoan R-bit binary codeword, where R = ⌈log2 L⌉ + 1.

Binary digits of a PCM signal can be transmitted using manyefficient modulation schemes.

There are several mappings: Natural binary coding (NBC),Gray mapping, foldover binary coding (FBC), etc.

1D

1T

2D 3D 4D 5D 6D 7D 8D 9D

2T 3T 4T 5T 6T 7T 8TÊÊÊÊ ËÊÊË ÌÊËÊ ÍÊËË ÎËÊÊ ÏËÊË ÐËËÊ ÑËËËÒÓÔÕÖ×Ø ÙÚÛÜÙ ÝÊÊÊ ÊÊË ÊËË ÊËÊ ËËÊ ËËË ËÊË ËÊÊÞÓ×ß Ù ÊËË ÊËÊ ÊÊË ÊÊÊ ËÊÊ ËÊË ËËÊ ËËËàÛÜÙ

A First Course in Digital Communications 42/42