Top Banner
SIGNALS AND COMMUNICATION TECHNOLOGY For further volumes: http://www.springer.com/series/4748
26

For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

Jul 31, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

SIGNALS AND COMMUNICATION TECHNOLOGY

For further volumes:http://www.springer.com/series/4748

Page 2: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

Apurba Das

Digital Communication

Principles and System Modelling

123

Page 3: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

Apurba DasScientist, Image Processing LabCDAC, KolkataA Scientific SocietyMinistry of Communication and ITGovernment of IndiaWest [email protected][email protected]

Additional material to this book can be downloaded from http://extra.springer.com

ISBN 978-3-642-12742-7 e-ISBN 978-3-642-12743-4DOI 10.1007/978-3-642-12743-4Springer Heidelberg Dordrecht London New York

Library of Congress Control Number: 2010929759

© Springer-Verlag Berlin Heidelberg 2010This work is subject to copyright. All rights are reserved, whether the whole or part of the material isconcerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting,reproduction on microfilm or in any other way, and storage in data banks. Duplication of this publicationor parts thereof is permitted only under the provisions of the German Copyright Law of September 9,1965, in its current version, and permission for use must always be obtained from Springer. Violationsare liable to prosecution under the German Copyright Law.The use of general descriptive names, registered names, trademarks, etc. in this publication does notimply, even in the absence of a specific statement, that such names are exempt from the relevant protectivelaws and regulations and therefore free for general use.

Cover design: WMXDesign GmbH, Heidelberg

Printed on acid-free paper

Springer is part of Springer Science+Business Media (www.springer.com)

Page 4: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

To YouAngana (Oli),my wife

Page 5: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

Preface

In today’s world of human-machine interaction, the necessity of custom commu-nication is increasing day by day. The adjective ‘custom’ in communication or intrue sense, telecommunication signifies a lot of things like secured communica-tion, communication with hidden data through any type of multimedia covers likeimage, speech or video, communication in user suggested bandwidth, multi-channelcommunication without cross-talk, internetworking in LAN, MAN, WAN and inte-grated service digital network (ISDN) of image, video and data, data transmission inencrypted but non-perceptible mode and so on. The information exchange betweenthe source and the destination is generally done through modulated signal both inanalog and digital form. Digital design and processing can not only be easily real-izable, but also digital signal processing can help one designer to meet the practicalneeds of this era as discussed before.

Therefore, the digital communication has become an important subject of studyfor students of electronics and communication, computer science and informationtechnology both in undergraduate and post-graduate levels.

The aim of the book is to represent the theory and application of the designphilosophy of the subject Digital Communication systems in a unique but lucidform. There are resource books that are supreme pedagogical documents of thissubject. It is a bit difficult to consider them as the standard text for the entire studentpopulation, because the said books do not visualize the design problem clearly. Anattempt has been made to bridge the gap between the design principle and systemmodelling. In this book, I have tried to introduce the subject through its obvious flow.Supporting MATLAB codes and outputs are also included for better understandingand visualization. Essentially it is designed for the large class of students in thestandards of bachelors, masters or those who have started their research carrier inscience, engineering or technology.

The title of the proposed book is ‘Digital Communication- Principles and systemmodelling’. By selecting this name I essentially took the task to insert equal impor-tance to the theory and application aspect of the subject. The subject is introducedconsidering absolutely zero prerequisite of the readers. The introductory chaptercreated a space for round table discussion between the author and the reader in thesubject of signals, systems, types and choices of telecommunication methodology.Basic building blocks play their roles to design one complete digital communication

vii

Page 6: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

viii Preface

system according to necessity of successful interaction of information. In secondchapter, the process of conversion of natural (analog) signal to digital signal isdiscussed for letting the input acceptable to digital communication system. In thesubsequent chapters the processes of signal transmission with and without mod-ulation are described. Process of security embedding in terms of spreading thebandwidth of a signal is represented. The issues of inter-symbol interference (ISI)are solved by using equalizer. Theory of information and channel capacity are alsodiscussed in the light of probability theory. As the book claims zero prerequisite,one Appendix titled as Elementary Probability Theory is also appended to the mainchapters. The error detection and correction in one digital communication systemis understood physically and then suitable coding schemes are being employed tosolve particular types of bit errors due to channel noise.

In the application part I have put my best effort to select a wide class of prob-lems. Some of them are referral in nature and found in most of the books but theother group includes the applications, which I have collected from different resourcebooks and different research papers (all the time submitting courtesy to the authors).Some applications are also represented as case studies on frequently used conceptsconvolution and correlation in Appendix B.

The style of writing is kept in the lucid level to attract the interest of a large classof readers. I always believe that, writing a text book is very much difficult in termsof presentation. Text book is not only for concept sharing, but also for preparing aslide show or movie which can just put the readers into a smooth and comfortablepath of understanding the subject. Similarly, teaching is not a delivery of some rawdata; conversely, it is a performance in front of the students/ audience. I think thisbook can be a good teaching aid, too.

Salient Features

1. The application area is rich and resemblance to the present trend of research.2. An online content is included with the title, which includes codes and MATLAB,

with illuminating uncommon and common applications along with some flashmovies for better understanding of the subject.

3. Elegant worked out exercise section is designed in such a way that, the readerscan get the flavour of the subject and get attracted towards the future scopes ofthe subject.

4. Unparallel tabular, flow chart based and pictorial methodology description isincluded for sustained impression of the proposed design/algorithms in mind.

The book is for everybody, the reader may be someone without the knowledge ofbasic engineering or someone like a researcher who wants to understand the subjectin a different angle. Let me use the technical terminology to let you understand.Ultimately the received signal to you transmitted by this book must be converted

Page 7: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

Preface ix

successfully to analog/ natural form; otherwise the knowledge cycle does not getcompleted.

Kolkata, India Apurba Das

Page 8: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

Acknowledgements

Human being is not at all an island. A person can be successful only when he/she isblessed and encircled by the relatives and community. This book would not be com-pleted without the blessings of my seniors, the well wishes of my friends, colleaguesand students.

First of all I like to express my deep respect to my parents Sri Barun Das andSmt. Nabanita Das for setting up a vision for me. I like to express my regards to myuncle and aunt (Jethu and Mamoni) Sri Arun Kr. Das and Smt. Moli Das for theircontinuous support. I am also thankful to my brother Anirban and sister Adwitia asthey considered me as their benchmark of living.

I am fortunate enough getting Prof. Amit Konar of Electronics and Tele-Communication Engineering department of Jadavpur University as my teacherduring my M-Tech. Sir has always inspired me about writing text books. He himselfis the inspiration for thirst of knowledge.

I am grateful to my friend Mr. Manoj Kr. Pain for everything. Not only he helpedme in preparing the flash files for online content, moreover he is the man behind allof my actions particularly in this phase of my life.

I thank my students, especially Dipto Pandit, Subarno Shekhar Gain, SubhojitChatterjee for their help in content preparation for error control coding chapter andsome parts of Delta Modulation.

I am really grateful to my senior Mr. Debasis Mazumdar of CDAC, Kolkata.I have learnt how nicely mathematical models can infer a physics and how a physicscan generate one nice mathematics. I am also thankful to my colleague Mr. RajaGupta for preparing the flash files for online content.

Last but not the least I like to express my thanks to the editorial team of Springer-Verlag, specially Christoph Baumann and Carmen Wolf for such a wonderfulproduction.

Kolkata, India Apurba Das

xi

Page 9: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

Contents

1 Preview and Introduction . . . . . . . . . . . . . . . . . . . . . . . 11.1 Process of Communication . . . . . . . . . . . . . . . . . . . . 11.2 General Definition of Signal . . . . . . . . . . . . . . . . . . . . 31.3 Time-Value Definition of Signals–Analog and Digital . . . . . . 6

1.3.1 Continuous Time Continuous Valued Signal . . . . . . . 71.3.2 Discrete Time Continuous Valued Signal . . . . . . . . . 71.3.3 Discrete Time Discrete Valued Signal . . . . . . . . . . . 7

1.4 Analog and Digital Communication Systems . . . . . . . . . . . 81.5 Elements of Digital Communication System . . . . . . . . . . . 101.6 MATLAB Programs . . . . . . . . . . . . . . . . . . . . . . . . 11

1.6.1 Time and Frequency Domain Representation of Signals . 111.6.2 CTSV, DTCV, DTDV Signals . . . . . . . . . . . . . . . 12

References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13

2 Waveform Encoding . . . . . . . . . . . . . . . . . . . . . . . . . . 152.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . 152.2 Pulse Code Modulation (PCM) . . . . . . . . . . . . . . . . . . 15

2.2.1 Process of Sampling . . . . . . . . . . . . . . . . . . . . 162.2.2 Process of Quantization . . . . . . . . . . . . . . . . . . 222.2.3 PCM Transmitter and Receiver . . . . . . . . . . . . . . 242.2.4 Quantization Error . . . . . . . . . . . . . . . . . . . . . 272.2.5 Signal to Noise Ratio (SNR) for Quantized Pulses . . . . 292.2.6 Non-uniform Quantization: Companding . . . . . . . . . 30

2.3 Differential Pulse Code Modulation (DPCM) . . . . . . . . . . . 352.3.1 Cumulative Error in PCM . . . . . . . . . . . . . . . . . 352.3.2 Prevention of Cumulative Error by Applying Feedback . . 362.3.3 How We Can Predict the Future? . . . . . . . . . . . . . 382.3.4 Analysis of DPCM . . . . . . . . . . . . . . . . . . . . . 40

2.4 Delta Modulation . . . . . . . . . . . . . . . . . . . . . . . . . 412.4.1 Drawbacks of Delta Modulation . . . . . . . . . . . . . . 43

2.5 Adaptive Delta Modulation . . . . . . . . . . . . . . . . . . . . 442.5.1 Song Algorithm . . . . . . . . . . . . . . . . . . . . . . 442.5.2 Space-Shuttle Algorithm . . . . . . . . . . . . . . . . . . 46

xiii

Page 10: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

xiv Contents

2.6 Sigma-Delta Modulation (SDM) . . . . . . . . . . . . . . . . . 472.6.1 Noise Performance . . . . . . . . . . . . . . . . . . . . . 48

2.7 Linear Predictive Coder (LPC) . . . . . . . . . . . . . . . . . . 492.7.1 Concept . . . . . . . . . . . . . . . . . . . . . . . . . . 492.7.2 Genetic Algorithm Based Approach . . . . . . . . . . . . 50

2.8 MATLAB Programs . . . . . . . . . . . . . . . . . . . . . . . . 532.8.1 Aliasing . . . . . . . . . . . . . . . . . . . . . . . . . . 53

References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54

3 Digital Baseband Signal Receivers . . . . . . . . . . . . . . . . . . 553.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . 553.2 Integrate and Dump Type Filter . . . . . . . . . . . . . . . . . . 56

3.2.1 Noise Power and Variance . . . . . . . . . . . . . . . . . 593.2.2 Figure of Merit . . . . . . . . . . . . . . . . . . . . . . . 613.2.3 Probability of Error . . . . . . . . . . . . . . . . . . . . 61

3.3 The Optimum Filter . . . . . . . . . . . . . . . . . . . . . . . . 633.4 The Matched Filter . . . . . . . . . . . . . . . . . . . . . . . . . 67

3.4.1 Impulse Response . . . . . . . . . . . . . . . . . . . . . 673.4.2 Probability of Error . . . . . . . . . . . . . . . . . . . . 673.4.3 Properties of Matched Filter . . . . . . . . . . . . . . . . 70

3.5 The Correlator . . . . . . . . . . . . . . . . . . . . . . . . . . . 723.6 Simulink Communication Block Set Example . . . . . . . . . . 74References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75

4 Digital Baseband Signal Transmitter . . . . . . . . . . . . . . . . . 774.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . 774.2 Elements of Digital Baseband Communication System . . . . . . 77

4.2.1 Formatting . . . . . . . . . . . . . . . . . . . . . . . . . 784.2.2 Regenerative Repeater . . . . . . . . . . . . . . . . . . . 78

4.3 Properties and Choice of Digital Formats . . . . . . . . . . . . . 804.4 Line Coding . . . . . . . . . . . . . . . . . . . . . . . . . . . . 814.5 Power Spectrum Density of Different Digital Formats . . . . . . 83

4.5.1 Unipolar-NRZ . . . . . . . . . . . . . . . . . . . . . . . 864.5.2 Unipolar-RZ . . . . . . . . . . . . . . . . . . . . . . . . 874.5.3 Polar-NRZ . . . . . . . . . . . . . . . . . . . . . . . . . 884.5.4 Polar-RZ . . . . . . . . . . . . . . . . . . . . . . . . . . 894.5.5 Bipolar-NRZ . . . . . . . . . . . . . . . . . . . . . . . . 904.5.6 Split-Phase (Manchester) . . . . . . . . . . . . . . . . . 91

References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93

5 Equalization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 955.1 Inter-Symbol Interference (ISI) . . . . . . . . . . . . . . . . . . 955.2 Nyquist Criterion for Distortion Less Transmission (Zero ISI) . . 97

5.2.1 Criteria in Frequency Domain . . . . . . . . . . . . . . . 985.2.2 Concept of Ideal Nyquist Channel . . . . . . . . . . . . . 1005.2.3 Limitations of Ideal Solution: Raised Cosine Spectrum . . 101

Page 11: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

Contents xv

5.3 Eye Pattern . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1035.3.1 Information Obtained from Eye Pattern . . . . . . . . . . 104

5.4 System Design for Known Channel . . . . . . . . . . . . . . . . 1045.5 Linear Equalizer . . . . . . . . . . . . . . . . . . . . . . . . . . 106

5.5.1 Linear Transversal Filter . . . . . . . . . . . . . . . . . . 1065.6 Adaptive Equalizer . . . . . . . . . . . . . . . . . . . . . . . . . 108References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110

6 Digital Modulation Techniques . . . . . . . . . . . . . . . . . . . . 1116.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1116.2 Amplitude Shift Keying (ASK) . . . . . . . . . . . . . . . . . . 112

6.2.1 Mathematical Model . . . . . . . . . . . . . . . . . . . . 1136.2.2 ASK Modulator . . . . . . . . . . . . . . . . . . . . . . 1156.2.3 Binary ASK Demodulator . . . . . . . . . . . . . . . . . 117

6.3 Frequency Shift Keying (FSK) . . . . . . . . . . . . . . . . . . 1186.3.1 Mathematical Model . . . . . . . . . . . . . . . . . . . . 1186.3.2 BFSK Modulator . . . . . . . . . . . . . . . . . . . . . . 1196.3.3 FSK Demodulator . . . . . . . . . . . . . . . . . . . . . 121

6.4 Binary Phase Shift Keying (BPSK) . . . . . . . . . . . . . . . . 1226.4.1 Mathematical Model . . . . . . . . . . . . . . . . . . . . 1236.4.2 BPSK Modulator . . . . . . . . . . . . . . . . . . . . . . 1246.4.3 BPSK Demodulator . . . . . . . . . . . . . . . . . . . . 125

6.5 Differential Phase Shift Keying (DPSK) . . . . . . . . . . . . . 1256.5.1 DPSK Modulator . . . . . . . . . . . . . . . . . . . . . 1256.5.2 DPSK Demodulator . . . . . . . . . . . . . . . . . . . . 127

6.6 Quadrature Phase Shift Keying (QPSK) . . . . . . . . . . . . . . 1276.6.1 Mathematical Model . . . . . . . . . . . . . . . . . . . . 1276.6.2 QPSK Modulator . . . . . . . . . . . . . . . . . . . . . 1316.6.3 QPSK Demodulator . . . . . . . . . . . . . . . . . . . . 1316.6.4 Offset QPSK (OQPSK) . . . . . . . . . . . . . . . . . . 132

6.7 Minimum Shift Keying (MSK) . . . . . . . . . . . . . . . . . . 1346.8 Probability of Error for Different Modulation Schemes . . . . . . 136

6.8.1 Probability of Error in ASK . . . . . . . . . . . . . . . . 1366.8.2 Probability of Error in FSK . . . . . . . . . . . . . . . . 1376.8.3 Probability of Error in PSK . . . . . . . . . . . . . . . . 138

6.9 MATLAB Programs . . . . . . . . . . . . . . . . . . . . . . . . 1396.9.1 QPSK Waveform . . . . . . . . . . . . . . . . . . . . . . 1396.9.2 MSK Waveform . . . . . . . . . . . . . . . . . . . . . . 140

References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141

7 Spread Spectrum Modulation . . . . . . . . . . . . . . . . . . . . . 1437.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1437.2 Processing Gain . . . . . . . . . . . . . . . . . . . . . . . . . . 1447.3 Pseudo-Noise (PN) Sequence . . . . . . . . . . . . . . . . . . . 145

7.3.1 Concept: A Hypothetical Experiment . . . . . . . . . . . 1457.3.2 Generation of PN Sequence . . . . . . . . . . . . . . . . 146

Page 12: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

xvi Contents

7.3.3 Properties of PN Sequence . . . . . . . . . . . . . . . . . 1477.4 Direct Sequence Spread Spectrum (DSSS) . . . . . . . . . . . . 149

7.4.1 Concept . . . . . . . . . . . . . . . . . . . . . . . . . . 1497.4.2 DSSS with Coherent BPSK . . . . . . . . . . . . . . . . 1517.4.3 Probability of Error Calculation . . . . . . . . . . . . . . 152

7.5 Frequency-Hopped Spread Spectrum . . . . . . . . . . . . . . . 1557.5.1 Concept . . . . . . . . . . . . . . . . . . . . . . . . . . 1557.5.2 FHSS with FSK . . . . . . . . . . . . . . . . . . . . . . 1577.5.3 Rate of Hopping: Fast and Slow . . . . . . . . . . . . . . 159

7.6 Application of Spread Spectrum . . . . . . . . . . . . . . . . . . 1597.6.1 GPS (Global Positioning System) . . . . . . . . . . . . . 159

7.7 CDMA (Code Division Multiple Access) . . . . . . . . . . . . . 1637.7.1 Orthogonal Chip Sequence . . . . . . . . . . . . . . . . 1637.7.2 Gold Sequence . . . . . . . . . . . . . . . . . . . . . . . 1657.7.3 Principle of Operation . . . . . . . . . . . . . . . . . . . 166

References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 166

8 Information Theory . . . . . . . . . . . . . . . . . . . . . . . . . . 1698.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1698.2 Entropy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1718.3 Rate of Information . . . . . . . . . . . . . . . . . . . . . . . . 1738.4 Information Sources . . . . . . . . . . . . . . . . . . . . . . . . 1738.5 Discrete Memoryless Channel (DMC) . . . . . . . . . . . . . . 176

8.5.1 Channel Representation . . . . . . . . . . . . . . . . . . 1768.5.2 The Channel Matrix . . . . . . . . . . . . . . . . . . . . 176

8.6 Special Channels . . . . . . . . . . . . . . . . . . . . . . . . . . 1778.6.1 Lossless Channel . . . . . . . . . . . . . . . . . . . . . . 1778.6.2 Deterministic Channel . . . . . . . . . . . . . . . . . . . 1788.6.3 Noise-Less Channel . . . . . . . . . . . . . . . . . . . . 1798.6.4 Binary Symmetric Channel (BSC) . . . . . . . . . . . . . 179

8.7 Mutual Information . . . . . . . . . . . . . . . . . . . . . . . . 1828.8 Channel Capacity . . . . . . . . . . . . . . . . . . . . . . . . . 183

8.8.1 Gaussian Channel: Shanon-Hartley Theorem . . . . . . . 1838.9 Entropy Coding . . . . . . . . . . . . . . . . . . . . . . . . . . 185

8.9.1 Shanon-Fano Coding . . . . . . . . . . . . . . . . . . . 1868.9.2 Huffman Coding . . . . . . . . . . . . . . . . . . . . . . 187

8.10 MATLAB Code . . . . . . . . . . . . . . . . . . . . . . . . . . 1888.10.1 Convergence of Pe in Cascaded BSC . . . . . . . . . . . 188

References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 189

9 Error Control Coding . . . . . . . . . . . . . . . . . . . . . . . . . 1919.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1919.2 Scope of Coding . . . . . . . . . . . . . . . . . . . . . . . . . . 1929.3 Linear Block Code . . . . . . . . . . . . . . . . . . . . . . . . . 193

9.3.1 Coding Technique Using Generator Matrix . . . . . . . . 1939.3.2 Syndrome Decoding . . . . . . . . . . . . . . . . . . . . 195

Page 13: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

Contents xvii

9.4 Convolutional Code . . . . . . . . . . . . . . . . . . . . . . . . 1969.4.1 Encoder . . . . . . . . . . . . . . . . . . . . . . . . . . 1969.4.2 State Diagram . . . . . . . . . . . . . . . . . . . . . . . 1999.4.3 Code Tree . . . . . . . . . . . . . . . . . . . . . . . . . 2009.4.4 Trellis Diagram . . . . . . . . . . . . . . . . . . . . . . 2009.4.5 Decoding of Convolutional Code by Viterbi . . . . . . . 202

9.5 Cyclic Code . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2049.5.1 Concept and Properties . . . . . . . . . . . . . . . . . . 2049.5.2 Encoder and Decoder . . . . . . . . . . . . . . . . . . . 2069.5.3 Meggitt Decoder . . . . . . . . . . . . . . . . . . . . . . 207

9.6 BCH Code . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2079.6.1 Simplified BCH Codes . . . . . . . . . . . . . . . . . . . 2089.6.2 General BCH Codes . . . . . . . . . . . . . . . . . . . . 2109.6.3 Properties . . . . . . . . . . . . . . . . . . . . . . . . . 210

References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 211

Appendix A: Elementary Probability Theory . . . . . . . . . . . . . . . 213

Appendix B: Convolution and Correlation – Some Case Studies . . . . . 225

Appendix C: Frequently Used MATLAB Functions . . . . . . . . . . . 237

Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 245

Page 14: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

Chapter 1Preview and Introduction

1.1 Process of Communication

A man is discussing about a cricket game with his friend sitting just in front ofhim. If this is the scenario, this process of interaction is interpersonal communica-tion. In this case, no help of electronics is needed for communication. Let’s nowchange the scenario. Say, a political meeting is going on at a large play ground.In front of 1,000,000 people one speaker is giving his/her lecture. It’s not easy tocommunicate now, as because (i) the distance between the communicating nodeshas been increased and (ii) the audience is not deaf and dumb therefore all of themare responsible for generating unwanted signal (noise). Here we require some extracircuits for successful communication. First the speech signal has to be convertedto electrical equivalent signal known as audio by a transducer namely, microphone.Next, the electrical signal should be amplified by an audio amplifier. Finally, thatamplified audio signal is re-converted by another transducer namely loud speakerto speech signal just as the amplified source signal to make it audible. The blockdiagram representation is shown in Fig. 1.1.

Spee

ch

Transducer

Transducer

MIC Electrical signal Amplified Audio Loud Speaker(Audio)

AudioAmplifier L

oude

r Sp

eech

Fig. 1.1 Speech signal amplification with the help of transducers and electrical amplifier

Therefore we have started using the knowledge of electrical and electronics engi-neering in communication. Now, let’s make the distance longer. Communication isrequired between two persons; one in USA is trying to communicate other per-sons in Germany. Here, microphone and loud speaker cannot also solve the presentproblem. Here two ways are there.

1A. Das, Digital Communication, Signals and Communication Technology,DOI 10.1007/978-3-642-12743-4_1, C© Springer-Verlag Berlin Heidelberg 2010

Page 15: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

2 1 Preview and Introduction

1. There must be a long connecting cable namely transmission line between thepersons. If this is the mode of communication, then that is known as LineCommunication.

2. Otherwise, we can take the help of an antenna to transmit and receive the un-modulated (base-band) or modulated audio signal, this is known as Radio wavecommunication.

Combining the above two, the process of long distance communication is namedas Tele-Communication. The meaning of the word ‘tele’ means far. Obviously, weare now convinced that, electronics must be needed for Tele-Communication. Ourstudy through out the title should be based on Tele-Communication only.

A communication system can also be classified into three categories in respectof direction of communication [1] as:

1. Simplex2. Half Duplex3. Full Duplex

Simplex communication is a unidirectional communication system i.e., commu-nication is possible in one direction only. Typically, the transmitter (the one talkingor sending information in any ways) sends a signal and it’s up to the other receivingdevice (the listener) to figure out what was sent. This type of communication is mostefficient when there is a lot of data flow in one direction, and no traffic is neededin the other direction. Broadcast systems like the T.V and radio signals, fire alarmsystems etc. are good examples of Simplex communication system.

In Half Duplex communication system, bi-directional communication is possi-ble, but only in one direction at a time. That means one can either transmit or receivea signal at a particular instant of time in this system of communication. One cannottransmit and receive a signal simultaneously. Say, within a specific time interval t1 ≤t < t2, node A is transmitting a signal to another node B. At time t = t2, node A willcommand ‘over’ and both of the nodes A and B will change their mode from trans-mitter to receiver and receiver to transmitter, respectively by switching the duplexer.Next, B can start sending information to A via the same link. The walky-talkyused in defense and by police is a good example of Half Duplex communicationsystem.

In Full Duplex communication system simultaneous two-way communicationis achieved. Unlike half duplex communication system, one can both transmit andreceive a signal simultaneously. Telephone conversation is an appropriate exampleof Full Duplex communication system (Fig. 1.2).

When single transmitter is sending the same information to a plenty of receivers,the special mode is called as broadcasting.

Page 16: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

1.2 General Definition of Signal 3

and

or

over over

(b)

(c)

Fire alarm

(a)

Fig. 1.2 Modes ofdirectional communication:(a) Simplex, (b) Half-duplex,(c) Full-duplex

1.2 General Definition of Signal

In a single phrase, signal is the physical quantity by which information is carriedbetween at least two entities. In other words by which physical quantity commu-nication is done, is signal. Signal is not necessarily always represented as someelectrical form of energy, it may be some gait, may be an image, may be a video.

To construct a complete definition let us try to have a close look at the generalproperties of a signal.

Property 1 Representation of a physical quantity.Property 2 Signal must carry some information. Meaning of a signal is not

important in the property discussion. If a signal does not havemeaning with respect to a particular communication, it may be incoded form or meaningful for another arena of communication. Itmeans the physical quantity is unwanted with respect to that specificapplication. Therefore, this is unwanted signal or noise.

Property 3 To measure or predict the response of a physical phenomena or sys-tem, mathematical modeling is important. Electrical current signal isgenerally characterized as

i(t) = I0 cos (ω0t + φ) (1.1)

If we observe a small time window of that signal, the waveform obtained wouldbe as shown in Fig. 1.3a.

Referring the Fig. 1.3, the time domain and frequency domain representationsare shown. Obviously, the spectrum of the single tone signal is showing an impulse

Page 17: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

4 1 Preview and Introduction

0 0.5 1 1.5 2 2.5 3 3.5 4 4.5 5–2

–1

0

1

2

time-->

ampl

itude

-->

Waveform

0 1000 2000 3000 4000 5000 60000

1000

2000

3000

4000

frequency-->

ampl

itude

-->

Amplitude Spectrum

0 0.5 1 1.5 2 2.5 3 3.5 4 4.5 5–2

–1

0

1

2

time-->

ampl

itude

-->

Waveform

0 1000 2000 3000 4000 5000 60000

500

1000

1500

2000

frequency-->

ampl

itude

-->

Amplitude Spectrum

(a)

(b)

Fig. 1.3 (a) Time and frequency representation of a single tone signal, (b) Time and frequencydomain representation of a two tone signal

Page 18: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

1.2 General Definition of Signal 5

only, whereas the two tone (DSB-SC type) signal generates a pair of impulses. Theserepresentations of math models are satisfying the definition of signal but can onlybe considered as an example of a special class of signal, which is modeled as func-tion of time or frequency as f(t) or F(ω). Let’s consider now an image shown in thefollowing Fig. 1.4. To represent the image as a mathematical function, we have tofirst divide the entire image into a number of unit squares of homogeneous intensityvalue to each square. These smallest picture elements are called as pixels. Intensityor color of each smallest square block is now can be represented as function of ordi-nate and abscissa, i.e., function of space where the entire image plane is consideredas a Cartesian co-ordinate system.

x Origin

y

f(x,y)

Fig. 1.4 Imagerepresentation as a functionof 2D space

Similarly, video images can be represented functionally as a multivariate func-tion, where image signal is represented as I(t,x,y), i.e., function of both time andspace.

As per the discussion above, now we can characterize a signal mathematically asa function of independent variable/variables.

Now from the above three properties, we can define signal as, A physical quan-tity used for carrying information from one entity to another and mathematicallymodeled as a function of independent variable/ variables.

Our discussion would be mainly focused on the signals which can be modeled asa function of time. In the next section, we’ll discuss the time-value definition andclassification of signals. Hence, we’ll clearly understand the time-value concept ofanalog and digital signals. Also we can find the step-by-step procedure of conversionof analog signal to digital signal.

Page 19: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

6 1 Preview and Introduction

1.3 Time-Value Definition of Signals–Analog and Digital

The word ‘analog’ comes from the word ‘analogy’ which means similarity. Here thesimilarity implies similarity with the nature. Directly we can say, any natural signalis analog signal. As nature, the starting time of analog signal is also t = −∞ andthe ending time is t = ∞.

Let’s consider the waveform as shown in the Fig. 1.5. We have taken one timewindow of the signal though the existence of the signal is beyond the time ranget = [t1 t2]. Within this time range, the signal x(t) has maximum and minimum valuesXmax and Xmin respectively. Now depending on the countability of the number ofpossible amplitude and possible time values, we can classify signal and this is inturn the step by step approach towards the procedure of ADC (analog to digitalconversion).

0 1 2 3 4 5–10

0

10

time-->

ampl

itude

-->

CTCV

0 1 2 3 4 5–10

0

10

time(nTS)-->

time(nTS)-->

ampl

itude

-->

DTCVX=1Y=5.7063

0 1 2 3 4 5–10

0

10

ampl

itude

-->

DTDV

Sampled signal

Quantized signal

Fig. 1.5 Time valued definition of signal

Page 20: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

1.3 Time-Value Definition of Signals–Analog and Digital 7

1.3.1 Continuous Time Continuous Valued Signal

As shown in the Fig. 1.5, the signal x(t) is considered within the time interval t =[t1 t2], say within time 10:10 a.m. and 10:11 a.m. This technique of watching asignal in a specific interval is called as windowing. This is easily understandablethat, we can take any time value within the specified interval and any amplitude canalso be obtained at any specific time instant ti, i.e., the number of possible validtime instants is infinite. From the concept of set theory, it is considered that, from aset of finite number of time values, any valid time instant ti must be the element ofthe predefined set. In the present case we cannot define any set of finite number ofelements. Because, we can have any instant like 10 h 10 min 1 s 1.3 ns, so possibletime values can be infinite. In the case of amplitude value also we can have infinitenumber of possible amplitude values within the range Xmax and Xmin. This type ofsignal is therefore called as continuous time continuous valued (CTCV) signal.

1.3.2 Discrete Time Continuous Valued Signal

Generally, the analog signals do have this property of continuous time and amplitudevalues. But no digital memory or processor can deal with infinite long words. Digitalsignals are represented using digits only. First, to express the CTCV signal, let’s takethe help of the equally samples of the signal. The equal time spacing between twoadjacent samples is called as sampling interval, Ts. Then the 2nd signal shown in thefigure must have finite number of time values but, we can have infinite number ofpossible voltages values yet. This signal is called as discrete time continuous valuedsignal (DTCV).

1.3.3 Discrete Time Discrete Valued Signal

As shown in Fig. 1.5, at t=1, the amplitude of the signal is 5.7063. It may be any-thing between Xmax and Xmin. Now, to get finite number of voltage values, a setof finite number of amplitude values setting the Xmax and Xmin as upper and lowerlimit, has to be defined. In the present case, within the amplitude range 10(Xmax)and −10(Xmin), 8 values have been taken to form that closed set. The elements are,±1.25, ±3.75, ±6.25, ±8.75. Now, sampled ales can be approximated (i.e., quan-tized) to the closest defined element of the amplitude. As shown in Fig. 1.5, at timeinstant t=1, the sampled value 5.7063 has been quantized to 6.25. The staircaseform of the signal is having finite number of time and amplitude values. This signalis called as discrete time discrete valued (DTDV) signal. Now, that defined ampli-tude values can easily be encoded to get the digital bit stream. The entire process iselaborated in the next chapter (Chap. 2).

Page 21: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

8 1 Preview and Introduction

1.4 Analog and Digital Communication Systems

In the process of telecommunication, one may be interested to transmit directly thenatural signal (analog signal) with or without modulation (base band transmission).There, all the processors/systems used for transmission process are analog proces-sors designed using discrete analog elements like op-amps, transistors, resistors,inductors, capacitors, etc. This is analog communication system.

On the other hand, the system which specifically deals with digital data anddigitally pre-processed signals is a digital communication system. Here, digital pro-cessors and accessories like stored program controlled processors, software codes,digital memory etc. takes important role in the process of signal transmission andreception. But, as we know, all the natural understandable signals are analog, over-head hardware for analog to digital conversion and digital to analog conversion areneeded at the transmitter and receiver end, respectively.

Although, the necessity of extra blocks for analog to digital conversion (ADC)and digital to analog conversion (DAC), digital communication system is preferredover analog communication system for some particular reasons as follows:

1. Noise immunity: While transmitting digital information, formatting is very essen-tial, i.e., two analog correspondence amplitude values are to be assigned for logiczero and logic one respectively in case of binary transmission. Noise immunityinto such formatted digital information is greater than that of an analog signal.An Additive White Gaussian Noise (AWGN), (additive in nature, constant PSD(Power Spectral Density) throughout all frequency components and GaussianPDF (Probability Density Function)) is added to both analog and digital signals.From the Figure 1.6, it’s clearly seen that the actual analog signal after beingattacked by the noise is extremely distorted. Similarly the actual digital signal isalso distorted but in case of digital signal the original signal can be easily recon-structed by simply taking the average amplitude at required time intervals. In theabove example, the average value within time intervals (bit width) TB, 2TB, 3TB& 4TB are somewhat nearer to +1 V, +1 V, 0 V & +1 V. Hence the original signalcan be easily reconstructed.

2. Memory: Analog signals are generally stored in devices like magnetic tapes,floppy disks, etc. It requires many magnetic tapes to store the analog signals.Moreover these are easily affected by the magnetic and other mechanical andphysical phenomenon. On the other hand, digital information is stored in deviceslike CDs and registers. For example, in a D-flip-flop, the output can be retainedfor many years without any external power. When the output is needed, the trig-ger clock pulse is supplied to the flip-flop & it will give the output. Lifetime ofdigital memory is also higher than that of analog memory.

3. System Re-configurability: One of the most significant advantages of digital sys-tems is their ease of system re-configurability. As for an example, let us consideran analog low pass filter. To convert it to a high pass filter, we will have to removethe components from the circuit and replace them with other appropriate com-ponents. This is a tiresome job if the system is a complex one. On the other

Page 22: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

1.4 Analog and Digital Communication Systems 9

0 2 4 60

0.5

1

t-->

d(t)

-->

Digital data: 10110

0 2 4 60

0.5

1

t-->

n(t)

-->

AWGN Noise

0 2 4 60

1

2

t-->

n(t)

+d(

t)--

>

Noisy d(t) at Rx

0 2 4 6-1

0

1

t-->

v(t)

-->

Analog signal

0 2 4 60

0.5

1

t-->n(

t)--

>

AWGN Noise

0 2 4 6–1

0

1

2

t-->

n(t)

+v(

t)--

>Noisy v(t) at Rx

Fig. 1.6 AWGN attacked digital and analog signal

hand of we want to convert a digital low pass filter into a high pass filter, wecan easily change the digital filter transfer function [H(z)] just by changing somecoefficients (a0, a1, a2 . . . ., b0, b1, b2, . . . .. ).Where

H(z) = a0 + a1z−1 + a2z−2 + . . . ..

b0 + b1z−1 + b2z−2 + . . . ..

Just taking the example of any multimedia audio player, we can get a clearview of the system. When the graphic equalizer is set to a ‘high treble’ preset, theentire system of reconstruction process responds as a highpass filter. Just at thevery next instance if anyone chose to listen ‘high bass’ music, the reconstructionsystem responds like a lowpass filter. It’s done only by dynamically change ofcoefficients values.

4. Aging: Aging signifies growing older of the system. It is obviously less effectivein case of digital systems. In case of analog systems, the output may change aftera few years due to aging of the discrete analog components like diode. As timegoes, the cut-in voltage of the diode increases slowly and unsteadily. This causesfluctuation in the system performance. In digital systems, the system error dueto the problem of aging is totally absent.

Page 23: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

10 1 Preview and Introduction

1.5 Elements of Digital Communication System

The system which specifically deals with digital data and digitally pre-processedsignals is a digital communication system. In the Fig. 1.7, the basic elements of adigital communication system is shown. As we know, objective of transmitting nat-ural information in terms of digital data from one end to another can be achievedby incorporating ADC at the transmitter side and DAC at the receiver side. Here,the message generated by the information source is to be converted to binary bitstream, first. At the time of this conversion, one should try to represent the messagethrough as few binary digits as possible, i.e., an efficient information representa-tion of the source message has been obtained, which results in very low or zeroredundancy. This process of efficiently converting analog or digital message gener-ated from source, into a sequence of binary digits is called as source encoding. Thisprocess includes digital data compression.

Inputtransducer

SourceEncoder

SourceDecoder

ChannelEncoder

Channeldecoder

Digitaldemodulator

Outputtransducer

Information Source

Com

munication

Channel

Digitalmodulator

Recovered Information

Fig. 1.7 Basic elements of a Digital Communication system

The sequence of bits is then passed through the channel encoder. The purposeof channel encoding is to introduce intentional custom redundancy into the infor-mation sequence to overcome the effects of noise encountered in the transmissionchannel at the time of communication. Let’s consider a (trivial) form of channelencoding where each bit of the information sequence is simply repeated by m times.A better encoding (non-trivial) takes k information bits at the time of mapping eachk-bit sequence into a unique n-bit sequence, called a code word[2]. The amount ofredundancy introduced by encoding the data in this manner is measured by the ration/k. the reciprocal of the ratio k/n is called the code rate.

The channel encoded bits are then passed to a digital modulator. Digital modu-lation here signifies assigning an equivalent set of wave forms for channel encodedbinary digits. To understand in brief, we can set S0(t) waveform is transmitted to

Page 24: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

1.6 MATLAB Programs 11

transmit logic 0 and S1(t) waveform is transmitted to transmit logic 1. This techniqueof modulation can also be called as binary modulation.

Communication channel is the physical medium that is used to communicatethe digital modulated/un-modulated signal from transmitter to the receiver end.In wireless communication, free space is considered as the channel. On the otherhand, telephone channels employ a variety of physical media, including wiredtransmission line, optical fiber cables and microwave. The characteristic of the chan-nel is randomly corrupting the transmitted signal in a variety of possible manner,such as additive thermal noise generated by electronic deices, human made noiselike automobile ignition noise, atmospheric noise like lightning discharges due tothunderstorm.

The digital demodulator processes the corrupted digital waveform and gener-ates output bit stream. The bit stream is passed then through the channel decoderto reconstruct correct information after removing the redundant bits from theknowledge of encoding scheme used in the channel encoder end.

To get natural (analog) signal at the output, the last and final stage employedis source decoder. Like channel decoding, source decoder also decodes the inputsignal according to the source encoding scheme applied at the transmitter end.The schemes may be anything out of PCM, Delta Modulation, Adaptive DeltaModulation (ADM), sigma delta modulation (SDM). The performance of the chan-nel decoder-source decoder pair depends upon the statistical prediction of theamount of error introduced per unit time, i.e., bit error rate. The parameter bit errorrate (BER) is highly dependent upon the waveform used at the time of source encod-ing, the modulation scheme applied, etc. When the two extreme end signals (inputanalog signal at the transmitter and recovered analog signal at the receiver) are com-pared, the difference is the measure of the total distortion introduced by the digitalcommunication system.

1.6 MATLAB Programs

1.6.1 Time and Frequency Domain Representation of Signals

% In CD: ch1_1.m

% Time & frequency domain representation of signals

% Output: Fig. 1.3

% Programed by Apurba Das (Aug,’09)

clc;

clear all;

close all;

t=0:.001:5;T=2;f=1/T;

Page 25: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

12 1 Preview and Introduction

phi=pi/4;a=2∗cos(2∗pi∗f∗t+phi);subplot(2,1,1);

plot(t,a);

xlabel(’time-->’);

ylabel(’amplitude-->’);

title(’Waveform’);

f_dom=fft(a);f_dom=fftshift(f_dom);% figure;

subplot(2,1,2);

plot(abs(f_dom));

xlabel(’frequency-->’);

ylabel(’amplitude-->’);

title(’Amplitude Spectrum’);

figure;

f=20;a=a.∗sin(2∗pi∗f∗t);subplot(2,1,1);

plot(t,a);

xlabel(’time-->’);

ylabel(’amplitude-->’);

title(’Waveform’);

f_dom=fft(a);f_dom=fftshift(f_dom);% figure;

subplot(2,1,2);

plot(abs(f_dom));

xlabel(’frequency-->’);

ylabel(’amplitude-->’);

title(’Amplitude Spectrum’);

1.6.2 CTSV, DTCV, DTDV Signals

% In CD: ch1_2.m

% CTCV, DTCV, DTDV signals

% Output: Fig. 1.5

% Programed by Apurba Das (Aug,’09)

clc;

Page 26: For further volumes:  · Apurba Das Digital Communication Principles and System Modelling 123. Apurba Das Scientist, Image Processing Lab CDAC, Kolkata A Scientific Society Ministry

References 13

clear all;

close all;

t=0:.001:5;T=5;f=1/T;a=1.5∗(5∗sin(2∗pi∗f∗t)+sin(7∗pi∗f∗t));%+4∗cos(4∗pi∗t);subplot(3,1,1);

plot(t,a,’k’);

xlabel(’time-->’);

ylabel(’amplitude-->’);

title(’CTCV’);

subplot(3,1,2);

t1=0:.5:5;a1=1.5∗(5∗sin(2∗pi∗f∗t1)+sin(7∗pi∗f∗t1));stem(t1,a1,’k’);

xlabel(’time(nT_S)-->’);

ylabel(’amplitude-->’);

title(’DTCV’);

subplot(3,1,3);

res=20/8; % resolution

[r c]=size(a1);s=zeros(1,9);s(1)=-10;for i=2:9

s(i)=s(i-1)+2.5;end;

for i=1:cfor j=2:9

if (a1(i)<=s(j) & a1(i)>=s(j-1))a2(i)=(s(j-1)+s(j))/2;

end;

end;

end;

stem(t1,a1,’k’);hold on;

stairs(t1,a2,’k--’);

xlabel(’time(nT_S)-->’);

ylabel(’amplitude-->’);

title(’DTDV’);

legend(’Sampled signal’,’Quantized signal’);

References

1. Das, A., “Line Communication System”, New Age International, 20062. Proakis, J.,“Digital Communication”, McGraw-Hill, 2000