EES 452: Digital Communication Systems

Synopsis

The subject of digital communications involves the transmission of information in digital form from a source that generates the information to one or more destinations. This course extends the knowledge gained from EES351 (Principles of Communications) and EES315 (Probability and Random Processes). Basic principles that underlie the analysis and design of digital communication systems are covered. This semester, the main focus includes performance analysis (symbol error probability), optimal receivers, and limits (information theoretic quantities). These topics are challenging but the presented material are carefully selected to keep the difficulty level appropriate for undergraduate students.

Announcements

• Our first meeting will be a live session in Google Meet at 10:40am on Jan 21.
  • The meeting link is given in Google Classroom.
• Main materials are posted in Google Classroom.
  • Log in with your "@g.siit.tu.ac.th" email account to access the site.
• Welcome to EES452! Feel free to look around this site.
• Materials for the midterm:
  • All pre-midterm annotated notes combined in one pdf file.
  • All pre-midterm slides.
  • Additional examples and their solutions
  • In-Class Exercises
    • All pre-midterm exercises and their solutions from 2019
    • All pre-midterm exercises and their solutions from 2018
    • All pre-midterm exercises and their solutions from 2017
    • All pre-midterm exercises and their solutions from 2016
  • Sample Exams
    • 2017 Midterm Exam
    • 2016 Midterm Exam

General Information

• Instructor: Asst. Prof. Dr.Prapun Suksompong (prapun@siit.tu.ac.th)
• Office Hours: See Google calendar below. (Or visit oh.prapun.com)
• Lectures: See Google calendar below.
• Course Syllabus
• Textbooks:
• [P&S] Proakis and Salehi, Digital Communications, 5th Edition, McGraw-Hill, 2007.
• [C&T] Thomas M. Cover and Joy A. Thomas, Elements of Information Theory, Second Edition, Wiley-Interscience, 2006

Handouts and Course Material

• Slides: Course Introduction
• Chapter 1: Elements of a Digital Communication System
• Annotated version [Posted @ 4PM on April 7]
• Slides [Posted @ 4PM on April 7]
• Reference: [P&S] Section 1.1
• Additional References:
  • C.E. Shannon
    • Paper: C.E. Shannon, "A Mathematical Theory of Communication", Bell System Technical Journal, vol. 27, pp. 379–423, 623-656, July, October, 1948
    • Video: Claude Shannon - Father of the Information Age
    • Article: The Significance of Shannon's Work by Aaron Wyner
    • Article: Claude Shannon Was A Genius On Par With Einstein And Turing. Why Isn't He As Famous?
    • Article: A Man in a Hurry: Claude Shannon’s New York Years
    • Shannon and his colleagues.
    • Article: E. O. Thorp, "The invention of the first wearable computer," Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215), Pittsburgh, PA, USA, 1998, pp. 4-8.
    • Shannon met Thorp at M.I.T. and worked together to build the first wearable computer that was used to beat roulette in Las Vegas.
• Chapter 2: Source Coding [Posted @ 4PM on April 7]
• Annotated version for Section 2.1 [Posted @ 4PM on April 7]
• Annotated version for Section 2.2 [Posted @ 4PM on April 7]
• Annotated version for Section 2.3 [Posted @ 4PM on April 7]
• Annotated version for Section 2.4 [Posted @ 4PM on April 7]
• Slides for Section 2.1 [Posted @ 4PM on April 7]
• Slidesfor Section 2.2 [Posted @ 4PM on April 7]
• Slidesfor Section 2.3 [Posted @ 4PM on April 7]
• Slidesfor Section 2.4 [Posted @ 4PM on April 7]
• MATLAB: Huffman_Demo_Ex1.m, Huffman_Demo_Ex2.m, entropy2.m
• References:
  • Chapters 2 and 5 in Cover and Thomas [C&T]
  • Section 16.1 in Carlson and Crilly [C&C]
    
  • Chapter 14 in Johnson, Sethares, and Klein [J&S]
    
  • Section 11.2 in Ziemer and Tranter [Z&T]
• Additional References:
  • Article: Without Claude Shannon's information theory there would have been no internet
  • David A. Huffman
    • Article: Encoding the “Neatness” of Ones and Zeroes from the September 1991 issue of Scientific American, pp. 54, 58.
  • 20 Questions
    • Twenty Questions online game
    • Twenty Questions (1949): Players were allowed to ask up to twenty questions about a mystery object in their quest to identify it.
      • Video: 20 Questions game show from the 1950's
• Chapter 3: An Introduction to Digital Communication Systems Over DMC [Posted @ 4PM on April 7]
• Annotated version for Section 3.1 [Posted @ 4PM on April 7]
• Slides for Section 3.1 [Posted @ 4PM on April 7]
• Annotated version for Section 3.2 [Posted @ 4PM on April 7]
• Slides for Section 3.2 [Posted @ 4PM on April 7]
• Annotated version for Section 3.3 [Posted @ 4PM on April 7]
• Slides for Section 3.3 [Posted @ 4PM on April 7]
• Annotated version for Section 3.4 [Posted @ 4PM on April 7]
• Slides for Section 3.4 [Posted @ 4PM on April 7]
• Annotated version for Section 3.5 [Posted @ 4PM on April 7]
• Slides for Section 3.5 [Posted @ 4PM on April 7]
• MATLAB: BSC_demo.m, BAC_demo.m, DMC_demo.m, DMC_Analysis_demo.m, DMC_Channel_sim.m, BSC_decoder_ALL_demo.m,DMC_decoder_DIY_demo.m, DMC_decoder_ALL_demo.m, DMC_decoder_MAP_demo.m, DMC_decoder_ML_demo.m
• MATLAB: PE_minDist.m, PE_minDist_demo1.m, PE_minDist_demo2.m
  • TXT: PE_minDist.txt, PE_minDist_demo1.txt, PE_minDist_demo2.txt
• Chapter 4: Mutual Information and Channel Capacity [Posted @ 4PM on April 7]
• Annotated version for Section 4.1 [Posted @ 4PM on April 7]
• Slides for Section 4.1 [Posted @ 4PM on April 7]
• Annotated version for Section 4.2 [Posted @ 4PM on April 7]
• Slides for Section 4.2 [Posted @ 4PM on April 7]
• Annotated version for Section 4.3 [Posted @ 4PM on April 7]
• Slides for Section 4.3 [Posted @ 4PM on April 7]
• Annotated version for Section 4.4 [Posted @ 4PM on April 7]
• Slides for Section 4.4 [Posted @ 4PM on April 7]
• Annotated version for Section 4.5 [Posted @ 4PM on April 7]
• MATLAB: capacity_blahut.m
• References:
  • Chapters 2, 7, and 8 in Cover and Thomas [C&T]
• Chapter 5: Channel Coding
  • Section 5.1A Part I [Posted @ 4PM on April 7]
  • Annotated version forSection 5.1A Part I
  • Section 5.1A Part II [Posted @ 4PM on April 7]
  • Annotated version for Section 5.1A Part II
  • Section 5.1B
  • Annotated version forSection 5.1B
• Chapters 6 and 7: Waveform Channel and The Conversion to Vector Channel
  • Annotated version for Chapters 6 and 7
• Chapter 8: Optimal Detection for Additive Noise Channels
  • Annotated version for Chapter 8

Calendar

Reading Assignment

Additional References

• [G] Robert G. Gallagher, Principles of Digital Communications, Cambridge University Press, 2008.
• 6.450 Principles of Digital Communications I Fall 2006
• [S] Bernard Sklar, Digital communications: fundamentals and applications, Prentice Hall, 2001. Call No: TK5103.7 S55 2001.
• [N&S] Ha H. Nguyen and Ed Shwedyk, A first course in digital communications, Cambridge University Press, 2009. Call No: TK5103.7 N49 2009
• [Z&T] Rodger E. Ziemer and William H. Tranter, Principles of Communications, 6th International student edition, John Wiley & Sons Ltd, 2010.
• Call No. QA273 Y384 2005. ISBN: 978-0-471-27214-4
• Student Companion Site
• [L&D] B.P. Lathi and Zhi Ding, Modern Digital and Analog Communication Systems, 4th Edition, Oxford: Oxford University Press, 2009. Call No. TK5101 L333 2009
• [C&C] A. Bruce Carlson and Paul B. Crilly, Communication Systems: An Introduction to Signals and Noise in Electrical Communication, McGraw-Hill, 2010, 5th International edition.
  • Call No. TK5102.5 C3 2010. ISBN: 978-007-126332-0.
  • Companion Site
• J. G. Proakis and M. Salehi, Communication Systems Engineering, 2nd Edition, Prentice Hall, 2002. ISBN: 0-13-095007-6
• S.S. Haykin, Communication Systems, 4th Edition, John Wiley & Sons, 2001. Call Number: TK5101 H38 2001.
• [J&S] C. R. J. Jr, W. A. Sethares, and A. G. Klein, Software Receiver Design: Build Your Own Digital Communication System in Five Easy Steps, 1st ed. Cambridge University Press, 2011.
  
• [J&S] C.R. Johnson and W.A. Sethares, Telecommunications Breakdown: Concepts of Communication Transmitted via Software-Defined Radio, Prentice Hall, 2003.
• P. Suksompong, ECS332: Principles of Communications
• MATLAB Primer, 8th edition T. A. Davis. CRC Press, 2010.
• MIT RES.6.007 Signals and Systems (1987) on Youtube

Misc. Links

• Information Theory Basics (Free sample chapter from the textbook "Information Theory Tools for Image Processing" by Miquel Feixas, Anton Bardera, Jaume Rigau, Qing Xu, and Mateu Sbert.
• Article: IEEE 802.11ac—Wi-Fi for the Mobile and Video Generation
  
• Paper: Sergio Verdü (2000). "Fifty years of Shannon theory"
• Video: Demo from MIT (1987) showing introduction to function generator, spectrum analyzer (with sampling and FFT), spectrum of square and triangular signals, time and frequency scaling, spectrum of speech, and amplitude modulation.
• Article: Jim Giles, Traffic jam: the coming cellphone crunch, New Scientist, November, 2010
• A Brief History of Communications: IEEE Communications Society - a fifty-year foundation for the future
  • ประวัติย่อ "การสื่อสารโลก": ห้าสิบปีชมรมไฟฟ้าสื่อสาร--รากฐานสู่อนาคต
• Thai Telecommunications Encyclopedia (สารานุกรม โทรคมนาคมไทย)
• IEEE Thailand Section
• Google Calculator (Cheat Sheet)
• Learn the Greek Alphabet in less than 10 minutes
• The Greek Alphabet Song