ECS 452: Digital Communication Systems

Synopsis

The subject of digital communications involves the transmission of information in digital form from a source that generates the information to one or more destinations. This course extends the knowledge gained from ECS332 (Principles of Communications) and ECS315 (Probability and Random Processes). Basic principles that underlie the analysis and design of digital communication systems are covered. This semester, the main focus includes performance analysis (symbol error probability), optimal receivers, and limits (information theoretic quantities). These topics are challenging but the presented material are carefully selected to keep the difficulty level appropriate for undergraduate students.

Announcements

• Information regarding the final exam [Posted @ 10AM on May 17; Updated @ 11AM on May 24]
• Check this course website regularly for breaking news about the final.
• Date: May 31, 2018
  
• TIME: 9:00-12:00
  
• ROOMs: BKD 3507 & 3510
• 11 pages: 10 + 1 cover page
• To save time, read the cover page posted here before going into the exam room.
• 15+1 questions: 14+6+6+2+2+6+1+7+1+15+10+8+8+7.5+5.5+1
• One A4 sheet allowed.
  • Use the returned study sheet from the midterm exam.
    
  • Add more formulas or information on the remaining side (or in the remaining space(s)).
    
    • Basically, you have one whole page for the final exam.
    • Q: Can I make a brand new study sheet?
      A: No.
      However, if you think the old one is in a bad shape (falling apart), you can use a photocopy of your own. (Reduction in size is not allowed though)
    • Q: What can I do if I lose my study sheet?
      A: Dr.Prapun may be able to print out a scanned copy for you. (The writing won’t be as crisp as the original one but it’s better than nothing.) Otherwise, see below.
    • Q: I think the midterm study sheet (and the thing I wrote on it) is cursed (making me get poor score); I don’t want to see or use anything on it anymore. What can I do?
      A: You may bring a brand new sheet for the final exam. However, you can only use one side of it.
  • Same rules as the midterm:
    • Must be hand-written in your own handwriting.
    • No small pieces of paper notes glued/attached on top of it.
    • Indicate your name and ID on the upper right corner of the sheet (in portrait orientation).
    • Do not modify (,e.g., add/underline/highlight) content on the sheet inside the exam room.
    • Submit your A4 sheet with your exam.
  • Violating the above instructions will cost you 10 pt.
• Cover all the materials that we discussed in class and practice in the HWs.
• Material Distribution (score-wise):
  37 (SEC5.1) + 22 (SEC5.2) + 29.5 (CH6) + 1 (CH7) + 9.5 (CH8)
• For your studying pleasure....
• All post-midterm annotated notes combined in one pdf file [Updated @ 4:30PM on May 22]
• All post-midterm exercises and their solutions [Updated @ 4PM on May 28]
• The original file without the solution. [Posted @ 4PM on May 28]
• All post-midterm slides [Updated @ 4:30PM on May 22]
• All post-midterm HWs and their solutions
• Additional practice problems [Posted @ 10AM on May 17]
• Solution [Posted @ 10AM on May 17]
• Midterm announcement [Posted @ 4:30PM on Mar 20]
• Information regarding the midterm exam [Posted @ 2:30PM on Mar 6]
  • Check this course website regularly for breaking news about the midterm.
  • Date: March 16, 2017
    
  • TIME: 9:00-11:00
    
  • ROOMs: BKD 2506, 2401
  • Slides
  • Information about the midterm exam:
  • 8 pages (including the cover page)
  • To save time, read the cover page posted here before going into the exam room.
  • 9+1 = 10 questions. (10+3+10+7+13+3+9+4+7+1 = 67 pt)
  • Cover all the materials that we discussed in class and practice in the HWs.
  • Material Distribution (score-wise): 30 (CH2) + 20 (CH3) + 16 (CH4)
  • Closed book. Closed notes.
  • (1 pt) One A4 page allowed.
    • Must be hand-written in your own handwriting.
    • No extra pieces of paper notes glued/attached on top of it.
    • Indicate your name and ID on the upper right corner of the sheet (in portrait orientation).
    • Do not modify (,e.g., add/underline/highlight) content on the sheet inside the exam room.
    • Make sure that another side is blank. This will be used for the final exam.
    • Submit your A4 sheet with your exam. (You can get it back from me after the midterm is graded.)
    • Q: I don't need any formulas. What should I do?
      A: Bring in and submit a blank sheet of paper with your name and ID. Note that you can still only use one side on the final exam.
      
    • Violating the above instructions will cost you 10 pt.
  • Basic SIIT-approved calculators, e.g,. FX-991MS, are permitted, but borrowing is not allowed.
  • For your studying pleasure....
  • All pre-midterm annotated notes combined in one pdf file.
  • Additional examples [Posted @ 6PM on Mar 9]
  • All pre-midterm slides.
  • All pre-midterm HWs and their solutions
    • Checked HWs can be picked up in front of the EC office on the 6th floor.
  • All pre-midterm exercises and their solutions
  • Graded exercises are posted on the SIIT Lecture Note System
  • If you have valid reason for missing class on the day that we have exercise, please indicate the date, exercise number, and the reason in the self evaluation form. Make sure that you also submit/email supporting document/evidence to me (if you haven't done so).
  • All pre-midterm exercises and their solutionsfrom 2016
  • Sample Exam
  • 2016 Midterm Exam
• We also have a Line group [QR code].
• This site can be accessed via ecs452.prapun.com
• Welcome to ECS452! Feel free to look around this site.

General Information

• Instructor: Asst. Prof. Dr.Prapun Suksompong (prapun@siit.tu.ac.th)
  • Office: BKD, 6th floor of Sirindhralai building
• Office Hours: See Google calendar below. (Or visit oh.prapun.com)
• Lectures: See Google calendar below.
• Course Syllabus [Distributed in class]
• Textbooks:
• [P&S] Proakis and Salehi, Digital Communications, 5th Edition, McGraw-Hill, 2007.
• [C&T] Thomas M. Cover, Joy A. Thomas, Elements of Information Theory, Second Edition, Wiley-Interscience, 2006

Handouts and Course Material

• Slides: Course Introduction [Posted @ 10PM on Jan 7]
• Full version [Posted @ 3:30PM on Jan 9]
• Chapter 1: Elements of a Digital Communication System [Posted @ 10PM on Jan 7]
• Annotated version [Posted @ 3:30PM on Jan 9; Updated @ 3PM on Jan 12]
• Slides [Posted @ 3:30PM on Jan 9]
• Chapter 2: Source Coding [Posted @ 10PM on Jan 7]
• Annotated version [Posted @ 3PM on Jan 12; Updated @ 10PM on Jan 16, @ 9PM on Jan 19, and @ 3PM on Feb 6]
• Slides [Posted @ 3PM on Jan 12; Updated @ 10PM on Jan 16, @ 9PM on Jan 19, and @ 9AM n Feb 12]
• Exercise 1 Solution [Posted @ 10PM on Jan 16]
• Exercise 2 Solution [Posted @ 10PM on Jan 16]
• Exercise 3 Solution [Posted @ 3PM on Feb 6]
• Exercise 4 Solution [Posted @ 10:30AM on Feb 12]
• MATLAB: Huffman_Demo_Ex1.m, Huffman_Demo_Ex2.m, entropy2.m
• Chapter 3: An Introduction to Digital Communication Systems Over DMC
• Section 3.1 [Posted @ 9:30AM on Feb 5]
• Annotated version [Posted @ 10AM on Feb 10]
• Exercise 5 Solution [Posted @ 10:30AM on Feb 12]
• Section 3.2 [Posted @ 9:30AM on Feb 5]
• Annotated version [Posted @ 2:30PM on Feb 13]
• Exercise 6 Solution [Posted @ 10PM on Feb 19]
• Section 3.3 [Posted @ 9:30AM on Feb 12]
• Annotated version [Posted @ 2:30PM on Feb 16]
• Printed version [Posted @ 2PM on Mar 6]
• This is for those who have troble viewing the annotations on mobile device.
• Exercise 7 Solution [Posted @ 10PM on Feb 19]
• Section 3.4-3.5 [Posted @ 9:30AM on Feb 12]
• Annotated version [Posted @ 4:30PM on Feb 20]
• Printed version [Posted @ 2PM on Mar 6]
• MATLAB: BSC_demo.m, BAC_demo.m, DMC_demo.m, DMC_Analysis_demo.m, DMC_Channel_sim.m, BSC_decoder_ALL_demo.m,DMC_decoder_DIY_demo.m, DMC_decoder_ALL_demo.m, DMC_decoder_MAP_demo.m, DMC_decoder_ML_demo.m
• Slides [Posted @ 2:30PM on Feb 16; Updated @ 10:30AM on Feb 27]
• Additional examples [Posted @ 6PM on Mar 9]
• Chapter 4: Mutual Information and Channel Capacity [Posted @ 9AM on Feb 19]
• Annotated version [Posted @ 4PM on Feb 23; Updated @ 6PM on Feb 27, @ 10:30PM on Mar 2, @ 3:30PM on Mar 6, and @ 5:30PM on Mar 9]
• Exercise 8 Solution [Posted @ 10AM on Feb 27]
• Exercise 9 Solution [Posted @ 6PM on Feb 27]
• Exercise 10 Solution [Posted @ 3:30PM on Mar 6]
• MATLAB: capacity_blahut.m
• Slides [Posted @ 10:30PM on Mar 2]
• Chapter 5: Channel Coding
• Section 5.1 [Posted @ 9AM on Mar 19]
• 1x2 and 2x2 versions [Posted @ 9AM on Mar 19]
• Annotated version (first half) [Posted @ 4:30PM on Mar 20; Updated @ 5PM on Mar 20, @ 4:30PM on Mar 23, and @ 4PM on Mar 30]
• Annotated version (second half) [Posted @ 4PM on Mar 30; Updated @ 4PM on Apr 3 and @ 3PM on Apr 10]
• Exercise 11 Solution [Posted @ 10AM on Mar 22]
• Exercise 12.1 Solution [Posted @ 4PM on Mar 30]
• Exercise 12.2 Solution [Posted @ 4PM on Mar 30]
• Exercise 13 Solution [Posted @ 4PM on Apr 3]
• Exercise 14 Solution [Posted @ 3PM on Apr 10]
• Additional Examples [Posted @ 10:20PM on Mar 22]
• Annotated version [Posted @ 4:30PM on Mar 23]
• Summary Slides [Posted @ 4PM on Apr 3; Updated @ 3PM on Apr 10]
• References
• [L&D] Chapter 15 p. 907-918
  
• [C&C] Chapter 13 p. 591-597, 604-611
  
• [C&T] Section 7.11 p. 210-215
• Sklar and F. J. Harris, “The ABCs of linear block codes”, IEEE Signal Process. Mag., 21(4), (2004).
• p. 14–24
• Also posted in the SIIT Lecture Note System
  
  
• Section 5.2 [Posted @ 4PM on Mar 27]
• 1x2 and 2x2 versions [Posted @ 4PM on Mar 27]
• Annotated version (first half) [Posted @ 11AM on Apr 19; Updated @ 5PM on Apr 20]
• Updated second half [Posted @ 2PM on Apr 25]
• Exercise 15 Solution [Posted @ 8AM on Apr 24]
• Exercise 16 Solution [Posted @ 4PM on May 2]
• References
• [L&D] Section 15.6 p. 932-941
  
• [C&C] Section 13.3 p. 617-637
  
• Chapter 6: Digital Modulation [Posted @ 9:30AM on Apr 23]
• Annotated version for Section 6.1 [Posted @ 10AM on Apr 26; Updated @ 4PM on Apr 27]
• Annotated version for Section 6.2 [Posted @ 4PM on Apr 27; Updated @ 9PM on May 3]
• Annotated version for Section 6.3 [Posted @ 9PM on May 3; Updated @ 4PM on May 4 and @ 7PM on May 8]
• Annotated version for Section 6.4 [Posted @ 4PM on May 4; Updated @ 7PM on May 8]
• Slides [Posted @ 5:30PM on May 18]
• Exercise 17 Solution [Posted @ 11AM on May 2]
• Exercise 18 Solution [Posted @ 9AM on May 2]
• Additional parts (with solution) [Posted @ 4PM on May 4]
• The annotated version shown in class [Posted @ 7PM on May 8]
• Chapter 7: The Waveform Channel [Posted @ 9AM on May 3]
• Annotated version [Posted @ 9PM on May 14]
• Slides [Posted @ 5:30PM on May 18]
• Exercise 19 Solution [Posted @ 12PM on May 17]
• Chapter 8: Optimal Detection for Additive Noise Channels [Posted @ 11AM on May 10]
• Annotated version [Posted @ 9PM on May 14; Updated @ 5PM on May 18]
• Slides [Posted @ 5:30PM on May 18]
• Exercise 20 Solution [Posted @ 12PM on May 17]

Problem Set

Calendar

Reading Assignment

Additional References

• [G] Robert G. Gallagher, Principles of Digital Communications, Cambridge University Press, 2008.
• 6.450 Principles of Digital Communications I Fall 2006
• [S] Bernard Sklar, Digital communications: fundamentals and applications, Prentice Hall, 2001. Call No: TK5103.7 S55 2001.
• [N&S] Ha H. Nguyen and Ed Shwedyk, A first course in digital communications, Cambridge University Press, 2009. Call No: TK5103.7 N49 2009
• [Z&T] Rodger E. Ziemer and William H. Tranter, Principles of Communications, 6th International student edition, John Wiley & Sons Ltd, 2010.
• Call No. QA273 Y384 2005. ISBN: 978-0-471-27214-4
• Student Companion Site
• [L&D] B.P. Lathi and Zhi Ding, Modern Digital and Analog Communication Systems, 4th Edition, Oxford: Oxford University Press, 2009. Call No. TK5101 L333 2009
• [C&C] A. Bruce Carlson and Paul B. Crilly, Communication Systems: An Introduction to Signals and Noise in Electrical Communication, McGraw-Hill, 2010, 5th International edition.
  • Call No. TK5102.5 C3 2010. ISBN: 978-007-126332-0.
  • Companion Site
• J. G. Proakis and M. Salehi, Communication Systems Engineering, 2nd Edition, Prentice Hall, 2002. ISBN: 0-13-095007-6
• S.S. Haykin, Communication Systems, 4th Edition, John Wiley & Sons, 2001. Call Number: TK5101 H38 2001.
• [J&S] C. R. J. Jr, W. A. Sethares, and A. G. Klein, Software Receiver Design: Build Your Own Digital Communication System in Five Easy Steps, 1st ed. Cambridge University Press, 2011.
  
• [J&S] C.R. Johnson and W.A. Sethares, Telecommunications Breakdown: Concepts of Communication Transmitted via Software-Defined Radio, Prentice Hall, 2003.
• P. Suksompong, ECS332: Principles of Communications
• MATLAB Primer, 8th edition T. A. Davis. CRC Press, 2010.
• MIT RES.6.007 Signals and Systems (1987) on Youtube

Misc. Links

• Information Theory Basics (Free sample chapter from the textbook "Information Theory Tools for Image Processing" by Miquel Feixas, Anton Bardera, Jaume Rigau, Qing Xu, and Mateu Sbert.
• Article: IEEE 802.11ac—Wi-Fi for the Mobile and Video Generation
  
• C.E. Shannon
  • Paper: C.E. Shannon, "A Mathematical Theory of Communication", Bell System Technical Journal, vol. 27, pp. 379–423, 623-656, July, October, 1948
  • Video: Claude Shannon - Father of the Information Age
  • The Significance of Shannon's Work by Aaron Wyner
• Paper: Sergio Verdü (2000). "Fifty years of Shannon theory"
• Video: Demo from MIT (1987) showing introduction to function generator, spectrum analyzer (with sampling and FFT), spectrum of square and triangular signals, time and frequency scaling, spectrum of speech, and amplitude modulation.
• Article: Articles about source coding: PC World article, US Patent 5,533,051, the comp.compression FAQ.
• Article: Jim Giles, Traffic jam: the coming cellphone crunch, New Scientist, November, 2010
• 20 Questions
  • Twenty Questions online game
  • Twenty Questions (1949): Players were allowed to ask up to twenty questions about a mystery object in their quest to identify it.
    • Video: 20 Questions game show from the 1950's
• A Brief History of Communications: IEEE Communications Society - a fifty-year foundation for the future
  • ประวัติย่อ "การสื่อสารโลก": ห้าสิบปีชมรมไฟฟ้าสื่อสาร--รากฐานสู่อนาคต
• Thai Telecommunications Encyclopedia (สารานุกรม โทรคมนาคมไทย)
• IEEE Thailand Section
• Google Calculator (Cheat Sheet)
• Learn the Greek Alphabet in less than 10 minutes
• The Greek Alphabet Song