Synopsis
The subject of digital communications involves the transmission of
information in digital form from a source that generates the
information to one or more destinations. This course extends the
knowledge gained from ECS332 (Principles of Communications) and ECS315
(Probability and Random Processes). Basic principles that underlie the
analysis and design of digital communication systems are covered. This
semester, the main focus includes performance analysis (symbol error
probability), optimal receivers, and limits (information theoretic quantities).
These topics are challenging but the presented material are carefully
selected to keep the difficulty level appropriate for undergraduate
students.
Announcements
- Information regarding the final exam [Posted @ 4:30PM on May 24; Last updated @ 9:30AM on June 1]
- Check this course website regularly for breaking news about the final.
- Date: June 8, 2017
- TIME: 9:00-12:00
- ROOMs: BKD 3506 & 3507
- 10 pages: 9 + 1 cover page
- To save time, read the cover page posted here before going into the exam room.
- 14+1 questions: 17+4+4+5+9+2+3+6+14+12+12+3+1+7+1
- One A4 sheet allowed.
- Use the returned study sheet from the midterm exam.
- Add more formulas or information on the remaining side (or in the remaining space(s)).
- Basically, you have one whole page for the final exam.
- Q: Can I make a brand new study sheet?
A: No.
However, if you think the old one is in a bad shape (falling apart), you can use a photocopy of your own. (Reduction in size is not allowed though) - Q: What can I do if I lose my study sheet?
A: Dr.Prapun may be able to print out a scanned copy for you. (The writing won’t be as crisp as the original one but it’s better than nothing.) Otherwise, see below. - Q: I think the midterm study sheet (and the thing I wrote on it) is cursed (making me get poor score); I don’t want to see or use anything on it anymore. What can I do?
A: You may bring a brand new sheet for the final exam. However, you can only use one side of it.
- Same rules as the midterm:
- Must be hand-written in your own handwriting.
- No small pieces of paper notes glued/attached on top of it.
- Indicate your name and ID on the upper right corner of the sheet (in portrait orientation).
- Do not modify (,e.g., add/underline/highlight) content on the sheet inside the exam room.
- Submit your A4 sheet with your exam.
- Violating the above instructions will cost you 10 pt.
- Use the returned study sheet from the midterm exam.
- Cover all the materials that we discussed in class and practice in the HWs.
- Material Distribution (score-wise): 41 (SEC5.1) + 23 (SEC5.2) + 27 (CH6) + 1 (CH7) + 7 (CH8)
- For your studying pleasure.... [Posted @ 12AM on May 28]
- All post-midterm annotated notes combined in one pdf file.
- All post-midterm HWs and their solutions
- Checked HWs can be picked up in front of the EC office on the 6th floor.
- All post-midterm exercises and their solutions
- Graded exercises are posted on the SIIT Lecture Note System
- If you have valid reason for missing class on the day that we have exercise, please indicate the date, exercise number, and the reason in the second self-evaluation form. Make sure that you also submit/email supporting document/evidence to Dr.Prapun (if you haven't done so).
- All post-midterm slides
- Midterm results [Posted @ 9AM on Mar 30]
- Information regarding the midterm exam [Posted @ 10AM on Mar 13]
- Check this course website regularly for breaking news about the midterm.
- Date: March 24, 2017
- TIME: 9:00-11:00
- ROOMs: BKD 2506, 2501-2
- Information about the midterm exam:
- 6 pages (including the cover page)
- To save time, read the cover page posted here before going into the exam room.
- 8+1 = 9 questions. (12+8+7+5.5+13+10.5+2+8+1 = 67 pt)
- Cover all the materials that we discussed in class and practice in the HWs.
- Material Distribution (score-wise): 27 (CH2) + 20.5 (CH3) + 18.5 (CH4)
- Closed book. Closed notes.
- (1 pt) One A4 page allowed.
- Must be hand-written in your own handwriting.
- No small pieces of paper notes glued/attached on top of it.
- Indicate your name and ID on the upper right corner of the sheet (in portrait orientation).
- Do not modify (,e.g., add/underline/highlight) content on the sheet inside the exam room.
- Make sure that another side is blank. This will be used for the final exam.
- Submit your A4 sheet with your exam. (You can get it back from me after the midterm is graded.)
- Q: I don't need any formulas. What should I do?
A: Bring in and submit a blank sheet of paper with your name and ID. Note that you can still only use one side on the final exam.
- Violating the above instructions will cost you 10 pt.
- Basic SIIT-approved calculators, e.g,. FX-991MS, are permitted, but borrowing is not allowed.
- For your studying pleasure....
- All pre-midterm annotated notes combined in one pdf file.
- All pre-midterm slides.
- All pre-midterm HWs and their solutions
- Checked HWs can be picked up in front of the EC office on the 6th floor.
- All pre-midterm exercises and their solutions
- Graded exercises are posted on the SIIT Lecture Note System
- If you have valid reason for missing class on the day that we have exercise, please indicate the date, exercise number, and the reason in the self evaluation form. Make sure that you also submit/email supporting document/evidence to me (if you haven't done so).
- This site can be accessed via ecs452.prapun.com
- Welcome to ECS452! Feel free to look around this site.
General Information
- Instructor: Asst. Prof. Dr.Prapun Suksompong (prapun@siit.tu.ac.th)
- Office: BKD, 6th floor of Sirindhralai building
- Office Hours: T 14:20-15:20, W 14:20-15:20, F 9:15-10:15
- Additinally, please feel free to ask any question or express any concern after class.
- Course Syllabus [To be distributed in class]
- Textbooks:
- [P&S] Proakis and Salehi, Digital Communications, 5th Edition, McGraw-Hill, 2007.
- [C&T] Thomas M. Cover, Joy A. Thomas, Elements of Information Theory, Second Edition, Wiley-Interscience, 2006
Handouts and Course Material
- Slides: Course Introduction [Posted @ 9AM on Jan 24]
- Chapter 1: Elements of a Digital Communication System [Posted @ 9AM on Jan 23][Distributed in class on Jan 24]
- Annotated version [Posted @ 2PM on Jan 24]
- Slides [Posted @ 2PM on Jan 24]
- Chapter 2: Source Coding [Posted at 9AM on Jan 23][Distributed in class on Jan 24]
- Annotated version [Posted @ 2PM on Jan 24; Updated @ 2PM on Jan 26, @ 2:30PM on Feb 2, and @ 8PM on Feb 7]
- Exercise 1 Solution [Posted on Feb 7, 2017]
- Exercise 2 Solution [Posted on Feb 7, 2017]
- MATLAB: Huffman_Demo_Ex1.m, Huffman_Demo_Ex2.m
- Slides [Posted @2PM on Jan 26; Updated @10AM on Feb 14]
- Chapter 3: An Introduction to Digital Communication Systems Over DMC [Posted @ 9AM on Feb 2; Updated @ 8:30AM on Feb 7 and @ 11:30AM on Feb 20]
- Annotated version for Sections 3.1 and 3.2 [Posted @ 6PM on Feb 9; Updated @ 11:20PM on Feb 14 and @ 4PM on Feb 16]
- Annotated version for Section 3.3 [Posted @ 4PM on Feb 16; Updated @ 4PM on Feb 21]
- Annotated version for Sections 3.4-3.5 [Posted @ 4PM on Feb 21; Updated @ 4:30PM on Mar 2]
- Exercise 3 Solution [Posted @ 4:30PM on Feb 23 Updated @ 1PM on Mar 8]
- Exercise 4 Solution [Posted @ 4PM on Feb 16]
- Exercise 5 Solution [Posted @ 4PM on Feb 16]
- Slides [Posted @ 4PM on Feb 21]
- MATLAB: BSC_demo.m, BAC_demo.m, DMC_demo.m, DMC_Analysis_demo.m, DMC_Channel_sim.m, BSC_decoder_ALL_demo.m,DMC_decoder_DIY_demo.m, DMC_decoder_ALL_demo.m, DMC_decoder_MAP_demo.m, DMC_decoder_ML_demo.m
- Section 4: Mutual Information and Channel Capacity [Posted @ 11:30AM on Feb 20; Updated @ 5:30PM on Mar 1 and @ 10:30AM on Mar 7]
- Annotated version for Section 4.1 [Posted @ 4:30PM on Mar 2; Updated @ 2:30PM on Mar 7]
- Annotated version for Sections 4.2-4.5 [Posted @ 3:30PM on Mar 9; Updated @ 11AM on Mar 16]
- Exercise 6 Solution [Posted @ 12:30AM on Mar 11]
- Exercise 7 Solution [Posted @ 12:30AM on Mar 11]
- Exercise 8 Solution [Posted @ 11AM on Mar 16]
- Slides [Posted @ 3:30PM on Mar 9]
- MATLAB: capacity_blahut.m
- Section 5: Channel Coding
- Section 5.1: Linear block codes and Hamming Codes [Posted @ 9:30PM on Mar 27; Updated @ 9AM on Mar 30 and @ 2PM on Apr 18]
- Annotated version (part A) [Posted @ 10AM on Mar 29; Updated @ 2PM on Apr 4]
- Annotated version (part B) [Posted @ 2PM on Apr 4; Updated @ 2PM on Apr 18 and @1:30PM on Apr 20]
- Annotated version (part C) [Posted @ 2PM on Apr 18]
- Exercise 9 Solution [Posted @ 9:30PM on Apr 27]
- Exercise 10 Solution [Posted @ 9:30PM on Apr 27]
- Exercise 11 Solution [Posted @ 9:30PM on Apr 27]
- Exercise 12 Solution [Posted @ 9:30PM on Apr 27]
- Section 5.2: Binary Convolutional Code [Posted @ 2PM on Apr 18; Updated @ 10PM on Apr 19 and @6PM on Apr 24]
- Annotated version (part A) [Posted @1:30PM on Apr 20; Updated @ 1:30PM on Apr 25]
- Annotated version (part B) [Posted @1:30PM on Apr 25; Updated @ 9:30PM on Apr 27]
- Exercise 13 Solution [Posted @ 9:30PM on Apr 27]
- Exercise 14 Solution [Posted @ 9:30AM on May 22]
- Section 6: Digital Modulation
- Section 6.1 Introduction to Digital Modulation [Posted @ 6PM on Apr 24]
- Annotated version [Posted @ 9:30PM on Apr 27; Updated @ 9AM on May 5]
- Section 6.2 Vector Space and Inner Product Space [Posted @ 9AM on May 1]
- Annotated version [Posted @ 9AM on May 5]
- Exercise 15 Solution [Posted @ 9:30AM on May 22]
- Section 6.3 Signal Space [Posted @ 9AM on May 5]
- Annotated version [Posted @ 9AM on May 5; Updated @ 9AM on May 11]
- Exercise 16 Solution [Posted @ 9:30AM on May 22]
- Section 6.4 Constellations
- Annotated version [Posted @ 9AM on May 11; Updated @ 10AM on May 15 and @ 1:30PM on May 16]
- Slides [Posted @ 9:30AM on May 18]
- Section 7: The Waveform Channel [Posted @ 10AM on May 11]
- Annotated version [Posted @ 1:30PM on May 16; Updated @ 10AM on May 22]
- Slides [Posted @ 9:30AM on May 18]
- Exercise 17 Solution [Posted @ 9:30AM on May 22]
- Section 8: Optimal Detection for Additive Noise Channels: 1-D Case [Posted @ 9AM on May 23]
- Annotated version [Posted @ 10AM on May 22; Updated @ 4PM on May 23]
- Exercise 18 Solution [Posted @ 2PM on May 27]
- Slides [Posted @ 2:30PM on May 27]
Problem Set
Due Date | Remarks/Solutions | |
HW1 | Feb 9, 4:30PM | |
HW2 | Feb 21, 4:30PM | |
HW3 | Mar 2, 4:30PM | |
HW4 | Mar 14, 4:30PM | Solution |
HW5 | Not Due | Solution |
Self-Evaluation Form (1) | Mar 24 | |
HW6 | Apr 25, 4:30PM | Solution |
HW7 | May 2, 4:30PM | Solution |
HW8 | May 16, 4:30PM | Solution |
HW9 | May 23, 4:30PM | Solution |
HW10 | Not Due | Solution |
Self-Evaluation Form (2) | June 8 |
Calendar
Reading Assignment
Additional References
- [G] Robert G. Gallagher, Principles of Digital Communications, Cambridge University Press, 2008.
- [S] Bernard Sklar, Digital communications: fundamentals and applications, Prentice Hall, 2001. Call No: TK5103.7 S55 2001.
- [N&S] Ha H. Nguyen and Ed Shwedyk, A first course in digital communications, Cambridge University Press, 2009. Call No: TK5103.7 N49 2009
- [Z&T] Rodger E. Ziemer and William H. Tranter, Principles of Communications, 6th International student edition, John Wiley & Sons Ltd, 2010.
- Call No. QA273 Y384 2005. ISBN: 978-0-471-27214-4
- Student Companion Site
- [L&D] B.P. Lathi and Zhi Ding, Modern Digital and Analog Communication Systems, 4th Edition, Oxford: Oxford University Press, 2009. Call No. TK5101 L333 2009
- J. G. Proakis and M. Salehi, Communication Systems Engineering, 2nd Edition, Prentice Hall, 2002. ISBN: 0-13-095007-6
- S.S. Haykin, Communication Systems, 4th Edition, John Wiley & Sons, 2001. Call Number: TK5101 H38 2001.
- [J&S] C. R. J. Jr, W. A. Sethares, and A. G. Klein, Software Receiver Design: Build Your Own Digital Communication System in Five Easy Steps, 1st ed. Cambridge University Press, 2011.
- [J&S] C.R. Johnson and W.A. Sethares, Telecommunications Breakdown: Concepts of Communication Transmitted via Software-Defined Radio, Prentice Hall, 2003.
- P. Suksompong, ECS332: Principles of Communications
- MATLAB Primer, 8th edition T. A. Davis. CRC Press, 2010.
- MIT RES.6.007 Signals and Systems (1987) on Youtube
Misc. Links
- Information Theory Basics (Free sample chapter from the textbook "Information Theory Tools for Image Processing" by Miquel Feixas, Anton Bardera, Jaume Rigau, Qing Xu, and Mateu Sbert.
- Article: IEEE 802.11ac—Wi-Fi for the Mobile and Video Generation
- C.E. Shannon
- Paper: C.E. Shannon, "A Mathematical Theory of Communication", Bell System Technical Journal, vol. 27, pp. 379–423, 623-656, July, October, 1948
- Video: Claude Shannon - Father of the Information Age
- The Significance of Shannon's Work by Aaron Wyner
- Paper: Sergio Verdü (2000). "Fifty years of Shannon theory"
- Video: Demo from MIT (1987) showing introduction to function generator, spectrum analyzer (with sampling and FFT), spectrum of square and triangular signals, time and frequency scaling, spectrum of speech, and amplitude modulation.
- Article: Articles about source coding: PC World article, US Patent 5,533,051, the comp.compression FAQ.
- Article: Jim Giles, Traffic jam: the coming cellphone crunch, New Scientist, November, 2010
- 20 Questions
- Twenty Questions online game
- Twenty Questions (1949): Players were allowed to ask up to twenty questions about a mystery object in their quest to identify it.
- A Brief History of Communications: IEEE Communications Society - a fifty-year foundation for the future
- ประวัติย่อ "การสื่อสารโลก": ห้าสิบปีชมรมไฟฟ้าสื่อสาร--รากฐานสู่อนาคต
- Thai Telecommunications Encyclopedia (สารานุกรม โทรคมนาคมไทย)
- IEEE Thailand Section
- Google Calculator (Cheat Sheet)
- Learn the Greek Alphabet in less than 10 minutes
- The Greek Alphabet Song