Synopsis
The subject of digital communications involves the transmission of
information in digital form from a source that generates the
information to one or more destinations. This course extends the
knowledge gained from ECS332 (Principles of Communications) and ECS315
(Probability and Random Processes). Basic principles that underlie the
analysis and design of digital communication systems are covered. This
semester, the main focus includes performance analysis (symbol error
probability), optimal receivers, and limits (information theoretic quantities).
These topics are challenging but the presented material are carefully
selected to keep the difficulty level appropriate for undergraduate
students.
Announcements
- Information regarding the final exam [Posted @ 1:30PM on May 9; Updated @ 12:30PM on May 18]
- Check this course website regularly for breaking news about the final.
- Date: May 24, 2019
- TIME: 9:00-12:00
- ROOMs: BKD 2501-2, 2506, and 2605
- 12 pages: 11 + 1 cover page
- To save time, read the cover page posted here before going into the exam room.
- 16+1 questions: 5+14+5+4+3+2+6+1+6+2+15+11+8+6+6+5+1
- One A4 sheet allowed.
- Use the returned study sheet from the midterm exam.
- Add more formulas or information on the remaining side (or in the remaining space(s)).
- Basically, you have one whole page for the final exam.
- Q: Can I make a brand new study sheet?
A: No.
However, if you think the old one is in a bad shape (falling apart), you can use a photocopy of your own. (Reduction in size is not allowed though) - Q: What can I do if I lose my study sheet?
A: Dr.Prapun may be able to print out a scanned copy for you. (The writing won’t be as crisp as the original one but it’s better than nothing.) Otherwise, see below. - Q: I think the midterm study sheet (and the thing I wrote on it) is cursed (making me get poor score); I don’t want to see or use anything on it anymore. What can I do?
A: You may bring a brand new sheet for the final exam. However, you can only use one side of it.
- Same rules as the midterm:
- Must be hand-written in your own handwriting.
- No small pieces of paper notes glued/attached on top of it.
- Indicate your name and ID on the upper right corner of the sheet (in portrait orientation).
- Do not modify (,e.g., add/underline/highlight) content on the sheet inside the exam room.
- Submit your A4 sheet with your exam.
- Violating the above instructions will cost you 10 pt.
- Use the returned study sheet from the midterm exam.
- Cover all the materials that we discussed in class and practice in the HWs.
- Material Distribution (score-wise):
3 (CH4) + 37 (SEC5.1) + 21 (SEC5.2) + 28 (CH6) + 2 (CH7) + 8 (CH8) - For your studying pleasure....
- All post-midterm annotated notes combined in one pdf file [Posted @3:30PM on May 10]
- All post-midterm exercises and their solutions [Posted @3:30PM on May 10]
- All post-midterm slides [Posted @3:30PM on May 10]
- All post-midterm HWs and their solutions [Posted @3:30PM on May 10]
- Midterm Results
- Information regarding the midterm exam [Posted @ 10AM on Mar 6]
- Check this course website regularly for breaking news about the midterm.
- Date: March 15, 2019
- TIME: 9:00-11:00
- ROOMs: BKD 3506, 3507
- Information about the midterm exam:
- 8 pages (including the cover page)
- To save time, read the cover page posted here before going into the exam room.
- 12+1 = 13 questions. (6+9+2+6.5+3+2+12+1.5+9+4+3.5+7.5+1 = 67 pt)
- Cover all the materials that we discussed in class and practice in the HWs.
- Material Distribution (score-wise): 23.5 (CH2) + 22 (CH3) + 20.5 (CH4)
- Closed book. Closed notes.
- (1 pt) One A4 page allowed.
- Must be hand-written in your own handwriting.
- No extra pieces of paper notes glued/attached on top of it.
- Indicate your name and ID on the upper right corner of the sheet (in portrait orientation).
- Do not modify (,e.g., add/underline/highlight) content on the sheet inside the exam room.
- Make sure that another side is blank. This will be used for the final exam.
- Submit your A4 sheet with your exam. (You can get it back from Dr.Prapun after the midterm is graded.)
- Q: I don't need any formulas. What should I do?
A: Bring in and submit a blank sheet of paper with your name and ID. Note that you can still only use one side on the final exam.
- Violating the above instructions will cost you 10 pt.
- Basic SIIT-approved calculators, e.g,. FX-991MS, are permitted, but borrowing is not allowed.
- For your studying pleasure....
- All pre-midterm annotated notes combined in one pdf file.
- All pre-midterm slides.
- All pre-midterm HWs and their solutions
- Checked HWs can be picked up in front of the EC office on the 6th floor.
- All pre-midterm exercises and their solutions
- Graded exercises are posted on Google Drive.
- If you have valid reason for missing class on the day that we have exercise, please indicate the date, exercise number, and the reason in the self evaluation form. Make sure that you also submit/email supporting document/evidence to me (if you haven't done so).
- All pre-midterm exercises and their solutions from 2017
- All pre-midterm exercises and their solutions from 2016
- Sample Exam
- Graded exercises are posted on Google Drive.
- This site can be accessed via ecs452.prapun.com.
- A mirror of this website is provided by Phatham.
- The course materials are also backed up on Google Drive.
- We also have a Line group: QR code.
- Welcome to ECS452! Feel free to look around this site.
General Information
- Instructor: Asst. Prof. Dr.Prapun Suksompong (prapun@siit.tu.ac.th)
- Office Hours: See Google calendar below. (Or visit oh.prapun.com)
- Lectures: See Google calendar below.
- Course Syllabus [Distributed in class]
- Textbooks:
- [P&S] Proakis and Salehi, Digital Communications, 5th Edition, McGraw-Hill, 2007.
- [C&T] Thomas M. Cover and Joy A. Thomas, Elements of Information Theory, Second Edition, Wiley-Interscience, 2006
Handouts and Course Material
- Slides: Course Introduction
- Chapter 1: Elements of a Digital Communication System
- Annotated version [Posted @ 4PM on Jan 17; Updated @ 4:30PM on Jan 18]
- Slides [Posted @ 3:30PM on Jan 17]
- Chapter 2: Source Coding
- Annotated version [Posted @ 4:30PM on Jan 18; Updated @ 5PM on Jan 24, @ 5PM on Jan 25, and @ 9PM on Feb 8]
- Slides [Posted @ 3:30PM on Jan 17; Updated @ 4:30PM on Jan 18, @ 5PM on Jan 24, and @ 5PM on Jan 25]
- Exercise 1 Solution [Posted @ 9AM on Feb 5]
- Exercise 2 Solution [Posted @ 9AM on Feb 5]
- Exercise 3 Solution [Posted @ 3:30PM on Feb 12]
- Exercise 4 Solution [Posted @ 3:30PM on Feb 12]
- Graded exercises are posted on Google Drive.
- MATLAB: Huffman_Demo_Ex1.m, Huffman_Demo_Ex2.m, entropy2.m
- Chapter 3: An Introduction to Digital Communication Systems Over DMC [Posted @ 5PM on Jan 24]
- Section 3.1 [Posted @ 9PM on Feb 8]
- Annotated version [Posted @ 9PM on Feb 8; Updated @ 4:30PM on Feb 14 and @3PM on Feb 15]
- Section 3.2-3.3 [Posted @ 9PM on Feb 8]
- Annotated version [Posted @ 3PM on Feb 15; Updated @ 3PM on Feb 21]
- Section 3.4-3.5 [Posted @ 4:30PM on Feb 14]
- Annotated version [Posted @ 3PM on Feb 21; Updated @ 5PM on Feb 28]
- Slides [Posted @ 9PM on Feb 8; Updated @ 4:30PM on Feb 14, @ 3PM on Feb 21, and @ 5PM on Feb 28]
- Exercise 5 Solution [Posted @ 10AM on Feb 25]
- Exercise 6 Solution [Posted @ 10AM on Feb 25]
- Exercise 7 Solution [Posted @ 10AM on Feb 25]
- MATLAB: BSC_demo.m, BAC_demo.m, DMC_demo.m, DMC_Analysis_demo.m, DMC_Channel_sim.m, BSC_decoder_ALL_demo.m,DMC_decoder_DIY_demo.m, DMC_decoder_ALL_demo.m, DMC_decoder_MAP_demo.m, DMC_decoder_ML_demo.m
- MATLAB: PE_minDist.m, PE_minDist_demo1.m, PE_minDist_demo2.m
- Chapter 4: Mutual Information and Channel Capacity [Posted @ 11AM on Feb 20]
- Annotated version [Posted @ 5PM on Feb 28; Updated @ 5PM on Mar 7, @ 3PM on Mar 8, and @ 4PM on Mar 21]
- MATLAB: capacity_blahut.m
- Exercise 8 Solution [Posted @ 9AM on Mar 6]
- Exercise 9 Solution [Posted @ 5PM on Mar 7]
- Exercise 10 Solution [Posted @ 3PM on Mar 19]
- Exercise 11 Solution [Posted @ 11PM on Apr 18]
- Slides [Posted @ 5PM on Mar 7; Updated @ 3PM on Mar 8 and @ 4PM on Mar 21]
- Chapter 5: Channel Coding
- Sectiion 5.1
- Part A [Posted @ 3PM on Mar 19]
- Annotated version [Posted @ 4PM on Mar 22; Updated @ 2PM on Mar 28, @ 3:30PM on Mar 29, and @ 3PM on Apr 4]
- Exercise 12 Solution [Posted @ 4:30PM on Apr 4]
- Exercise 13 Solution [Posted @ 4:30PM on Apr 4]
- Exercise 14 Solution [Posted @ 4:30PM on Apr 4]
- Exercise 15 Solution [Posted @ 11PM on Apr 18]
- Exercise 16 Solution [Posted @ 11PM on Apr 18]
- Part B [Posted @ 3PM on Mar 19]
- Annotated version [Posted @ 3PM on Apr 4; Updated @ 2:30 PM on Apr 5]
- Section 5.2 [Posted @ 3:30PM on Mar 28]
- Annotated version [Posted @ 11:30 AM on Apr 12; Updated @ 4PM on Apr 19]
- Exercise 17 Solution [Posted @ 4PM on Apr 22]
- Exercise 18 Solution [Posted @ 4PM on Apr 22]
- Chapter 6: Digital Modulation [Posted @ 10AM on April 17]
- Annotated version [Posted @ 3PM on Apr 25; Updated @ 9AM on May 3]
- Exercise 19 Solution [Posted @ 11:30AM on May 1]
- Slides [Posted @ 9AM on May 3]
- Chapter 7: The Waveform Channel [Posted @ 4PM on Apr 30]
- Annotated version [Posted @ 9AM on May 3]
- Slides [Posted @ 9AM on May 3]
- Chapter 8: Optimal Detection for Additive Noise Channels [Posted @ 4PM on Apr 30]
- Annotated version [Posted @ 5PM on May 3; Updated @ 3PM on May 10]
- Slides [Posted @ 5PM on May 3; Updated @ 3PM on May 10]
- Exercise 20 Solution [Posted @ 9AM on May 3]
Problem Set
Due Date | Remarks/Solutions | |
HW1 | 9AM, Jan 18 [Video] 10:40AM, Jan 18 [Worksheet] |
Accompanying Slides [Posted @ 4PM on Jan 17] |
HW2 | 4PM, Feb 14 |
Solution [Posted @ 5PM on Feb 19] |
HW3 | 4PM, Feb 22 | Solution [Posted @ 12PM on Feb 26] |
HW4 | 4PM, Mar 8 |
Solution [Posted @ 3:30PM on Mar 8] |
HW5 | Not Due | MATLAB: capacity_blahut.m Solution [Posted @ 3:30PM on Mar 8] Still important for the midterm exam. |
Self-Evaluation Form (1) | Mar 15 | |
HW6 | 4PM, Apr 11 | Solution [Posted @ 9PM on Apr 22] |
HW7 | 4PM, Apr 26 | Solution [Posted @ 9AM on May 3] |
HW8 | 4PM, May 3 | Solution [Posted @ 5PM on May 3] |
HW9 | Not Due | Solution [Posted @ 9AM on May 3] |
Self-Evaluation Form (2) | May 24 |
Calendar
Reading Assignment
Additional References
- [G] Robert G. Gallagher, Principles of Digital Communications, Cambridge University Press, 2008.
- [S] Bernard Sklar, Digital communications: fundamentals and applications, Prentice Hall, 2001. Call No: TK5103.7 S55 2001.
- [N&S] Ha H. Nguyen and Ed Shwedyk, A first course in digital communications, Cambridge University Press, 2009. Call No: TK5103.7 N49 2009
- [Z&T] Rodger E. Ziemer and William H. Tranter, Principles of Communications, 6th International student edition, John Wiley & Sons Ltd, 2010.
- Call No. QA273 Y384 2005. ISBN: 978-0-471-27214-4
- Student Companion Site
- [L&D] B.P. Lathi and Zhi Ding, Modern Digital and Analog Communication Systems, 4th Edition, Oxford: Oxford University Press, 2009. Call No. TK5101 L333 2009
- [C&C] A. Bruce Carlson and Paul B. Crilly, Communication Systems: An Introduction to Signals and Noise in Electrical Communication, McGraw-Hill, 2010, 5th International edition.
- Call No. TK5102.5 C3 2010. ISBN: 978-007-126332-0.
- Companion Site
- J. G. Proakis and M. Salehi, Communication Systems Engineering, 2nd Edition, Prentice Hall, 2002. ISBN: 0-13-095007-6
- S.S. Haykin, Communication Systems, 4th Edition, John Wiley & Sons, 2001. Call Number: TK5101 H38 2001.
- [J&S] C. R. J. Jr, W. A. Sethares, and A. G. Klein, Software Receiver Design: Build Your Own Digital Communication System in Five Easy Steps, 1st ed. Cambridge University Press, 2011.
- [J&S] C.R. Johnson and W.A. Sethares, Telecommunications Breakdown: Concepts of Communication Transmitted via Software-Defined Radio, Prentice Hall, 2003.
- P. Suksompong, ECS332: Principles of Communications
- MATLAB Primer, 8th edition T. A. Davis. CRC Press, 2010.
- MIT RES.6.007 Signals and Systems (1987) on Youtube
Misc. Links
- Information Theory Basics (Free sample chapter from the textbook "Information Theory Tools for Image Processing" by Miquel Feixas, Anton Bardera, Jaume Rigau, Qing Xu, and Mateu Sbert.
- Article: IEEE 802.11ac—Wi-Fi for the Mobile and Video Generation
- C.E. Shannon
- Paper: C.E. Shannon, "A Mathematical Theory of Communication", Bell System Technical Journal, vol. 27, pp. 379–423, 623-656, July, October, 1948
- Video: Claude Shannon - Father of the Information Age
- The Significance of Shannon's Work by Aaron Wyner
- Paper: Sergio Verdü (2000). "Fifty years of Shannon theory"
- Video: Demo from MIT (1987) showing introduction to function generator, spectrum analyzer (with sampling and FFT), spectrum of square and triangular signals, time and frequency scaling, spectrum of speech, and amplitude modulation.
- Article: Articles about source coding: PC World article, US Patent 5,533,051, the comp.compression FAQ.
- Article: Jim Giles, Traffic jam: the coming cellphone crunch, New Scientist, November, 2010
- 20 Questions
- Twenty Questions online game
- Twenty Questions (1949): Players were allowed to ask up to twenty questions about a mystery object in their quest to identify it.
- A Brief History of Communications: IEEE Communications Society - a fifty-year foundation for the future
- ประวัติย่อ "การสื่อสารโลก": ห้าสิบปีชมรมไฟฟ้าสื่อสาร--รากฐานสู่อนาคต
- Thai Telecommunications Encyclopedia (สารานุกรม โทรคมนาคมไทย)
- IEEE Thailand Section
- Google Calculator (Cheat Sheet)
- Learn the Greek Alphabet in less than 10 minutes
- The Greek Alphabet Song