Synopsis
The subject of digital communications involves the transmission of
information in digital form from a source that generates the
information to one or more destinations. This course extends the
knowledge gained from ECS332 (Principles of Communications) and ECS315
(Probability and Random Processes). Basic principles that underlie the
analysis and design of digital communication systems are covered. This
semester, the main focus includes performance analysis (symbol error
probability), optimal receivers, and limits (information theoretic quantities).
These topics are challenging but the presented material are carefully
selected to keep the difficulty level appropriate for undergraduate
students.
Announcements
- Information regarding the final exam [Posted on May 4; Last updated @ 11AM on May 16]
- Check this course website regularly for breaking news about the final.
- See the Google Calendar below for Dr.Prapun's Office Hours during the exam week.
- More can be added
- Date: 18 May 2016
- TIME: 13:30-16:30
- ROOMs: BKD 3506, 3507
- 11 pages (including 1 cover page)
- 12+1 = 13 Questions (14+17+9+3+5+7+6+11+12+11+3+1+1)
- One A4 sheet allowed.
- Use the returned study sheet from the midterm exam.
- Add more formulas or information on the remaining side (or in the remaining space(s)).
- Basically, you have one whole page for the final exam.
- Q: Can I make a brand new study sheet?
A: No.
However, if you think the old one is in a bad shape (falling apart), you can use a photocopy of your own. (Reduction in size is not allowed though) - Q: What can I do if I lose my study sheet?
A: Dr.Prapun can print out a scanned copy for you. (The writing won’t be as crisp as the original one but it’s better than nothing.) - Q: I think the midterm study sheet (and the thing I wrote on it) is cursed (making me get poor score); I don’t want to see or use anything on it anymore. What can I do?
A: You may bring a brand new sheet for the final exam. However, you can only use one side of it.
- Same rules as the midterm:
- Must be hand-written in your own handwriting.
- No small pieces of paper notes glued/attached on top of it.
- Indicate your name and ID on the upper right corner of the sheet (in portrait orientation).
- Do not modify (,e.g., add/underline/highlight) content on the sheet inside the exam room.
- Submit your A4 sheet with your exam.
- Violating the above instructions will cost you 10 pt.
- Use the returned study sheet from the midterm exam.
- Cover all the materials that we discussed in class and practice in the HWs.
- Material Distribution (score-wise): 14 (CH4) + 47 (CH5) + 34 (CH6) + 4 (CH7,8)
- All post-midterm annotated notes
- All post-midterm HWs and solutions.
- There is one HW with no name. Please contact me ASAP to claim your HW.
- Note that only a part of one question is graded. So, read the solutions even when you get a 5.
- All graded HWs are available in the HW box. [May 10, 2016]
- Correction
- In Q6b of HW7, three methods were provided for the optimization of the constant "a". However, for Method 3, when I took the derivative, a minus sign was missing. This did not affect the final result though because we set the derivative to be zero anyway. [Credit: Panyawat]
- The solution of HW7 and the combined solution are updated accordingly [Fixed @ 11AM on May 16]
- All post-midterm slides
- All post-midtermin-class exercises and solutions
- Graded exercises can be downloded from the SIIT Lecture Note System
- Information regarding midterm exam
- Check this course website regularly for breaking news about the midterm.
- Date: 9 Mar 2016
- TIME: 13:30-16:30
- ROOMs: BKD 3506 & 3507
- 10 pages (including 1 cover page)
- 11+1 = 12 Questions (9+14+9+1+10+11.5+13.5+13+2+4+12+1)
- One A4 page allowed.
- Must be hand-written in your own handwriting.
- No small pieces of paper notes glued/attached on top of it.
- Indicate your name and ID on the upper right corner of the sheet (in portrait orientation).
- Do not modify (,e.g., add/underline/highlight) content on the sheet inside the exam room.
- Submit your A4 sheet with your exam. (You can get it back from me after the midterm is graded.)
- 1 pt
- Basic calculators (fx-991) are permitted, but borrowing is not allowed. You will need it for entropy calculation.
- Cover all the materials that we discussed in class and practice in the HWs.
- Material Distribution (score-wise): 43 (CH2) + 44 (CH3) + 12 (CH4)
- All annotated notes
- All HWs and solutions (Note that only a part of one question is graded. So, read the solutions even when you get a 5.)
- Graded HWs (1-3)are available in the HW box
- Typo in the solution for HW3: For Q4.d.iii, the conclusion (in red color) for p0 > 0.4 and p0 < 0.4 should be swapped. The current solution has been fixed (in pink color). [Credit: Nonpawit]
- All slides
- All in-class exercises and solutions
- Graded exercise can be downloded from the SIIT Lecture Note System
- Graded HWs are available in the HW box.
- Room changes:
- Wednesday: BKD2401 (also ECS306)
- Thursday: BKD2506 (also ECS462)
- Wednesday: BKD2401 (also ECS306)
- The lecture on Wed 27 is replaced by the talks from HKNU Visitors.
- Room: 2501-2
- This site can be accessed via ecs452.prapun.com
- A basic RSS feed is available for tracking site updates.
- Welcome to ECS452! Feel free to look around this site.
General Information
- Instructor:Asst. Prof. Dr.Prapun Suksompong (prapun@siit.tu.ac.th)
- Office: BKD, 4th floor of Sirindhralai building
- Office Hour (Tentative): M 14:00-16:00, R 10:30 - 11:30, F 12:00 - 13:00
- Additinally, please feel free to ask any question or express any concern after class.
- Course Syllabus [To be distributed in class]
- Textbook: [P&S] Proakis and Salehi, Digital Communications, 5th Edition, McGraw-Hill, 2007.
- References
- [G] Robert G. Gallagher, Principles of Digital Communications, Cambridge University Press, 2008.
- [S] Bernard Sklar, Digital communications: fundamentals and applications, Prentice Hall, 2001. Call No: TK5103.7 S55 2001.
- [N&S] Ha H. Nguyen and Ed Shwedyk, A first course in digital communications, Cambridge University Press, 2009. Call No: TK5103.7 N49 2009
- [Z&T] Rodger E. Ziemer and William H. Tranter, Principles of Communications, 6th International student edition, John Wiley & Sons Ltd, 2010.
- Call No. QA273 Y384 2005. ISBN: 978-0-471-27214-4
- Student Companion Site
- [L&D] B.P. Lathi and Zhi Ding, Modern Digital and Analog Communication Systems, 4th Edition, Oxford: Oxford University Press, 2009. Call No. TK5101 L333 2009
- J. G. Proakis and M. Salehi, Communication Systems Engineering, 2nd Edition, Prentice Hall, 2002. ISBN: 0-13-095007-6
- S.S. Haykin, Communication Systems, 4th Edition, John Wiley & Sons, 2001. Call Number: TK5101 H38 2001.
- [J&S] C. R. J. Jr, W. A. Sethares, and A. G. Klein, Software Receiver Design: Build Your Own Digital Communication System in Five Easy Steps, 1st ed. Cambridge University Press, 2011.
- [J&S] C.R. Johnson and W.A. Sethares, Telecommunications Breakdown: Concepts of Communication Transmitted via Software-Defined Radio, Prentice Hall, 2003.
- [C&T] Thomas M. Cover, Joy A. Thomas, Elements of Information Theory, Second Edition, Wiley-Interscience, 2006
- P. Suksompong, ECS332: Principles of Communications
- MATLAB Primer, 8th edition T. A. Davis. CRC Press, 2010.
- MIT RES.6.007 Signals and Systems (1987) on Youtube
Handouts and Course Material
- Slides: Course Introduction [Posted @ 4PM on Jan 13]
- Section 1: Elements of a Digital Communication System
- Annotated version [Posted @ 4PM on Jan 13; Updated @ 5PM on Jan 14]
- Slides [Posted @ 4PM on Jan 13]
- Section 2: Source Coding
- Annotated version [Posted @ 5PM on Jan 14; Updated @ 10PM on Jan 20, @ 4:30PM on Jan 21, and @ 4:30PM on Jan 28]
- Slides [Posted @ 5PM on Jan 14; Updated @ 10PM on Jan 20 and @ 4:30PM on Jan 21]
- MATLAB: Huffman_Demo_Ex1.m, Huffman_Demo_Ex2.m
- Solution for In-Class Exercise 1
- Graded exercise can be downloded from the SIIT Lecture Note System
- Section 3: An Introduction to Digital Communication Systems Over Discrete Memoryless Channel (DMC)
[Updated @ 4PM on Feb 9]
- Annotated version for Section 3.1-3.4 [Posted @ 4:30PM on Jan 28; Updated @ 8 PM on Feb 3, @ 5PM on Feb 4, @ 4PM on Feb 10, and @ 4:30PM on Feb 11]
- Annotated version for Section 3.5-3.6 [Posted @ 4:30PM on Feb 11; Updated @ 5PM on Feb 17, @ 6PM on Feb 18, and @ 3PM on Feb 24]
- Slides [Posted @ 4:30PM on Jan 28; Updated @ 8 PM on Feb 3, @ 4:30PM on Feb 11, and @ 9:30PM on Feb 17]
- MATLAB: BSC_demo.m, BAC_demo.m, DMC_demo.m, DMC_Analysis_demo.m, DMC_Channel_sim.m, BSC_decoder_ALL_demo.m,DMC_decoder_DIY_demo.m, DMC_decoder_ALL_demo.m, DMC_decoder_MAP_demo.m, DMC_decoder_ML_demo.m
- Solution for In-Class Exercise 2
- Section 4: Mutual Information and Channel Capacity
- Annotated version [Posted @ 3PM on Feb 24; Updated @ 5PM on Feb 25, @ 5PM on Mar 16, and @ 5:30 PM on Mar 17]
- Solution for In-Class Exercise 3
- MATLAB: capacity_blahut.m
- Slides [Posted @ 3:30 PM on Mar 23]
- Solution for In-Class Exercise 4 [Posted @ 6PM on May 5]
- Section 5: Channel Coding
- Slides for Section 5.1[Posted @ 11AM on Mar 23]
- Annotated version [Posted @ 3:30 PM on Mar 23; Updated @ 7:30PM on Mar 24, @ 4PM on Mar 30, and @ 8:30PM on Mar 31]
- Slides for Section 5.2 [Posted @ 12PM on Mar 30]
- Annotated version [Posted @ 9PM on Apr 7; Updated @ 10AM on Apr 21]
- Sample Exam Questions for Electrical Engineering License [Posted @ 4PM on Mar 30; Updated @ 8:30PM on Mar 31 and @ 9PM on Apr 7]
- Solution for In-Class Exercise 5 [Posted @ 6PM on May 5]
- Solution for In-Class Exercise 6 [Posted @ 6PM on May 5]
- Section 6: Introduction to Digital Modulation
- Section 6.1 [Posted @ 9:30AM on Apr 19]
- Annotated version [Posted @ 9PM on Apr 20; Updated @ 6PM on Apr 21 and @ 8:30PM on Apr 27]
- Sections 6.2-6.3 [Posted @ 9PM on Apr 20]
- Annotated version [Posted @ 8:30PM on Apr 27; Updated @ 6PM on Apr 28]
- Slides [Posted @ 10AM on Apr 21]
- Section 7: Additive Noise in the Waveform Channel
- Annotated version [Posted @ 6PM on Apr 28; Updated @ 3PM on May 4]
- Slides [Posted @ 10:30PM on May 4]
- Section 8: Optimal Detection for Digital Modulation (1-D)
- Annotated version [Posted @ 3PM on May 4]
- Slides [Posted @ 10:30PM on May 4]
Problem Set
- HW 1
(Due: Feb 5)
- Solution[Posted @ 5PM on Feb 10]
- HW2 (Due: Feb 19)
- Solution[Posted @ 4PM on Feb 24]
- HW_DMC_Channel_Data.mat
- HW3 (Due: Feb 26)
- Solution [Posted @ 4PM on Feb 26]
- HW4 (Not Due)
- Solution [Posted @ 4PM on Feb 26]
- Self-Evaluation (1) (Due: Mar 9)
- HW5 (Due: Apr 1)
- MATLAB: capacity_blahut.m
- Solution [Posted @ 10AM on Apr 11]
- HW6 (Due: Apr 27)
- Solution [Posted @ 11AM on Apr 28]
- HW7 (Not Due)
- Solution [Posted @ 12PM on Apr 28; Fixed @ 11AM on May 16]
- HW8 (Not Due)
- Solution [Posted @ 9:30AM on May 4]
- Self-Evaluation (2) (Due: May 18)
Calendar
Reading Assignment
Misc. Links
- Information Theory Basics (Free sample chapter from the textbook "Information Theory Tools for Image Processing" by Miquel Feixas, Anton Bardera, Jaume Rigau, Qing Xu, and Mateu Sbert.
- Article: IEEE 802.11ac—Wi-Fi for the Mobile and Video Generation
- C.E. Shannon
- Paper: C.E. Shannon, "A Mathematical Theory of Communication", Bell System Technical Journal, vol. 27, pp. 379–423, 623-656, July, October, 1948
- Video: Claude Shannon - Father of the Information Age
- The Significance of Shannon's Work by Aaron Wyner
- Paper: Sergio Verdü (2000). "Fifty years of Shannon theory"
- Video: Demo from MIT (1987) showing introduction to function generator, spectrum analyzer (with sampling and FFT), spectrum of square and triangular signals, time and frequency scaling, spectrum of speech, and amplitude modulation.
- Article: Articles about source coding: PC World article, US Patent 5,533,051, the comp.compression FAQ.
- Article: Jim Giles, Traffic jam: the coming cellphone crunch, New Scientist, November, 2010
- 20 Questions
- Twenty Questions online game
- Twenty Questions (1949): Players were allowed to ask up to twenty questions about a mystery object in their quest to identify it.
- A Brief History of Communications: IEEE Communications Society - a fifty-year foundation for the future
- ประวัติย่อ "การสื่อสารโลก": ห้าสิบปีชมรมไฟฟ้าสื่อสาร--รากฐานสู่อนาคต
- Thai Telecommunications Encyclopedia (สารานุกรม โทรคมนาคมไทย)
- IEEE Thailand Section
- Google Calculator (Cheat Sheet)
- Learn the Greek Alphabet in less than 10 minutes
- The Greek Alphabet Song