Synopsis
The subject of digital communications involves the transmission of
information in digital form from a source that generates the
information to one or more destinations. This course extends the
knowledge gained from ECS332 (Principles of Communications) and ECS315
(Probability and Random Processes). Basic principles that underlie the
analysis and design of digital communication systems are covered. This
semester, the main focus includes performance analysis (symbol error
probability), optimal receivers, and limits (information theoretic quantities).
These topics are challenging but the presented material are carefully
selected to keep the difficulty level appropriate for undergraduate
students.
Announcements
- New materials are now posted in Google Classroom.
- Don't forget that you need to use your SIIT email account to access the site.
- We are testing the use of Google Classroom that is provided by SIIT.
- All registered students' emails are automanically added.
- There should be an email invitation to join the class. Please "join" our ECS452 classroom.
- We are transitioning our course to be 100% online. We will not have lecture in BKD3511 anymore.
- All of our lectures will be posted as short videos that you can use to study in your own time.
- There will still be some exercises to be submitted.
- Classes on Mar 17 and 20 are canceled.
- Online exercise submission (the link is different from the one for HW submission)
- This site can be accessed via ecs452.prapun.com.
- A mirror of this website is provided by Phatham.
- The course materials are also backed up on Google Drive.
- We also have a Line group: QR code.
- Welcome to ECS452! Feel free to look around this site.
- Graded exercises are posted on Google Drive.
- Information regarding the midterm exam [Posted @ 5PM on Feb 21]
- Check this course website regularly for breaking news about the midterm.
- Date: March 6, 2020
- TIME: 9:00-11:00
- ROOMs: BKD 3207
- Information about the midterm exam (to be announced)
- 8 pages (including the cover page)
- To save time, read the cover page before going into the exam room.
- 12+1 questions.
- Cover all the materials that we discussed in class and practice in the exercises and HWs.
- Material Distribution (score-wise): 25 (CH2) + 25 (CH3) + 16 (CH4)
- Closed book. Closed notes.
- (1 pt) One A4 page allowed.
- Must be hand-written in your own handwriting.
- Recommendation: Avoid using pencil or erasable pen.
- No extra pieces of paper notes glued/attached on top of it.
- Indicate your name and ID on the upper right corner of the sheet (in portrait orientation).
- Do not modify (,e.g., erase/add/underline/highlight) content on the sheet inside the exam room.
- Make sure that another side is blank. This will be used for the final exam.
- Submit your A4 sheet with your exam. (You can get it back from Dr.Prapun after the midterm is graded.)
- Q: I don't need any formulas. What should I do?
A: Bring in and submit a blank sheet of paper with your name and ID.
- Q: Can I use iPad or other devices with pen input to produce this?
A: Yes, but, again, all the content must still be hand-written in your own handwriting. - Violating the above instructions will cost you 10 pt.
- Basic SIIT-approved calculators, e.g,. FX-991MS, are permitted, but borrowing is not allowed.
- For your studying pleasure....
- All pre-midterm annotated notes combined in one pdf file.
- All pre-midterm slides.
- All pre-midterm HWs and their solutions
- Checked HWs can be picked up in front of the EC office on the 6th floor.
- In-Class Exercises
- All pre-midterm exercises and their solutions
- Graded exercises are posted on Google Drive.
- All pre-midterm exercises and their solutions from 2018
- All pre-midterm exercises and their solutions from 2017
- All pre-midterm exercises and their solutions from 2016
- Sample Exams
General Information
- Instructor: Asst. Prof. Dr.Prapun Suksompong (prapun@siit.tu.ac.th)
- Office Hours: See Google calendar below. (Or visit oh.prapun.com)
- Lectures: See Google calendar below.
- Course Syllabus [Distributed in class]
- Textbooks:
- [P&S] Proakis and Salehi, Digital Communications, 5th Edition, McGraw-Hill, 2007.
- [C&T] Thomas M. Cover and Joy A. Thomas, Elements of Information Theory, Second Edition, Wiley-Interscience, 2006
Handouts and Course Material
- Slides: Course Introduction [Posted @ 2PM on Jan 10; Updated @ 3PM on Jan 14]
- Chapter 1: Elements of a Digital Communication System [Posted @ 1:30PM on Jan 10]
- Annotated version [Posted @ 3PM on Jan 14]
- Slides [Posted @ 3PM on Jan 14]
- Reference: [P&S] Section 1.1
- Additional References:
- C.E. Shannon
- Paper: C.E. Shannon, "A Mathematical Theory of Communication", Bell System Technical Journal, vol. 27, pp. 379–423, 623-656, July, October, 1948
- Video: Claude Shannon - Father of the Information Age
- Article: The Significance of Shannon's Work by Aaron Wyner
- Article: Claude Shannon Was A Genius On Par With Einstein And Turing. Why Isn't He As Famous?
- Article: A Man in a Hurry: Claude Shannon’s New York Years
- Shannon and his colleagues.
- Article: E. O. Thorp, "The invention of the first wearable computer," Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215), Pittsburgh, PA, USA, 1998, pp. 4-8.
- Shannon met Thorp at M.I.T. and worked together to build the first wearable computer that was used to beat roulette in Las Vegas.
- C.E. Shannon
- Chapter 2: Source Coding [Posted @ 1:30PM on Jan 10]
- Annotated version [Posted @ 4PM on Jan 17; Updated @ 3PM on Jan 21, @ 2:30PM on Jan 24, @ 4:30PM on Jan 28, and @ 1PM on Jan 31]
- Slides[Posted @ 4PM on Jan 17; Updated @ 3PM on Jan 21, @ 2:30PM on Jan 24, @ 4:30PM on Jan 28, and @ 1PM on Jan 31]
- Exercise 1 solution [Posted @ 4PM on Jan 22]
- Exercise 2 solution [Posted @ 4PM on Jan 22]
- Exercise 3 solution [Posted @ 3PM on Feb 4]
- Exercise 4 solution [Posted @ 3PM on Feb 4]
- Exercise 5 solution [Posted @ 3PM on Feb 4]
- MATLAB: Huffman_Demo_Ex1.m, Huffman_Demo_Ex2.m, entropy2.m
- References:
- Chapters 2 and 5 in Cover and Thomas [C&T]
- Section 16.1 in Carlson and Crilly [C&C]
- Chapter 14 in Johnson, Sethares, and Klein [J&S]
- Section 11.2 in Ziemer and Tranter [Z&T]
- Additional References:
- Article: Without Claude Shannon's information theory there would have been no internet
- David A. Huffman
- Article: Encoding the “Neatness” of Ones and Zeroes from the September 1991 issue of Scientific American, pp. 54, 58.
- 20 Questions
- Twenty Questions online game
- Twenty Questions (1949): Players were allowed to ask up to twenty questions about a mystery object in their quest to identify it.
- Chapter 3: An Introduction to Digital Communication Systems Over DMC [Posted @ 4PM on Jan 29]
- Annotated version for Section 3.1 [Posted @ 2:30PM on Feb 4; Updated @3PM on Feb 7]
- Annotated version for Section 3.2-3.3 [Posted @3PM on Feb 7; Updated @ 9AM on Feb 12, @ 6:30PM on Feb 14, and @ 9AM on Feb 17]
- Additional summary page for Section 3.3 [Posted @ 11:30AM on Feb 13]
- Annotated version for Section 3.4-3.5 [Posted @ 9AM on Feb 17; Updated @ 2PM on Feb 18]
- Slides[Posted @ 2:30PM on Feb 4; Updated @3PM on Feb 7, @ 9AM on Feb 12, and @ 2PM on Feb 18]
- Exercise 6 solution [Posted @ 11AM on Feb 19]
- Exercise 7 solution [Posted @ 11AM on Feb 19]
- Exercise 8 solution [Posted @ 11AM on Feb 19]
- Exercise 9 solution [Posted @ 5PM on Feb 25]
- Exercise 10 solution [Posted @ 5PM on Feb 25]
- MATLAB: BSC_demo.m, BAC_demo.m, DMC_demo.m, DMC_Analysis_demo.m, DMC_Channel_sim.m, BSC_decoder_ALL_demo.m,DMC_decoder_DIY_demo.m, DMC_decoder_ALL_demo.m, DMC_decoder_MAP_demo.m, DMC_decoder_ML_demo.m
- MATLAB: PE_minDist.m, PE_minDist_demo1.m, PE_minDist_demo2.m
- Chapter 4: Mutual Information and Channel Capacity [Posted @ 2:30PM on Feb 12]
- Annotated version for Section 4.1 [Posted @4:30PM on Feb 21; Updated @3:30PM on Feb 25 and @4PM on Feb 28]
- Annotated version for Sections 4.3-4.4 [Posted @3:30PM on Feb 25; Updated @4PM on Feb 28]
- Slides for Sections 4.1, 4.3, and 4.4[Posted @3:30PM on Feb 25]
- MATLAB: capacity_blahut.m
- Annotated version for Sections 4.2 and 4.5[Posted @ 5PM on Mar 11]
- Slides for Sections 4.2 and 4.5[Posted @ 5PM on Mar 11]
- References:
- Chapters 2, 7, and 8 in Cover and Thomas [C&T]
- Chapter 5: Channel Coding
- Sectiion 5.1
- Part A [Posted @ 9AM on Mar 9]
- Annotated version[Posted @ 5PM on Mar 11; Updated @ 8PM on Mar 13]
- New materials are now posted in Google Classroom.
- Don't forget that you need to use your SIIT email account to access the site.
- Section 5.2
- Chapter 6: Digital Modulation
- Chapter 7: The Waveform Channel
- Chapter 8: Optimal Detection for Additive Noise Channels
Problem Set
- Submission Instruction: You have two choices.
- Hardcopy submission: Put your completed HW in the 452 HW box outside of EC office.
- Online Submission
- Only for those who directly work on the posted HW files using devices with pen input and don’t want to print a hardcopy.
- No scanned work or photos.
- PDF only.
- Your file name should start with your 10-digit student ID followed by the course code and the assignment number:“5565242231 452 HW2.pdf”
- Don't forget to write your your first name and the last three digits of your student ID in the spaces provided on the upper-right corner of the first page.
Due Date | Remarks/Solutions | |
HW1 | Jan 16 |
|
HW2 | Feb 7, 4PM | Solution [Posted @ 9AM on Feb 19] |
HW3 | Feb 18, 4PM | Solution [Posted @ 9AM on Feb 19] |
HW4 | Feb 28, 4PM | MATLAB: HW_DMC_Channel_Data.mat |
HW5 | Not Due | Solution [Posted @ 4PM on Feb 27] |
Self-Evaluation Form (1) | Mar 6, 11:59PM | |
HW6 | ||
HW7 | ||
HW8 | ||
HW9 | ||
Self-Evaluation Form (2) |
Calendar
Reading Assignment
Additional References
- [G] Robert G. Gallagher, Principles of Digital Communications, Cambridge University Press, 2008.
- [S] Bernard Sklar, Digital communications: fundamentals and applications, Prentice Hall, 2001. Call No: TK5103.7 S55 2001.
- [N&S] Ha H. Nguyen and Ed Shwedyk, A first course in digital communications, Cambridge University Press, 2009. Call No: TK5103.7 N49 2009
- [Z&T] Rodger E. Ziemer and William H. Tranter, Principles of Communications, 6th International student edition, John Wiley & Sons Ltd, 2010.
- Call No. QA273 Y384 2005. ISBN: 978-0-471-27214-4
- Student Companion Site
- [L&D] B.P. Lathi and Zhi Ding, Modern Digital and Analog Communication Systems, 4th Edition, Oxford: Oxford University Press, 2009. Call No. TK5101 L333 2009
- [C&C] A. Bruce Carlson and Paul B. Crilly, Communication Systems: An Introduction to Signals and Noise in Electrical Communication, McGraw-Hill, 2010, 5th International edition.
- Call No. TK5102.5 C3 2010. ISBN: 978-007-126332-0.
- Companion Site
- J. G. Proakis and M. Salehi, Communication Systems Engineering, 2nd Edition, Prentice Hall, 2002. ISBN: 0-13-095007-6
- S.S. Haykin, Communication Systems, 4th Edition, John Wiley & Sons, 2001. Call Number: TK5101 H38 2001.
- [J&S] C. R. J. Jr, W. A. Sethares, and A. G. Klein, Software Receiver Design: Build Your Own Digital Communication System in Five Easy Steps, 1st ed. Cambridge University Press, 2011.
- [J&S] C.R. Johnson and W.A. Sethares, Telecommunications Breakdown: Concepts of Communication Transmitted via Software-Defined Radio, Prentice Hall, 2003.
- P. Suksompong, ECS332: Principles of Communications
- MATLAB Primer, 8th edition T. A. Davis. CRC Press, 2010.
- MIT RES.6.007 Signals and Systems (1987) on Youtube
Misc. Links
- Information Theory Basics (Free sample chapter from the textbook "Information Theory Tools for Image Processing" by Miquel Feixas, Anton Bardera, Jaume Rigau, Qing Xu, and Mateu Sbert.
- Article: IEEE 802.11ac—Wi-Fi for the Mobile and Video Generation
- Paper: Sergio Verdü (2000). "Fifty years of Shannon theory"
- Video: Demo from MIT (1987) showing introduction to function generator, spectrum analyzer (with sampling and FFT), spectrum of square and triangular signals, time and frequency scaling, spectrum of speech, and amplitude modulation.
- Article: Jim Giles, Traffic jam: the coming cellphone crunch, New Scientist, November, 2010
- A Brief History of Communications: IEEE Communications Society - a fifty-year foundation for the future
- ประวัติย่อ "การสื่อสารโลก": ห้าสิบปีชมรมไฟฟ้าสื่อสาร--รากฐานสู่อนาคต
- Thai Telecommunications Encyclopedia (สารานุกรม โทรคมนาคมไทย)
- IEEE Thailand Section
- Google Calculator (Cheat Sheet)
- Learn the Greek Alphabet in less than 10 minutes
- The Greek Alphabet Song