COURSE INFORMATION Course Title: INFORMATION THEORY AND CODING

Code	Course Type	Regular Semester	Theory	Practice	Lab	Credits	ECTS
ECE 358	C	99	3	0	0	3	6

Language:	English
Compulsory/Elective:	Elective
Classroom and Meeting Time:
Course Description:	-
Course Objectives:	The course aims to introduce to the students the concepts of mutual information, entropy, channel capacity, source coding (data compression), error-detection and error-correction codes, block coding, convolutional coding, and Viterbi decoding algorithm and its applications to reliable, efficient communication systems.

COURSE OUTLINE

Week	Topics
1	Introduction to information and coding theory.
2	Signal representations, Intersymbol interference and Nyquist theorem.
3	Entropy and optimal Huffman coding.
4	Entropy of the discrete source.
5	Markov source.
6	Discrete channel. Channel entropy and discrete channel capacity.
7	Conditional entropy and capacity of a discrete channel.
8	Linear block codes.
9	Maximum likelihood detection. Hard & Soft decoding.
10	Systematic linear codes and syndrome decoding.
11	Convolution code.
12	Turbo code.
13	Low density parity check code.
14	Asymptotic Equipartition Property.

Prerequisite(s):	Signals & Systems and Fundamental of Probability.
Textbook:	T. M. Cover, J. A, Thomas, “Elements of information theory,” Wiely Interscience, 2nd Edition, 2006.
Other References:	R. W. Hamming, “Coding and information theory,” Prentice Hall Inc., 1980.
Laboratory Work:
Computer Usage:
Others:	No

COURSE LEARNING OUTCOMES

1	Understand the difference and relation between mutual information and entropy.
2	Understand source coding.
3	Understand optimal codes.
4	Explain information channel and channel capacity.
5	Explain forward error correcting codes.
6	Explain the basic principles of information theory and coding.
7	Explain Basic principles of asymptotic equipartition property.

COURSE CONTRIBUTION TO... PROGRAM COMPETENCIES (Blank : no contribution, 1: least contribution ... 5: highest contribution)

No	Program Competencies	Cont.
Bachelor in Electronics and Digital Communication Engineering (3 years) Program
1	Engineering graduates with sufficient theoretical and practical background for a successful profession and with application skills of fundamental scientific knowledge in the engineering practice.	5
2	Engineering graduates with skills and professional background in describing, formulating, modeling and analyzing the engineering problem, with a consideration for appropriate analytical solutions in all necessary situations	5
3	Engineering graduates with the necessary technical, academic and practical knowledge and application confidence in the design and assessment of machines or mechanical systems or industrial processes with considerations of productivity, feasibility and environmental and social aspects.	5
4	Engineering graduates with the practice of selecting and using appropriate technical and engineering tools in engineering problems, and ability of effective usage of information science technologies.	4
5	Ability of designing and conducting experiments, conduction data acquisition and analysis and making conclusions.	4
6	Ability of identifying the potential resources for information or knowledge regarding a given engineering issue.	4
7	The abilities and performance to participate multi-disciplinary groups together with the effective oral and official communication skills and personal confidence.	4
8	Ability for effective oral and official communication skills in foreign language.	4
9	Engineering graduates with motivation to life-long learning and having known significance of continuous education beyond undergraduate studies for science and technology.	3
10	Engineering graduates with well-structured responsibilities in profession and ethics.	3
11	Engineering graduates who are aware of the importance of safety and healthiness in the project management, workshop environment as well as related legal issues.	3
12	Consciousness for the results and effects of engineering solutions on the society and universe, awareness for the developmental considerations with contemporary problems of humanity.	2

COURSE EVALUATION METHOD

Method	Quantity	Percentage
Homework	2	10
Midterm Exam(s)	1	30
Final Exam	1	50
	Total Percent:	100%

ECTS (ALLOCATED BASED ON STUDENT WORKLOAD)

Activities	Quantity	Duration(Hours)	Total Workload(Hours)
Course Duration (Including the exam week: 16x Total course hours)	16	4	64
Hours for off-the-classroom study (Pre-study, practice)	10	2	20
Mid-terms	1	20	20
Assignments	1	16	16
Final examination	1	30	30
Other			0
Total Work Load:			150
Total Work Load/25(h):			6
ECTS Credit of the Course:			6