Course detail

Information Theory and Encoding

FSI-VTIAcad. year: 2024/2025

The course is aimed to basics in information theory (message, entropy, transfer of information, discrete and continuous channels) and signals (signal processing, modulation). Further the course includes basic overview of coding methods in areas: bar codes, compression codes, error correcting codes and cryptography. At the end of the course the modern trends in coding are presented (quantum error correction, quantum cryptography).

Language of instruction

Czech

Number of ECTS credits

4

Mode of study

Not applicable.

Guarantor

prof. Ing. Radomil Matoušek, Ph.D.

Department

Institute of Automation and Computer Science (ÚAI)

Entry knowledge

Basic mathematical knowledge is required.

Rules for evaluation and completion of the course

The active participation and mastering the assigned task.
Solving an extra assignment can compensate absence.

Aims

The course objective is to make students familiar with the basics of the Theory of information and Coding theory. A key measure in information theory is "entropy". Applications of fundamental topics of information theory include lossless data compression and channel coding. Codes are used for data compression, cryptography, error-correction and more recently also for network coding..
The acquired knowledge will be sufficient for the good orientation in given principles of ICT.

Study aids

Not applicable.

Prerequisites and corequisites

Not applicable.

Basic literature

ADÁMEK, Jiří: Kódování. Praha, SNTL, 1989. (CS)
LUBBE J.C.A.: Information Theory, Cambridge University Press, 1997 (EN)
SCHNEIER, B. Applied Cryptography, John Wiley & Sons, Inc. 1996. (EN)

Recommended reading

Přibyl J.,Kodl J.: Ochrana dat v informatice. (CS)
SAYOOD, K.: Introduction to Data Compression, Fifth Edition, 2017, ISBN 978-0-12809-474-7 (EN)

Classification of course in study plans

  • Programme N-AIŘ-P Master's 1 year of study, summer semester, compulsory
  • Programme N-MAI-P Master's 1 year of study, summer semester, elective

  • Programme C-AKR-P Lifelong learning

    specialization CLS , 1 year of study, summer semester, elective

Type of course unit

 

Lecture

26 hod., optionally

Teacher / Lecturer

prof. Ing. Radomil Matoušek, Ph.D.

Syllabus

1. Introduction to the information theory 1/2 (information, entropy, mutual information).
2. Introduction to the information theory 2/2 (channel capacity, noisy-channel coding theorem).
3. Basic principle of communication (model of discrete channel).
4. Introduction to encoding theory.
5. Bar Code. RFID technology.
6. Data compression I.
7. Data compression II.
8. Error detection and correction I.
9. Error detection and correction II.
10. Cryptogaphy I.
11. Cryptogaphy II.
12. Cryptogaphy III.
13. Advanced in encoding and cryptography theory (quantum cryptography).

Computer-assisted exercise

26 hod., compulsory

Teacher / Lecturer

prof. Ing. Radomil Matoušek, Ph.D.

Syllabus

Computer labs (exercises) are consistent with the content of lectures. The aim of the labs is to introduce students to practical part of the course above all using Matlab/Simulink system.
The labs are divided into six parts:
a) Bit rate, channel capacity, information ratio.
b) Signals, modulation methods.
c) Bar code.
d) Data compression.
e) Error detection and correction.
f) Cryptography.