Course detail

Information Theory and Encoding

FSI-VTI-KAcad. year: 2014/2015

The course is aimed to basics in information theory (message, entropy, transfer of information, discrete and continuous channels) and signals (signal processing, modulation). Further the course includes basic overview of coding methods in areas: bar codes, compression codes, error correcting codes and cryptography. At the end of the course the modern trends in coding are presented (quantum error correction, quantum cryptography).

Language of instruction

Czech

Number of ECTS credits

5

Mode of study

Not applicable.

Guarantor

prof. Ing. Pavel Ošmera, CSc.

Department

Institute of Automation and Computer Science (ÚAI)

Learning outcomes of the course unit

The acquired knowledge will be sufficient for the basic orientation in the Theory of Information.

Prerequisites

Basic mathematical knowledge is required.

Co-requisites

Not applicable.

Planned learning activities and teaching methods

The course is taught through lectures explaining the basic principles and theory of the discipline. Exercises are focused on practical topics presented in lectures.

Assesment methods and criteria linked to learning outcomes

The active participation and mastering the assigned task.

Course curriculum

1. Introduction to the information theory
2. Basic concepts of the information theory
3. Exercises to basic concepts
4. The discrete memoryless information source
5. Exercises to the discrete memoryless information source
6. The discrete information source with memory
7. The discrete communication channel
8. Network information theory
9. Error-correcting codes

Work placements

Not applicable.

Aims

The course objective is to make students familiar with the basics of the Theory of information.

Specification of controlled education, way of implementation and compensation for absences

Solving an extra assignment can compensate absence.

Recommended optional programme components

Not applicable.

Prerequisites and corequisites

Not applicable.

Basic literature

Lubbe J.C.A.: Information Theory, Cambridge University Press, 1997
SIMMOND A.: Data Communication and Transmission Principles, , 0
TERRELL T.J.,SHARK K.L.: Digital Signal Processing, , 0
USHER M.J.,GUY C.G,: Information and Communication for Engineers, , 0

Recommended reading

Lubbe J.C.A.: Information Theory, Cambridge University Press, 1997
Ošmera P.: Informační systémy, , 0
Ošmera P.: Mikroprocesorová technika a informační systémy, , 0
Přibyl J.,Kodl J.: Ochrana dat v informatice, , 0

Classification of course in study plans

  • Programme B2341-3 Bachelor's

    branch B-AIŘ , 3 year of study, winter semester, compulsory

Type of course unit

 

Guided consultation

17 hod., optionally

Teacher / Lecturer

prof. Ing. Radomil Matoušek, Ph.D.

Syllabus

1. Introduction to the information theory (channel capacity, noisy-channel coding theorem).
2. Basic principle of communication (discrete and continuous channel).
3. Signal processing.
4. Introduction to encoding theory.
5. Bar Code. RFID technology.
6. Data compression I.
7. Data compression II.
8. Error detection and correction I.
9. Error detection and correction II.
10. Cryptogaphy I.
11. Cryptogaphy II.
12. Cryptogaphy III.
13. Advanced in encoding and cryptography theory (quantum cryptography).