Course detail

Multimedia

FIT-MULAcad. year: 2022/2023

Definition of multimedia technology, multimedia peripheral devices, connection between signal processing and multimedia, digital signal processors and their features, "case study" of system design with digital signal processor, Windows sound, video, and raster operation API, formats for image and sound digitization, formats for image and sound encoding, image compression, video compression, sound compression, DirectX raster operations, DirectX sound, OpenGL raster operations, multimedia programming interfaces.

Language of instruction

Czech

Number of ECTS credits

5

Mode of study

Not applicable.

Guarantor

prof. Dr. Ing. Pavel Zemčík, dr. h. c.

Department

Department of Computer Graphics and Multimedia (UPGM)

Learning outcomes of the course unit

The students will learn and understand basic methods of image processing and sound processing as 2D and 1D digital signals. They will get acquainted with compression and decompression methods for image and sound data in PC environment. They will also learn how to exploit programmers interfaces' for image and sound and get acquainted with data formats for image and sound representation and with basic features of digital signal processors. They will learn about raster operations in Windows API, DirectX, and OpenGL and with sound interfaces of Windows API and DirectX, too. Finally, they will get acquainted with the anticipated development of multimedia data processing.
The students will learn to search team partners, to work in team, and to defend their work in public. They will also improve their skills in development tools usage and also in practical C/C++ programming.

Prerequisites

Basic knowledge of C/C++ programming, basics of signal processing.

Co-requisites

Not applicable.

Planned learning activities and teaching methods

Not applicable.

Assesment methods and criteria linked to learning outcomes

Mid-term test, evaluated computer exercises, and individual project.

Course curriculum

  1. Introduction, signal processing (slides)
  2. Filtration (slides)
  3. Compression techniques (slides)
  4. Audio formats (slides, new slides)
  5. Sound interfaces (slides)
  6. Image and video compression fundamentals (slides)
  7. Image formats (slides)
  8. Video formats (slides)
  9. Multimedia frameworks (slides), mid-term test
  10. DirectX (slides)
  11. OpenGL (slides)
  12. Formats and technologies in TV (slides)
  13. Conclusion

Work placements

Not applicable.

Aims

To learn and understand basic methods of image processing and sound processing as 2D and 1D digital signals. To get acquainted with compression and decompression methods for image and sound data in PC environment. To learn how to exploit programmers' interfaces for image and sound. To get acquainted with data formats for image and sound representation. To get acquainted with basic features of digital signal processors. To learn about raster operations in Windows API, DirectX, and OpenGL and sound interfaces of Windows API and DirectX. To get acquainted with the anticipated development of multimedia data processing.

Specification of controlled education, way of implementation and compensation for absences

The monitored teaching activities include mid-term test, evaluated computer exercises, individual project, and final exam. The mid-term test does not have correction option, the final exam has two possible correction terms.

Recommended optional programme components

Not applicable.

Prerequisites and corequisites

Basic literature

Not applicable.

Recommended reading

David Salomon, Giovanni Motta. Handbook of Data Compression. Springer, 2010. ISBN 978-1-84882-902-2
Iain E. G. Richardson. H.264 and MPEG-4 Video Compression: Video Coding for Next-generation Multimedia. John Wiley & Sons, 2003. ISBN 978-0-470-86960-7
IEEE Multimedia, IEEE, USA - série časopisů - různé články (CS)
IEEE Multimedia, IEEE, USA – various articles (EN)
John Watkinson. The MPEG Handbook. CRC Press, 2012. ISBN 978-1-136-02898-6
Simon, R. J.: Multimedia & ODBC API Bible, Watte Group Press, Carte Madera, CA, USA, 1996, ISBN 1-57169-011-5
Studijní opora „Multimédia“ ke stažení (CS)
Study support "Multimedia" (in Czech) to download (EN)
Wodtke, M.: Mind Over Media, McGraw-Hill, New York, USA, 1993, ISBN 0-07-067633-X
Yun Q. Shi, Huifang Sun. Image and Video Compression for Multimedia Engineering: Fundamentals, Algorithms, and Standards. CRC Press, 1999. ISBN 978-1-4200-4979-8

Elearning

eLearning: currently opened course

Classification of course in study plans

  • Programme IT-MSC-2 Master's

    branch MBI , 0 year of study, summer semester, elective
    branch MBS , 0 year of study, summer semester, elective
    branch MGM , 1 year of study, summer semester, compulsory
    branch MIN , 0 year of study, summer semester, elective
    branch MMM , 0 year of study, summer semester, elective
    branch MPV , 0 year of study, summer semester, elective
    branch MSK , 0 year of study, summer semester, elective

  • Programme MITAI Master's

    specialization NADE , 0 year of study, summer semester, elective
    specialization NBIO , 0 year of study, summer semester, elective
    specialization NCPS , 0 year of study, summer semester, elective
    specialization NEMB , 0 year of study, summer semester, elective
    specialization NGRI , 0 year of study, summer semester, compulsory
    specialization NHPC , 0 year of study, summer semester, elective
    specialization NIDE , 0 year of study, summer semester, elective
    specialization NISD , 0 year of study, summer semester, elective
    specialization NISY up to 2020/21 , 0 year of study, summer semester, elective
    specialization NMAL , 0 year of study, summer semester, elective
    specialization NMAT , 0 year of study, summer semester, elective
    specialization NNET , 0 year of study, summer semester, elective
    specialization NSEC , 0 year of study, summer semester, elective
    specialization NSEN , 0 year of study, summer semester, elective
    specialization NSPE , 0 year of study, summer semester, elective
    specialization NVER , 0 year of study, summer semester, elective
    specialization NVIZ , 0 year of study, summer semester, elective
    specialization NISY , 0 year of study, summer semester, elective

  • Programme IT-MSC-2 Master's

    branch MIS , 0 year of study, summer semester, compulsory-optional

  • Programme VUB Bachelor's

    branch VU-D , 3 year of study, summer semester, elective
    branch VU-IDT , 3 year of study, summer semester, elective
    branch VU-VT , 3 year of study, summer semester, elective
    branch VU-VT , 3 year of study, summer semester, elective
    branch VU-VT , 3 year of study, summer semester, elective
    branch VU-VT , 3 year of study, summer semester, elective
    branch VU-IDT , 3 year of study, summer semester, elective
    branch VU-IDT , 3 year of study, summer semester, elective
    branch VU-IDT , 3 year of study, summer semester, elective
    branch VU-IDT , 3 year of study, summer semester, elective
    branch VU-VT , 3 year of study, summer semester, elective
    branch VU-D , 3 year of study, summer semester, elective
    branch VU-VT , 3 year of study, summer semester, elective
    branch VU-IDT , 3 year of study, summer semester, elective
    branch VU-D , 3 year of study, summer semester, elective
    branch VU-IDT , 3 year of study, summer semester, elective

  • Programme MITAI Master's

    specialization NEMB up to 2021/22 , 0 year of study, summer semester, elective

Type of course unit

 

Lecture

26 hod., optionally

Teacher / Lecturer

Ing. Matej Karas
Ing. David Bařina, Ph.D.
prof. Dr. Ing. Pavel Zemčík, dr. h. c.
Ing. Tomáš Milet, Ph.D.
Ing. František Grézl, Ph.D.

Syllabus

  1. Úvod, Kompresní techniky (8. 2. 2023, slajdy, slajdy)
  2. Zpracování signálu (15. 2. 2023)
  3. Filtrace (22. 2. 2023, slajdy)
  4. Principy komprese obrazu a videa (1. 3. 2023, slajdy)
  5. Zvuková rozhraní (8. 3. 2023, slajdy)
  6. Zvukové formáty (15. 3. 2023, slajdy, nové slajdy)
  7. Formáty obrazu (22. 3. 2023, slajdy)
  8. Formáty videa (29. 3. 2023, slajdy)
  9. Multimediální frameworky (5. 4. 2023, slajdy), půlsem. test
  10. Vulkan (12. 4. 2023)
  11. OpenGL (19. 4. 2023, slajdy)
  12. Formáty a technologie TV (26. 4. 2023, slajdy)
  13. Závěr, DSP use case (3. 5. 2023, slajdy)

Exercise in computer lab

13 hod., compulsory

Teacher / Lecturer

Ing. Jozef Kobrtek, Ph.D.
Ing. Tomáš Chlubna
Ing. David Bařina, Ph.D.

Syllabus

  1. Introductory lab, introduction to tools
  2. Sound filter design and implementation
  3. JPEG compression - DCT settings
  4. Multimedia framework FFmpeg
  5. Shaders
  6. OpenGL

Project

13 hod., compulsory

Teacher / Lecturer

Ing. David Bařina, Ph.D.

Syllabus

  1. Individually assigned examples for the duration of the course

E-learning texts

BAŘINA, David. Multimédia: Studijní opora. 2023. Vysoké učení technické v Brně.
mul-opora-2023-04-04.pdf 1.3 MB

Elearning

eLearning: currently opened course