Course detail
Multimedia
FIT-MULAcad. year: 2022/2023
Definition of multimedia technology, multimedia peripheral devices, connection between signal processing and multimedia, digital signal processors and their features, "case study" of system design with digital signal processor, Windows sound, video, and raster operation API, formats for image and sound digitization, formats for image and sound encoding, image compression, video compression, sound compression, DirectX raster operations, DirectX sound, OpenGL raster operations, multimedia programming interfaces.
Language of instruction
Number of ECTS credits
Mode of study
Learning outcomes of the course unit
The students will learn and understand basic methods of image processing and sound processing as 2D and 1D digital signals. They will get acquainted with compression and decompression methods for image and sound data in PC environment. They will also learn how to exploit programmers interfaces' for image and sound and get acquainted with data formats for image and sound representation and with basic features of digital signal processors. They will learn about raster operations in Windows API, DirectX, and OpenGL and with sound interfaces of Windows API and DirectX, too. Finally, they will get acquainted with the anticipated development of multimedia data processing.
The students will learn to search team partners, to work in team, and to defend their work in public. They will also improve their skills in development tools usage and also in practical C/C++ programming.
Prerequisites
Co-requisites
Planned learning activities and teaching methods
Assesment methods and criteria linked to learning outcomes
Course curriculum
- Introduction, signal processing (slides)
- Filtration (slides)
- Compression techniques (slides)
- Audio formats (slides, new slides)
- Sound interfaces (slides)
- Image and video compression fundamentals (slides)
- Image formats (slides)
- Video formats (slides)
- Multimedia frameworks (slides), mid-term test
- DirectX (slides)
- OpenGL (slides)
- Formats and technologies in TV (slides)
- Conclusion
Work placements
Aims
Specification of controlled education, way of implementation and compensation for absences
Recommended optional programme components
Prerequisites and corequisites
- recommended prerequisite
Basic literature
Recommended reading
IEEE Multimedia, IEEE, USA – various articles (EN)
IEEE Multimedia, IEEE, USA - série časopisů - různé články (CS)
Studijní opora „Multimédia“ ke stažení (CS)
Wodtke, M.: Mind Over Media, McGraw-Hill, New York, USA, 1993, ISBN 0-07-067633-X
Simon, R. J.: Multimedia & ODBC API Bible, Watte Group Press, Carte Madera, CA, USA, 1996, ISBN 1-57169-011-5
Yun Q. Shi, Huifang Sun. Image and Video Compression for Multimedia Engineering: Fundamentals, Algorithms, and Standards. CRC Press, 1999. ISBN 978-1-4200-4979-8
John Watkinson. The MPEG Handbook. CRC Press, 2012. ISBN 978-1-136-02898-6
David Salomon, Giovanni Motta. Handbook of Data Compression. Springer, 2010. ISBN 978-1-84882-902-2
Iain E. G. Richardson. H.264 and MPEG-4 Video Compression: Video Coding for Next-generation Multimedia. John Wiley & Sons, 2003. ISBN 978-0-470-86960-7
eLearning
Classification of course in study plans
- Programme VUB Bachelor's
branch VU-D , 3. year of study, summer semester, elective
branch VU-D , 3. year of study, summer semester, elective
branch VU-D , 3. year of study, summer semester, elective
branch VU-VT , 3. year of study, summer semester, elective
branch VU-VT , 3. year of study, summer semester, elective
branch VU-VT , 3. year of study, summer semester, elective
branch VU-VT , 3. year of study, summer semester, elective
branch VU-VT , 3. year of study, summer semester, elective
branch VU-VT , 3. year of study, summer semester, elective
branch VU-IDT , 3. year of study, summer semester, elective
branch VU-IDT , 3. year of study, summer semester, elective
branch VU-IDT , 3. year of study, summer semester, elective
branch VU-IDT , 3. year of study, summer semester, elective
branch VU-IDT , 3. year of study, summer semester, elective
branch VU-IDT , 3. year of study, summer semester, elective
branch VU-IDT , 3. year of study, summer semester, elective - Programme IT-MGR-2 Master's
branch MBI , any year of study, summer semester, elective
branch MPV , any year of study, summer semester, elective
branch MSK , any year of study, summer semester, elective
branch MIS , any year of study, summer semester, compulsory-optional
branch MBS , any year of study, summer semester, elective
branch MIN , any year of study, summer semester, elective
branch MMM , any year of study, summer semester, elective - Programme MITAI Master's
specialization NADE , any year of study, summer semester, elective
specialization NBIO , any year of study, summer semester, elective
specialization NGRI , any year of study, summer semester, compulsory
specialization NNET , any year of study, summer semester, elective
specialization NVIZ , any year of study, summer semester, elective
specialization NCPS , any year of study, summer semester, elective
specialization NSEC , any year of study, summer semester, elective
specialization NEMB , any year of study, summer semester, elective
specialization NEMB do 2021/22 , any year of study, summer semester, elective
specialization NHPC , any year of study, summer semester, elective
specialization NISD , any year of study, summer semester, elective
specialization NIDE , any year of study, summer semester, elective
specialization NISY do 2020/21 , any year of study, summer semester, elective
specialization NISY , any year of study, summer semester, elective
specialization NMAL , any year of study, summer semester, elective
specialization NMAT , any year of study, summer semester, elective
specialization NSEN , any year of study, summer semester, elective
specialization NVER , any year of study, summer semester, elective
specialization NSPE , any year of study, summer semester, elective - Programme IT-MGR-2 Master's
branch MGM , 1. year of study, summer semester, compulsory
Type of course unit
Lecture
Teacher / Lecturer
Syllabus
- Úvod, Kompresní techniky (8. 2. 2023, slajdy, slajdy)
- Zpracování signálu (15. 2. 2023)
- Filtrace (22. 2. 2023, slajdy)
- Principy komprese obrazu a videa (1. 3. 2023, slajdy)
- Zvuková rozhraní (8. 3. 2023, slajdy)
- Zvukové formáty (15. 3. 2023, slajdy, nové slajdy)
- Formáty obrazu (22. 3. 2023, slajdy)
- Formáty videa (29. 3. 2023, slajdy)
- Multimediální frameworky (5. 4. 2023, slajdy), půlsem. test
- Vulkan (12. 4. 2023)
- OpenGL (19. 4. 2023, slajdy)
- Formáty a technologie TV (26. 4. 2023, slajdy)
- Závěr, DSP use case (3. 5. 2023, slajdy)
Exercise in computer lab
Teacher / Lecturer
Syllabus
- Introductory lab, introduction to tools
- Sound filter design and implementation
- JPEG compression - DCT settings
- Multimedia framework FFmpeg
- Shaders
- OpenGL
Project
Teacher / Lecturer
Syllabus
- Individually assigned examples for the duration of the course
E-learning texts
- Studijní opora do MUL [.pdf] 1.3 MB
eLearning