We review the history of the development of transform-based image and video codecs and re-construct logical chains that led to the inventions of DCT, zigzag scan, adaptive coding, and hybrid DPCM + transform-based architecture. We also review the subsequent evolution of this architecture and explain the reasoning behind multiple transform choices in modern video codecs (HEVC, VVC, etc.), in-loop filters, etc. Finally, we also describe the role of fast transform algorithms in image and video codec evolution and will give an outlook on current developments, including increasing use of CNNs, learning methods, and performance-energy usage tradeoffs that may shape future architectures.
|