Performance Comparison of Video Codecs

About

This is a codec comparison dataset, the BVI-CC, produced with the purpose of a performance assessment of three competitive video codecs: High Efficiency Video Coding (HEVC) Test Model (HM), AOMedia Video 1 (AV1) and Versatile Video Coding Test Model (VTM). Nine source video sequences were carefully selected to offer both diversity and representativeness in the spatio-temporal domain. Different spatial resolution versions of the sequences were created and encoded by all three codecs at pre-defined target bitrates. The compression efficiency of the codecs was evaluated with commonly used objective quality metrics. Furthermore, the subjective quality of their reconstructed content was evaluated through psychophysical experiments. Additionally, HEVC and AV1 were compared within an adaptive bitrate framework (convex hull rate-distortion optimization across resolutions), using both objective and subjective evaluations. Finally, the computational complexities of the tested codecs were examined. The findings from the subjective assessments indicate that, for the tested versions there is no significant difference between AV1 and HM, while the tested VTM version shows significant enhancements. All data have been made publicly available as part of the dataset. Parts of this work have been presented in the IEEE International Conference on Image Processing (ICIP) 2019 in Taipei and in the Alliance for Open Media (AOM) Symposium 2019 in San Francisco.

Thumbnails

Downloads

To get access and download the dataset, please fill in this form.

If this content has been mentioned in a research publication, please give credit to the University of Bristol, by referencing the following papers:

1. A. V. Katsenou, F. Zhang, M. Afonso and D. R. Bull, “A Subjective Comparison of AV1 and HEVC for Adaptive Video Streaming,” 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan, 2019, pp. 4145-4149.
2. A. V. Katsenou, F. Zhang, M. Afonso, Goce Dimitrov and D. R. Bull, “BVI-CC: A Dataset for Research on Video Compression and Quality Assessment”, arXiv:2003. 10282 [eess.IV], 2020.