Performance comparison of H.265/MPEG-HEVC, VP9, and H.264/MPEG-AVC encoders
01 Dec 2013-pp 394-397
TL;DR: This work presents a performance comparison of the two latest video coding standards H.265/MPEG-HEVC (High-Efficiency Video Coding) as well as the recently published proprietary video coding scheme VP9, which provides significant average bit-rate savings relative to VP9 and H.264/ MPEG-AVC.
Abstract: This work presents a performance comparison of the two latest video coding standards H.264/MPEG-AVC and H.265/MPEG-HEVC (High-Efficiency Video Coding) as well as the recently published proprietary video coding scheme VP9. According to the experimental results, which were obtained for a whole test set of video sequences by using similar encoding configurations for all three examined representative encoders, H.265/MPEG-HEVC provides significant average bit-rate savings of 43.3% and 39.3% relative to VP9 and H.264/MPEG-AVC, respectively. As a particular aspect of the conducted experiments, it turned out that the VP9 encoder produces an average bit-rate overhead of 8.4% at the same objective quality, when compared to an open H.264/MPEG-AVC encoder implementation - the x264 encoder. On the other hand, the typical encoding times of the VP9 encoder are more than 100 times higher than those measured for the x264 encoder. When compared to the full-fledged H.265/MPEG-HEVC reference software encoder implementation, the VP9 encoding times are lower by a factor of 7.35, on average.
Citations
More filters
TL;DR: The technical development of HAS, existing open standardized solutions, but also proprietary solutions are reviewed in this paper as fundamental to derive the QoE influence factors that emerge as a result of adaptation.
Abstract: Changing network conditions pose severe problems to video streaming in the Internet. HTTP adaptive streaming (HAS) is a technology employed by numerous video services that relieves these issues by adapting the video to the current network conditions. It enables service providers to improve resource utilization and Quality of Experience (QoE) by incorporating information from different layers in order to deliver and adapt a video in its best possible quality. Thereby, it allows taking into account end user device capabilities, available video quality levels, current network conditions, and current server load. For end users, the major benefits of HAS compared to classical HTTP video streaming are reduced interruptions of the video playback and higher bandwidth utilization, which both generally result in a higher QoE. Adaptation is possible by changing the frame rate, resolution, or quantization of the video, which can be done with various adaptation strategies and related client- and server-side actions. The technical development of HAS, existing open standardized solutions, but also proprietary solutions are reviewed in this paper as fundamental to derive the QoE influence factors that emerge as a result of adaptation. The main contribution is a comprehensive survey of QoE related works from human computer interaction and networking domains, which are structured according to the QoE impact of video adaptation. To be more precise, subjective studies that cover QoE aspects of adaptation dimensions and strategies are revisited. As a result, QoE influence factors of HAS and corresponding QoE models are identified, but also open issues and conflicting results are discussed. Furthermore, technical influence factors, which are often ignored in the context of HAS, affect perceptual QoE influence factors and are consequently analyzed. This survey gives the reader an overview of the current state of the art and recent developments. At the same time, it targets networking researchers who develop new solutions for HTTP video streaming or assess video streaming from a user centric point of view. Therefore, this paper is a major step toward truly improving HAS.
746 citations
Cites background from "Performance comparison of H.265/MPE..."
...265/HEVC [123]–[125] and VP9 [126], [127] will become relevant for HAS in the next years....
[...]
01 Oct 2015
TL;DR: This paper introduces IoMT as a novel paradigm in which smart heterogeneous multimedia things can interact and cooperate with one another and with other things connected to the Internet to facilitate multimedia based services and applications that are globally available to the users.
Abstract: Internet of Things (IoT) systems cannot successfully realize the notion of ubiquitous connectivity of everything if they are not capable to truly include 'multimedia things'. However, the current research and development activities in the field do not mandate the features of multimedia objects, thus leaving a gap to benefit from multimedia content based services and applications. In this paper, we analyze this issue by contemplating the concept of IoT and drawing an inspiration towards the perspective vision of 'Internet of Multimedia Things' (IoMT). Therein, we introduce IoMT as a novel paradigm in which smart heterogeneous multimedia things can interact and cooperate with one another and with other things connected to the Internet to facilitate multimedia based services and applications that are globally available to the users. Some applications and use-cases for IoMT are presented to reflect the possibilities enabled by this new paradigm. An IoMT architecture is then presented which is segregated into four distinct stages; (i) multimedia sensing, (ii) reporting and addressability, (iii) multimedia-aware cloud, and (iv) multi-agent systems. Instead of proposing specific technical solutions for each individual stage of the presented architecture, we survey the already existing technologies, providing a synthesis for the realization of the vision of IoMT. Subsequently, various requirements and challenges as well as the feasibility of existing solutions for each stage of proposed IoMT architecture are comprehensively discussed.
218 citations
Cites background or methods from "Performance comparison of H.265/MPE..."
...Authors in [41] presented the comparative analysis of these encoding techniques, using x264 [44] reference software for H....
[...]
...Performance comparisons of these three video compression schemes are referenced therein [41–43]....
[...]
TL;DR: The limitations of IoT for multimedia computing are explored and the relationship between the M-IoT and emerging technologies including event processing, feature extraction, cloud computing, Fog/Edge computing and Software-Defined-Networks (SDNs) is presented.
Abstract: The immense increase in multimedia-on-demand traffic that refers to audio, video, and images, has drastically shifted the vision of the Internet of Things (IoT) from scalar to Multimedia Internet of Things (M-IoT). IoT devices are constrained in terms of energy, computing, size, and storage memory. Delay-sensitive and bandwidth-hungry multimedia applications over constrained IoT networks require revision of IoT architecture for M-IoT. This paper provides a comprehensive survey of M-IoT with an emphasis on architecture, protocols, and applications. This article starts by providing a horizontal overview of the IoT. Then, we discuss the issues considering the characteristics of multimedia and provide a summary of related M-IoT architectures. Various multimedia applications supported by IoT are surveyed, and numerous use cases related to road traffic management, security, industry, and health are illustrated to show how different M-IoT applications are revolutionizing human life. We explore the importance of Quality-of-Experience (QoE) and Quality-of-Service (QoS) for multimedia transmission over IoT. Moreover, we explore the limitations of IoT for multimedia computing and present the relationship between the M-IoT and emerging technologies including event processing, feature extraction, cloud computing, Fog/Edge computing and Software-Defined-Networks (SDNs). We also present the need for better routing and Physical-Medium Access Control (PHY-MAC) protocols for M-IoT. Finally, we present a detailed discussion on the open research issues and several potential research areas related to emerging multimedia communication in IoT.
182 citations
Cites background from "Performance comparison of H.265/MPE..."
...265, VP9, and DAALA has been presented in [43]....
[...]
...Various multimedia encoding and compression techniques to reduce the complexity of multimedia data transmission in IoT has been detailed in [43], [173]–[182]....
[...]
TL;DR: In this article, a large-scale video codec comparison test is performed for VP9 encoder settings optimized for non-real-time random access, as used in a video-on-demand encoding pipeline.
Abstract: Over the last years, we have seen exciting improvements in video compression technology, due to the introduction of HEVC and royalty-free coding specifications such as VP9. The potential compression gains of HEVC over H.264/AVC have been demonstrated in different studies, and are usually based on the HM reference software. For VP9, substantial gains over H.264/AVC have been reported in some publications, whereas others reported less optimistic results. Differences in configurations between these publications make it more difficult to assess the true potential of VP9. Practical open-source encoder implementations such as x265 and libvpx (VP9) have matured, and are now showing high compression gains over x264. In this paper, we demonstrate the potential of these encoder imple- mentations, with settings optimized for non-real-time random access, as used in a video-on-demand encoding pipeline. We report results from a large-scale video codec comparison test, which includes x264, x265 and libvpx. A test set consisting of a variety of titles with varying spatio-temporal characteristics from our catalog is used, resulting in tens of millions of encoded frames, hence larger than test sets previously used in the literature. Re- sults are reported in terms of PSNR, SSIM, MS-SSIM, VIF and the recently introduced VMAF quality metric. BD-rate calculations show that using x265 and libvpx vs. x264 can lead to significant bitrate savings for the same quality. x265 outperforms libvpx in most cases, but the performance gap narrows (or even reverses) at the higher resolutions.
71 citations
Cites background from "Performance comparison of H.265/MPE..."
...Mukherjee et al.10 and Grois et al.21 were two of the initial studies that aimed to compare HEVC and VP9 compression performance....
[...]
...and Grois et al.(21) were two of the initial studies that aimed to compare HEVC and VP9 compression performance....
[...]
...For the set of 16 HD sequences, VP9 resulted in 30.4% bitrate savings over x264 and required 2.5% more bits than HEVC for the same PSNR. Grois et al.21 on the other hand reported less favorable results for VP9 with libvpx....
[...]
...Grois et al.(21) on the other hand reported less favorable results for VP9 with libvpx....
[...]
01 Jan 2016
TL;DR: It was observed that the AOM/AV1 encoding times are quite similar to those of the full-fledged HM and JM reference software encoders, while the typical encoding times of the HM encoder are in the range of 30–300 times higher on average than those measured for the configurable HHI HEVC encoder, depending on its chosen trade-off between encoding speed and coding efficiency.
Abstract: This work presents a coding efficiency evaluation of the recently published first release of the video coding scheme of the Alliance for Open Media (AOM), so called AOM/AV1, in comparison to the video coding standards H.264/MPEG-AVC (Advanced Video Coding) and H.265/MPEG-HEVC (High-Efficiency Video Coding). As representatives of the two last-mentioned video coding standards, the corresponding reference software encoders of JM and HM were selected, and for HEVC, in addition, the Fraunhofer HHI HEVC commercial software encoder and the open source software implementation x265 were used. According to the experimental results, which were obtained by using similar configurations for all examined representative encoders, the H.265/MPEG-HEVC reference software implementation provides significant average bit-rate savings of 38.4 % and 32.8 % compared to AOM/AV1 and H.264/MPEG-AVC, respectively. Particularly, when directly compared to H.264/MPEG-AVC High Profile, the AOM/AV1 encoder produces an average bit-rate overhead of 10.5% at the same objective quality. In addition, it was observed that the AOM/AV1 encoding times are quite similar to those of the full-fledged HM and JM reference software encoders. On the other hand, the typical encoding times of the HM encoder are in the range of 30–300 times higher on average than those measured for the configurable HHI HEVC encoder, depending on its chosen trade-off between encoding speed and coding efficiency.
65 citations
References
More filters
TL;DR: An overview of the technical features of H.264/AVC is provided, profiles and applications for the standard are described, and the history of the standardization process is outlined.
Abstract: H.264/AVC is newest video coding standard of the ITU-T Video Coding Experts Group and the ISO/IEC Moving Picture Experts Group. The main goals of the H.264/AVC standardization effort have been enhanced compression performance and provision of a "network-friendly" video representation addressing "conversational" (video telephony) and "nonconversational" (storage, broadcast, or streaming) applications. H.264/AVC has achieved a significant improvement in rate-distortion efficiency relative to existing standards. This article provides an overview of the technical features of H.264/AVC, describes profiles and applications for the standard, and outlines the history of the standardization process.
8,646 citations
"Performance comparison of H.265/MPE..." refers methods in this paper
...264/MPEG-4 Advanced Video Coding (AVC) [2] standards, the development of which was coordinated by the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Pictures Expert Group (MPEG)....
[...]
...264/MPEGAVC-based products and services [2], [4]....
[...]
TL;DR: The main goal of the HEVC standardization effort is to enable significantly improved compression performance relative to existing standards-in the range of 50% bit-rate reduction for equal perceptual video quality.
Abstract: High Efficiency Video Coding (HEVC) is currently being prepared as the newest video coding standard of the ITU-T Video Coding Experts Group and the ISO/IEC Moving Picture Experts Group. The main goal of the HEVC standardization effort is to enable significantly improved compression performance relative to existing standards-in the range of 50% bit-rate reduction for equal perceptual video quality. This paper provides an overview of the technical features and characteristics of the HEVC standard.
7,383 citations
"Performance comparison of H.265/MPE..." refers methods in this paper
...265/MPEG-HEVC-based encoding [19], [20], the HM reference software encoder [21] was selected, since it is currently considered as the most popular available encoder implementation....
[...]
01 Jan 2001
4,379 citations
"Performance comparison of H.265/MPE..." refers background in this paper
..., for the same PSNRYUV values) [26], where negative BD-BR values indicate actual bit-rate savings....
[...]
...In addition, Table IV presents detailed experimental results, including the calculated BD-BR savings [26]....
[...]
TL;DR: A unified approach to the coder control of video coding standards such as MPEG-2, H.263, MPEG-4, and the draft video coding standard H.264/AVC (advanced video coding) is presented.
Abstract: A unified approach to the coder control of video coding standards such as MPEG-2, H.263, MPEG-4, and the draft video coding standard H.264/AVC (advanced video coding) is presented. The performance of the various standards is compared by means of PSNR and subjective testing results. The results indicate that H.264/AVC compliant encoders typically achieve essentially the same reproduction quality as encoders that are compliant with the previous standards while typically requiring 60% or less of the bit rate.
3,312 citations