Journal ArticleDOI
Assessment of Machine Learning-Based Audiovisual Quality Predictors: Why Uncertainty Matters
K Mythili,Manish Narwaria +1 more
Reads0
Chats0
TLDR
In this paper, the authors raise some fundamental questions about the current approach of ML-based model development for audiovisual quality assessment and signal processing for multimedia communication in general.Abstract:
Quality assessment of audiovisual (AV) signals is important from the perspective of system design, optimization, and management of a modern multimedia communication system. However, automatic prediction of AV quality via the use of computational models remains challenging. In this context, machine learning (ML) appears to be an attractive alternative to the traditional approaches. This is especially when such assessment needs to be made in no-reference (i.e., the original signal is unavailable) fashion. While development of ML-based quality predictors is desirable, we argue that proper assessment and validation of such predictors is also crucial before they can be deployed in practice. To this end, we raise some fundamental questions about the current approach of ML-based model development for AV quality assessment and signal processing for multimedia communication in general. We also identify specific limitations associated with the current validation strategy which have implications on analysis and comparison of ML-based quality predictors. These include a lack of consideration of: (a) data uncertainty, (b) domain knowledge, (c) explicit learning ability of the trained model, and (d) interpretability of the resultant model. Therefore, the primary goal of this article is to shed some light into mentioned factors. Our analysis and proposed recommendations are of particular importance in the light of significant interests in ML methods for multimedia signal processing (specifically in cases where human-labeled data is used), and a lack of discussion of mentioned issues in existing literature.read more
References
More filters
Proceedings ArticleDOI
XGBoost: A Scalable Tree Boosting System
Tianqi Chen,Carlos Guestrin +1 more
TL;DR: XGBoost as discussed by the authors proposes a sparsity-aware algorithm for sparse data and weighted quantile sketch for approximate tree learning to achieve state-of-the-art results on many machine learning challenges.
Journal ArticleDOI
Mathematical Contributions to the Theory of Evolution. III. Regression, Heredity, and Panmixia
TL;DR: A considerable portion of the present memoir is devoted to the expansion and fuller development of Galton's ideas, particularly their application to the problem of bi-parental inheritance as mentioned in this paper.
Journal ArticleDOI
Machine Learning Interpretability: A Survey on Methods and Metrics
TL;DR: A review of the current state of the research field on machine learning interpretability while focusing on the societal impact and on the developed methods and metrics is provided.
Journal Article
Distance metric learning with eigenvalue optimization
Yiming Ying,Peng Li +1 more
TL;DR: A novel metric learning approach called DML-eig is introduced which is shown to be equivalent to a well-known eigen value optimization problem called minimizing the maximal eigenvalue of a symmetric matrix.
Journal ArticleDOI
Objective Image Quality Assessment Based on Support Vector Regression
Manish Narwaria,Weisi Lin +1 more
TL;DR: A new approach to address the problem of objective image quality estimation, with the use of singular vectors out of singular value decomposition (SVD) as features for quantifying major structural information in images and then support vector regression (SVR) for automatic prediction of image quality.