Toward Better Statistical Validation of Machine Learning-Based Multimedia Quality Estimators
Citations
33 citations
20 citations
Cites methods from "Toward Better Statistical Validatio..."
...In this work, we follow the traditional way to randomly split the distorted images into training and test set according to the 80/20 rule despite of some limitations such as possibly dependent sample observations [43]....
[...]
5 citations
4 citations
2 citations
References
19,398 citations
"Toward Better Statistical Validatio..." refers background in this paper
..., class label 0) scores (recall that in our context, we assign a label 1 if d(i, j) > th and 0 otherwise) [45], [46], while oth-...
[...]
17,017 citations
"Toward Better Statistical Validatio..." refers background or methods in this paper
...The AUC values from the ROC analysis performed only on statistically different pairs are then used to compare objective quality predictors....
[...]
...This can be treated as a binary classification problem and analyzed based on ROC analysis [40]–[42]....
[...]
...The idea was further extended to include Receiver Operating Characteristics (ROC) [39] based comparison [40]–[42], and states that a better performance measure should be able to distinguish (classify) different quality levels by considering the dispersion (uncertainty) in the opinion scores....
[...]
...The idea was further extended to include Receiver Operating Characteristics (ROC) [39] based compar-...
[...]
...The Area Under Curve (AUC) is then to evaluate discrimination abilities [39]....
[...]
10,306 citations
"Toward Better Statistical Validatio..." refers background in this paper
...While p-value or significance level adjustments have been proposed in literature to control the family-wise error error [18], these adjustment procedures are debatable due to practical reasons (for instance refer to [30]–[32])....
[...]
..., refer to [2]–[12] for some existing efforts in ML based quality estimation for video or [13]–[16] for standardized recommendations) reveals that these important issues have not been thoroughly examined (either from theoretical or practical view points) although few works such as [4], [9], and [11] have considered the practical implications of the first issue regarding the qualitative aspects of training and testing data (also refer to some related works on statistical comparison of classifiers [18] or analysis of their learning ability [19])....
[...]
6,420 citations
5,471 citations