JEG HEVC DB analysis
Agreement analysis between pairs
Comparing two processed video sequences (PVS) originating from the same uncompressed video by means of PSNR, SSIM, VIF, it is possible that:
- all metrics agree on which sequence has the best quality;
- one of the three metrics gives another indication.
In the latter case, considering all these pairs of sequences, the value of the other two metrics is shown in the graph below. In particular, if x is SSIM and y is VIF, it means that the metric which disagrees is the third one, i.e., PSNR. The graph shows the number of pairs that, for the specific SSIM and VIF difference, disagrees on the PSNR.
src01:
src02:
src03:
src04:
src05:
src06:
src07:
src08:
src09:
src10:
All together:
Prediction consistency
Selecting a given percentile value it is possible to identify a reasonable threshold for the prediction consistency of the measure with respect to the two others. Values are strongly dependent on the sequence and also on the cause of disagreement (i.e., the measure that disagrees) within the same sequence.
95 percentile:
99 percentile: