Difference between revisions of "Software for objective quality evaluation"

From VQEG JEG Wiki
Jump to: navigation, search
m
Line 4: Line 4:
  
 
{| border="1" class="sortable"
 
{| border="1" class="sortable"
−
!
+
! || MSE || PSNR || SSIM || VIF || MS-SSIM || IFC || VQM || MOVIE || VMAF || Also computes ||
−
!MSE
+
−
!PSNR
+
−
!SNR
+
−
!SSIM
+
−
!VIF
+
−
!VIF pixed-based
+
−
!MS-SSIM
+
−
!PSNRHVS
+
−
!PSNRHVSM
+
−
!VSNR
+
−
!IFC
+
−
!UQI
+
−
!NQM
+
−
!WSNR
+
−
!VQM
+
−
!MOVIE
+
−
!VMAF
+
−
!URL to code
+
 
|-
 
|-
−
!VQMT
+
| VQMT || || x || x || x || x || ||  || || || PSNRHVS, PSNRHVSM || http://mmspg.epfl.ch/vqmt
−
|
+
−
|x
+
−
|
+
−
|x
+
−
|x
+
−
|
+
−
|x
+
−
|x
+
−
|x
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|http://mmspg.epfl.ch/vqmt
+
 
|-
 
|-
−
!MetrixMux
+
| MetrixMux || x || x || x || x || x || x || || || || SNR, VIF pixel based, VSNR, UQI, NQM, WSNR || https://web.archive.org/web/20140405042807/http://foulard.ece.cornell.edu/gaubatz/metrix_mux/metrix_mux_1.1.zip
−
|x
+
−
|x
+
−
|x
+
−
|x
+
−
|x
+
−
|x
+
−
|x
+
−
|
+
−
|
+
−
|x
+
−
|x
+
−
|x
+
−
|x
+
−
|x
+
−
|
+
−
|
+
−
|
+
−
|https://web.archive.org/web/20140405042807/http://foulard.ece.cornell.edu/gaubatz/metrix_mux/metrix_mux_1.1.zip
+
 
|-
 
|-
−
!CVQM
+
| CVQM || || || || || || || x || ||  ||  || https://www.its.bldrdoc.gov/resources/video-quality-research/guides-and-tutorials/description-of-vqm-tools.aspx
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|x
+
−
|
+
−
|
+
−
|https://www.its.bldrdoc.gov/resources/video-quality-research/guides-and-tutorials/description-of-vqm-tools.aspx
+
 
|-
 
|-
−
!VQM_pc,VQM_lx
+
| VQM_pc,VQM_lx || || || || || || || x || ||  ||  || https://www.its.bldrdoc.gov/resources/video-quality-research/guides-and-tutorials/description-of-vqm-tools.aspx
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|x
+
−
|
+
−
|
+
−
|https://www.its.bldrdoc.gov/resources/video-quality-research/guides-and-tutorials/description-of-vqm-tools.aspx
+
 
|-
 
|-
−
!MOVIE
+
| MOVIE || || || || || || || || x ||  ||  || http://live.ece.utexas.edu/research/Quality/movie.html
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|x
+
−
|
+
−
|http://live.ece.utexas.edu/research/Quality/movie.html
+
 
|-
 
|-
−
!VMAF
+
| VMAF || || || || || || || || || x ||  || https://github.com/Netflix/vmaf
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|x
+
−
|https://github.com/Netflix/vmaf
+
 
|-
 
|-
−
!SSIM
+
| SSIM || ||  || x || ||  || || || || || || http://www.cns.nyu.edu/~zwang/files/research/ssim/ssim_index.m
−
|
+
−
|
+
−
|
+
−
|x
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|http://www.cns.nyu.edu/~zwang/files/research/ssim/ssim_index.m
+
 
|-
 
|-
−
!MS-SSIM
+
| MS-SSIM || || || ||  || x || || || || || || http://live.ece.utexas.edu/research/Quality/ms_ssim.zip
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|x
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|http://live.ece.utexas.edu/research/Quality/ms_ssim.zip
+
 
|-
 
|-
−
!IFC
+
| IFC || || || || || || x || ||  || || || http://live.ece.utexas.edu/research/Quality/ifcvec_release.zip
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|x
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|http://live.ece.utexas.edu/research/Quality/ifcvec_release.zip
+
 
|-
 
|-
−
!MSU VQMT
+
| MSU VQMT || x || 4 variants || 2 variants || || 2 variants || || x || || || || http://www.compression.ru/video/quality_measure/vqmt_download.html#free
−
|x
+
−
|4 variants
+
−
|
+
−
|2 variants
+
−
|
+
−
|
+
−
|2 variants
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|
+
−
|x
+
−
|
+
−
|
+
−
|http://www.compression.ru/video/quality_measure/vqmt_download.html#free
+
 
|}
 
|}

Revision as of 16:48, 11 September 2017

There are a number of publicly available software for objective quality evaluation.

The following table attempts to list and compare them.

MSE PSNR SSIM VIF MS-SSIM IFC VQM MOVIE VMAF Also computes
VQMT x x x x PSNRHVS, PSNRHVSM http://mmspg.epfl.ch/vqmt
MetrixMux x x x x x x SNR, VIF pixel based, VSNR, UQI, NQM, WSNR https://web.archive.org/web/20140405042807/http://foulard.ece.cornell.edu/gaubatz/metrix_mux/metrix_mux_1.1.zip
CVQM x https://www.its.bldrdoc.gov/resources/video-quality-research/guides-and-tutorials/description-of-vqm-tools.aspx
VQM_pc,VQM_lx x https://www.its.bldrdoc.gov/resources/video-quality-research/guides-and-tutorials/description-of-vqm-tools.aspx
MOVIE x http://live.ece.utexas.edu/research/Quality/movie.html
VMAF x https://github.com/Netflix/vmaf
SSIM x http://www.cns.nyu.edu/~zwang/files/research/ssim/ssim_index.m
MS-SSIM x http://live.ece.utexas.edu/research/Quality/ms_ssim.zip
IFC x http://live.ece.utexas.edu/research/Quality/ifcvec_release.zip
MSU VQMT x 4 variants 2 variants 2 variants x http://www.compression.ru/video/quality_measure/vqmt_download.html#free
Retrieved from "http://vqegjeg.intec.ugent.be/wiki/index.php?title=Software_for_objective_quality_evaluation&oldid=350"