Difference between revisions of "Software for objective quality evaluation"

From VQEG JEG Wiki
Jump to: navigation, search
m
Line 2: Line 2:
  
 
The following table attempts to list and compare them.
 
The following table attempts to list and compare them.
 +
 +
{| border="1" class="sortable"
 +
!
 +
!MSE
 +
!PSNR
 +
!SNR
 +
!SSIM
 +
!VIF
 +
!VIF pixed-based
 +
!MS-SSIM
 +
!PSNRHVS
 +
!PSNRHVSM
 +
!VSNR
 +
!IFC
 +
!UQI
 +
!NQM
 +
!WSNR
 +
!VQM
 +
!MOVIE
 +
!VMAF
 +
!URL to code
 +
|-
 +
!VQMT
 +
|
 +
|x
 +
|
 +
|x
 +
|x
 +
|
 +
|x
 +
|x
 +
|x
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|http://mmspg.epfl.ch/vqmt
 +
|-
 +
!MetrixMux
 +
|x
 +
|x
 +
|x
 +
|x
 +
|x
 +
|x
 +
|x
 +
|
 +
|
 +
|x
 +
|x
 +
|x
 +
|x
 +
|x
 +
|
 +
|
 +
|
 +
|https://web.archive.org/web/20140405042807/http://foulard.ece.cornell.edu/gaubatz/metrix_mux/metrix_mux_1.1.zip
 +
|-
 +
!CVQM
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|x
 +
|
 +
|
 +
|https://www.its.bldrdoc.gov/resources/video-quality-research/guides-and-tutorials/description-of-vqm-tools.aspx
 +
|-
 +
!VQM_pc,VQM_lx
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|x
 +
|
 +
|
 +
|https://www.its.bldrdoc.gov/resources/video-quality-research/guides-and-tutorials/description-of-vqm-tools.aspx
 +
|-
 +
!MOVIE
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|x
 +
|
 +
|http://live.ece.utexas.edu/research/Quality/movie.html
 +
|-
 +
!VMAF
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|x
 +
|https://github.com/Netflix/vmaf
 +
|-
 +
!SSIM
 +
|
 +
|
 +
|
 +
|x
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|http://www.cns.nyu.edu/~zwang/files/research/ssim/ssim_index.m
 +
|-
 +
!MS-SSIM
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|x
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|http://live.ece.utexas.edu/research/Quality/ms_ssim.zip
 +
|-
 +
!IFC
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|x
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|http://live.ece.utexas.edu/research/Quality/ifcvec_release.zip
 +
|-
 +
!MSU VQMT
 +
|x
 +
|4 variants
 +
|
 +
|2 variants
 +
|
 +
|
 +
|2 variants
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|
 +
|x
 +
|
 +
|
 +
|http://www.compression.ru/video/quality_measure/vqmt_download.html#free
 +
|}

Revision as of 18:23, 29 August 2017

There are a number of publicly available software for objective quality evaluation.

The following table attempts to list and compare them.

MSE PSNR SNR SSIM VIF VIF pixed-based MS-SSIM PSNRHVS PSNRHVSM VSNR IFC UQI NQM WSNR VQM MOVIE VMAF URL to code
VQMT x x x x x x http://mmspg.epfl.ch/vqmt
MetrixMux x x x x x x x x x x x x https://web.archive.org/web/20140405042807/http://foulard.ece.cornell.edu/gaubatz/metrix_mux/metrix_mux_1.1.zip
CVQM x https://www.its.bldrdoc.gov/resources/video-quality-research/guides-and-tutorials/description-of-vqm-tools.aspx
VQM_pc,VQM_lx x https://www.its.bldrdoc.gov/resources/video-quality-research/guides-and-tutorials/description-of-vqm-tools.aspx
MOVIE x http://live.ece.utexas.edu/research/Quality/movie.html
VMAF x https://github.com/Netflix/vmaf
SSIM x http://www.cns.nyu.edu/~zwang/files/research/ssim/ssim_index.m
MS-SSIM x http://live.ece.utexas.edu/research/Quality/ms_ssim.zip
IFC x http://live.ece.utexas.edu/research/Quality/ifcvec_release.zip
MSU VQMT x 4 variants 2 variants 2 variants x http://www.compression.ru/video/quality_measure/vqmt_download.html#free