Software for objective quality evaluation
From VQEG JEG Wiki
There are a number of publicly available software for objective quality evaluation.
The following table attempts to list and compare them.
Note that, for better visualization purposes, when a tool only computes one metric, such a metric is listed as a column in the table. When a tool computes more than one metric, metrics computed only by such a tool are listed in the "Also computes" column.
| MSE | PSNR | SSIM | VIF | MS-SSIM | IFC | VQM | MOVIE | VMAF | Also computes | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
| VQMT | x | x | x | x | PSNRHVS, PSNRHVSM | http://mmspg.epfl.ch/vqmt | |||||
| MetrixMux | x | x | x | x | x | x | SNR, VIF pixel based, VSNR, UQI, NQM, WSNR | http://ollie-imac.cs.northwestern.edu/~ollie/GMM/code/metrix_mux_1.1.zip | |||
| CVQM | x | https://www.its.bldrdoc.gov/resources/video-quality-research/guides-and-tutorials/description-of-vqm-tools.aspx | |||||||||
| VQM_pc,VQM_lx | x | https://www.its.bldrdoc.gov/resources/video-quality-research/guides-and-tutorials/description-of-vqm-tools.aspx | |||||||||
| MOVIE | x | http://live.ece.utexas.edu/research/Quality/movie.html | |||||||||
| VMAF | x | https://github.com/Netflix/vmaf | |||||||||
| SSIM | x | http://www.cns.nyu.edu/~zwang/files/research/ssim/ssim_index.m | |||||||||
| MS-SSIM | x | http://live.ece.utexas.edu/research/Quality/ms_ssim.zip | |||||||||
| IFC | x | http://live.ece.utexas.edu/research/Quality/ifcvec_release.zip | |||||||||
| MSU VQMT | x | 4 variants | 2 variants | 2 variants | x | http://www.compression.ru/video/quality_measure/vqmt_download.html#free |
