Difference between revisions of "Software for objective quality evaluation"
From VQEG JEG Wiki
(Created page with "There are a number of publicly available software for objective quality evaluation. The following table attempts to list and compare them.") |
|||
| (4 intermediate revisions by one user not shown) | |||
| Line 1: | Line 1: | ||
There are a number of publicly available software for objective quality evaluation. | There are a number of publicly available software for objective quality evaluation. | ||
| + | |||
The following table attempts to list and compare them. | The following table attempts to list and compare them. | ||
| + | |||
| + | Note that, for better visualization purposes, when a tool only computes one metric, such a metric is listed as a column in the table. When a tool computes more than one metric, metrics computed only by such a tool are listed in the "Also computes" column. | ||
| + | |||
| + | {| border="1" class="sortable" | ||
| + | ! || MSE || PSNR || SSIM || VIF || MS-SSIM || IFC || VQM || MOVIE || VMAF || Also computes || | ||
| + | |- | ||
| + | | VQMT || || x || x || x || x || || || || || PSNRHVS, PSNRHVSM || http://mmspg.epfl.ch/vqmt | ||
| + | |- | ||
| + | | MetrixMux || x || x || x || x || x || x || || || || SNR, VIF pixel based, VSNR, UQI, NQM, WSNR || http://ollie-imac.cs.northwestern.edu/~ollie/GMM/code/metrix_mux_1.1.zip | ||
| + | |- | ||
| + | | CVQM || || || || || || || x || || || || https://www.its.bldrdoc.gov/resources/video-quality-research/guides-and-tutorials/description-of-vqm-tools.aspx | ||
| + | |- | ||
| + | | VQM_pc,VQM_lx || || || || || || || x || || || || https://www.its.bldrdoc.gov/resources/video-quality-research/guides-and-tutorials/description-of-vqm-tools.aspx | ||
| + | |- | ||
| + | | MOVIE || || || || || || || || x || || || http://live.ece.utexas.edu/research/Quality/movie.html | ||
| + | |- | ||
| + | | VMAF || || || || || || || || || x || || https://github.com/Netflix/vmaf | ||
| + | |- | ||
| + | | SSIM || || || x || || || || || || || || http://www.cns.nyu.edu/~zwang/files/research/ssim/ssim_index.m | ||
| + | |- | ||
| + | | MS-SSIM || || || || || x || || || || || || http://live.ece.utexas.edu/research/Quality/ms_ssim.zip | ||
| + | |- | ||
| + | | IFC || || || || || || x || || || || || http://live.ece.utexas.edu/research/Quality/ifcvec_release.zip | ||
| + | |- | ||
| + | | MSU VQMT || x || 4 variants || 2 variants || || 2 variants || || x || || || || http://www.compression.ru/video/quality_measure/vqmt_download.html#free | ||
| + | |} | ||
Latest revision as of 15:03, 13 September 2017
There are a number of publicly available software for objective quality evaluation.
The following table attempts to list and compare them.
Note that, for better visualization purposes, when a tool only computes one metric, such a metric is listed as a column in the table. When a tool computes more than one metric, metrics computed only by such a tool are listed in the "Also computes" column.
| MSE | PSNR | SSIM | VIF | MS-SSIM | IFC | VQM | MOVIE | VMAF | Also computes | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
| VQMT | x | x | x | x | PSNRHVS, PSNRHVSM | http://mmspg.epfl.ch/vqmt | |||||
| MetrixMux | x | x | x | x | x | x | SNR, VIF pixel based, VSNR, UQI, NQM, WSNR | http://ollie-imac.cs.northwestern.edu/~ollie/GMM/code/metrix_mux_1.1.zip | |||
| CVQM | x | https://www.its.bldrdoc.gov/resources/video-quality-research/guides-and-tutorials/description-of-vqm-tools.aspx | |||||||||
| VQM_pc,VQM_lx | x | https://www.its.bldrdoc.gov/resources/video-quality-research/guides-and-tutorials/description-of-vqm-tools.aspx | |||||||||
| MOVIE | x | http://live.ece.utexas.edu/research/Quality/movie.html | |||||||||
| VMAF | x | https://github.com/Netflix/vmaf | |||||||||
| SSIM | x | http://www.cns.nyu.edu/~zwang/files/research/ssim/ssim_index.m | |||||||||
| MS-SSIM | x | http://live.ece.utexas.edu/research/Quality/ms_ssim.zip | |||||||||
| IFC | x | http://live.ece.utexas.edu/research/Quality/ifcvec_release.zip | |||||||||
| MSU VQMT | x | 4 variants | 2 variants | 2 variants | x | http://www.compression.ru/video/quality_measure/vqmt_download.html#free |
