JEG no-reference hybrid HEVC
JEG no-reference hybrid HEVC
JEG is currently developing a database of HEVC-encoded video sequences to eventually develop a Hybrid No Reference metric suited for HEVC.
Contents |
Main idea
Project Setup
Database
Link: ftp://ftp.ivc.polytech.univ-nantes.fr/VQEG/JEG/HYBRID/hevc_database/
Folders:
- ENC : compressed video sequences
- FR : available quality measures (see below)
- SRC : uncompressed original video sequences used for encoding and quality measures
Sequences (from src01 to src10):
Key to compressed file naming
Example filename:
src01_960x544p25.yuv_LDGOP4_8000001_2_16_64_8_4.265
Convention
src<SEQN>_<WIDTH>x<HEIGHT>p25.yuv_<GOPTYPESIZE>_<RATECONTROL>_<REFRESH>_<INTRAPERIOD>_<SEARCHRANGE>_<BITDEPTH>_<SLICEARGUMENT>.265
Meaning of parameters (Refer to https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/branches/HM-11.0-dev/doc/software-manual.pdf for further details on the encoder)
SEQN = sequence number, from 01 to 10
WIDTH = picture width, possibile values: 960, 1280, 1920
HEIGHT = picture height, possibile values: 544, 720, 1080
GOPTYPESIZE = GOP type and size, possibile values: GOP2, GOP4, GOP8, LDGOP4
GOP2 : GOP size 2 GOP4 : GOP size 4 GOP8 : GOP size 8 LDGOP4 : GOP size 4 in low-delay configuration
RATECONTROL = parameter for rate control, possibile values: 26, 32, 38, 46 or a number >= 500000 (ending with 0 or 1)
The number <= 46 corresponds to the -q encoder option The number >= 500000 corresponds to the --TargetBitrate encoder option The last digit (0 or 1) if number >= 500000 corresponds to the --LCULevelRateControl encoder option 26 : fixed QP = 26 32 : fixed QP = 32 38 : fixed QP = 38 46 : fixed QP = 46 500000 : rate control at the frame level, 500 kbit/s 500001 : rate control at the LCU level, 500 kbit/s 1000000 : rate control at the frame level, 1 Mbit/s 1000001 : rate control at the LCU level, 1 Mbit/s 2000000 : rate control at the frame level, 2 Mbit/s 2000001 : rate control at the LCU level, 2 Mbit/s 4000000 : rate control at the frame level, 4 Mbit/s 4000001 : rate control at the LCU level, 4 Mbit/s 8000000 : rate control at the frame level, 8 Mbit/s 8000001 : rate control at the LCU level, 8 Mbit/s 16000000 : rate control at the frame level, 16 Mbit/s 16000001 : rate control at the LCU level, 16 Mbit/s
REFRESH = intra refresh type, possible values: 1, 2
The number corresponds to the --DecodingRefreshType encoder option 1 : Applies a non-IDR clean random access point (open GOP). 2 : Applies an IDR random access point (closed GOP).
INTRAPERIOD = intra frame period, possible values: 8, 16, 32, 64
The number corresponds to the --IntraPeriod encoder option 8 : one intra every 8 16 : one intra every 16 32 : one intra every 32 64 : one intra every 64
SEARCHRANGE = search range for motion estimation (around the predictor), possibile values: only 64
The number corresponds to the --SearchRange encoder option
BITDEPTH = bit depth used for coding, possibile values: only 8
The number corresponds to the --InternalBitDepth encoder option
SLICEARGUMENT = specifies how slicing is performed for each picture, possibile values: 0, 2, 4, 1500
The number corresponds to the --SliceMode and --SliceArgument encoder options
0 : only one slice per frame
(SliceMode = 0 and SliceArgument = 0)
2 : 2 slices per frame (max 270,120,75 CTU per slice when WIDTH=1920,1280,960)
(SliceMode = 1 and SliceArgument = 270 if 1920, 120 if 1280, 75 if 960)
4 : 4 slices per frame (max 130,60,34 CTU per slice when WIDTH=1920,1280,960)
(SliceMode = 1 and SliceArgument = 130 if 1920, 60 if 1280, 34 if 960)
1500 : each slice is maximum 1500 bytes
(SliceMode = 2 and SliceArgument = 1500)
Downloads
Database
The database of the original and processed video sequences can be downloaded at:
ftp://ftp.ivc.polytech.univ-nantes.fr/VQEG/JEG/HYBRID/hevc_database/
Please note that the whole database is larger than 300 GB. In particular:
- the SRC folder contains the original video sequences in YUV format
- the ENC folder contains the compressed files (.265 extension)
Objective scores
Already computed objective scores are available in the FR folder:
- for PSNR, SSIM, VIFP: look for .csv files
FRmetricsAverage.csv contains the final average value for each sequence
FRmetricsFrameByFrame.csv contains the detailed values for each frame, for each sequence
- for VQM, PVQM: look for the .tar.bz2 files
results_vqm001_RES_converted.tar.bz2 contains the detailed values of VQM for each frame for each sequence at resolution RES (can be 960, 1280, 1920). One csv file per sequence is provided.
results_pvqm001_RES_converted.tar.bz2 contains the detailed values of PVQM for each frame for each sequence at resolution RES (can be 960, 1280, 1920). One csv file per sequence is provided.
In both cases, in each csv file, the line "final_value" contains the final value of the metric for that sequence.
For convienience, all final_value results are included in a single csv file available from FRmetricsAverage_pvqm_vqm_psnr054_ssim_vifp.csv.bz2. Note that in this case when the PSNR value of a single frame is infinite, the value has been clipped at 54.15 dB PSNR (hence the name psnr054). This happens for some sequences which have completely black frames which are encoded perfectly. The other SSIM and VIFP values are the same as the ones available in the FRmetricsAverage.csv file, and the data format is the same.
Tools
The tools used to compute the scores:
Current status
The database is composed of 59520 sequences (10 different contents at three different resolutions each, encoded with 1984 different encoding parameters).
For all 59520 HEVC sequences in the database, the following objective quality metrics are available:
- PSNR (as computed by the VQMT software)
- SSIM (as computed by the VQMT software)
- VIF (as computed by the VQMT software)
- VQM (as computed by the software available at NTIA/ITS )
- PVQM (as computed by the PVQM_EM software)
The database is currently being extended by computing the previous measures on sequences which have loss impairments. 25 different loss patterns are being used.
Priority list
Since the work is huge, a priority list has been agreed in the periodic bi-weekly JEG conference calls.
It has been suggested to prioritize the work according to three classes:
- 1 GOLD - should always be done
- 2 SILVER - should be done if possible
- 3 BRONZE - the rest of the work
Other criteria include testing the extreme values first.
The current proposal is:
Glenn is computing PSNR, SSIM, VIF on all sequences when they are subject to 25 different loss patterns.
Enrico is computing VQM, PVQM on the 960x544 encoded sequences when they are subject to 25 different loss patterns. As of Sep 17, 2014 seq01 and seq10 are available (ask by email using: masala at polito for the results).
