Difference between revisions of "Main Page"
(→Participating Groups and Contacts) |
(→Meetings) |
||
| (32 intermediate revisions by 6 users not shown) | |||
| Line 1: | Line 1: | ||
<font size="+3">'''VQEG-JEG Wiki'''</font> | <font size="+3">'''VQEG-JEG Wiki'''</font> | ||
| − | The Joint Effort Group is | + | The Joint Effort Group is an activity of the [http://www.its.bldrdoc.gov/vqeg/ Video Quality Experts Group (VQEG)] created in 2009 that proposes an alternative collaborative action. Usually, VQEG inspects models performance from individual proponents with respects to jointly developed test plans in a competitive manner. |
== Mission == | == Mission == | ||
| Line 17: | Line 17: | ||
== News == | == News == | ||
| − | JEG Hybrid recently launched a [[JEG-Hybrid_cfp|''Call for Proposals and Participation'']]. | + | <!-- JEG Hybrid recently launched a [[JEG-Hybrid_cfp|''Call for Proposals and Participation'']]. --> |
| + | JEG Hybrid is preparing a Call for Proposals and Participation for late 2016. Stay tuned and join the biweekly conference calls! | ||
== JEG Projects == | == JEG Projects == | ||
The following projects are currently ongoing in JEG: | The following projects are currently ongoing in JEG: | ||
| − | *[[JEG_no-reference_hybrid_H264|JEG-Hybrid]]: | + | *[[JEG_no-reference_hybrid_H264|JEG-Hybrid for H.264/AVC]]: General framework for objective quality assessment for video using bitstream and decoded video information for H.264/AVC<br/> |
| + | *[[JEG_no-reference_hybrid_HEVC|JEG-Hybrid database for HEVC]]: Large-scale database with video bitstreams and results of objective quality measures for HEVC<br/> | ||
| + | *[[JEG_large_scale_objective_characterization|JEG-Hybrid characterization of objective measures]]: Using our large-scale databases to analyze agreement between simple objective measures such as PSNR, SSIM, VIF<br/> | ||
| + | *[[JEG_Reproducible_Video_Quality_Analysis_Framework|Reproducible Video Quality Analysis Framework]]: Using the large-scale databases to analyze objective video quality measures<br/> | ||
| + | *[[VQEGplayer-main|VQEGplayer]]: 2D and 3D video playback program for performing subjective assessment with remote control and stand-alone facilities<br/> | ||
| − | Some more information on JEG and the ongoing project JEG NR hybrid H264 is provided here in the [[VQEG-JEG:Community_Portal]] list of this wiki. Discussions concerning single parts of a specific project can be followed | + | Some more information on JEG and the ongoing project JEG NR hybrid H264 is provided here in the [[VQEG-JEG:Community_Portal]] list of this wiki. Discussions concerning single parts of a specific project can be followed on the mailing list. |
| + | |||
| + | == JEG Resources == | ||
| + | JEG is organized around shared resources that are used in research projects at the different JEG members.<br/> | ||
| + | Consistency of information is judged to be important. Any questions or remarks are therefore welcome.<br/> | ||
| + | The following resources are shared by the JEG members and are explained and/or improved on request.<br/> | ||
| + | * [[Databases]] ([[SRC]], H.264, HEVC, annotation with objective measurements, questions...)<br/> | ||
| + | * Organisation of reproducible research: [[Virtualbox]], HMIX files and tools, [[MySQL processing database]]<br/> | ||
| + | * [[RobustDecoder|Robust decoder]], packet error introduction and concealment, restreaming<br/> | ||
| + | * Statistical analysis of objective Full-Reference measures towards understanding which data needs to be subjectively evaluated<br/> | ||
| + | * Contribution from VQEG-MOAVI / Development of indicators for bitstream analysis / indicators for NR measurements<br/> | ||
| + | * Combination algorithms for indicators / training / verification / validation including statistical analysis<br/> | ||
| + | * Planning of an open call for contributions/competition, updates on Wiki, further plans<br/> | ||
| + | * [[List of Publications]] | ||
| + | * [http://vqegstl.ugent.be/ Tools and Subjective Labs Setup] | ||
== Joining JEG == | == Joining JEG == | ||
| − | If you are interested in joining JEG, please | + | If you are interested in joining JEG, please follow the procedure to join the JEG and JEG-Hybrid mailing list, described [http://www.its.bldrdoc.gov/vqeg/email-reflectors.aspx here]. |
| − | == | + | == Getting started == |
| − | + | Please be aware that VQEG-JEG is a scientific working group. This implies that often results are yet unverified. In many cases, researchers also lack time to document work-in-progress. Please consider this as reason why there is not a lot of written documentation available.<br/> | |
| + | We discuss work in progress on our biweekly conference calls and either officially publish the results or update the documentation when our research is stable and validated.<br/> | ||
| + | The best way to get started is: | ||
| + | * Join the VQEG reflector and the VQEG-JEG reflector or contact the co-chairs if you have trouble with this | ||
| + | * Contact the co-chairs, write a mail to the reflector or join a conference call | ||
| + | * Provide a short introduction of yourself and your research on a conference call (5-10 minutes, slides sent to the JEG reflector beforehand are welcome but not mandatory) | ||
| + | * In the following discussion, we will conjointly integrate your research topic and ideas into the currently ongoing JEG research | ||
| + | * More detailed calls or mail exchanges will follow naturally | ||
== Participating Groups and Contacts == | == Participating Groups and Contacts == | ||
*Acreo (Sweden)<br/>Kjell Brunnström | *Acreo (Sweden)<br/>Kjell Brunnström | ||
| − | *AGH University (Poland)<br/>Lucjan Janowski | + | *AGH University (Poland)<br/>Lucjan Janowski, Mikolaj Leszcuk |
*IP-Label.newtest (France)<br/>Alex Bourret | *IP-Label.newtest (France)<br/>Alex Bourret | ||
| − | * | + | *Technical University Berlin, T-Labs (Germany)<br/>Marie-Neige Garcia, Werner Robitza |
| − | *Ghent University - iMinds (Belgium)<br/> | + | *Ghent University - iMinds (Belgium)<br/>Glenn Van Wallendael |
| − | *IRCCyN, University of Nantes (France)<br/>Marcus Barkowsky, Patrick Le Callet | + | *IRCCyN, University of Nantes (France)<br/>Marcus Barkowsky, Patrick Le Callet, Ahmed Aldahdooh |
| − | *University of Vienna (Austria)<br/>Shelley Buchinger, | + | *Kingston University (United Kingdom)<br/>Maria Martini |
| + | *University of Vienna (Austria)<br/>Shelley Buchinger | ||
| + | *Politecnico di Torino (Italy)<br/>Enrico Masala, Lohic Fotio Tiotsop | ||
== Chair == | == Chair == | ||
| − | The chairs of the JEG support group are | + | The chairs of the JEG support group are Kjell Brunnström, and Patrick Le Callet.<br/> |
| − | The chairs of the JEG-Hybrid group are Marcus Barkowsky, | + | The chairs of the JEG-Hybrid group are Marcus Barkowsky, Glenn Van Wallendael, and Enrico Masala.<br/> |
| − | + | ||
== Meetings == | == Meetings == | ||
| − | The Working Group | + | The Working Group has biweekly conference calls, announced on the mailing list, (currently on Mondays, 3PM Paris Time CE(S)T). Face–to–face meetings will take place during the biennial [http://www.its.bldrdoc.gov/vqeg/meetings.aspx VQEG meetings]. |
== Communication == | == Communication == | ||
| Line 68: | Line 95: | ||
It was decided on 11th of March 2010 that the topic of patents will only be discussed when there is new relevant information not contained in this text. | It was decided on 11th of March 2010 that the topic of patents will only be discussed when there is new relevant information not contained in this text. | ||
| − | == | + | == Links and further information on VQEG == |
<!--* [http://forum.vqeg-jeg.org VQEG-JEG Forum] --> | <!--* [http://forum.vqeg-jeg.org VQEG-JEG Forum] --> | ||
* [http://www.its.bldrdoc.gov/vqeg VQEG web site] | * [http://www.its.bldrdoc.gov/vqeg VQEG web site] | ||
| Line 77: | Line 104: | ||
== Edit the Wiki == | == Edit the Wiki == | ||
| − | To modify the wiki's content, | + | To modify the wiki's content, a login is required, please contact the co-chairs. Glenn Van Wallendael will assign an account glenn.vanwallendael(at)ugent.be. |
(Origin: VQEG‐JEG_NR_hybrid_H264_v3.pdf) | (Origin: VQEG‐JEG_NR_hybrid_H264_v3.pdf) | ||
Latest revision as of 16:05, 4 November 2019
VQEG-JEG Wiki
The Joint Effort Group is an activity of the Video Quality Experts Group (VQEG) created in 2009 that proposes an alternative collaborative action. Usually, VQEG inspects models performance from individual proponents with respects to jointly developed test plans in a competitive manner.
Contents |
Mission
The Joint Effort Group (JEG) is intending to work jointly on both mandatory actions to validate metrics: subjective dataset completion and metrics design. That means that any proposal for improving metrics should be possible to inspect and that it is not necessary to provide a full metric to enter in the process. Therefore, JEG is clearly offering an opportunity to jointly propose quality metrics. In order to maintain fair validation of proposed tool and to avoid precious subjective quality assessment results, the metric has to be designed in a such a way that any contribution is assessed according to the availability of source code to the group. It is also expected to increase after validation for some purposes, to extend the subjective dataset in order to better identify the limitations or extension of application scope of quality metrics. Regarding this latter comment, JEG could produce quality metrics identified through profile/layer with respect of their application scope.
News
JEG Hybrid is preparing a Call for Proposals and Participation for late 2016. Stay tuned and join the biweekly conference calls!
JEG Projects
The following projects are currently ongoing in JEG:
- JEG-Hybrid for H.264/AVC: General framework for objective quality assessment for video using bitstream and decoded video information for H.264/AVC
- JEG-Hybrid database for HEVC: Large-scale database with video bitstreams and results of objective quality measures for HEVC
- JEG-Hybrid characterization of objective measures: Using our large-scale databases to analyze agreement between simple objective measures such as PSNR, SSIM, VIF
- Reproducible Video Quality Analysis Framework: Using the large-scale databases to analyze objective video quality measures
- VQEGplayer: 2D and 3D video playback program for performing subjective assessment with remote control and stand-alone facilities
Some more information on JEG and the ongoing project JEG NR hybrid H264 is provided here in the VQEG-JEG:Community_Portal list of this wiki. Discussions concerning single parts of a specific project can be followed on the mailing list.
JEG Resources
JEG is organized around shared resources that are used in research projects at the different JEG members.
Consistency of information is judged to be important. Any questions or remarks are therefore welcome.
The following resources are shared by the JEG members and are explained and/or improved on request.
- Databases (SRC, H.264, HEVC, annotation with objective measurements, questions...)
- Organisation of reproducible research: Virtualbox, HMIX files and tools, MySQL processing database
- Robust decoder, packet error introduction and concealment, restreaming
- Statistical analysis of objective Full-Reference measures towards understanding which data needs to be subjectively evaluated
- Contribution from VQEG-MOAVI / Development of indicators for bitstream analysis / indicators for NR measurements
- Combination algorithms for indicators / training / verification / validation including statistical analysis
- Planning of an open call for contributions/competition, updates on Wiki, further plans
- List of Publications
- Tools and Subjective Labs Setup
Joining JEG
If you are interested in joining JEG, please follow the procedure to join the JEG and JEG-Hybrid mailing list, described here.
Getting started
Please be aware that VQEG-JEG is a scientific working group. This implies that often results are yet unverified. In many cases, researchers also lack time to document work-in-progress. Please consider this as reason why there is not a lot of written documentation available.
We discuss work in progress on our biweekly conference calls and either officially publish the results or update the documentation when our research is stable and validated.
The best way to get started is:
- Join the VQEG reflector and the VQEG-JEG reflector or contact the co-chairs if you have trouble with this
- Contact the co-chairs, write a mail to the reflector or join a conference call
- Provide a short introduction of yourself and your research on a conference call (5-10 minutes, slides sent to the JEG reflector beforehand are welcome but not mandatory)
- In the following discussion, we will conjointly integrate your research topic and ideas into the currently ongoing JEG research
- More detailed calls or mail exchanges will follow naturally
Participating Groups and Contacts
- Acreo (Sweden)
Kjell Brunnström - AGH University (Poland)
Lucjan Janowski, Mikolaj Leszcuk - IP-Label.newtest (France)
Alex Bourret - Technical University Berlin, T-Labs (Germany)
Marie-Neige Garcia, Werner Robitza - Ghent University - iMinds (Belgium)
Glenn Van Wallendael - IRCCyN, University of Nantes (France)
Marcus Barkowsky, Patrick Le Callet, Ahmed Aldahdooh - Kingston University (United Kingdom)
Maria Martini - University of Vienna (Austria)
Shelley Buchinger - Politecnico di Torino (Italy)
Enrico Masala, Lohic Fotio Tiotsop
Chair
The chairs of the JEG support group are Kjell Brunnström, and Patrick Le Callet.
The chairs of the JEG-Hybrid group are Marcus Barkowsky, Glenn Van Wallendael, and Enrico Masala.
Meetings
The Working Group has biweekly conference calls, announced on the mailing list, (currently on Mondays, 3PM Paris Time CE(S)T). Face–to–face meetings will take place during the biennial VQEG meetings.
Communication
The Working Group will utilize the JEG Member mailing list, jeg@its.bldrdoc.gov
Confidentiality
Patent Policy
This text is preliminary and may be incorrect. It is published in order to prevent repetitive discussions on patents.
The JEG group is a cooperative approach. Patents do not necessarily conflict with cooperative approaches.
If a member of JEG wants to file a patent on a particular idea, he cannot discuss it openly, e.g. by using the mailing list, before the idea is filled. He first has to develop the idea, file a patent, get it accepted and then he can discuss it openly and propose it to the JEG for inclusion. When it is known that a proposed algorithm part is patented, this information should be shared within JEG. This applies to both self-owned and third party patents.
In case two or more members of the JEG group wish to have a common patent, the same rules as above apply: They cannot reveal their idea by an open discussion on the mailing list. Practical problems may arise from the fact that patents can usually only be filed by a legal entity and cross-country issues may appear due to different laws.
The purpose of the JEG group is to develop an outstanding objective quality metric. In order to achieve this goal, all algorithm enhancements will be evaluated on an objective basis. This involves, for example, comparing the model performance increase to the computational cost. Patented algorithms will neither be rejected nor preferred.
The JEG group is aware that the (final) developed model will need to be evaluated regarding the patented parts of the algorithm before it can be commercially xploited. It is expected that more than one party is involved. In this phase, a shared solution is advised, e.g. by forming a patent pool. As it is expected that patent owners outside the group need to be contacted, it is welcomed to also have patented parts of the algorithm owned by members of the group in order to facilitate the negotiations. Please note, that this is the last stage of the project and following the current schedule may be expected after 2012.
It was decided on 11th of March 2010 that the topic of patents will only be discussed when there is new relevant information not contained in this text.
Links and further information on VQEG
Edit the Wiki
To modify the wiki's content, a login is required, please contact the co-chairs. Glenn Van Wallendael will assign an account glenn.vanwallendael(at)ugent.be.
(Origin: VQEG‐JEG_NR_hybrid_H264_v3.pdf)
