Subjective and Objective Quality Assessment for in-the-Wild Computer Graphics Images

Authors: Zicheng Zhang, Wei Sun, Tao Wang, Wei Lu, Quan Zhou, Jun he, Qiyuan Wang, Xiongkuo Min, Guangtao Zhai

License: CC BY 4.0

Results of the summarizing process for the arXiv paper: 2303.08050v1

  • Comprehensive Summary
  • Key points
  • Layman's Summary
  • Blog article
Computer graphics images (CGIs) are widely used in various scenarios such as games and streaming media. However, the quality of CGIs often suffers from poor rendering during production and compression artifacts during transmission. Despite this challenge, few works have been dedicated to addressing computer graphics image quality assessment (CGIQA). Most image quality assessment (IQA) metrics are developed for natural scene images (NSIs) and validated on databases consisting of NSIs with synthetic distortions, which are not suitable for in-the-wild CGIs. To bridge the gap between evaluating the quality of NSIs and CGIs, this paper proposes a large-scale in-the-wild CGIQA database consisting of 6,000 CGIs called CGIQA-6k. The database covers a wider range of resolutions from 480p to 4K and contains more diverse content as well as authentic distortions. A well-organized subjective experiment is carried out in a controlled laboratory environment to obtain accurate perceptual ratings of the CGIs. Furthermore, an effective deep learning-based no-reference IQA model is proposed by utilizing multi-stage feature fusion strategy and multi-stage channel attention mechanism. The proposed model takes advantage of inter-channel information from low-level to high-level since CGIs have apparent patterns as well as rich interactive semantic content. The experimental results show that the proposed method outperforms all other state-of-the-art NR IQA methods on the constructed CGIQA-6k database and other CGIQA related databases. The major contributions of this work include constructing the largest in-the wild CGIQA database with subjective quality scores covering a wider range of resolutions and diverse content along with proposing an effective deep learning based NR IQA model through multi stage feature fusion and multi stage channel attention mechanisms. The database along with code will be released to facilitate further research in this area.
AI-generated keywords: Computer Graphics Image Quality Assessment (CGIQA)

AI-generated Key Points

  • Computer graphics images (CGIs) are widely used in various scenarios such as games and streaming media.
  • The quality of CGIs often suffers from poor rendering during production and compression artifacts during transmission.
  • Few works have been dedicated to addressing computer graphics image quality assessment (CGIQA).
  • Most image quality assessment (IQA) metrics are developed for natural scene images (NSIs) and validated on databases consisting of NSIs with synthetic distortions, which are not suitable for in-the-wild CGIs.
  • To bridge the gap between evaluating the quality of NSIs and CGIs, this paper proposes a large-scale in-the-wild CGIQA database consisting of 6,000 CGIs called CGIQA-6k.
  • The proposed model takes advantage of inter-channel information from low-level to high-level since CGIs have apparent patterns as well as rich interactive semantic content.
  • The experimental results show that the proposed method outperforms all other state-of-the-art NR IQA methods on the constructed CGIQA-6k database and other CGIQA related databases.
  • The major contributions of this work include constructing the largest in-the wild CGIQA database with subjective quality scores covering a wider range of resolutions and diverse content along with proposing an effective deep learning based NR IQA model through multi stage feature fusion and multi stage channel attention mechanisms.
  • The database along with code will be released to facilitate further research in this area.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Abstract: Computer graphics images (CGIs) are artificially generated by means of computer programs and are widely perceived under various scenarios, such as games, streaming media, etc. In practical, the quality of CGIs consistently suffers from poor rendering during the production and inevitable compression artifacts during the transmission of multimedia applications. However, few works have been dedicated to dealing with the challenge of computer graphics images quality assessment (CGIQA). Most image quality assessment (IQA) metrics are developed for natural scene images (NSIs) and validated on the databases consisting of NSIs with synthetic distortions, which are not suitable for in-the-wild CGIs. To bridge the gap between evaluating the quality of NSIs and CGIs, we construct a large-scale in-the-wild CGIQA database consisting of 6,000 CGIs (CGIQA-6k) and carry out the subjective experiment in a well-controlled laboratory environment to obtain the accurate perceptual ratings of the CGIs. Then, we propose an effective deep learning-based no-reference (NR) IQA model by utilizing multi-stage feature fusion strategy and multi-stage channel attention mechanism. The major motivation of the proposed model is to make full use of inter-channel information from low-level to high-level since CGIs have apparent patterns as well as rich interactive semantic content. Experimental results show that the proposed method outperforms all other state-of-the-art NR IQA methods on the constructed CGIQA-6k database and other CGIQA-related databases. The database along with the code will be released to facilitate further research.

Submitted to arXiv on 14 Mar. 2023

Tools for this paper

Explain it differently 3 free rewrites left today
Export BibTeX · RIS (Zotero, Mendeley, EndNote) · Markdown (Notion, Obsidian) · Premium
Citation alerts Premium
Journal club Slides to present it Premium
For journalists Press kit and hype check Premium

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

Figures and plots

Ask about a figure by number or use its question button to request visual analysis. Up to two figures and four image panels per question. Values read from plots are approximate; check the original data.

AI assistant instructions?

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.