Exploring the Naturalness of AI-Generated Images

AI-generated keywords: AI-Generated Images

AI-generated Key Points

  • Authors address the challenge of assessing the naturalness of Artificial Intelligence-Generated Images (AGIs)
  • Constructed AI-Generated Image Naturalness (AGIN) database through a large-scale subjective study
  • AGIN database verifies that naturalness is affected by both types of distortions
  • Proposed Joint Objective Image Naturalness evaluaTor (JOINT) to learn naturalness aligning with human ratings
  • JOINT outperforms baselines in providing more subjectively consistent results on naturalness assessment
  • Appendix section provides additional details for construction of AGIN database
  • Collected multi-sourced images from five tasks to cover diverse appearances of naturalness issues
  • Chose 20 keywords and created 10 prompts for each keyword using GPT3.5 for text-to-image models
  • Generated prompts were manually examined for compliance before collecting AI-generated images
  • Proposed JOINT++ as an extension to JOINT, incorporating additional features into their model
  • Paper contributes to understanding and evaluating the naturalness of AGIs by presenting a benchmark database and objective evaluators aligned with human opinions
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Zijian Chen, Wei Sun, Haoning Wu, Zicheng Zhang, Jun Jia, Xiongkuo Min, Guangtao Zhai, Wenjun Zhang

22 pages
License: CC BY 4.0

Abstract: The proliferation of Artificial Intelligence-Generated Images (AGIs) has greatly expanded the Image Naturalness Assessment (INA) problem. Different from early definitions that mainly focus on tone-mapped images with limited distortions (e.g., exposure, contrast, and color reproduction), INA on AI-generated images is especially challenging as it has more diverse contents and could be affected by factors from multiple perspectives, including low-level technical distortions and high-level rationality distortions. In this paper, we take the first step to benchmark and assess the visual naturalness of AI-generated images. First, we construct the AI-Generated Image Naturalness (AGIN) database by conducting a large-scale subjective study to collect human opinions on the overall naturalness as well as perceptions from technical and rationality perspectives. AGIN verifies that naturalness is universally and disparately affected by both technical and rationality distortions. Second, we propose the Joint Objective Image Naturalness evaluaTor (JOINT), to automatically learn the naturalness of AGIs that aligns human ratings. Specifically, JOINT imitates human reasoning in naturalness evaluation by jointly learning both technical and rationality perspectives. Experimental results show our proposed JOINT significantly surpasses baselines for providing more subjectively consistent results on naturalness assessment. Our database and code will be released in https://github.com/zijianchen98/AGIN.

Submitted to arXiv on 09 Dec. 2023

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2312.05476v1

In this paper, the authors address the challenge of assessing the naturalness of Artificial Intelligence-Generated Images (AGIs). They construct the AI-Generated Image Naturalness (AGIN) database through a large-scale subjective study, collecting human opinions on the overall naturalness as well as perceptions from technical and rationality perspectives. The AGIN database verifies that naturalness is universally and disparately affected by both types of distortions. To automatically learn the naturalness of AGIs that aligns with human ratings, the authors propose the Joint Objective Image Naturalness evaluaTor (JOINT). JOINT imitates human reasoning in naturalness evaluation by jointly learning both technical and rationality perspectives. Experimental results demonstrate that JOINT outperforms baselines in providing more subjectively consistent results on naturalness assessment. In an appendix section, additional details are provided for the construction of the AGIN database. The authors explain that they collected multi-sourced images from five tasks to cover diverse appearances of naturalness issues. For text-to-image models, they chose 20 keywords and created 10 prompts for each keyword using GPT3.5. The generated prompts were manually examined for compliance before collecting AI-generated images. Furthermore, the authors propose JOINT++ as an extension to JOINT, incorporating additional features such as texture losses, blurs, artifacts, semantic information, attribute theme, layout, and aesthetic assessment elements into their model. Overall, this paper contributes to understanding and evaluating the naturalness of AGIs by presenting a benchmark database and objective evaluators that align with human opinions. The work has implications for future research in this field and encourages new research on assessing AGI naturalness via analysis of technical and rationality features; it also promotes development of better algorithms for assessing naturalness in AI-generated multimedia.
Created on 15 Dec. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.