Exploring the Naturalness of AI-Generated Images
AI-generated Key Points
- Authors address the challenge of assessing the naturalness of Artificial Intelligence-Generated Images (AGIs)
- Constructed AI-Generated Image Naturalness (AGIN) database through a large-scale subjective study
- AGIN database verifies that naturalness is affected by both types of distortions
- Proposed Joint Objective Image Naturalness evaluaTor (JOINT) to learn naturalness aligning with human ratings
- JOINT outperforms baselines in providing more subjectively consistent results on naturalness assessment
- Appendix section provides additional details for construction of AGIN database
- Collected multi-sourced images from five tasks to cover diverse appearances of naturalness issues
- Chose 20 keywords and created 10 prompts for each keyword using GPT3.5 for text-to-image models
- Generated prompts were manually examined for compliance before collecting AI-generated images
- Proposed JOINT++ as an extension to JOINT, incorporating additional features into their model
- Paper contributes to understanding and evaluating the naturalness of AGIs by presenting a benchmark database and objective evaluators aligned with human opinions
Authors: Zijian Chen, Wei Sun, Haoning Wu, Zicheng Zhang, Jun Jia, Xiongkuo Min, Guangtao Zhai, Wenjun Zhang
Abstract: The proliferation of Artificial Intelligence-Generated Images (AGIs) has greatly expanded the Image Naturalness Assessment (INA) problem. Different from early definitions that mainly focus on tone-mapped images with limited distortions (e.g., exposure, contrast, and color reproduction), INA on AI-generated images is especially challenging as it has more diverse contents and could be affected by factors from multiple perspectives, including low-level technical distortions and high-level rationality distortions. In this paper, we take the first step to benchmark and assess the visual naturalness of AI-generated images. First, we construct the AI-Generated Image Naturalness (AGIN) database by conducting a large-scale subjective study to collect human opinions on the overall naturalness as well as perceptions from technical and rationality perspectives. AGIN verifies that naturalness is universally and disparately affected by both technical and rationality distortions. Second, we propose the Joint Objective Image Naturalness evaluaTor (JOINT), to automatically learn the naturalness of AGIs that aligns human ratings. Specifically, JOINT imitates human reasoning in naturalness evaluation by jointly learning both technical and rationality perspectives. Experimental results show our proposed JOINT significantly surpasses baselines for providing more subjectively consistent results on naturalness assessment. Our database and code will be released in https://github.com/zijianchen98/AGIN.
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
Assess the quality of the AI-generated content by voting
Score: 0
Why do we need votes?
Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.
The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.
Similar papers summarized with our AI tools
Navigate through even more similar papers through a
tree representationLook for similar papers (in beta version)
By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.