LLaVA-Docent: Instruction Tuning with Multimodal Large Language Model to Support Art Appreciation Education

AI-generated keywords: Education Art Appreciation Multi-Modal Large Language Models LLaVA-Docent Innovative Solutions

AI-generated Key Points

  • Art appreciation is crucial for fostering critical thinking and emotional intelligence in learners.
  • Technological advancements have led to innovative solutions in art education.
  • The study developed LLaVA-Docent, a multi-modal large language model, using virtual dialogue datasets.
  • LLaVA-Docent was found effective in enhancing accessibility and engagement in art appreciation education compared to the GPT-4 model.
  • The study proposes a novel methodology that reimagines how art appreciation is taught and experienced by harnessing the potential of MLLMs.
  • Integration of technology addresses challenges and enriches educational experiences for students from diverse backgrounds.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Unggi Lee, Minji Jeon, Yunseo Lee, Gyuri Byun, Yoorim Son, Jaeyoon Shin, Hongkyu Ko, Hyeoncheol Kim

37 pages, 4 figures, 10 tables
License: CC BY-NC-SA 4.0

Abstract: Art appreciation is vital in nurturing critical thinking and emotional intelligence among learners. However, traditional art appreciation education has often been hindered by limited access to art resources, especially for disadvantaged students, and an imbalanced emphasis on STEM subjects in mainstream education. In response to these challenges, recent technological advancements have paved the way for innovative solutions. This study explores the application of multi-modal large language models (MLLMs) in art appreciation education, focusing on developing LLaVA-Docent, a model that leverages these advancements. Our approach involved a comprehensive literature review and consultations with experts in the field, leading to developing a robust data framework. Utilizing this framework, we generated a virtual dialogue dataset that was leveraged by GPT-4. This dataset was instrumental in training the MLLM, named LLaVA-Docent. Six researchers conducted quantitative and qualitative evaluations of LLaVA-Docent to assess its effectiveness, benchmarking it against the GPT-4 model in a few-shot setting. The evaluation process revealed distinct strengths and weaknesses of the LLaVA-Docent model. Our findings highlight the efficacy of LLaVA-Docent in enhancing the accessibility and engagement of art appreciation education. By harnessing the potential of MLLMs, this study makes a significant contribution to the field of art education, proposing a novel methodology that reimagines the way art appreciation is taught and experienced.

Submitted to arXiv on 09 Feb. 2024

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2402.06264v1

In the realm of education, art appreciation plays a crucial role in fostering critical thinking and emotional intelligence among learners. Recent technological advancements have opened up new possibilities for innovative solutions to traditional challenges faced by art education. This study focuses on the development of LLaVA-Docent, a multi-modal large language model (MLLM) that utilizes virtual dialogue datasets created through an extensive literature review and expert consultations. The effectiveness of LLaVA-Docent was evaluated through quantitative and qualitative assessments by six researchers. Results showed its efficacy in enhancing accessibility and engagement in art appreciation education compared to the GPT-4 model. By harnessing the potential of MLLMs, this study proposes a novel methodology that reimagines how art appreciation is taught and experienced, making a significant contribution to the field of art education. The integration of technology not only addresses existing challenges but also opens up new avenues for enriching educational experiences for students across diverse backgrounds.
Created on 22 Mar. 2024

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.