Results of the summarizing process for the arXiv paper: 2303.13379v1

This article presents the findings of a systematic literature review conducted to identify the current state of research on using Large Language Models (LLMs) to automate and support educational tasks. The review analyzed 118 peer-reviewed papers published since 2017, focusing on the practical and ethical challenges associated with LLMs-based innovations in education. The study identified concerns regarding technological readiness, model performance, replicability, system transparency, privacy, equality and beneficence of these innovations. To address these issues and support future research in this area three recommendations were proposed: updating existing innovations with state-of-the-art models such as GPT-3; embracing open sourcing models/systems initiative; and adopting a human-centered approach throughout the developmental process. The study also extracted contextual information related to educational tasks, stakeholders involved, LLMs used and machine learning tasks performed by each included paper. Additionally seven data extraction items were developed to assess technology readiness and ethicality based on Australian Department of Defense's Technology Readiness Levels (TRL). The findings provide valuable insights for researchers and practitioners exploring viable directions for developing practical and ethical LLMs-based innovations that benefit students, teachers and institutions while addressing potential challenges.

• Systematic literature review conducted to identify the current state of research on using Large Language Models (LLMs) in education
• 118 peer-reviewed papers published since 2017 were analyzed
• Focus on practical and ethical challenges associated with LLMs-based innovations in education
• Concerns identified regarding technological readiness, model performance, replicability, system transparency, privacy, equality and beneficence of these innovations
• Three recommendations proposed: updating existing innovations with state-of-the-art models such as GPT-3; embracing open sourcing models/systems initiative; and adopting a human-centered approach throughout the developmental process
• Contextual information related to educational tasks, stakeholders involved, LLMs used and machine learning tasks performed by each included paper was extracted
• Seven data extraction items were developed to assess technology readiness and ethicality based on Australian Department of Defense's Technology Readiness Levels (TRL)
• Findings provide valuable insights for researchers and practitioners exploring viable directions for developing practical and ethical LLMs-based innovations that benefit students, teachers and institutions while addressing potential challenges.

A group of people looked at lots of papers about using computers to help with learning. They found 118 papers that were written since 2017. They wanted to see if there were any problems or concerns with using these computer programs in schools. They found some worries about how well the programs work, how private they are, and if they treat everyone fairly. They suggested three things to make the programs better: use newer technology, share the programs with others, and think about what people need when making them. Definitions- Systematic literature review: a process of analyzing many research studies on a particular topic - Large Language Models (LLMs): computer programs that can understand and generate human language - Peer-reviewed papers: research studies that have been checked by other experts before being published - Technological readiness: how well a technology is developed and ready for use - Replicability: whether a study or experiment can be repeated by others with similar results - System transparency: how clear and understandable a system or program is to users - Equality: treating everyone fairly and equally - Beneficence: doing good for others

Using Large Language Models to Automate and Support Educational Tasks: A Systematic Literature Review

The use of large language models (LLMs) has been gaining traction in recent years, with a range of applications being developed to automate and support educational tasks. To better understand the current state of research on this topic, a systematic literature review was conducted to identify the practical and ethical challenges associated with LLMs-based innovations in education. This article presents the findings of that review.

Methodology

The review analyzed 118 peer-reviewed papers published since 2017, focusing on the practical and ethical challenges associated with LLMs-based innovations in education. Additionally seven data extraction items were developed to assess technology readiness and ethicality based on Australian Department of Defense's Technology Readiness Levels (TRL). The study also extracted contextual information related to educational tasks, stakeholders involved, LLMs used and machine learning tasks performed by each included paper.

Findings

The study identified several concerns regarding technological readiness, model performance, replicability, system transparency, privacy, equality and beneficence of these innovations. To address these issues and support future research in this area three recommendations were proposed: updating existing innovations with state-of-the-art models such as GPT-3; embracing open sourcing models/systems initiative; and adopting a human-centered approach throughout the developmental process.

Conclusion

The findings provide valuable insights for researchers and practitioners exploring viable directions for developing practical and ethical LLMs-based innovations that benefit students, teachers and institutions while addressing potential challenges.