Aligning Learners' Expectations and Performance by Learning Analytics Systemwith a Predictive Model

AI-generated keywords: Learning Analytics Higher Education Grade Prediction Self-Regulation Qualitative Analysis

AI-generated Key Points

  • Learning analytics (LA) is a tool for improving student learning and performance by collecting, analyzing, and representing data about learners.
  • Adoption of LA in higher education institutions has been slow, with Slovenian institutions lagging behind other European countries.
  • Researchers used surveys and focus groups to gather students' expectations of LA in higher education.
  • Focus groups allowed for in-depth exploration of students' perceptions and expectations without the limitations of questionnaires.
  • Participants were asked about their interest in receiving information through LA, how often they would like access to this information, and whether they would like teaching staff to have access as well.
  • Based on these expectations gathered from students, researchers developed a requirement-oriented LA solution consisting of an interface that utilizes grade prediction with an AI model for a selected course.
  • The main benefit of this system is its support for self-regulation of the learning process during the semester.
  • Positive grade predictions presented students with predicted grades along with visual and text explanations while negative grade predictions prompted learners to change their behavior by comparing their behavior trends with academically successful and unsuccessful students.
  • This research highlights the potential benefits of using LA to improve student learning outcomes in higher education institutions.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Saša Brdnik, Boštjan Šumak, Vili Podgorelec

11 pages, 4 figures, submitted to ACM IUI conference
License: CC BY-NC-SA 4.0

Abstract: Learning analytics (LA) is data collection, analysis, and representation of data about learners in order to improve their learning and performance. Furthermore, LA opens the door to opportunities for self-regulated learning in higher education, a circular process in which learners activate and sustain behaviours that are oriented toward their personal learning goals. The potentials of LA and self-regulated learning are huge; however, they are not yet widely applied in higher education institutions. Slovenian higher education institutions have lagged behind other European countries in LA adoption. Our research aims to fill this gap by using a qualitatively and quantitatively led workflow for building a requirement-oriented LA solution, consisting of empirically gathering the students' expectations of LA and presenting a dashboard solution. Translated Student Expectations of Learning Analytics Questionnaire and focus groups were used to gather expectations from learners. Based on them, a user interface utilizing LA and grade prediction with an AI model was implemented for a selected course. The interface includes early grade prediction, peer comparison, and historical data overview. Grade prediction is based on a machine learning model built on users' interaction in the virtual learning environment, demographic data and lab grades. First, classification is used to determine students at risk of failing - its precision reaches 98% after the first month of the course. Second, the exact grade is predicted with the Decision Tree Regressor, reaching a mean absolute error of 11.2grade points (on a 100 points scale) after the first month. The proposed system's main benefit is the support for self-regulation of the learning process during the semester, possibly motivating students to adjust their learning strategies to prevent failing the course. Initial student evaluation showed positive results.

Submitted to arXiv on 14 Nov. 2022

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2211.07729v1

Learning analytics (LA) is a powerful tool for improving student learning and performance by collecting, analyzing, and representing data about learners. The adoption of LA in higher education institutions has been slow, with Slovenian institutions lagging behind other European countries. To address this gap, researchers used a combination of surveys and focus groups to gather students' expectations of LA in higher education. The focus groups allowed for in-depth exploration of students' perceptions and expectations without the limitations of questionnaires. Participants were asked about their interest in receiving information through LA, how often they would like access to this information, and whether they would like teaching staff to have access as well. They were also asked about their feelings regarding data collection, processing, and publication in view of the proposed LA solution. Based on these expectations gathered from students, researchers developed a requirement-oriented LA solution consisting of an interface that utilizes grade prediction with an AI model for a selected course. The interface includes early grade prediction, peer comparison, historical data overview, and self-reported effort in hours spent working on the course. The main benefit of this system is its support for self-regulation of the learning process during the semester. The proposed system's initial evaluation showed positive results among ten students who received access to anonymized data on two representative users via the dashboard. Two user flows were considered in user interface development: one for positive grade predictions and another for negative grade predictions. Positive grade predictions presented students with predicted grades along with visual and text explanations while negative grade predictions prompted learners to change their behavior by comparing their behavior trends with academically successful and unsuccessful students. Overall, this research highlights the potential benefits of using LA to improve student learning outcomes in higher education institutions. By gathering student expectations through qualitative analysis methods such as surveys and focus groups, researchers can develop requirement-oriented solutions that meet student needs while supporting self-regulated learning behaviors throughout the semester. As such systems become more widely adopted, they have the potential to transform higher education by providing personalized learning experiences that help students achieve their academic goals.
Created on 25 Jun. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.