Innovedum Public
Evaluating the impact of AI-based tutoring systems on student learning in biology education
Dr. Katja Köhler | D-BIOL

Share

This project investigates the effectiveness of an AI chatbot on the learning behavior and learning success of students in biology education. The ready-to-use, self-developed chatbot aims to promote the individual learning process of students through interactive dialogs and to provide lecturers with an overview of the students' learning progress.
Abstract
Acquiring a sound understanding of concepts is a prerequisite for successfully studying at ETH and enables students to tackle interdisciplinary issues and future challenges. Critical examination of one's own knowledge plays a key role in this. However, the constantly increasing number of students poses a major challenge for lecturers to ensure that the requirements for a personalized education are met in the future. The rapid development and spread of new technologies such as ChatGPT are opening up new possibilities for learning support; at the same time, however, it is also clear that their direct use at universities is accompanied by limitations in terms of factual accuracy, didactic embedding and benefits for learning and teaching. In this project, we want to investigate the effectiveness of a biology-specific AI-based chatbot on student learning. The ready-to-use, self-developed chatbot "bioTutor" offers a constructivist learning environment and is specifically tailored to lecture content. This enables an individualized learning experience with personalized feedback and promotes learning by working on biological topics while incorporating prior knowledge. The bioTutor differs from classic chatbots in that, as part of the conversations, further topic-relevant questions are asked, which are answered by the students and thus critically reflected upon. The tool can be used in lectures to consolidate knowledge and prepare for exams. The learning process can be tracked by lecturers via detailed usage analyses so that comprehension difficulties can be identified early on and students can be given targeted support.
Project goals
This project is about integrating a lecture-specific and AI-supported chatbot «bioTutor» into biology lectures to optimally support students in developing complex interdisciplinary content through individual learning experiences. We are pursuing the following goals: Goal 1: Integrate and use bioTutor in specific lectures to a) track and analyze student learning and b) increase student engagement and learning performance through continuous development of the tool based on surveys and measurements. Goal 2: Plan and conduct research and surveys to find out how and for what purpose AI-based chatbots can be used most effectively to best support students. Goal 3: Establish workflows that allow instructors to analyze usage data anonymously to uncover comprehension issues and track student learning Goal 4: Develop a white paper to support lecturers and teachers in the planning, development, and implementation of a similar lecture-based chatbot or the use of the developed chatbot, investigate the transferability of the results to other contexts, topics and disciplines, and scientifically publish the collected data and findings.
Effects of the project
The project shows possible applications of new technologies in teaching and has a potential impact on students' learning process, the design process of teaching materials, and curriculum development. Added value for students: The availability of a knowledge-based and lecture-specific chatbot for learning new concepts and knowledge review represents a new opportunity for self-study. Specifically, the chatbot is made available to students as a web application for personalized preparation and follow-up of lectures, as well as for support in exam preparation. By constructively embedding the already developed chatbot in various lectures, the academic learning success of the students can ideally be better promoted. In addition, the tool offers the opportunity to acquire AI-specific skills in relation to the use and risks of such tools. Added value for lecturers: By having students use the course-specific chatbot, lecturers gain insight into the data collected, which provides an overview of prior knowledge, existing misconceptions, and the learning process. This allows lectures and exercises to be adapted accordingly. In addition, the chatbot allows better control over the handling of misinformation from other chatbots, as mainly lecture-relevant content would be available. Added value for degree programs: In addition to the students directly involved in the project, other students could benefit, as a successful project completion could contribute to changes in individual aspects of teaching. Better knowledge of the level of knowledge of a student cohort is valuable for curriculum development in order to adapt learning content or learning units or to provide additional learning opportunities to close knowledge gaps. Knowledge about the integration and application of such chatbots can also be used in course initiatives to offer similar courses across disciplines and semesters.



Applicant Dr. Katja Köhler | Manager Dr. Samuel Tobler | Contact person Dr. Katja Köhler
koehlerk@ethz.ch
| Department D-BIOL | Institute Center for Active Learning (CAL) | | Filing date 01.03.2024 | Period 01.06.2024 to 31.12.2025