Enhancing E-Learning Interaction through Customized LLM-Based Chatbots – A Prototype Study
Keywords:
E-Learning, Large Language Models, Chatbots, Instructional DesignAbstract
Introduction and Objective: E-learning supports both synchronous and asynchronous education and plays an important role in knowledge transfer and management. The article explores how generative AI, specifically Large Language Models (LLMs), can enhance learner interaction in E-learning environments. Based on theoretical insights into instructional and conversational design, a chatbot prototype was developed for a blended, practice-oriented course on "Container Orchestration and Coding with DevOps" targeting IT professionals.
Methodology: The chatbot integrates an open-source model (LLaMA 3.3) and employs retrieval-augmented generation (RAG) techniques within an online IDE. It offers three modes: task support, task recommendation, and Q&A, enriched with context-specific documentation. The prototype was developed iteratively, informed by theoretical research, hands-on experimentation, and the author’s long-term experience as a trainer. An initial user evaluation was conducted through an online survey. A follow-up evaluation based on an improved chatbot is planned for May 2025 and will be incorporated into the final study.
Results: Although technically functional, user engagement during the first four-week evaluation was limited. About 10% used the chatbot occasionally, while 70% did not use it at all. Preferred alternatives included traditional course materials (100%), online sources (~75%) and general-purpose chatbots like ChatGPT (~45%). Reasons for low adoption included time constraints, preference for existing online chatbots, or general lack of interest in using chatbot-based support.
Conclusions: The findings reveal that, while LLM chatbots hold promise for E-learning, effective onboarding strategies, user-centered design, and AI literacy are critical. Long-term studies are needed to evaluate their real-world impact across educational settings.
Downloads
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 International Congress of Knowledge and Innovation
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
DECLARATION OF ASSIGNMENT AND TRANSFER OF PATRIMONIAL RIGHTS ON ARTICLE PUBLISHED IN THE CIKI PROCEEDINGS AND AUTHORIZATION FOR PUBLICATION
The AUTHOR, according to the law n. 9.610 of February 19th, 1998, hereby declares to whomsoever may concern, that it assigns and transfers, in a universal, definitive, irreversible, exclusive and gratuitous manner, all of its author's economic rights on the article submitted to the International Congress of Knowledge and Innovation - ciki.
The AUTHOR guarantees:
- That the article is original, except for the citations of other published works, provided that the limitations expressed in articles 46 and 47 of Law 9.610 of February 19, 1998 are observed;
- That the article does not contain any slanderous or defamatory statements and does not infringe any intellectual, commercial or industrial property rights of any third parties;
- To promptly compensate the International Congress of Knowledge and Innovation - ciKi for any indemnities, losses or expenses arising from the breach of the guarantees expressed in paragraphs 1 and 2, above.
With this assignment and transfer of the patrimonial rights referring to the author's right, the International Congress of Knowledge and Innovation - ciKi and its successors are free of any copyright payment to the AUTHOR or to their heirs or successors.
The AUTHOR further declares that the International Congress of Knowledge and Innovation - ciKi is fully authorized to use this article, in whole or in part, edited or complete, in Portuguese and in all other languages, in print, in Electronic means, internet, for commercial purposes or not, including distributing, adapting, creating derivative works, assigning rights to third parties in Brazil and / or abroad, including but not limited to: teaching, study and research; publication and dissemination; quote; use in general telecommunication means; audiovisual use in general, including all existing or future digital technologies, capable of storing and reproducing data.
The AUTHOR has guaranteed the moral rights over his article, including the binding of his name as author of the article object of this transfer.
The AUTHOR must always make a written request to the International Congress of Knowledge and Innovation - ciKi, when he intends to use his article, and is obliged to always insert the credit in the original publication, citing the bibliographic reference, complete and legible.
