AI Chatbot as an Effective English Teaching Partner for University Students
DOI:
https://doi.org/10.51601/ijersc.v5i3.820Abstract
This study investigated the effectiveness of an AI chatbot for improving English language skills among Indonesian university students. In order to address the research question, the researchers conducted an analysis of responses to a 20-item questionnaire distributed via Google Form among a sample of 95 university students. The survey was conducted to evaluate student perceptions of the chatbot's usability, language accuracy, feedback quality, and overall strengths. The findings revealed high student satisfaction with all aspects of the chatbot. Students agreed that the chatbot was user-friendly, understood their questions, provided helpful feedback, and offered valuable learning opportunities. These results align with previous research on the effectiveness of chatbots in enhancing English language proficiency. The study suggests that AI chatbots can be a beneficial tool for both independent language practice and supplementing classroom instruction. The chatbot's ability to personalise learning experiences and adapt to individual needs contributes to improved student engagement and language acquisition. This research adds to the growing body of evidence supporting the use of AI chatbots in computer-assisted language learning (CALL). Future research could investigate the effectiveness of the chatbot for learners with varying proficiency levels.
Downloads
References
Alfonso Echazarra, B., Radinger, T., Echazarra, A., & Alfonsoechazarra, A. (2019). DIRECTORATE FOR EDUCATION AND SKILLS LEARNING IN RURAL SCHOOLS: INSIGHTS FROM PISA, TALIS AND THE LITERATURE OECD Education Working Paper No. 196. www.oecd.org/edu/workingpapers
Alharbi, W. (2023). AI in the Foreign Language Classroom: A Pedagogical Overview of Automated Writing Assistance Tools. Education Research International, 2023. https://doi.org/10.1155/2023/4253331
Amin, M. Y. M. (2023). AI and Chat GPT in Language Teaching: Enhancing EFL Classroom Support and Transforming Assessment Techniques. International Journal of Higher Education Pedagogies, 4(4), 1–15. https://doi.org/10.33422/ijhep.v4i4.554
Annamalai, N., Rashid, R. A., Munir Hashmi, U., Mohamed, M., Harb Alqaryouti, M., & Eddin Sadeq, A. (2023). Using chatbots for English language learning in higher education. Computers and Education: Artificial Intelligence, 5, 100153. https://doi.org/10.1016/j.caeai.2023.100153
Belda-Medina, J., & Calvo-Ferrer, J. R. (2022). Using Chatbots as AI Conversational Partners in Language Learning. Applied Sciences (Switzerland), 12(17), 8427. https://doi.org/10.3390/app12178427
Broom, C. (2015). Empowering students: Pedagogy that benefits educators and learners. Citizenship, Social and Economics Education, 14(2), 79–86. https://doi.org/10.1177/2047173415597142
Brownell, M. T., Bishop, A. M., & Sindelar, P. T. (2018). Republication of “NCLB and the Demand for Highly Qualified Teachers: Challenges and Solutions for Rural Schools.” Rural Special Education Quarterly, 37(1), 4–11. https://doi.org/10.1177/8756870517749604
Chu, Y., Chen, C., Wang, G., & Su, F. (2022). The Effect of Education Model in Physical Education on Student Learning Behavior. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.944507
du Plessis, P., & Mestry, R. (2019). Teachers for rural schools – A challenge for South Africa. South African Journal of Education, 39(1), s1–s9. https://doi.org/10.15700/saje.v39ns1a1774
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., Albanna, H., Albashrawi, M. A., Al-Busaidi, A. S., Balakrishnan, J., Barlette, Y., Basu, S., Bose, I., Brooks, L., Buhalis, D., … Wright, R. (2023). “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642. https://doi.org/10.1016/j.ijinfomgt.2023.102642
Esiyok, E., Gokcearslan, S., & Kucukergin, K. G. (2024). Acceptance of Educational Use of AI Chatbots in the Context of Self-Directed Learning with Technology and ICT Self-Efficacy of Undergraduate Students. International Journal of Human-Computer Interaction. https://doi.org/10.1080/10447318.2024.2303557
Filgona, J., Sakiyo, J., Gwany, D. M., & Okoronka, A. U. (2020). Motivation in Learning. Asian Journal of Education and Social Studies, 16–37. https://doi.org/10.9734/ajess/2020/v10i430273
Grudin, J., & Jacques, R. (2019, May 2). Chatbots, humbots, and the quest for artificial general intelligence. Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/3290605.3300439
Haugeland, I. K. F., Følstad, A., Taylor, C., & Alexander, C. (2022). Understanding the user experience of customer service chatbots: An experimental study of chatbot interaction design. International Journal of Human Computer Studies, 161, 102788. https://doi.org/10.1016/j.ijhcs.2022.102788
Huang, W., Hew, K. F., & Fryer, L. K. (2022). Chatbots for language learning—Are they really useful? A systematic review of chatbot-supported language learning. In Journal of Computer Assisted Learning (Vol. 38, Issue 1, pp. 237–257). John Wiley and Sons Inc. https://doi.org/10.1111/jcal.12610
Jo, H., & Park, D. H. (2024). Effects of ChatGPT’s AI capabilities and human-like traits on spreading information in work environments. Scientific Reports, 14(1), 1–18. https://doi.org/10.1038/s41598-024-57977-0
Kaledio, P., Robert, A., & Frank, L. (2024). The Impact of Artificial Intelligence on Students’ Learning Experience. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.4716747
Kamalov, F., Santandreu Calonge, D., & Gurrib, I. (2023). New Era of Artificial Intelligence in Education: Towards a Sustainable Multifaceted Revolution. Sustainability (Switzerland), 15(16), 12451. https://doi.org/10.3390/su151612451
Kim, A., & Su, Y. (2024). How implementing an AI chatbot impacts Korean as a foreign language learners’ willingness to communicate in Korean. System, 122, 103256. https://doi.org/10.1016/j.system.2024.103256
Klímová, B., & Ibna Seraj, P. M. (2023). The use of chatbots in university EFL settings: Research trends and pedagogical implications. In Frontiers in Psychology (Vol. 14). Frontiers Media SA. https://doi.org/10.3389/fpsyg.2023.1131506
Kohnke, L. (2023). A Pedagogical Chatbot: A Supplemental Language Learning Tool. RELC Journal, 54(3), 828–838. https://doi.org/10.1177/00336882211067054
Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023). Interacting with educational chatbots: A systematic review. Education and Information Technologies, 28(1), 973–1018. https://doi.org/10.1007/s10639-022-11177-3
Labadze, L., Grigolia, M., & Machaidze, L. (2023). Role of AI chatbots in education: systematic literature review. In International Journal of Educational Technology in Higher Education (Vol. 20, Issue 1, pp. 1–17). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1186/s41239-023-00426-1
Lee, Y. F., Hwang, G. J., & Chen, P. Y. (2022). Impacts of an AI-based chabot on college students’ after-class review, academic performance, self-efficacy, learning attitude, and motivation. Educational Technology Research and Development, 70(5), 1843–1865. https://doi.org/10.1007/s11423-022-10142-8
Lo, C. K., & Al-Abdullatif, A. M. (2023). Modeling Students’ Perceptions of Chatbots in Learning: Integrating Technology Acceptance with the Value-Based Adoption Model. Education Sciences 2023, Vol. 13, Page 1151, 13(11), 1151. https://doi.org/10.3390/EDUCSCI13111151
Lochner, B., Conrad, R. M., & Graham, E. (2015). Secondary Teachers’ Concerns in Adopting Learning Management Systems: A U.S. Perspective. TechTrends, 59(5), 62–70. https://doi.org/10.1007/s11528-015-0892-4
Menon, D., & Shilpa, K. (2023). “Chatting with ChatGPT”: Analyzing the factors influencing users’ intention to Use the Open AI’s ChatGPT using the UTAUT model. Heliyon, 9(11), e20962. https://doi.org/10.1016/j.heliyon.2023.e20962
Na-Young, K. (2018). Chatbots and Korean EFL Students’ English Vocabulary Learning. Journal of Digital Convergence, 16(2), 1–7.
Parsakia, K. (2023). The Effect of Chatbots and AI on The Self-Efficacy, Self-Esteem, Problem-Solving and Critical Thinking of Students. Health Nexus, 1(1), 71–76. https://doi.org/10.61838/hn.1.1.14
Qasem, F., Ghaleb, M., Mahdi, H. S., Al Khateeb, A., & Al Fadda, H. (2023). Dialog chatbot as an interactive online tool in enhancing ESP vocabulary learning. Saudi Journal of Language Studies, 3(2), 76–86. https://doi.org/10.1108/sjls-10-2022-0072
Qinghua, Y., & Satar, M. (2020). Language Acquisition (SLA) researchers (Atwell. English. International Online Journal of Education and Teaching (IOJET), 7(2), 390–410. http://iojet.org/index.php/IOJET/article/view/707
Ren, R., Zapata, M., Castro, J. W., Dieste, O., & Acuna, S. T. (2022). Experimentation for Chatbot Usability Evaluation: A Secondary Study. IEEE Access, 10, 12430–12464. https://doi.org/10.1109/ACCESS.2022.3145323
Roos, S. (2018). CHATBOTS IN EDUCATION A passing trend or a valuable pedagogical tool ? Chatbots in Education A, 58. http://www.diva-portal.org/smash/record.jsf?pid=diva2%3A1223692&dswid=879
Saeed Ahmed Mohamed, S., & Mahmoud Ibrahim Alian, E. (2023). Students’ Attitudes toward Using Chatbot in EFL Learning. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.4591887
Sol, K., Heng, K., & Sok, S. (2024). Using Ai in English Language Education: An Exploration of Cambodian Efl University Students’ Experiences, Perceptions, and Attitudes. https://doi.org/10.2139/SSRN.4687461
Steigerwald, E., Ramírez-Castañeda, V., Brandt, D. Y. C., Báldi, A., Shapiro, J. T., Bowker, L., & Tarvin, R. D. (2022). Overcoming Language Barriers in Academia: Machine Translation Tools and a Vision for a Multilingual Future. BioScience, 72(10), 988–998. https://doi.org/10.1093/biosci/biac062
Wong, L. H., Chan, T. W., Chen, W., Looi, C. K., Chen, Z. H., Liao, C. C. Y., King, R. B., & Wong, S. L. (2020). IDC theory: interest and the interest loop. Research and Practice in Technology Enhanced Learning, 15(1), 1–16. https://doi.org/10.1186/s41039-020-0123-2
Yin, J., Goh, T. T., Yang, B., & Xiaobin, Y. (2021). Conversation Technology With Micro-Learning: The Impact of Chatbot-Based Learning on Students’ Learning Motivation and Performance. Journal of Educational Computing Research, 59(1), 154–177. https://doi.org/10.1177/0735633120952067
Zhang, Z., & Huang, X. (2024). The impact of chatbots based on large language models on second language vocabulary acquisition. Heliyon, 10(3), e25370. https://doi.org/10.1016/J.HELIYON.2024.E25370
Zumstein, D., & Hundertmark, S. (2017). Chatbots-An Interactive Technology for Personalized Communication, Transactions and Services. IADIS International Journal on WWW/Internet, 15(1), 96–109. https://www.researchgate.net/publication/322855718.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 International Journal of Educational Research & Social Sciences
This work is licensed under a Creative Commons Attribution 4.0 International License.
