A Systematic Analytical Review of the Effects of Using ChatGPT in Education

Amani, Hossein; Motallebinejad, Alireza; Choupani, Fatemeh; Zare Gachi,, Mohammad

doi:10.30473/t-edu.2024.70960.1136

Document Type : Original Article

Authors

¹ Technology and Training Group Expert, Damghan City Education Department, Semnan, Iran.

² Assistant Professor, Department of Educational Sciences, Farhangian University, Semnan, Iran.

³ Elementary Teacher, Damghan City Education Department, Semnan, Iran.

⁴ Elementary Teacher, Education Department of Sabzevar, Iran.

https://doi.org/10.30473/t-edu.2024.70960.1136

Abstract

Today, with the development of science and technology, we are witnessing the application of artificial intelligence in human life. One of the applications of artificial intelligence is its application in the production of GPT chat. The purpose of this research is to present a systematic analysis of the effects of the use of GPT chat in education, based on the existing literature in this field. To conduct this research, the meta-analysis method based on the PRISMA Statement was used and the selected databases are Web of Science, Scopus, and Google Scholar. A literature search was conducted between May and June 2023 with an initial identification of 154 records, and finally, 12 case studies were analyzed. The findings showed that the integration of artificial intelligence as a complementary tool and great educational support in the teaching-learning process, by increasing learning experiences and strengthening interaction between students and teachers, has a positive effect on the teaching-learning process. Of course, it should be kept in mind that the successful application and implementation of this program requires teachers to be familiar with its function. Finally, it should be said that the findings of this research provide a strong basis for future research and decisions regarding the use of GPT chat in the field of education.

Keywords

References

Alonso-Arévalo, J & Quinde-Cordero, M. (2023). ChatGPT: La creación automática de textos académicos con Inteligencia artificial y su impacto en la comunicación académica y educativa. Desiderata, 6(22), 136-142.

Aromataris, E & Munn, Z. (Eds.). (2020). JBI manual for evidence synthesis. Jbi. https://doi.org/10.3389/feduc.2023.1166682

Ausat, A. M. A. Massang, B. Efendi, M. Nofirman, N & Riady, Y. (2023). Can Chat GPT replace the role of the teacher in the classroom: A fundamental analysis. Journal on Education, 5(4), 16100-16106. https://doi.org/10.31004/joe.v5i4

Brazdil, P & Jorge, A. (Eds.). (2001). Progress in Artificial Intelligence. Knowledge Extraction, Multi-agent Systems, Logic Programming, and Constraint Solving: 10th Portuguese Conference on Artificial Intelligence, EPIA 2001, Porto, Portugal, December 17-20, 2001. Proceedings (Vol. 2258). Springer Science & Business Media.

Castillo, A. G. R. Rivera, H. V. H. Teves, R. M. V. Lopez, H. R. P. Reyes, G. Y. Rodriguez, M. A. M & Arias-Gonzáles, J. L. (2023). Effect of Chat GPT on the digitized learning process of university students. Journal of Namibian Studies: History Politics Culture, 33, 1-15.

Diego Olite, F. M. Morales Suárez, I. D. R & Vidal Ledo, M. J. (2023). Chat GPT: origen, evolución, retos e impactos en la educación. Educación Médica Superior, 37(2).

Fauzi, F. Tuhuteru, L. Sampe, F. Ausat, A. M. A & Hatta, H. R. (2023). Analysing the role of ChatGPT in improving student productivity in higher education. Journal on Education, 5(4), 14886-14891. DOI https://doi.org/10.31004/joe.v5i4.2563

Firat, M. (2023). What ChatGPT means for universities: Perceptions of scholars and students. Journal of Applied Learning and Teaching, 6(1), 57-63.

Flores, F. A. I. Sanchez, D. L. C. Urbina, R. O. E. Coral, M. Á. V. Medrano, S. E. V & Gonzales, D. G. E. (2022). Inteligencia artificial en educación: una revisión de la literatura en revistas científicas internacionales. Apuntes universitarios, 12(1), 353-372. https://doi.org/10.17162/au.v12i1.974

Fuchs, K. (2023, May). Exploring the opportunities and challenges of NLP models in higher education: is Chat GPT a blessing or a curse? In Frontiers in Education. (Vol. 8, p. 1166682). Frontiers. https://doi.org/10.3389/feduc.2023.1166682

García-Peñalvo, F. J. (2023). La percepción de la Inteligencia Artificial en contextos educativos tras el lanzamiento de ChatGPT: disrupción o pánico. Education in the Knowledge Society (EKS), 24, e31279-e31279. https://doi.org/10.14201/eks.31279

Gilson, A. Safranek, C. W. Huang, T. Socrates, V. Chi, L. Taylor, R. A & Chartash, D. (2023). How Does ChatGPT Perform on the United States Medical Licensing Examination (USMLE)? The Implications of Large Language Models for Medical Education and Knowledge Assessment. JMIR Medical Education, 9(1), e45312.

Halaweh, M. (2023). ChatGPT in education: Strategies for responsible implementation. https://doi.org/10.30935/cedtech/13036

Hung, J & Chen, J. (2023). The benefits, risks and regulation of using ChatGPT in Chinese academia: a content analysis. Social Sciences, 12(7), 380.‌

Jara I, Ochoa, J. (2021). Uses and Effects of Artificial Intelligence in Education. Social Sector Education Division. Available online: https://ie42003cgalbarracin.edu.pe/biblioteca/LIBR-NIV331012022134652.pdf (accessed on 3 June 2023).

Javaid, M. Haleem, A. Singh, R. P. Khan, S & Khan, I. H. (2023). Unlocking the opportunities through ChatGPT Tool towards ameliorating the education system. BenchCouncil Transactions on Benchmarks, Standards and Evaluations, 3(2), 100115. https://doi.org/10.1016/j.tbench.2023.100115

Megahed, F. M. Chen, Y. J. Ferris, J. A. Knoth, S & Jones-Farmer, L. A. (2024). How generative AI models such as ChatGPT can be (mis) used in SPC practice, education, and research? An exploratory study. Quality Engineering, 36(2), 287-315. https://doi.org/10.1080/08982112.2023.2206479

Montenegro-Rueda, M. Fernández-Cerero, J. Fernández-Batanero, J. M & López-Meneses, E. (2023). Impact of the implementation of ChatGPT in education: A systematic review. Computers, 12(8), 153. DOI: https://doi.org/10.17162/au.v12i1.974

Mulyawati, I. B & Ramadhan, D. F. (2021). Bibliometric and visualized analysis of scientific publications on geotechnics fields. ASEAN Journal of Science and Engineering Education, 1(1), 37-46. https://doi.org/10.17509/ajsee.v1i1.32405

Nandiyanto, A. B. D & Al Husaeni, D. F. (2021). A bibliometric analysis of materials research in Indonesian journal using VOSviewer. Journal of Engineering Research. https://doi.org/10.36909/jer.ASSEEE.16037

Neumann, M. Rauschenberger, M & Schön, E. M. (2023, May). “We Need To Talk About ChatGPT”: The Future of AI and Higher Education. In 2023 IEEE/ACM 5th International Workshop on Software Engineering Education for the Next Generation (SEENG) (pp. 29-32). IEEE. https://doi.org/10.25968/opus-2467

Osorio, J. A. C. (2023). Explorando el potencial de ChatGPT en la escritura científica: ventajas, desafíos y precauciones. Scientia et Technica, 28(1), 3-5. DOI: 10.36227/techrxiv.21789434.v1

Page, M. J. McKenzie, J. E. Bossuyt, P. M. Boutron, I. Hoffmann, T. C. Mulrow, C. D... & Moher, D. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Bmj, 372. https://doi.org/10.1016/j.jclinepi.2021.03.001

Qadir, J. (2023, May). Engineering education in the era of ChatGPT: Promise and pitfalls of generative AI for education. In 2023 IEEE Global Engineering Education Conference (EDUCON) (pp. 1-9). IEEE. DOI: 10.36227/techrxiv.21789434.v1

Rahman, M. M & Watanobe, Y. (2023). ChatGPT for education and research: Opportunities, threats, and strategies. Applied Sciences, 13(9), 5783. https://doi.org/10.3390/app13095783

Rudolph, J. Tan, S & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of applied learning and teaching, 6(1), 342-363. tecnologías de la información, 11(23), 98-107. de la información, 11(23), 98-107. DOI: https://doi.org/10.36825/RITI.11.23.009

Sok, S & Heng, K. (2023). ChatGPT for education and research: A review of benefits and risks. Available at SSRN 4378735.‌

Sorensen, A. A. Seary, A & Riopelle, K. (2010). Alzheimer's disease research: a COIN study using co-authorship network analytics. Procedia-Social and Behavioral Sciences, 2(4), 6582-6586. https://doi.org/10.1016/j.sbspro.2010.04.068

Strzelecki, A. (2023). To use or not to use ChatGPT in higher education? A study of students’ acceptance and use of technology. Interactive Learning Environments, 1-14. https://doi.org/10.1080/10494820.2023.2209881

Topsakal, O & Topsakal, E. (2022). Framework for a foreign language teaching software for children utilizing AR, voicebots and ChatGPT (large language models). The Journal of Cognitive Systems, 7(2), 33-38. https://doi.org/10.52876/jcs.1227392

Wang, T. Lund, B. D. Marengo, A. Pagano, A. Mannuru, N. R. Teel, Z. A & Pange, J. (2023). Exploring the potential impact of artificial intelligence (AI) on international students in higher education: Generative AI, chatbots, analytics, and international student success. Applied Sciences, 13(11), 6716. https://doi.org/10.3390/app13116716

Sánchez, O. V. G. (2023). Uso y percepción de ChatGPT en la educación superior. Revista de investigación en tecnologías de la información, 11(23), 98-107.