Izazovi korištenja jezičnih modela OpenAI platforme u kontekstu vrednovanja studentskih rješenja projektnih zadataka iz domene računalnog programiranja
PDF

Ključne riječi

evaluation of knowledge
project-based learning
OpenAI
academic integrity
Artificial Intelligence vrednovanje znanja
učenje bazirano na projektima
OpenAI
akademski integritet
umjetna inteligencija

Kako citirati

Kučak, D. (2023). Izazovi korištenja jezičnih modela OpenAI platforme u kontekstu vrednovanja studentskih rješenja projektnih zadataka iz domene računalnog programiranja. Politehnika, 7(2), 8-16. https://doi.org/10.36978/cte.7.2.1

Sažetak

Autori ovog istraživanja godinama svjedoče da je motivacija studenata za kontinuirani rad relativno niska. Kako bi povećali motivaciju studenata na samostalni rad, nastavnici na Visokom učilištu Algebra odlučili su promijeniti pristup zadnjih godina. Umjesto tjeranja studenata da uče za ispit na određene datume, studenti su dobili niz projekata koje su trebali samostalno implementirati. Rezultati istraživanja pokazali su da postoji napredak u kasnije ostvarenim rezultatima u odnosu na tradicionalne ispite. S druge strane, pojavom moćnih i besplatnih ili vrlo pristupačnih jezičnih modela kao što su oni platforme OpenAI, nastavnici se susreću sa izazovima da studenti mogu koristiti takve modele kako bi riješi projektni zadatak što je u suprotnosti sa etičkim kodeksom. Svrha ovog istraživanja je utvrditi kakve rezultate je sposoban postići jezični model platforme OpenAI ako mu se zada projektni zadatak iz određenog kolegija. Definirana su 2 istraživačka pitanja. Kakav rezultat postiže jezični model na OpenAI platformi kad mu se zada projektni zadatak iz kolegija Java web programiranje i postoji li razlika u rezultatima u odnosu na postignute rezultate studenata (Q1)? Postoji li razlika u rezultatima koje postiže jezični model u odnosu na prirodni jezik na kojem mu je zadan projektni zadatak (hrvatski ili engleski) (Q2)? Analiza rezultata pokazala je da u određenim slučajevima jezični model je sposoban riješiti ispit za prolaznu ocjenu bez dodatnih intervencija korisnika, iako su postignuti rezultati značajno slabiji od rezultata koje postižu studenti. Bolje rezultate jezični model postiže ako mu se ispit zada na engleskom jeziku u odnosu na hrvatski jezik.
https://doi.org/10.36978/cte.7.2.1
PDF

Reference

Bele, D., Kučak, D., Pašić, Đ. (2023) Increasing Students’ Motivation and Improving Outcome by Changing the Course Examination from Test to Project on a University Course. U Skala, K. (ur.) 2023 46th International Convention on Information, Communication and Electronic Technology (MIPRO) (str. 611-615). IEEE.

Biswas, S. (2023). ChatGPT and the future of medical writing. Radiology, 307(2), e223312.

Bognar, L. (2012). Kreativnost u nastavi. Napredak: Časopis za interdisciplinarna istraživanja u odgoju i obrazovanju, 153(1), 9-20.

Cigan, V., Šlogar, H. (2012). Istraživanje stavova studenata o metodama poučavanja na visokim čilištima u cilju razvoja poduzetničke kompetencije. Učenje za poduzetništvo, 2(1), 179-190.

Debeljak De Martini, A., Ristić, R., Potočnjak, J. (2020). Nastavne metode u edukaciji zdravstvenih djelatnika. Journal of Applied Health Sciences= Časopis za primijenjene zdravstvene znanosti, 6(2), 297-304.

Dubovicki, S. (2019). Professors’ views on the relationship between the curriculum of the teacher education and the development of students’ creativity based on the Delphi method–longitudinal research. U Dziurzyński, K.; Duda, E. (ur.), What is new in the Field of Education? (str. 61-81). (ISSN 978-83-66010-31-4)

Finnie-Ansley, J., Denny, P., Becker, B. A., Luxton-Reilly, A., Prather, J. (2022). The robots are coming: Exploring the implications of openai codex on introductory programming. U ACE '22: Proceedings of the 24th Australasian Computing Education Conference (str. 10-19). doi: https://doi.org/10.1145/3511861.3511863

Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., Chartash, D. (2023). How does ChatGPT perform on the United States medical licensing examination? The implications of large language models for medical education and knowledge assessment. JMIR Medical Education, 9(1), e45312.

Gratchev, I., Jeng, D. S. (2018). Introducing a project-based assignment in a traditionally taught engineering course. European Journal of Engineering Education, 43(5), 788-799.

Kerić, E., Radanović, I., Lukša, Ž., Garašić, D., Sertić Perić, M. (2017). The effect of active teaching in the primary school's ecological content. Educatio biologiae: časopis edukacije biologije, 3, 15-20.

Konecki, M., Lovrenčić, S., Kaniški, M. (2016). Using real projects as motivators in programming education. U 2016 39th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) (str. 883-886). IEEE.

Kučak, D., Bele, D., Pašić, Đ. (2021). Climbing up the leaderboard: an empirical study of improving student outcome by applying Gamification principles to an object-oriented programming course on a university level. U 2021 44th International Convention on Information, Communication and Electronic Technology (MIPRO) (str. 527-531). IEEE.

Kučak, D., Pašić, Đ., Mršić, L. (2022, October). An Empirical Study of Long-Term Effects of Applying Gamification Principles to an Introductory Programming Courses on a University Level. U Intelligent Computing & Optimization: Proceedings of the 5th International Conference on Intelligent Computing and Optimization 2022 (ICO2022) (str. 469-477). Cham: Springer International Publishing.

Ljubin-Golub, T., Rijavec, M., Olčar, D. (2020). Student flow and burnout: The role of teacher autonomy support and student autonomous motivation. Psychological Studies, 65(2), 145-156.

Mijwil, M. M., Hiran, K. K., Doshi, R., Dadhich, M., Al-Mistarehi, A. H., Bala, I. (2023). ChatGPT and the future of academic integrity in the artificial intelligence era: a new frontier. Al-Salam Journal for Engineering and Technology, 2(2), 116-127.

Močinić, S. N. (2012). Active teaching strategies in higher education. Metodički obzori: časopis za odgojno-obrazovnu teoriju i praksu, 7(15), 97-105.

Mohorovičić, S., Strčić, V. (2011). An overview of computer programming teaching methods. U Central European Conference on Information and Intelligent Systems (str. 47-52). Varaždin: Faculty of Organization and Informatics Varazdin.

OpenAI Platform (2023). Preuzeto s https://platform.openai.com/

Pap, M., Vdović, R., Baletić, B. (2019). Design Thinking metoda u znanstvenom istraživanju, edukaciji i poslovnoj praksi. Prostor, 27 (2(58)), 334-347. doi: https://doi.org/10.31522/p.27.2(58).12

Perkins, M. (2023). Academic Integrity considerations of AI Large Language Models in the post-pandemic era: ChatGPT and beyond. Journal of University Teaching & Learning Practice, 20(2), 07.

Sullivan, M., Kelly, A., McLaughlan, P. (2023). ChatGPT in higher education: Considerations for academic integrity and student learning. Journal of Applied Learning and Teaching, 6(1).

Vinduška, I. (2016). Inovativne edukacijske metode i pristupi u nastavi stručnih predmeta u srednjim medicinskim školama (Doktorska disertacija, University of Zagreb. School of Medicine. Chair of Medical Sociology and Health Economics).

Yuliansyah, A., Ayu, M. (2021). The implementation of project-based assignment in online learning during covid-19. Journal of English Language Teaching and Learning, 2(1), 32-38.

Zawacki-Richter, O., Marín, V. I., Bond, M., Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education–where are the educators?. International Journal of Educational Technology in Higher Education, 16(1), 1-27.

Shukor, N. A., Tasir, Z., Van der Meijden, H., Harun, J. (2014). A Predictive Model to Evaluate Students’ Cognitive Engagement in Online Learning. Procedia - Social and Behavioral Sciences, 116, 4844–4853. doi: https://doi.org/10.1016/j.sbspro.2014.01.1036

Steingartner, W., Novitzká, V. (2015). A new approach to operational semantics by categories. U T. Hunjak, V. Kirinić, M. Konecki (ur.), Proceedings of the 26th Central European Conference on Information and Intelligent System (CECIIS 2015) (str. 247–254). University of Zagreb, Faculty of Organization and Informatics Varaždin.

Creative Commons License

Ovaj rad licenciran je pod Creative Commons Attribution-NonCommercial 4.0 International License.

Copyright (c) 2023 Array