Analisis Dampak ChatGPT Sebagai Code Assistant Terhadap Kualitas Kode Mahasiswa Informatika UTS

Siska Atmawan Oktavia Siska; Siska  Atmawan Oktavia; Muhammad  Alfan Habib

doi:10.47065/mis.v4i3.3043

Siska Atmawan Oktavia Siska * Universitas Teknologi Sumbawa, Indonesia
Siska Atmawan Oktavia Universitas Teknologi Sumbawa, Indonesia
Muhammad Alfan Habib STMIK Syaikh Zainuddin Nahdlatul Wathan Anjani, Lombok, Indonesia

DOI: https://doi.org/10.47065/mis.v4i3.3043

Keywords: : ChatGPT, Code Assistant, Kualitas Kode Program, SonarQube, Eksperimen Kuantitatif

Abstract

The rapid advancement of Artificial Intelligence (AI) has introduced various tools that support software development, one of which is ChatGPT. This study aims to analyze the impact of using ChatGPT as a code assistant on the quality of program code produced by Informatics students at Universitas Teknologi Sumbawa. A quantitative experimental method was employed by comparing programming tasks completed manually and with the assistance of ChatGPT. Code quality was evaluated using SonarQube based on three metrics: Maintainability Index, Cyclomatic Complexity, and Reliability (Bug Count), followed by statistical analysis to examine differences between the two conditions. The results indicate that there were no significant differences across all evaluated metrics between manually written code and code generated with ChatGPT assistance (p > 0.05). These findings suggest that the use of ChatGPT did not affect code quality in this study; however, it still has the potential to improve the efficiency of software development. Furthermore, this study provides empirical evidence regarding the impact of using ChatGPT on code quality, based on SonarQube static analysis metrics. The findings are expected to serve as a reference for educators, students, and researchers in evaluating the use of ChatGPT as a code assistant in both learning and software development contexts.

References

A. D. Nugroho et al., “Implementasi AI ChatGPT Sebagai Alat Pendukung Pembelajaran Mahasiswa pada Prodi Sistem Informasi di Perguruan Tinggi Universitas Negeri Semarang,” Jurnal Mediasi, vol. 3, no. 1, pp. 106–118, 2024, [Online]. Available: https://jurnalilmiah.org/journal/index.php/mediasi/article/view/754

A. Bachtiar and R. Andrian, “The Impact of Chatgpt In Front-End Development With A Focus On Reactjs,” Jurnal Media Computer Science, vol. 3, no. 1, pp. 79–82, 2024, doi: https://doi.org/10.37676/jmcs.v3i1.4361.

A. N. Sihananto, P. W. Atmaja, and Sugiarto, “Pemanfaatan AI dalam Pembelajaran Pemrograman untuk Mahasiswa,” Seminar Nasional Rekayasa dan Teknologi, vol. 4, no. 1, pp. 8–11, 2024, doi: 10.47970/snarstek.v2i1.706.

M. M. Rachman, L. Wati, and M. K. Wardani, “Pemanfaatan Teknologi AI ChatGPT untuk Mendukung Pemahaman Dasar Pemrograman,” Citizen : Jurnal Ilmiah Multidisiplin Indonesia, vol. 5, no. 4, pp. 1055–1063, 2025, doi: 10.53866/jimi.v5i4.948.

F. I. Inayah and M. Idris, “Implementasi Clean Code pada Pengembangan Berbasis Web,” Prosiding Automata, vol. 2, no. 2, pp. 113–116, 2021, [Online]. Available: https://journal.uii.ac.id/AUTOMATA/article/view/19528

Aldiansyah and D. Sulistyo, “Analisis Perbandingan Proses Pembangunan Aplikasi Berbasis Website: Pendekatan Manual Vs Ai-generated,” e-Proceeding of Engineering, vol. 12, no. 1, pp. 2162–2169, 2025, [Online]. Available: https://repository.telkomuniversity.ac.id/home/catalog/id/217757/slug/analisis-perbandingan-proses-pembangunan-aplikasi-berbasis-website-pendekatan-manual-vs-ai-generated-dalam-bentuk-buku-karya-ilmiah.html%0A/home/catalog/id/217757/slug/analisis-perbandi

Idham, A. Rahman, and M. Rizkillah, “ANALISIS KEEFEKTIFAN CHATGPT DALAM PERANCANGAN APLIKASI,” Jurnal Informatika Teknologi dan Sains (JINTEKS), vol. 6, no. 2, pp. 115–121, 2024, doi: https://doi.org/10.51401/jinteks.v6i2.4050.

R. A. Wijaya and Karmilasari, “Pengukuran Kualitas Website Pengurus Cabang NU Depok Menggunakan Software Metric,” Jurnal Sisfokom (Sistem Informasi dan Komputer), vol. 10, no. 3, pp. 438–443, 2021, doi: 10.32736/sisfokom.v10i3.1267.

M. I. N. Ilmi, Aminudin, and Z. Sari, “Dampak Test-Driven Development pada Kualitas Kode,” Jurnal Edukasi dan Penelitian Informatika (JEPIN), vol. 9, no. 3, pp. 371–377, 2023, [Online]. Available: https://jurnal.untan.ac.id/index.php/jepin/article/view/66815/75676600467

A. Hardoni, “Integrasi SMOTE pada Naive Bayes dan Logistic Regression Berbasis Particle Swarm Optimization untuk Prediksi Cacat Perangkat Lunak,” Jurnal Sistem dan Teknologi Informasi (JUSTIN), vol. 9, no. 2, p. 144, 2021, doi: 10.26418/justin.v9i2.43173.

E. H. A. Prastyo, Suhartono, M. Faisal, M. A. Yaqin, and R. A. J. Firdaus, “Naive Bayes Classification Untuk Prediksi Cacat Perangkat Lunak,” JIPI (Jurnal Ilmiah Penelitian dan Pembelajaran Informatika), vol. 9, no. 2, pp. 782–791, 2024, doi: https://doi.org/10.29100/jipi.v9i2.5508.

Sugiyono, Metodologi Penelitian Kuantitatif, Kualitatif dan R & D. Bandung: Alfabeta Bandung, 2013.

H. Sastrawan and H. Menap, Fundamental Riset Kuantitatif. Yogyakarta: Deepublish Digital, 2023.

A. R. Barakbah, T. Karlita, and A. S. Ahsan, Logika dan Algoritma, no. tahun 1736. Politeknik Elektronika Negeri Surabaya, 2013.

Nuryadi, T. D. Astuti, E. S. Utami, and M. Budiantara, Dasar-dasar Statistik Penelitian. Yogyakarta: Sibuku Media, 2017.

A. D. Wulansari, Aplikasi Statistika Nonparametrik Dalam Penelitian. Thalibul Ilmi Publishing & Education, 2023.

L. Cohen, L. Manion, and K. Morrison, Research Methods in Education, 6th ed. New York, 2018. doi: 10.4324/9781315456539-19.

M. Fadhli, Y. Fitrisia, and D. Nurmalasari, “Pengujian Kualitas Kode Program Aplikasi Bank Sampah DLHK Kota Pekanbaru Menggunakan Code Smell Tools,” Proceedings of the ASIL Annual Meeting, vol. 10, no. 1, pp. 86–97, 2024, doi: https://doi.org/10.35143/jkt.v10i1.6211.

M. Shen, A. Pillai, B. A. Yuan, J. C. Davis, and A. Machiry, “An Empirical Study on the Use of Static Analysis Tools in Open Source Embedded Software,” vol. 1, no. 1, pp. 1–22, 2023, [Online]. Available: http://arxiv.org/abs/2310.00205

A. B. Pratama, Analisis Data Kuantitatif Dalam Penelitian Sosial Menggunakan Jamovi Konsep Dasar dan Aplikasinya. Yogyakarta: Penerbit Gava Media, 2022.