Implementasi Sistem Pembuatan Soal Otomatisasi Pembelajaran Pendidikan Agama Islam Dengan Menggunakan Langchain Dan Llm Berbasis Gemini
Abstract
This study examines the implementation of an automated question generation system in the context of Islamic Religious Education (PAI) using LangChain technology and a Gemini-based Large Language Model (LLM). The research methodology includes data collection, needs analysis, system architecture design, implementation, and validation through black-box testing and expert evaluation. The system is designed to automatically generate questions aligned with instructional content and the cognitive levels of Bloom's Taxonomy, ranging from factual knowledge to evaluation and creation. The testing process involved six expert evaluators with educational backgrounds and experience in PAI. Results indicate that the system successfully produced high-quality questions, with an average approval rate of 96.89%. Differentiated scores revealed the highest performance in theoretical interpretation questions (100%) and the lowest in critical analysis (30%), indicating varying system capabilities across the cognitive spectrum. This study demonstrates that integrating artificial intelligence into question generation is highly feasible and yields significant outcomes, although challenges remain in producing questions that stimulate higher-order and authentic thinking.
References
Riska Rahman Tanjung, Annida Azhari Ritonga, Bintang Mahrani Abdullah, Nita Afriani Siregar, and Armilah Armilah, “Transformasi Digital dalam Pendidikan: Meningkatkan Kualitas Pembelajaran Melalui Teknologi,” Sinar Dunia: Jurnal Riset Sosial Humaniora dan Ilmu Pendidikan, vol. 3, no. 2, pp. 211–217, Jun. 2024, doi: 10.58192/sidu.v3i2.2195.
R. Yasmar and D. R. Amalia, “ANALISIS SWOT PENGGUNAAN CHAT GPT DALAM DUNIA PENDIDIKAN ISLAM,” Fitrah: Jurnal Studi Pendidikan, vol. 15, no. 1, pp. 43–64, Jul. 2024, doi: 10.47625/fitrah.v15i1.668.
N. Noor Kamala Sari, J. Irawan, and V. Handrianus Pranatawijaya, “Implementasi Gemini API untuk Generatif Teks Deskripsi Karya Otomatis dalam Aplikasi Pameran Berbasis Web dengan Metode Waterfall,” 2024. [Online]. Available: https://doi.org/10/25047/jtit.v11i1.356
B. Raharjo, P Y YAYASAN PRIMA AGUS TEKNIK YAYASAN PRIMA AGUS TEKNIK YAYASAN PRIMA AGUS TEKNIK.
Y. Rozi Astino, P. Korespondensi, and V. Pitsalitz Sabandar, “Pengembangan Dan Penerapan Sistem Computer Assisted Test (CAT) Untuk Mengelola Ujian Berbasis Website,” vol. 4, no. 3, pp. 253–259, 2023, doi: 10.33365/jatika.v412.2603.
A. T. U. BR. Lubis, N. S. Harahap, S. Agustian, M. Irsyad, and I. Afrianty, “Question Answering System pada Chatbot Telegram Menggunakan Large Language Models (LLM) dan Langchain (Studi Kasus UU Kesehatan),” MALCOM: Indonesian Journal of Machine Learning and Computer Science, vol. 4, no. 3, pp. 955–964, May 2024, doi: 10.57152/malcom.v4i3.1378.
A. A. Munshi, W. H. AlSabban, A. T. Farag, O. E. Rakha, A. Al Sallab, and M. Alotaibi, “Automated Islamic Jurisprudential Legal Opinions Generation Using Artificial Intelligence,” Pertanika J Sci Technol, vol. 30, no. 2, pp. 1135–1156, Apr. 2022, doi: 10.47836/pjst.30.2.16.
Karishma M Mujawar and Prof. Vidya S, “INTERNATIONAL JOURNAL OF MULTIDISCIPLINARY RESEARCH Content and Question Generation from Book using LLM, Lang Chain, and FAISS,” 2024, doi: 10.15680/IJMRSET.2024.0707173.
A. Hafiz, A. Mu’ti, and A. Amirrachman, “Pengembangan Media Pembelajaran Agama Islam Berbasis Kecerdasan Buatan: Perspektif Pendidikan Agama Islam,” Mauriduna: Journal of Islamic Studies, vol. 5, no. 1, pp. 56–63, May 2024, doi: 10.37274/mauriduna.v5i1.1070.
N. S. Harahap, A. Saad, and H. Ubaidullah, “Comprehensive Bibliometric Literature Review of Chatbot Research: Trends, Frameworks, and Emerging Applications.” [Online]. Available: www.ijacsa.thesai.org
L. Ilma’ Nun, A. Mohtarom, A. Marzuki, and U. S. Lawal, “The Integration of Artificial Intelligence as a Teacher’s Partner in Islamic Religious Education Learning,” Journal of Islamic Education Research, vol. 6, no. 02, 2025, doi: 10.35719/jier.v6i2.473.
Achruh, M. Rapi, M. Rusdi, and R. Idris, “Challenges and Opportunities of Artificial Intelligence Adoption in Islamic Education in Indonesian Higher Education Institutions,” International Journal of Learning, Teaching and Educational Research, vol. 23, no. 11, pp. 423–443, Nov. 2024, doi: 10.26803/ijlter.23.11.22.
F. Farhana, A. Suryadi, and D. Wicaksono, “PENGEMBANGAN BAHAN AJAR BERBASIS DIGITAL PADA MATA PELAJARAN BAHASA INGGRIS DI SMK ATLANTIS PLUS DEPOK.”
D. Susilawati Sj, M. A. Maarif, and A. Zamroni, “Strategi Pengembangan Program Pembelajaran Pendidikan Agama Islam Sekolah,” Tafkir: Interdisciplinary Journal of Islamic Education, vol. 2, no. 1, pp. 20–40, Jan. 2021, doi: 10.31538/tijie.v2i1.21.
F. Rizki, A. Sutiyo, N. S. Harahap, S. Agustian, and R. M. Candra, “KLIK: Kajian Ilmiah Informatika dan Komputer Implementasi Question Answering Berbasis Chatbot Telegram Pada Tafsir Al-Jalalain Menggunakan Langchain dan LLM,” Media Online, vol. 4, no. 5, pp. 2464–2472, 2024, doi: 10.30865/klik.v4i5.1784.
S. Alnefaie, E. Atwell, and M. A. Alsalka, “Using Automatic Question Generation Web Services Tools to Build a Quran Question-and-Answer Dataset,” 2023. [Online]. Available: https://exploreai.jisc.ac.uk/tool/question-generation
Sukiman, Hendry, Muhammad Khahfi Zuhanda, Fenny, and sjukun, “Pelatihan Pemanfaatan Gemini AI untuk Mendukung Pembelajaran pada SMA di Sumatera Utara,” vol. Vol 6, May 2024.
R. Diky Dermawan, “Meningkatkan Kinerja Output ChatGPT Melalui Teknik Prompt Engineering Yang Dapat Dikustomisasi,” 2024.
B. Singh, Building Applications with Large Language Models: Techniques, Implementation, and Applications. Apress Media LLC, 2024. doi: 10.1007/979-8-8688-0569-1.
D. Apriliani, “Penggunaan artificial intelligence dalam pembelajaran bahasa Indonesia,” DIKBASTRA: Jurnal Pendidikan Bahasa dan Sastra, vol. 7, no. 1, Aug. 2024, doi: 10.22437/dikbastra.v7i1.33262.
I. Rofiki and A. R. Dewi, “PROBLEMATIKA PENALARAN CHATGPT DALAM MENYELESAIKAN SOAL KOMBINATORIKA [THE PROBLEMATIC REASONING OF CHATGPT IN SOLVING COMBINATORICS PROBLEMS],” JOHME: Journal of Holistic Mathematics Education, vol. 8, no. 2, pp. 231–252, Dec. 2024, doi: 10.19166/johme.v8i2.8600.
Aji Bayu Permadi, Nazruddin Safaat H, Lestari Handayani, and Yusra, “IMPLEMENTASI QUESTION ANSWERING SYSTEM TAFSIR AL-AZHAR MENGGUNAKAN LANGCHAIN DAN LARGE LANGUAGE MODEL BERBASIS CHATBOT TELEGRAM,” Jurnal Teknoif Teknik Informatika Institut Teknologi Padang, vol. 12, no. 1, pp. 62–69, Apr. 2024, doi: 10.21063/jtif.2024.v12.1.62-
Copyright (c) 2025 Irgi Fahrezy, Nazruddin Safaat Harahap, Fitri Wulandari, Surya Agustian

This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (Refer to The Effect of Open Access).


.png)
.png)


