Data Driven Decision Making dalam Penentuan Kelayakan Soal Ujian Menggunakan Algoritma Fuzzy
Article Sidebar
Main Article Content
Abstract
The need for evident-based education makes some steps that must be taken by educational institutions. In relation to improving learning and student achievement, data driven decision making (DDDM) can be utilized to find out various things, such as the level of knowledge and skills of students at a personal level, one of which is through examinations. This research was conducted to determine the eligibility standards of college-level English exam questions using DDDM and fuzzy algorithms. 20 first-year students were tested to see the quality of the questions based on the results of the exam. The results are the level of difficulty of the question 0.611, Discrimination Power 20.2%, Validity produces 19 valid questions and 31 invalid questions, and reliability results are reliable. The conclusion is that DDDM method can be used to calculate the feasibility level of questions so that it can provide input on the development of exam questions standardization, especially for English. Further research should be conducted with larger data in several locations with different participants, thus the standard of questions’ eligibility can be more accurate. The use of different algorithms or calculation models is also recommended so that it can provide benefits to this field.
Downloads
Article Details
References
E. B. Mandinach and K. Schildkamp, “Misconceptions about data-based decision making in education: An exploration of the literature,” Stud. Educ. Eval., vol. 69, no. September 2019, p. 100842, 2021, doi: 10.1016/j.stueduc.2020.100842.
Y. Zhu, “A data driven educational decision support system,” Int. J. Emerg. Technol. Learn., vol. 13, no. 11, pp. 4–16, 2018, doi: 10.3991/ijet.v13i11.9582.
M. Nurzen S, “Pengambilan keputusan berbasis data untuk perencanaan pendidikan: strategi untuk keberhasilan kepala sekolah,” J. Konseling dan Pendidik., vol. 10, no. 4, pp. 589–596, 2022, doi: 10.29210/189500.
S. Hong, Carrie Eunyoung Lawrence, “Action Research in Teacher Education: Classroom Inquiry, Reflection, and Data-Driven Decision Making.,” J. Inq. Action Educ., vol. 4, no. 2, pp. 1–17, 2011.
F. M. Van der Kleij, J. A. Vermeulen, K. Schildkamp, and T. J. H. M. Eggen, “Integrating data-based decision making, Assessment for Learning and diagnostic testing in formative assessment,” Assess. Educ. Princ. Policy Pract., vol. 22, no. 3, pp. 324–343, 2015, doi: 10.1080/0969594X.2014.999024.
A. Mre?a, O. Sokolov, and W. Urbaniak, “The method of learning outcomes assessment based on fuzzy relations,” Bull. Polish Acad. Sci. Tech. Sci., vol. 67, no. 3, pp. 527–533, 2019, doi: 10.24425/bpasts.2019.129651.
D. H. Rao, S. R. Mangalwede, and V. B. Deshmukh, “Student performance evaluation model based on scoring rubric tool for network analysis subject using fuzzy logic,” Int. Conf. Electr. Electron. Commun. Comput. Technol. Optim. Tech. ICEECCOT 2017, vol. 2018-January, no. May, pp. 857–861, 2017, doi: 10.1109/ICEECCOT.2017.8284623.
J. Domingo-Peña, H. Martínez-García, and E. García-Vílchez, “a Contribution To Students’ Assessment Adjusts of Multiple Choice Questionnaires With Fuzzy Logic,” SEFI 2022 - 50th Annu. Conf. Eur. Soc. Eng. Educ. Proc., pp. 520–530, 2022, doi: 10.5821/conference-9788412322262.1377.
E. Do?an and A. O. Demirbolat, “Data-driven Decision-Making in Schools Scale: A Study of Validity and Reliability conditions of the Creative Commons Attribution license (CC BY-NC-ND),” Int. J. Curric. Instr., vol. 13, no. 1, pp. 507–523, 2021.
S. Gaftandzhieva, S. Hussain, S. Hil?enko, R. Doneva, and K. Boykova, “Data-driven Decision Making in Higher Education Institutions: State-of-play,” Int. J. Adv. Comput. Sci. Appl., vol. 14, no. 6, pp. 397–405, 2023, doi: 10.14569/IJACSA.2023.0140642.
S. Kaspi and S. Venkatraman, “Data-Driven Decision-Making (DDDM) for Higher Education Assessments: A Case Study,” Systems, vol. 11, no. 6, 2023, doi: 10.3390/systems11060306.
M. van Geel, A. J. Visscher, and B. Teunis, “School characteristics influencing the implementation of a data-based decision making intervention,” Sch. Eff. Sch. Improv., vol. 28, no. 3, pp. 443–462, 2017, doi: 10.1080/09243453.2017.1314972.
K. Schildkamp, “Data-based decision-making for school improvement: Research insights and gaps,” Educ. Res., vol. 61, no. 3, pp. 257–273, 2019, doi: 10.1080/00131881.2019.1625716.
A. H. Elgadal and A. A. Mariod, “Item Analysis of Multiple-choice Questions (MCQs): Assessment Tool For Quality Assurance Measures,” Sudan J. Med. Sci., vol. 16, no. 3, pp. 334–346, 2021, doi: 10.18502/sjms.v16i3.9695.
D. Kumar, R. Jaipurkar, A. Shekhar, G. Sikri, and V. Srinivas, “Item analysis of multiple choice questions: A quality assurance test for an assessment tool,” Med. J. Armed Forces India, vol. 77, pp. S85–S89, 2021, doi: 10.1016/j.mjafi.2020.11.007.
M. Marsevani, “Item Analysis of Multiple-Choice Questions: an Assessment of Young Learners,” English Rev. J. English Educ., vol. 10, no. 2, pp. 401–408, 2022, doi: 10.25134/erjee.v10i2.6241.
R. P. Patil, S. E. Bahekar, M. D. Kulkarni, and M. S. Baig, “Evaluation of validity and reliability of multiple-choice questions in second MBBS competency-based medical education-based pharmacology examination of medical institute of India,” Int. J. Res. Med. Sci., vol. 10, no. 12, p. 2878, 2022, doi: 10.18203/2320-6012.ijrms20223091.
K. Tarwati, “Metode Fuzzy Logic Untuk Penentuan Kelayakan Penerima Beasiswa Mahasiswa Di Universitas Muhammadiyah Sukabumi,” J. Sist. Informasi), vol. 1, no. 2, p. 56, 2020.
F. Firdaus, W. Susanti, Y. Desnelita, I. Irwan, and G. Gustientiedina, “Penerapan Algoritma Fuzzy Berbasis Expert System untuk Mengukur Kompetensi Mahasiswa,” SEMASTER Semin. Nas. Teknol. Inf. Ilmu Komput., vol. 1, no. 1, pp. 266–274, 2020, [Online]. Available: https://journal.unilak.ac.id/index.php/Semaster/article/view/6136/2679
S. Loka, “Instrumentasi Kemampuan Pemecahan Masalah Matematis: Analisis Reliabilitas, Validitas, Tingkat Kesukaran Dan Daya Beda Butir Soal,” Gema Wiralodra, vol. 10, no. 1, pp. 41–52, 2019.
I. Magdalena, S. N. Fauziah, S. N. Faziah, and F. S. Nupus, “Analisis Validitas, Reliabilitas, Tingkat Kesulitan Dan Daya Beda Butir Soal Ujian Akhir Semester Tema 7 Kelas III SDN Karet 1 Sepatan,” BINTANG J. Pendidik. dan Sains, vol. 3, no. 2, pp. 198–214, 2021, [Online]. Available: https://ejournal.stitpn.ac.id/index.php/bintang