Development and usability evaluation of a web-based tool for the psychometric analysis of multiple-choice tests

In this master's thesis, a web-based system was developed to perform the psychometric analysis of multiple-choice tests in an online environment, and the usability of the system was evaluated. The software was built on the Laravel framework and supported by technologies such as HTML, CSS, JavaScript, jQuery, and MySQL. Through a user-friendly interface, the system is capable of automatically calculating item difficulty, item discrimination, average success rate, and reliability coefficients such as KR-20 and KR-21. The system also provides visualized analysis outputs and export options, aiming to facilitate and accelerate assessment processes for users. The usability of the system was evaluated through task-based tests and Likert-scale questionnaires with the participation of five academic users. The findings revealed that users successfully completed most of the tasks; however, certain difficulties were encountered in tasks related to uploading exams and interpreting analysis results. Task-specific difficulty levels were presented in a pie chart, serving as a guide for identifying areas of the system in need of improvement. In addition, a Web Site Usability Scale was administered to a larger sample of 50 academic users to assess overall user experience. According to the data obtained, the system achieved an average score of 113.70 out of 135, indicating a high level of usability. Participants particularly highlighted the effectiveness of the visual structure, the clarity and functionality of menu labels, and the transparency of the analysis screens. The highest-rated statement was "The item analysis screen enables detailed examination of questions." These findings indicate that the system is not only functionally effective but also provides a satisfactory and robust user experience. As a result, the developed system enhances the efficiency of digital assessment practices in education, reduces the workload of educators, and contributes to more reliable evaluation of test instruments. This thesis offers a comprehensive contribution to the field of educational technologies in terms of both software development and user-centered evaluation.