Design, evaluation and implementation of a system aimed at assessment of learning achievement through open-ended questions in massive, open and distance learning

Assessment tools can vary according to learning objectives and cognitive levels identified by them. To be able to assess academic achievement, not only multiple-choice questions, but true-false, fill in the blanks, short answers, matching and short open-ended questions are used as well. Open-ended questions are specifically used for revealing what is learned in depth and providing opportunities to learners for adapting what has been learned. Open-ended questions enable learners to approach their learning from their own perspective and reflect their own ideas. However, it is known that open-ended questions aren't used sufficiently in massive open and distance learning because it is hard to prepare and evaluate these questions. In this context, it is aimed to design and implement a holistic system in which open-ended questions are used to assess student achievement, and the system in terms of pedagogy, management and technology. This study in which design-based research is planned to be used will be applied in terms of analysis, design, development, implementation and evaluation steps for a systematic design model. It is the importance of this study to provide a solution to limitations in assessment process within open and distance learning, and to develop a holistic model to different types of institutions for using open-ended questions in assessment process. At the end of the study, effectiveness, efficiency, attractiveness and sustainability of the new system, within the context of student, tutor and administrator, aiming the use of open-ended questions in open education system of Anadolu University, are all analyzed according to views of the participants and the level of the necessity of the developed system is identified in the results. Keywords: Open and Distance Learning, Open Education System, Assessment,Open-ended questions, Design-based Research, System Design