Measuring student engagement level by survey and scripted content analysis technique

In scientific studies, the survey technique is widely used in order to collect data such as emotions, thoughts, perceptions, attitudes, etc. from the participants about a subject. It can be said that the rapid change in technology has brought new techniques that can be an alternatives to the survey techniques used in research. For this reason, it is tried to support the classical survey technique with visual materials by using digital tools such as photography, audio, and video. In the case of using digital tools such as photography, video, and animation in research, it is necessary to develop alternative survey techniques in the name of science, with the assumption that the effect of the visual materials created on people's perceptions, attitudes and thoughts is important. In data collection techniques, it is aimed to present the written and scripted texts to the participants by enriching and combining them with digital tools such as images, audio, video, and animation, and to enable the participants to perceive the scale items more easily. In this study, a new data collection technique called "scripted content analysis technique" prepared with visual materials such as image, sound, video and animation, as well as the "survey technique" prepared with written and oral texts using pencil and paper, was used. In the research, it is aimed to reveal the statistical difference between the quantitative data obtained from the measurement of the commitment levels of university students with questionnaires and scripted content analysis techniques. The population of the research consists of students studying at Aksaray University, and the sample is 500 students studying at faculties and vocational schools. Questionnaire and scripted content analysis techniques were used as data collection tools in the research. The questionnaire form prepared within the scope of this purpose consists of 52 questions and 4 sections. Statistical analysis of the obtained data was carried out using IBM SPSS Statistics Version 22 program. In the research, descriptive statistics (frequency, percentage, mean, standard deviation), reliability analysis, exploratory and confirmatory factor analyzes were used to develop the scale. In addition, the paired group tTest to measure the difference between the average scores of the students' engagement levels obtained by the questionnaire and the scripted content analysis technique of the participants in the sample, the tTest to compare in terms of demographic variables with dual groups, and the one-way ANOVA to compare in terms of demographic variables with three or more groups test has been done. As a result of the analysis of the data, it was determined that the average of student engagement obtained from the scripted content analysis technique was statistically higher than the average of student engagement obtained with the survey technique. The findings show that there is a statistically significant difference between the averages of student engagement obtained with the survey and scripted content analysis techniques. However, it was concluded that the scores of student engagement levels did not differ statistically in terms of gender, age, faculty and vocational school, education type, and grade level variables in terms of both techniques. When the general evaluations of the participants about the survey and scripted content analysis techniques were analyzed, it was determined that they found the survey technique appropriate in terms of "clearness, fluency, satisfaction and preference" themes and the scripted content analysis technique in terms of "entertainment" theme.