Development of a speaking test for second language learners of Turkish

This study reports the findings of an initial investigation into a speaking test for learners of Turkish as a second language (L2) that is in the development process. The test aims at assessing the speaking proficiency levels of incoming exchange and Erasmus students at Boğaziçi University. For this purpose, six tasks were developed based on the Common European Framework of Reference for Languages (Council of Europe, 2001) level descriptors. These tasks were administered to a 24-person sample of L2 learners of Turkish enrolled in intermediate and advanced level Turkish language classes at Boğaziçi University. The study focused on the cognitive demands, contextual features, and "scoring validity" (Weir, 2005) of the tasks. The cognitive task demands were analyzed based on Field's (2011) cognitive processing framework for speaking, which is based on the Levelt (1989) model of speech production. The discussion of contextual task characteristics was built upon the aspects of context validity outlined by Weir (2005). Generalizability theory analyses were conducted to investigate the dependability of the scores and to examine the effect of different numbers of tasks and raters on score dependability. The findings from these qualitative and quantitative analyses provide empirical evidence into the validity and dependability of the test and inform the further refinement of the test tasks.