An iterative approach to keyword search in sign language
Bu tez size mi ait?
Bu kayıt toplu arşivden geldi. Sizinse profilinize bağlayın.
Özet (EN)
Sign languages are the main medium of communication for the Deaf. However, insufficient retrieval tools for sign languages restrict the Deaf's access to information. To address this issue, we tackle the problem of keyword search in sign language. Although keyword search is a well-studied task for domains like speech processing, it has not been extensively studied in the context of sign language. To this end, we introduce improvements to an existing keyword search system for sign language and a new iterative training approach. We adapt Graph Attention Networks (GAT) to the sign language domain and extend its capabilities by employing a learnable mask and a separate temporal attention mechanism. Moreover, we investigate the effectiveness of the Pseudo-Relevance Feedback (PRF) technique in improving retrieval accuracy. Additionally, it is demonstrated that the existing model can also be trained with similarity-based methods using cosine and triplet losses, which can later be fused with other models to boost performance. Finally, we introduce an iterative training method similar to Expectation-Maximization (EM) that gradually improves its predictions. This method employs a cross-modal attention mechanism and a query encoder to discover subtle video-query interactions. The experiments are carried out on the RWTH-Phoenix2014T dataset, where the effectiveness of the proposed methods is verified. The results show that the pose models trained with a GAT-based encoder and in an iterative way significantly improve the retrieval performance.
Yazar
Mansur Yeşilbursa
Bu Yayına Nasıl Atıf Yapılır
Mansur Yeşilbursa (Master Thesis). An iterative approach to keyword search in sign language, 2022, Boğaziçi University.
Anahtar Kelimeler
Lisans
Tüm Hakları Saklıdır
Bu eser belirtilen lisans koşulları altında paylaşılmaktadır.
Boğaziçi University tezlerinden daha fazlası
- Behind the gallows: Capital punishment, law, and legislative performance in Turkey (1926-1990)(2025)
- From the movement of '68 to the rupture of '71: The transformation of student protests in Turkey(2025)
- Assessing the success of agile software projects using machine learning techniques: A case study(2025)
- Freedom and the unintelligibility of evil in Kant's moral philosophy(2025)
- A critical examination of the philosophical defense of free logics(2014)
- İstatiksel yöntemlerle gerçek zamanlı yapı sağlığı izleme(2023)
