An archival system using face identification and verification for broadcast news

AN ARCHIVAL SYSTEM USING FACE DETECTION AND VERIFICATION FORBROADCAST NEWSKürşat KÜÇÜKKÖŞKERComputer Engineering, M.S. ThesisWith multimedia applications becoming increasingly important, projects that carry outidentification and verification operations on news videos where exposure and lightningconditions vary for archiving and querying purposes have also become important.In this dissertation, an archiving system has been developed based on face recognition andverification for the purposes of storing and querying desired people in news videos.News videos have been assessed by sampling 25 frames per second. At the face detectionstage, the first stage in face recognition and face verification operation, feature based facedetection method has been used for upright and frontal facial images. Results of feature basedface detection operation have been subjected to skin filter and erroneous face detection ratehas been reduced. Facial areas detected have been resized to facial images in the facedatabase. Facial features have been contemplated using Principal Component Analysis (PCA)and Linear Discriminant Analysis (LDA), ensuring the contribution of both methods insuccess of the identification and verification. Euclidean Distance Metrics and Support VectorMachines methods have been used for face identification and verification and success of theeach method have been compared. Based on the results attained, it has been observed thatPCA gives the best results for feature extraction while SVM gives the best results foridentification purposes. Further to identification and verification operations, images of thequeried people have been recorded in a new video file and archiving operation is completed.Keywords: Broadcast news, face detection, face recognition, principal component analysis,linear discriminant analysis, support vector machines.JURY:1. Yrd. Doç. Dr. M. Elif KARSLIGİL (Danışman) Date: 20.03.20062. Prof. Dr. Fikret GÜRGEN Page: 813. Prof. Dr. Coşkun SÖNMEZ