Pasif optik yüzeylere dayalı artırılmış gerçeklik 3D ekran ve ışık alan görüntüleme sistemleri

This dissertation presents new display and imaging techniques where a number of micro-structured passive optical surfaces are developed and then combined with mobile projectors and cameras to achieve novel display and imaging modalities. Three types of novel optical surfaces are developed: (i) a transparent AR screen, which is a transparent retroreflective surface developed for augmented reality and automotive head-up display (HUD) applications, (ii) a 3D imaging surface, which is a handheld lens array sheet used for mobile light-field capture when combined with a regular camera, and (iii) an integrated dual-purpose screen, which combines the first two surfaces to achieve 3D display and 3D imaging on the same screen simultaneously. The transparent AR screen provides high optical gain within a small viewing window and enables the use of low lumen output head-mounted laser projectors to produce a bright content. Higher see-through performance is achieved through partial covering of a clear substrate with retroreflective microspheres. The screen transparency and optical gain is varied by changing the retroreflective fill factor, and three versions of the screen providing 50%, 75% and 90% transparency are developed. The transparent retroreflective AR screen was first used with a pair of head-mounted laser projectors (pico-projectors) for 3D vision. We achieved good stereoscopic vision providing down-to 1% crosstalk between two eyes and up-to 1,000 cd/m2 brightness using 30 lumen projectors. For automotive 3D head-up-display applications, we performed a user study to test the simulated collimation and provide the virtual image perception at different screen distances. The user study focused on the visual acuity response under the see-through condition and the simulated collimation condition that shows the relation of visual acuity with the distance of HUD screen and amount of accommodation-convergence (AC) conflict. We showed that the visual acuity is slightly dropped (from 20/20 to 20/25) when the HUD screen is placed between the driver/user and a real-scene. For the simulated collimation condition, an inverse relationship between the amount of AC conflict and the visual acuity is observed, which shows the minimum effect on the visual acuity and viewing comfort when AC conflict is less than 0.85 diopters or when the screen distance is >100 cm. The 3D imaging surface introduces a light-field imaging platform that can turn a regular camera into a multi-perspective 3D capture system. The 3D imaging surface contains an array of lenses and tracking markers to capture the 3D perspective views of a scene. The camera image provides an array of sub-images; each corresponding to a different perspective view. The location of the mobile surface is determined by tracking the distinct markers attached to the corners of the surface. A computational ray tracing tool is developed using OpenGL to perform the real-time light-field reconstruction and demonstrate digital image refocusing and partial occlusion capture. Lastly, a novel integrated dual-purpose screen is introduced for simultaneous display and imaging. The screen mainly consists of patterned retroreflective microspheres as the top layer and an array of curved mirrors as the bottom layer for 3D display and multi-perspective imaging, respectively. The simultaneous display and imaging are performed by using an intermediate polarization selective layer and performing polarization multiplexing to separate the projected and captured light. A telepresence demonstrator is built where user-1 uses a pair of head-mounted projectors and a camera while across the integrated dual-purpose screen and user-2 uses a VR headset, where user-2 can watch user-1 in real-time and from arbitrary perspectives. The display and imaging characteristics of the developed prototype are also evaluated. While mobile 3D telepresence is not possible using existing head-mounted AR and VR displays, our proposed solution offers a unique alternative and can be the future of mobile telepresence.