Hareket eden nesne videolarının altband istatistikleri kullanılarak yüzey yansıtma özelliğinin belirlenmesi

Image motion can convey a broad range of object properties including 3D structure(structure from motion, SfM), animacy (biological motion), and its material. Our understanding of how the visual system may estimate complex properties such as surface reflectance or object rigidity from image motion is still limited. In order to reveal the neural mechanisms underlying surface material understanding, a natural point to begin with is to study the output of filters that mimic response properties of low level visual neurons to different classes of moving textures, such as patches of shiny and matte surfaces. To this end we designed spatio-temporal bandpass filters whose frequency response is the second order derivative of the Gaussian function. Those filters are generated towards eight orientations in three scales in the frequency domain. We computed responses of these filters to dynamic specular and matte textures. Specifically, we assessed the statistics of the resultant filter output histograms and calculated the mean, standard deviation, skewness and kurtosis of those histograms. We found that there were substantial differences in standard deviation and skewness of specular and matte texture subband histograms. To formally test whether these simple measurements can in fact predict surface material from image motion we developed a computer-assisted classier based on these statistics. The results of the classication showed that, 75% of all movies are classied correctly, where the correct classication rate of shiny object movies is around 77% and the correct classification rate of matte object movies is around 71%. Next, we synthesized dynamic textures which resembled the subband statistics of videos of moving shiny and matte objects. Interestingly the appearance of these synthesized textures were neither shiny nor matte. Taken together our results indicate that there are dierences in the spatio-temporal subband statistics of image motion generated by rotating matte and specular objects. While these dierences may be utilized by the human brain during the perceptual process, our results on the synthesized textures suggest that the statistics may not be sucient to judge the material qualities of an object.Keywords: The Human Visual System, Surface Reflectance, Movie Subband Statistics, Three-Dimensional Second Order Derivative of Gaussian Filter, Texture Synthesis, Steerable Pyramid