Development of image processing based robotic test automation system for touch screen devices

When we have a wide perspective on awareness of consumer electronics, increasing the demand of touch screen devices such as tablet, smart phone etc. has created a need for making the test of these devices quickly and reliably. The human factor plays an important role on structure of existing test platforms, and creates many errors during operation. So as to overcome these problems, some solutions have been developed. Especially, robotic based test automation systems are now playing an important role on testing electronic devices. In this study a delta robot based test automation system is designed to perform for touch screen device testing. In order to design delta robot, LEGO® Mindstorms® NXT 2.0 servo motors and their controller are used as hardware elements. The designed delta robot system is controlled via MATLAB® R2016b development environment. Kinematic equations of the robot are run in MATLAB® and the transformation between angles of the robot arms and cartesian coordinate plane of end effector is provided by the equations. The images taken by the camera from touch screen are compared with the template images and given as feedback to the system by using NCC ( normalized cross correlation) as computer vision algorithm. By capturing images via camera that is taken part in the system. Hence, the whole system works more stable in this condition. The designed delta robot can be used in different size of touch screen devices. Moreover, the robot can be used for different test methods including performance, stress etc. If professional products had been used as the motion control elements in the designed robot system, it woluld be possible to introduce much faster and more stable industrial solutions.