Action patterns: Non-verbal communication methods in consumer electronics

In consumer electronics, non-verbal communication methods such as point light, graphic animation, and body movement have been used to express different informational device states. Previous studies have examined these actions to reveal an emotion, intention, or state of a device. However, the applicability of expressive actions across devices and media has not as yet been discussed. An action patterns hypothesis was presented in this thesis to discuss the relationships between blinking point light, graphic animation, or body movement able to express a device message with identical or similar timing and intensity patterns. The hypothesis aims to examine whether a universal action pattern dictionary can be established via comparison of the patterns over different media. Rather than designing new motion patterns for each feature, product, or medium, it should be possible to define a more inclusive and intuitive level of human-computer communication. Additionally, these abstract messages could be more comprehensible if users are exposed to similar patterns in various products. Thus, the applicability of action patterns over different media may increase the learnability and usability of user interfaces. Two user studies were conducted to analyze the applicability of identical action patterns with different devices and different media to express the same device message. Following that, the main contribution of this thesis and the application areas of non-verbal communication in interface design were discussed. The thesis is based on three research questions to examine action patterns hypothesis. First research question (RQ1) aims to classify device states, feedback, and notification to define action patterns that represent these device messages. A taxonomy of device messages is presented in this study. Second research question (RQ2) focuses on the applicability of identical action patterns in different products. Same point light actions were compared on a dishwasher and a mobile phone in an online survey. The last research question (RQ3) aims at examining whether similar action patterns in different media such as blinking light, graphic animation, and body movements are inferred as similar device messages by participants and it was tested in an online survey.