A speech-driven embodied entrainment character system for supporting line-of-sight interaction using an interaction-activated communication model

Line-of-sight such as gaze and eye-contract plays an important role to enhance the embodied interaction and communication through avatars. In addition, many eyeball movement models and communication systems using avatars with the line-of-sight have been proposed and developed. However, these eyeball movements by generating the above-mentioned models were not considered to enhance the embodied interaction such as activated communication, because the models stochastically generate the eyeball movements based on the human gaze behavior. Therefore, in order to enhance and promote the embodied interaction from the view point of line-of-sight, it is desired to design a line-of-sight interaction which relates to the interaction-activated communication. In this study, we analyze the interaction between human gaze behavior and the interaction-activated communication by using an embodied communication system with line-of-sight measurement devices. Then, we propose a line-of-sight model based on the above-mentioned analysis, and develop an advanced embodied communication system by applying the proposed model to the speech-driven embodied entrainment character. This system generates the eyeball movements such as gaze and looking away based on the proposed model, and provides a communication environment wherein the embodied interaction is promoted. The effectiveness of the system is demonstrated by means of sensory evaluations of 15 pairs of subjects involved in avatar-mediated communication.