Category: Publication

人間は固有の精神テンポ（パーソナルテンポ）を持ち，テンポの一致がシステムとの円滑な対話において重要な役割を果たす．本研究は，対話におけるテンポの同調，特に交替潜時と発話速度の関係性に着目し，これらが効果的なコミュニケーションに果たす役割を分析した．動的時間伸縮法を用いた分析により，交替潜時の同調が対話に与える影響を明らかにした．さらに，発話速度と交替潜時の相関関係を明らかにし，音声対話システムのための発話タイミング決定モデルを構築した．この研究成果は，より自然で適応的な対話システムの開発に寄与するものである．

Eyes play a significant role in human-human interaction, and blinking is particularly important as it can indicate a pause in the conversation and even lead to eye blink entrainment. However, most communication robots cannot reproduce eye blink movements due to cost constraints. Thus, our aim is to create a low-cost robot that can physically reproduce eye blink movements and induce eye blink entrainment. In this paper, we describe the implementation of the robot and evaluate the subjective impression of the robot’s eye blink movements. Our results suggest that the robot’s blinking behavior at pauses in the conversation facilitated the participants’ understanding of the robot’s speech. Our findings also suggest that simulating eye blink entrainment movement can increase the participant’s affinity and acceptance towards the robot in certain cases, and if the blinking is not well designed, affinity may be adversely affected

Every individual lives in daily lives in own unique tempo, called Personal Tempo. Tempo is also highly important in dialogue situations, and it is thought that if the tempo can be matched with the conversational partner, it will lead to smoother communication with a higher level of comprehension. Spoken-dialogue systems have been used in many situations, and by personalizing dialogue on the basis of the user’s tempo, it is thought that dialogue will be able to make it easier to speak and make people want to speak. Previous research has focused on methods for encouraging users to change their tempo to be in tune with the tempo of their dialogue partner. However, a conversation that differs from the user’s tempo can be stressful and burdensome for the user in the process of tuning in.Therefore, we define personal tempo as speech speed, which is the number of moras divided by the duration of speech and propose a speech-speed control method for spoken-dialogue systems. We implemented our method in a spoken-dialogue system that synchronizes speech with the user. We verified the effectiveness of the proposed method by analyzing its impact on the comprehension of speech and user impressions of the spoken-dialogue system. The results indicate that significant differences were obtained with the proposed method between impression and comprehension of the speech content.

Since the pandemic, the decrease in face-to-face communication and the increase in feelings of loneliness have become
significant issues. Houseplants, which are often displayed as “green amenities” in rooms, are the most familiar plants that
humans can easily form attachments . Research that considers houseplants as conversation partners aims to draw out positive
emotions and improve mental health while maintaining privacy. By utilizing Mixed Reality technology, this approach promotes
self-care through interaction with plants. It contributes to the reduction of loneliness by building trust and controlling negative
emotions. It is expected that the agents, by encouraging anthropomorphism and self-dialogue, will have a positive impact on daily life.

This study proposes a model for generating facial expressions from speech text. While previous research has focused on generating facial animation from audio, this study concentrates on directly generating expressions from text. The output utilizes Action Units (AUs) based on the Facial Action Coding System (FACS). To reduce computational complexity and enhance model scalability, the proposed architecture employs only the encoder component of the Transformer, omitting the decoder.
The model is trained using a sliding window approach, enabling generation of expressions for each token in temporal sequence. The dataset for training was constructed by collecting publicly available videos from the web, performing facial expression detection, and transcribing the speech content.

Sorry, this entry is only available in 日本語.