Overall Design and Physical Validation of Voice Interaction based on the ChatGPT Humanoid Robot Brain
ID:42 View Protection:ATTENDEE Updated Time:2024-10-10 11:18:29 Hits:1540 Virtual Presentation

Start Time:2024-10-26 12:15(Asia/Bangkok)

Duration:15min

Session:RS2 Regular Session 2 » RS2-4Others

No files

Abstract
Aimed to the challenge of robotic voice interaction, this study leverages ChatGPT(Chat Generative Pre-trained Transformer) technology to develop a humanoid robot solution with a central processing system. Employing a top-down design approach, the solution encompasses the design of voice, video, and motion streams between users and the robot, enabling voice communication and expression output. By integrating hardware devices and a central control system, the entire humanoid robot system achieves a twofold purpose. On one hand, it combines data from conversational context, user tone and emotion, and user facial expressions to appropriately exhibit expressions. On the other hand, it formulates reasonable voice responses in conjunction with extracted statement content and emotional cues. Lastly, two physical prototypes of the humanoid robot are constructed. Experimental trials are conducted to assess the voice conversation and expression output capabilities of the humanoid robot, thereby confirming the rationality and effectiveness of the proposed solution.
Keywords
Humanoid Robot; ChatGPT; Voice Interaction; Expression Output
Speaker
Liang Yan
Amileyuan Intelligent Technology (Beijing) Co., LTD

Submission Author
Zhenzhong Li Automotive Test Center (Ningbo) Co., LTD
Liang Yan Amileyuan Intelligent Technology (Beijing) Co., LTD
Zhiyuan Yu BIT Chongqing Institute of Microelectronics and Microsystems
Bing Li Automotive Test Center (Ningbo) Co., LTD
Jingwen Li Beijing Institute of Technology
Yibo He DONGFENG LIUZHOU MOTOR CO., LTD
Jie Tang East Shineray Group Co., LTD
Submit Comment
Verify Code Change Another
All Comments
Important Date
  • Conference Date

    Oct 24

    2024

    to

    Oct 27

    2024

  • Oct 14 2024

    Draft paper submission deadline

  • Oct 29 2024

    Registration deadline

  • Oct 31 2024

    Contribution Submission Deadline

Sponsored By
United Societies of Science
King Mongkut's University of Technology North Bangkok (KMUTNB)
IEEE Thailand Section
IEEE Thailand Section C Chapter
Previous Conferences