A Lightweight Edge-Cloud Architecture for Real-Time Vietnamese Sign Language Translation Using YOLO-Based Hand Detection on Raspberry Pi
ID:15 View Protection:ATTENDEE Updated Time:2026-10-08 17:27:50 Hits:80 Poster Presentation

Start Time:2026-10-12 15:15(Asia/Ho_Chi_Minh)

Duration:15min

Session:OP Poster » OP1Poster

Presentation File Attachment File

Tips: Only the registered participant can access the file. Please sign in first.

Abstract
Sign language serves as a primary communication medium for deaf and hard-of-hearing individuals. However, the lack of widespread sign language literacy among the general population creates significant communication barriers in public service environments such as hospitals, schools, banks, and administrative offices. This paper presents a lightweight Edge–Cloud architecture for real-time Vietnamese Sign Language (VSL) translation into Vietnamese speech using an embedded Raspberry Pi platform. The proposed system integrates a YOLO-based hand detection module, a convolutional neural network (CNN) for static hand-sign classification, cloud-assisted natural language processing for sentence reconstruction, and text-to-speech synthesis for voice generation. The work desmontrate a temporal confirmation mechanism and automatic phrases termination strategy to reduce classification noise and eliminate manual input controls, as well as contribute a curated dataset of 7070 Vietnamese hand-signalphabet gestures. Experimental results demonstrate a classification accuracy upto 98.5%, while maintaining real-time operation on a resource-constrained embedded device. The proposed system offers a complete, low-cost and deployable end-to-end embedded sign-to-speech prototype solution for assistive communication and inclusive smart services. It is especially useful and convinient for disability to communicate and express their thoughts directly with others in public services, hospitals, banks or edge for smart customer services.
Keywords
Vietnamese Sign Language, Edge AI, Computer Vision, YOLO, CNN, Raspberry Pi, Assistive Technology, Human-Centered AI
Speaker
Trung Tra Bui
student Post and Telecommunications Institute Of Technology

Nhu Nguyet Tran
student Posts and Telecommunications Institute of Technology

Submission Author
Lan Phan Posts and Telecommunications Institute of Technology
Trung-Hieu Nguyen Posts and Telecommunications Institute of Technology (PTIT)
Trung Tra Bui Post and Telecommunications Institute Of Technology
Nhu Nguyet Tran Posts and Telecommunications Institute of Technology
Submit Comment
Verify Code Change Another
All Comments
Important Date
  • Conference Date

    Oct 11

    2026

    to

    Oct 14

    2026

  • Dec 30 2025

    Contribution Submission Deadline

  • Sep 28 2026

    Early Bird Registration

  • Oct 14 2026

    Draft paper submission deadline

  • Oct 15 2026

    Registration deadline

Sponsored By
United Societies of Science
Organized By
Posts and Telecommunications Institute of Technology
Supported By
IEEE Section
IEEE Vietnam Section