HCMC UNIVERSITY OF TECHNOLOGY AND EDUCATION
FACULTY OF INTERNATIONAL EDUCATION

GRADUATION PROJECT

DEVELOPMENT OF A REAL-TIME
SIGN LANGUAGE COMMUNICATION
WEB APPLICATION USING COMPUTER
VISION AND NATURAL LANGUAGE PROCESSING

DUONG HOANG GIA
Student ID: 20119129
Major: COMPUTER ENGINEERING TECHNOLOGY
Supervisor: HUYNH THE THIEN,PhD

Ho Chi Minh City, September 2024

THE SOCIALIST REPUBLIC OF VIETNAM

Independence – Freedom– Happiness


PRE-DEFENSE EVALUATION SHEET
Student name: .................Duong Hoang Gia......................... Student ID: .......20119129......
Major: .......................................Computer Engineering Technology......................................
Project title:

Development of a Real-Time Sign Language Communication Web
Application Using Computer Vision and Natural Language Processing

Name of Examiner: .................................................................................................................
EVALUATION
1. Content and workload of the project
.................................................................................................................................................
.................................................................................................................................................
.................................................................................................................................................
.................................................................................................................................................
2. Strengths:
.................................................................................................................................................
.................................................................................................................................................
.................................................................................................................................................
3. Weaknesses:
.................................................................................................................................................
.................................................................................................................................................
...........................................................................................................
...

...
15, pp. 539–543. DOI: 10.1109/
ACPR.2015.7486561.
[13] Ahmed Samir Roshdy et al. “A Proposed Hybrid Sensor Architecture for
Arabic Sign Language Recognition”. In: vol. 323. Sept. 2014. ISBN: 978-3319-11309-8. DOI: 10.1007/978-3-319-11310-4_63.
[14] Giulio Marin, Fabio Dominio, and Pietro Zanuttigh. “Hand gesture recognition with leap motion and kinect devices”. In: 2014 IEEE International
Conference on Image Processing (ICIP). 2014, pp. 1565–1569. DOI: 10 .
1109/ICIP.2014.7025313.
[15] T. Starner, J. Weaver, and A. Pentland. “Real-time American sign language
recognition using desk and wearable computer based video”. In: IEEE Transactions on Pattern Analysis and Machine Intelligence 20.12 (1998), pp. 1371–
1375. DOI: 10.1109/34.735811.
[16] Arman Savran, Ruben Gur, and Ragini Verma. “Automatic Detection of
Emotion Valence on Faces Using Consumer Depth Cameras”. In: Dec. 2013,
pp. 75–82. DOI: 10.1109/ICCVW.2013.17.
[17] Camillo Lugaresi et al. MediaPipe: A Framework for Building Perception
Pipelines. 2019. arXiv: 1906.08172 [cs.DC]. URL: https://arxiv.org/
abs/1906.08172.
[18] Google Developers. MediaPipe Hand Landmarker. 2024. URL: https://
developers . google . com / mediapipe / solutions / vision / hand _
landmarker.

52

[19] Rahib Abiyev, John Bush Idoko, and Murat Arslan. “Reconstruction of Convolutional Neural Network for Sign Language Recognition”. In: 2020 International Conference on Electrical, Communication, and Computer Engineering (ICECCE). 2020, pp. 1–5. DOI: 10 . 1109 / ICECCE49384 . 2020 .
9179356.
[20] Pravati Nayak et al. “2D-convolutional neural network based fault detection
and classification of transmission lines using scalogram images”. In: Heliyon
10.19 (2024), e38947. ISSN: 2405-8440. DOI: https : / / doi . org / 10 .
1016/j.heliyon.2024.e38947. URL: https://www.sciencedirect.
com/science/article/pii/S240584402414978X.
[21] Cao Dong, Ming Leu, and Zhaozheng Yin. “American Sign Language alphabet recognition using Microsoft Kinect”. In: June 2015, pp. 44–52. DOI:
10.1109/CVPRW.2015.7301347.
[22] Vivek Bheda and Dianna Radpour. “Using Deep Convolutional Networks
for Gesture Recognition in American Sign Language”. In: (Oct. 2017). DOI:
10.48550/arXiv.1710.06836.
[23] Aurelijus Vaitkevičius et al. “Recognition of American Sign Language Gestures in a Virtual Reality Using Leap Motion”. In: Applied Sciences 9.3
(2019). ISSN: 2076-3417. DOI: 10 . 3390 / app9030445. URL: https : / /
www.mdpi.com/2076-3417/9/3/445.

53