HO CHI MINH CITY UNIVERSITY OF TECHNOLOGY AND EDUCATION
FACULTY FOR HIGH QUALITY TRAINING

GRADUATION PROJECT

SERVICE ROBOT FOR STUDENTS BASED ON
COMPUTER VISION AND NATURAL LANGUAGE
PROCESSING

NGUYỄN TUẤN THANH
Student ID: 17151028
Major: AUTOMATION AND CONTROL ENGINEERING
TECHNOLOGY
Advisor: Assoc. Prof. PhD. LE MY HA

Ho Chi Minh City, August 2022

HO CHI MINH CITY UNIVERSITY OF TECHNOLOGY AND EDUCATION
FACULTY FOR HIGH QUALITY TRAINING

GRADUATION PROJECT

SERVICE ROBOT FOR STUDENTS BASED ON
COMPUTER VISION AND NATURAL LANGUAGE
PROCESSING

NGUYỄN TUẤN THANH
Student ID: 17151028
Major: AUTOMATION AND CONTROL ENGINEERING
TECHNOLOGY
Advisor: Assoc. Prof. PhD. LE MY HA

Ho Chi Minh City, August 2022

Faculty for High Quality Training – HCMC University of Technology and Education
THE SOCIALIST REPUBLIC OF VIETNAM
Independence – Freedom– Happiness

-Ho Chi Minh City, August 6th, 2022

GRADUATION PROJECT ASSIGNMENT

Student name: Nguyen Tuan Thanh

Student ID: 17151028

Major: Automation and Control Engineering
Technology

Class: 17151CLA1

Advisor: Assoc. Prof. PhD. Le My Ha

Phone number: 0938811201

Date of assignment: Feb 21th, 2022

Date of submission: August 6th, 2022

1. Project title: Service robot for students based on computer vision and natural language
processing.
2. Initial materials provided by the advisor: References, reference programs, data sets, expected
parameters of the Robot.
3. Content of the project:
- Design, implement a service robot with two functions: chat and talk.
- Apply computer vision to identify wearing a mask and user information.
- Apply natural language processing in virtual voice assistant to communicate with human.
- Apply natural language toolkit (NLTK) to build chatbot to communicate with human.
- Build database and collect more database when communicate with human.
4. Final product: Finish a service robot that have abilities to recognize human with high accuracy
and communicating with human by given knowledge database.
CHAIR OF THE PROGRAM
(Sign with full name)

ADVISOR
(Sign with full name)

Faculty for High Quality Training – HCMC University of Technology and Education
THE SOCIALIST REPUBLIC OF VIETNAM
Independence – Freedom– Happiness

-Ho Chi Minh City, August 6, 2022

ADVISOR’S EVALUATION SHEET
Student name: Nguyen Tuan Thanh

Student ID: 17151028

Major: Automation and Control Engineering Technology
Project title: Service robot for students based on computer vision and nat
...

...
ch,” BioSMART 2019 Proceedings: 3rd International Conference on Bio-Engineering for Smart
Technologies, Apr. 2019, doi: 10.1109/BIOSMART.2019.8734250.

[2]

D. Gries and F. B. Schneider, “Computer Vision: Algorithms and Applications.”
[Online]. Available: www.springer.com/series/3191.

[3]

M. M. Sani, K. A. Ishak, and S. A. Samad, “Evaluation of face recognition system
using support vector machine,” SCOReD2009 - Proceedings of 2009 IEEE Student
Conference on Research and Development, pp. 139–141, 2009, doi:
10.1109/SCORED.2009.5443223.

[4]

NVIDIA: “Jetson Nano,” Nvidia.com, May 20, 2022.

[5]

Pham Dinh Khanh: “Thuật toán HOG (Histrogram of oriented gradient)”,
phamdinhkhanh.github.io, June 6,2022.

[6]

Simplilearn: “Speech Recognition in Python”, simplilearn.com, july 12, 2022.

[7]

SAS Insights: “Natural Language Processing (NLP)”, sas.com, july 3, 2022.

[8]

David Amos: “The Ultimate Guide To Speech Recognition With Python’,
realpython.com, july 11, 2022.

[9]

Khuyen Tran: “What is PyTorch? Think about Numpy, but with strong GPU
acceleration”, towardsdatascience.com, June 6,2022.

[10]

XUAN HIEP: “Framework Pytorch”, itguru.vn, June 6,2022.

[11]

Nguyen Van Gieu: “Pandas Python Tutorial”, viblo.asia, April 21, 2022.

[12]

Hybrid Technologies: “SỰ PHÁT TRIỂN CỦA TRỢ LÝ ẢO”, jobs.hybridtechnologies.vn, july 3, 2022.

[13]

Tung Phat: “ChatBox là gì?”, tungphat.com, july 7, 2022.

[14]

Corinne Bernstein: “Face Detection”, techtarget.com, july 2, 2022.

[15]

Machine Learning Project: “AI Chatbot in Python (using NLTK): How to build a
chatbot?”, pykit.org, May 22, 2022.

[16]

THEMEGAZINE.CA: “Chatbot Statistics: Which Industries Are Using Chatbots
the Most?”, themegazine.ca, May 20, 2022.

[17]

Md. Zubair: “Write a Few Lines of Code and Detect Faces, Draw Landmarks from
Complex Images”, towardsdatascience.com, july 18, 2022.

[18]

Gaurav Maindola: “Face Detection with HAAR Cascade in OpenCV Python”,
machinelearningknowledge.ai, june 10, 2022.
48

Graduation Thesis
[19]

Kelvin Salton do Prado: Face Recognition: Understanding LBPH Algorithm,
june 13, 2022.

[20]

Sovit Ranjan: Face Landmark Detection using Dlib, debuggercafe.com, june 3,
2022.

[21]

gTTS: GTTS Documentation, gtts.readthedocs.io, june 3, 2022.

[22]

Patrick Loeber: Chat Bot With PyTorch - NLP And Deep Learning, pythonengineer.com, june 20, 2022.

[23]

Khang: Understanding Feedforward Neural Networks, vankhangfet.github.io,
june 20, 2022.

49