HO CHI MINH CITY UNIVERSITY OF TECHNOLOGY AND EDUCATION
FACULTY FOR HIGH QUALITY TRAINING

CAPSTONE DESIGN PROJECT

ARBITRARILY-SHAPED TEXT RECOGNIZER AND
TRANSLATOR FOR SMART MENU APPLICATION

PHAM MINH LONG
Student ID: 19119067
CAO HOANG BACH
Student ID: 19119002
Major: COMPUTER ENGINEERING TECHNOLOGY
Advisor: PhD. TRAN VU HOANG.

Ho Chi Minh City, July 2023

THE SOCIALIST REPUBLIC OF
VIETNAM
Independence – Freedom– Happiness
-Ho Chi Minh City, February 08, 2023
GRADUATION PROJECT ASSIGNMENT
Student name: Pham Minh Long

Student ID: 19119067

Major: Computer Engineering Technology

Class: 19119CLA1

Student name: Cao Hoang Bach

Student ID: 19119002

Major: Computer Engineering Technology

Class: 19119CLA2

Advisor: PhD. Tran Vu Hoang

Phone number: 0988757515

Date of assignment: 08/02/2023

Date of submission: 26/06/2023

1. Project title: Arbitrarily-shaped text recognizer and translator for smart menu
application
2. Initial materials provided by the advisor: Documents such as papers and books related
to model quantization and distillation in text recognizer.
3. Content of the project:
-

Refer to papers and conduct surveys to define project objectives.
Survey and choose frameworks and models for text recognizer and chatbot
Design and implement algorithms for English translator and food recommender
Evaluate the results of each module on smartphone devices.
Write the report and enhance the application’s time and space complexity.
a presentation slide.

4. Final product: A smart menu software running on smartphone devices, video, CD, and
report.
CHAIR OF THE PROGRAM

ADVISOR

(Sign with full name)

(Sign with full name)

i

THE SOCIALIST REPUBLIC OF
VIETNAM
Independence – Freedom– Happiness
-Ho Chi Minh City, June 26, 2023
ADVISOR’S EVALUATION SHEET
Student name: Pham Minh Long

Student ID: 19119067

Major: Computer Engineering Technology
Student name: Cao Hoang Bach

Student ID: 19119002

Major: Computer Engineering Technology
Project title: Arbitrarily-shaped text recognizer and translator for smart menu
application
Advisor: Ph.D. Tran Vu Hoang
EVALUATION
Content of the project: The content and workload of the project is suitable
for an undergraduate thesis.
1.

Strengths: Build a smart menu system that meets the actual needs. The
system includes many features such as: recognizing characters in the menu,
translating from Vietnamese to English, recommending dishes according to
customer preferences, and a cha
...

...
Graves, S. Fernandez, F. J. Gomez, and J. Schmidhuber, Connectionist temporal classification:
labelling unsegmented sequence data with recurrent neural networks, in ICML, 2006.
[49] W. A. Burkhard and R. M. Keller, Some approaches to best match file searching, Commun. ACM,
vol. 16, no. 4, pp. 230–236, 1973.
[50] M. D. Zeiler, ADADELTA: an adaptive learning rate method, CoRR, abs/1212.5701, 2012.
[51] A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H.
Adam, Mobilenets: Efficient convolutional neural networks for mobile vision applications, CoRR,
abs/1704.04861, 2017.
[52] M. Sandler, A. G. Howard, M. Zhu, A. Zhmoginov, and L.-C. Chen, Mobilenetv2: Inverted
residuals and linear bottlenecks. mobile networks for classification, detection and segmentation,
CoRR, abs/1801.04381, 2018.
[53] M. Tan, B. Chen, R. Pang, V. Vasudevan, and Q. V. Le, Mnasnet: Platform-aware neural
architecture search for mobile, CoRR, abs/1807.11626, 2018.
[54] H. Cai, L. Zhu, and S. Han, Proxylessnas: Direct neural architecture search on target task and
hardware, CoRR, abs/1812.00332, 2018.
[55] T.-J. Yang, A. G. Howard, B. Chen, X. Zhang, A. Go, M. Sandler, V. Sze, and H. Adam, Netadapt:
Platform-aware neural network adaptation for mobile applications, in ECCV, 2018.
[56] A. Howard, M. Sandler, G. Chu, L. Chen, B. Chen, M. Tan, W. Wang, Y. Zhu, R. Pang, V.
Vasudevan, Q. V. Le, and H. Adam, Searching for MobileNetV3, arXiv preprint
arXiv:1905.02244, 2019.
[57] P. Ramachandran, B. Zoph, and Q. V. Le, Searching for activation functions, CoRR,
abs/1710.05941, 2017.

61

Appendix
Code for the whole system.
Link github: https://github.com/Syun1208/smart-menu-application

Docker hub.
Link docker hub:
https://hub.docker.com/repository/docker/syun1208/chatbot-rasa/general

62

ARBITRARILY-SHAPED TEXT RECOGNIZER AND TRANSLATOR
FOR SMART MENU APPLICATION
ORIGINALITY REPORT

26

%

SIMILARITY INDEX

23%

INTERNET SOURCES

19%

PUBLICATIONS

15%

STUDENT PAPERS

PRIMARY SOURCES

1

deepai.org

3%

2

www.arxiv-vanity.com

3%

Submitted to Ho Chi Minh University of
Technology and Education

2%

4

sure.sunderland.ac.uk

1%

5

arxiv.org

1%

3

Internet Source

Internet Source

Student Paper

6

Internet Source

Internet Source

Document Analysis and Recognition – ICDAR
2021, Springer Science and Business Media
LLC, 2021

1 %

ir.lib.ncu.edu.tw:88

1 %

Publication

7

Internet Source

S

K

L

0

0

2

1

5

4