ANALISIS PERBANDINGAN KLASIFIKASI INTENT CHATBOT MENGGUNAKAN DEEP LEARNING BERT, ROBERTA, DAN INDOBERT

DWIYONO, ASWIN and Abdiansah, Abdiansah and Fachrurrozi, Muhammad (2024) ANALISIS PERBANDINGAN KLASIFIKASI INTENT CHATBOT MENGGUNAKAN DEEP LEARNING BERT, ROBERTA, DAN INDOBERT. Masters thesis, Sriwijaya University.

	Text RAMA_55101_09012682125012_cover.jpg - Accepted Version Restricted to Repository staff only Available under License Creative Commons Public Domain Dedication. Download (141kB) | Request a copy
	Text RAMA_55101_09012682125012.pdf - Accepted Version Restricted to Repository staff only Available under License Creative Commons Public Domain Dedication. Download (13MB) | Request a copy
	Text RAMA_55101_09012682125012_TURNITIN.pdf - Accepted Version Restricted to Repository staff only Available under License Creative Commons Public Domain Dedication. Download (5MB) | Request a copy
	Text RAMA_55101_09012682125012_0001108401_0222058001_front_ref.pdf - Accepted Version Available under License Creative Commons Public Domain Dedication. Download (893kB)
	Text RAMA_55101_09012682125012_0001108401_0222058001_02.pdf - Accepted Version Restricted to Repository staff only Available under License Creative Commons Public Domain Dedication. Download (730kB) | Request a copy
	Text RAMA_55101_09012682125012_0001108401_0222058001_03.pdf - Accepted Version Restricted to Repository staff only Available under License Creative Commons Public Domain Dedication. Download (660kB) | Request a copy
	Text RAMA_55101_09012682125012_0001108401_0222058001_04.pdf - Accepted Version Restricted to Repository staff only Available under License Creative Commons Public Domain Dedication. Download (850kB) | Request a copy
	Text RAMA_55101_09012682125012_0001108401_0222058001_05.pdf - Accepted Version Restricted to Repository staff only Available under License Creative Commons Public Domain Dedication. Download (53kB) | Request a copy
	Text RAMA_55101_09012682125012_0001108401_0222058001_06_ref.pdf - Accepted Version Restricted to Repository staff only Available under License Creative Commons Public Domain Dedication. Download (174kB) | Request a copy
	Text RAMA_55101_09012682125012_0001108401_0222058001_07_lamp.pdf - Accepted Version Restricted to Repository staff only Available under License Creative Commons Public Domain Dedication. Download (11MB) | Request a copy

Abstract

A chatbot is a software application to designed handle user inputs and generate appropriate replies based on those inputs, which are then communicated back to the user. In able to provide accurate responses, the chatbot must be able to understand the intent of the user accurately. An issue in the development of chatbots is how to accurate classify user intent. Incorrectly understanding user intent can result in irrelevant responses. In order to have a conversation with the user, the intent of the user needs to be classified correctly. This paper compares three state-of-the-art transformer-based models BERT (Bidirectional Encoder Representations from Transformers), RoBERTa (Robustly Optimized BERT Pretraining Approach), and IndoBERT (Indonesia Bidirectional Encoder Representations from Transformer) for the task of intent classification in chatbot systems. Various performance metrics, including accuracy, F1-score, precision, and recall, were analyzed to determine which model performs more effectively in the same parameter conditions. Performance metrics like accuracy and F1-score were compared to assess model BERT, RoBERTa and IndoBERT performs better in a University Chatbot Dataset in Indonesian language. The BERT model achieved an accuracy of 0.89, RoBERTa model achieved 0.84 and IndoBERT model achieved an accuracy of 0.94. The better performance of IndoBERT compared to BERT and RoBERTa is caused by more language-specific training, more relevant pretraining, and more effective adaptation to Indonesian context and structure.

Item Type:	Thesis (Masters)
Subjects:	T Technology > T Technology (General) > T58.6-58.62 Management information systems > T58.6 General works Industrial engineering Information technology. Information systems (General) Management information systems -- Continued
Divisions:	09-Faculty of Computer Science > 55101-Informatics (S2)
Depositing User:	Aswin Dwiyono
Date Deposited:	13 Jan 2025 07:58
Last Modified:	13 Jan 2025 07:58
URI:	http://repository.unsri.ac.id/id/eprint/164391

Actions (login required)

View Item