Evaluasi IndoBERTweet untuk Klasifikasi Sentimen Ulasan Wisata melalui Inferensi Langsung Lintas Domain: Studi Kasus Kota Baubau

Nurul Hidayah, Dodiman Dodiman, Asniati Asniati, La Ode Dwiyan Pramono Darmin

Abstract


Ulasan wisatawan di platform digital merupakan sumber data persepsi publik yang berharga untuk mendukung pengelolaan pariwisata berbasis bukti. Penelitian ini menganalisis kemampuan IndoBERTweet dalam mengklasifikasikan sentimen ulasan wisatawan melalui pendekatan cross-domain direct inference tanpa fine-tuning tambahan, dengan studi kasus pada Benteng Keraton Buton dan Pantai Nirwana di Kota Baubau. Sebanyak 896 ulasan dikumpulkan dari Google Maps melalui web scraping dan diproses melalui case folding, cleaning, normalisasi teks, dan penggabungan kata negasi untuk mengklasifikasikan sentimen positif, negatif, dan netral. Evaluasi menggunakan confusion matrix menghasilkan akurasi 0,67 dan weighted F1-Score 0,71, dengan kinerja terbaik pada kelas positif (F1: 0,80) dan kinerja lebih rendah pada kelas negatif (F1: 0,41) dan netral (F1: 0,44). Temuan ini mengindikasikan bahwa IndoBERTweet berpotensi digunakan sebagai instrumen awal analisis sentimen wisata lokal pada kondisi ketiadaan dataset berlabel domain spesifik, dan hasilnya dapat menjadi pertimbangan awal bagi prioritas kebijakan pengelolaan pariwisata Kota Baubau, namun peningkatan performa lebih lanjut memerlukan fine-tuning dengan data berlabel dari domain wisata yang relevan.


Keywords


(Analisis sentimen; Deep learning; Google Maps; IndoBERT; Klasifikasi teks; Pariwisata).

Full Text:

PDF

References


A. Mukti, “Dinamika Pengembangan Desa Wisata di Indonesia: Analisis Sistematik tentang Pendorong, Tantangan, dan Dampak,” Jurnal Pembangunan Nagari, vol. 10, no. 1, pp. 20–37, Jun. 2025, doi: 10.30559/jpn.v10i1.529.

Y. Okdamaiyanti, I. Muda, and N. Angelia, “Implementasi Kebijakan Pengembangan Daerah Wisata oleh Pemerintah Kabupaten Karo (Studi Deskriptif Terhadap Wisata Danau Lau Kawar),” Jurnal Ilmu Pemerintahan, Administrasi Publik, dan Ilmu Komunikasi (JIPIKOM), vol. 7, no. 2, pp. 179–185, May 2025, doi: 10.31289/jipikom.v7i2.6070.

P. N. Yasintha, “Collaborative Governance Dalam Kebijakan Pembangunan Pariwisata di Kabupaten Gianyar,” Jurnal Ilmiah Dinamika Sosial, vol. 4, no. 1, pp. 1–23, Jan. 2020, doi: 10.38043/jids.v4i1.2219.

T. Sutadi and E. P. Marsongko, “Studi Kebijakan Pengembangan Kawasan Pangandaran Sebagai Kawasan Strategis Pariwisata Nasional,” Jurnal Kepariwisataan: Destinasi, Hospitalitas dan Perjalanan, vol. 1, no. 1, pp. 1–9, Jun. 2017, doi: 10.34013/jk.v1i1.1.

L. F. Nago, S. N. Hamzah, and C. Panigoro, “Persepsi Wisatawan terhadap Destinasi Wisata Pantai Tilalohe, Kabupaten Gorontalo,” Buletin Ilmiah Marina Sosial Ekonomi Kelautan dan Perikanan, vol. 10, no. 1, pp. 49–58, Feb. 2024, doi: 10.15578/marina.v10i1.13130.

A. I. P. Nugraheni, L. Prihanti Putri, and N. Pancawati, “Penggunaan Electronic Word of Mouth (eWOM) untuk Berbagi Pengalaman Kuliner oleh Wisatawan,” Tourism Scientific Journal, vol. 7, no. 1, pp. 15–30, Mar. 2022, doi: 10.32659/tsj.v7i1.144.

I. P. G. A. Sudiatmika, P. S. Saputra, R. L. Rahardian, and K. H. S. Dewi, “Sentiment Analysis of Tourist Reviews on Google Maps For Pura Besakih Using Machine Learning Algorithms,” Jurnal Mandiri IT, vol. 14, no. 1, pp. 149–158, Jul. 2025, doi: 10.35335/mandiri.v14i1.449.

F. Koto, A. Rahimi, J. H. Lau, and T. Baldwin, “IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLP,” in Proceedings of the 28th International Conference on Computational Linguistics, Barcelona: Online, Dec. 2020, pp. 757–770. doi: 10.18653/v1/2020.coling-main.66.

Ardiansyah, A. S. Widagdo, K. N. Qodri, F. E. N. Saputro, and N. A. Rizky P, “Analisis Sentimen Terhadap Pelayanan Kesehatan Berdasarkan Ulasan Google Maps Menggunakan BERT,” Jurnal Fasilkom, vol. 13, no. 2, pp. 326–333, Aug. 2023, doi: 10.37859/jf.v13i02.5170.

F. W. Atmojo, V. Atina, and H. Permatasari, “Analisis Sentimen Pelanggan Pada Ulasan Google Maps Restoran Al-Ghiff Steak Menggunakan Model IndoBERT,” Jurnal Sistem Informasi dan Teknik Komputer, vol. 10, no. 2, pp. 336–343, Oct. 2025, doi: 10.51876/simtek.v10i2.1602.

F. Koto, J. H. Lau, and T. Baldwin, “INDOBERTWEET: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initialization,” in Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Melbourne: Association for Computational Linguistics, Nov. 2021, pp. 10660–10668. doi: 10.18653/v1/2021.emnlp-main.833.

M. A. N. Hibrizi and D. A. Fatah, “Dampak Pra-pemrosesan Teks pada Akurasi Analisis Sentimen Multi-Aspek Menggunakan IndoBERT,” Sains Data Jurnal Studi Matematika dan Teknologi, vol. 4, no. 1, pp. 42–48, Mar. 2026, doi: 10.52620/sainsdata.v4i1.301.

S. Nur, S. Sahibu, and M. Razak, “Aspect-Based Sentiment Analysis of Tourist Attractions in Labuanbajo Using The Transformer Model As A Recommendation for Improving Service Quality,” Journal of Applied Informatics and Computing (JAIC), vol. 10, no. 1, p. 496, Feb. 2026, doi: 10.30871/jaic.v10i1.11565.

D. Al Akhdaan, T. E. Sutanto, and M. Liebenlito, “Confident Learning pada IndoBERT: Peningkatan Kinerja Klasifikasi Sentimen,” The Indonesian Journal of Computer Science, vol. 13, no. 5, Oct. 2024, doi: 10.33022/ijcs.v13i5.4401.

A. Y. Pratama, G. A. Sanjaya, N. K. Lubis, M. R. Aditya, and Y. Yennimar, “Analisis Sentimen Publik Terkait Danantara Menggunakan Algoritma IndoBERT pada Platform Media Sosial,” Metik Jurnal, vol. 9, no. 1, p. 2025, Jun. 2025, doi: 10.47002/metik.v9i1.1055.

J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding,” in Proceedings of North American Chapter of the Association for Computational Linguistics, Minneapolis, Jun. 2019, pp. 4171–4186. doi: 10.18653/v1/N19-1423.

N. M. Gardazi, A. Daud, M. K. Malik, A. Bukhari, T. Alsahfi, and B. Alshemaimri, “BERT applications in natural language processing: a review,” Artif. Intell. Rev., vol. 58, no. 6, Jun. 2025, doi: 10.1007/s10462-025-11162-5.

A. Rogers, O. Kovaleva, and A. Rumshisky, “A Primer in BERTology: What We Know About How BERT Works,” Trans. Assoc. Comput. Linguist., vol. 8, pp. 842–866, Dec. 2020, doi: 10.1162/tacl_a_00349.

R. Gupta, “Bidirectional Encoders to State-of-the-art: A Review of BERT and Its Transformative Impact on Natural Language Processing,” Informatics. Economics. Management, vol. 3, no. 1, pp. 0311–0320, Mar. 2024, doi: 10.47813/2782-5280-2024-3-1-0311-0320.

J. Ipmawati, S. Saifulloh, and K. Kusnawi, “Analisis Sentimen Tempat Wisata Berdasarkan Ulasan pada Google Maps Menggunakan Algoritma Support Vector Machine,” MALCOM: Indonesian Journal of Machine Learning and Computer Science, vol. 4, no. 1, pp. 247–256, Jan. 2024, doi: 10.57152/malcom.v4i1.1066.

Yuyun, N. Hidayah, and S. Sahibu, “Algoritma Multinomial Naïve Bayes Untuk Klasifikasi Sentimen Pemerintah Terhadap Penanganan Covid-19 Menggunakan Data Twitter,” Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), vol. 5, no. 4, pp. 820–826, Aug. 2021, doi: 10.29207/resti.v5i4.3146.

A. Asniati, S. Hady, and I. N. Tolanto, “Analisis Sentimen Netizen Twitter Terhadap Program Makan Siang Gratis Menggunakan Algoritma Naïve Bayes,” JURNAL INFORMATIKA, vol. 14, no. 2, pp. 19–28, Dec. 2025, doi: 10.55340/jiu.v14i2.2582.

R. I. Perwira, V. A. Permadi, D. I. Purnamasari, and R. P. Agusdin, “Domain-Specific Fine-Tuning of IndoBERT for Aspect-Based Sentiment Analysis in Indonesian Travel User-Generated Content,” Journal of Information Systems Engineering and Business Intelligence, vol. 11, no. 1, pp. 30–40, Feb. 2025, doi: 10.20473/jisebi.11.1.30-40.

C. A. Bahri and L. H. Suadaa, “Aspect-Based Sentiment Analysis in Bromo Tengger Semeru National Park Indonesia Based on Google Maps User Reviews,” IJCCS (Indonesian Journal of Computing and Cybernetics Systems), vol. 17, no. 1, p. 79, Feb. 2023, doi: 10.22146/ijccs.77354.

D. D. Purwanto, “Empirical Evaluation of IndoBERT and LSTM for Sentiment Analysis of Tourism Reviews: A Data-Driven Study on Kenjeran Park,” Jurnal Teknik Informatika (Jutif), vol. 7, no. 1, pp. 463–474, Feb. 2026, doi: 10.52436/1.jutif.2026.7.1.4901.

M. A. Rosid, A. S. Fitrani, I. R. I. Astutik, N. I. Mulloh, and H. A. Gozali, “Improving Text Preprocessing for Student Complaint Document Classification Using Sastrawi,” IOP Conf. Ser. Mater. Sci. Eng., vol. 874, no. 1, Art. no. 012017, pp. 1–6, Jul. 2020, doi: 10.1088/1757-899X/874/1/012017.

J. Asher and E. P. Rachmawati, “Analisis Sentimen Ulasan Bintang Lima Aplikasi Instagram di Google Play Store menggunakan IndoBERT,” Dinamik, vol. 30, no. 2, pp. 318–330, Jul. 2025, doi: 10.35315/dinamik.v30i2.10192.

R. Amalia, M. A. Bijaksana, and D. Darmantoro, “Negation Handling in Sentiment Classification Using Rule-Based Adapted from Indonesian Language Syntactic for Indonesian Text in Twitter,” in Journal of Physics: Conference Series, Bandung: Institute of Physics Publishing, Apr. 2018. doi: 10.1088/1742-6596/971/1/012039.

T. G. Prahasiwi and R. Kusumaningrum, “Implementation of Negation Handling Techniques Using Modified Syntactic Rule in Indonesian Sentiment Analysis,” in Journal of Physics: Conference Series, Semarang: Institute of Physics Publishing, Jun. 2019. doi: 10.1088/1742-6596/1217/1/012115.

V. Ganganwar and R. Rajalakshmi, “Employing Synthetic Data for Addressing the Class Imbalance in Aspect-Based Sentiment Classification,” Journal of Information and Telecommunication, vol. 8, no. 2, pp. 167–188, Apr. 2024, doi: 10.1080/24751839.2023.2270824.

F. Koto, T. Beck, Z. Talat, I. Gurevych, and T. Baldwin, “Zero-shot Sentiment Analysis in Low-Resource Languages Using a Multilingual Sentiment Lexicon,” in Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), St. Julian’s, Malta: Association for Computational Linguistics, Mar. 2024, pp. 298–320. doi: 10.18653/v1/2024.eacl-long.18.




DOI: https://doi.org/10.55340/jiu.v15i1.2683

Refbacks

  • There are currently no refbacks.


__________________________________________________________________________________________________________________________________________________

SK Accreditation No. 286/DST/C3/HM.01.00/2026 Tanggal 7 April 2026

Editorial Address :

Program Studi Teknik Informatika, Fakultas Teknik, Universitas Dayanu Ikhsanuddin Jl. Dayanu Ikhsanuddin no.124 Baubau, Sulawesi Tenggara 

Jurnal Informatika by Program Studi Teknik Informatika, Fakultas Teknik, Universitas Dayanu Ikhsanuddin Baubau, Indonesia is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. Based on work at https://ejournal.unidayan.ac.id/index.php/JIU