A Supervised Learning Model for Sentiment Analysis Based on Regional Dialects in Tourism-Related Issues

Tb Ai Munandar

doi:10.30591/jpit.v10i3.8627

A Supervised Learning Model for Sentiment Analysis Based on Regional Dialects in Tourism-Related Issues

Tb Ai Munandar

Abstract

Indonesia has an exceptionally rich diversity of regional languages, one of which is the Bekasi dialect, often used in social media communication. The uniqueness of this dialect presents specific challenges in extracting public opinion, especially in text-based sentiment analysis. This study aims to develop a sentiment analysis framework that incorporates regional dialects from social media data and evaluate the effectiveness of various supervised learning algorithms. Data were collected from the Facebook group “Explore Bekasi Tourism,” totaling 1,257 posts and comments, which were filtered down to 1,000 relevant instances. A manual validation process was conducted by linguistic experts to convert non-standard terms and regional dialects into standardized Indonesian, followed by translation into English for annotation purposes. The analysis method involved preprocessing steps (tokenizing, case folding, stemming), feature weighting using TF-IDF, and sentiment classification using four algorithms: Naive Bayes, K-Nearest Neighbor, Support Vector Machine, and Decision Tree. The evaluation results show that Naive Bayes achieved the best performance with an accuracy of 76%, followed by K-Nearest Neighbor (67.5%), SVM (65.5%), and Decision Tree (28%). These findings highlight the crucial role of expert judgment in processing dialect-based data to ensure accurate sentiment classification. The study recommends developing a broader annotated corpus of regional dialects and exploring deep learning methods in future research to enhance classification performance and generalizability.

Keywords

Facebook; Regional Dialect; Sentiment Analysis; Supervised Learning; TF-IDF

Full Text:

References

Kemendikbud, “Badan Bahasa Petakan 652 Bahasa Daerah di Indonesia,” https://www.kemdikbud.go.id/main/blog/2018/07/badan-bahasa-petakan-652-bahasa-daerah-di-indonesia, Jakarta, Jul. 2018.

M.L. Phyu and K. Hashimoto, “Sentiment Analysis of the Burmese Language Using n-Gram-Based Words,” CIC Express Letters, vol. 13, no. 3, pp. 217–224, 2019, Accessed: Sep. 27, 2024. [Online]. Available: http://www.icicel.org/ell/contents/2019/3/el-13-03-06.pdf

I. Erlin, H. Suliani, L. Asnal, Suryati, and R. Efendi, “Sentiment Analysis for Abolition of National Exams in Indonesia using Support Vector Machine,” Engineering Letters, vol. 30, no. 4, pp. 1342–1352, 2022, Accessed: Sep. 27, 2024. [Online]. Available: https://www.engineeringletters.com/issues_v30/issue_4/EL_30_4_19.pdf

S. Sidorov, A. Faizliev, and V.Balash, “Fractality and Multifractality Analysis of News Sentiments Time Series,” IAENG International Journal of Applied Mathematics, vol. 48, no. 1, pp. 90–97, 2018, Accessed: Sep. 27, 2024. [Online]. Available: https://www.iaeng.org/IJAM/issues_v48/issue_1/IJAM_48_1_13.pdf

X. Jiawei and T. Murata, “Stock Market Trend Prediction with Sentiment Analysis based on LSTM Neural Network,” in Lecture Notes in Engineering and Computer Science: Proceedings of The International MultiConference of Engineers and Computer Scientists 2019, Hongkong, 2019, pp. 475–479. Accessed: Sep. 27, 2024. [Online]. Available: https://www.iaeng.org/publication/IMECS2019/IMECS2019_pp475-479.pdf

A. Kumar and A. Jaiswal, “Empirical Study of Twitter and Tumblr for Sentiment Analysis using Soft Computing Techniques,” in Lecture Notes in Engineering and Computer Science: Proceedings of The World Congress on Engineering and Computer Science 2017, San Fransisco, 2017, pp. 472–476.

S. Elbagir and J. Yang, “Twitter Sentiment Analysis Using Natural Language Toolkit and VADER Sentiment,” in Proceedings of the International MultiConference of Engineers and Computer Scientists 2019, International Association of Engineers, 2019, p. 575. Accessed: Sep. 27, 2024. [Online]. Available: https://www.iaeng.org/publication/IMECS2019/IMECS2019_pp12-16.pdf

D. R. Lazuardi, T. A. Munandar, H. Harsiti, Z. Mutaqin, and R. N. Hays, “Sentiment analysis of public opinions on the welfare of honorary educators using Naive Bayes,” IOP Conf Ser Mater Sci Eng, vol. 830, no. 3, p. 032018, Apr. 2020, doi: 10.1088/1757-899X/830/3/032018.

V. Rohini, M. Thomas, and C.A. Latha, “Domain Based Sentiment Analysis in Regional Languange-Kannada,” International Journal Of Engineering Research & Technology (IJERT), vol. 4, no. 22, 2016.

H. Al Suwaidi, T.R. Soomro, and K. Shaalan, “Sentiment Analysis for Emiriti Dialects in Twitter,” Sindh University Research Journal (Science Series, vol. 48, no. 4, pp. 707–710, 2016.

R. M. Duwairi, “Sentiment analysis for dialectical Arabic,” in 2015 6th International Conference on Information and Communication Systems (ICICS), IEEE, Apr. 2015, pp. 166–170. doi: 10.1109/IACS.2015.7103221.

A. Chader, D. Lanasri, L. Hamdad, M. Belkheir, and W. Hennoune, “Sentiment Analysis for Arabizi: Application to Algerian Dialect,” in Proceedings of the 11th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management, SCITEPRESS - Science and Technology Publications, 2019, pp. 475–482. doi: 10.5220/0008353904750482.

M.H.S.M. Amin, O. Al-Rassam, and Z.S. Faeq, “Kurdish Language Sentiment Analysis: Problems and Challenges,” Mathematical Statistician and Engineering Applications, vol. 71, no. 4, pp. 3282–3293, 2022.

J. O. Atoum and M. Nouman, “Sentiment Analysis of Arabic Jordanian Dialect Tweets,” International Journal of Advanced Computer Science and Applications, vol. 10, no. 2, 2019, doi: 10.14569/IJACSA.2019.0100234.

S. Medhaffar, F. Bougares, Y. Estève, and L. Hadrich-Belguith, “Sentiment Analysis of Tunisian Dialects: Linguistic Ressources and Experiments,” in Proceedings of the Third Arabic Natural Language Processing Workshop, Stroudsburg, PA, USA: Association for Computational Linguistics, 2017, pp. 55–61. doi: 10.18653/v1/W17-1307.

A. B. Braiek and Z. N. Ben Salem, “Sentiment Analysis Classification for Text in Social Media: Application to Tunisian Dialect,” International Journal on Cybernetics & Informatics, vol. 12, no. 2, pp. 313–326, Mar. 2023, doi: 10.5121/ijci.2023.120223.

A. Alqarni and A. Rahman, “Arabic Tweets-Based Sentiment Analysis to Investigate the Impact of COVID-19 in KSA: A Deep Learning Approach,” Big Data and Cognitive Computing, vol. 7, no. 1, p. 16, Jan. 2023, doi: 10.3390/bdcc7010016.

N. Khurana, “Sentiment Analysis of Regional Languages Written in Roman Script on Social Media,” Data Science and Intelligent Applications, Lecture Notes on Data Engineering and Communications Technologies, vol. 52, pp. 113–119, 2021, doi: 10.1007/978-981-15-4474-3_13.

P. Shah, P. Swaminarayan, M. Patel, and N. Patel, “Sentiment Analysis on Movie Reviews in Regional Language Gujarati Using Machine Learning Algorithm,” International Journal of Engineering Trends and Technology, vol. 70, no. 1, pp. 313–326, Jan. 2022, doi: 10.14445/22315381/IJETT-V70I1P236.

K. Rakshitha, R. H M, M. Pavithra, A. H D, and M. Hegde, “Sentimental analysis of Indian regional languages on social media,” Global Transitions Proceedings, vol. 2, no. 2, pp. 414–420, Nov. 2021, doi: 10.1016/j.gltp.2021.08.039.

M.B. Shelke and S.N. Deshmukh, “Recent Advances in Sentiment Analysis of Indian Languages,” International Journal of Future Generation Communication and Networking , vol. 13, no. 4, pp. 1656–1675, 2020, Accessed: Sep. 27, 2024. [Online]. Available: http://sersc.org/journals/index.php/IJFGCN/article/view/32962/18184

B. Hdioud and M. E. H. Tirari, “Sentiment Analysis of Moroccan Dialect Using Deep Learning,” in Proceedings of the 5th International Conference on Big Data and Internet of Things. BDIoT 2021. Lecture Notes in Networks and Systems, Vol 489, Springer, 2022, pp. 457–466. doi: 10.1007/978-3-031-07969-6_34.

M. Dahbi, R. Saadane, and S. Mbarki, “Citizen Sentiment Analysis in Social Media Moroccan Dialect as Case Study,” in Innovations in Smart Cities Applications Edition 3, 2020, pp. 16–29. doi: 10.1007/978-3-030-37629-1_2.

Y. Matrane, F. Benabbou, and N. Sael, “Sentiment analysis through word embedding using AraBERT: Moroccan dialect use case,” in 2021 International Conference on Digital Age & Technological Advances for Sustainable Development (ICDATA), IEEE, Jun. 2021, pp. 80–87. doi: 10.1109/ICDATA52997.2021.00024.

P. Ranjitha and K. N. Bhanu, “Improved Sentiment Analysis for Dravidian Language-Kannada Using Dicision Tree Algorithm With Efficient Data Dictionary,” IOP Conf Ser Mater Sci Eng, vol. 1123, no. 1, p. 012039, Apr. 2021, doi: 10.1088/1757-899X/1123/1/012039.

A.J.V. Boquiren, R.A. Garcia, C.J.D. Hungria, and J.C. de Goma, “Tagalog Sentiment Analysis Using Deep Learning Approach With Backward Slang Inclusion,” in Proceedings of the International Conference on Industrial Engineering and Operations Management Nsukka, Nigeria, Apr. 2022.

A. Chaer and I. Agustina, Sosiolinguistik: Perkenalan Awal, 1st ed. Jakarta: Rineka Cipta Publisher, 1995.

G. Yule, The Study of Language: Third Edition. NewYork: Cambridge University Press, 2006.

hawaii.edu, “Language Varieties: Definisions of Different Kinds of Languate Varieties,” https://www.hawaii.edu/satocenter/langnet/definitions/index.html#regional, access at August 05, 2024.

M. Farhadloo and E. Rolland, “Fundamentals of Sentiment Analysis and Its Applications,” in Sentiment Analysis and Ontology Engineering , 2016, pp. 1–24. doi: 10.1007/978-3-319-30319-2_1.

Z. Drus and H. Khalid, “Sentiment Analysis in Social Media and Its Application: Systematic Literature Review,” Procedia Comput Sci, vol. 161, pp. 707–714, 2019, doi: 10.1016/j.procs.2019.11.174.

M. Z. Naeem, F. Rustam, A. Mehmood, Mui-zzud-din, I. Ashraf, and G. S. Choi, “Classification of movie reviews using term frequency-inverse document frequency and optimized machine learning algorithms,” PeerJ Comput Sci, vol. 8, p. e914, Mar. 2022, doi: 10.7717/peerj-cs.914.

F. Karabiber, “Term Frequency-Inverse Document Frequency,” https://www.learndatasci.com/glossary/tf-idf-term-frequency-inverse-document-frequency, accessed on August 07, 2024.

J. Han and M. Kamber, Data Mining Concepts and Techniques , Third Edition. San Francisco: Morgan Kaufmann Publishers, 2012.

J. Han and M. Kamber, Data Mining: Concepts and Technique, Second Edition. San Francisco: Morgan Kaufmann Publishers, 2006.

D.T. Larose, Data Mining Methods and Models . New Jersey: John Wiley & Sons, Inc, 2006.

S. Styawati and K. Mustofa, “A Support Vector Machine-Firefly Algorithm for Movie Opinion Data Classification,” IJCCS (Indonesian Journal of Computing and Cybernetics Systems), vol. 13, no. 3, p. 219, Jul. 2019, doi: 10.22146/ijccs.41302.

DOI: https://doi.org/10.30591/jpit.v10i3.8627