Term Standardisation with LDA Model to Detect Service Disruption Events using English and Manglish Tweets

Authors

• Noraysha Yusuf, Universiti Malaya, Malaysia
• Maizatul Akmar Ismail, Universiti Malaya, Malaysia
• Tasnim M.A. Zayet, Universiti Malaya, Malaysia
• Kasturi Dewi Varathan, Universiti Malaya, Malaysia
• Rafidah MD Noor, Universiti Malaya, Malaysia

Corresponding Author ORCID Identifer

Tasnim M.A. Zayet https://orcid.org/0000-0001-5755-5953

Section

Regular Issue

Abstract

Rapid transit is one of Malaysia's most important transportation modes, where commuters use public transportation to travel. Any disruption in the rapid transit service affects their daily routines. Therefore, detecting such service disruption has become fundamental. In this study, the disruption in Malaysia's rapid transit service was assessed using English and Manglish (a combination of English and Malay) tweets through Latent Dirichlet Allocation (LDA). The gathered tweets were classified into event and non-event tweets and LDA was applied to the event tweets. Manglish event tweets were pre-processed using the proposed term standardisation technique. As a result, LDA has proved its efficiency in topic detection for both English and Manglish tweets with better performance for Manglish tweets; The best event detection rate of the LDA_English model was at the likelihood of 80% while the best detection rate of the LDA_Manglish model was at a likelihood of 60%.

Cite This Article

Yusuf, N. ., Ismail, M. A., Zayet, T. M., Dewi Varathan, K., & MD Noor, R. (2024). Term Standardisation with LDA Model to Detect Service Disruption Events using English and Manglish Tweets. Journal of Informatics and Web Engineering, 3(1), 1–14. https://doi.org/10.33093/jiwe.2024.3.1.1.1

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.