Maskat, Ruhaila and Azman, Norazmiera Ayunie and Nulizairos, Nur Shaheera Shastera and Zahidin, Nurul Athirah and Mahadi, Adibah Humairah and Norshamsul, Siti Rubaya and Mohd Sharif, Mohd Mukhlis and Mahdin, Hairulnizam (2024) A bi-annotated Malay-English code-switching (Manglish) dataset of X posts for biological gender identification and authorship attribution. Data in Brief, 52. pp. 1-14.
![[img]](http://eprints.uthm.edu.my/style/images/fileicons/text.png) |
Text
J17377_a3b15f369ba6e61ca5517eaf40899173.pdf Restricted to Registered users only Download (2MB) | Request a copy |
Abstract
Low-resource languages, like Malay, face the threat of extinction when linguistic resources become scarce. This paper addresses the scarcity issue by contributing to the inventory of low-resource languages, specifically focusing on Malay-English, known as Manglish. Manglish speakers are primarily located in Malaysia, Indonesia, Brunei, and Singapore. As global adoption of second languages and social media usage increases, language code-switching, such as Spanglish and Chinglish, becomes more prevalent. In the case of Malay-English, this phenomenon is termed Manglish. To enhance the status of the Malay language and its transition out of the low-resource category, this unique text corpus, with binary annotations for biological gender and anonymized author identities is presented. This bi-annotated dataset offers valuable applications for various fields, including the investigation of cyberbullying, combating gender bias,and providing targeted recommendations for gender-specific products. This corpus can be used with either of the annotations or their composite. The dataset comprises of posts from 50 Malaysian public figures, equally split between biological males and females. The dataset contains a total of 709,012 raw X posts (formerly Twitter), with a relatively balanced distribution of 53.72% from biological female authors and 46.28% from biological male authors. Twitter API was used to scrape the posts. After pre-processing, the total posts reduced to 650,409 posts, widening the gap between the genders with the 56.88% for biological female and 43.12% for biological male. This dataset is a valuable resource for researchers in the field of Malay-English code-switching Natural Language Processing (NLP) and can be used to train or enhance existing and future Manglish language transformers.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | Biological gender identification Authorship attribution Code-switching Malay-English Manglish NLP Text analytics |
| Subjects: | T Technology > T Technology (General) |
| Divisions: | Faculty of Computer Science and Information Technology > FSKTM |
| Depositing User: | Mr. Mohamad Zulkhibri Rahmad |
| Date Deposited: | 13 May 2024 11:48 |
| Last Modified: | 13 May 2024 11:48 |
| URI: | http://eprints.uthm.edu.my/id/eprint/10920 |
Actions (login required)
 |
View Item |