A comprehensive survey on arabic text classification: progress, challenges, and techniques
DOI:
https://doi.org/10.38152/bjtv8n1-022Abstract
The exponential growth of textual data has heightened the importance of efficient text classification, a fundamental natural language processing task that assigns predefined categories to documents. This task can follow flat classification, where categories are equally structured, or hierarchical classification, which organizes categories in multi-level structures and presents additional complexities. While extensive research has advanced text classification for English, studies on Arabic text classification remain limited, particularly in hierarchical contexts. The unique features of Arabic, such as its rich morphology, diverse dialects, and syntactic complexity, pose significant challenges. This survey provides a comprehensive review of Arabic text classification by examining data sources, preprocessing steps, and feature extraction techniques, ranging from traditional methods like Bag of Words and TF-IDF to modern approaches such as neural embeddings (e.g., Word2Vec) and transformer-based models like BERT. Additionally, it explores classification techniques, from machine learning algorithms (e.g., SVM, Random Forest) to deep learning models (e.g., CNN, RNN, LSTM, GPT), and evaluates performance through metrics such as precision, recall, and F1-score. This survey aims to guide future research and innovation in Arabic text classification by addressing current advancements and challenges.
References
ABABNEH, A. H. Investigating the relevance of Arabic text classification datasets based on supervised learning. Journal of Electronic Science and Technology, 20, n. 2, p. 100160, 2022 2022.
ABBAS, M.; SMAÏLI, K., 2005, English, Borovets, Bulgaria. Comparison of Topic Identification methods for Arabic Language. https://inria.hal.science/inria-00000448v1/document
https://inria.hal.science/inria-00000448v1/file/ranlp2005.pdf. Disponível em: https://inria.hal.science/inria-00000448.
ABBAS, M.; SMAÏLI, K.; BERKANI, D. Evaluation of Topic Identification Methods on Arabic Corpora. J. Digit. Inf. Manag., 9, p. 185-192, 2011.
ABDULGHANI, F. A.; ABDULLAH, N. A. Z. A Survey on Arabic Text Classification Using Deep and Machine Learning Algorithms. Iraqi Journal of Science, 63, n. 1, p. 409-419, 2022.
ABU DOUSH, I.; ALKHATEEB, F.; ALBSOUL, A. AraDaisy: A system for automatic generation of Arabic DAISY books. International Journal of Computer Applications in Technology, 55, n. 4, p. 322-333, 2017 2017.
AKHADAM, I.; AYYAD, H., 2024, Enhancing Arabic Text Classification: A Comparative Study of Machine Learning and Deep Learning Approaches. 1-6.
AL-DEBSI, R.; ELNAGAR, A.; EINEA, O. NADiA: News Articles Dataset in Arabic for Multi-Label Text Categorization. DATA, M. 2019.
AL-DIHAYMAWEE, D. T. M.; MERZAH, A. A.; ABDUL RIDHA, H. M. The Story of Arabic Language: Historical Linguistics Study. Tasnim International Journal for Human, Social and Legal Sciences, 3, n. 1, p. 572-582, 2024.
AL-QEREM, A.; RAJA, M.; TAQATQA, S.; SARA, M. Utilizing Deep Learning Models (RNN, LSTM, CNN-LSTM, and Bi-LSTM) for Arabic Text Classification. In, 2024. p. 287-301.
AL-SALEMI, B.; AYOB, M.; KENDALL, G.; NOAH, S. A. M. Multi-label Arabic text categorization: A benchmark and baseline comparison of multi-label learning algorithms. Information Processing & Management, 56, n. 1, p. 212-227, 2019/01/01/ 2019.
AL-SBOU, A. M. F. A Survey of Arabic Text Classification Models. 2018, 8, n. 6, p. 4, 2018-12-01 2018. arabic language processing, arabic text categorization; arabic text mining, classification algorithms, clustering algorithms, natural languages processing, text classification.
ALHAWARAT, M.; ASEERI, A. O. A Superior Arabic Text Categorization Deep Model (SATCDM). IEEE Access, 8, p. 24653-24661, 2020 2020.
ALJEDANI, N.; ALOTAIBI, R.; TAILEB, M. HMATC: Hierarchical multi-label Arabic text classification model using machine learning. Egyptian Informatics Journal, 22, n. 3, p. 225-237, 2021 2021.
ALMUZAINI, H. A.; AZMI, A. M. Impact of Stemming and Word Embedding on Deep Learning-Based Arabic Text Categorization. IEEE Access, 8, p. 127913-127928, 2020 2020.
ALSUKHNI, B., 2021, Multi-Label Arabic Text Classification Based On Deep Learning. 475-477.
ANOUAL, E. K.; ZEROUAL, I. The effects of Pre-Processing Techniques on Arabic Text Classification. International Journal of Advanced Trends in Computer Science and Engineering, 10, p. 41-48, 2021/02// 2021.
AYADI, R.; MARAOUI, M.; ZRIGUI, M. A Survey of Arabic Text Representation and Classification Methods. Res. Comput. Sci., 117, n. 1, p. 51-62, 2016.
BAHBIB, M.; YAKHLEF, M., 2024, Effects of applying stemmers with word representation on Arabic text classification performance using deep learning methods. 1-6.
BDEIR, A. M.; IBRAHIM, F., 2020, A Framework for Arabic Tweets Multi-label Classification Using Word Embedding and Neural Networks Algorithms. New York, NY, USA: Association for Computing Machinery. 105-112. Disponível em: https://doi.org/10.1145/3404512.3404526.
BINIZ, M. DataSet for Arabic Classification. DATA, M. 2018.
BINIZ, M.; BOUKIL, S.; ADNANI, F.; CHERRAT, L. et al. Arabic Text Classification Using Deep Learning Technics. International Journal of Grid and Distributed Computing, 11, p. 103-114, 2018/09// 2018.
BOUCHIHA, D.; BOUZIANE, A.; DOUMI, N. Machine Learning for Arabic Text Classification: A Comparative Study. Malaysian Journal of Science and Advanced Technology, 2, p. 163-173, 2022/12// 2022.
BOUCHIHA, D.; BOUZIANE, A.; DOUMI, N.; BERBOUCHI, O. F. et al., 2024, WiHArD: Wikipedia Based Hierarchical Arabic Dataset for Text Classification. 115-118.
CESA-BIANCHI, N.; GENTILE, C.; LUCA, Z. Incremental Algorithms for Hierarchical Classification. Advances in neural information processing systems, 7, n. 2, p. 31-54, 2006.
CHOUIGUI, A.; BEN KHIROUN, O.; ELAYEB, B., 2017, ANT Corpus: An Arabic News Text Collection for Textual Classification. 135-142.
DEVLIN, J.; CHANG, M.-W.; LEE, K.; TOUTANOVA, K., 2019, Minneapolis, Minnesota. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Association for Computational Linguistics. 4171–4186. Disponível em: https://aclanthology.org/N19-1423.
EINEA, O.; ELNAGAR, A.; AL DEBSI, R. SANAD: Single-label Arabic News Articles Dataset for automatic text categorization. Data in Brief, 25, p. 104076, 2019/08/01/ 2019.
EL-ALAMI, F.-Z.; EL MAHDAOUY, A.; EL ALAOUI, S. O.; EN-NAHNAHI, N. A DEEP AUTOENCODER-BASED REPRESENTATION FOR ARABIC TEXT CATEGORIZATION. Journal of Information and Communication Technology, 19, n. 3, p. 381-398, 2020/06/11/ 2020.
EL RIFAI, H.; AL QADI, L.; ELNAGAR, A., 2021, Cairo, Egypt. Arabic Multi-label Text Classification of News Articles. Springer International Publishing. 431-444. Disponível em: https://link.springer.com/chapter/10.1007/978-3-030-69717-4_41.
EL RIFAI, H.; AL QADI, L.; ELNAGAR, A. Arabic text classification: the need for multi-labeling systems. Neural Computing and Applications, 34, n. 2, p. 1135-1159, 2022/01/01/ 2022.
ELGHANNAM, F. Multi-Label Annotation and Classification of Arabic Texts Based on Extracted Seed Keyphrases and Bi-Gram Alphabet Feed Forward Neural Networks Model. ACM Trans. Asian Low-Resour. Lang. Inf. Process., 22, n. 1, 2022/11// 2022.
ELNAGAR, A.; AL-DEBSI, R.; EINEA, O. Arabic text classification using deep learning models. Information Processing & Management, 57, n. 1, p. 102121, 2020 2020.
FERHAT, Z.; BETKA, A.; BARKA, R.; KAHHOUL, Z. et al., 2024, Bangkok, Thailand. Functional Text Dimensions for Arabic Text Classification. Bangkok, Thailand: Association for Computational Linguistics. 352-360. Disponível em: https://aclanthology.org/2024.arabicnlp-1.29.
GALAL, M. M.; MADBOULY, M. M.; EL-ZOGHBY, A. CLASSIFYING ARABIC TEXT USING DEEP LEARNING. Journal of Theoretical and Applied Information Technology, 97, n. 23, p. 3412-3422, 2019 2019.
HAMZAOUI, B.; BOUCHIHA, D.; BOUZIANE, A.; DOUMI, N. BERT-BiLSTM model for hierarchical Arabic text classification. Indonesian Journal of Electrical Engineering and Informatics (IJEEI), 12, 2024/09// 2024.
HOWARD, J.; RUDER, S., 2018, Melbourne, Australia. Universal Language Model Fine-tuning for Text Classification. Association for Computational Linguistics. 328–339. Disponível em: https://aclanthology.org/P18-1031.
JAMALEDDYN, I.; AYACHI, R.; BINIZ, M. Novel Multichannel Deep Learning Model for Arabic News Classification. Jordanian Journal of Computers and Information Technology, p. 1, 2024/01// 2024.
KANAN, T.; ABEDALGHAFER, A.; KANAAN, G. G.; ALSHALABI, R. et al., 2021, Arabic Text Categorization: A Comparison Survey. 739-742.
KANELLOPOULOS, D.; KOTSIANTIS, S. B.; PINTELAS, P. E. Data preprocessing for supervised learning. International Journal of Computer, Electrical, Automation, Control and Information Engineering, 1, n. 12, p. 234-245, 2007 2007.
KHELIL, H. F.; IBRAHIM, M. F.; HUSSEIN, H. A. Classifications of Arabic Customer Reviews Using Stemming and Deep Learning. Indonesian Journal of Electrical Engineering and Informatics (IJEEI), 12, n. 3, p. 489-502, 2024 2024.
LE, Q.; MIKOLOV, T. Distributed representations of sentences and documents. In: Proceedings of the 31st International Conference on International Conference on Machine Learning - Volume 32, 2014, Beijing, China. JMLR.org, p. II–1188–II–1196.
LIU, Y.; OTT, M.; GOYAL, N.; DU, J. et al. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692, 364, 2019 2019.
LOUAIL, M.; HAMDI-CHERIF, C. K.-M.; HAMDI-CHERIF, A. Tasneef: A Fast and Effective Hybrid Representation Approach for Arabic Text Classification. IEEE Access, 2024 2024.
MASADEH, M.; MOUSTAPHA, A.; SHARADA, B.; HANUMANTHAPPA, J. et al. Investigating the Impact of Preprocessing Techniques and Representation Models on Arabic Text Classification Using Machine Learning. International Journal of Advanced Computer Science and Applications, 15, p. 1-9, 2024/01// 2024.
MESLEH, A. M. D. A. Chi Square Feature Extraction Based Svms Arabic Language Text Categorization System. Journal of Computer Science, 3, n. 6, p. 430-435, 2007/06// 2007.
MIKOLOV, T.; GRAVE, E.; BOJANOWSKI, P.; PUHRSCH, C. et al., 2018, Miyazaki, Japan. Advances in pre-training distributed word representations. European Language Resources Association (ELRA). Disponível em: https://aclanthology.org/L18-1008.
MIKOLOV, T.; SUTSKEVER, I.; CHEN, K.; CORRADO, G. S. et al. Distributed representations of words and phrases and their compositionality. In: Proceedings of the 26th International Conference on Neural Information Processing Systems - Volume 2, 2013, Lake Tahoe, Nevada. Curran Associates Inc., p. 3111–3119.
MOHAMMAD, A. H. Arabic text classification: A review. Modern Applied Science, 13, n. 5, p. 1-88, 2019.
MUAAD, A. Y.; KUMAR, G. H.; HANUMANTHAPPA, J.; BENIFA, J. V. B. et al. An effective approach for Arabic document classification using machine learning. Global Transitions Proceedings, 3, n. 1, p. 267-271, 2022 2022.
PENNINGTON, J.; SOCHER, R.; MANNING, C. D., 2014, Doha, Qatar. Glove: Global vectors for word representation. Association for Computational Linguistics. 1532-1543. Disponível em: https://aclanthology.org/D14-1162.
RADFORD, A.; NARASIMHAN, K.; SALIMANS, T.; SUTSKEVER, I. Improving Language Understanding by Generative Pre-Training. OpenAI: 2018. 2018.
SAAD, M.; ASHOUR, W. M., 2010, OSAC: Open Source Arabic Corpora.
SABRI, T.; BAHASSINE, S.; EL BEGGAR, O.; KISSI, M. An improved Arabic text classification method using word embedding. International Journal of Electrical & Computer Engineering (2088-8708), 14, n. 1, 2024 2024.
SABRI, T.; BEGGAR, O. E.; KISSI, M. Comparative study of Arabic text classification using feature vectorization methods. Procedia Computer Science, 198, p. 269-275, 2022/01/01/ 2022.
SAYED, M.; SALEM, R. K.; KHDER, A. E. A survey of Arabic text classification approaches. International Journal of Computer Applications in Technology, 59, n. 3, p. 236-251, 2019 2019.
SELAB, E.; GUESSOUM, A. Building TALAA, a Free General and Categorized Arabic Corpus. In: Proceedings of the International Conference on Agents and Artificial Intelligence - Volume 1, 2015, Lisbon, Portugal. SCITEPRESS - Science and Technology Publications, Lda, p. 284–291. DOI: 10.5220/0005352102840291. Disponível em: https://doi.org/10.5220/0005352102840291.
SETU, J. H.; HALDER, N.; SIKDER, S.; ISLAM, A. et al., 2024, Empowering Multiclass Classification and Data Augmentation of Arabic News Articles Through Transformer Model. 1-7.
TSOUMAKAS, G.; KATAKIS, I.; VLAHAVAS, I. Mining Multi-label Data. In: MAIMON, O. e ROKACH, L. (Ed.). Data mining and knowledge discovery handbook. Boston, MA: Springer US, 2009. p. 667-685.
VASWANI, A.; SHAZEER, N.; PARMAR, N.; USZKOREIT, J. et al. Attention is all you need. In: Proceedings of the 31st International Conference on Neural Information Processing Systems, 2017, Long Beach, California, USA. Curran Associates Inc., p. 6000–6010. Disponível em: https://dl.acm.org/doi/10.5555/3295222.3295349.
WAHDAN, A.; AL-EMRAN, M.; SHAALAN, K. A systematic review of Arabic text classification: areas, applications, and future directions. Soft Computing, 28, n. 2, p. 1545-1566, 2024 2024.
ZHU, S.; JI, X.; XU, W.; GONG, Y. Multi-labelled classification using maximum entropy method. In: Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, 2005, Salvador, Brazil. Association for Computing Machinery, p. 274–281. DOI: 10.1145/1076034.1076082. Disponível em: https://doi.org/10.1145/1076034.1076082.
