JBT Journal
Advanced

Raqamli Transformatsiya va Sun’iy Intellekt

O‘ZBEK TILIDAGI ELEKTRON MATNLARNING SEMANTIK XUSUSIYATLARINI CHUQUR IFODALASHNING KO‘P BOSQICHLI KONSEPTUAL MODELI

Karaxanova Shirin Azizjon qizi1

1 Muhammad al-Xorazmiy nomidagi Toshkent axborot texnologiyalari universiteti

Zenodo DOI: 10.5281/zenodo.23996105

Keywords

semantik tahlil gibrid neyron tarmoq BPE Sentiment tahlil tabiiy tilni qayta ishlash BiLSTM o‘zbek tili tematik tasniflash CNN matnni normallashtirish

Abstract

Maqolada o‘zbek tilidagi elektron matnlarning semantik xususiyatlarini chuqur ifodalash maqsadida tematik va sentiment tahlil vazifalarini ketma-ket hamda o‘zaro uzviy bog‘liq holda bajaruvchi ko‘p bosqichli konseptual model taklif etilgan. Modelning matematik asosi matnni uzluksiz semantik fazodagi chiziqli bo‘lmagan trayektoriya sifatida qarashga, semantik fazoni esa tematik va sentiment ko‘pxilliklarining ko‘paytmasi ko‘rinishida ifodalashga tayanadi. Modelni amalga oshirish uchun CNN va BiLSTM arxitekturalarini birlashtirgan gibrid neyron tarmoq ishlab chiqilgan: CNN lokal n-gramm xususiyatlarini ajratadi, BiLSTM ikki yo‘nalishli kontekstni modellashtiradi, yakuniy qatlamda sentiment sinflari uchun Softmax, ko‘p yorliqli tematik tasniflash uchun esa sigmoid funksiyasi qo‘llaniladi. Lotin, kirill va yangi lotin alifbosidagi yozuvlarni yagona shaklga keltiruvchi idempotent normallashtirish operatori ishlab chiqilgan. Tajribalarda normallashtirishsiz berilgan kirill yozuvidagi matnlarda aniqlik 53–80% ga pasayishi, operator qo‘llanilganda esa sifat yo‘qotilmasligi aniqlandi; BPE tokenizatsiyasi sharoitida stop-so‘zlarni olib tashlash va lemmatizatsiya aniqlikni sezilarli oshirmadi. Taklif etilgan yondashuv klassik TF-IDF usulidan yuqori, Transformer modellari bilan teng F1-score hamda yozuv tizimi o‘zgarishiga nisbatan barqarorlikni namoyish etadi.

Views: 55 Published: 2026-10-28 Pages: 124-136 Volume: 4 Issue: 5-Special-Issues

References

  1. Sokolova M., Lapalme G. A systematic analysis of performance measures for classification tasks // Information Processing & Management. – 2009. – Vol. 45, No. 4. – P. 427–437.
  2. Liu B. Sentiment Analysis and Opinion Mining. – San Rafael: Morgan & Claypool Publishers, 2012. – 167 p.
  3. Smith L.N., Topin N. Super-convergence: Very fast training of neural networks using large learning rates // arXiv:1708.07120. – 2017.
  4. Tahrirchi. tahrirchi-bert-base: pretrained BERT model for the Uzbek language [Electronic resource]. – Hugging Face. – URL: https://huggingface.co/tahrirchi/tahrirchi-bert-base
  5. Conneau A., Khandelwal K., Goyal N., et al. Unsupervised cross-lingual representation learning at scale // Proceedings of ACL 2020. – 2020. – P. 8440–8451.
  6. Bojanowski P., Grave E., Joulin A., Mikolov T. Enriching word vectors with subword information // Transactions of the Association for Computational Linguistics. – 2017. – Vol. 5. – P. 135–146.
  7. Kuriyozov E., Matlatipov S., Alonso M.A., Gómez-Rodríguez C. Construction and evaluation of sentiment datasets for low-resource languages: The case of Uzbek // Human Language Technology. Challenges for Computer Science and Linguistics (LTC 2019). – Cham: Springer, 2020. – P. 232–243.
  8. Pang B., Lee L. Opinion mining and sentiment analysis // Foundations and Trends in Information Retrieval. – 2008. – Vol. 2, No. 1–2. – P. 1–135.
  9. Rabbimov I., Mporas I., Simaki V., Kobilov S. Investigating the effect of emoji in opinion classification of Uzbek movie review comments // Speech and Computer (SPECOM 2020), LNCS 12335. – Cham: Springer, 2020. – P. 435–445.
  10. Ba J.L., Kiros J.R., Hinton G.E. Layer normalization // arXiv:1607.06450. – 2016.
  11. Schuster M., Paliwal K.K. Bidirectional recurrent neural networks // IEEE Transactions on Signal Processing. – 1997. – Vol. 45, No. 11. – P. 2673–2681.
  12. Zhang X., Zhao J., LeCun Y. Character-level convolutional networks for text classification // Advances in Neural Information Processing Systems 28 (NIPS 2015). – 2015. – P. 649–657.
  13. Lai S., Xu L., Liu K., Zhao J. Recurrent convolutional neural networks for text classification // Proceedings of the 29th AAAI Conference on Artificial Intelligence. – 2015. – P. 2267–2273.
  14. Devlin J., Chang M.-W., Lee K., Toutanova K. BERT: Pre-training of deep bidirectional transformers for language understanding // Proceedings of NAACL-HLT 2019. – 2019. – P. 4171–4186.
  15. Kudo T., Richardson J. SentencePiece: A simple and language independent subword tokenizer and detokenizer for neural text processing // Proceedings of EMNLP 2018: System Demonstrations. – 2018. – P. 66–71.
  16. Loshchilov I., Hutter F. Decoupled weight decay regularization // International Conference on Learning Representations (ICLR 2019). – 2019.
  17. Kim Y. Convolutional neural networks for sentence classification // Proceedings of EMNLP 2014. – 2014. – P. 1746–1751.
  18. Sennrich R., Haddow B., Birch A. Neural machine translation of rare words with subword units // Proceedings of ACL 2016. – 2016. – P. 1715–1725.
  19. Kingma D.P., Ba J. Adam: A method for stochastic optimization // International Conference on Learning Representations (ICLR 2015). – 2015.
  20. Zhou C., Sun C., Liu Z., Lau F. A C-LSTM neural network for text classification // arXiv:1511.08630. – 2015.
  21. Salaev U., Kuriyozov E., Gómez-Rodríguez C. A machine transliteration tool between Uzbek alphabets // arXiv:2205.09578. – 2022.
  22. Rabbimov I.M., Kobilov S.S. Multi-class text classification of Uzbek news articles using machine learning // Journal of Physics: Conference Series. – 2020. – Vol. 1546. – Art. 012097.
  23. Mikolov T., Chen K., Corrado G., Dean J. Efficient estimation of word representations in vector space // arXiv:1301.3781. – 2013.
  24. Hochreiter S., Schmidhuber J. Long short-term memory // Neural Computation. – 1997. – Vol. 9, No. 8. – P. 1735–1780.
  25. Vaswani A., Shazeer N., Parmar N., Uszkoreit J., Jones L., Gomez A.N., Kaiser Ł., Polosukhin I. Attention is all you need // Advances in Neural Information Processing Systems 30 (NeurIPS 2017). – 2017. – P. 5998–6008.
  26. Salton G., Buckley C. Term-weighting approaches in automatic text retrieval // Information Processing & Management. – 1988. – Vol. 24, No. 5. – P. 513–523.