The accelerating growth of unstructured textual data across scientific, social, medical, and technological domains has created an unprecedented demand for intelligent systems capable of extracting meaningful, concise, and semantically rich information. Among these tasks, keyword extraction and semantic similarity modeling occupy a central role because they directly enable indexing, retrieval, sentiment analysis, document classification, question answering, and automated knowledge generation. Despite decades of research, the complexity of language, the heterogeneity of domains, and the short and noisy nature of many modern texts continue to challenge both classical and neural approaches. This study develops a comprehensive, integrative research framework that synthesizes classical keyword extraction algorithms, text similarity metrics, and state-of-the-art deep learning architectures to advance the theoretical and empirical understanding of automated semantic intelligence. Drawing strictly upon the referenced literature, this work connects statistical, graph-based, rule-based, and transformer-based approaches into a unified conceptual ecosystem.

The paper begins by positioning keyword extraction as a foundational problem in natural language engineering, grounded in issues of domain specificity, semantic ambiguity, and linguistic variability, as elaborated by Firoozeh et al. (2020) and Miah et al. (2021). Classical unsupervised techniques such as RAKE, SOBEK, and TextRank are explored not merely as algorithms but as epistemic devices that encode assumptions about term relevance, co-occurrence, and discourse structure (Huang et al., 2020; Reategui et al., 2022; Huang & Xie, 2021). These methods are then contrasted with modern deep learning paradigms such as BERT-based architectures and transformer-driven neural taggers, which model language through contextual embeddings and attention mechanisms that capture long-range semantic dependencies (Tang et al., 2019; Martinc et al., 2021).

A central theoretical contribution of this study is the articulation of text similarity as the conceptual bridge between keyword extraction, sentiment analysis, and semantic understanding. By integrating similarity measures such as Jaccard, embedding-based similarity, and semantic alignment, the article demonstrates how relevance, polarity, and conceptual cohesion can be modeled in a single analytical framework (Fernando & Herath, 2021; Mohler et al., 2011; Amur et al., 2023). The methodological section proposes a hybrid pipeline in which neural models generate contextual representations, while symbolic and statistical methods refine and validate extracted keywords against domain knowledge and prior public information (Huang & Xie, 2021; Jain et al., 2022).

The results are described through an extensive comparative analysis of how classical, hybrid, and deep learning approaches perform across domains such as scientific literature, social media, and biomedical texts. The findings show that deep neural architectures excel in capturing semantic nuance, while hybrid methods grounded in similarity metrics and domain knowledge improve precision, interpretability, and robustness to noise (Dang et al., 2020; Imran et al., 2020; Blake & Mangiameli, 2011). The discussion critically examines the implications of these findings for automated question generation, sentiment detection, and knowledge extraction in complex domains such as healthcare and education (Gilal et al., 2022; Alaggio et al., 2022).

By offering an integrated, theory-driven synthesis of keyword extraction, semantic similarity, and deep learning, this article contributes a comprehensive foundation for future research and applied systems. It argues that the future of text analytics lies not in the dominance of any single algorithmic paradigm, but in the strategic orchestration of symbolic, statistical, and neural intelligence into adaptive, explainable, and domain-aware semantic engines.

Keyword extraction, semantic similarity, deep learning, text mining

Alaggio, R.; Amador, C.; Anagnostopoulos, I.; Attygalle, A.D.; Araujo, I.B.D.O.; Berti, E.; Bhagat, G.; Borges, A.M.; Boyer, D.; Calaminici, M.; et al. The 5th edition of the World Health Organization Classification of Haematolymphoid Tumours: Lymphoid Neoplasms. Leukemia 2022, 36, 1720–1748.

Amur, Z.H.; Hooi, Y.K.; Bhanbhro, H.; Dahri, K.; Soomro, G.M. Short-Text Semantic Similarity (STSS): Techniques, Challenges and Future Perspectives. Applied Sciences 2023, 13, 3911.

Blake, R.; Mangiameli, P. The effects and interactions of data quality and problem complexity on classification. Journal of Data and Information Quality 2011, 2, 1–28.

Dang, N.C.; Moreno-García, M.N.; De La Prieta, F. Sentiment analysis based on deep learning: A comparative study. Electronics 2020, 9, 483.

Fernando, B.; Herath, S. Anticipating human actions by correlating past with the future with Jaccard similarity measures. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA, 20–25 June 2021; pp. 13219–13228.

Firoozeh, N.; Nazarenko, A.; Alizon, F.; Daille, B.J. Keyword extraction: Issues and methods. Natural Language Engineering 2020, 26, 259–291.

Gilal, A.R.; Waqas, A.; Talpur, B.A.; Abro, R.A.; Jaafar, J.; Amur, Z.H. In Question Guru: An Automated Multiple-Choice Question Generation System. In Proceedings of the 2nd International Conference on Emerging Technologies and Intelligent Systems, ICETIS 2022, Online, 2–3 September 2022; Volume 2, pp. 501–514.

Huang, H.; Wang, X.; Wang, H. NER-RAKE: An improved rapid automatic keyword extraction method for scientific literatures based on named entity recognition. Proceedings of the Association for Information Science and Technology 2020, 57, e374.

Huang, Z.; Xie, Z. A patent keywords extraction method using TextRank model with prior public knowledge. Complex & Intelligent Systems 2021, 8, 1–12.

Imran, A.S.; Daudpota, S.M.; Kastrati, Z.; Bhatra, R. Cross-cultural polarity and emotion detection using sentiment analysis and deep learning on COVID-19 related tweets. IEEE Access 2020, 8, 181074–181090.

Jain, P.K.; Quamer, W.; Pamula, R.; Saravanan, V. Employing BERT-DCNN with semantic knowledge base for social media sentiment analysis. Journal of Ambient Intelligence and Humanized Computing 2022.

Martinc, M.; Škrlj, B.; Pollak, S. TNT-KID: Transformer-based neural tagger for keyword identification. Natural Language Engineering 2021, 28, 409–448.

Miah, M.S.U.; Sulaiman, J.; Bin Sarwar, T.; Zamli, K.Z.; Jose, R. Study of keyword extraction techniques for electric double-layer capacitor domain using text similarity indexes: An experimental analysis. Complexity 2021, 2021, 8192320.

Mohler, M.; Bunescu, R.; Mihalcea, R. Learning to grade short answer questions using semantic similarity measures and dependency graph alignments. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Portland, OR, USA, 19–24 June 2011; pp. 752–762.

Reategui, E.; Bigolin, M.; Carniato, M.; dos Santos, R.A. Evaluating the Performance of SOBEK Text Mining Keyword Extraction Algorithm. In Proceedings of the Machine Learning and Knowledge Extraction: 6th IFIP TC 5, TC 12, WG 8.4, WG 8.9, WG 12.9 International Cross-Domain Conference, CD-MAKE 2022, Vienna, Austria, 23–26 August 2022; pp. 233–243.

Tang, M.; Gandhi, P.; Kabir, M. Progress notes classification and keyword extraction using attention-based deep learning models with BERT. arXiv 2019, arXiv:1910.05786.