Signmatics: An Interactive Digital Based System for Multimodal Learning of Hearing Students in Bulgarian Sign Language
DOI:
https://doi.org/10.23947/2334-8496-2025-13-1-117-125Keywords:
signmatics, digital based system, multimodal learning, Bulgarian Sign LanguageAbstract
The proposed scientific text describes an experimental study, the purpose of which is prioritized to test an interactive digitally based system Signmatics for mastering linguistic content in Bulgarian Sign Language (BGSL) by students who study it as a second language (E2). The formed sample includes 62 participants –- students studying in a bachelor’s program in the specialty of Special Education. The study uses a quasi-experimental design of non-equivalent groups: an experimental group of 30 students (48.39%) which was subjected to the digitally based intervention and a control group of 32 students (51.61%), trained in conventional ways. The verification of receptive and expressive language skills in BGSL at the level of phonetics, vocabulary and morphosyntax was carried out by applying a standardized language test, decomposed into 3 subtests. The comparative approach to the results of the study convincingly shows that the interactive Signmatics system applied in a real time frame has a high efficiency coefficient in mastering the visual language at the level of vocabulary (F=26.574, p<0.000), morphosyntax (F=1.423, p<0.001). At the phonetic level, no statistically significant difference was found between the two groups (F=0.001, p=0.971), an explanation for which can be sought in the specificity of the visual phonemes, as building blocks of the sign. The latter finding suggests the idea of maintaining continuity between modern digital technologies and traditional strategies for teaching and learning linguistic material which have stood the test of time.
Downloads
References
Adam, R. & Braithwaite, B. (2022). Geographies and circulations: Sign language contact at the peripheries. Journal of Sociolinguistics, 26, 99-104. https://doi.org/10.1111/josl.12521 DOI: https://doi.org/10.1111/josl.12521
Angelova, Ts. (2017). Psychosocial situation of development of students with sensory and motor disabilities in the general and special education. International journal Knowledge, 20(4), 1963-1969.
Aran, O., Ari, I., Benoit, A., Campr, P., Carrillo, A. H, Fanard, F-X., Akarun, L., Caplier, A., Rombaut, M., & Sankur, B. (2009). Sign Tutor: An Interactive System for Sign Language Tutoring. IEEE MultiMedia, 16 (1), 81-93. https://academics.boun.edu.tr/bulent.sankur/sites/bulent.sankur/files/inline-files/Jour_Aran_Sign%20Tutor_IEEE-MM.pdf DOI: https://doi.org/10.1109/MMUL.2009.17
Ackovska, N., Kostoska, M., & Gjuroski, M. (2012). Sign Language Tutor – Digital improvement for people who are deaf and hard of hearing. ICT Innovatons Conference Web Proceedings. 103–112. https://proceedings.ictinnovations.org/2012/paper/42/sign-language-tutor---digital-improvement-for-people-who-are-deaf-and-hard-of-hearing
Balkanska, N. (2013). Practical aspects of language therapy in hearing children (Author’s method for acquiring prepositions). Annual of Konstantin Preslavski University, Faculty of Education, 17 D, 391-396. https://www.shu.bg/wp-content/uploads/file-manager-advanced/users/faculties/pf/izdaniya/godishnici/God_na_PF_2013.pdf
Balkanska, N., & Lozanova, S. (2021). Methodological guide for teaching Bulgarian sign language in preschool and primary school age. Sign language and bilingualism, 1, 26-84 https://journal.deafstudiesinstitute.bg/archive/
Beal, J. (2020). University American Sign Language (ASL) Second Language Learners: Receptive and Expresive ASL Perfomance. Journal of Interpretation, 28(1), 1-28. https://digitalcommons.unf.edu/joi/vol28/iss1/1
De Villiers, H. A. C. (2014). A Vision-based South African Sign Language Tutor. Dissertation: PhD. of Philosophy in the Faculty of Engineering at Stellenbosch University. https://core.ac.uk/download/pdf/37421343.pdf
Dermendzhieva, S. H., & Tsankov, N. (2022). Transgressive Core of Multi-Modal Education. International Journal of Cognitive Research in Science, Engineering and Education (IJCRSEE), 10(3), 167–175. https://doi.org/10.23947/2334-8496-2022-10-3-167-175 DOI: https://doi.org/10.23947/2334-8496-2022-10-3-167-175
Dermendjieva, S. H., & Tsankov, N. (2023). Designing a Multimodal Environment for Cognitive and Creative Activity in Pre-School Education – Competence of the Teacher. International Journal of Cognitive Research in Science, Engineering and Education (IJCRSEE), 11(2), 351–358. https://doi.org/10.23947/2334-8496-2023-11-2-351-358 DOI: https://doi.org/10.23947/2334-8496-2023-11-2-351-358
Dimich, N., & Sesum, M. (2011). Sign language – the basic way of communication for the deaf. Belgrade Special Needs School, 17(1), 13-41. https://www.belgradeschool.com/uploads/4/6/5/1/46514917/bds_1_2011_final.pdf
Fenlon, J., Denmark, T., Campbell, R., & Woll, B. (2007). Seeing sentence boundaries. Sign Language and Linguistics, 10(2), 177-200. https://www.researchgate.net/publication/233562191 DOI: https://doi.org/10.1075/sll.10.2.06fen
Joy, J., Kannan, B., & Sreeraj, M. (2019). SiLearn: an intelligent sign vocabulary learning tool. Journal of Enabling Technologies, 13(3), 173-187. https://doi.org/10.1108/JET-03-2019-0014 DOI: https://doi.org/10.1108/JET-03-2019-0014
Kusters, A. (2020). The tipping point: On the use of signs from American Sign Language in International Sign. Language & Communication, 75, 51-68. https://doi.org/10.1016/j.langcom.2020.06.004 DOI: https://doi.org/10.1016/j.langcom.2020.06.004
Lozanova, S., & Stoyanova, Iv. (2022). Creating a sign dictionary to support communication with deaf people in crisis situations, Special Pedagogy and Speech Therapy, 5(1), 51-64. https://fnoi.uni-sofia.bg/magazine/index.php/special-edu_language-therapy/issue/view/27
Papadimitriou, K., Potamianos, G., Sapountzaki, G., Goulas, T., Efthimiou, E., Fotinea, S. E., & Maragos, P. (2025). Greek sign language recognition for an education platform. Universal Access in the Information Society, 24(1), 51-68. https://doi.org/10.1007/s10209-023-01017-7 DOI: https://doi.org/10.1007/s10209-023-01017-7
Quandt, L. C., Lamberton, J., Willis, A.S., Wang, J. Weeks, K., Kubicek, E., Malzkuhn, M. (2020). Teaching ASL Signs using Signing Avatars and Immersive Learning in Virtual Reality. In Proceedings of the 22nd International ACM SIGACCESS Conference, on Computers and Accessibility, 1-4. https://www.researchgate.net/publication/345391930_Teaching_ASL_Signs_using_Signing_Avatars_and_Immersive_Learning_in_Virtual_Reality DOI: https://doi.org/10.1145/3373625.3418042
Schmidt, R. (1992). Awareness and second language acquisition. Annual review of applied linguistics, 13, 206-226. https://doi.org/10.1017/S0267190500002476 DOI: https://doi.org/10.1017/S0267190500002476
Tsankov N., & Levunlieva M. (2024). Designing Digital Multimodal Resources for the Kindergarten: From Intuition to Awareness. International Journal of Cognitive Research in Science, Engineering and Education (IJCRSEE), 12(3), 657-667. https://doi.org/10.23947/2334-8496-2024-12-3-657-667 DOI: https://doi.org/10.23947/2334-8496-2024-12-3-657-667
Tsankov, N. S. & Dermendzhieva, S. H. (2024). Designing Digital Resources for Multimodal Composition in the Kindergarten Environment. International Journal of Cognitive Research in Science, Engineering and Education (IJCRSEE), 12(2), 489-496. https://doi.org/10.23947/2334-8496-2024-12-2-489-496 DOI: https://doi.org/10.23947/2334-8496-2024-12-2-489-496
Vijitkunsawat, W., Rachark, T., Nguyen, CH., & Minh, N. (2023). Video-Based Sign Language Digit Recognition for the Thai Language: A New Dataset and Method Comparisons. The 12th International Conference on Pattern Recognition Applications and Methods Proceedings, 775-782. https://www.scitepress.org/Papers/2023/116437/116437.pdf DOI: https://doi.org/10.5220/0011643700003411
Published
How to Cite
Issue
Section
Categories
License
Copyright (c) 2025 Diyana Georgieva

This work is licensed under a Creative Commons Attribution 4.0 International License.
Metrics
Plaudit
Accepted 2025-04-12
Published 2025-04-29