ChatGPT, Let us Chat Sign Language: Experiments, Architectural Elements, Challenges and Research Directions
2023 International Symposium on Networks, Computers and Communications (ISNCC)(2024)
摘要
ChatGPT is a language model based on Generative AI. Existing research work on
ChatGPT focused on its use in various domains. However, its potential for Sign
Language Translation (SLT) is yet to be explored. This paper addresses this
void. Therefore, we present GPT's evolution aiming a retrospective analysis of
the improvements to its architecture for SLT. We explore ChatGPT's capabilities
in translating different sign languages in paving the way to better
accessibility for deaf and hard-of-hearing community. Our experimental results
indicate that ChatGPT can accurately translate from English to American (ASL),
Australian (AUSLAN), and British (BSL) sign languages and from Arabic Sign
Language (ArSL) to English with only one prompt iteration. However, the model
failed to translate from Arabic to ArSL and ASL, AUSLAN, and BSL to Arabic.
Consequently, we present challenges and derive insights for future research
directions.
更多查看译文
关键词
AI,ChatGPT,Decoder,Encoder,NLP,Sign Language Translation,Transformer
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要