Good explanation about the sign language tracking.  Allow me to share this about a French signing chatbot I found in my RSS feed this morning. I think you'll find it intriguing:

https://www.chatbots.org/virtual_assistant/pascal/