Project #04

Natural Language to Sign Language Translator (Virtual Interpreter)

  • ExpressJS
  • NodeJS
  • MySQL
  • JavaScript
  • NextJS

Development of an ExpressJS API to interpret Colombian sign language based on artificial intelligence using GPT-4 and the OpenAI API.

Project highlights

  1. Context-Aware Translation: The system does not simply translate words individually but analyzes entire sentences to maintain proper grammatical structure in sign language. It handles idiomatic expressions by translating the underlying meaning rather than literal words.

  2. Customizable Avatar System: The interpreter avatar can be customized for gender, age, and appearance to create a more comfortable and personalized experience for users. Different signing speeds are available to accommodate both beginners and fluent signers.

  3. Educational Mode: Beyond translation, the system includes an educational component that explains sign choices and provides alternative signs for certain concepts. This feature helps users learn sign language while using the translation tool.

01 / 01