DominiSigns is an innovative accessibility application that uses artificial intelligence to translate text and voice into Dominican sign language (LSRD) through an animated 3D avatar. Our goal is to break down communication barriers and promote the inclusion of the deaf community in the Dominican Republic.
- Text-to-Sign Translation: Converts text input into Dominican sign language animations
- Speech-to-Sign Translation: Recognizes audio and converts it to signs
- Customized 3D Avatar: Realistic avatar that performs signs with precision and fluidity
- Integrated Dictionary: Comprehensive LSRD database
- Accessible Interface: Designed following universal accessibility principles
Currently in active development phase. The project is at the following stages:
- Collection of LSRD dictionary and reference videos
- Development of text/voice processor
- Creation of base 3D avatar
- Implementation of sign animations
- Development of user interface
- Testing with the Dominican deaf community
- Frontend: React, Three.js
- Backend: Node.js, Express
- Language Processing: TensorFlow/PyTorch for NLP
- 3D Animation: Blender, Mixamo
- Generative AI: Pollinations.ai API
- Database: MongoDB
- Node.js v14 or higher
- Access to Pollinations.ai API
- Dependencies listed in package.json
# Clone the repository
git clone https://github.com/cmunozdev/dominisigns.git
cd dominisigns
# Install dependencies
npm install
# Configure environment variables
cp .env.example .env
# Edit the .env file with your API credentials
# Start the development server
npm run dev
βββββββββββββββββ
β Text/Audio β
β Input β
βββββββββ¬ββββββββ
β
βββββββββΌββββββββ
β NLP β
β Processor β
βββββββββ¬ββββββββ
β
βββββββββββββ¬ββββββββββΌβββββββββ¬ββββββββββββ
β β β β
βββββββββΌββββ βββββββΌββββββ βββββββββΌββββ βββββββΌββββββ
β Syntactic β β LSRD β β Animation β β Sign β
β Analysis β βTranslationβ β Generation β β Sequencingβ
βββββββββ¬ββββ βββββββ¬ββββββ βββββββββ¬ββββ βββββββ¬ββββββ
β β β β
βββββββββββββ΄ββββββββββ¬βββββββββ΄ββββββββββββ
β
βββββββββΌββββββββ
β 3D β
β Avatar β
βββββββββββββββββ
- Education: Support in inclusive classrooms
- Public Services: Improved accessibility in hospitals, banks, etc.
- Personal Communication: Facilitates everyday interactions
- Events and Conferences: Automatic interpretation for presentations
This project is aimed at approximately 100,000 deaf people in the Dominican Republic who use LSRD as their primary means of communication. By providing a technological tool that respects the cultural and linguistic particularities of the country, we seek to:
- Reduce communication barriers
- Promote social inclusion
- Preserve and spread Dominican sign language
- Support independence and autonomy of the deaf community
This project is licensed under the MIT License.
- National Association of the Deaf of the Dominican Republic
- Accessibility developer community
- Pollinations.ai team for their technical support
- All interpreters and collaborators who have contributed reference material