Signlingo is a web app that gamifies the process of learning American Sign Language (ASL). Inspired by the need for accessible, engaging language-learning tools for the Deaf and hard-of-hearing communities, Signlingo provides bite-sized lessons, real-time gesture recognition, and progress tracking. The app allows users to practice ASL in a fun and interactive way, with personalized learning paths that adapt to the user's skill level.
- Bite-sized Lessons: Learn ASL vocabulary through quick, manageable lessons.
- Real-Time Gesture Recognition: AI-powered feedback on your ASL gestures.
- Progress Tracking (WIP): Monitor your progress with streaks, hearts, and a detailed progress tracker.
- Quizzes: Test your ASL knowledge with fun quizzes and challenges.
- Leaderboard: Compete with others and track your performance.
- Frontend: Next.js, React.js, TypeScript, Tailwind CSS
- Backend: Flask (API), Supabase (Authentication & Database)
- AI/ML: TensorFlow, Python (for ASL gesture recognition)
- Other: WebSockets (for real-time video streaming)
To get a local copy up and running, follow these steps:
- Node.js
- Python 3.x
- Supabase account for authentication and database setup
-
Clone the repository:
git clone cd signlingo
-
Install dependencies
npm install
cd ml python3 -m venv venv (Windows) source venv/bin/activate (Linux/MacOS) pip install -r requirements.txt
-
Setup Supabase Create a Supabase project and configure your API keys and database. Add the Supabase keys to your environment variables.
-
Run the project
npm run dev cd ml python app.py