shubham-murtadak/Anuwad-Transforming-Regional-AI-Translation

Anuwad ๐ŸŒ is an AI-powered language translation app that bridges communication across regional Indian languages ๐Ÿ‡ฎ๐Ÿ‡ณ. Converts speech to text ๐ŸŽค, translates ๐ŸŒ, and converts text back to speech ๐Ÿ”Š in real-time. Built with React โš›๏ธ, Flask ๐Ÿ, and Firebase ๐Ÿ”‘ for seamless interaction.

1

stars

52

commits

Python

primary language

Dec 28, 2024

updated

anuwad-transforming-regional-ai-translation.vercel.app

README

๐ŸŒ Anuwad: Transforming Regional AI Translation ๐Ÿค–

๐Ÿ“ Problem Statement

Language barriers limit communication across languages, affecting collaboration and access to information. Anuwad aims to solve this by:

  • Converting speech to text ๐ŸŽค
  • Translating it into different languages ๐ŸŒ
  • Converting the translated text back into speech ๐Ÿ”Š

๐Ÿ”‘ Key Features

1. Real-Time Speech Recognition ๐ŸŽง

  • Converts speech to text using Speech-to-Text (STT) ๐Ÿ“.
  • Supports various Indian languages (Hindi, Kannada, Marathi, etc.).
  • Handles diverse accents and dialects.

2. Language Translation ๐ŸŒ

  • Translates text from mentorโ€™s language to userโ€™s native language ๐Ÿ”„.
  • Uses IndicTrans2 models for accurate translations.
  • Fallback for unsupported languages ๐Ÿ› ๏ธ.

3. Text-to-Speech (TTS) ๐Ÿ— ๏ธ

  • Converts translated text back to speech using Google TTS ๐Ÿ”Š.
  • Multiple voice options for a natural-sounding output ๐ŸŽถ.

4. Bidirectional Communication ๐Ÿ”„

  • Allows communication in both languages (mentor & user).
  • Toggle feature for seamless switching ๐Ÿ”„.

5. Language Selection ๐ŸŒ

  • Users select their preferred language from a list ๐ŸŒ.
  • Automatic language detection for ease โšก.

6. User Interface (UI) ๐Ÿ–ฅ๏ธ

  • Simple, intuitive interface for users ๐Ÿ‘จโ€๐Ÿ’ป.
  • Visual cues for real-time translation and speech status ๐Ÿ‘.
  • Optimized for accessibility (large fonts, screen reader compatible) ๐Ÿ’ก.

7. Scalability & Performance ๐Ÿš€

  • Optimized for multiple users simultaneously ๐ŸŒŸ.
  • Low-latency for real-time communication โฑ๏ธ.

8. Security & Privacy ๐Ÿ”’

  • No sensitive data storage โŒ.
  • Encrypted data transmission ๐Ÿ”.

โš™๏ธ Tech Stack

  • Frontend: React.js โš›๏ธ
  • Backend: Flask ๐Ÿ
  • Authentication: Firebase Authentication ๐Ÿ”‘
  • Speech Recognition: Webkit Speech Recognition ๐ŸŽค
  • Text-to-Speech (TTS): Google TTS ๐Ÿ”Š
  • Translation: IndicTrans2 Models ๐ŸŒ

๐Ÿ–ผ Screenshot

Hereโ€™s a glimpse of the application interface:

Screenshot


๐Ÿš€ Future Enhancements

  • Offline functionality for STT & TTS ๐Ÿ›ฒ.
  • Option to save/export translated conversations ๐Ÿ’พ.
  • Integration with messaging/video platforms ๐Ÿ“ฑ๐Ÿ“ฉ.
  • Teacher-Student Platform Integration: ๐Ÿ‘จโ€๐Ÿซ
    • Teachers will be able to upload their audio lessons via a login portal.
    • Students can access lessons in their preferred language.
    • A centralized dashboard for teachers to manage uploaded content and track engagement.

Click here! ๐ŸŽฌ


Status

Implemented:

  1. Real-Time Speech Recognition:

    • Speech-to-Text (STT) implemented.
    • Supports multiple Indian languages (Hindi, Kannada, Marathi, etc.).
  2. Language Translation:

    • Text is translated from mentorโ€™s language to the userโ€™s native language.
    • Translation is handled using IndicTrans2 models.
  3. Text-to-Speech (TTS):

    • Converts translated text to speech using Google TTS.
  4. Bidirectional Communication:

    • Users can communicate in both languages (mentor & user).
    • Toggle feature to switch between languages seamlessly.
  5. Language Selection:

    • Language selection dropdown for users to choose their preferred language.
  6. User Interface (UI):

    • Simple, intuitive interface with visual cues for real-time translation and speech status.
    • Optimized for accessibility (large fonts, screen reader compatible).
  7. Backend & Frontend:

    • Backend implemented using Flask.
    • Frontend developed using React.js.
  8. Authentication Pages:

    • Firebase project created & Authentication pages completed.

Remaining Tasks:

  1. Security & Privacy:

    • Implement data encryption for secure transmission.
    • Ensure no sensitive data storage (currently pending).
  2. Teacher-Student Module Integration:

    • Develop a teacher login portal.
    • Enable video uploads for lessons.
    • Build a student interface to access lessons in their native language.
  3. Deployment on Cloud:

    • Deploy web application on Vercel Cloud Platform**.

๐Ÿ“ง Contact

For further inquiries, reach out to me at: Shubham Murtadak ~ AI Engineer ๐Ÿ“ฉ.


Contributors

shubham-murtadak/Anuwad-Transforming-Regional-AI-Translation

Anuwad ๐ŸŒ is an AI-powered language translation app that bridges communication across regional Indian languages ๐Ÿ‡ฎ๐Ÿ‡ณ. Converts speech to text ๐ŸŽค, translates ๐ŸŒ, and converts text back to speech ๐Ÿ”Š in real-time. Built with React โš›๏ธ, Flask ๐Ÿ, and Firebase ๐Ÿ”‘ for seamless interaction.

1

stars

52

commits

Python

primary language

Dec 28, 2024

updated

anuwad-transforming-regional-ai-translation.vercel.app

README

๐ŸŒ Anuwad: Transforming Regional AI Translation ๐Ÿค–

๐Ÿ“ Problem Statement

Language barriers limit communication across languages, affecting collaboration and access to information. Anuwad aims to solve this by:

  • Converting speech to text ๐ŸŽค
  • Translating it into different languages ๐ŸŒ
  • Converting the translated text back into speech ๐Ÿ”Š

๐Ÿ”‘ Key Features

1. Real-Time Speech Recognition ๐ŸŽง

  • Converts speech to text using Speech-to-Text (STT) ๐Ÿ“.
  • Supports various Indian languages (Hindi, Kannada, Marathi, etc.).
  • Handles diverse accents and dialects.

2. Language Translation ๐ŸŒ

  • Translates text from mentorโ€™s language to userโ€™s native language ๐Ÿ”„.
  • Uses IndicTrans2 models for accurate translations.
  • Fallback for unsupported languages ๐Ÿ› ๏ธ.

3. Text-to-Speech (TTS) ๐Ÿ— ๏ธ

  • Converts translated text back to speech using Google TTS ๐Ÿ”Š.
  • Multiple voice options for a natural-sounding output ๐ŸŽถ.

4. Bidirectional Communication ๐Ÿ”„

  • Allows communication in both languages (mentor & user).
  • Toggle feature for seamless switching ๐Ÿ”„.

5. Language Selection ๐ŸŒ

  • Users select their preferred language from a list ๐ŸŒ.
  • Automatic language detection for ease โšก.

6. User Interface (UI) ๐Ÿ–ฅ๏ธ

  • Simple, intuitive interface for users ๐Ÿ‘จโ€๐Ÿ’ป.
  • Visual cues for real-time translation and speech status ๐Ÿ‘.
  • Optimized for accessibility (large fonts, screen reader compatible) ๐Ÿ’ก.

7. Scalability & Performance ๐Ÿš€

  • Optimized for multiple users simultaneously ๐ŸŒŸ.
  • Low-latency for real-time communication โฑ๏ธ.

8. Security & Privacy ๐Ÿ”’

  • No sensitive data storage โŒ.
  • Encrypted data transmission ๐Ÿ”.

โš™๏ธ Tech Stack

  • Frontend: React.js โš›๏ธ
  • Backend: Flask ๐Ÿ
  • Authentication: Firebase Authentication ๐Ÿ”‘
  • Speech Recognition: Webkit Speech Recognition ๐ŸŽค
  • Text-to-Speech (TTS): Google TTS ๐Ÿ”Š
  • Translation: IndicTrans2 Models ๐ŸŒ

๐Ÿ–ผ Screenshot

Hereโ€™s a glimpse of the application interface:

Screenshot


๐Ÿš€ Future Enhancements

  • Offline functionality for STT & TTS ๐Ÿ›ฒ.
  • Option to save/export translated conversations ๐Ÿ’พ.
  • Integration with messaging/video platforms ๐Ÿ“ฑ๐Ÿ“ฉ.
  • Teacher-Student Platform Integration: ๐Ÿ‘จโ€๐Ÿซ
    • Teachers will be able to upload their audio lessons via a login portal.
    • Students can access lessons in their preferred language.
    • A centralized dashboard for teachers to manage uploaded content and track engagement.

Click here! ๐ŸŽฌ


Status

Implemented:

  1. Real-Time Speech Recognition:

    • Speech-to-Text (STT) implemented.
    • Supports multiple Indian languages (Hindi, Kannada, Marathi, etc.).
  2. Language Translation:

    • Text is translated from mentorโ€™s language to the userโ€™s native language.
    • Translation is handled using IndicTrans2 models.
  3. Text-to-Speech (TTS):

    • Converts translated text to speech using Google TTS.
  4. Bidirectional Communication:

    • Users can communicate in both languages (mentor & user).
    • Toggle feature to switch between languages seamlessly.
  5. Language Selection:

    • Language selection dropdown for users to choose their preferred language.
  6. User Interface (UI):

    • Simple, intuitive interface with visual cues for real-time translation and speech status.
    • Optimized for accessibility (large fonts, screen reader compatible).
  7. Backend & Frontend:

    • Backend implemented using Flask.
    • Frontend developed using React.js.
  8. Authentication Pages:

    • Firebase project created & Authentication pages completed.

Remaining Tasks:

  1. Security & Privacy:

    • Implement data encryption for secure transmission.
    • Ensure no sensitive data storage (currently pending).
  2. Teacher-Student Module Integration:

    • Develop a teacher login portal.
    • Enable video uploads for lessons.
    • Build a student interface to access lessons in their native language.
  3. Deployment on Cloud:

    • Deploy web application on Vercel Cloud Platform**.

๐Ÿ“ง Contact

For further inquiries, reach out to me at: Shubham Murtadak ~ AI Engineer ๐Ÿ“ฉ.


Contributors

Languages

Python

53.8%

JavaScript

34.6%

CSS

9.1%

HTML

2.6%