RealImage/labs-aitt-ai4b

This repository contains tools for Indian language processing: IndicTrans for script transliteration and IndicTrans2 for text translation between Indian languages.

0

stars

18

commits

Python

primary language

Oct 29, 2024

updated

models.ai4bharat.org/

README

IndicTrans and IndicTrans2 Repository

This repository contains two distinct systems for handling language processing tasks related to Indian languages: IndicTrans for transliteration and IndicTrans2 for text-to-text translation.

Folder Structure

  • IndicTrans: Contains the transliteration tool that converts text between different scripts, preserving phonetic accuracy.
  • IndicTrans2: Contains the text-to-text translation system, optimized for translation between Indian languages.

IndicTrans (Transliterator)

IndicTrans is designed to transliterate text between various Indian language scripts and the Roman script. It ensures phonetic correctness and is useful for tasks such as cross-script search and name transliteration.

Features:

  • Transliteration between Indian scripts such as Devanagari, Tamil, Telugu, and more.
  • Lightweight and efficient for quick script conversions.

For more information on usage, refer to the IndicTrans README.


IndicTrans2 (Text-to-Text Translation)

IndicTrans2 is an advanced text translation system built for translating text between multiple Indian languages. It uses state-of-the-art machine translation models to maintain context, meaning, and fluency.

Features:

  • Translates between Indian languages such as Hindi, Tamil, Telugu, Kannada, and others.
  • Optimized for accuracy, handling complex grammar and sentence structures.

For more details on usage and implementation, refer to the IndicTrans2 README.


Conclusion

The INDIC-TRANS model effectively captures the clarity and emotional undertones of the original dialogue, retaining humour and contextual understanding. However, there are areas for improvement, particularly in enhancing idiomatic expressions and cultural relevance for Tamil speakers. Overall, the translation demonstrates strong fidelity to meaning, grammatical correctness, and natural fluency, making it relatable for the target audience.

IndicTrans2 - Performance Analysis [October 2024]

CriterionDescription
Fidelity to MeaningOriginal Dialogue: Explores favourite colours, masculinity, and personal experiences.
Translation Accuracy: Captures key phrases like “yellow is my favourite colour” and “I love violence” without loss of meaning.
Contextual RelevanceCultural Insights: Addresses societal expectations of masculinity and femininity.
Nuanced Translation: Effectively conveys playful commentary and humour sensitive to Tamil cultural contexts.
Grammatical CorrectnessEnglish Standards: Adheres to proper grammatical conventions.
Tamil Proficiency: Maintains grammatical integrity with correct sentence structure and punctuation.
Naturalness and FluencyAuthenticity: Utilizes colloquial expressions to enhance relatability for Tamil audiences.
Smooth Flow: Ensures seamless conversational tone in both languages.

Positive Performance

AspectDescription
Clarity of MeaningEffectively captures the primary ideas and emotional undertones of the original dialogue.
Humour RetentionMaintains an engaging tone throughout, preserving the humour well.
Contextual UnderstandingThe narrative flows smoothly, enabling the audience to follow along without confusion.

Areas for Improvement

AreaDescription
Idiomatic ExpressionsSome Tamil phrases could be more idiomatic, resulting in occasional awkward phrasing.
Nuance LossCertain expressions lack subtle cultural and emotional depth in translation.
Cultural RelevanceSome references may not resonate effectively with Tamil speakers without additional context.


Contributors

ASHQUBE

18 commits

RealImage/labs-aitt-ai4b

This repository contains tools for Indian language processing: IndicTrans for script transliteration and IndicTrans2 for text translation between Indian languages.

0

stars

18

commits

Python

primary language

Oct 29, 2024

updated

models.ai4bharat.org/

README

IndicTrans and IndicTrans2 Repository

This repository contains two distinct systems for handling language processing tasks related to Indian languages: IndicTrans for transliteration and IndicTrans2 for text-to-text translation.

Folder Structure

  • IndicTrans: Contains the transliteration tool that converts text between different scripts, preserving phonetic accuracy.
  • IndicTrans2: Contains the text-to-text translation system, optimized for translation between Indian languages.

IndicTrans (Transliterator)

IndicTrans is designed to transliterate text between various Indian language scripts and the Roman script. It ensures phonetic correctness and is useful for tasks such as cross-script search and name transliteration.

Features:

  • Transliteration between Indian scripts such as Devanagari, Tamil, Telugu, and more.
  • Lightweight and efficient for quick script conversions.

For more information on usage, refer to the IndicTrans README.


IndicTrans2 (Text-to-Text Translation)

IndicTrans2 is an advanced text translation system built for translating text between multiple Indian languages. It uses state-of-the-art machine translation models to maintain context, meaning, and fluency.

Features:

  • Translates between Indian languages such as Hindi, Tamil, Telugu, Kannada, and others.
  • Optimized for accuracy, handling complex grammar and sentence structures.

For more details on usage and implementation, refer to the IndicTrans2 README.


Conclusion

The INDIC-TRANS model effectively captures the clarity and emotional undertones of the original dialogue, retaining humour and contextual understanding. However, there are areas for improvement, particularly in enhancing idiomatic expressions and cultural relevance for Tamil speakers. Overall, the translation demonstrates strong fidelity to meaning, grammatical correctness, and natural fluency, making it relatable for the target audience.

IndicTrans2 - Performance Analysis [October 2024]

CriterionDescription
Fidelity to MeaningOriginal Dialogue: Explores favourite colours, masculinity, and personal experiences.
Translation Accuracy: Captures key phrases like “yellow is my favourite colour” and “I love violence” without loss of meaning.
Contextual RelevanceCultural Insights: Addresses societal expectations of masculinity and femininity.
Nuanced Translation: Effectively conveys playful commentary and humour sensitive to Tamil cultural contexts.
Grammatical CorrectnessEnglish Standards: Adheres to proper grammatical conventions.
Tamil Proficiency: Maintains grammatical integrity with correct sentence structure and punctuation.
Naturalness and FluencyAuthenticity: Utilizes colloquial expressions to enhance relatability for Tamil audiences.
Smooth Flow: Ensures seamless conversational tone in both languages.

Positive Performance

AspectDescription
Clarity of MeaningEffectively captures the primary ideas and emotional undertones of the original dialogue.
Humour RetentionMaintains an engaging tone throughout, preserving the humour well.
Contextual UnderstandingThe narrative flows smoothly, enabling the audience to follow along without confusion.

Areas for Improvement

AreaDescription
Idiomatic ExpressionsSome Tamil phrases could be more idiomatic, resulting in occasional awkward phrasing.
Nuance LossCertain expressions lack subtle cultural and emotional depth in translation.
Cultural RelevanceSome references may not resonate effectively with Tamil speakers without additional context.


Contributors

ASHQUBE

18 commits

Languages

Python

100.0%