Skip to content

Latest commit

 

History

History
51 lines (34 loc) · 1.75 KB

README.md

File metadata and controls

51 lines (34 loc) · 1.75 KB
Raw

English-Hindi-Translation-using-Transformer

Machine translation using Transformers

Dataset used The IIT Bombay English-Hindi Parallel Corpus

Predicted translations after 8 Epochs

translate("Trade has stopped ")
Predicted translation: व्यापार का रोक दिया गया है । 

translate("This is the problem we have to solve .")
Predicted translation: इस समस्या के लिए एक साथ समस्या है जिससे हम किसी समस्या को हल करना चाहते हैं ।

translate("Very Less employment opportunities are produced")
Predicted translation: रोजगार की प्रतिभूति के लिए बहुत कम होती है ।

translate("Union is strength")
Predicted translation: संयुक्त संयोजन । 

translate("Union of india includes several states")
Predicted translation: भारत में संयुक्त राज्य सभा के विभिन्न राज्यों में से एक है ।

Transformer

Transformer

Attention

Scaled dot product attention

Multi head Attention

References

  1. https://www.tensorflow.org/tutorials/text/transformer

  2. Attention Is All You Need

  3. Anoop Kunchukuttan, Pratik Mehta, Pushpak Bhattacharyya. The IIT Bombay English-Hindi Parallel Corpus. Language Resources and Evaluation Conference. 2018.