Builds

13 repos

Showing 13 of 13 projects

Screenshot of Lexa AI

~/builds/lexa-ai

05

Lexa AI

From-scratch transformer for English-to-Hindi/Telugu translation

Lexa AI is a multilingual machine translation model, built as an NLP course project. It implements a small encoder-decoder transformer from scratch in PyTorch, with no pretrained weights, to translate English into Hindi and Telugu.

A single encoder handles English input while the decoder is shared across both target languages, switched by a beginning-of-sentence token (<s-hi> or <s-te>). The model was trained on the Opus100 en-hi and en-te subsets using a custom BERT-style tokenizer, and is exposed through a Streamlit interface with a provided Dockerfile.

Highlights

  • 7M-parameter encoder-decoder transformer written from scratch, no pretrained weights
  • Custom BERT-style tokenizer trained on the Opus100 en-hi/en-te dataset
  • One encoder, one decoder shared across languages, switched via a BOS token per target language
  • Streamlit UI for interactive testing, packaged with a Dockerfile for containerized runs