Attenta

About Attenta

Attenta is a from-scratch Rust implementation of the Transformer architecture (Vaswani et al. 2017) built without PyTorch or TensorFlow. Designed for high efficiency, it features multi-head attention, BPE tokenization, and custom matrix multiplication. This release comes pre-trained on Indian legal documents, showcasing a pure Rust pipeline for specialized NLP tasks from tokenization to beam search decoding. Fully tested with 85 unit tests and ready to self-host.

The person behind Attenta

• 
  Meet Mendapara

  Maker

  AI Researcher | AI & Cognitive Systems

  m***@attenta.ioUnverified