PersistenceAI 3.5 Mini

PersistenceAI 3.5 Mini is an experimental lightweight transformer language model built from scratch.

Goals:

• Fast
• Lightweight
• Local-friendly
• Educational
• Open-source

Features

• Decoder-only transformer
• Custom tokenizer
• Local inference
• Pretraining support
• Instruction tuning

Tech Stack

• PyTorch
• SentencePiece
• Python