- parameters
- 1.09B
- pretraining
- ~130B tokens
- architecture
- Qwen3-family
- tokenizer
- 32k SentencePiece
- hardware
- 2× RTX 5090 + 2× H100
- inherited weights
- none
rivet-1b, a 1.09B model trained end to end
Tokenizer, corpus, pretraining, post-training, evaluation and release. No weights, embeddings or tokenizer state inherited from another model.
SentencePiece · Qwen3 architecture · Hugging Face
Read the build note