Research & Writing
Model reports, engineering lessons, and the occasional personal system that got too useful not to write down.
4 articles
No articles match these filters. Clear filters or try different keywords.
- · 7 min read · Evaluation When a frontier lab ships a model in your domain, benchmark it NVIDIA shipped a strong 4B translation model. We benchmarked it against our customer-tuned models on three client domains. The result says more about metrics than about models.
- · 13 min read · Evaluation Designing new metrics to define model success. Traditional metrics are not keeping up with modern model progression. How do we tackle this, and how is arbitr pushing bringing generation evaluation into the future.
- · 4 min read · Evaluation When Your AI Model Works Better Than You Think A Translation Model Discovery Story
- · 5 min read · Evaluation Effects of beam search on translation quality and resource consumption A Study of Quality and Resource Tradeoffs in Straker Tiri Models
