TECHAGENT - MY AI LIFE
LLM Models
45Score

Mistral NeMo

#34Open Source

Mistral AI

12B open-source. Best-in-class at its size. MIT license.

Official page →
📖Context128K tokens
🚀Speed180 tok/s
💵Input price$0.020/1M
💸Output price$0.030/1M
🧠Parameters12B

Benchmarks

Gray bar = dataset average
MMLU57 academic subjects
68.0%avg 81.8
GPQA DiamondPhD-level science questions
32.0%avg 50.4
HumanEvalPython code generation
73.4%avg 79.9
SWE-Bench VerifiedReal GitHub engineering tasks
15.0%avg 32.4
Composite ScoreScore = MMLU×20% + GPQA×30% + HumanEval×25% + SWE-Bench×25%45.3

Details

Provider
Mistral AI
Parameters
12B
Context
128K tokens
Speed
180 tok/s
Open Source
Yes
License
Open (varies)
Released
Jul 2024

Reviews

No reviews yet

Log in to rate