WizardLM-2 8x22B

Open Source

Microsoft

WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models. It is...

openrouter.ai ↗

📖Context66K tokens

🚀Speed-

💵Input price$0.620/1M

💸Output price$0.620/1M

🧠Parameters140.621B

Benchmarks

Gray bar = dataset average

Composite ScoreScore = MMLU×20% + GPQA×30% + HumanEval×25% + SWE-Bench×25%-

HF Open LLM Leaderboard

IFEval · BBH · MATH · GPQA · MuSR · MMLU-Pro

Average

33.1

View on HF →

IFEvalInstruction following

52.7%avg 79.9

BBHBig Bench Hard

48.6%avg 48.7

MATH Lvl 5Competition mathematics

25.0%avg 37.8

GPQAGraduate-level science Q&A

17.6%avg 12.9

MuSRMultistep soft reasoning

14.5%avg 10.7

MMLU-ProProfessional knowledge

40.0%avg 40.0

Made by

More from Microsoft

Phi 4 Mini InstructOSS

$0.080/1M→

Phi 4OSS

$0.065/1M→

API Providers

Details

Provider: Microsoft
Parameters: 140.621B
Context: 66K tokens
Speed: -
Open Source: Yes
License: Open (varies)
Released: Apr 2024

Reviews

No reviews yet

← View all 376 models