Hermes 2 Pro - Llama-3 8B

Open Source

Nousresearch

Hermes 2 Pro is an upgraded, retrained version of Nous Hermes 2, consisting of an updated and cleaned version of the OpenHermes 2.5 Dataset, as well as a newly introduced...

openrouter.ai ↗

📖Context8K tokens

🚀Speed-

💵Input price$0.140/1M

💸Output price$0.140/1M

🧠Parameters8.031B

Benchmarks

Gray bar = dataset average

Composite ScoreScore = MMLU×20% + GPQA×30% + HumanEval×25% + SWE-Bench×25%-

HF Open LLM Leaderboard

IFEval · BBH · MATH · GPQA · MuSR · MMLU-Pro

Average

22.1

View on HF →

IFEvalInstruction following

53.6%avg 79.9

BBHBig Bench Hard

30.7%avg 48.7

MATH Lvl 5Competition mathematics

8.4%avg 37.8

GPQAGraduate-level science Q&A

5.7%avg 12.9

MuSRMultistep soft reasoning

11.3%avg 10.7

MMLU-ProProfessional knowledge

22.8%avg 40.0

Made by

🏢

Nousresearch

HuggingFace: 3 models · 0.5M downloads

startup

→

More from Nousresearch

Hermes 3 70B InstructOSS

Hermes 3 405B Instruct (free)

$1.000/1M→

API Providers

Details

Provider: Nousresearch
Parameters: 8.031B
Context: 8K tokens
Speed: -
Open Source: Yes
License: Open (varies)
Released: May 2024

Reviews

No reviews yet

← View all 376 models