LLaMA 3 (8B/70B)vsGPT-6 Sol

LLaMA 3 (8B/70B)
GPT-6 Sol
Specifications
Context window
1.05M
API pricing
Input price
$2.00
Output price
$10.00
Cached input price
$0.20
Benchmarks
DeepSWE 1.1
68.8%
Next.js Evals
97%
OSWorld 2.0
60.5%
Agent's Last Exam · pass@1
56.4%
AutomationBench
33.2%
Overview
CompanyMetaOpenAI
Release dateApr 18 2024Sep 22 2026
AccessOpen WeightProprietary

Other comparisons

LLaMA 3 (8B/70B)vsClaude Opus 5.5GPT-6 SolvsClaude Opus 5.5LLaMA 3 (8B/70B)vsGemini 3.8 FlashGPT-6 SolvsGemini 3.8 FlashLLaMA 3 (8B/70B)vsGrok 4.7GPT-6 SolvsGrok 4.7LLaMA 3 (8B/70B)vsDeepSeek-V4.1-FlashGPT-6 SolvsDeepSeek-V4.1-FlashLLaMA 3 (8B/70B)vsMistral Medium 3.5GPT-6 SolvsMistral Medium 3.5LLaMA 3 (8B/70B)vsKimi K3GPT-6 SolvsKimi K3

Frequently asked questions

LLaMA 3 (8B/70B) and GPT-6 Sol don't publish scores on any of the same benchmarks, so there's no direct head-to-head comparison. Only GPT-6 Sol has a verified first-party API price: $2.00 per million input tokens and $10.00 per million output tokens. No pay-as-you-go API rate is tracked for LLaMA 3 (8B/70B). LLaMA 3 (8B/70B) shipped 887 days before GPT-6 Sol, so benchmark comparisons should account for the intervening progress.

LLaMA 3 (8B/70B) is open weight, while GPT-6 Sol is proprietary.

Direct benchmark comparisons are unavailable — LLaMA 3 (8B/70B) and GPT-6 Sol don't publish scores on any of the same benchmarks.