AI Model Release Tracker

Claude 2

Released

Claude 2 is an AI model released by Anthropic on Tuesday, Jul 11 2023, 119 days after Claude 1. It has a 100k token context windowHow much information the model can work with in one request, measured in tokens — pieces of words or other data. This includes your question, attachments, conversation and reply. Limits can vary by model variant and provider. (roughly 75,000 words). Benchmark results (shown below) cover HumanEval, MMLU, and GSM8K.

Benchmarks

Coding

HumanEvalFunction synthesis — 164 small Python problems: the AI is given a function's description and has to write the working function. This was the coding benchmark of the GPT-3.5 and GPT-4 era, before the field moved to fixing real bugs in real repositories. Higher is better.
71.2%
#3 of 6

Reasoning & science

MMLUGeneral knowledge — A 57-subject multiple-choice exam — history, law, medicine, maths — that was the standard measure of how much a model knows from 2020 until roughly 2024, when frontier scores crowded into the high 80s and labs moved on to harder tests. The scores here were published years apart under different testing setups, so read them as a historical record rather than a like-for-like ranking. Higher is better.
78.5%
#7 of 7
GSM8KGrade-school math — Grade-school maths word problems that take a few steps of arithmetic to work through. It separated the models of 2022 and 2023 sharply, then saturated. One caveat on the historical numbers: OpenAI included part of the GSM8K training set in GPT-4's pre-training mix, so GPT-4's score is not a clean few-shot result. Higher is better.
88%
#4 of 5

Compare Claude 2 with

Claude 2

Suggested comparisons

Claude 2vsClaude Haiku 5.5Claude 2vsGPT-6.1 SolClaude 2vsGemini 4 ArgonClaude 2vsMuse Spark OpenClaude 2vsGrok 4.7Claude 2vsDeepSeek-V4.1-Flash-1017Claude 2vsMistral Large 4Claude 2vsKimi K3Claude 2vsGLM-5.3-FlashClaude 2vsQwen3.8-Max-0902Claude 2vsNemotron 3.5 Super VL

About

Claude 2, released July 11, 2023, was the first Claude anyone could simply sign up and use. It launched alongside claude.ai as a public beta in the US and UK, ending the waitlist-and-API-key period that had kept Claude 1 to a narrow developer audience. It carried a 100K-token context window — roughly 75,000 words — which at the time was the largest available from any major AI lab and made whole-book and whole-codebase prompting a mainstream idea rather than a research demo.

Anthropic pitched it on measured gains over Claude 1.3: 71.2% on Codex HumanEval, up from 56.0%; 88.0% on GSM8K; 78.5% on MMLU; and 76.5% on the multistate bar exam. Those were respectable rather than record-setting figures next to GPT-4, and Claude 2's real significance was distribution — it put Anthropic in front of consumers four months after GPT-4 shipped, and set up the context-window expansion that arrived with Claude 2.1 in November.

Frequently asked questions

Claude 2 was released by Anthropic on Tuesday, Jul 11 2023.

All Anthropic releases

30 tracked