Claude 2

Released

Claude 2 is an AI model released by Anthropic on Tuesday, Jul 11 2023, 119 days after Claude 1. It has a 100k token context window (roughly 75,000 words). Benchmark results (shown below) cover HumanEval, MMLU, and GSM8K.

Benchmarks

Coding

HumanEval
71.2%
#1

Reasoning & science

MMLU
78.5%
#4 of 4
GSM8K
88%
#2 of 3

About

Claude 2, released July 11, 2023, was the first Claude anyone could simply sign up and use. It launched alongside claude.ai as a public beta in the US and UK, ending the waitlist-and-API-key period that had kept Claude 1 to a narrow developer audience. It carried a 100K-token context window — roughly 75,000 words — which at the time was the largest available from any major AI lab and made whole-book and whole-codebase prompting a mainstream idea rather than a research demo.

Anthropic pitched it on measured gains over Claude 1.3: 71.2% on Codex HumanEval, up from 56.0%; 88.0% on GSM8K; 78.5% on MMLU; and 76.5% on the multistate bar exam. Those were respectable rather than record-setting figures next to GPT-4, and Claude 2's real significance was distribution — it put Anthropic in front of consumers four months after GPT-4 shipped, and set up the context-window expansion that arrived with Claude 2.1 in November.

Compare Claude 2 with

Claude 2

Suggested comparisons

Frequently asked questions

Claude 2 was released by Anthropic on Tuesday, Jul 11 2023.

Claude 2 was built by Anthropic. AI safety company building the Claude family of models. Founded in 2021 by former OpenAI researchers.

Claude 2 reports 3 tracked benchmark scores — HumanEval: 71.2%; MMLU: 78.5%; GSM8K: 88%. Scores are the figures published at release by Anthropic.

Claude 2 has a context window of 100k — roughly 75,000 words of text. That is the maximum amount of input plus output the model can hold in a single request.

No. Claude 2 is a proprietary model. The weights are not published — it is available only through the provider's own API, apps, or partner platforms.

Anthropic's previous tracked release was Claude 1 on Mar 14 2023, 119 days earlier. It was followed by Claude Instant 1.2 on Aug 9 2023.

All Anthropic releases

27 tracked