# Claude 2

Claude 2 is an AI model released by Anthropic on Jul 11 2023. It has a 100k context window.

## Facts

| Field | Value |
| --- | --- |
| Model | Claude 2 |
| Developer | Anthropic |
| Release date | Tuesday, Jul 11 2023 |
| Licensing | Proprietary |
| Context window | 100k |

## Benchmark scores published at release

| Benchmark | Score | Source | What it measures |
| --- | --- | --- | --- |
| HumanEval | 71.2% | Lab | 164 small Python problems: the AI is given a function's description and has to write the working function. This was the coding benchmark of the GPT-3.5 and GPT-4 era, before the field moved to fixing real bugs in real repositories. Higher is better. |
| MMLU | 78.5% | Lab | A 57-subject multiple-choice exam — history, law, medicine, maths — that was the standard measure of how much a model knows from 2020 until roughly 2024, when frontier scores crowded into the high 80s and labs moved on to harder tests. The scores here were published years apart under different testing setups, so read them as a historical record rather than a like-for-like ranking. Higher is better. |
| GSM8K | 88% | Lab | Grade-school maths word problems that take a few steps of arithmetic to work through. It separated the models of 2022 and 2023 sharply, then saturated. One caveat on the historical numbers: OpenAI included part of the GSM8K training set in GPT-4's pre-training mix, so GPT-4's score is not a clean few-shot result. Higher is better. |

## About Claude 2

Claude 2, released July 11, 2023, was the first Claude anyone could simply sign up and use. It launched alongside claude.ai as a public beta in the US and UK, ending the waitlist-and-API-key period that had kept Claude 1 to a narrow developer audience. It carried a 100K-token context window — roughly 75,000 words — which at the time was the largest available from any major AI lab and made whole-book and whole-codebase prompting a mainstream idea rather than a research demo.

Anthropic pitched it on measured gains over Claude 1.3: 71.2% on Codex HumanEval, up from 56.0%; 88.0% on GSM8K; 78.5% on MMLU; and 76.5% on the multistate bar exam. Those were respectable rather than record-setting figures next to GPT-4, and Claude 2's real significance was distribution — it put Anthropic in front of consumers four months after GPT-4 shipped, and set up the context-window expansion that arrived with Claude 2.1 in November.

## Questions and answers

### When was Claude 2 released?

Claude 2 was released by Anthropic on Tuesday, Jul 11 2023.

### Who made Claude 2?

Claude 2 was built by Anthropic. AI safety company building the Claude family of models. Founded in 2021 by former OpenAI researchers.

### What benchmark scores did Claude 2 get?

Claude 2 reports 3 tracked benchmark scores — HumanEval: 71.2%; MMLU: 78.5%; GSM8K: 88%. Scores are the figures published at release by Anthropic.

### What is the context window of Claude 2?

Claude 2 has a context window of 100k — roughly 75,000 words of text. That is the maximum amount of input plus output the model can hold in a single request.

### Is Claude 2 open source?

No. Claude 2 is a proprietary model. The weights are not published — it is available only through the provider's own API, apps, or partner platforms.

### What came before and after Claude 2?

Anthropic's previous tracked release was Claude 1 on Mar 14 2023, 119 days earlier. It was followed by Claude Instant 1.2 on Aug 9 2023.


---

Canonical page: https://aireleasetracker.com/model/anthropic/claude-2
Full dataset: https://aireleasetracker.com/llms-full.txt · JSON: https://aireleasetracker.com/models.json
Source: AI Release Tracker (https://aireleasetracker.com). Benchmark scores are the figures published by the releasing lab at launch.