Home » Anthropic Releases Claude 2 With 100,000-Token Window

Anthropic Releases Claude 2 With 100,000-Token Window

By

–

Anthropic Releases Claude 2 With 100,000-Token Window

July 11, 2023 — cybernewschronicle.com — Anthropic released Claude 2 on July 11, 2023. The headline number is 100,000 tokens for its context window. That number matters because it changes what users can actually do with the chatbot.

A token is roughly three-quarters of a word in English. Crunch that and you get around 75,000 words of text the model can handle in a single session.

That is a long novel. Or a dense technical manual. Or an entire codebase for a modest software project.

Claude itself first appeared in March 2023. It already had a reputation in AI-assisted software development.

The upgrade broadens that reach. Developers can now feed the model an entire application’s source code, ask for a refactor, and get a coherent answer without breaking the conversation into chunks. That is a practical shift, not just a spec bump.

The company, Anthropic, trains its models using something called constitutional AI. That is their internal method for aligning the model with ethical and legal rules. It is not a marketing phrase.

It is a technical approach baked into the training process. The goal is to make the chatbot refuse harmful requests without needing a human moderator in the loop for every edge case.

Claude 2 inherits that foundation. The context window expansion does not change the safety layer. It just lets users push more material through that layer at once.

Anthropic releases each generation of Claude in three sizes. The smallest is Haiku.

The middle is Sonnet. The largest is Opus. The report does not specify which size got the 100,000-token upgrade.

It likely applies across the tier. That matters for pricing and deployment. A Haiku running on a phone cannot handle the same workload as an Opus running on server clusters.

But if all three get the larger window, then the capability trickles down to cheaper, faster deployments. The public access piece is significant.

Claude 2 is not locked inside a research lab. Anyone can try it. That puts pressure on competitors.

OpenAI’s GPT-4 had a context window of roughly 8,000 tokens at the time. Google’s PaLM 2 was similar.

Anthropic jumped past both by an order of magnitude. That is a concrete advantage for users who need to analyze long documents or maintain long conversations without the model forgetting the start. What happens next is predictable.

Competitors will match or exceed the 100,000-token mark. The real question is whether larger windows degrade response quality. More tokens mean more information for the model to weigh.

Attention mechanisms have limits. Anthropic claims the upgrade works.

Independent testing will tell. For now, the release is the latest step in a rapid cycle. Claude launched in March.

Claude 2 arrived four months later. That pace suggests Anthropic is iterating fast, possibly compressing a year of research into a quarter.

The company was founded in 2021 by former OpenAI employees. It raised hundreds of millions of dollars. The pressure to ship is real.

The expanded context window changes the user experience more than any other single metric. It shifts the chatbot from a tool for short Q&A to a tool for sustained, document-level work. That is a different product category.

Whether users adopt it that way depends on interface design and reliability. The raw capability is there.

#AnthropicReleasesClaude #TokenWindow #AI #News

More stories by

Most read

AI Tools

Artificial Intelligence

Business

World News