Qwen Blog company blog

Extending the context length to 1M tokens

by Qwen Team qwenlm.github.io published 2024-11-1511 min read

API Documentation (Chinese) HuggingFace Demo ModelScope Demo Introduction After the release of Qwen2.5, we heard the community’s demand for processing longer contexts. In recent months, we have made many optimizations for the model capabilities and inference performance of extremely long context. Today, we are proud…

Points

116

HN comments

107

Submissions

1

Cited by

0 commenters

AI & Machine LearningSystems & Performance2024

Related posts from the same era

Bing: “I will not harm you unless you harm me first”

Simon Willison20233,363 points1,673 commentscited by 6 details

GPT-4o

OpenAI Blog20243,138 points2,366 commentscited by 16 details

Open source AI is the path forward

Meta Newsroom20242,360 points887 commentscited by 5 details

My AI skeptic friends are all nuts

Fly.io Blog20252,356 points2,826 commentscited by 13 details

Claude 3.7 Sonnet and Claude Code

Anthropic20252,127 points963 commentscited by 6 details

Claude 4

Anthropic20252,013 points1,170 comments details