Step 5 Preview: Advancing the Pareto Frontier
阶跃星辰于2023年4月成立,以“智能阶跃,十倍每个人的可能”为使命。阶跃星辰坚定自研超级模型,积极布局算力、数据等关键资源,发挥算法和人才优势,已完成 Step-1 千亿参数语言大模型和 Step-1V 千亿多模态大模型的研发,在图像理解、多轮指令跟随、数学能力、逻辑推理、文本创作等方面性能达到业界领先水平。
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 6,334 posts.
阶跃星辰于2023年4月成立,以“智能阶跃,十倍每个人的可能”为使命。阶跃星辰坚定自研超级模型,积极布局算力、数据等关键资源,发挥算法和人才优势,已完成 Step-1 千亿参数语言大模型和 Step-1V 千亿多模态大模型的研发,在图像理解、多轮指令跟随、数学能力、逻辑推理、文本创作等方面性能达到业界领先水平。
Generative Adversarial Networks refer to a family of generative models that seek to discover the underlying distribution behind a certain data generating process. This distribution is discovered through an adversarial competition between a generator and a discriminator. As we saw in an earlier introductory post on…
In this guide, I will share the standard architecture for data-informed language model applications and explain forthcoming improvements in knowledge retrieval.
Singular Value Decomposition (SVD) is a fundamental concept in linear algebra, and it is particularly important in the field of machine learning for tasks such as dimensionality reduction, data compression, and noise reduction.
In the world of data, textual data stands out as being particularly complex. It doesn’t fall into neat rows and columns like numerical data does. As a side project, I’m in the process of developing my own personal AI assistant. The objective is to use the data within my notes and documents to answer my questions. The…
When I first read Google’s RETRO paper, I was skeptical. Sure, RETRO models are 25x smaller than the competition, supposedly leading to HUGE savings in training and inference costs. But what about the new trillion token “retrieval database” they added to the architcture? Surely that must add back some computational…
Also, shortcomings in document retrieval and how to overcome them with search & recsys techniques.
Recurrent Neural Network Tutorial for Artists
A few months ago, we showed how effectively an LSTM network can perform text transliteration .
How using AI as a bridge when doctors aren't available can improve patient-to-doctor communications in real time emergencies
LLMs suck at comedy, art, journalism, research, and science for the same fundamental reason
Grok 4.1 is now available to all users on grok.com, 𝕏, and the iOS and Android apps. It is rolling out immediately in Auto mode and can be selected explicitly as “Grok 4.1” in the model picker.
The goal of this analysis was to understand what’s working for YC companies by looking at which ones have raised Series A rounds.
Why the productivity gains from AI are still small.
Transcript of interview on how tech changes the world
Qwen3.8 27B benchmarked on a Mac Studio M3 Ultra: Ollama and llama.cpp numbers, the 1-bit quant tested, RAM math, and the hardware that actually fits.
Today, Waymo and Hyundai Motor Company announced they have entered into a multi-year, strategic partnership.
Thoughts on the new technical report from AMÁLIA: The Open Source LLM for European Portuguese
Maybe you’re a Claude code/codex user diligently avoiding uploading personal data to LLM providers. Is it possible that the most valuable information isn’t your data- but the metadata about your sessions? The intuitions you apply in coming up with ways to coax the ai into solving problems might actually be special…
The current (and future) monetization strategies of "Shopify for SaaS"
We’re making Duet AI for Google Workspace available to organizations around the world and announcing new AI capabilities, including automatic summaries and action items in Meet.
are they good or bad?
Fast and Portable Llama2 Inference on the Heterogeneous Edge.
Stability AI and its CarperAI lab are proud to announce FreeWilly1 and its successor FreeWilly2, two powerful new, open access, Large Language Models (LLMs). Both models demonstrate exceptional reasoning ability across varied benchmarks.
How a Single Function Call Gates Safety Alignment in Gemma, Qwen, and Other Open-Source LLMs
"Lorem ipsum is latin, slightly jumbled, the remnants of a passage from Cicero's _de Finibus_ 1.10.32, which begins 'Neque porro quisquam est qui dolorem ipsum quia dolor sit amet, consectetur, adipisci velit...' [There is no one who loves pain itself, who seeks after it and wants to have it, simply because it is…
Posted by Alexander B Wiltschko, Senior Research Scientist, Google Research Smell is a sense shared by an incredible range of living organisms, a...
Compare 153 autonomous runs from 18 frontier models on the nanoGPT optimizer speedrun.