481
Visualizing Attention, a Transformer's Heart [video]
Demystifying attention, the key mechanism inside transformers and LLMs.
New
The latest blog posts to take off on Hacker News. 673 posts.
482
Lessons after a Half-billion GPT Tokens
[custom_views_and_hn_comments hn_id=”40015185″] My startup Truss (gettruss.io) released a few LLM-heavy features in the last six months, and the narrative around LLMs that I read on Hacker News is now starting to diverge from my reality, so I thought I’d share some of the more “surprising” lessons after churning…
483
Meta MTIA v2 – Meta Training and Inference Accelerator
We are sharing details of our next generation chip in our Meta Training and Inference Accelerator (MTIA) family. MTIA is a long-term bet to provide the most efficient architecture for Meta’s unique workloads.
484
Three major LLM releases in 24 hours
I’m a bit behind on my weeknotes, so there’s a lot to cover here. But first... a review of the last 24 hours of Large Language Model news. All times …
485
GPT-4 Turbo with Vision is a step backwards for coding
OpenAI’s GPT-4 Turbo with Vision model scores worse on aider’s code editing benchmarks than all the previous GPT-4 models. In particular, it seems much more prone to “lazy coding” than the existing GPT-4 Turbo “preview” models.
486
487
488
Intel Gaudi 3 AI Accelerator
Intel Gaudi 3 AI accelerator brings global enterprises choice for generative AI, building on the performance and scalability of its Gaudi 2 predecessor.
489
Hello OLMo: A truly open LLM
Introducing OLMo 7B, a truly open, state-of-the-art large language model.
490
491
Chronon, Airbnb's ML feature platform, is now open source
A feature platform that offers observability and management tools, allows ML practitioners to use a variety of data sources, while handling…
492
493
The lifecycle of a code AI completion
Demystifying code AI: Learn how Cody analyzes context, retrieves references, prompts models, and refines completions behind the scenes.
494
Clojure's machine learning ecosystem
I had a really enlightening talk with Daniel Slutsky this week (who is an exceptional data scientist, software engineer, and community organizer I highly…
495
Understanding and managing the impact of machine learning models on the web
This document proposes an analysis of the systemic impact of AI systems, and in particular ones based on Machine Learning models, on the Web, and the role that Web standardization may play in managing that impact.
496
JetMoE: Reaching LLaMA2 performance with 0.1M dollars
The project is contributed by Yikang Shen , Zhen Guo , Tianle Cai and Zengyi Qin . For technical inquiries, please contact Yikang Shen. For media and collaboration inquiries, please contact Zengyi Qin.
497
Tokens, n-grams, and bag-of-words models (2023)
This post covers Natural Language Processing fundamentals that are essential to understanding all of today’s language models.
498
Banning open weight models would be a disaster
My comments on the NTIA AI Open Model Weights RFC
499
OpenAI's comment to the NTIA on open model weights
OpenAI’s comment to the NTIA on open model weights This comment was submitted by OpenAI in response to NTIA’s March 2024 Request for Information on Dual-Use Foundation Models with Widely Available Weights.
500
OpenAI: Start using ChatGPT instantly
We’re making it easier for people to experience the benefits of AI without needing to sign up
501
502
Can GPT optimize my taxes? An experiment in letting the LLM be the UX
TL;DR Yes, albeit with patience.
503
The jobs being replaced by AI – an analysis of 5M freelancing jobs
Last Updated: January 23, 2026There’s no question that AI will impact jobs. But which jobs are more likely…
504
Models all the way down
LAION-5B is an open-source foundation dataset. It contains 5.8 billion image and text pairs—a size too large to make sense of. We follow the construction of the dataset to better understand its contents, implications and entanglements.
505
Running OCR against PDFs and images directly in the browser
I attended the Story Discovery At Scale data journalism conference at Stanford this week. One of the perennial hot topics at any journalism conference concerns data extraction: how can we …
506
507
Qwen1.5-Moe: Matching 7B Model Performance with 1/3 Activated Parameters
GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD Introduction Since the surge in interest sparked by Mixtral, research on mixture-of-expert (MoE) models has gained significant momentum. Both researchers and practitioners are keenly interested in understanding how to effectively train such models and assessing their…
508
OpenVoice: Versatile instant voice cloning
Discover OpenVoice: Instant voice cloning technology that replicates voices from short audio clips. Supports multiple languages, emotion and accent control, and cross-lingual cloning. Efficient and cost-effective, outperforming commercial APIs. Explore the future of AI voice synthesis.
509
LLMs use a surprisingly simple mechanism to retrieve some stored knowledge
Researchers find large language models use a simple mechanism to retrieve stored knowledge when they respond to a user prompt. These mechanisms can be leveraged to see what the model knows about different subjects and possibly to correct false information it has stored.
510