New
The latest blog posts to take off on Hacker News. 6,333 posts.
What happened to BERT and T5?
A Blogpost series about Model Architectures Part 1: What happened to BERT and T5? Thoughts on Transformer Encoders, PrefixLM and Denoising objectives
Mistral NeMo
The most powerful AI platform for enterprises. Customize, fine-tune, and deploy AI assistants, autonomous agents, and multimodal AI with open models.
Want to spot a deepfake? Look for the stars in their eyes
In an era when the creation of artificial intelligence (AI) images is at the fingertips of the masses, the ability to detect fake pictures – particularly deepfakes...
Overcoming the limits of current LLMs
Large language models (LLM) have been all the rage for quite some time now. Looking beyond the hype though, they have severe limitations: hallucinations, lack o
SAPwned: SAP AI vulnerabilities expose customers' cloud environments and privat
Wiz Research uncovers vulnerabilities in SAP AI Core, allowing malicious actors to take over the service and access customer data.
Prover-Verifier Games improve legibility of language model outputs
Discover how prover-verifier games improve the legibility of language model outputs, making AI solutions clearer, easier to verify, and more trustworthy for both humans and machines.
The golden age of scammers: AI-powered phishing
AI phishing is all over the headlines and that’s not going to change. Learn about the capabilities of the dark side of gen ai, and how to defend against it.
Codestral Mamba
The most powerful AI platform for enterprises. Customize, fine-tune, and deploy AI assistants, autonomous agents, and multimodal AI with open models.
The Engineer’s Guide to Deep Learning: Understanding the Transformer Model
In the previous two golden ages (1950s-1960s and the 1980s), our expectations outpaced the capabilities of the technology at the time, leading to disappointment. In contrast, the AI technology of the current golden age, which began in the mid-2010s, has consistently exceeded our expectations.
The Illustrated AlphaFold
A visual walkthrough of the AlphaFold3 architecture, with more details and diagrams than you were probably looking for.
AuraFlow v0.1: a open source alternative to Stable Diffusion 3
Open-source AI is in jeopardy. As community interest in AI models skyrocketed over the past year, we noticed that development of new open-source foundational models came to a halt. Some even boldly announced that open-source AI is dead. Not so fast! We are excited to present you
FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-Precision
FlashAttention-3 achieves up to 75% GPU utilization on H100s, making AI models up to 2x faster and enabling efficient processing of longer text inputs. It allows for faster training and inference of LLMs, supports lower precision operations for improved efficiency.
General Theory of Neural Networks
From gene regulatory networks to artificial neural networks
If AI chatbots are the future, I hate it
About a week ago, my home Internet (AT&T Fiber) went from the ~1 Gbps I pay for down to about 100 Mbps (see how I monitor my home Internet with a Pi). It wasn't too inconvenient, and I considered waiting it out to see if the speed recovered at some point, because latency was fine. But as you can see around 7/7 on that…
Knowledge Graphs in RAG: Hype vs. Ragas Analysis
A deep dive on Microsoft's GraphRAG paper found questionable metrics with vaguely defined lift, so I analyzed knowledge graphs in RAG overall using Neo4j vs FAISS
Another AI company wrote us and here’s our response
Read the new story by War and Peas! This never-ending webcomic of woefully funny stories will leave you cry-laughing or the other way around.
Roblox Open Sources Real-Time Voice Safety Model
The Research Team at Roblox is discovering new possibilities for the next generation of technology.
Why Vivaldi won't follow the current AI trend?
Web browsers are integrating the current AI trend with Large Language Model (LLM) functionality. But there are fundamental issues with it. We address them.
Insights from over 10,000 comments on "Ask HN: Who Is Hiring" using GPT-4o
By structuring the comments on Hacker News using a predefined response_scheme for the LLM, I’ve tried to get a feeling for current job market and trends.
"Superintelligence" 10 years later
10 years on, some things have changed and some did not
Diffusion Forcing: Next-Token Prediction Meets Full-Sequence Diffusion
Official Website of Diffusion Forcing
AI's $600B Question
The AI bubble is reaching a tipping point. As we continue to follow the GPUs, navigating what comes next will be essential.
Block AI bots, scrapers and crawlers with a single click
To help preserve a safe Internet for content creators, we’ve just launched a brand new “easy button” to block all AI bots. It’s available for all customers, including those on our free tier
I Received an AI Email
At first I thought it was from a reader.
Why AI Infrastructure Startups Are Insanely Hard to Build
Level of difficulty: insane
GraphRAG is now on GitHub
GraphRAG, a graph-based approach to retrieval-augmented generation (RAG) that significantly improves question-answering over private or previously unseen datasets, is now available on GitHub. Learn more:
Trying Kolmogorov-Arnold Networks in Practice
There's been a fair bit of buzz about Kolmogorov-Arnold networks online lately. Some research papers were posted around claiming that they offer better accuracy or faster training compared to traditional neural networks/MLPs for the same parameter count.