Short Message Compression Using LLMs
ts_sms works similarly to ts_zip . It uses a specific padding system compatible with arithmetic coding so that the message length does not need to be explicitly encoded.
Topics /
The most popular blog posts about ai & machine learning on Hacker News. 6,324 posts.
ts_sms works similarly to ts_zip . It uses a specific padding system compatible with arithmetic coding so that the message length does not need to be explicitly encoded.
We are excited to launch Workers AI - an AI inference as a service platform, empowering developers to run AI models with just a few lines of code, all powered by our global network of GPUs
In another thrilling adventure with ChatGPT, I endeavored to integrate it with a Raspberry Pi, effectively turning it into my own personal light switch. My custom ChatGPT plugin, sporting just two ...
Posted by Yang Zhao, Senior Software Engineer, and Tingbo Hou, Senior Staff Software Engineer, Core ML Text-to-image diffusion models have shown ex...
A bug that plagues thousands of open-source ML projects.
We often think of the same information at different levels or abstraction. Here's a simple example:
Freeways were supposed to be easy. What happened?
Welcome to Internet and Technology Addicts Anonymous! We’re glad you’ve found us, and we hope our community can be as helpful to you as it has been for us. ITAA is a Twelve-Step fellowship of individuals who support each other in recovering from internet and technology addiction. This includes social media addiction…
The Long Arc of History Bends Towards Social Democracy
Humane AI (Humane, hereafter) combines the mid-2010s failed concept of using a laser projector to project on the body with the early 2000s failed projector phone (something I wrote about in 2013), …
Gmail doesn't just offer to write your emails for you, they actually do it, and it's up to you to delete the text it wrote. Hard to make a screen shot to demo without revealing personal i…
AI-powered browser extensions come with alarming security risks, but most companies still don't have policies for how their employees can use them.
Posted by Sergey Levine, Research Scientist, and Alexander Herzog, Staff Research Software Engineer, Google Research, Brain Team Reinforcement lear...
An update on the latest advancements of Elixir, data, and Machine Learning.
Large Language Models (LLMs) are typically presumed to process context uniformly—that is, the model should handle the 10,000th token just as reliably as the 100th. However, in practice, this assumption does not hold. We observe that model performance varies significantly as input length changes, even on simple tasks…
Thank you so much to lots of lovely friends who have offered to visit me in hospital! Ramesh and I are wanting to keep life really simple...
Claude Opus 4 and 4.1 can now end a rare subset of conversations. An update on our exploratory research on model welfare.
Large language models (LLMs) like the GPT family learn the statistical structure of language by optimising their ability to predict missing words in sentences (as in ‘The cat sat on the [BLANK]’). Despite the impressive technical ju-jitsu of transformer models and the billions of parameters they learn, it’s still a…
OpenAI begins testing ads in ChatGPT to support free access, with clear labeling, answer independence, strong privacy protections, and user control.
A field guide to responsible AI-assisted development
One of my favorite AI dev products today is Full Line Code Completion in PyCharm (bundled with the IDE since late 2023). It’s extremely well-thought out,...
I have previously blogged about the relatively new trend of AI slop in vulnerability reports submitted to curl and how it hurts and exhausts us. This trend does not seem to slow down. On the contrary, it seems that we have recently not only received more AI slop but also more human slop. The latter … Continue reading…
(Some of) what we've been up to for the past year-and-a-half at EleutherAI.