LLMs pose an interesting problem for DSL designers
The most exciting part of Programming Languages (PL) research for me has always been in Programming Language Design.
Topics /
The most popular blog posts about ai & machine learning on Hacker News. 3,091 posts.
The most exciting part of Programming Languages (PL) research for me has always been in Programming Language Design.
Kelly predicted AI heavyweights while advocating for a future of open weights
Burnout is on the rise again, with an ironic twist.
Over the past few years, we've seen that next-token prediction scales, denoising diffusion scales, contrastive learning scales, and so on, all the way to the point where we can train models with billions of parameters with a scalable objective that can eat up as much data as we can throw at it. Then, what about…
Can you see the resemblance?
K/V context cache quantisation has been added to Ollama. This enables significant reductions in VRAM usage, allowing users to realise the potential of expanded context sizes and run larger models at their existing context sizes.
Hey! Before we go any further — if you want to support my work, please sign up for the premium version of Where’s Your Ed At, it’s a $7-a-month (or $70-a-year) paid product where every week you get a premium newsletter, all while supporting my
I've been trying to make progress on a herculean task; I want decent looking programs for personal use which I can generate quickly using AI agents yet I'm a person without taste controlling an AI without taste. I found "one weird trick" that does enough for me, the results are not extra nice but it doesn't make me…
Welcome to the very first post in a new blog! Here I will discuss software development, SRE work, and other fun stuff. Sometimes an idea is just too good to pass up. I hope this blog will motivate me to turn sparks and little pieces into general knowledge in writing the words down. The other day I was discussing Tabby…
Leo de Moura on Formal Proofs, AI Agents, and the End of “Trust Me” Code. Subscribe: Apple • Spotify • … More
A visual introduction to self-supervised learning methods for visual representations.
Right from my undergrad days when I was starting out with machine learning to this date, my admiration for Kaggle continues to grow. In addition to being synonymous with and popularizing data scien…
What is OpenAI? I realize you might say "a foundation model lab" or "the company that runs ChatGPT," but that doesn't really give the full picture of everything it’s promised, or claimed, or leaked that it was or would be. No, really, if you believe its leaks to
During the last 3 months, I spent some of my time and tokens decompiling a popular first-person shooter. The goal was not to reach a simple proof-of-concept state. Instead, we really wanted an accurate, stable and feature-complete recreation of the game. The avid reader of my blog might have noticed that I had…
Proposal & discussion of how default mode networks for LLMs are an example of missing capabilities for search and novelty in contemporary AI systems.
In the two years after publishing this, I worked on refining this algorithm to power a real-time world generator, called Generate Worlds, and it lets you des...
Table of Contents
Deep learning, despite its remarkable successes, is a young field. While models called artificial neural networks have been studied for decades, much of that work seems only tenuously connected to modern results.
GPT-3 says the title for this post is very bad.
Why generative AI tools can be so difficult to use and how we might improve them
From gene regulatory networks to artificial neural networks
Last week, I posted a visual demonstration of the sameness of AI-generated content.
A year of failure postmortems from building document AI for public tenders: phantom partners, silent coverage collapses, broken truth-meters, and why the refusal became the product.
If OpenAI was a public company, it's stock would have been down about 38% today in a shocking turn of events.
I got into programming because it let me turn thought into reality. If I could reason precisely, then a computer could carry out my thoughts unerringly. I could step away from tiring, ambiguous human interaction for a while.
A personal blog, by a programmer and IT expert. Essays, Articles, Guides, and Recipes. As well as Code, Quotes, and Links.
Photo by Kevin Steinhardt When Azeem asked me to give a talk at CogX, he asked me to focus on just a single point that I wanted the audience to take away. A few years ago my priority would have bee…
For most people I interact with, I’m just another text-based program for the most of the time. If input and output are so simple, could I be replaced by the model? For this to work, the model would need to not only understand my writing style but also know a lot about me. The best source for this is my Telegram…