How to scale LLMs better with an alternative to transformers
Monarch Mixer: Revisiting BERT, Without Attention or MLPs
The latest blog posts to take off on Hacker News. 1,733 posts.
Monarch Mixer: Revisiting BERT, Without Attention or MLPs
You had things running with occasional glitches and there was always an excuse “It works in my machine” as there is rarely identical…
Specify UTF-8 as the default charset of the standard Java APIs. With this change, APIs that depend upon the default charset will behave consistently across all implementations, operating systems, locales, and configurations.
I have a super power. I want to share it in this blog post so that you, my dear reader, also have it!
The original NMOS version of the MOS 6502, used in computers like the Commodore 64, the Apple II and the Nintendo Entertainment System (NES), is well-known for its illegal opcodes: Out of 256 possible opcodes, 151 are defined by the architecture, but many of the remaining 105 undefined opcodes do…
Learn Ruby metaprogramming: call methods dynamically with send, define them at runtime with define_method, and handle missing calls with method_missing.
A model that helps people design effective teams for software development.
Rants, experiments and experiences collected while delving into the magical world of computers.
Moving on from Python Machine Learning might seem impossible. Let me break down why and how you can do it.
My inspiration for this article was this thread in r/embedded . There are still many myths and misconception when it comes to the simple questions "Which compiler should I use?" or "Which compiler is the best?". I will try to share my practical experience with GCC, Clang and IAR on Cortex-M ( and Cortex-M only ). This…
I’m not sure of the exact date, but 20 years ago, around now, I started my first professional programming job. It’s weird to think about having done anything for 20 years. That’s as long as all my schooling put together.
Brev.Dev Instances Console
This is an overview of the HTTP clients we have available in Elixir, as well as when to use each one.
Examining the misleading claims in a published paper about Elixir security
Let’s fix these pesky Transformer outliers using Softmax One and QuietAttention.
What I write about my own personal journey is intended as just that—my personal journey.
Learning Elixir when you already know Ruby? Here are the three most important things you need to understand
Swift is a general-purpose programming language built using a modern approach to safety, performance, and software design patterns.
So after several years of reading oversimplified and flat out incorrect comments about threads and fibers/goroutines/async/etc and fighting this reaction: I’ve decided to write my own still-over-simplified all in one guide to the difference between a couple popular threads and fiber implementations. In order to…
The document you seek is not available. Please consider one of the links below or use the Search feature on the right-hand side of the menu bar above.
The most important coding habits are those that enable us to enjoy this craft for years to come. Here are tips for programming without pain.
Talk transcript on various patterns that slowly influence how teams deal with reliability, and highlight some of the key interactions and behaviors I keep finding work well in the organizations I've been part of.
vite dev support, Workers, bun --smol, WebSocket.ping(), structuredClone(), serialize() and better Node.js compatibility
Early in my research career, I had a chance to work with some of the best system researchers1 in the world on a number of really interesting system designs. One of the enjoyable aspects of research was the particular process used by researchers (particularly in the SOSP/OSDI community) to come up with novel yet…
I've been operating Pushover 's public-facing API for over a decade now and I thought I'd pass on some advice for those creating a new API.
Our strategy for making updates and maintaining stability while we migrate languages.
Recently I’ve been thinking a lot about infrastructure complexity, and the current state of infrastructure as code. This is problem space that many talented people are tackling.