I made a transformer to predict a simple sequence manually
To better understand how transformers work, I hand-assigned all the weights to predict a simple sequence.
Topics /
The most popular blog posts about software engineering on Hacker News. 1,733 posts.
To better understand how transformers work, I hand-assigned all the weights to predict a simple sequence.
Bun gets debugger support, fetch streaming, and `bun update`. ReadStream and WriteStream from `node:tty` are implemented, including raw mode on `process.stdin`. SvelteKit now works in Bun. Plus bug fixes and stability improvements.
"Prompt Engineering" emerged from the growth of language models to describe the process of applying prompting to effectively extract information from language models, typically for use in real-world applications.
Post by Eshel Yaron about changes for the worse in Emacs 30 registers feature
A call-by-call look at context switch logging with the Event Tracing for Windows API.
Phoenix 1.7.0 is here! This releases includes major new features, component-based generators, updated conventions, LiveView Streams, and more!
Want to rekindle your passion for coding? Learn how to create video games from scratch using Go and Ebitengine. We break down core concepts like game loops, sprites, and collisions that we've applied in multiple projects. In just one evening, you'll build a simple Asteroids clone and reignite your love for programming.
Ever wanted more different ways to understand what’s going on in a program? Here I catalogue a huge variety of tracing methods you can use for varying types of problems. Tracing has been such a long-standing interest (and job) of mine that some of these will novel and interesting to anyone who reads this. I’ll…
Mike Kohn's music, software, and electronics projects.
Where you store your application data has enormous impacts on your entire application. There are implications on the entire stack based on what you decide to...
Introducing Deno Queues - zero config, scalable messaging with a guaranteed at-least-once delivery. This new primitive builds on the foundation set by Deno KV, and is available today in the Deno JavaScript runtime and Deno Deploy.
htmx gives you access to AJAX, CSS Transitions, WebSockets and Server Sent Events directly in HTML, using attributes, so you can build modern user interfaces with the simplicity and power of hypertext htmx is small (~14k min.gz’d), dependency-free, extendable, IE11 compatible & has reduced code base sizes by 67% when…
Dynamicland is still going, just quietly. We closed the Oakland space for covid, but Realtalk development and collaborations have continued -- basically as originally planned, if more slowly due to our small size.
Comparison of MRSK and Fly.io
Thanks to 185 contributors, 567 pull requests, community reviewers, and our generous sponsors, we're happy to announce the Bevy 0.12 release on crates…
My opinions have changed somewhat since I last wrote this blog post, and I wish to clarify some things. Please read the follow-up in my latest post Clarifying Some Things .
Today, we’re thrilled to tell you about the many additions to WebKit that are included in Safari 16.4.
Discover io_uring, an async I/O API for Linux that can potentially benefit networking, and learn how to integrate it into your applications and I/O libraries.
Note : This post stirred up some interesting discussions on HackerNews and Lobste.rs .
Apple’s use of Swift and SwiftUI in iOS 17
How I switched hosting my Go-based side projects from Amazon EC2 to Fly.io, significantly simplified deployment, and saved a bit of cash while I was at it.
Ferris meme Discussion on HackerNews and Lobsters. I have been writing C++ professionally for the last 4 years and 3 months ago I started a new job in Rust....
But they are victims of complex societal factors that are beyond their control
Things I Learned From Hundreds of Experiments
4 Years In, OpenTelemetry Delivers on its Promise for Open Observability
Why does 0.1 + 0.2 = 0.30000000000000004?
Fastest general and simple binary search C++ implementation