Training LLMs from ground zero as a startup
Chronicles of training strong LLMs from scratch in the wild
Chronicles of training strong LLMs from scratch in the wild
MDM push of password based IMAP, CalDAV, CardDAV, STMP, POP and Exchange ActiveSync (Google Sync) will no longer work for customers who try to connect to an LSA for the first time.
I’ve had the curiosity to explore radio communication protocols for a few years now, ever since I’ve started fiddling around with an RTL-SDR dongle. I always had the goal of figuring out how data is transmitted in remote controls (car key fobs particularly), trying replay attacks, and other possible attack vectors.
Llama 3.1 405B on Cerebras is by far the fastest frontier model in the world – 12x faster than GPT-4o and 18x faster than Claude 3.5 Sonnet.
It seems like just yesterday WordPress was becoming a teenager, and in a blink of the eye it’s now old enough to drink! 21 years since Mike and I did the first release of WordPress, forking Michel’…
Update: This kinda blew up! Featured in Hacker News, Ars Technica and PC Gamer, among others. Just months after Neil Armstrong’s historic moonwalk, Jim Storer, a Lexington High School student…
Delving the depths of computing, hoping not to get eaten by wumpus
By all accounts, Pat Gelsinger is affable, technically sharp, hard-working, and decent. Those who have worked for him praise him as a singularly good manager. In January 2021, when Gelsinger was abruptly named the CEO of Intel, this is more or less all I knew of him — and I found myself urgently needing to learn much…
I went for a spelunk through an ancient codebase a few weeks ago which contained a curious regex that I just couldn't grok. Copied to 📋⧉ {<((https?|ftp|dict|tel):[^\'">\s]+)>}i I'm familiar with HTTP and FTP. I worked in the mobile industry, so knew that tel:+44... could be used to launch a dialer. But DICT?!?!?! It…
Towards the end of my mid-2019 job search, I was down to joining the Google Go team or Sourcegraph. Sourcegraph ultimately won due to cultural factors - the most important of which was the ability to build 100% in the open . All documents were public by default. Technical and product RFCs (and later PR/FAQs) were…
The thought behind the thought
Creating small games is an enjoyable endeavor in itself. So what constitutes a small game? According to the 'Small Game Manifesto', 1 it refers to games that conclude within 10 minutes and can be easily played on browsers.
For over thirty years, a dead rabbit has hung inside Seven Sisters tube station, and thousands of people walk past it every day without noticing.
OpenAI and Apple announce partnership to integrate ChatGPT into Apple experiences.
It seems that (1) there is still more software in circulation that depends on archaic CRLF line endings than I originally thought and (2) many people do not share my enthusiasm for creating a CRLF-free world. Alas. This makes me sad, but it is what it is. Thanks to everyone who was willing to give the idea a test run…
Researchers have long loved PDFs for reading papers. You can focus on absorbing the scholarship – the format is simple and clean. Researche...
When you launch an app, macOS connects to Apple's OCSP service to check whether the app's Developer ID code signing certificate has been revoked by Apple. In November 2020, Apple's OCSP service experienced a mass outage , preventing Mac users worldwide from launching apps. In response and remedy to this outage, Apple…
After Snowden’s whistleblowing in 2013, large parts of the internet became encrypted, enabling private and secure communication. Not everyone has welcomed this change. Most notably, the FBI and other U.S. government agencies have fought what is often called the “crypto wars”, the war on encryption. In recent years…
Back in 2008, I wrote some software for fun to generate various optimized walking mechanisms. And when I also picked up some electronics and wood working skills in more recent years, I was able to turn one of these mechanisms into an actual wireless walking wooden coffee table: the Carpentopod. This post briefly…
What is the average size of JavaScript code downloaded per website? Fuck around and find out!
turns out, you can even search for them with powerful search engines!
If Instagram and Facebook users want to withdraw their consent, they have to buy an expensive subscription
My 4U 71 TiB ZFS NAS built with twenty-four 4 TB drives is over 10 years old and still going strong.