Mercury: Commercial-scale diffusion language model
We trained diffusion large language models that are up to 10x faster and cheaper than current LLMs, pushing the frontier of intelligence and speed for language models.
Every blog post that took off on Hacker News, ranked by the votes of its best submission. 80,859 posts.
We trained diffusion large language models that are up to 10x faster and cheaper than current LLMs, pushing the frontier of intelligence and speed for language models.
Debunking the myth that search engines and AI eliminate the need for memory. Building deep knowledge through active learning remains essential for critical thinking, despite promises of instant information access.
One of the most important things I learned from running a startup is that on a macro scale the innovation market is efficient. If the market conditions allow for a startup to arise, it’s overwhelmingly probable that multiple startups already exist in that market. The converse is also true — if there are no startups in…
Imagine shrinking satellite technology that predicts the weather into a device that transmits vital information about the health of the person wearing it.
At Backblaze we now have 34,881 drives and store over 100 petabytes of data. We continually track how our disk drives are doing, which ones are reliable, and which ones need to be replaced.
When Apple introduced the first iPad in 2010, I bought one immediately. I didn't know what I'd use it for, but I was sure that I would find some use for it. I never did. I played around with it, wrote some code for it, but eventually stopped using it. I would pick it up from time to time to read something or watch a…
A few months ago someone told me about a new Raspberry Pi Compute Module 4 cluster board, the DeskPi Super6c. You may have heard of another Pi CM4 cluster board, the Turing Pi 2, but that board is not yet shipping. It had a very successful Kickstarter campaign, but production has been delayed due to parts shortages…
One of my favourite uses for the GPT-3 AI language model is generating explanations of how code works. It’s shockingly effective at this: its training set clearly include a vast …
Elixir v1.19 released: type checking of protocols and anonymous functions, broader type inference, improved compile times, and more.
Back in January this year we found a new family of cross-platform backdoors for desktop environments. After the discovery of the binaries for Linux and Windows systems, we have now finally come across the OS X version of Mokes.A.
Earlier this week, I read a really interesting piece on 3 things that need to be done to save the web [https://www.theguardian.com/technology/2017/mar/11/tim-berners-lee-web-inventor-save-internet] . The first observation was that "we’ve lost control of our personal data" and
You've raised a new funding round. You need to staff up. Here's what that looks like.
A few months ago, our AM radio hot dog experiment went mildly viral. That was a result of me asking my Dad 'what would happen if you ground a hot dog to one of your AM radio towers?' He didn't know, so one night on the way to my son's volleyball practice, we tested it. And it was awesome. There's a video and some…
When customers come to us with new and unique requirements for AWS, we listen closely, ask lots of questions, and do our best to understand and address their needs. When we do this, we make the resulting service or feature generally available; we do not build one-offs or “snowflakes” for individual customers. That…
Belts in Karate are ordered from white to black. This is of course a new invention. Originally, new colored belts were not given upon arbitrary levels of attainment, a white belt was given at the beginning of one's training and you just never washed it. Over the years...
Spoiler: Our app template makes it possible.
Twice in the past month KrebsOnSecurity has heard from readers who had their accounts at big-three credit bureau Experian hacked and updated with a new email address that wasn’t theirs. In both cases the readers used password managers to select strong, unique passwords for their Experian accounts. Research suggests…
Keras and PyTorch are both excellent choices for your first deep learning framework. Learn how they differ and which one will suit your needs better.
Following your passion is the worst career advice you can get. Cal Newport argues for a more effective alternative.
We know, "no idea is a bad idea," but brainstorming is often unsuccessful. These prompts actually work. They could even lead to a unique business model.
This entry focuses on Wube Software's long-running Factorio Friday Facts; a seven-year labor of love documenting the creation of the titular video game.
Marc Olson, a long-time Amazonian, discusses the evolution of EBS, highlighting hard-won lessons in queueing theory, the importance of comprehensive instrumentation, and the value of incrementalism versus radical changes. It's an insightful look at how one of AWS’s foundational services has evolved to meet the needs…
A handful of Brooklyn Law students forced a patent troll to drop a meritless lawsuit.