3691
New
The latest blog posts to take off on Hacker News. 6,334 posts.
3692
3693
Learn as you search (and browse) using generative AI
New updates to Search Generative Experience (SGE) help people easily learn new things and understand key concepts while searching online.
3694
Open Challenges in LLM Research
[LinkedIn discussion, Twitter thread]
3695
3696
OpenAI acquires Global Illumination
The entire team has joined OpenAI.
3697
How Is LLaMa.cpp Possible?
If you want to read more of my writing, I have a Substack . Articles will be posted simultaneously to both places.
3698
My deep learning rig (2022)
A lot of people have asked about the computers I used to train TorToiSe. I’ve been meaning to snap some pictures, but it’s never “convenient” to turn these servers off so I keep procrastinating. We had some severe thunderstorms today here i
3699
Why host your own LLM?
In the Terminator movies, good relationships beat technological superiority. Kyle Reese and Sarah Connor outwit the advanced T-800 who in turn helps Sarah and John beat the ultra-advanced T-1000. OpenAI’s GPT-4 is currently the most advanced publicly available language model. There are also analyses showing it’s…
3700
3701
Continuous batching to increase LLM inference throughput and reduce p50 latency
In this blog, we discuss continuous batching, a critical systems-level optimization that improves both throughput and latency under load for LLMs.
3702
3703
3704
3705
3706
Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Models
We examine the Llama-2 models under 3 real-world use cases and show that fine-tuning yields significant accuracy improvements.
3707
ML is useful for many things, but not for predicting scientific replicability
How the veneer of AI is used to legitimize awful ideas
3708
There is no hard takeoff
Back in 2014, Elon Musk referred to AI as summoning the demon. And it wasn’t hard to see that view. Soon, Go agents would beat top humans learning from self play. By the end of 2017, the same algorithm mastered Chess and Shogi. By 2020, it didn’t even need tons of calls to the simulator, and could play Atari too.
3709
Artificial General Intelligence – A gentle introduction
[On-line document since 2007, last updated in September 2026] [Translations: 中文 , Español , lietuvių kalba ]
3710
Do Machine Learning Models Memorize or Generalize?
An interactive introduction to grokking and mechanistic interpretability.
3711
Making AMD GPUs competitive for LLM inference
MLC-LLM makes it possible to compile LLMs and deploy them on AMD GPUs using ROCm with competitive performance. More specifically, AMD Radeon™ RX 7900 XTX gives 80% of the speed of NVIDIA® GeForce RTX™ 4090 and 94% of the speed of NVIDIA® GeForce RTX™ 3090Ti for Llama2-7B/13B. Besides ROCm, our Vulkan support allows us…
3712
Llama from scratch, or how to implement a paper without crying
Llama from scratch I want to provide some tips from my experience implementing a paper. I'm going to cover my tips so far from implementing a dramatically...
3713
Testing Intel’s Arc A770 GPU for Deep Learning
This post covers my experience training image classification models with Intel’s PyTorch extension on the Arc A770 GPU.
3714
StableCode
Stability AI has just announced the release of StableCode, its very first LLM generative AI product for coding. This product is designed to assist programmers with their daily work while also providing a great learning tool for new developers ready to take their skills to the next level.
3715
How Zoom’s terms of service and practices apply to AI features
As part of our commitment to transparency and user control, we're providing clarity on our approach to Zoom’s AI features and content sharing for product improvement purposes.
3716
Nvidia's CUDA Monopoly
CUDA (Compute Unified Device Architecture) is a closed-source low-level API that interfaces software with NVIDIA GPUs.
3717
3718
MK-1
AMD acquires MK1, welcoming their world-class team and marking another key milestone in our strategy to advance AI performance and efficiency.
3719
IBM and NASA open-source largest geospatial AI foundation model on Hugging Face
IBM & open-source AI platform Hugging Face today announced that IBM's watsonx.ai geospatial foundation model – built from NASA's satellite data – will now be openly available on Hugging Face.
3720
Double neural bypass restores movement, sense of touch after paralysis
Using brain implants, artificial intelligence and novel stimulation technology, double neural bypass technology restores quadraplegic man’s sense of touch and movement.