Topics /

AI & Machine Learning

The most popular blog posts about ai & machine learning on Hacker News. 402 posts.

2023
61

Non-determinism in GPT-4 is caused by Sparse MoE

It’s well-known at this point that GPT-4/GPT-3.5-turbo is non-deterministic, even at temperature=0.0. This is an odd behavior if you’re used to dense decoder-only models, where temp=0 should imply greedy sampling which should imply full determinism, because the logits for the next token should be a pure function of…

88

Gaussian splatting is pretty cool

SIGGRAPH 2023 just had a paper “ 3D Gaussian Splatting for Real-Time Radiance Field Rendering ” by Kerbl, Kopanas, Leimkühler, Drettakis, and it looks pretty cool! Check out their website, source code repository, data sets and so on (I should note that it is really, really good to see full source and full data sets…