1
Effort – a possibly new algorithm for LLM Inference
A possibly new algorithm for LLM Inference. Adjust smoothly - and in real time - how many calculations you'd like to do during inference.
Reports, experiments and field notes on AI, software, and the occasional deep dive into something useful.
Visit kolinko.github.io → On Hacker News Apr 2024 – Apr 2024
A possibly new algorithm for LLM Inference. Adjust smoothly - and in real time - how many calculations you'd like to do during inference.