kolinko.eu personal blog

Effort – a possibly new algorithm for LLM Inference

A possibly new algorithm for LLM Inference. Adjust smoothly - and in real time - how many calculations you'd like to do during inference.
Points
130
HN comments
4
Submissions
1
Cited by
0 commenters

AI & Machine LearningMath & Algorithms2024

On Hacker News

SubmittedTitle on HNPointsComments
Apr 17, 2024Effort – a possibly new algorithm for LLM Inference by stared1304

Related posts from the same era