1
Fast and Portable Llama2 Inference on the Heterogeneous Edge
Fast and Portable Llama2 Inference on the Heterogeneous Edge.
Cloud-native runtime for serverless functions and microservices on edge clouds, SaaS platforms, data platforms, and next-gen blockchains.
Visit secondstate.io → On Hacker News Nov 2023 – Nov 2023
AI & Machine Learning 2Software Engineering 1Infrastructure & DevOps 1
Fast and Portable Llama2 Inference on the Heterogeneous Edge.
Fast and Portable Llama2 Inference on the Heterogeneous Edge.