1
Eagle 7B: Soaring past Transformers
A brand new era for the RWKV-v5 architecture and linear transformer's has arrived - with the strongest multi-lingual model in open source today
Development blog for the RWKV open source architecture, and their derivative OSS models. Click to read RWKV Open Source Development Blog, a Substack publication with hundreds of subscribers.
Visit blog.rwkv.com → RSS feedOn Hacker News Jan 2024 – Jan 2024
A brand new era for the RWKV-v5 architecture and linear transformer's has arrived - with the strongest multi-lingual model in open source today