Back to trending
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
Python14,593 stars1,008 forksApache-2.0
attention-mechanismchatgptdeep-learninggptgpt-2gpt-3language-modellinear-attentionlstmpytorchrnnrwkvtransformertransformers
Rankings
Daily
#18842
0
Weekly
#1302
19
Monthly
#4064
7
Engagement
Total stars
Daily new stars
Embed suite
Live embeds for your README
This repository is tracked by Trending Repos. Every embed updates itself — and the badge upgrades to a medal tier the moment you crack the top 100. Set it once and forget it.
- ✓ Live star count, refreshed every 4 hours
- ✓ Medal tiers — gold, silver, bronze
- ✓ Best-ever rank, never downgrades
- ✓ Animated (respects reduced-motion)
- ✓ Free, no sign-up
The badge — your medal
Animated rank-tier badge with your live star count built in. Starts bronze, upgrades automatically the moment your repo climbs — gold at #1, silver top-3, bronze top-10. Shows your best-ever rank, permanently.
Markdown — paste into your README
[](https://trending-repos.com/repositories/BlinkDL/RWKV-LM?utm_source=github&utm_medium=badge)The card — your scorecard
Compact momentum card: stars, recent velocity, a 14-day sparkline and your rank tier. The at-a-glance proof your project is moving.
Markdown — paste into your README
[](https://trending-repos.com/repositories/BlinkDL/RWKV-LM?utm_source=github&utm_medium=card)The chart — your proof
A live star-growth chart that replaces static screenshots forever. Light and dark variants; GitHub picks the right one automatically with the HTML snippet.
