A concise but complete full-attention transformer with a set of promising experimental features from various papers
lucidrains/x-transformers has 5,943 GitHub stars.
It currently ranks #22363 daily, #23062 weekly, #25453 monthly by momentum on Trending Repos; its best-ever rank is #7338.