Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
huggingface/datatrove has 3,363 GitHub stars.
It currently ranks #28927 daily, #29394 weekly, #31176 monthly by momentum on Trending Repos; its best-ever rank is #5377.