Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.
7 daysStars14.6k24h gain+10Score5.6
Search
Find trending repositories by name or description.
8 results for “deduplication”
RankRepository7 daysStars24h gainScore
Very efficient backup system based on the git packfile format, providing fast incremental saves and global deduplication (among and within files, including virtual machine images). Please post problems or patches to the mailing list for discussion (see the end of the README below).
7 daysStars7.3k24h gain-Score0.0
Fast block-level out-of-band BTRFS deduplication tool.
7 daysStars19724h gain-Score0.0
A practical Douyin downloader for both single-item and profile batch downloads, with progress display, retries, SQLite deduplication, and browser fallback support. 抖音批量下载工具，去水印，支持视频、图集、合集、音乐(原声)。
7 daysStars12.6k24h gain+11Score0.0
Fast Multimodal Semantic Deduplication & Filtering
7 daysStars97224h gain-Score0.0
全自动短视频搬运工具，支持自动下载、去重、AI生成标题+标签、上传，可二开扩展至多平台，例如：TikTok->视频号/抖音/小红书、抖音->TikTok/视频号/小红书......video-processing, automation, tiktok, selenium, pyqt5, ffmpeg, bot, data-scraping, video-deduplication.
7 daysStars45824h gain-Score0.0
一款强大的Python视频去重GUI工具，采用高帧率抽帧混合算法，以规避短视频平台查重。支持GPU加速。video-processing, automation, tiktok, selenium, pyqt5, ffmpeg, bot, data-scraping, video-deduplication.
7 daysStars20024h gain-Score0.0
TeleMem is a high-performance drop-in replacement for Mem0, featuring semantic deduplication, long-term dialogue memory, and multimodal video reasoning.
7 daysStars49324h gain0Score0.0