Use rsync to compare large directory trees

· Whynothugo · Sept. 19, 2026, 11:51 p.m.
Summary
This blog post discusses the author's experience comparing large directory trees using rsync and diff tools while rewriting backups for better deduplication with restic. The author conducts benchmarks between rsync and diff, noting the efficiency and quirks of each tool, especially with regard to handling file permissions and symlinks. Results show rsync outperforming diff in this specific context, and highlights challenges faced with diffoscope when comparing large datasets containing problematic files.
AUTHOR