FEATURES / Duplicate Detector
/// Duplicate Detector
Stop paying for the same file stored twice.
Find byte-for-byte duplicate objects across all your buckets using ETag matching. See the exact monthly cost of the redundancy. Remove copies in bulk.
Start for freeSame ETag. Multiple buckets. Exact cost of the redundancy.
/// How it works
Run duplicate detection
Select which buckets to scan — one, several, or all connected accounts. Storafleet compares ETags across all objects in the selected scope and groups matches.
Review duplicate groups
Each group shows all copies of a file: which bucket, which path, the size, and the cost. The total wasted storage and monthly cost is shown at the top.
Delete copies you don't need
Choose which copies to delete per group. Keep the canonical copy, remove the rest. Storafleet applies the deletions to S3 immediately. Storage cost drops at the next billing cycle.
ETag-based exact matching
Storafleet uses S3 ETags (MD5 checksums) to identify byte-for-byte identical objects. If two files have the same ETag, they're the same data — regardless of filename or path.
Cost of redundancy calculated
Each duplicate group shows how many copies exist, total wasted storage, and the exact dollar cost per month. Know what cleaning up is worth before you spend time on it.
Cross-bucket detection
Duplicates are found across all connected buckets — not just within a single bucket. The same file copied across prod, staging, and dev shows as a single duplicate group.
Grouped by ETag
Results are shown as groups of identical objects. Each group displays all copies with their bucket, path, size, and last modified date — so you know which one to keep.
Bulk delete duplicates
Select which copies to delete from each group — keep the one in the right place, remove the rest. Deletions applied to S3 immediately. No scripting required.
Summary: total wasted storage
The detection run shows total duplicate storage found, total monthly cost of the redundancy, and the number of unique groups. Prioritize the groups that cost the most.
/// Without Storafleet
Detecting duplicate S3 objects requires writing a script to list all objects, compute checksums, and group by hash — then figuring out what to delete.
- No native duplicate detection in S3 or the AWS Console
- Detecting duplicates requires listing all objects and comparing checksums — a multi-hour script
- Cross-bucket duplicate detection requires merging data from multiple ListObjectsV2 calls
- No cost quantification — you can't see how much the redundancy costs without manual math
- Deleting specific copies while keeping others requires scripted selection logic
/// With Storafleet
ETag-based duplicate detection across all buckets. Grouped results with wasted cost. Bulk delete in one action.
- ETag-based exact duplicate detection across all connected buckets
- Results grouped by ETag with all copies shown: bucket, path, size, modified date
- Monthly cost of each duplicate group and total wasted storage shown upfront
- Bulk delete: select which copies to remove per group, applied to S3 immediately
- Summary view shows total duplicate storage and cost across the entire detection run
/// When you'll use this
The same build artifacts in 4 places
Your CI pipeline copies artifacts to prod, staging, dev, and an archive bucket. Over 2 years, this has accumulated hundreds of GB of identical files. Storafleet groups them by ETag and shows $34/month of redundant storage. You delete the copies in staging and dev. Bill drops.
Key featureCross-bucket duplicate detection with bulk delete
Users uploading the same stock photo 200 times
Your platform lets users upload images. You notice total storage is growing but unique content isn't. Storafleet detects the same stock photos uploaded by hundreds of users — all with identical ETags. You quantify the redundancy, plan a deduplication strategy, and remove the extras.
Key featureUser-upload duplicate detection with cost quantification
Cleaning up a client's inherited S3 mess
A client migrated from another agency and their S3 has years of duplicate backups across 6 buckets. Before setting up proper lifecycle rules, you run Storafleet's detector to find and remove the worst offenders. 847GB of duplicates, $19/month savings, cleaned in an afternoon.
Key featureFull-account duplicate scan before lifecycle setup
Your storage estate deserves a control plane.
Join the DevOps teams and founders who run every cloud's buckets from one control plane.
Free plan · No credit card · 50+ cloud providers · Cancel any time