case study
Hashing 100,000 JSON Lines Found No Duplicates, Hashing Them With Canon Found 9,900
Event pipelines get the same event twice. A producer times out, retries, and the retry goes through a different service that writes JSON its own way. The usual dedupe is …