Tool Gate · How it works
How the Duplicate & Near-Duplicate Finder gate works
How the Duplicate & Near-Duplicate Finder scans 7 sample records for exact-key duplicates and near-duplicate collisions: an exact-key gate flags any record that matches another on the functional key, and the batch reads worst-not-average — which is how one exact match makes the sample batch HAS DUPLICATES.
How the gate works
This tool grades one list for exact copies and sneaky near-matches before you double-count or double-pay. It reads 7 records and rolls them into one verdict — the worst, never the average — and then a gate that can only make it worse.
The 7 records
| Record | Verdict |
|---|---|
| Row 3 · Jane Doe, jane.doe@acme.comfix first | DUPLICATEexact email-key match to row 1 |
| Row 4 · Jane M Doe, jane.doe@mail.acme.com | REVIEWshares phone with row 1, key differs |
| Row 1 · Jane Doe, jane.doe@acme.com | UNIQUEfirst occurrence |
| Row 2 · Bob Smith, bob.smith@widgetco.io | UNIQUEno prior match |
| Row 5 · Carla Nguyen, carla.n@northstar.co | UNIQUEno prior match |
| Row 6 · Dmitri Volkov, d.volkov@orbit.dev | UNIQUEno prior match |
| Row 7 · Priya Patel, priya@lumen.studio | UNIQUEno prior match |
The verdict bands
An exact email-key match to an earlier record is a DUPLICATE no matter what else differs, and a shared name or phone with a different email is only a REVIEW - but one DUPLICATE is enough to hold the whole batch at HAS DUPLICATES, whatever share of records are otherwise unique.
In the worked sample it reads HAS DUPLICATES — Five of seven records are unique and one is a near-match worth a review - a mail-relay alias for Jane Doe sharing her phone number. But row 3 is an exact email match to row 1, so it's a DUPLICATE outright. Batch status is the worst record, never the average, so it reads HAS DUPLICATES. The one thing to fix first: Row 3, the second jane.doe@acme.com - merge it into row 1 before touching the review; an exact key match is the least ambiguous call in the set..
Common questions
Can every record look survivable on the How the Duplicate & Near-Duplicate Finder gate works and the company still read HAS DUPLICATES?
Yes. The roll-up takes the worst of 7 records — never the average — then a worsen-only gate, the Exact-key duplicate gate, escalates when trouble clusters. In the worked sample it reads HAS DUPLICATES because five of seven records are unique and one is a near-match worth a review - a mail-relay alias for Jane Doe sharing her phone number. But row 3 is an exact email match to row 1, so it's a DUPLICATE outright. Batch status is the worst record, never the average, so it reads HAS DUPLICATES.
What is a worsen-only gate?
A dispositive rule that can only lower a verdict, never raise it. One fatal flaw overrides an otherwise-set of survivable lines, because a single disqualifying gap shouldn't hide behind an average of the healthy ones. The tool also names the one thing to fix first — here, "Row 3, the second jane.doe@acme.com - merge it into row 1 before touching the review; an exact key match is the least ambiguous call in the set.".
Matches on the fields you provide using exact and shared-field rules; it does not merge records for you and does not identify people beyond the data given.
Embed this diagram
Free to share and embed with attribution (CC BY 4.0) — keep the link to redhub.ai.
Interactive — renders the live diagram
<iframe src="https://redhub.ai/visuals/tool/duplicate-near-duplicate-finder.html" title="How the Duplicate & Near-Duplicate Finder gate works — RedHub AI" width="760" height="1872" loading="lazy" style="border:0;width:100%;max-width:760px"></iframe>
<p style="font:14px/1.5 system-ui,sans-serif"><a href="https://redhub.ai/visuals/tool/duplicate-near-duplicate-finder">How the Duplicate & Near-Duplicate Finder gate works</a> — by <a href="https://redhub.ai">RedHub AI</a>, the AI that tells you when to doubt it.</p>Image + link — a static picture for any blog
<a href="https://redhub.ai/visuals/tool/duplicate-near-duplicate-finder"><img src="https://redhub.ai/visuals/tool/duplicate-near-duplicate-finder-share.png" alt="Diagram of the Duplicate & Near-Duplicate Finder: seven records rolled up worst-not-average, an exact-key duplicate gate, and the batch reading HAS DUPLICATES on one exact match." width="760" loading="lazy" style="max-width:100%;height:auto;border-radius:16px"></a>
<p style="font:14px/1.5 system-ui,sans-serif"><a href="https://redhub.ai">RedHub AI</a> — the AI that tells you when to doubt it.</p>
This is how Duplicate & Near-Duplicate Finder works. More diagrams in the Visual Field Guide.