In this article
Where duplicates come from
- Merging contact lists from a form, a spreadsheet and a phone.
- Exporting keywords from several SEO tools.
- Copying product codes or order numbers from multiple reports.
- Guests or students who registered twice.
Step 1: Put one item on each line
The tool works line by line. If your list is comma-separated, replace commas with line breaks first using Find and Replace (enable regular expressions and replace ,\s* with \n). From a spreadsheet, simply copy one column – each cell becomes a line.
Step 2: Normalise so real duplicates match
Duplicates are often not exactly identical. “Ali@Example.com” and “ali@example.com ” (with a trailing space) are the same address. The tool ignores spaces at the start and end of lines and can match case-insensitively. For other differences, clean up first:
| List | Normalise first |
|---|---|
| Email addresses | Ignore case (addresses are effectively case-insensitive) |
| Phone numbers | Use one format: e.g. +92 3001234567 vs 0300-1234567 – remove dashes and spaces, use the same prefix |
| Keywords | Ignore case; remove extra inner spaces with Remove Extra Spaces |
| Product codes | Keep case-sensitive if “AB12” and “ab12” are different products |
Step 3: Remove duplicates
- Paste the list into Remove Duplicate Lines.
- Tick case-insensitive matching if appropriate.
- Choose to keep the original order or sort A–Z / Z–A.
- See how many duplicates and empty lines were removed, then copy the clean list.
Check what was removed
After cleaning, look at the counts. If a list of 500 emails drops to 120, something may be wrong – for example, a column of names was pasted instead of addresses, or every line contained the same text. A reasonable duplicate rate for merged contact lists is usually between a few percent and a third. When the number looks surprising, compare the before and after lists before you use the result.
Keep the first or the order?
Keeping the original order is usually best: the first occurrence stays where it was, so a list ranked by importance or date keeps its meaning. Sort alphabetically when you want to scan the list or compare it with another one.
Comparing two lists
Need to know who is on list A but not list B – for example, people who registered but did not attend? Sort both lists with Sort Lines and compare them with Text Compare; the differences are highlighted line by line.
Email list hygiene
Removing duplicates is only the first step. Before sending a newsletter, also remove obviously invalid addresses (missing @, spaces inside), and only email people who agreed to receive messages from you. Many countries have laws about marketing emails, and sending to people who did not opt in hurts your sender reputation.
Privacy
Contact lists are personal data. The tool runs entirely in your browser; your list is never uploaded or stored.