Remove Duplicate Lines
Clean up lists instantly.
Runs entirely in your browser. Nothing you enter or upload leaves your device.
What the duplicate line remover does
This tool reads a list line by line and removes any line that has already appeared, leaving one copy of each. It also tells you how many lines went in, how many came out, and how many duplicates and empty lines were taken away.
It helps when you merge mailing lists, combine keyword research, clean up a column copied from a spreadsheet, tidy a list of web addresses or tags, or check a guest list for people entered twice.
How to use the duplicate line remover
- Paste your list, one item per line.
- Choose whether to ignore case, trim spaces at line ends and remove empty lines. Trimming and removing empty lines are on to start with.
- Pick an order: keep the original order, sort A → Z or Z → A, shortest first, or numbers ascending.
- Copy or download the cleaned list. Tick List the duplicates that were removed to see what was taken out.
Tips
Two lines only count as duplicates when they match exactly, so the options matter. With Ignore case on, “London” and “london” are treated as the same line. With trimming on, a stray space at the end of a line no longer makes it look unique, and a line holding only spaces counts as empty.
Sorting happens after duplicates are removed. A → Z sorting ignores capitals and accents when it compares lines. Numbers ascending reads the number at the start of each line, and lines that do not start with a number are treated as zero.
Questions
Which copy is kept?
The first occurrence, so the original order is kept unless you choose a sort. With Ignore case on, the line keeps the spelling it had the first time it appeared.
How does sorting handle numbers?
A → Z sorting is natural, so “item 2” comes before “item 10”. Numbers ascending sorts by the number at the start of each line.
Is there a limit?
There is no set limit. The list is processed in your browser, so the size it can handle depends on your device.
Can I compare two lists instead?
To see what changed between two versions of a list, use the diff checker, which compares text line by line.
Is my list uploaded?
No. It is cleaned in this page and is not sent to UtiBox or saved.