How to remove duplicate lines
Paste your list into the left box with one item per line. The right box instantly shows the list with every repeated line removed. The first occurrence of each line is kept, and the original order is preserved, so nothing gets shuffled. A note below the result tells you how many duplicates were removed.
Options explained
- Ignore case treats "Apple", "apple" and "APPLE" as the same line. The first version found is the one kept.
- Ignore leading/trailing spaces trims spaces and tabs from the start and end of each line before comparing. Text copied from spreadsheets and web pages often has invisible trailing spaces that make identical lines look different, so this is on by default.
- Remove empty lines drops blank lines entirely instead of keeping one of them.
What people use it for
Deduplicating email lists before an import, cleaning keyword lists for SEO or PPC research, merging URL lists from different crawls, tidying tags and categories, and removing repeated log entries are some of the most common jobs. Anything with one value per line works.
Need the list sorted too?
This tool keeps your original order on purpose. If you'd rather have the result alphabetical, copy it into Sort Lines, which can also remove duplicates while sorting.
Working with spreadsheets
You can copy a single column from Excel or Google Sheets and paste it here; each cell becomes one line. If you copy several columns, each row becomes one line with tabs between the cells, and a row only counts as a duplicate if every cell matches.
Frequently asked questions
Does it keep the original order?
Yes. The first time each line appears is kept in its original position. Later repeats are removed.
How do I remove duplicates regardless of capital letters?
Tick "Ignore case". Lines that differ only in capitalization will then count as duplicates.
Why weren't two identical-looking lines removed?
They probably contain different invisible characters, such as a trailing space or a non-breaking space. Keep "Ignore leading/trailing spaces" ticked, or run the text through the Text Cleaner first.
How many lines can I process?
Hundreds of thousands of lines work fine in a modern browser. Everything is processed locally, so your list is never uploaded.
Last updated