Remove Duplicate Lines
Clean up email lists, keyword lists, log files or any list with repeats. Paste it in and get each line once, in its original order. Your list never leaves your device.
How to remove duplicate lines
- 1Paste your list, one item per line, or open a .txt or .csv file.
- 2Choose whether case and extra spaces matter, and whether to keep the first or last copy.
- 3Copy the cleaned list or download it.
Order is kept
Lines stay in their original order; only the repeats are taken out. To sort the list as well, use Sort Lines, which can also remove duplicates.
Near-duplicates
With “Match case” off, “Apple” and “apple” count as the same line. With “Ignore spaces” on, spaces at the start or end of a line don't make it different. The count of removed lines appears under the result.
Big lists
Lists with hundreds of thousands of lines work fine, because it all runs on your own device without uploading anything.
Frequently asked questions
- Is my list uploaded?
- No. Everything happens in your browser, so even private lists such as customer emails stay on your device.
- Which copy is kept?
- The first one by default, so the list keeps its original order. Choose “Last copy” to keep the latest occurrence instead.
- Can it dedupe a CSV by one column?
- It compares whole lines. For a CSV, two rows count as duplicates only when every column matches.