Remove repeated lines from any block of text while preserving the original order of first occurrences. Case-sensitive and case-insensitive deduplication modes supported.
Key Features
Removes duplicate lines while preserving original appearance order
Supports case-sensitive and case-insensitive comparison modes
Option to trim leading/trailing whitespace before comparing lines
Displays count of total lines, unique lines remaining, and duplicates purged
How to Use
Paste your multi-line text or list into the input box.
Select whether comparisons should be case-sensitive or insensitive.
Choose whether to trim whitespace before checking for duplicates.
Click "Remove Duplicates" to filter out repeated lines.
Copy the unique list of lines to your clipboard.
Example
Sample input
alpha
beta
alpha
gamma
beta
Sample output
alpha
beta
gamma
Edge Cases
Case-sensitive vs insensitive comparison
Trim whitespace before comparing
Blank lines treated as duplicates
Frequently Asked Questions
Does deduplication alter the order of items in my list?
No. The first occurrence of each unique line is kept in its exact original position; only subsequent duplicate occurrences are removed.
Can this tool handle whitespace variations between identical lines?
Yes. Enabling the "Trim Whitespace" option strips leading and trailing spaces before comparing, ensuring lines like "apple " and "apple" match.
Is there any line count limit when deduplicating text?
The tool processes lists with tens of thousands of lines in fractions of a second using efficient browser hash-sets.
Privacy notice: when you run this tool, your input is sent over HTTPS to our server, processed in memory and returned. It is not stored or logged. Avoid pasting live secrets such as private keys or passwords.