mindblown/ Text
Language: English ▾

MINDBLOWN / TEXT · Made for the task at hand

Remove duplicate lines and keep the first occurrence.

Deduplicate a list of text lines without sorting it. Try a five-line example and compare trimming, blank lines and case sensitivity.

Processed on your deviceNo account needed

Remove duplicate lines

Text / 03

The form contains this example. Change the values to try your own input.

Up to 500,000 characters. Character counts use Unicode code points; word counts use locale-aware segmentation when available.

Use duplicate removal to tidy a pasted list while keeping its original order. The example contains five lines but only three distinct values. The tool keeps the first occurrence of each value and removes later matches.

Example input

apple
banana
apple
pear
banana

Expected result

apple
banana
pear

Try it step by step

  1. Inspect the example list, with trimming and removal of blank lines enabled.
  2. Run the tool and check that apple, banana and pear remain in their original order.
  3. Add Apple with a capital A, then compare the result with case-insensitive matching on and off.

How to read the result

By default, apple and Apple are different values. Trimming makes a line with surrounding spaces match the same word without those spaces. Removing duplicates does not sort the list; use the separate sorting tool if order should change.

Limits and important details

Matching applies to whole text lines, not CSV columns or semantic records. Visually similar Unicode characters can still differ. Review important lists before replacing the original.

Open the tool

How to use it

Keep the first occurrence of each line and clean up a list.

Input → Run → Result. Processed on your device.

Your data & advertising

Tool inputs and files are processed in your browser. They are not uploaded or saved by these tools. Reloading clears your work. Downloads and your system clipboard remain under your control.

Production pages display Adsterra ads in frames on a separate origin. The ad provider receives connection data such as your IP address and browser information and may use cookies. It cannot read tool inputs through these frames. Hosting also processes connection metadata.

Adsterra privacy policy