Skip to content

Magenaut

  • Home
  • Topics
    • Notes
    • Tutorial
    • Bug fixing
    • Extension
    • Server
  • Q&A
  • Privacy Policy
  • About

uniq

How to get only the unique results without having to sort data?

August 11, 2022 by Magenaut

$ cat data.txt aaaaaa aaaaaa cccccc aaaaaa aaaaaa bbbbbb $ cat data.txt | uniq aaaaaa cccccc aaaaaa bbbbbb $ cat data.txt | sort | uniq aaaaaa bbbbbb cccccc $ The result that I need is to display all the lines from the original file removing all the duplicates (not just the consecutive ones), while maintaining … Read more

Categories Q&A, Unix & Linux Tags text-processing, uniq Leave a comment

sum pair of columns based on matching fields

August 11, 2022 by Magenaut

I have a large file in the following format:

Categories Q&A, Unix & Linux Tags awk, sort, text-processing, uniq Leave a comment

How is uniq not unique enough that there is also uniq –unique?

August 10, 2022 by Magenaut

Here are commands on a random file from pastebin:

Categories Q&A, Unix & Linux Tags uniq Leave a comment

How to create an array of unique elements from a string/array in bash?

August 9, 2022 by Magenaut

If I have a string “1 2 3 2 1” – or an array [1,2,3,2,1] – how can I select the unique values, i.e.

Categories Q&A, Unix & Linux Tags array, patterns, string, uniq Leave a comment

How can I remove duplicates in my .bash_history, preserving order?

August 9, 2022 by Magenaut

I really enjoying using control+r to recursively search my command history. I’ve found a few good options I like to use with it:

Categories Q&A, Unix & Linux Tags bash, command-history, command-line, sort, uniq Leave a comment

Uniq won’t remove duplicate

August 8, 2022 by Magenaut

I was using the following command

Categories Q&A, Unix & Linux Tags command-line, curl, uniq Leave a comment

Keeping unique rows based on information from 2 of three columns

August 8, 2022 by Magenaut

Suppose you have a file like this:

Categories Q&A, Unix & Linux Tags awk, uniq Leave a comment

Delete duplicate lines pairwise?

August 8, 2022 by Magenaut

I encountered this use case today. It seems simple at first glance, but fiddling around with sort, uniq, sed and awk revealed that it’s nontrivial.

Categories Q&A, Unix & Linux Tags sed, text-processing, uniq Leave a comment
  1. michealSmith07 on Is there a way to dynamically refresh the less command?August 21, 2022

    That is a very nice post. I like this post.

  2. anonymous on Fix libwacom9 dependency issue when upgrade DebianJune 27, 2022

    saved my day!! Thanks for the help…

  3. sreedhar on Fix libwacom9 dependency issue when upgrade DebianMay 10, 2022

    Thanks its working

  4. saintnick on Fix libwacom9 dependency issue when upgrade DebianMay 10, 2022

    remove libwacom2 worked for me as well

  5. ranafoul on Fix libwacom9 dependency issue when upgrade DebianApril 22, 2022

    apt remove libwacom2 helped on kali 2022.01. gr8

.net ajax asp.net asp.net-core asp.net-mvc asp.net-mvc-3 asp.net-mvc-4 asp.net-web-api bash c# command-line css custom-post-types custom-taxonomy dataframe dictionary django entity-framework functions gridview html iis javascript jquery json linux list matplotlib numpy pandas php plugin-development plugins posts python python-2.7 python-3.x security shell shell-script sql string vb.net webforms wp-query

© 2026 Magenaut • Built with GeneratePress