Re: unable to remove duplicate lines from the attached file

[Eric Blake]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

According to Joseph Butler on 6/13/2008 6:37 AM:
|
| Hello Tech Support:

We're not really paid tech support, just volunteers...

| For some reason, I'm unable to remove duplicate lines using the uniq
utility.

Reread 'uniq --help', particularly this bit:

| Note: 'uniq' does not detect repeated lines unless they are adjacent.
| You may want to sort the input first, or use `sort -u' without `uniq'.

But I don't see any duplicate lines in your test file to begin with:

$ wc < test03
~   7611   22949  121649
$ uniq test03 | wc
~   7611   22949  121649
$ sort -u test03 | wc
~   7611   22949  121649

On a quick inspection, I did see some close matches ("at sea " vs. "at
sea"), but as the trailing space means those aren't identical, and you
didn't explain which lines you thought were duplicates, I don't see any bug.

- --
Don't work too hard, make some time for fun as well!

Eric Blake             address@hidden
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (Cygwin)
Comment: Public key at home.comcast.net/~ericblake/eblake.gpg
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAkhSbgkACgkQ84KuGfSFAYBZtwCfZa6SSqy48GmUB880knz3iNLX
qCgAoIk8XeD0IDZJDjLyc/BhYsiHolf0
=aDId
-----END PGP SIGNATURE-----