uniq will only work on an already sorted file.

sort first, then uniq if desired.

Bob Ammerman
RAm Systems

----- Original Message -----
From: "Peter L. Peres" <plp@ACTCOM.CO.IL>
To: <PICLIST@MITVMA.MIT.EDU>
Sent: Thursday, November 28, 2002 12:39 PM
Subject: Re: [OT]:Sorting large files


> On Wed, 27 Nov 2002, Brendan Moran wrote:
>
> *>Does anyone know of an algorithm for sorting extremely large files of
> *>linebreak-separated, case-sensitive ASCII values?
> *>
> *>I have a file that is 3,480,231kB of unsorted ASCII values, and I need
it
> *>sorted... and, yes, I do have some idea of the time that this will take.
> *>
> *>I'm using WinXP for this, so win32 compatible utilities are a good thing
> *>for me.
>
> Get GNU sort.exe and uniq.exe and use them as in:
>
> uniq thefile.dat >tmp1.dat
> sort tmp1.dat >out.dat
>
> If you do not care about duplicates you can skip uniq.
>
> Peter
>
> --
> http://www.piclist.com hint: PICList Posts must start with ONE topic:
> [PIC]:,[SX]:,[AVR]: ->uP ONLY! [EE]:,[OT]: ->Other [BUY]:,[AD]: ->Ads
>
>

--
http://www.piclist.com hint: The list server can filter out subtopics
(like ads or off topics) for you. See http://www.piclist.com/#topics