GNU bug report logs - #10877
[sort] too eager to use temp files

Previous Next

Full log

Message #26 received at 10877 <at> debbugs.gnu.org (full text, mbox):

From: Rogier Wolff <R.E.Wolff <at> BitWizard.nl>
To: Pádraig Brady <P <at> draigBrady.com>
Cc: Paul Eggert <eggert <at> cs.ucla.edu>, 10877 <at> debbugs.gnu.org,
	Rogier Wolff <R.E.Wolff <at> BitWizard.nl>
Subject: Re: bug#10877: Wimpy external files.
Date: Sun, 26 Feb 2012 07:53:11 +0100

On Sat, Feb 25, 2012 at 02:59:21PM +0000, Pádraig Brady wrote:
> Some very quick testing here (a while ago), shows -S2M -T/dev/shm
> was as fast or faster than big buffers, as well as being "nicer" to
> the rest of the system.

If that is the case, I expect it is still way faster to sort chunks of
the processor cache size, and then merge them in memory before writing
out chunks of a gigabyte (in my case with 8G RAM) to disk.

On the other hand. I'm not sure how efficient the 500-way merge is
going to be.

	Roger. 

-- 
** R.E.Wolff <at> BitWizard.nl ** http://www.BitWizard.nl/ ** +31-15-2600998 **
**    Delftechpark 26 2628 XH  Delft, The Netherlands. KVK: 27239233    **
*-- BitWizard writes Linux device drivers for any device you may have! --*
The plan was simple, like my brother-in-law Phil. But unlike
Phil, this plan just might work.

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.