GNU bug report logs - #13089
Wish: split every n'th into n pipes

Previous Next

Full log

View this message in rfc822 format

From: Ole Tange <tange <at> gnu.org>
To: 13089 <at> debbugs.gnu.org
Subject: bug#13089: Wish: split every n'th into n pipes
Date: Wed, 5 Dec 2012 15:11:32 +0100

I often have data that can be processed in parallel.

It would be great if split --filter could look at every n'th line
instead of chunking into n chunks:

  cat bigfile | split --every-nth -n 8 --filter "grep foo"

The above should start 8 greps and give each a line in round robin manner.

Ideally it should be possible to do so non-blocking so if some lines
take longer for one instance of grep, then the rest of the greps are
not blocked.


/Ole

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.