GNU bug report logs - #60506
feature: parallel grep --recursive

Previous Next

Full log

Message #26 received at 60506 <at> debbugs.gnu.org (full text, mbox):

From: Eike Dierks <foonlyboy <at> gmail.com>
To: 60506 <at> debbugs.gnu.org
Subject: parallel grep
Date: Sat, 7 Jan 2023 01:40:46 +0100

I was thinking about this again.
It looked easy at first, but it is not.

My prime use would be to grep in /usr/include
That would search a lot of files, but only return a few results.
In that case, searching a lot of files in parallel could be beneficial.

But it gets a lot more troublesome,
if you get a lot of results from a single file.
In that case a lot of results would need to be buffered,
so as to give them the very same ordering of the results.
Because the output of grep should always stay stable.

But we could make this explicit:
We could introduce a new option: --parallel (-P)
That would not have any order of the results returned.

I know, that we have to be very conservative about how grep works.
Actually a wrapper with gnu-parallel could do.

I want the grep to make my machine to scream and go.
I want to have grep to use all io and all compute,
and to return results as fast as it can get.

// hi at the grep
// eike

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.