GNU bug report logs - #50353
Excessive temproots size when running guix build

Previous Next

To reply to this bug, email your comments to 50353 AT debbugs.gnu.org.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Christopher Baines <mail <at> cbaines.net>
To: bug-guix <at> gnu.org
Subject: Excessive temproots size when running guix build
Date: Fri, 03 Sep 2021 10:53:52 +0100

[Message part 1 (text/plain, inline)]

I spotted a problem with data.guix.gnu.org trying to process this old
revision [1]

1: https://data.guix.gnu.org/revision/75dabac633bb9a33efbebf859f8aa4bb3b9582b2

The machine ran out of disk space, as a ~30GiB file had been created in
/var/guix/temproots.

I think I can reproduce the situation by running this command.

  guix time-machine --commit=75dabac633bb9a33efbebf859f8aa4bb3b9582b2 -- build --system=armhf-linux guix

It's the build of the guix package that seems to be involved.

For some reason though, I can't reproduce this on my local machine, I
get a build failure for [2].

2: /gnu/store/cz4sr5whzf3qhp8c47bzlfzcxxwl485i-python2-2.7.15.drv

Any ideas? Is there a known issue (perhaps with grafts) for old
revisions of Guix which could lead to excessive temproots file sizes in
some situations?

[signature.asc (application/pgp-signature, inline)]

Message #8 received at 50353 <at> debbugs.gnu.org (full text, mbox):

From: Ludovic Courtès <ludo <at> gnu.org>
To: Christopher Baines <mail <at> cbaines.net>
Cc: 50353 <at> debbugs.gnu.org
Subject: Re: bug#50353: Excessive temproots size when running guix build
Date: Mon, 06 Sep 2021 23:18:18 +0200

Hi,

Christopher Baines <mail <at> cbaines.net> skribis:

> I spotted a problem with data.guix.gnu.org trying to process this old
> revision [1]
>
> 1: https://data.guix.gnu.org/revision/75dabac633bb9a33efbebf859f8aa4bb3b9582b2
>
> The machine ran out of disk space, as a ~30GiB file had been created in
> /var/guix/temproots.

Sounds fishy.  Those files contain a nul-separated list of GC roots
(store file names).  Thus, a file in there is proportional to the number
of ‘add-temp-root’ RPCs made by the client during the session.

A client with a long-running session (‘guix publish’, Coordinator, Data
Service, Cuirass, etc.) that regularly adds temp roots makes that file
grow endlessly.

HTH!

Ludo’.

Message #11 received at 50353 <at> debbugs.gnu.org (full text, mbox):

From: Maxime Devos <maximedevos <at> telenet.be>
To: Ludovic Courtès <ludo <at> gnu.org>, Christopher Baines
 <mail <at> cbaines.net>
Cc: 50353 <at> debbugs.gnu.org
Subject: Re: bug#50353: Excessive temproots size when running guix build
Date: Tue, 07 Sep 2021 11:45:33 +0200

[Message part 1 (text/plain, inline)]

Ludovic Courtès schreef op ma 06-09-2021 om 23:18 [+0200]:
> Hi,
> 
> Christopher Baines <mail <at> cbaines.net> skribis:
> 
> > I spotted a problem with data.guix.gnu.org trying to process this old
> > revision [1]
> > 
> > 1: https://data.guix.gnu.org/revision/75dabac633bb9a33efbebf859f8aa4bb3b9582b2
> > 
> > The machine ran out of disk space, as a ~30GiB file had been created in
> > /var/guix/temproots.
> 
> Sounds fishy.  Those files contain a nul-separated list of GC roots
> (store file names).  Thus, a file in there is proportional to the number
> of ‘add-temp-root’ RPCs made by the client during the session.
> 
> A client with a long-running session (‘guix publish’, Coordinator, Data
> Service, Cuirass, etc.) that regularly adds temp roots makes that file
> grow endlessly.

FWIW, temp roots are added in ‘DerivationGoal::DerivationGoal’
when building things, and ‘DerivationGOal::haveDerivation’,
‘SubstitutionGoal::init’, ‘LocalStore::optimiseStore’
‘LocalStore::addToStoreFromDump’, ‘LocalStore::addTextToStore’,
‘LocalStore::createTempDirInStore’ and ‘LocalStore::importPath’.

I.e., temp roots are not only added from the add-temp-root RPC.

Greetings,
Maxime.

[signature.asc (application/pgp-signature, inline)]

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.