GNU bug report logs - #48178
Out of memory error when generating a docker-image.

Previous Next

Full log

View this message in rfc822 format

From: help-debbugs <at> gnu.org (GNU bug Tracking System)
To: Roel Janssen <roel <at> gnu.org>
Cc: tracker <at> debbugs.gnu.org
Subject: bug#48178: closed (Out of memory error when generating a
 docker-image.)
Date: Mon, 10 May 2021 07:47:01 +0000

[Message part 1 (text/plain, inline)]

Your message dated Mon, 10 May 2021 09:46:25 +0200
with message-id <1d6f2f78d43e79457f53d865ae1905385da30006.camel <at> gnu.org>
and subject line Re: bug#48178: Out of memory error when generating a docker-image.
has caused the debbugs.gnu.org bug report #48178,
regarding Out of memory error when generating a docker-image.
to be marked as done.

(If you believe you have received this mail in error, please contact
help-debbugs <at> gnu.org.)


-- 
48178: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=48178
GNU Bug Tracking System
Contact help-debbugs <at> gnu.org with problems

[Message part 2 (message/rfc822, inline)]

From: Roel Janssen <roel <at> gnu.org>
To: bug-guix <at> gnu.org
Subject: Out of memory error when generating a docker-image.
Date: Mon, 03 May 2021 00:09:36 +0200

[Message part 3 (text/plain, inline)]

Dear Guix,

While generating a docker-image that contains only a sshd service, an
nginx service, and an iptables service, it seems the VM that is spawned
to generate a docker image was allocated too little memory.  I attached
the log file.

Looking at 'guix/scripts/system.scm', it seems that we always pass 256M
of memory to the VM.  After bumping that to 4096M, I was able to
produce a docker image.

I'd like to see what we can do here.  Assigning too little memory leads
to problems generating the container, but assigning too much memory wil
l cause problems for computing machines that don't have much memory to
spare.

Would it be a good idea to make it configurable at run-time?

Kind regards,
Roel Janssen

[guix-docker-image.log (text/x-log, attachment)]

[Message part 5 (message/rfc822, inline)]

From: Roel Janssen <roel <at> gnu.org>
To: Efraim Flashner <efraim <at> flashner.co.il>
Cc: 48178-done <at> debbugs.gnu.org, Leo Famulari <leo <at> famulari.name>
Subject: Re: bug#48178: Out of memory error when generating a docker-image.
Date: Mon, 10 May 2021 09:46:25 +0200

On Mon, 2021-05-10 at 10:29 +0300, Efraim Flashner wrote:
> On Mon, May 03, 2021 at 07:47:49PM +0200, Roel Janssen wrote:
> > On Mon, 2021-05-03 at 12:39 -0400, Leo Famulari wrote:
> > > On Mon, May 03, 2021 at 12:09:36AM +0200, Roel Janssen wrote:
> > > > Looking at 'guix/scripts/system.scm', it seems that we always
> > > > pass
> > > > 256M
> > > > of memory to the VM.  After bumping that to 4096M, I was able
> > > > to
> > > > produce a docker image.
> > > 
> > > Can you test somes values that are in between? Like, 512M, 1024M,
> > > etc,
> > > until we know how much is actually required? If 512M is enough, I
> > > don't
> > > see a problem with increasing the hard-coded value to that.
> > > 
> > 
> > I monitored the VM's memory usage and it peaked at 1.6G. But after
> > testing, it seems 1024 also works.
> > 
> > I tested with 2048 (worked), 1024 (worked), and 512 (didn't work).
> > 
> > > > I'd like to see what we can do here.  Assigning too little
> > > > memory
> > > > leads
> > > > to problems generating the container, but assigning too much
> > > > memory
> > > > wil
> > > > l cause problems for computing machines that don't have much
> > > > memory
> > > > to
> > > > spare.
> > > 
> > 
> > In that case... The attached patch would only increase the size
> > when
> > generating a Docker container image.  Would that be acceptable?
> > 
> > > There are some use cases for this code that we'd like to work on
> > > low-resource machines (`guix system vm`), and other use cases
> > > (like
> > > building Docker images) that shouldn't be expected to work on
> > > machines
> > > with limited RAM.
> > > 
> > > > Would it be a good idea to make it configurable at run-time?
> > > 
> > > Yeah, maybe.
> > > 
> > 
> > I think it'd be better to have it somehow dynamically increase, but
> > I
> > don't see how I could determine the VM size needed for a given
> > system
> > configuration.  So perhaps the attached patch is an acceptable
> > compromise.
> > 
> > Kind regards,
> > Roel Janssen
> > 
> 
> Looks good to me!
> 

Thank you for looking at it!  I pushed the proposed patch in
ce3d05cc08c01351756ab5d5b7f25cfe0295c230.

Kind regards,
Roel Janssen

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.