GNU bug report logs - #25625
Opening djvu file eats up all my RAM

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 25625 in the body.
You can then email your comments to 25625 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Antoine Levitt <antoine.levitt <at> inria.fr>
To: bug-gnu-emacs <at> gnu.org
Subject: Opening djvu file eats up all my RAM
Date: Sun, 05 Feb 2017 09:50:28 +0100

Hi,

When opening a djvu file, emacs eats up all my RAM and subsequently
crashes my system. I can reproduce this from emacs -Q with a few djvu
files I have. I can't post them publicly, but I can send them to anyone
interested.

I'm using emacs 25.1.1 with the following config, if that matters.

Best,
Antoine

  Where should the build process find the source code?    .
  What compiler should emacs be built with?               gcc -g3 -O2
  Should Emacs use the GNU version of malloc?             yes
      (Using Doug Lea's new malloc from the GNU C Library.)
  Should Emacs use a relocating allocator for buffers?    no
  Should Emacs use mmap(2) for buffer allocation?         no
  What window system should Emacs use?                    x11
  What toolkit should Emacs use?                          GTK3
  Where do we find X Windows header files?                Standard dirs
  Where do we find X Windows libraries?                   Standard dirs
  Does Emacs use -lXaw3d?                                 no
  Does Emacs use -lXpm?                                   yes
  Does Emacs use -ljpeg?                                  yes
  Does Emacs use -ltiff?                                  yes
  Does Emacs use a gif library?                           yes -lgif
  Does Emacs use a png library?                           yes -lpng12
  Does Emacs use -lrsvg-2?                                yes
  Does Emacs use cairo?                                   no
  Does Emacs use imagemagick?                             yes
  Does Emacs support sound?                               yes
  Does Emacs use -lgpm?                                   yes
  Does Emacs use -ldbus?                                  yes
  Does Emacs use -lgconf?                                 yes
  Does Emacs use GSettings?                               yes
  Does Emacs use a file notification library?             yes -lglibc (inotify)
  Does Emacs use access control lists?                    no
  Does Emacs use -lselinux?                               yes
  Does Emacs use -lgnutls?                                yes
  Does Emacs use -lxml2?                                  yes
  Does Emacs use -lfreetype?                              yes
  Does Emacs use -lm17n-flt?                              yes
  Does Emacs use -lotf?                                   yes
  Does Emacs use -lxft?                                   yes
  Does Emacs use -lsystemd?                               no
  Does Emacs directly use zlib?                           yes
  Does Emacs have dynamic modules support?                no
  Does Emacs use toolkit scroll bars?                     yes
  Does Emacs support Xwidgets (requires gtk3)?            no

Message #8 received at 25625 <at> debbugs.gnu.org (full text, mbox):

From: Eli Zaretskii <eliz <at> gnu.org>
To: Antoine Levitt <antoine.levitt <at> inria.fr>
Cc: 25625 <at> debbugs.gnu.org
Subject: Re: bug#25625: Opening djvu file eats up all my RAM
Date: Sun, 05 Feb 2017 20:31:48 +0200

> From: Antoine Levitt <antoine.levitt <at> inria.fr>
> Date: Sun, 05 Feb 2017 09:50:28 +0100
> 
> When opening a djvu file, emacs eats up all my RAM and subsequently
> crashes my system. I can reproduce this from emacs -Q with a few djvu
> files I have. I can't post them publicly, but I can send them to anyone
> interested.

Is it doc-view-mode that tries to display djvu files?

Message #11 received at 25625 <at> debbugs.gnu.org (full text, mbox):

From: Antoine Levitt <antoine.levitt <at> inria.fr>
To: Eli Zaretskii <eliz <at> gnu.org>
Cc: 25625 <at> debbugs.gnu.org
Subject: Re: bug#25625: Opening djvu file eats up all my RAM
Date: Sun, 05 Feb 2017 19:35:53 +0100

Not, it's image-mode: opening a blank .djvu file in emacs -Q gives me

Image minor mode (indicator Image[imagemagick]):
Toggle Image minor mode in this buffer.
With a prefix argument ARG, enable Image minor mode if ARG is
positive, and disable it otherwise.  If called from Lisp, enable
the mode if ARG is omitted or nil.

Image minor mode provides the key C-c C-c,
to switch back to ‘image-mode’ and display an image file as the
actual image.

05 February 2017 19:31 +0100, Eli Zaretskii <eliz <at> gnu.org>:
>> From: Antoine Levitt <antoine.levitt <at> inria.fr>
>> Date: Sun, 05 Feb 2017 09:50:28 +0100
>> 
>> When opening a djvu file, emacs eats up all my RAM and subsequently
>> crashes my system. I can reproduce this from emacs -Q with a few djvu
>> files I have. I can't post them publicly, but I can send them to anyone
>> interested.
>
> Is it doc-view-mode that tries to display djvu files?

Message #14 received at 25625 <at> debbugs.gnu.org (full text, mbox):

From: Eli Zaretskii <eliz <at> gnu.org>
To: Antoine Levitt <antoine.levitt <at> inria.fr>
Cc: 25625 <at> debbugs.gnu.org
Subject: Re: bug#25625: Opening djvu file eats up all my RAM
Date: Sun, 05 Feb 2017 21:40:37 +0200

> From: Antoine Levitt <antoine.levitt <at> inria.fr>
> Cc: 25625 <at> debbugs.gnu.org
> Date: Sun, 05 Feb 2017 19:35:53 +0100
> 
> Not, it's image-mode: opening a blank .djvu file in emacs -Q gives me
> 
> Image minor mode (indicator Image[imagemagick]):

What version of ImageMagick do you have?

Message #17 received at 25625 <at> debbugs.gnu.org (full text, mbox):

From: Antoine Levitt <antoine.levitt <at> inria.fr>
To: Eli Zaretskii <eliz <at> gnu.org>
Cc: 25625 <at> debbugs.gnu.org
Subject: Re: bug#25625: Opening djvu file eats up all my RAM
Date: Sun, 05 Feb 2017 20:43:57 +0100

Standard imagemagick from linux mint 18.1:

antoine <at> epsilon:~$ convert --version
Version: ImageMagick 6.8.9-9 Q16 x86_64 2016-11-29 http://www.imagemagick.org
Copyright: Copyright (C) 1999-2014 ImageMagick Studio LLC
Features: DPC Modules OpenMP
Delegates: bzlib cairo djvu fftw fontconfig freetype jbig jng jpeg lcms lqr ltdl lzma openexr pangocairo png rsvg tiff wmf x xml zlib

05 February 2017 20:40 +0100, Eli Zaretskii <eliz <at> gnu.org>:
>> From: Antoine Levitt <antoine.levitt <at> inria.fr>
>> Cc: 25625 <at> debbugs.gnu.org
>> Date: Sun, 05 Feb 2017 19:35:53 +0100
>> 
>> Not, it's image-mode: opening a blank .djvu file in emacs -Q gives me
>> 
>> Image minor mode (indicator Image[imagemagick]):
>
> What version of ImageMagick do you have?

Message #20 received at 25625 <at> debbugs.gnu.org (full text, mbox):

From: Noam Postavsky <npostavs <at> gmail.com>
To: Antoine Levitt <antoine.levitt <at> inria.fr>
Cc: 25625 <at> debbugs.gnu.org
Subject: Re: bug#25625: Opening djvu file eats up all my RAM
Date: Tue, 05 Jun 2018 19:44:14 -0400

Antoine Levitt <antoine.levitt <at> inria.fr> writes:

> When opening a djvu file, emacs eats up all my RAM and subsequently
> crashes my system. I can reproduce this from emacs -Q with a few djvu
> files I have. I can't post them publicly, but I can send them to anyone
> interested.
>
> I'm using emacs 25.1.1 with the following config, if that matters.

Does this still happen in Emacs 26?  There's been some changes regarding
the memory allocaters selected.

Message #23 received at 25625 <at> debbugs.gnu.org (full text, mbox):

From: Antoine Levitt <antoine.levitt <at> inria.fr>
To: Noam Postavsky <npostavs <at> gmail.com>
Cc: 25625 <at> debbugs.gnu.org
Subject: Re: bug#25625: Opening djvu file eats up all my RAM
Date: Wed, 06 Jun 2018 07:52:13 +0200

06 June 2018 01:44 +02, Noam Postavsky <npostavs <at> gmail.com>:
> Antoine Levitt <antoine.levitt <at> inria.fr> writes:
>
>> When opening a djvu file, emacs eats up all my RAM and subsequently
>> crashes my system. I can reproduce this from emacs -Q with a few djvu
>> files I have. I can't post them publicly, but I can send them to anyone
>> interested.
>>
>> I'm using emacs 25.1.1 with the following config, if that matters.
>
> Does this still happen in Emacs 26?  There's been some changes regarding
> the memory allocaters selected.

Confirmed in Emacs 26.1.

Message #30 received at 25625 <at> debbugs.gnu.org (full text, mbox):

From: Noam Postavsky <npostavs <at> gmail.com>
To: Antoine Levitt <antoine.levitt <at> inria.fr>
Cc: 25625 <at> debbugs.gnu.org
Subject: Re: bug#25625: Opening djvu file eats up all my RAM
Date: Wed, 06 Jun 2018 19:43:02 -0400

[Message part 1 (text/plain, inline)]

Antoine Levitt <antoine.levitt <at> inria.fr> writes:

> When opening a djvu file, emacs eats up all my RAM and subsequently
> crashes my system. I can reproduce this from emacs -Q with a few djvu
> files I have. I can't post them publicly, but I can send them to anyone
> interested.

Yes, can you send it to me please?

(you can get my PGP key at
https://savannah.gnu.org/people/viewgpg.php?user_id=102411 if you'd like
to encrypt it)

[signature.asc (application/pgp-signature, inline)]

Message #33 received at 25625 <at> debbugs.gnu.org (full text, mbox):

From: Noam Postavsky <npostavs <at> gmail.com>
To: Antoine Levitt <antoine.levitt <at> inria.fr>
Cc: Eli Zaretskii <eliz <at> gnu.org>, 25625 <at> debbugs.gnu.org
Subject: Re: bug#25625: Opening djvu file eats up all my RAM
Date: Thu, 07 Jun 2018 07:47:12 -0400

tags 25625 + unreproducible
quit

Antoine Levitt <antoine.levitt <at> inria.fr> writes:

> Standard imagemagick from linux mint 18.1:
>
> antoine <at> epsilon:~$ convert --version
> Version: ImageMagick 6.8.9-9 Q16 x86_64 2016-11-29 http://www.imagemagick.org
> Copyright: Copyright (C) 1999-2014 ImageMagick Studio LLC
> Features: DPC Modules OpenMP
> Delegates: bzlib cairo djvu fftw fontconfig freetype jbig jng jpeg lcms lqr ltdl lzma openexr pangocairo png rsvg tiff wmf x xml zlib

I'm not able to reproduce the problem, I can read the file you sent
without trouble, albeit pretty slowly.  It takes about ~15s to go to the
next page, during which time I see (in top) Emacs' memory usage go up,
but it goes back down again after the page is displayed.  Perhaps the
imagemagick version is the problem?

~$ convert --version
Version: ImageMagick 6.9.7-4 Q16 x86_64 20170114 http://www.imagemagick.org
Copyright: © 1999-2017 ImageMagick Studio LLC
License: http://www.imagemagick.org/script/license.php
Features: Cipher DPC Modules OpenMP 
Delegates (built-in): bzlib djvu fftw fontconfig freetype jbig jng jp2 jpeg lcms lqr ltdl lzma openexr pangocairo png tiff wmf x xml zlib

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND   
23078 npostavs  20   0 1390832 831836 535952 D  42.9 20.9   2:08.71 emacs //{while going to next page}
23078 npostavs  20   0  679200 120040  26632 S   0.0  3.0   2:21.38 emacs //{after page is displayed}

By the way (sorry I forgot to suggest this before asking you to retest)
if you use ulimit to cap virtual mem at say 2GB 'ulimit -v $((2 * 1024
1024))' does Emacs give you an out of memory error instead of crashing
your system?

Message #38 received at 25625 <at> debbugs.gnu.org (full text, mbox):

From: Antoine Levitt <antoine.levitt <at> inria.fr>
To: Noam Postavsky <npostavs <at> gmail.com>
Cc: Eli Zaretskii <eliz <at> gnu.org>, 25625 <at> debbugs.gnu.org
Subject: Re: bug#25625: Opening djvu file eats up all my RAM
Date: Thu, 7 Jun 2018 14:43:51 +0200

[Message part 1 (text/plain, inline)]

With ulimit I get

libgomp: Thread creation failed: Resource temporarily unavailable

On Thu, 7 Jun 2018 at 13:47, Noam Postavsky <npostavs <at> gmail.com> wrote:

> tags 25625 + unreproducible
> quit
>
> Antoine Levitt <antoine.levitt <at> inria.fr> writes:
>
> > Standard imagemagick from linux mint 18.1:
> >
> > antoine <at> epsilon:~$ convert --version
> > Version: ImageMagick 6.8.9-9 Q16 x86_64 2016-11-29
> http://www.imagemagick.org
> > Copyright: Copyright (C) 1999-2014 ImageMagick Studio LLC
> > Features: DPC Modules OpenMP
> > Delegates: bzlib cairo djvu fftw fontconfig freetype jbig jng jpeg lcms
> lqr ltdl lzma openexr pangocairo png rsvg tiff wmf x xml zlib
>
> I'm not able to reproduce the problem, I can read the file you sent
> without trouble, albeit pretty slowly.  It takes about ~15s to go to the
> next page, during which time I see (in top) Emacs' memory usage go up,
> but it goes back down again after the page is displayed.  Perhaps the
> imagemagick version is the problem?
>
> ~$ convert --version
> Version: ImageMagick 6.9.7-4 Q16 x86_64 20170114
> http://www.imagemagick.org
> Copyright: © 1999-2017 ImageMagick Studio LLC
> License: http://www.imagemagick.org/script/license.php
> Features: Cipher DPC Modules OpenMP
> Delegates (built-in): bzlib djvu fftw fontconfig freetype jbig jng jp2
> jpeg lcms lqr ltdl lzma openexr pangocairo png tiff wmf x xml zlib
>
>   PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+
> COMMAND
> 23078 npostavs  20   0 1390832 831836 535952 D  42.9 20.9   2:08.71 emacs
> //{while going to next page}
> 23078 npostavs  20   0  679200 120040  26632 S   0.0  3.0   2:21.38 emacs
> //{after page is displayed}
>
> By the way (sorry I forgot to suggest this before asking you to retest)
> if you use ulimit to cap virtual mem at say 2GB 'ulimit -v $((2 * 1024
> 1024))' does Emacs give you an out of memory error instead of crashing
> your system?
>

[Message part 2 (text/html, inline)]

Message #41 received at 25625 <at> debbugs.gnu.org (full text, mbox):

From: Lars Ingebrigtsen <larsi <at> gnus.org>
To: Antoine Levitt <antoine.levitt <at> inria.fr>
Cc: 25625 <at> debbugs.gnu.org
Subject: Re: bug#25625: Opening djvu file eats up all my RAM
Date: Thu, 10 Feb 2022 09:02:54 +0100

Antoine Levitt <antoine.levitt <at> inria.fr> writes:

> When opening a djvu file, emacs eats up all my RAM and subsequently
> crashes my system. I can reproduce this from emacs -Q with a few djvu
> files I have. I can't post them publicly, but I can send them to anyone
> interested.

(I'm going through old bug reports that unfortunately weren't resolved
at the time.)

Are you still seeing this problem in recent Emacs versions?

-- 
(domestic pets only, the antidote for overdose, milk.)
   bloggy blog: http://lars.ingebrigtsen.no

Message #46 received at 25625 <at> debbugs.gnu.org (full text, mbox):

From: Lars Ingebrigtsen <larsi <at> gnus.org>
To: Antoine Levitt <antoine.levitt <at> inria.fr>
Cc: 25625 <at> debbugs.gnu.org
Subject: Re: bug#25625: Opening djvu file eats up all my RAM
Date: Sat, 12 Mar 2022 23:44:34 +0100

Lars Ingebrigtsen <larsi <at> gnus.org> writes:

> Are you still seeing this problem in recent Emacs versions?

More information was requested, but no response was given within a
month, so I'm closing this bug report.  If the problem still exists,
please respond to this email and we'll reopen the bug report.

-- 
(domestic pets only, the antidote for overdose, milk.)
   bloggy blog: http://lars.ingebrigtsen.no

Message #51 received at 25625 <at> debbugs.gnu.org (full text, mbox):

From: Antoine Levitt <antoine.levitt <at> inria.fr>
To: Lars Ingebrigtsen <larsi <at> gnus.org>
Cc: 25625 <at> debbugs.gnu.org
Subject: Re: bug#25625: Opening djvu file eats up all my RAM
Date: Sun, 13 Mar 2022 13:57:53 +0100

I haven't seen this in a while, and I just opened a djvu fine (though I
had to install a package and the emacs error message was pretty
unhelpful), so I guess this is fixed.

12 March 2022 23:44 +01, Lars Ingebrigtsen:
> Lars Ingebrigtsen <larsi <at> gnus.org> writes:
>
>> Are you still seeing this problem in recent Emacs versions?
>
> More information was requested, but no response was given within a
> month, so I'm closing this bug report.  If the problem still exists,
> please respond to this email and we'll reopen the bug report.

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.