GNU bug report logs - #25045
[Website] Packages page takes too long to load

Previous Next

Package: guix;

Reported by: Luis Felipe López Acevedo <felipe.lopez <at> openmailbox.org>

Date: Sun, 27 Nov 2016 19:20:02 UTC

Severity: normal

Done: ludo <at> gnu.org (Ludovic Courtès)

Bug is archived. No further changes may be made.

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 25045 in the body.
You can then email your comments to 25045 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to bug-guix <at> gnu.org:
bug#25045; Package guix. (Sun, 27 Nov 2016 19:20:02 GMT) Full text and rfc822 format available.

Acknowledgement sent to Luis Felipe López Acevedo <felipe.lopez <at> openmailbox.org>:
New bug report received and forwarded. Copy sent to bug-guix <at> gnu.org. (Sun, 27 Nov 2016 19:20:02 GMT) Full text and rfc822 format available.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Luis Felipe López Acevedo <felipe.lopez <at> openmailbox.org>
To: bug-guix <at> gnu.org
Subject: [Website] Packages page takes too long to load
Date: Sun, 27 Nov 2016 14:19:21 -0500
Steps to reproduce
==================

1. Open a Web browser
2. Go to https://www.gnu.org/software/guix/packages/
3. Download the page, and check its size


Unexpected behavior
===================

* The page takes almost 60 seconds to load when visited for the first
  time, and about 30 seconds when is cached.
* The page is 9.9 MiB in size.
* The browser becomes unresponsive while the page is loading.


Expected behavior
=================

The page loads so fast that nobody will file a bug.


System information
==================

I tested the page with the following hardware and software:

Desktop computer
    OS: Debian 8.6
    PROCESSOR: AMD Ahtlon X2 245
    RAM: 1.9 GiB
    BROWSER: Firefox ESR 45.4.0

Notebook
    OS: Windows 10
    PROCESSOR: Intel Atom CPU Z3735F
    RAM: 2.0 GiB
    BROWSER:
        Internet Explorer 11
	Edge 38.14393.0.0
	Google Chrome 54.0.2840.99 m

Mobile phone
    OS: Android 5.1.0
    PROCESSOR: Quad-core 1.0 GHz
    RAM: 1.0 GiB
    BROWSER: Google Chrome 54.0.2840.85


Additional information
======================

I plan to redesign the packages page, and submit a proposal to fix
this bug.


-- 
Luis Felipe López Acevedo
http://sirgazil.bitbucket.org/




Information forwarded to bug-guix <at> gnu.org:
bug#25045; Package guix. (Sun, 27 Nov 2016 23:11:02 GMT) Full text and rfc822 format available.

Message #8 received at 25045 <at> debbugs.gnu.org (full text, mbox):

From: ludo <at> gnu.org (Ludovic Courtès)
To: Luis Felipe López Acevedo <felipe.lopez <at> openmailbox.org>
Cc: Alex Sassmannshausen <alex.sassmannshausen <at> gmail.com>,
 25045 <at> debbugs.gnu.org
Subject: Re: bug#25045: [Website] Packages page takes too long to load
Date: Mon, 28 Nov 2016 00:10:17 +0100
Hello!

Luis Felipe López Acevedo <felipe.lopez <at> openmailbox.org> skribis:

> I plan to redesign the packages page, and submit a proposal to fix
> this bug.

For the record, Alex (Cc’d) posted an initial patch a week ago:

  https://lists.gnu.org/archive/html/guix-devel/2016-11/msg00498.html

Please coordinate.  :-)

Glad to see people working on this longstanding issue!

Ludo’.




Information forwarded to bug-guix <at> gnu.org:
bug#25045; Package guix. (Mon, 28 Nov 2016 17:07:01 GMT) Full text and rfc822 format available.

Message #11 received at 25045 <at> debbugs.gnu.org (full text, mbox):

From: Alex Sassmannshausen <alex <at> pompo.co>
To: Ludovic Courtès <ludo <at> gnu.org>
Cc: Luis Felipe López Acevedo <felipe.lopez <at> openmailbox.org>,
 25045 <at> debbugs.gnu.org
Subject: Re: bug#25045: [Website] Packages page takes too long to load
Date: Mon, 28 Nov 2016 18:00:33 +0100
Hi Luis,

Indeed, I had a first bash at solving this problem by providing a set of
static html pages paginated by the first letter of the package name.

I'm not particularly wedded to this solution, so if you feel strongly
about going another way, I'd be keen to hear/see about it.

In the meantime, I'm open to testing/feedback.  I will unfortunately not
be able to put work into this until at least Saturday/Sunday, as some
Perl work has higher priority at the moment.

But let me know if you have questions or feedback!

Best wishes,

Alex

Ludovic Courtès writes:

> Hello!
>
> Luis Felipe López Acevedo <felipe.lopez <at> openmailbox.org> skribis:
>
>> I plan to redesign the packages page, and submit a proposal to fix
>> this bug.
>
> For the record, Alex (Cc’d) posted an initial patch a week ago:
>
>   https://lists.gnu.org/archive/html/guix-devel/2016-11/msg00498.html
>
> Please coordinate.  :-)
>
> Glad to see people working on this longstanding issue!
>
> Ludo’.





Information forwarded to bug-guix <at> gnu.org:
bug#25045; Package guix. (Mon, 28 Nov 2016 18:43:02 GMT) Full text and rfc822 format available.

Message #14 received at 25045 <at> debbugs.gnu.org (full text, mbox):

From: Luis Felipe López Acevedo <felipe.lopez <at> openmailbox.org>
To: alex <at> pompo.co
Cc: Ludovic Courtès <ludo <at> gnu.org>, 25045 <at> debbugs.gnu.org
Subject: Re: bug#25045: [Website] Packages page takes too long to load
Date: Mon, 28 Nov 2016 13:41:49 -0500
On 2016-11-28 12:00, Alex Sassmannshausen wrote:
> Hi Luis,
> 
> Indeed, I had a first bash at solving this problem by providing a set 
> of
> static html pages paginated by the first letter of the package name.
> 
> I'm not particularly wedded to this solution, so if you feel strongly
> about going another way, I'd be keen to hear/see about it.
> 
> In the meantime, I'm open to testing/feedback.  I will unfortunately 
> not
> be able to put work into this until at least Saturday/Sunday, as some
> Perl work has higher priority at the moment.
> 
> But let me know if you have questions or feedback!
> 
> Best wishes,

Hi, Alex :)

The solution I had in mind includes an alphabetic index, and pagination 
as well. However, it includes a few more things, and would take some 
time to design and implement. So I think we should use your patch to fix 
the size issue as soon as possible.


For what is worth, this is what I had in mind:

/packages/
First page of the list of packages. Packages listed here only provide a 
summary: package logo (if any), name, version, description, and an 
indicator if it has issues. This page also has filters to find packages 
(for now, alphabetic filter. In the future, category filter, and search 
box).

/packages/page/N/
Page N of the list of packages.

/packages/a/
First page of the list of packages whose name starts with A. Packages 
are presented the same way as in /packages/.

/packages/a/page/N/
Page N of the list of packages starting with letter A.

/packages/icecat/X.Y.Z/
Page with details about IceCat version X.Y.Z. It includes all the 
information about this package, including its issues (which are 
currently listed in a separate page along with the issues of other 
packages: /packages/issues.html). Including the issues of a package in 
its detail page could avoid having the current issues page grow too 
much, like the current Packages page.

This static pagination and filtering would generate A LOT of pages, but 
of reasonable size for web browsers to load.

Best,


-- 
Luis Felipe López Acevedo
http://sirgazil.bitbucket.org/




Information forwarded to bug-guix <at> gnu.org:
bug#25045; Package guix. (Mon, 28 Nov 2016 20:19:01 GMT) Full text and rfc822 format available.

Message #17 received at 25045 <at> debbugs.gnu.org (full text, mbox):

From: ludo <at> gnu.org (Ludovic Courtès)
To: Luis Felipe López Acevedo <felipe.lopez <at> openmailbox.org>
Cc: alex <at> pompo.co, 25045 <at> debbugs.gnu.org
Subject: Re: bug#25045: [Website] Packages page takes too long to load
Date: Mon, 28 Nov 2016 21:18:07 +0100
Luis Felipe López Acevedo <felipe.lopez <at> openmailbox.org> skribis:

> On 2016-11-28 12:00, Alex Sassmannshausen wrote:
>> Hi Luis,
>>
>> Indeed, I had a first bash at solving this problem by providing a
>> set of
>> static html pages paginated by the first letter of the package name.
>>
>> I'm not particularly wedded to this solution, so if you feel strongly
>> about going another way, I'd be keen to hear/see about it.
>>
>> In the meantime, I'm open to testing/feedback.  I will unfortunately
>> not
>> be able to put work into this until at least Saturday/Sunday, as some
>> Perl work has higher priority at the moment.
>>
>> But let me know if you have questions or feedback!
>>
>> Best wishes,
>
> Hi, Alex :)
>
> The solution I had in mind includes an alphabetic index, and
> pagination as well. However, it includes a few more things, and would
> take some time to design and implement. So I think we should use your
> patch to fix the size issue as soon as possible.

I agree!

Alex, was there anything left to address?  If not, feel free to push.
:-)

> For what is worth, this is what I had in mind:
>
> /packages/
> First page of the list of packages. Packages listed here only provide
> a summary: package logo (if any), name, version, description, and an
> indicator if it has issues. This page also has filters to find
> packages (for now, alphabetic filter. In the future, category filter,
> and search box).
>
> /packages/page/N/
> Page N of the list of packages.
>
> /packages/a/
> First page of the list of packages whose name starts with A. Packages
> are presented the same way as in /packages/.
>
> /packages/a/page/N/
> Page N of the list of packages starting with letter A.
>
> /packages/icecat/X.Y.Z/
> Page with details about IceCat version X.Y.Z. It includes all the
> information about this package, including its issues (which are
> currently listed in a separate page along with the issues of other
> packages: /packages/issues.html). Including the issues of a package in
> its detail page could avoid having the current issues page grow too
> much, like the current Packages page.
>
> This static pagination and filtering would generate A LOT of pages,
> but of reasonable size for web browsers to load.

Sounds like a good plan as well, though that’s indeed a lot of web pages
for that rusty CVS repo to handle…

Medium-term, I think we should consider a solution involving pages
generated on the fly server-side, with a caching proxy (nginx!) in front
of it.  We’ll have to seek assistance from the gnu.org web masters, but
ISTR they were not against that idea.

Thanks!

Ludo’.




Information forwarded to bug-guix <at> gnu.org:
bug#25045; Package guix. (Tue, 29 Nov 2016 09:13:02 GMT) Full text and rfc822 format available.

Message #20 received at 25045 <at> debbugs.gnu.org (full text, mbox):

From: Alex Sassmannshausen <alex <at> pompo.co>
To: Ludovic Courtès <ludo <at> gnu.org>
Cc: Luis Felipe López Acevedo <felipe.lopez <at> openmailbox.org>,
 25045 <at> debbugs.gnu.org
Subject: Re: bug#25045: [Website] Packages page takes too long to load
Date: Tue, 29 Nov 2016 10:12:49 +0100
Ludovic Courtès writes:

> Luis Felipe López Acevedo <felipe.lopez <at> openmailbox.org> skribis:
>
>> On 2016-11-28 12:00, Alex Sassmannshausen wrote:
>>> Hi Luis,
>>>
>>> Indeed, I had a first bash at solving this problem by providing a
>>> set of
>>> static html pages paginated by the first letter of the package name.
>>>
>>> I'm not particularly wedded to this solution, so if you feel strongly
>>> about going another way, I'd be keen to hear/see about it.
>>>
>>> In the meantime, I'm open to testing/feedback.  I will unfortunately
>>> not
>>> be able to put work into this until at least Saturday/Sunday, as some
>>> Perl work has higher priority at the moment.
>>>
>>> But let me know if you have questions or feedback!
>>>
>>> Best wishes,
>>
>> Hi, Alex :)
>>
>> The solution I had in mind includes an alphabetic index, and
>> pagination as well. However, it includes a few more things, and would
>> take some time to design and implement. So I think we should use your
>> patch to fix the size issue as soon as possible.
>
> I agree!
>
> Alex, was there anything left to address?  If not, feel free to push.
> :-)

Having pushed some other stuff around my calendar, I should now be able
to spend some time on polishing the patch tonight.

>> For what is worth, this is what I had in mind:
>>
>> /packages/
>> First page of the list of packages. Packages listed here only provide
>> a summary: package logo (if any), name, version, description, and an
>> indicator if it has issues. This page also has filters to find
>> packages (for now, alphabetic filter. In the future, category filter,
>> and search box).
>>
>> /packages/page/N/
>> Page N of the list of packages.
>>
>> /packages/a/
>> First page of the list of packages whose name starts with A. Packages
>> are presented the same way as in /packages/.
>>
>> /packages/a/page/N/
>> Page N of the list of packages starting with letter A.
>>
>> /packages/icecat/X.Y.Z/
>> Page with details about IceCat version X.Y.Z. It includes all the
>> information about this package, including its issues (which are
>> currently listed in a separate page along with the issues of other
>> packages: /packages/issues.html). Including the issues of a package in
>> its detail page could avoid having the current issues page grow too
>> much, like the current Packages page.
>>
>> This static pagination and filtering would generate A LOT of pages,
>> but of reasonable size for web browsers to load.

The routing schema looks pretty neat to me! :-)

> Sounds like a good plan as well, though that’s indeed a lot of web pages
> for that rusty CVS repo to handle…
>
> Medium-term, I think we should consider a solution involving pages
> generated on the fly server-side, with a caching proxy (nginx!) in front
> of it.  We’ll have to seek assistance from the gnu.org web masters, but
> ISTR they were not against that idea.

This sounds like a pretty good idea — though I probably won‘t have time
to take the initiative here, I'm happy to do review and discussion of
patches.

Alex

>
> Thanks!
>
> Ludo’.





Information forwarded to bug-guix <at> gnu.org:
bug#25045; Package guix. (Fri, 02 Dec 2016 22:42:02 GMT) Full text and rfc822 format available.

Message #23 received at 25045 <at> debbugs.gnu.org (full text, mbox):

From: ng0 <ng0 <at> libertad.pw>
To: 25045 <at> debbugs.gnu.org
Subject: Re: bug#25045: [Website] Packages page takes too long to load
Date: Fri, 02 Dec 2016 22:41:39 +0000
Ludovic Courtès <ludo <at> gnu.org> writes:

> Luis Felipe López Acevedo <felipe.lopez <at> openmailbox.org> skribis:
>
>> On 2016-11-28 12:00, Alex Sassmannshausen wrote:
>>> Hi Luis,
>>>
>>> Indeed, I had a first bash at solving this problem by providing a
>>> set of
>>> static html pages paginated by the first letter of the package name.
>>>
>>> I'm not particularly wedded to this solution, so if you feel strongly
>>> about going another way, I'd be keen to hear/see about it.
>>>
>>> In the meantime, I'm open to testing/feedback.  I will unfortunately
>>> not
>>> be able to put work into this until at least Saturday/Sunday, as some
>>> Perl work has higher priority at the moment.
>>>
>>> But let me know if you have questions or feedback!
>>>
>>> Best wishes,
>>
>> Hi, Alex :)
>>
>> The solution I had in mind includes an alphabetic index, and
>> pagination as well. However, it includes a few more things, and would
>> take some time to design and implement. So I think we should use your
>> patch to fix the size issue as soon as possible.
>
> I agree!
>
> Alex, was there anything left to address?  If not, feel free to push.
> :-)
>
>> For what is worth, this is what I had in mind:
>>
>> /packages/
>> First page of the list of packages. Packages listed here only provide
>> a summary: package logo (if any), name, version, description, and an
>> indicator if it has issues. This page also has filters to find
>> packages (for now, alphabetic filter. In the future, category filter,
>> and search box).
>>
>> /packages/page/N/
>> Page N of the list of packages.
>>
>> /packages/a/
>> First page of the list of packages whose name starts with A. Packages
>> are presented the same way as in /packages/.
>>
>> /packages/a/page/N/
>> Page N of the list of packages starting with letter A.
>>
>> /packages/icecat/X.Y.Z/
>> Page with details about IceCat version X.Y.Z. It includes all the
>> information about this package, including its issues (which are
>> currently listed in a separate page along with the issues of other
>> packages: /packages/issues.html). Including the issues of a package in
>> its detail page could avoid having the current issues page grow too
>> much, like the current Packages page.
>>
>> This static pagination and filtering would generate A LOT of pages,
>> but of reasonable size for web browsers to load.
>
> Sounds like a good plan as well, though that’s indeed a lot of web pages
> for that rusty CVS repo to handle…

If I remember correctly, Gnu projects do not have to host their
websites on gnu.org, if the CVS should be the blocker to move
forwards and stay static.
But with every package and every version of them we add, this
would add a lot of generated pages (right now around 4550
packages and rising), so it might get difficult to manage that
unless management for this in place somehow (gets cleared on
reboot, make clean, or something similar).

> Medium-term, I think we should consider a solution involving pages
> generated on the fly server-side, with a caching proxy (nginx!) in front
> of it.  We’ll have to seek assistance from the gnu.org web masters, but
> ISTR they were not against that idea.
>
> Thanks!
>
> Ludo’.
>
>
>
>

-- 
♥Ⓐ  ng0  | ng0.chaosnet.org




Reply sent to ludo <at> gnu.org (Ludovic Courtès):
You have taken responsibility. (Fri, 09 Dec 2016 23:26:05 GMT) Full text and rfc822 format available.

Notification sent to Luis Felipe López Acevedo <felipe.lopez <at> openmailbox.org>:
bug acknowledged by developer. (Fri, 09 Dec 2016 23:26:05 GMT) Full text and rfc822 format available.

Message #28 received at 25045-done <at> debbugs.gnu.org (full text, mbox):

From: ludo <at> gnu.org (Ludovic Courtès)
To: Alex Sassmannshausen <alex <at> pompo.co>
Cc: 25045-done <at> debbugs.gnu.org,
 Luis Felipe López Acevedo <felipe.lopez <at> openmailbox.org>
Subject: Re: bug#25045: [Website] Packages page takes too long to load
Date: Fri, 09 Dec 2016 23:40:06 +0100
Hi!

This is now fixed, thank you!

Ludo’.




bug archived. Request was from Debbugs Internal Request <help-debbugs <at> gnu.org> to internal_control <at> debbugs.gnu.org. (Sat, 07 Jan 2017 12:24:04 GMT) Full text and rfc822 format available.

This bug report was last modified 8 years and 166 days ago.

Previous Next


GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.