From unknown Fri Jun 20 07:15:10 2025 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.509 (Entity 5.509) Content-Type: text/plain; charset=utf-8 From: bug#65345 <65345@debbugs.gnu.org> To: bug#65345 <65345@debbugs.gnu.org> Subject: Status: guix-pull --list-generations is slow Reply-To: bug#65345 <65345@debbugs.gnu.org> Date: Fri, 20 Jun 2025 14:15:10 +0000 retitle 65345 guix-pull --list-generations is slow reassign 65345 guix submitter 65345 Olivier Dion severity 65345 normal thanks From debbugs-submit-bounces@debbugs.gnu.org Wed Aug 16 15:29:21 2023 Received: (at submit) by debbugs.gnu.org; 16 Aug 2023 19:29:21 +0000 Received: from localhost ([127.0.0.1]:42119 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qWMCm-00005U-Pp for submit@debbugs.gnu.org; Wed, 16 Aug 2023 15:29:21 -0400 Received: from lists.gnu.org ([2001:470:142::17]:58818) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qWMCk-00005E-Ja for submit@debbugs.gnu.org; Wed, 16 Aug 2023 15:29:19 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qWMCf-0002Qr-94 for bug-guix@gnu.org; Wed, 16 Aug 2023 15:29:13 -0400 Received: from smtpout.efficios.com ([167.114.26.122]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qWMCc-0002SJ-M9 for bug-guix@gnu.org; Wed, 16 Aug 2023 15:29:13 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=efficios.com; s=smtpout1; t=1692214146; bh=Ko6uLFlgcdT97n/bD68CtK83b9WgLDdFvnq63J9uCa0=; h=From:To:Subject:Date:From; b=B+lAQzcv7qZuiELJVfHx8DObdmQqCPfqtshE+TSd4QUDL09lhvIS1epHFgrYvufqB ZXxWt6cE8Iq0YKajX9q/ac1XqcELwH/gJc6ym9QeQVCrMMlyvckGxlciZjYEDoyX9E bRuYBH1AZ2z9DZzIeIwdDbFhL/T4l75M8LDJyKeNRS+hZ7c2grs/6BP0y9bH6QGkZL yE8TLcdxRyr/gYNB+qMeHcnEaCemHgen/EHRFJ0VRuSAeT61ooFqhKl04wL3N5X1HQ UMIiD6EhTwR6+32w0ovCyvoXEGo/pSLXeQ74HHd4QMHDH1k0KtWxAJWzcs01YF/jfG w+txOoU98O5Eg== Received: from localhost (modemcable094.169-200-24.mc.videotron.ca [24.200.169.94]) by smtpout.efficios.com (Postfix) with ESMTPSA id 4RQyqk5FBhz1LMn for ; Wed, 16 Aug 2023 15:29:06 -0400 (EDT) From: Olivier Dion To: bug-guix@gnu.org Subject: guix-pull --list-generations is slow Organization: EfficiOS Date: Wed, 16 Aug 2023 15:29:06 -0400 Message-ID: <87cyzmwzul.fsf@laura> MIME-Version: 1.0 Content-Type: text/plain Received-SPF: pass client-ip=167.114.26.122; envelope-from=odion@efficios.com; helo=smtpout.efficios.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.0 (/) Hi, Calling `guix-pull --list-generations' is very slow on my system with 37 generations. $ time guix pull --list-generations > /dev/null real 0m58.702s user 1m8.418s sys 0m1.527s Also, it takes a lot of CPU (100% of a core). $ guix describe: guix 7b2b0a5 repository URL: https://git.savannah.gnu.org/git/guix.git branch: master commit: 7b2b0a5e1d635fb0e3d2d3e9141ac27c2db644b5 >From a search in pull.scm, I think that the culprit is in the `channel-news-for-commit' procedure. Thanks, old -- Olivier Dion EfficiOS Inc. https://www.efficios.com From debbugs-submit-bounces@debbugs.gnu.org Thu Aug 24 06:49:00 2023 Received: (at 65345) by debbugs.gnu.org; 24 Aug 2023 10:49:00 +0000 Received: from localhost ([127.0.0.1]:36230 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qZ7tb-0007MN-On for submit@debbugs.gnu.org; Thu, 24 Aug 2023 06:49:00 -0400 Received: from mail-wm1-x32f.google.com ([2a00:1450:4864:20::32f]:39328) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qZ7tZ-0007M1-Gg for 65345@debbugs.gnu.org; Thu, 24 Aug 2023 06:48:58 -0400 Received: by mail-wm1-x32f.google.com with SMTP id 5b1f17b1804b1-400e8ab9325so1842575e9.1 for <65345@debbugs.gnu.org>; Thu, 24 Aug 2023 03:48:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1692874128; x=1693478928; h=content-transfer-encoding:mime-version:message-id:date:references :in-reply-to:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=GQI3QLqyRlj0HEhfk89lZSTzNqSeFYpvcmuYZSHh2GI=; b=sNmogpR8atU+sLvY+jxby5paWKi/cLEkkDPgW1foqdXVBn+6MH+7PZXmOtjsPQK+/c 3ABNuXYEuJs/Dz6T/JhOKvNlMz0XUuQdVZnMY4XTARiqrRhhkLpQ6SJ6kfQ2pR39fsxt Bg10SpA75Joz7GffeqdUI4q4moW0PLK1C/9e+4bOHr5GsOv4RTSBV5CljhgjUvDC8/2f F4N5Kf5cKtSQIzJI+RCDI18Hz9K+n/SZ4TzTRDFqvGXrl3+dmG2Q+FfR8K82eQb1F250 y74eFaXUlpbugvBGLkFw2PWJDdk6oSw8yrs9IRpZRrJmCbtHALvCRWc5P4czheSm7Yh7 3Aag== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1692874128; x=1693478928; h=content-transfer-encoding:mime-version:message-id:date:references :in-reply-to:subject:to:from:x-gm-message-state:from:to:cc:subject :date:message-id:reply-to; bh=GQI3QLqyRlj0HEhfk89lZSTzNqSeFYpvcmuYZSHh2GI=; b=KBxLNWssJQF/+RYzkCmO44rSspLlJzEOUj96VUji6ii6QPNg39yPkmh+f0AlzS+WAs x5jTzSKiJGc0ovukCzi1w6AhxY7CI7mrD8KQ4DXl9TwdQEoAnGiWQs83avvYOE8NH6eU qXQPOvZ4NZFVD1azB95hhw6A0+YUbtvbM4eAUPhZR1tR2N/9uQHcVNE5JMS0cbEmEtz0 C5nkl+9/PK7GZWyHAwyhVNW9KK3xhIDFakRVB6T1v+JZecRdI63n2Hfhx8jaw40Wr6cl LImiehvZIJQxNUNFs1zy62xak2M8Ohfm7TyAtsAIOt8O1gGkeejg3vPcWu8ucBvhODn9 8Bgg== X-Gm-Message-State: AOJu0YyPQCJFF0YSlNm5kxkfehiQKGb4M30yCYZexxBqIyXJaMwWUZRt oP8RLZZoRO71ds/+BBdAFQf3tEkC8Yc= X-Google-Smtp-Source: AGHT+IH+MZzP42SlwwIOB7Qj9hNG3HKgmIecE1Jkx0V1f/abZpth06UyoT6tD1fFQyf8u9FUbvvUWg== X-Received: by 2002:a05:600c:1c9c:b0:3f8:efad:31ee with SMTP id k28-20020a05600c1c9c00b003f8efad31eemr11975796wms.2.1692874127440; Thu, 24 Aug 2023 03:48:47 -0700 (PDT) Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e]) by smtp.gmail.com with ESMTPSA id x21-20020a05600c21d500b003fef30b28b2sm2269261wmj.18.2023.08.24.03.48.47 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 24 Aug 2023 03:48:47 -0700 (PDT) From: Simon Tournier To: Olivier Dion , 65345@debbugs.gnu.org Subject: Re: bug#65345: guix-pull --list-generations is slow In-Reply-To: <87cyzmwzul.fsf@laura> References: <87cyzmwzul.fsf@laura> Date: Thu, 24 Aug 2023 11:33:44 +0200 Message-ID: <86lee0zsw7.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 65345 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Hi, On Wed, 16 Aug 2023 at 15:29, Olivier Dion wrote: > $ time guix pull --list-generations > /dev/null > real 0m58.702s > user 1m8.418s > sys 0m1.527s On my poor laptop, it=E2=80=99s the same (14 Generations): $ time guix pull --list-generations >/dev/null real 1m2.201s user 1m0.021s sys 0m2.482s And note before it was worse. ;-) $ time guix pull --list-generations --details > /dev/null real 1m57.606s user 2m6.575s sys 0m5.608s > From a search in pull.scm, I think that the culprit is in the > `channel-news-for-commit' procedure. Well, as pointers, we discussed some part of this issue in: https://issues.guix.gnu.org/53909 https://issues.guix.gnu.org/54000 And as I said in these past discussions, because the default behaviour is very slow for me, I barely use these options. I do not know if it can be optimized or if another option for bypassing the news part should be added. Cheers, simon