From unknown Thu Aug 14 22:18:01 2025 X-Loop: help-debbugs@gnu.org Subject: bug#11624: Slowness with virtual groups Resent-From: John Wiegley Original-Sender: debbugs-submit-bounces@debbugs.gnu.org Resent-CC: bugs@gnus.org Resent-Date: Mon, 04 Jun 2012 07:18:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 11624 X-GNU-PR-Package: gnus X-GNU-PR-Keywords: To: 11624@debbugs.gnu.org Cc: Lars Magne Ingebrigtsen X-Debbugs-Original-To: submit@debbugs.gnu.org (The Gnus Bugfixing Girls + Boys) Received: via spool by submit@debbugs.gnu.org id=B.13387942606709 (code B ref -1); Mon, 04 Jun 2012 07:18:01 +0000 Received: (at submit) by debbugs.gnu.org; 4 Jun 2012 07:17:40 +0000 Received: from localhost ([127.0.0.1]:56465 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SbRXn-0001k8-Sj for submit@debbugs.gnu.org; Mon, 04 Jun 2012 03:17:40 -0400 Received: from mail-yx0-f172.google.com ([209.85.213.172]:47712) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SbRXj-0001jt-W5 for submit@debbugs.gnu.org; Mon, 04 Jun 2012 03:17:38 -0400 Received: by yenq13 with SMTP id q13so2862834yen.3 for ; Mon, 04 Jun 2012 00:15:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:from:to:cc:subject:x-debbugs-version:x-debbugs-package:date :message-id:user-agent:mime-version:content-type; bh=od4mNkSbp6aY5hoym4FiFOBYUGmtzf61WdSw0UXfTZ8=; b=GaklwE6Y3JfOp/uO3C6XozB8bZgWqsDlA5oK8nymbmavdgnvRIjvaXSIABGe8clETd lysqKM76jZKBC8q06Y29rkRd+sfl2YuGMnhoIkEr1zyehmq45a6YyC46FLH5/Py5KL3G hStSVhqtOIPFs2q1j3FqeVBJuyt4YJ5mbaHM7MLbL1dP9O3XZNhGV/HmPNZWjIzy8EAa JiukyehaO69oFBk1AxgE/54xoWmuJiP1acTlHBHpNYqoeQYaOAc9W55fAOAawI3mej3v /q5KYYdLZxEsjtG3caLs+xEMCxSO1Zn9H3wT6TbYN3D0deiwGPWUltR0sfSld/a1bmkc ZkFA== Received: by 10.50.163.39 with SMTP id yf7mr6955235igb.39.1338794134565; Mon, 04 Jun 2012 00:15:34 -0700 (PDT) Received: from vulcan.local (c-98-215-105-167.hsd1.il.comcast.net. [98.215.105.167]) by mx.google.com with ESMTPS id nh8sm13676704igc.1.2012.06.04.00.15.33 (version=TLSv1/SSLv3 cipher=OTHER); Mon, 04 Jun 2012 00:15:34 -0700 (PDT) Received: by vulcan.local (Postfix, from userid 501) id F0330EC4288E; Mon, 4 Jun 2012 02:15:32 -0500 (CDT) From: John Wiegley Date: Mon, 04 Jun 2012 02:15:32 -0500 Message-ID: User-Agent: Gnus/5.130006 (Ma Gnus v0.6) Emacs/24.1 (darwin) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.6 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -2.6 (--) Hello, I recently added a LOT of read messages to some groups I have mapped in an nnvirtual group. Now, every time I hit 'g' in my *Group* buffer, it takes 44 seconds for nothing to happen. It takes this long every time I hit 'g', even if done immediately after. Here are the ELP results: --8<---------------cut here---------------start------------->8--- gnus-group-get-new-news 1 44.266004 44.266004 gnus-get-unread-articles 1 44.255942 44.255942 gnus-read-active-for-groups 11 44.242622 4.0220565454 gnus-activate-group 7 43.951563 6.2787947142 nnvirtual-request-group 5 43.949273000 8.7898546000 nnvirtual-create-mapping 5 43.948769 8.7897538 nnvirtual-reverse-map-article 3445374 9.3037520002 2.700...e-06 nnvirtual-merge-sorted-lists 75 6.2297310000 0.0830630800 gnus-compress-sequence 712 1.2107359999 0.0017004719 gnus-finish-retrieve-group-infos 2 0.2818409999 0.1409204999 nnimap-finish-retrieve-group-infos 1 0.281205 0.281205 nnimap-wait-for-response 1 0.265584 0.265584 nnheader-accept-process-output 28 0.2629859999 0.0093923571 gnus-topic-prepare-topic 24 0.018455 0.0007689583 gnus-cache-articles-in-group 130 0.017135 0.0001318076 nnimap-update-infos 1 0.013326 0.013326 nnimap-update-info 41 0.0126370000 0.0003082195 nnimap-update-qresync-info 41 0.0098389999 0.0002399756 gnus-cache-file-name 130 0.009786 7.527...e-05 gnus-read-active-file-1 4 0.009648 0.002412 gnus-group-list-groups 2 0.008211 0.0041055 gnus-group-prepare-topics 2 0.0071719999 0.0035859999 gnus-retrieve-group-data-early 4 0.006225 0.00155625 gnus-run-hooks 16 0.0058650000 0.0003665625 nnimap-retrieve-group-data-early 2 0.005678 0.002839 nnmh-request-list-1 3 0.005511 0.001837 gnus-request-list 4 0.0052089999 0.0013022499 nnoo-parent-function 3 0.0049159999 0.0016386666 nndraft-request-list 1 0.004274 0.004274 nnmh-request-list 1 0.004206 0.004206 gnus-topic-parent-topic 512 0.0040740000 7.957...e-06 gnus-topic-hierarchical-parameters 24 0.003825 0.0001593749 gnus-request-scan 3 0.003082 0.0010273333 nnml-request-scan 1 0.002996 0.002996 nnmail-get-new-mail 1 0.002974 0.002974 nnmail-get-new-mail-1 1 0.002968 0.002968 nnheader-message 2 0.002921 0.0014605 gnus-current-topics 24 0.002216 9.233...e-05 gnus-topic-find-topology 292 0.0019769999 6.770...e-06 gnus-add-to-range 410 0.0017880000 4.360...e-06 gnus-request-update-info 7 0.0017059999 0.0002437142 nnimap-parse-flags 1 0.001601 0.001601 gnus-message 25 0.0015480000 6.192e-05 nnheader-message-maybe 28 0.0015310000 5.467...e-05 gnus-group-set-parameter 123 0.001469 1.194...e-05 gnus-group-insert-group-line 6 0.0014570000 0.0002428333 gnus-group-save-newsrc 1 0.001422 0.001422 gnus-open-server 10 0.0014160000 0.0001416000 gnus-save-newsrc-file 1 0.001416 0.001416 nndraft-request-update-info 2 0.0014 0.0007 gnus-active-to-gnus-format 5 0.001312 0.0002624 gnus-topic-parameters 68 0.0012780000 1.879...e-05 nnimap-send-command 41 0.00123 3e-05 nntp-with-open-group-function 3 0.001068 0.000356 gnus-update-format-specifications 4 0.0010659999 0.0002664999 gnus-server-opened 37 0.0010039999 2.713...e-05 nndraft-possibly-change-group 4 0.0010010000 0.0002502500 --8<---------------cut here---------------end--------------->8--- Does this represent a speed problem with virtual groups, or do I have to avoid having large groups aggregated in nnvirtual? Thanks, John Ma Gnus v0.6 GNU Emacs 24.1.1 (x86_64-apple-darwin11.4.0, Carbon Version 1.6.0 AppKit 1138.47) of 2012-06-02 on vulcan.local 200 Leafnode NNTP daemon, version 2.0.0.alpha20110815a.luascript at newartisans.com 500 Unknown command From unknown Thu Aug 14 22:18:01 2025 X-Loop: help-debbugs@gnu.org Subject: bug#11624: Slowness with virtual groups Resent-From: Lars Magne Ingebrigtsen Original-Sender: debbugs-submit-bounces@debbugs.gnu.org Resent-CC: bugs@gnus.org Resent-Date: Mon, 11 Jun 2012 21:06:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 11624 X-GNU-PR-Package: gnus X-GNU-PR-Keywords: To: John Wiegley Cc: 11624@debbugs.gnu.org Received: via spool by 11624-submit@debbugs.gnu.org id=B11624.133944872015943 (code B ref 11624); Mon, 11 Jun 2012 21:06:01 +0000 Received: (at 11624) by debbugs.gnu.org; 11 Jun 2012 21:05:20 +0000 Received: from localhost ([127.0.0.1]:38325 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SeBnc-000494-5x for submit@debbugs.gnu.org; Mon, 11 Jun 2012 17:05:20 -0400 Received: from hermes.netfonds.no ([80.91.224.195]:34212) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SeBnZ-00048x-IK for 11624@debbugs.gnu.org; Mon, 11 Jun 2012 17:05:18 -0400 Received: from cm-84.215.51.58.getinternet.no ([84.215.51.58] helo=stories.gnus.org) by hermes.netfonds.no with esmtpsa (TLS1.0:DHE_RSA_AES_128_CBC_SHA1:16) (Exim 4.72) (envelope-from ) id 1SeBku-0004AP-UU; Mon, 11 Jun 2012 23:02:32 +0200 From: Lars Magne Ingebrigtsen References: Face: iVBORw0KGgoAAAANSUhEUgAAADAAAAAwBAMAAAClLOS0AAAAFVBMVEXw7+ZYQyJoWDdKMRIz HgidknMXCgP2NUKkAAACa0lEQVQ4jaVTwY7jIAz1jpQPMGT2XJzyARS29wwW5zRd9r4axP9/wj5S jdRqjgtKQvywjZ8fRK9jqrU+/9evsYv4Z2AbYzpWmM8A5jTBcaKJvntMG4CXFNg8PGCdXh0e0Z4/ Xx7yPL75/O94FDy9vuq2UYpGxOy2lyazxiAxRNvY0JzZGuvmXnpITXNmdvheyGbD4uy1a1fVou0i 9aYlEwcjfmcATTUn1Q/kSb2RYyN1AC0HzeyC309Uz42EWaoMYI2qQcL2hoa8JZpwKAlse88ai+rq bwaELgdNLrAvvSN70+A4nia50e4rEFt/AujIz2LjOy2e5DS57cYCjwYgB0EB232Dxy7bPfAASuv6 ISkHjzZWID5p1hEKLyMW4R4k7hbbcyoDaF52KwLFSK3LOFFjIFgYT074/QYPV44oK8eRB8A9pmhJ JA17v+ZoZtQnUuekMZJLh8NnyRxsycbZAGrshdCJo7S++jO4cjaCYY0bQpXHOVe/aGC24Qr6AbzX 8wE0GDFsvIwMYOVS9yNWhA3FQQIW9qQU/XRFipRdUkbCYBzM6CCc/uD0y19XGo7Vs1lG9kz2F/3u nzyv8NCxNcYZyQ3ZD/pRWhqdK6Adz+cMu5BDkx3SodH3niPUkitkJxAD+BU2416cI+haTbVGHAB0 yrEM4A2aaBdXYUoAjEBNDgLYiFNfIQ1B0SDfMdcF3rjgi44ijd8LBOedtX4BR1AkJg5i5NyV0EXm gzxmcyK6JZAzCkTfdzfI4wcAMYOSHMlgvaM5mRHDHz+4DAB4rEEnbkDGPZrqnrpyDMQo4BbRTcU9 QAGQRIMa+R9/9sV1BsBQTAAAAABJRU5ErkJggg== X-Now-Playing: Various Artists's _After Twilight_: "Blaine L. Reininger - Cafe au Lait" Date: Mon, 11 Jun 2012 23:02:32 +0200 In-Reply-To: (John Wiegley's message of "Mon, 04 Jun 2012 02:15:32 -0500") Message-ID: User-Agent: Gnus/5.130006 (Ma Gnus v0.6) Emacs/24.1.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-MailScanner-ID: 1SeBku-0004AP-UU X-Netfonds-MailScanner: Found to be clean X-Netfonds-MailScanner-From: larsi@gnus.org MailScanner-NULL-Check: 1340053353.14361@fXaQiSqI3cGoSyzvnT0j3Q X-Spam-Status: No X-Spam-Score: -1.9 (-) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -1.9 (-) John Wiegley writes: > I recently added a LOT of read messages to some groups I have mapped in an > nnvirtual group. Now, every time I hit 'g' in my *Group* buffer, it takes 44 > seconds for nothing to happen. It takes this long every time I hit 'g', even > if done immediately after. > > Here are the ELP results: Does `M-g' on the virtual group also take 44 seconds? If so, can you send the ELP output on `M-g'-ing the virtual group? -- (domestic pets only, the antidote for overdose, milk.) bloggy blog http://lars.ingebrigtsen.no/ From unknown Thu Aug 14 22:18:01 2025 X-Loop: help-debbugs@gnu.org Subject: bug#11624: Slowness with virtual groups Resent-From: John Wiegley Original-Sender: debbugs-submit-bounces@debbugs.gnu.org Resent-CC: bugs@gnus.org Resent-Date: Tue, 12 Jun 2012 18:42:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 11624 X-GNU-PR-Package: gnus X-GNU-PR-Keywords: To: Lars Magne Ingebrigtsen Cc: 11624@debbugs.gnu.org Received: via spool by 11624-submit@debbugs.gnu.org id=B11624.133952652126091 (code B ref 11624); Tue, 12 Jun 2012 18:42:02 +0000 Received: (at 11624) by debbugs.gnu.org; 12 Jun 2012 18:42:01 +0000 Received: from localhost ([127.0.0.1]:39715 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SeW2P-0006mg-DR for submit@debbugs.gnu.org; Tue, 12 Jun 2012 14:42:01 -0400 Received: from mail-gh0-f172.google.com ([209.85.160.172]:51910) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SeW2H-0006mS-4H for 11624@debbugs.gnu.org; Tue, 12 Jun 2012 14:41:54 -0400 Received: by ghbg16 with SMTP id g16so3793574ghb.3 for <11624@debbugs.gnu.org>; Tue, 12 Jun 2012 11:39:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:from:to:cc:subject:references:date:in-reply-to:message-id :user-agent:mime-version:content-type; bh=+hG6MAaT/qvw9SslMP05560oRg+5ehRPIxVP1FaeBx0=; b=Dih6iRit1AI0E4bdtax8ZqlpeZDt4Pte6hMgGa/Ug3YZDXiwmdkFqA1yZKd7FGU170 O7W4heXlDpjRf1jVkdnhsIZtAbzM9RXwycmbBC2lhnbj9jSNr3OD6Jmioxe6jyF3LCWa qkFle89aWbKn2gkPZLmcfjnx3iTZn4OU2SqUAuCQS+q5UWwuV4bmbdBgZVyaieeCxTk+ gXnYp5ssSi636NMvnIZYlSCRz4YJ/PND6g5Sw+gNoiDgrVauhN4IUK4d3nV4Qf8S9BrM qMIKipQ1jtL5gGd4p1euYe1OcqmKQuC1d1Gm5nc2dNPcaMpURQkKVqxmK4UAIrX4gxk6 zylA== Received: by 10.236.156.69 with SMTP id l45mr28410261yhk.123.1339526344215; Tue, 12 Jun 2012 11:39:04 -0700 (PDT) Received: from vulcan.local (c-98-215-105-167.hsd1.il.comcast.net. [98.215.105.167]) by mx.google.com with ESMTPS id d10sm298115anm.17.2012.06.12.11.39.02 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 12 Jun 2012 11:39:02 -0700 (PDT) Received: by vulcan.local (Postfix, from userid 501) id 5AD01EE93717; Tue, 12 Jun 2012 13:39:01 -0500 (CDT) From: John Wiegley References: Date: Tue, 12 Jun 2012 13:39:01 -0500 In-Reply-To: (Lars Magne Ingebrigtsen's message of "Mon, 11 Jun 2012 23:02:32 +0200") Message-ID: User-Agent: Gnus/5.130006 (Ma Gnus v0.6) Emacs/24.1 (darwin) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.6 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -2.6 (--) >>>>> Lars Magne Ingebrigtsen writes: > John Wiegley writes: >> I recently added a LOT of read messages to some groups I have mapped in an >> nnvirtual group. Now, every time I hit 'g' in my *Group* buffer, it takes >> 44 seconds for nothing to happen. It takes this long every time I hit 'g', >> even if done immediately after. >> >> Here are the ELP results: > Does `M-g' on the virtual group also take 44 seconds? If so, can you send > the ELP output on `M-g'-ing the virtual group? M-g on the virtual group -- which references 25 local (Dovecot) IMAP groups -- takes 18s when there is no new mail available. Below are the ELP results. John gnus-activate-group 27 18.722542 0.6934274814 gnus-topic-get-new-news-this-topic 1 12.326267 12.326267 gnus-group-get-new-news-this-group 1 12.326228 12.326228 nnvirtual-request-group 1 12.322866 12.322866 nnvirtual-create-mapping 1 12.322745 12.322745 nnimap-request-group 25 6.396344 0.25585376 nnimap-update-infos 25 3.742512 0.14970048 nnimap-update-info 25 3.741962 0.14967848 gnus-set-difference 50 3.7230020000 0.0744600400 nnvirtual-reverse-map-article 509809 1.8513919999 3.631...e-06 nnimap-wait-for-response 25 1.785377 0.07141508 nnimap-parse-flags 25 0.815576 0.03262304 nnvirtual-merge-sorted-lists 15 0.692959 0.0461972666 nnheader-accept-process-output 384 0.2845970000 0.0007411380 gnus-compress-sequence 264 0.1363189999 0.0005163598 nnimap-flags-to-marks 25 0.047354 0.00189416 gnus-cache-articles-in-group 25 0.0030949999 0.0001237999 gnus-cache-file-name 25 0.0019930000 7.972...e-05 gnus-run-hooks 3 0.00156 0.00052 gnus-delay-send-queue 1 0.001551 0.001551 gnus-group-update-group 1 0.001342 0.001342 gnus-group-set-parameter 100 0.0012220000 1.222...e-05 nndraft-request-group 1 0.001172 0.001172 gnus-topic-update-topic-line 3 0.001032 0.0003439999 nnimap-send-command 50 0.0010130000 2.026...e-05 gnus-server-opened 27 0.0007809999 2.892...e-05 gnus-topic-update-topics-containing-group 1 0.000607 0.000607 nndraft-possibly-change-group 1 0.000553 0.000553 nnimap-server-opened 50 0.000548 1.096e-05 nndraft-open-server 1 0.000532 0.000532 nnoo-parent-function 1 0.000436 0.000436 nnimap-decode-gnus-group 50 0.000427 8.540...e-06 nnmh-request-group 1 0.00038 0.00038 gnus-range-difference 50 0.0003670000 7.340...e-06 gnus-group-insert-group-line-info 1 0.000357 0.000357 nnimap-possibly-change-group 25 0.0003469999 1.387...e-05 gnus-group-insert-group-line 1 0.000346 0.000346 gnus-agent-possibly-alter-active 28 0.0003050000 1.089...e-05 nnmail-group-pathname 3 0.000249 8.3e-05 gnus-parse-active 27 0.0002180000 8.074...e-06 nnimap-store-info 50 0.0001819999 3.639...e-06 gnus-cache-decoded-group-name 25 0.0001730000 6.920...e-06 nndraft-articles 1 0.000152 0.000152 gnus-topic-insert-topic-line 3 0.000149 4.966...e-05 nnmh-possibly-change-directory 1 0.000142 0.000142 gnus-group-remove-parameter 100 0.0001309999 1.309...e-06 gnus-topic-find-groups 3 0.0001219999 4.066...e-05 nnimap-buffer 25 0.0001150000 4.600...e-06 gnus-topic-parent-topic 17 0.0001129999 6.647...e-06 nnimap-find-connection 50 0.0001039999 2.079...e-06 gnus-group-name-decode 3 0.000103 3.433...e-05 gnus-agent-method-p 29 0.0001009999 3.482...e-06 gnus-find-method-for-group 6 9.6e-05 1.6e-05 gnus-info-set-entry 125 8.799...e-05 7.039...e-07 gnus-make-directory 1 8.3e-05 8.3e-05 gnus-group-prev-unread-group-same-level 1 8.2e-05 8.2e-05 gnus-group-remove-mark 1 8e-05 8e-05 gnus-list-of-unread-articles 25 7.800...e-05 3.120...e-06 gnus-group-position-point 5 7.3e-05 1.459...e-05 gnus-request-update-info 1 7.2e-05 7.2e-05 gnus-group-next-unread-group 2 6.9e-05 3.45e-05 nnheader-insert 2 6.9e-05 3.45e-05 gnus-group-highlight-line 1 6e-05 6e-05 gnus-group-mark-group 1 5.6e-05 5.6e-05 gnus-group-search-forward 2 5.6e-05 2.8e-05 gnus-online 55 5.399...e-05 9.818...e-07 gnus-summary-buffer-name 1 5.1e-05 5.1e-05 gnus-group-set-mode-line 1 5.1e-05 5.1e-05 gnus-goto-colon 5 4.9e-05 9.8e-06 gnus-group-decoded-name 1 4.5e-05 4.5e-05 gnus-server-status 27 4.4e-05 1.629...e-06 nnoo-current-server 56 4.399...e-05 7.857...e-07 gnus-topic-goto-topic 4 4e-05 1e-05 gnus-topic-find-topology 8 3.500...e-05 4.375...e-06 gnus-mode-line-buffer-identification 1 3.5e-05 3.5e-05 gnus-group-update-eval-form 1 3.4e-05 3.4e-05 gnus-range-add 2 3.2e-05 1.6e-05 gnus-group-name-charset 2 3.1e-05 1.55e-05 gnus-get-unread-articles-in-group 1 2.8e-05 2.8e-05 nnoo-change-server 2 2.600...e-05 1.300...e-05 nnimap-log-command 50 2.500...e-05 5.000...e-07 nnheader-init-server-buffer 1 2.5e-05 2.5e-05 nnheader-translate-file-chars 28 2.100...e-05 7.500...e-07 gnus-group-topic-p 1 2.1e-05 2.1e-05 nnoo-server-opened 3 2e-05 6.666...e-06 nnheader-report 2 1.999...e-05 9.999...e-06 nnvirtual-request-update-info 2 1.999...e-05 9.999...e-06 gnus-emacs-version 1 1.9e-05 1.9e-05 nnimap-find-process-buffer 25 1.700...e-05 6.800...e-07 gnus-group-process-prefix 1 1.6e-05 1.6e-05 gnus-group-get-parameter 2 1.6e-05 8e-06 gnus-use-long-file-name 25 1.500...e-05 6.000...e-07 gnus-add-text-properties 7 1.499...e-05 2.142...e-06 gnus-group-timestamp-delta 1 1.4e-05 1.4e-05 gnus-virtual-group-p 1 1.4e-05 1.4e-05 nnoo-backend 1 1.4e-05 1.4e-05 nndraft-server-opened 1 1.4e-05 1.4e-05 gnus-methods-equal-p 16 1.300...e-05 8.125...e-07 gnus-group-topic-name 1 1.3e-05 1.3e-05 gnus-group-group-level 1 1.2e-05 1.2e-05 gnus-group-goto-group 1 1.2e-05 1.2e-05 nnvirtual-possibly-change-server 3 1.2e-05 4e-06 gnus-put-text-property 5 1.1e-05 2.2e-06 nnvirtual-server-opened 1 1.1e-05 1.1e-05 nnmh-server-opened 1 1.1e-05 1.1e-05 gnus-get-function 1 9e-06 9e-06 gnus-group-topic-unread 8 9e-06 1.125e-06 gnus-put-text-property-excluding-characters-with-faces 1 9e-06 9e-06 nnheader-replace-duplicate-chars-in-string 3 8e-06 2.666...e-06 nnvirtual-current-group 3 7e-06 2.333...e-06 gnus-undo-boundary 4 6e-06 1.5e-06 gnus-group-parameter-value 2 6e-06 3e-06 gnus-methods-sloppily-equal 7 5.999...e-06 8.571...e-07 gnus-agent-save-group-info 1 5e-06 5e-06 gnus-group-group-indentation 2 4.999...e-06 2.499...e-06 gnus-group-group-name 2 4.999...e-06 2.499...e-06 nnoo-parents 4 4.999...e-06 1.249...e-06 gnus-topic-update-unreads 3 4e-06 1.333...e-06 nnheader-concat 1 4e-06 4e-06 gnus-group-topic-level 3 3e-06 1e-06 gnus-topic-visible-p 3 3e-06 1e-06 gnus-remove-denial 1 2e-06 2e-06 gnus-region-active-p 1 2e-06 2e-06 nnoo-variables 2 2e-06 1e-06 nnheader-re-read-dir 2 2e-06 1e-06 gnus-group-get-icon 1 1e-06 1e-06 gnus-topic-unread 1 1e-06 1e-06 gnus-extent-start-open 1 1e-06 1e-06 gnus-range-length 1 1e-06 1e-06 From unknown Thu Aug 14 22:18:01 2025 X-Loop: help-debbugs@gnu.org Subject: bug#11624: Slowness with virtual groups Resent-From: John Wiegley Original-Sender: debbugs-submit-bounces@debbugs.gnu.org Resent-CC: bugs@gnus.org Resent-Date: Tue, 12 Jun 2012 18:44:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 11624 X-GNU-PR-Package: gnus X-GNU-PR-Keywords: To: Lars Magne Ingebrigtsen Cc: 11624@debbugs.gnu.org Received: via spool by 11624-submit@debbugs.gnu.org id=B11624.133952660526260 (code B ref 11624); Tue, 12 Jun 2012 18:44:02 +0000 Received: (at 11624) by debbugs.gnu.org; 12 Jun 2012 18:43:25 +0000 Received: from localhost ([127.0.0.1]:39724 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SeW3p-0006pV-Bv for submit@debbugs.gnu.org; Tue, 12 Jun 2012 14:43:25 -0400 Received: from mail-yx0-f172.google.com ([209.85.213.172]:35206) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1SeW3n-0006pN-13 for 11624@debbugs.gnu.org; Tue, 12 Jun 2012 14:43:23 -0400 Received: by yenq13 with SMTP id q13so3794059yen.3 for <11624@debbugs.gnu.org>; Tue, 12 Jun 2012 11:40:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:from:to:cc:subject:references:date:in-reply-to:message-id :user-agent:mime-version:content-type; bh=WrlGtt7+hdt++OCI+i2yhCrbYOSUbD3cMj5ZLZjHSpw=; b=n86VX8bgbrIeKYElrdaRK31p6MLyA4U4bD/SS9nOffu3fFM0WJFsu8Mn3k2unxvuZP hd+ihlaTIp4ormj+8/vlX6kwh/rYUWeKGhEVdKmwglpIlrJnV7aYVQNZ8gD4aTnLpuWr rr/Xfs6XzdnUoYcYtdxcA4RDIXdpa7n7AUhEuIK/qD/w4+ZRR21blCAURN9Vv1oBidKs ncrAZN30r03ejAV51e7+EFgmr0oJzQ6r3xsQfAWvBgE7lPKjeaFNiojSkT9fVD575Exr qKnfnTCODpXmASK2WEMUGBCWmFDnM7iI+RahyeWBYpPzRjjGU2yZnc5+FV8ABh5/mvVx aahg== Received: by 10.236.76.5 with SMTP id a5mr29539495yhe.8.1339526439320; Tue, 12 Jun 2012 11:40:39 -0700 (PDT) Received: from vulcan.local (c-98-215-105-167.hsd1.il.comcast.net. [98.215.105.167]) by mx.google.com with ESMTPS id g66sm513148yhf.15.2012.06.12.11.40.38 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 12 Jun 2012 11:40:38 -0700 (PDT) Received: by vulcan.local (Postfix, from userid 501) id 95E77EE937BB; Tue, 12 Jun 2012 13:40:37 -0500 (CDT) From: John Wiegley References: Date: Tue, 12 Jun 2012 13:40:37 -0500 In-Reply-To: (John Wiegley's message of "Tue, 12 Jun 2012 13:39:01 -0500") Message-ID: User-Agent: Gnus/5.130006 (Ma Gnus v0.6) Emacs/24.1 (darwin) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.6 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -2.6 (--) >>>>> John Wiegley writes: > M-g on the virtual group -- which references 25 local (Dovecot) IMAP groups > -- takes 18s when there is no new mail available. Below are the ELP > results. Here are the message counts in those groups: mailbox messages recent unseen vsize ------------------------------------------------------ list.wg21.admin 1903 0 0 8613702 list.wg21.all 4119 0 0 19785019 list.wg21.comm 8 0 0 18264 list.wg21.compat 1411 0 0 5839262 list.wg21.core 23896 0 0 68808790 list.wg21.date-lib 210 0 0 2053990 list.wg21.edit 1215 0 0 2268430 list.wg21.embed 4 0 0 100494 list.wg21.env 563 0 0 1574636 list.wg21.ext 15284 0 0 54233222 list.wg21.ibof 4 0 0 35113 list.wg21.intl 221 0 0 1003327 list.wg21.lib 34328 0 0 89911277 list.wg21.migration 72 0 0 194927 list.wg21.modules 2 0 0 80070 list.wg21.networking 30 0 0 120095 list.wg21.news 257 0 0 2381908 list.wg21.parallel 194 0 0 580438 list.wg21.perf 272 0 0 849683 list.wg21.rationale 11 0 0 22923 list.wg21.sci 19 0 0 39385 list.wg21.syntax 349 0 0 878593 list.wg21.ustag 13 0 0 70770 list.isocpp.discussion 69 0 0 414767 list.isocpp.proposals 248 0 0 2928343 John From unknown Thu Aug 14 22:18:01 2025 X-Loop: help-debbugs@gnu.org Subject: bug#11624: Slowness with virtual groups Resent-From: Lars Magne Ingebrigtsen Original-Sender: debbugs-submit-bounces@debbugs.gnu.org Resent-CC: bugs@gnus.org Resent-Date: Wed, 20 Jun 2012 17:14:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 11624 X-GNU-PR-Package: gnus X-GNU-PR-Keywords: To: John Wiegley Cc: 11624@debbugs.gnu.org Received: via spool by 11624-submit@debbugs.gnu.org id=B11624.13402124156603 (code B ref 11624); Wed, 20 Jun 2012 17:14:02 +0000 Received: (at 11624) by debbugs.gnu.org; 20 Jun 2012 17:13:35 +0000 Received: from localhost ([127.0.0.1]:50114 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1ShOTG-0001iR-Jf for submit@debbugs.gnu.org; Wed, 20 Jun 2012 13:13:35 -0400 Received: from hermes.netfonds.no ([80.91.224.195]:45905) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1ShOTE-0001iJ-2l for 11624@debbugs.gnu.org; Wed, 20 Jun 2012 13:13:33 -0400 Received: from cm-84.215.51.58.getinternet.no ([84.215.51.58] helo=stories.gnus.org) by hermes.netfonds.no with esmtpsa (TLS1.0:DHE_RSA_AES_128_CBC_SHA1:16) (Exim 4.72) (envelope-from ) id 1ShOPl-00072J-0P; Wed, 20 Jun 2012 19:09:57 +0200 From: Lars Magne Ingebrigtsen References: X-Now-Playing: Arthur Russell's _World of Echo_: "Lucky Cloud" Date: Wed, 20 Jun 2012 19:09:56 +0200 In-Reply-To: (John Wiegley's message of "Mon, 04 Jun 2012 02:15:32 -0500") Message-ID: User-Agent: Gnus/5.130006 (Ma Gnus v0.6) Emacs/24.1.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-MailScanner-ID: 1ShOPl-00072J-0P X-Netfonds-MailScanner: Found to be clean X-Netfonds-MailScanner-From: larsi@gnus.org MailScanner-NULL-Check: 1340816997.12776@2HTFN5px5V075CY1sUasRA X-Spam-Status: No X-Spam-Score: -1.9 (-) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -1.9 (-) John Wiegley writes: Actually, I think the `M-g' on the group is a red herring, because that will trigger lots of network traffic. The problem is here: > nnvirtual-request-group 5 43.949273000 8.7898546000 > nnvirtual-create-mapping 5 43.948769 8.7897538 > nnvirtual-reverse-map-article 3445374 9.3037520002 2.700...e-06 > nnvirtual-merge-sorted-lists 75 6.2297310000 0.0830630800 It's calling `nnvirtual-reverse-map-article' a gazillion times. That's slow. Looking at the code, it's been this way since nnvirtual was created. So I guess nnvirtual just isn't suited to deal with big groups. -- (domestic pets only, the antidote for overdose, milk.) bloggy blog http://lars.ingebrigtsen.no/ From unknown Thu Aug 14 22:18:01 2025 X-Loop: help-debbugs@gnu.org Subject: bug#11624: Slowness with virtual groups Resent-From: John Wiegley Original-Sender: debbugs-submit-bounces@debbugs.gnu.org Resent-CC: bugs@gnus.org Resent-Date: Fri, 22 Jun 2012 11:09:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 11624 X-GNU-PR-Package: gnus X-GNU-PR-Keywords: To: Lars Magne Ingebrigtsen Cc: 11624@debbugs.gnu.org Received: via spool by 11624-submit@debbugs.gnu.org id=B11624.134036332012645 (code B ref 11624); Fri, 22 Jun 2012 11:09:01 +0000 Received: (at 11624) by debbugs.gnu.org; 22 Jun 2012 11:08:40 +0000 Received: from localhost ([127.0.0.1]:52670 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1Si1j8-0003Ho-Jc for submit@debbugs.gnu.org; Fri, 22 Jun 2012 07:08:38 -0400 Received: from mail-gg0-f172.google.com ([209.85.161.172]:56916) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1Si1j2-0003Hd-KO for 11624@debbugs.gnu.org; Fri, 22 Jun 2012 07:08:33 -0400 Received: by ggnc4 with SMTP id c4so1389925ggn.3 for <11624@debbugs.gnu.org>; Fri, 22 Jun 2012 04:04:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:from:to:cc:subject:references:date:in-reply-to:message-id :user-agent:mime-version:content-type; bh=J0RGGMEwTTNvr7Ts/u99WC3c6MzNwEZhpg/HK4G85Uc=; b=Y5rodPKm946R/5+a2qe17CPaOZU8Pm9PHmyLEbcO8KommMi0grjwF9AF7WvHQC2oiQ ycZXHkYgS2KMD9s/PKeo5j6lMPWokavRLfuLde407f3uTYaU063C02nUdYJtoecMszwP QGeOveBb3lcJxlFBYDFuvacx3Uirq9jczw6yaM7SQoeRuu0j8efCpaPX5LFSCyL22c+Q JyiPmkkrCH3f4NV9IqnIE0hqRRqOFekjRDRm71mukRrKVNBK5N0uJpA01Uk2sa0rRqxz 4GTKl/bId8YAMF4cPW1x7EPyeV7zLFnDsKnxMtbaaxq70c9v9PCMCosYWSqUljzqb76J dGfg== Received: by 10.50.213.71 with SMTP id nq7mr1132391igc.12.1340363088768; Fri, 22 Jun 2012 04:04:48 -0700 (PDT) Received: from vulcan.local (c-98-215-105-167.hsd1.il.comcast.net. [98.215.105.167]) by mx.google.com with ESMTPS id pp4sm38539517igb.5.2012.06.22.04.04.47 (version=TLSv1/SSLv3 cipher=OTHER); Fri, 22 Jun 2012 04:04:48 -0700 (PDT) Received: by vulcan.local (Postfix, from userid 501) id 1C094F03E973; Fri, 22 Jun 2012 06:04:46 -0500 (CDT) From: John Wiegley References: Date: Fri, 22 Jun 2012 06:04:46 -0500 In-Reply-To: (Lars Magne Ingebrigtsen's message of "Wed, 20 Jun 2012 19:09:56 +0200") Message-ID: User-Agent: Gnus/5.130006 (Ma Gnus v0.6) Emacs/24.1 (darwin) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.6 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -2.6 (--) >>>>> Lars Magne Ingebrigtsen writes: > So I guess nnvirtual just isn't suited to deal with big groups. (The sound of me weeping tears of sadness into my "Bones of Steel" mug). John From debbugs-submit-bounces@debbugs.gnu.org Wed Sep 05 14:34:17 2012 Received: (at control) by debbugs.gnu.org; 5 Sep 2012 18:34:17 +0000 Received: from localhost ([127.0.0.1]:40960 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1T9KQa-0003zG-Pz for submit@debbugs.gnu.org; Wed, 05 Sep 2012 14:34:17 -0400 Received: from hermes.netfonds.no ([80.91.224.195]:40543) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1T9KQZ-0003zA-Bb for control@debbugs.gnu.org; Wed, 05 Sep 2012 14:34:15 -0400 Received: from ip-200-13-149-91.dialup.ice.net ([91.149.13.200] helo=rusty) by hermes.netfonds.no with esmtpsa (TLS1.0:DHE_RSA_AES_128_CBC_SHA1:16) (Exim 4.72) (envelope-from ) id 1T9KQL-0002TM-3R for control@debbugs.gnu.org; Wed, 05 Sep 2012 20:34:01 +0200 Date: Wed, 05 Sep 2012 20:33:57 +0200 Message-Id: <87oblks4iy.fsf@gnus.org> To: control@debbugs.gnu.org From: Lars Ingebrigtsen Subject: control message for bug #11624 X-MailScanner-ID: 1T9KQL-0002TM-3R X-Netfonds-MailScanner: Found to be clean X-Netfonds-MailScanner-From: larsi@gnus.org MailScanner-NULL-Check: 1347474841.71718@zrqSf+KDz8DOHAqgId7G0w X-Spam-Status: No X-Spam-Score: -1.9 (-) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: debbugs-submit-bounces@debbugs.gnu.org Errors-To: debbugs-submit-bounces@debbugs.gnu.org X-Spam-Score: -1.9 (-) tags 11624 wontfix close 11624