From unknown Sun Aug 17 22:01:51 2025 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.509 (Entity 5.509) Content-Type: text/plain; charset=utf-8 From: bug#54158 <54158@debbugs.gnu.org> To: bug#54158 <54158@debbugs.gnu.org> Subject: Status: 28.0.91; duplicate mail downloads in Gnus (IMAP) Reply-To: bug#54158 <54158@debbugs.gnu.org> Date: Mon, 18 Aug 2025 05:01:51 +0000 retitle 54158 28.0.91; duplicate mail downloads in Gnus (IMAP) reassign 54158 emacs submitter 54158 Roland Winkler severity 54158 normal thanks From debbugs-submit-bounces@debbugs.gnu.org Fri Feb 25 11:43:04 2022 Received: (at submit) by debbugs.gnu.org; 25 Feb 2022 16:43:04 +0000 Received: from localhost ([127.0.0.1]:53577 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nNdgO-0003zi-CV for submit@debbugs.gnu.org; Fri, 25 Feb 2022 11:43:04 -0500 Received: from lists.gnu.org ([209.51.188.17]:34954) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nNdgL-0003zP-Pw for submit@debbugs.gnu.org; Fri, 25 Feb 2022 11:43:03 -0500 Received: from eggs.gnu.org ([209.51.188.92]:57768) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nNdgL-0003tF-34 for bug-gnu-emacs@gnu.org; Fri, 25 Feb 2022 11:43:01 -0500 Received: from [2001:470:142:3::e] (port=38618 helo=fencepost.gnu.org) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nNdgK-0006zV-P4 for bug-gnu-emacs@gnu.org; Fri, 25 Feb 2022 11:43:00 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:Subject:To:From:in-reply-to: references; bh=horxZrLP0Rfx9eTNTMlRYuaupiutBbtmRBcSlEB1G/s=; b=XAdT6MAwFXtO0G tFFZB5AUX22+lKsP0imhcQ4V6ykZVSbMZznM+WbmXaiXwEcxgSvIY6tTK2bf3yM0yWOZxyudPukMG Pd/B+EbsaWY029nhzheDjxg4dsyBI7OSSdKyxOWmGeHaKedT3xQ3V0sCdvnVa9ETSVpQpJfN/EcKZ Y/OQ6nIoM8UW4LzTPdiJTcDOrWFdXeLmjX3uOcr2QhlE2U4zwPq04bj7TxlsFyll2OwSnnga08emP 79A52hv+kdfgUhcy+UOM3lwXNsAEg5MgVapVtX9uppMZO1SqzbNddA7nhHEBsMVvU13GWNi4lys8A UAecDQe0NCEw/3Oah6mA==; Received: from [2600:1700:5650:f790::42] (port=60290 helo=regnitz) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nNdgK-0001Dp-Dq for bug-gnu-emacs@gnu.org; Fri, 25 Feb 2022 11:43:00 -0500 From: Roland Winkler To: bug-gnu-emacs@gnu.org Subject: 28.0.91; duplicate mail downloads in Gnus (IMAP) Date: Fri, 25 Feb 2022 10:42:59 -0600 Message-ID: <87tucmc2y4.fsf@gnu.org> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) I have not been able to get to the root of the following problem. Yet I thought I post it anyway as it is rather annoying. I am fairly new to Gnus when I first used it with Emacs 27 (for about half a year). Since Emacs 28.0.91 came out, I have been using it and this gives me the strange problem that Gnus downloads some mail messages from the IMAP server multiple times without deleting them on the server (typically three to five times) till Gnus (or the IMAP server?) decides it has downloaded this message often enough. These messages are marked in Gnus as duplicates of the first instance of this message. Yet stranger, it only happens with spam emails including many emails that are not marked as spam by the spam filter of the IMAP server. But only when I look into these emails I see that I do not want or need them. First, I thought that something had changed on the IMAP server (Office 365) that triggered this. Then I switched back from Emacs 28.0.91 to Emacs 27.2, when the problem disappeared again. Then I went back to 28.0.91, when I am annoyed again by these duplicate messages. So from all I can tell, it appears to be related to some difference between how Emacs 27 and 28.0.91 fetch mail from the IMAP server. Is anybody else seeing something similar? Let me know what kind of details might help to debug this further. (I am not yet a Gnus expert and yet less an expert of the IMAP protocol that may also play a role here.) In GNU Emacs 28.0.91 (build 2, x86_64-pc-linux-gnu, GTK+ Version 3.24.5, cairo version 1.16.0) of 2022-01-16 built on regnitz Windowing system distributor 'The X.Org Foundation', version 11.0.12004000 System Description: Debian GNU/Linux 10 (buster) Configured using: 'configure --with-native-compilation' Configured features: ACL CAIRO DBUS FREETYPE GIF GLIB GMP GNUTLS GPM GSETTINGS HARFBUZZ JPEG JSON LCMS2 LIBOTF LIBSELINUX LIBSYSTEMD LIBXML2 M17N_FLT MODULES NATIVE_COMP NOTIFY INOTIFY PDUMPER PNG RSVG SECCOMP SOUND THREADS TIFF TOOLKIT_SCROLL_BARS X11 XDBE XIM XPM GTK3 ZLIB Important settings: value of $LC_COLLATE: C value of $LANG: en_US.utf8 value of $XMODIFIERS: @im=ibus locale-coding-system: utf-8-unix From debbugs-submit-bounces@debbugs.gnu.org Fri Feb 25 16:05:28 2022 Received: (at 54158) by debbugs.gnu.org; 25 Feb 2022 21:05:28 +0000 Received: from localhost ([127.0.0.1]:53844 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nNhmJ-0001Hu-Vx for submit@debbugs.gnu.org; Fri, 25 Feb 2022 16:05:28 -0500 Received: from mail.ericabrahamsen.net ([52.70.2.18]:59404) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nNhmH-0001Hg-IV for 54158@debbugs.gnu.org; Fri, 25 Feb 2022 16:05:26 -0500 Received: from localhost (c-71-197-232-41.hsd1.wa.comcast.net [71.197.232.41]) (Authenticated sender: eric@ericabrahamsen.net) by mail.ericabrahamsen.net (Postfix) with ESMTPSA id A550AFA557; Fri, 25 Feb 2022 21:05:19 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericabrahamsen.net; s=mail; t=1645823119; bh=B1EGu+e64uye+zAQDhu3IlfCH7ZQw64edsMu7SJBD78=; h=From:To:Cc:Subject:References:Date:In-Reply-To:From; b=HwhkBDRvPOqReTEMUxxw2fKnizD7pGhDGgiETCAagcjlSIsDn9I7sMNL4fbvf0wKA YwEBiiF3IMmyswNxPFrhDjpDZr6zp+EU6jHgtgO7OVwad7wMNs85mQ6zna4WJDIpsY 8rhdpBf+2ayLJCA79eh3oVtSDqzhSjb5RTtzTrsI= From: Eric Abrahamsen To: Roland Winkler Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> Date: Fri, 25 Feb 2022 13:05:18 -0800 In-Reply-To: <87tucmc2y4.fsf@gnu.org> (Roland Winkler's message of "Fri, 25 Feb 2022 10:42:59 -0600") Message-ID: <87mtiek67l.fsf@ericabrahamsen.net> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/29.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: 54158@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Roland Winkler writes: > I have not been able to get to the root of the following problem. Yet I > thought I post it anyway as it is rather annoying. > > I am fairly new to Gnus when I first used it with Emacs 27 (for about > half a year). Since Emacs 28.0.91 came out, I have been using it and > this gives me the strange problem that Gnus downloads some mail messages > from the IMAP server multiple times without deleting them on the server > (typically three to five times) till Gnus (or the IMAP server?) decides > it has downloaded this message often enough. These messages are marked > in Gnus as duplicates of the first instance of this message. Yet > stranger, it only happens with spam emails including many emails that > are not marked as spam by the spam filter of the IMAP server. But only > when I look into these emails I see that I do not want or need them. You're using the IMAP server as a mail source, right? Can you post your value of `mail-sources'? From debbugs-submit-bounces@debbugs.gnu.org Fri Feb 25 16:36:47 2022 Received: (at 54158) by debbugs.gnu.org; 25 Feb 2022 21:36:47 +0000 Received: from localhost ([127.0.0.1]:53860 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nNiGd-00028y-9d for submit@debbugs.gnu.org; Fri, 25 Feb 2022 16:36:47 -0500 Received: from eggs.gnu.org ([209.51.188.92]:60782) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nNiGb-00028j-A4 for 54158@debbugs.gnu.org; Fri, 25 Feb 2022 16:36:45 -0500 Received: from [2001:470:142:3::e] (port=48532 helo=fencepost.gnu.org) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nNiGV-000809-Vm; Fri, 25 Feb 2022 16:36:39 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=HcFPFzyn9LYTMoZq5FXpk4dKVGUl5A0Ou+/V5bXRym0=; b=CvcHlO77Amk5CcgDL1Ca uOwzGNcB0AD2/jPXrO2xhPlbE8UdmmzT6bgbCmFDLXi71cfNICHmsoZoGpg95KjvU2bdu3y/O1QrP MDJT2+SMaGumvxnn8UwW4J9/iZ90iFtKWXAcutAXDDtQzw6n7DByPftHQqoLwF7w+Kzj43d7anAGl eE1g3sPXLM1RHtyqtSvGMAOPRTmzGOojhS33wIYkVfj79jyexzVAKN5w7RA7E2M68m6K7Tj7G4gQC H3yClK4ALOeZrDycHaKXFF/vz8BWDPduSlzQllnWhwxyLRcwg7iaGwLQUJlZKQlFahy5kBxk92SUj lztc5x8nkVmyqA==; Received: from [2600:1700:5650:f790::42] (port=60922 helo=regnitz) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nNiGV-0000sE-NA; Fri, 25 Feb 2022 16:36:39 -0500 From: Roland Winkler To: Eric Abrahamsen Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87mtiek67l.fsf@ericabrahamsen.net> Date: Fri, 25 Feb 2022 15:36:39 -0600 In-Reply-To: <87mtiek67l.fsf@ericabrahamsen.net> (Eric Abrahamsen's message of "Fri, 25 Feb 2022 13:05:18 -0800") Message-ID: <87v8x2ljbs.fsf@gnu.org> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: 54158@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) On Fri, Feb 25 2022, Eric Abrahamsen wrote: > You're using the IMAP server as a mail source, right? Can you post > your value of `mail-sources'? mail-sources is ((imap :server "localhost" :port 1143 :user "winkler@foo.com" :authentication 'login :predicate "1:*" :mailbox ("INBOX" "JUNK EMAIL")) (pop :server "fencepost.gnu.org" :port 995 :user "winkler" :authentication 'apop)) Server is "localhost" because I am using davmail in between emacs and the actual IMAP server (Office 365). There is no problem with fencepost. From debbugs-submit-bounces@debbugs.gnu.org Sat Feb 26 00:19:47 2022 Received: (at 54158) by debbugs.gnu.org; 26 Feb 2022 05:19:47 +0000 Received: from localhost ([127.0.0.1]:54105 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nNpUg-0006rv-Rs for submit@debbugs.gnu.org; Sat, 26 Feb 2022 00:19:47 -0500 Received: from mail.ericabrahamsen.net ([52.70.2.18]:55130) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nNpUe-0006qg-D5 for 54158@debbugs.gnu.org; Sat, 26 Feb 2022 00:19:45 -0500 Received: from localhost (c-71-197-232-41.hsd1.wa.comcast.net [71.197.232.41]) (Authenticated sender: eric@ericabrahamsen.net) by mail.ericabrahamsen.net (Postfix) with ESMTPSA id 20027FA558; Sat, 26 Feb 2022 05:19:38 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericabrahamsen.net; s=mail; t=1645852778; bh=52uJ+NI4yFPP83MKjVywIJ6k3LcmyDxpUWeyJwOyoTg=; h=From:To:Cc:Subject:References:Date:In-Reply-To:From; b=lLClfJPGx10e/94kparDcRbDd1M9rgpYyWWp0D1U2va8Bq4p/gxWEsjnlMoXEb9ot G++kbR4/lUHykHSmgjHjH4o4lMAlL4c5dBA0sUchJw82KAsJjwS/PBTgpNz+SjmK8R WJ5A2Jxn6M7TmD3Vy13hT0Tn95v5XNp4VFvsrQFo= From: Eric Abrahamsen To: Roland Winkler Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87mtiek67l.fsf@ericabrahamsen.net> <87v8x2ljbs.fsf@gnu.org> Date: Fri, 25 Feb 2022 21:19:36 -0800 In-Reply-To: <87v8x2ljbs.fsf@gnu.org> (Roland Winkler's message of "Fri, 25 Feb 2022 15:36:39 -0600") Message-ID: <87a6eejjbr.fsf@ericabrahamsen.net> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/29.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: 54158@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Roland Winkler writes: > On Fri, Feb 25 2022, Eric Abrahamsen wrote: >> You're using the IMAP server as a mail source, right? Can you post >> your value of `mail-sources'? > > mail-sources is > > ((imap :server "localhost" > :port 1143 > :user "winkler@foo.com" > :authentication 'login > :predicate "1:*" > :mailbox ("INBOX" "JUNK EMAIL")) I went down a bit of a rabbit hole here, and my best guess is that commit daa4e0120 (which is in emacs-28 but not emacs-27) might have resulted in a bug in the dynamic binding of your imap mail-source definition data. More specifically, the body of `mail-source-fetch-imap' is wrapped in `mail-source-bind', which perpetuates some voodoo to locally bind all of the data in your definition to local variables (e.g. :mailbox turns into the variable `mailbox'). `mail-source-fetch-imap' hasn't changed much, but `mail-source-bind' has, so maybe something's going wrong in the binding of imap source data? Something to try would be to edebug `mail-source-fetch-imap' and make sure that the dynamic variables `dontexpunge' and `fetchflag' are what you'd expect them to be, ie nil and "\Deleted". And watch what happens for both "INBOX" and "JUNK EMAIL" (why are you fetching your junk mail, anyway?) when you get to this bit of the code: (when (and remove fetchflag) (setq remove (nreverse remove)) (imap-message-flags-add (imap-range-to-message-set (gnus-compress-sequence remove)) fetchflag nil buf)) (if dontexpunge (imap-mailbox-unselect buf) (imap-mailbox-close nil buf)) To be honest I don't see why `imap-mailbox-close' would expunge mail anyway: its docstring says it does, but no expunge command is given. There's a `imap-mailbox-expunge' function, but nothing ever calls it. Anyway, that part of the code hasn't changed since emacs-27, so . If something funny is happening with the values of fetchflag or dontexpunge, we can drag in Stefan M, who changed `mail-source-bind'. Eric From debbugs-submit-bounces@debbugs.gnu.org Mon Feb 28 11:31:00 2022 Received: (at 54158) by debbugs.gnu.org; 28 Feb 2022 16:31:00 +0000 Received: from localhost ([127.0.0.1]:34626 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nOivL-0004cj-PM for submit@debbugs.gnu.org; Mon, 28 Feb 2022 11:30:59 -0500 Received: from eggs.gnu.org ([209.51.188.92]:46182) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nOivK-0004cX-4V for 54158@debbugs.gnu.org; Mon, 28 Feb 2022 11:30:58 -0500 Received: from [2001:470:142:3::e] (port=43338 helo=fencepost.gnu.org) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nOivE-0003IZ-QS; Mon, 28 Feb 2022 11:30:52 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=J7JPiGnfyk+hQWHrb0nNbC+cy/coY5RizxOL55XC468=; b=DtQeC1PF/cBM8VBTsb53 zZEqJq8Ozc39KD0kOn7TtpJuMK4OuKz3+C9pp4MmSCFqW3bUeWrkBDLbdE6Ml9+kAKTB7wGiHyPpM lcmwqni1RwpLf2jGZ3JGUGwHwoBOgr9zvHIc0e5p4BGpCrGHSvybfcJfyDG3s3y9qMlwf7X5c2EuL rxHYIofLoz+E65k2JpkG3FnJWNzLYaF447pH5DvOE2bgCNuQYSnIisQdc9g61yyMDY4aaBHJrbc20 EZ7EdoRGPdwnJ8F8glHSlxpkMl5vg9Kp9tHWBHGHr8PcVcf0vkafXJTRPjaQZfClnG2cSGbI57Cg3 Qve6qN7Pql8OtQ==; Received: from [2600:1700:5650:f790::42] (port=39182 helo=regnitz) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nOivD-00020B-8T; Mon, 28 Feb 2022 11:30:52 -0500 From: Roland Winkler To: Eric Abrahamsen Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87mtiek67l.fsf@ericabrahamsen.net> <87v8x2ljbs.fsf@gnu.org> <87a6eejjbr.fsf@ericabrahamsen.net> Date: Mon, 28 Feb 2022 10:30:50 -0600 In-Reply-To: <87a6eejjbr.fsf@ericabrahamsen.net> (Eric Abrahamsen's message of "Fri, 25 Feb 2022 21:19:36 -0800") Message-ID: <87lexvdkcl.fsf@gnu.org> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: 54158@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) On Fri, Feb 25 2022, Eric Abrahamsen wrote: > I went down a bit of a rabbit hole here, and my best guess is that > commit daa4e0120 (which is in emacs-28 but not emacs-27) might have > resulted in a bug in the dynamic binding of your imap mail-source > definition data. Thank you! Unfortunately, I am very busy the next couple of days. Later this week I'll try to debug what you have suggested. From debbugs-submit-bounces@debbugs.gnu.org Mon Mar 07 10:50:26 2022 Received: (at 54158) by debbugs.gnu.org; 7 Mar 2022 15:50:26 +0000 Received: from localhost ([127.0.0.1]:54451 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nRFcv-00009e-PL for submit@debbugs.gnu.org; Mon, 07 Mar 2022 10:50:26 -0500 Received: from eggs.gnu.org ([209.51.188.92]:37884) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nRFcu-00009R-HS for 54158@debbugs.gnu.org; Mon, 07 Mar 2022 10:50:24 -0500 Received: from [2001:470:142:3::e] (port=45554 helo=fencepost.gnu.org) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nRFcp-0006F3-6J; Mon, 07 Mar 2022 10:50:19 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=Ea569PVSOYPYeX/u+5iqYmblRDcCOov6Yhp8vR8SOcs=; b=j0dN4KWR9BsjpTSasgxK CMigplhrFURnKZ+UUY3iMcK+g1oMuZk8YkD/S++JzMUVMhgqJUFiVHO1RHMNRGQaf5DnVcOTS62ey 2C8oMi/vlzBVkRdZ2c1uCQRUnfbJGLyuGW7FyxS8u3WZmZJE39vKye3DonOrErJSpUY397aQRlXz2 yVUpMRUIvexA/F4MBcs6a4ac9Mc5OIf/xLSYm4WtXZo1Ko/q/xEpUGn/ljk8LVIU5ALjQ3Onvm+o2 fP5qqnLrW9ur1vSYbHfrzMsjJ8mwuxaMaWEtks7oDmZPjDn4yUKZpVsBhHTK+uTrvD0BrfoOLMXWw ccRkj+23HIsYUQ==; Received: from [2600:1700:5650:f790::42] (port=51180 helo=regnitz) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nRFco-0004Uv-Tt; Mon, 07 Mar 2022 10:50:18 -0500 From: Roland Winkler To: Eric Abrahamsen Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87mtiek67l.fsf@ericabrahamsen.net> <87v8x2ljbs.fsf@gnu.org> <87a6eejjbr.fsf@ericabrahamsen.net> Date: Mon, 07 Mar 2022 09:50:18 -0600 In-Reply-To: <87a6eejjbr.fsf@ericabrahamsen.net> (Eric Abrahamsen's message of "Fri, 25 Feb 2022 21:19:36 -0800") Message-ID: <87a6e1n4n9.fsf@gnu.org> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: 54158@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) On Fri, Feb 25 2022, Eric Abrahamsen wrote: > I went down a bit of a rabbit hole here, and my best guess is that > commit daa4e0120 (which is in emacs-28 but not emacs-27) might have > resulted in a bug in the dynamic binding of your imap mail-source > definition data. ...First I thought "let me revert this patch and see what happens", but that's not a meaningful step. > Something to try would be to edebug `mail-source-fetch-imap' and make > sure that the dynamic variables `dontexpunge' and `fetchflag' are what > you'd expect them to be, ie nil and "\Deleted". And watch what happens > for both "INBOX" and "JUNK EMAIL" The values of these variables are always what you said they should be, nil and "\Deleted". > (why are you fetching your junk mail, anyway?) It's the usual problem that the folder "JUNK EMAIL" contains messages that should not be there. And I haven't figured out how the server identifies mail as spam, nor whether it would allow me to fine-tune this. I find it easier to do all this on the client side. > To be honest I don't see why `imap-mailbox-close' would expunge mail > anyway: its docstring says it does, but no expunge command is given. > There's a `imap-mailbox-expunge' function, but nothing ever calls it. > Anyway, that part of the code hasn't changed since emacs-27, so > . I looked at this code. Unfortunately, the wrappers it uses make it very difficult to understand what it is doing, also because I do not know either what it needs to do to get things right. > If something funny is happening with the values of fetchflag or > dontexpunge, we can drag in Stefan M, who changed `mail-source-bind'. Following your suggestions of monitoring the variables `dontexpunge' and `fetchflag', I do not see anything unusual in mail-source-fetch-imap. My understanding is that IMAP servers permit to expunge individual messages while keeping others, though I do not want to use this feature (I want to expunge everything after fetching it). However, I do not see where mail-source-fetch-imap would implement such fine control. But my problem of multiple downloads exists only for *some*, but not all messages. So it seems to me we may be looking at the wrong part of the code altogether. But that's only a wild guess of someone who does not know much about all of this. Any help is appreciated! Roland From debbugs-submit-bounces@debbugs.gnu.org Thu Mar 10 14:38:41 2022 Received: (at 54158) by debbugs.gnu.org; 10 Mar 2022 19:38:41 +0000 Received: from localhost ([127.0.0.1]:35558 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nSOcT-00059Z-7D for submit@debbugs.gnu.org; Thu, 10 Mar 2022 14:38:41 -0500 Received: from mail.ericabrahamsen.net ([52.70.2.18]:58164) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nSOcR-00059J-Dl for 54158@debbugs.gnu.org; Thu, 10 Mar 2022 14:38:39 -0500 Received: from localhost (c-71-197-232-41.hsd1.wa.comcast.net [71.197.232.41]) (Authenticated sender: eric@ericabrahamsen.net) by mail.ericabrahamsen.net (Postfix) with ESMTPSA id 4D8A1FA0B2; Thu, 10 Mar 2022 19:38:33 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericabrahamsen.net; s=mail; t=1646941113; bh=K8RMOVjKQ7L32SAktJbSo47A/hySTM0LUQMGFKBPQ1U=; h=From:To:Cc:Subject:References:Date:In-Reply-To:From; b=q9t7X5Yy88K7Re7X1Df6lsJGhnERIea4YiKi2NzlR5jLzA8iCR8YKra8QhQKrIxVX Yl4ltX7cYsWvp73VQ5FIr2+4ROgZht83Ohf00nokEiTUUOYLWqzo9H8sszakhgmpOB DIQ1Hnchbzk1K+/v7b7I8Sl1dy6UXzWUHtxlOod0= From: Eric Abrahamsen To: Roland Winkler Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87mtiek67l.fsf@ericabrahamsen.net> <87v8x2ljbs.fsf@gnu.org> <87a6eejjbr.fsf@ericabrahamsen.net> <87a6e1n4n9.fsf@gnu.org> Date: Thu, 10 Mar 2022 11:38:32 -0800 In-Reply-To: <87a6e1n4n9.fsf@gnu.org> (Roland Winkler's message of "Mon, 07 Mar 2022 09:50:18 -0600") Message-ID: <87r1797g3r.fsf@ericabrahamsen.net> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/29.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: 54158@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Roland Winkler writes: > On Fri, Feb 25 2022, Eric Abrahamsen wrote: >> I went down a bit of a rabbit hole here, and my best guess is that >> commit daa4e0120 (which is in emacs-28 but not emacs-27) might have >> resulted in a bug in the dynamic binding of your imap mail-source >> definition data. > > ...First I thought "let me revert this patch and see what happens", but > that's not a meaningful step. > >> Something to try would be to edebug `mail-source-fetch-imap' and make >> sure that the dynamic variables `dontexpunge' and `fetchflag' are what >> you'd expect them to be, ie nil and "\Deleted". And watch what happens >> for both "INBOX" and "JUNK EMAIL" > > The values of these variables are always what you said they should be, > nil and "\Deleted". > >> (why are you fetching your junk mail, anyway?) > > It's the usual problem that the folder "JUNK EMAIL" contains messages > that should not be there. And I haven't figured out how the server > identifies mail as spam, nor whether it would allow me to fine-tune > this. I find it easier to do all this on the client side. > >> To be honest I don't see why `imap-mailbox-close' would expunge mail >> anyway: its docstring says it does, but no expunge command is given. >> There's a `imap-mailbox-expunge' function, but nothing ever calls it. >> Anyway, that part of the code hasn't changed since emacs-27, so >> . > > I looked at this code. Unfortunately, the wrappers it uses make it very > difficult to understand what it is doing, also because I do not know > either what it needs to do to get things right. > >> If something funny is happening with the values of fetchflag or >> dontexpunge, we can drag in Stefan M, who changed `mail-source-bind'. > > Following your suggestions of monitoring the variables `dontexpunge' and > `fetchflag', I do not see anything unusual in mail-source-fetch-imap. My intuitive shots-in-the-dark are pretty much always wrong :( > My understanding is that IMAP servers permit to expunge individual > messages while keeping others, though I do not want to use this feature > (I want to expunge everything after fetching it). However, I do not see > where mail-source-fetch-imap would implement such fine control. But my > problem of multiple downloads exists only for *some*, but not all > messages. So it seems to me we may be looking at the wrong part of the > code altogether. But that's only a wild guess of someone who does not > know much about all of this. I don't know that much, either. I'll set up a local IMAP account and do some testing with this, but it will take me a week or so to get to it. Can you tell me what IMAP server you're talking to here? From debbugs-submit-bounces@debbugs.gnu.org Sun Mar 13 00:33:32 2022 Received: (at 54158) by debbugs.gnu.org; 13 Mar 2022 05:33:32 +0000 Received: from localhost ([127.0.0.1]:41378 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nTGrD-0007Ze-TL for submit@debbugs.gnu.org; Sun, 13 Mar 2022 00:33:32 -0500 Received: from eggs.gnu.org ([209.51.188.92]:41876) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nTGrC-0007ZR-6s for 54158@debbugs.gnu.org; Sun, 13 Mar 2022 00:33:30 -0500 Received: from [2001:470:142:3::e] (port=50938 helo=fencepost.gnu.org) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nTGr6-00067r-SU; Sun, 13 Mar 2022 00:33:24 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=pPaRHZY+LWBR7IaAKpvQ+s9AYMCmiDWO9huV6zxj968=; b=F+Pdllv1BaAwHBkmXFw4 D39ymTe8FouOWHhX+S9mQEkLggCVnS9x2+K61njVXC7vn1GqvVMGPNRZOJ6XJUAMZATvyyIP+X1qW VuSM20qe4kmAu5iuyaikM420ZF7e3Epyi4oh0DsdLFuWe+NXQ2zY3xn1dsNGFt9vipI7eyat0hOxW XQYgvtfHwSI6YzQkexA39jRfbo4cOIrKE1CJzmgLRW0pHhj2qmng1rlT964ypSjkRh4+pQI2XHV/l sFilSDbqZP5ztuwXiYeNc/9dsBMRSob0h7pn7J/3RAHADpDGtXsGo6lDU+RmLrLupV4EqrmOwuY9R gU1Tt+NDp+ifPA==; Received: from [2600:1700:5650:f790::42] (port=33500 helo=regnitz) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nTGr6-0004ak-IB; Sun, 13 Mar 2022 00:33:24 -0500 From: Roland Winkler To: Eric Abrahamsen Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87mtiek67l.fsf@ericabrahamsen.net> <87v8x2ljbs.fsf@gnu.org> <87a6eejjbr.fsf@ericabrahamsen.net> <87a6e1n4n9.fsf@gnu.org> <87r1797g3r.fsf@ericabrahamsen.net> Date: Sat, 12 Mar 2022 23:33:24 -0600 In-Reply-To: <87r1797g3r.fsf@ericabrahamsen.net> (Eric Abrahamsen's message of "Thu, 10 Mar 2022 11:38:32 -0800") Message-ID: <87v8wi8li3.fsf@gnu.org> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: 54158@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) On Thu, Mar 10 2022, Eric Abrahamsen wrote: >> My understanding is that IMAP servers permit to expunge individual >> messages while keeping others, though I do not want to use this feature >> (I want to expunge everything after fetching it). However, I do not see >> where mail-source-fetch-imap would implement such fine control. But my >> problem of multiple downloads exists only for *some*, but not all >> messages. So it seems to me we may be looking at the wrong part of the >> code altogether. But that's only a wild guess of someone who does not >> know much about all of this. > > I don't know that much, either. I'll set up a local IMAP account and do > some testing with this, but it will take me a week or so to get to it. > Can you tell me what IMAP server you're talking to here? The IMAP server is Office365 that's accessed via a local davmail (for Office365 interactive authentication). I was always surprised that the duplicate emails are "mostly spam". Previously, I sent you my settting of `mail-sources'. I changed the line :mailbox ("INBOX" "JUNK EMAIL") to :mailbox ("JUNK EMAIL" "INBOX") Strange enough, I didn't observe any duplicate message downloads when I tested this for a few days. To be more specific: if I understand the office365 spam filter correctly, it puts messages quite generously into the "JUNK EMAIL" folder, which is why I prefer to review these messages locally. But these messages in "JUNK EMAIL" are tagged as spam more or less aggressively as spam. Also, I believe gnus won't tell me whether it downloaded a message from the INBOX or "JUNK EMAIL" folder. That's why I cannot tell with certainty for some of the duplicate downloads from which folder on the server they originated. But it seems that all my duplicate messages are coming from the "JUNK EMAIL" folder on the IMAP server. I believe that "INBOX" is really the default folder on an IMAP server that also appears in some gnus defaults. Then, adding another folder to :mailbox may be less common. So my problems arise only in what may be a less frequent use case. Certainly, this becomes yet more obscure if it matters whether a second folder is listed in :mailbox before or after the default "INBOX". All the above is describing symptoms. The root of the problem remains unclear to me. Roland From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 18 11:27:43 2022 Received: (at 54158) by debbugs.gnu.org; 18 Mar 2022 15:27:43 +0000 Received: from localhost ([127.0.0.1]:58118 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVEVz-0008U7-8e for submit@debbugs.gnu.org; Fri, 18 Mar 2022 11:27:43 -0400 Received: from mailscanner.iro.umontreal.ca ([132.204.25.50]:8765) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVEVx-0008Tq-PG for 54158@debbugs.gnu.org; Fri, 18 Mar 2022 11:27:42 -0400 Received: from pmg3.iro.umontreal.ca (localhost [127.0.0.1]) by pmg3.iro.umontreal.ca (Proxmox) with ESMTP id AE337442280; Fri, 18 Mar 2022 11:27:35 -0400 (EDT) Received: from mail01.iro.umontreal.ca (unknown [172.31.2.1]) by pmg3.iro.umontreal.ca (Proxmox) with ESMTP id 703814415D8; Fri, 18 Mar 2022 11:27:34 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=iro.umontreal.ca; s=mail; t=1647617254; bh=OHzLfKqWG2IKEPsIoy1rN/ur7ySeFcp6J9+eP4SMIH4=; h=From:To:Cc:Subject:References:Date:In-Reply-To:From; b=N6EBWID5NXoMv7k1n2LHUd2LOmULM4ZFntlb8XkWQnf10BfXH1gDQrlCd/jfrHol9 fBIKSmlsNcBamqdUoisOiKlfnFC9wjuLYOLJg1kz9etguTNejwGv90EvUtbMZjq/Qh um7KJTbkpxMDEcME5CCA1vKRF2ItrDhAseU3gXPTEuCMCw3mS/lrltFAHQhcZgWB7Y zidSg6ugrRH2weyFBA+X9i/cgPS6UPnUl10Jgvkex9c2WbViovCs0AP6lUjTduADun xDQ3aWaGY3xkKjQ7u16mD2B9eQ+PG8ZrUb+9uC5Dveo/WXkjm6BzJTqGb5jnPRJnvR 7WFkcPnnpYXMA== Received: from ceviche (unknown [45.44.229.252]) by mail01.iro.umontreal.ca (Postfix) with ESMTPSA id 4EF5412066D; Fri, 18 Mar 2022 11:27:34 -0400 (EDT) From: Stefan Monnier To: Eric Abrahamsen Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) Message-ID: References: <87tucmc2y4.fsf@gnu.org> <87mtiek67l.fsf@ericabrahamsen.net> <87v8x2ljbs.fsf@gnu.org> <87a6eejjbr.fsf@ericabrahamsen.net> Date: Fri, 18 Mar 2022 11:27:32 -0400 In-Reply-To: <87a6eejjbr.fsf@ericabrahamsen.net> (Eric Abrahamsen's message of "Fri, 25 Feb 2022 21:19:36 -0800") User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/29.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-SPAM-INFO: Spam detection results: 0 ALL_TRUSTED -1 Passed through trusted hosts only via SMTP AWL 0.108 Adjusted score from AWL reputation of From: address BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain T_SCC_BODY_TEXT_LINE -0.01 - X-SPAM-LEVEL: X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: 54158@debbugs.gnu.org, Roland Winkler X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) > If something funny is happening with the values of fetchflag or > dontexpunge, we can drag in Stefan M, who changed `mail-source-bind'. FWIW, I just took a look at the macroexpanded form of `mail-source-fetch-imap` and my "fishiness" detector didn't notice anything out of the expected. I don't understand the code enough to detect if there's something wrong, but at least the new expanded code looks the way I wanted to make it look (e.g. `dontexpunge` is indeed dynamically bound inside this function). Stefan From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 18 12:03:39 2022 Received: (at 54158) by debbugs.gnu.org; 18 Mar 2022 16:03:39 +0000 Received: from localhost ([127.0.0.1]:58173 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVF4Y-00014C-KO for submit@debbugs.gnu.org; Fri, 18 Mar 2022 12:03:39 -0400 Received: from mail.ericabrahamsen.net ([52.70.2.18]:52028) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVF4X-00013w-1n for 54158@debbugs.gnu.org; Fri, 18 Mar 2022 12:03:25 -0400 Received: from localhost (c-71-197-232-41.hsd1.wa.comcast.net [71.197.232.41]) (Authenticated sender: eric@ericabrahamsen.net) by mail.ericabrahamsen.net (Postfix) with ESMTPSA id 75077FA023; Fri, 18 Mar 2022 16:03:19 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericabrahamsen.net; s=mail; t=1647619399; bh=j3ZnyDox0B93lQfFRMMZRD6e3upzy0GR0o1yju5/FEo=; h=From:To:Cc:Subject:References:Date:In-Reply-To:From; b=F7XpXILykUhw/FQIvXrVQaiqtotD710or7zGu7FFkVCdWUXGiCAl88Bp6Ry2aJVhl tZhf/5aO71d06i1Dv5TrMgRHnsh/hbLdC8ofj8HvjMTkrBgeNi5IaXe6/ZCsRDkTlK e2Oz3gS3OZ/poSHylJeipzdysbYJmk3mXAN12SyI= From: Eric Abrahamsen To: Stefan Monnier Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87mtiek67l.fsf@ericabrahamsen.net> <87v8x2ljbs.fsf@gnu.org> <87a6eejjbr.fsf@ericabrahamsen.net> Date: Fri, 18 Mar 2022 09:03:18 -0700 In-Reply-To: (Stefan Monnier's message of "Fri, 18 Mar 2022 11:27:32 -0400") Message-ID: <877d8rqmd5.fsf@ericabrahamsen.net> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/29.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: 54158@debbugs.gnu.org, Roland Winkler X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) On 03/18/22 11:27 AM, Stefan Monnier wrote: >> If something funny is happening with the values of fetchflag or >> dontexpunge, we can drag in Stefan M, who changed `mail-source-bind'. > > FWIW, I just took a look at the macroexpanded form of > `mail-source-fetch-imap` and my "fishiness" detector didn't notice > anything out of the expected. > > I don't understand the code enough to detect if there's something wrong, > but at least the new expanded code looks the way I wanted to make it > look (e.g. `dontexpunge` is indeed dynamically bound inside this > function). Yeah, my "hunches" are wrong almost 100% of the time. It's too bad, though, because otherwise I don't have the faintest idea where to start debugging this. I was just going to set up a local IMAP account to use as a mail source, and hope that something presented itself. From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 18 12:10:04 2022 Received: (at 54158) by debbugs.gnu.org; 18 Mar 2022 16:10:05 +0000 Received: from localhost ([127.0.0.1]:58178 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVFAy-0001Ep-Kc for submit@debbugs.gnu.org; Fri, 18 Mar 2022 12:10:04 -0400 Received: from eggs.gnu.org ([209.51.188.92]:51764) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVFAv-0001EC-Nr for 54158@debbugs.gnu.org; Fri, 18 Mar 2022 12:10:02 -0400 Received: from [2001:470:142:3::e] (port=50736 helo=fencepost.gnu.org) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nVFAl-000564-Kp; Fri, 18 Mar 2022 12:09:56 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=uCaWau7uyek81bdJT+AmrJAfbugLiP7nyvQnHE5rErc=; b=UA0n+cNLhqxK6oxYTL0N nsUTwyJaDuzXl8IS7HZXWLc+boF/5ZruYZBOSefaMaqM0lg+Uep3d5qopZaGr+P7+8HDSdxAFMgJg x2bk7D9bJrdfSquuCJPjDDXeX+wXidA3rCEDr6U9dfIXaaxtHqC7sKk7yGB4d0kbfE4iy+MgH9MRN T3xc4Ba6hc6ahNvAzulVtHYPGzp96VHmwct0fG1ewJyCyHvaueMVxE87/59rf9DzExb7TFrJg3d/9 cipvXRC5NIUNs83dkhgQOsD1Xfvklt+3zZ8B9xZhLkH08x5QUn1sMc0dUjuWGgjTNvRW44IWbxueT rUsQjHmBBc9iBA==; Received: from [2600:1700:5650:f790::42] (port=36792 helo=regnitz) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nVFAl-0007KT-A6; Fri, 18 Mar 2022 12:09:51 -0400 From: Roland Winkler To: Eric Abrahamsen Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87mtiek67l.fsf@ericabrahamsen.net> <87v8x2ljbs.fsf@gnu.org> <87a6eejjbr.fsf@ericabrahamsen.net> <87a6e1n4n9.fsf@gnu.org> <87r1797g3r.fsf@ericabrahamsen.net> <87v8wi8li3.fsf@gnu.org> Date: Fri, 18 Mar 2022 11:09:50 -0500 In-Reply-To: <87v8wi8li3.fsf@gnu.org> (Roland Winkler's message of "Sat, 12 Mar 2022 23:33:24 -0600") Message-ID: <874k3vutrl.fsf@gnu.org> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: 54158@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) On Sat, Mar 12 2022, Roland Winkler wrote: > I was always surprised that the duplicate emails are "mostly spam". > Previously, I sent you my settting of `mail-sources'. I changed the > line > > :mailbox ("INBOX" "JUNK EMAIL") > > to > > :mailbox ("JUNK EMAIL" "INBOX") > > Strange enough, I didn't observe any duplicate message downloads when I > tested this for a few days. One more observation: The bug appears to be related to :mailbox being a list of folders. I just installed a rule on the IMAP server that puts part of my regular incoming mail in another folder FOO. Now downloading the messages from the IMAP folder FOO into Gnus gives me more duplicates. Any IMAP folder beyond INBOX appears to show this behavior. From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 18 12:19:52 2022 Received: (at 54158) by debbugs.gnu.org; 18 Mar 2022 16:19:52 +0000 Received: from localhost ([127.0.0.1]:58198 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVFKS-0001Vi-LD for submit@debbugs.gnu.org; Fri, 18 Mar 2022 12:19:52 -0400 Received: from mail.ericabrahamsen.net ([52.70.2.18]:52756) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVFKR-0001VU-MX for 54158@debbugs.gnu.org; Fri, 18 Mar 2022 12:19:51 -0400 Received: from localhost (c-71-197-232-41.hsd1.wa.comcast.net [71.197.232.41]) (Authenticated sender: eric@ericabrahamsen.net) by mail.ericabrahamsen.net (Postfix) with ESMTPSA id CF50DFA023; Fri, 18 Mar 2022 16:19:45 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericabrahamsen.net; s=mail; t=1647620386; bh=SM9QVNyzP7I/6Ct7SvQzJryJMM7FOmQ+SPCUxgv9eGU=; h=From:To:Cc:Subject:References:Date:In-Reply-To:From; b=BCIG/EKwbobHjZ/gGl+N2VzXuJQYauHCpWOQe30lLGiJr57DLHjCmWl7pGDzZIhUR zhSgvmv7gO9YDasS+WCtvjlTw186/57bX7FaSo2gzhSgn2W4cqfQf9/xP9NCSnfHdC pqDFnBxoairej8Yuy4KncbScjqLdBwVevedQpdH4= From: Eric Abrahamsen To: Roland Winkler Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87mtiek67l.fsf@ericabrahamsen.net> <87v8x2ljbs.fsf@gnu.org> <87a6eejjbr.fsf@ericabrahamsen.net> <87a6e1n4n9.fsf@gnu.org> <87r1797g3r.fsf@ericabrahamsen.net> <87v8wi8li3.fsf@gnu.org> <874k3vutrl.fsf@gnu.org> Date: Fri, 18 Mar 2022 09:19:44 -0700 In-Reply-To: <874k3vutrl.fsf@gnu.org> (Roland Winkler's message of "Fri, 18 Mar 2022 11:09:50 -0500") Message-ID: <8735jfqllr.fsf@ericabrahamsen.net> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/29.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: 54158@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) On 03/18/22 11:09 AM, Roland Winkler wrote: > On Sat, Mar 12 2022, Roland Winkler wrote: >> I was always surprised that the duplicate emails are "mostly spam". >> Previously, I sent you my settting of `mail-sources'. I changed the >> line >> >> :mailbox ("INBOX" "JUNK EMAIL") >> >> to >> >> :mailbox ("JUNK EMAIL" "INBOX") >> >> Strange enough, I didn't observe any duplicate message downloads when I >> tested this for a few days. > > One more observation: > > The bug appears to be related to :mailbox being a list of folders. > I just installed a rule on the IMAP server that puts part of my regular > incoming mail in another folder FOO. Now downloading the messages from > the IMAP folder FOO into Gnus gives me more duplicates. Any IMAP folder > beyond INBOX appears to show this behavior. Okay, that's helpful, thanks. I'll try to concentrate on finding differences in behavior between a single :mailbox and multiple. From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 18 12:34:34 2022 Received: (at 54158) by debbugs.gnu.org; 18 Mar 2022 16:34:34 +0000 Received: from localhost ([127.0.0.1]:58214 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVFYg-0001wB-3h for submit@debbugs.gnu.org; Fri, 18 Mar 2022 12:34:34 -0400 Received: from eggs.gnu.org ([209.51.188.92]:58792) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVFYe-0001vx-Ea for 54158@debbugs.gnu.org; Fri, 18 Mar 2022 12:34:32 -0400 Received: from [2001:470:142:3::e] (port=51364 helo=fencepost.gnu.org) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nVFYY-0000xA-C6; Fri, 18 Mar 2022 12:34:27 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=BMONQN2icn0EaVZviDKvdrHpQyBS+2Siacxc4aSceGA=; b=UIgdomgfy1tCiRmOPA3D ha3KZjIiFG254x9NRA586WsjnH8TL9H7EjOCCd1udNCCSd5EVVh1KnHEYZL3l3qnFcM7XM0XLkOs0 8vXqSZtCUBbqqcB9tL4rpUDWzz3vioWMnecN65GY2WVQEqZLmrpO+qN4Y/934GR71VdupDbt8MQ+b tscpWSMj1/NUCke6OtVBMQ6ima1si/jYIrvLFOca6AsSowzIYnxGIaLFAjvpPgibliC78j2+jBYB/ 4f/+Tj4LIAXpBQqgpKpUfeIK9oBCeGoxocfGF38sl38KwukkwggyZ3rmGKqVCNXZRQ9gHZSeTlVvZ fryQaIpMZxw2tw==; Received: from [2600:1700:5650:f790::42] (port=36914 helo=regnitz) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nVFYY-0005Gy-49; Fri, 18 Mar 2022 12:34:26 -0400 From: Roland Winkler To: Eric Abrahamsen Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87mtiek67l.fsf@ericabrahamsen.net> <87v8x2ljbs.fsf@gnu.org> <87a6eejjbr.fsf@ericabrahamsen.net> <87a6e1n4n9.fsf@gnu.org> <87r1797g3r.fsf@ericabrahamsen.net> <87v8wi8li3.fsf@gnu.org> <874k3vutrl.fsf@gnu.org> <8735jfqllr.fsf@ericabrahamsen.net> Date: Fri, 18 Mar 2022 11:34:25 -0500 In-Reply-To: <8735jfqllr.fsf@ericabrahamsen.net> (Eric Abrahamsen's message of "Fri, 18 Mar 2022 09:19:44 -0700") Message-ID: <8735jfte26.fsf@gnu.org> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: 54158@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) On Fri, Mar 18 2022, Eric Abrahamsen wrote: > Okay, that's helpful, thanks. I'll try to concentrate on finding > differences in behavior between a single :mailbox and multiple. One more thought: My Gnus talks to the imap server on localhost (davmail). Is it possible to look at this communication? Then I could try to find out in which way Emacs 27 is communicating differently with the imap server compared with Emacs 28. (I just convinced myself once more that the problems with duplicate mail downloads for multiple folders on the IMAP server go away when I use Emacs 27.) From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 18 12:45:40 2022 Received: (at 54158) by debbugs.gnu.org; 18 Mar 2022 16:45:40 +0000 Received: from localhost ([127.0.0.1]:58220 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVFjQ-0002Eh-4L for submit@debbugs.gnu.org; Fri, 18 Mar 2022 12:45:40 -0400 Received: from mail-wr1-f54.google.com ([209.85.221.54]:34685) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVFjO-0002EV-39 for 54158@debbugs.gnu.org; Fri, 18 Mar 2022 12:45:38 -0400 Received: by mail-wr1-f54.google.com with SMTP id m30so2649084wrb.1 for <54158@debbugs.gnu.org>; Fri, 18 Mar 2022 09:45:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:cc:subject:references:date:in-reply-to:message-id :mime-version; bh=IBweEPuk5obOZZdxi7rsz0/feGXAlffFUrUZCNi3LS8=; b=COcgKJn1R0MDhh643UL+7qamSvQWNlHnHZ35iyQdbSZ4PR4jHilza7QfkgcyFn2Fxl v3CcdGB1W3auJLW0/jlSHEGfKLz9rQSeeCcseTsXHsdDaU9/LLGBDQuEWATECrpM6QzB 6ASR7g2RMmYfhGU1IeFVMNmf/McEZ1Ix/l69kxSYZlYypxLU/3vw/lgR8u0lVWTkwezL CG7wImTT361KVeKtw/yMLBKjuvK+cLra652OdjlFcU4hrvOLL4Mj24zw1CygHbQAsCA+ svipXof5k5e68ZN/PiFPaUqqABjT9Sh7WDv4uLr0F5MjPbLlevqVzOSR0yNRoa0LSUxp zLVA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:references:date:in-reply-to :message-id:mime-version; bh=IBweEPuk5obOZZdxi7rsz0/feGXAlffFUrUZCNi3LS8=; b=xzq4NS1y5jK8HGr7cYtZr+Pz93/KVpX9TWX0bqb0rJYJtwTamblJyz2LzRTqzyTpR1 39vX7T65E+DMvQD8uLJvBiilgTSGQXkzyxLfj7tBIysSxMyNCs6T7SSfDCMsrE4W7Rws QHtpquvUQ+CoO97GPFfD1frzPpKC3MhQljQFV8EQPgLf2Z4fmA2Xv0YwZPKFPg8ETzKb N+ro3MlLgPw81d243ebLjjmk8Qz9caz2G/a9Qbs+QWqz+Z0R0Fvyl88nvP5T2DQH34tJ F+Q0w/ORs4FynrnDUzc6HupCMkDehNJ4EFQzSdIfLLjqUQ2S/oUQZa8UqYJ8UEtEd6Qr zDGA== X-Gm-Message-State: AOAM531LMmcwly3YtOW6hfFWRodzvuyQI2wRUXNSL94jMD3KCHd6hb7b hcKpG8v3CtHLpF4s4tkjDByNz9vxe5o= X-Google-Smtp-Source: ABdhPJzc3AQuFQwgxwdX2VYEEFB6TZo0679RW5TkjYM2rX1XpXsRgfM3Z2Wo8dn7oVsU5YFxx4Rrig== X-Received: by 2002:adf:f84c:0:b0:203:f4b9:4213 with SMTP id d12-20020adff84c000000b00203f4b94213mr4027164wrq.27.1647621931758; Fri, 18 Mar 2022 09:45:31 -0700 (PDT) Received: from rltb ([2a01:e0a:3f3:fb50:3d70:9c22:114c:213b]) by smtp.gmail.com with ESMTPSA id m9-20020a05600c4f4900b00389e8184edcsm10400830wmq.35.2022.03.18.09.45.30 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 18 Mar 2022 09:45:31 -0700 (PDT) From: Robert Pluim To: Roland Winkler Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87mtiek67l.fsf@ericabrahamsen.net> <87v8x2ljbs.fsf@gnu.org> <87a6eejjbr.fsf@ericabrahamsen.net> <87a6e1n4n9.fsf@gnu.org> <87r1797g3r.fsf@ericabrahamsen.net> <87v8wi8li3.fsf@gnu.org> <874k3vutrl.fsf@gnu.org> <8735jfqllr.fsf@ericabrahamsen.net> <8735jfte26.fsf@gnu.org> Date: Fri, 18 Mar 2022 17:45:30 +0100 In-Reply-To: <8735jfte26.fsf@gnu.org> (Roland Winkler's message of "Fri, 18 Mar 2022 11:34:25 -0500") Message-ID: <87wngr9plh.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 54158 Cc: Eric Abrahamsen , 54158@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) >>>>> On Fri, 18 Mar 2022 11:34:25 -0500, Roland Winkler said: Roland> On Fri, Mar 18 2022, Eric Abrahamsen wrote: >> Okay, that's helpful, thanks. I'll try to concentrate on finding >> differences in behavior between a single :mailbox and multiple. Roland> One more thought: Roland> My Gnus talks to the imap server on localhost (davmail). Is it possible Roland> to look at this communication? Then I could try to find out in which Roland> way Emacs 27 is communicating differently with the imap server compared Roland> with Emacs 28. You mean (setq imap-log t)? Robert -- From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 18 12:49:32 2022 Received: (at 54158) by debbugs.gnu.org; 18 Mar 2022 16:49:33 +0000 Received: from localhost ([127.0.0.1]:58224 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVFnA-0002NH-Kt for submit@debbugs.gnu.org; Fri, 18 Mar 2022 12:49:32 -0400 Received: from mail.ericabrahamsen.net ([52.70.2.18]:54112) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVFn9-0002N0-1M for 54158@debbugs.gnu.org; Fri, 18 Mar 2022 12:49:31 -0400 Received: from localhost (c-71-197-232-41.hsd1.wa.comcast.net [71.197.232.41]) (Authenticated sender: eric@ericabrahamsen.net) by mail.ericabrahamsen.net (Postfix) with ESMTPSA id 3C08DFA023; Fri, 18 Mar 2022 16:49:25 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericabrahamsen.net; s=mail; t=1647622165; bh=Cj6gzK2HeQcK9+tIag1nEOEc+0xqzTBsqUVlTGGLB3s=; h=From:To:Cc:Subject:References:Date:In-Reply-To:From; b=rrRJN4/wPQ5B+sb8Oq30fzk13rTm/Ju3g+FCfMhSMUU1GZWe8nXvKVQrQtRlC1TUu 85zHFrWpoEb+9ss5zO1VaoHCaEGM2rYZLTSp4f69VdgKO2LuklmP/sekbuDd5SNPSe 6ZPYpDhkqlpqzJvuE6diyzpb1Le0rg2zEGsR2Ays= From: Eric Abrahamsen To: Roland Winkler Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87mtiek67l.fsf@ericabrahamsen.net> <87v8x2ljbs.fsf@gnu.org> <87a6eejjbr.fsf@ericabrahamsen.net> <87a6e1n4n9.fsf@gnu.org> <87r1797g3r.fsf@ericabrahamsen.net> <87v8wi8li3.fsf@gnu.org> <874k3vutrl.fsf@gnu.org> <8735jfqllr.fsf@ericabrahamsen.net> <8735jfte26.fsf@gnu.org> Date: Fri, 18 Mar 2022 09:49:24 -0700 In-Reply-To: <8735jfte26.fsf@gnu.org> (Roland Winkler's message of "Fri, 18 Mar 2022 11:34:25 -0500") Message-ID: <87y217p5nv.fsf@ericabrahamsen.net> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/29.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: 54158@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) On 03/18/22 11:34 AM, Roland Winkler wrote: > On Fri, Mar 18 2022, Eric Abrahamsen wrote: >> Okay, that's helpful, thanks. I'll try to concentrate on finding >> differences in behavior between a single :mailbox and multiple. > > One more thought: > > My Gnus talks to the imap server on localhost (davmail). Is it possible > to look at this communication? Then I could try to find out in which > way Emacs 27 is communicating differently with the imap server compared > with Emacs 28. > > (I just convinced myself once more that the problems with duplicate mail > downloads for multiple folders on the IMAP server go away when I use > Emacs 27.) You can set `nnimap-record-commands' non-nil, and should get a buffer containing the client-server conversation to look at. From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 18 12:53:49 2022 Received: (at 54158) by debbugs.gnu.org; 18 Mar 2022 16:53:49 +0000 Received: from localhost ([127.0.0.1]:58234 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVFrJ-0002V2-BT for submit@debbugs.gnu.org; Fri, 18 Mar 2022 12:53:49 -0400 Received: from mail.ericabrahamsen.net ([52.70.2.18]:54300) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVFrH-0002Uj-K9 for 54158@debbugs.gnu.org; Fri, 18 Mar 2022 12:53:47 -0400 Received: from localhost (c-71-197-232-41.hsd1.wa.comcast.net [71.197.232.41]) (Authenticated sender: eric@ericabrahamsen.net) by mail.ericabrahamsen.net (Postfix) with ESMTPSA id E3D0BFA023; Fri, 18 Mar 2022 16:53:41 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericabrahamsen.net; s=mail; t=1647622422; bh=t9hdMcoxRVMIP5x3HLu/pKMYwqcui2ZbDBCI3oOEQTY=; h=From:To:Cc:Subject:References:Date:In-Reply-To:From; b=T613UGfi+N/mphgSODlmJ3Z2r8iHWRNdlLP2RqnYxLXD6kuIH+dHki4iAb0Kf/icr hC8In3qZuD5sBIhARkueSjTBEoNN+zoSAgRvmaNdbYwdU18YSwV21UEUMcnTzCAZlh +Fv/LHpg5sNA1bOKM2QuKAQnGOivXp8hMB6Zn2sY= From: Eric Abrahamsen To: Roland Winkler Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87mtiek67l.fsf@ericabrahamsen.net> <87v8x2ljbs.fsf@gnu.org> <87a6eejjbr.fsf@ericabrahamsen.net> <87a6e1n4n9.fsf@gnu.org> <87r1797g3r.fsf@ericabrahamsen.net> <87v8wi8li3.fsf@gnu.org> <874k3vutrl.fsf@gnu.org> <8735jfqllr.fsf@ericabrahamsen.net> <8735jfte26.fsf@gnu.org> <87y217p5nv.fsf@ericabrahamsen.net> Date: Fri, 18 Mar 2022 09:53:40 -0700 In-Reply-To: <87y217p5nv.fsf@ericabrahamsen.net> (Eric Abrahamsen's message of "Fri, 18 Mar 2022 09:49:24 -0700") Message-ID: <87tubvp5gr.fsf@ericabrahamsen.net> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/29.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: 54158@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Eric Abrahamsen writes: > On 03/18/22 11:34 AM, Roland Winkler wrote: >> On Fri, Mar 18 2022, Eric Abrahamsen wrote: >>> Okay, that's helpful, thanks. I'll try to concentrate on finding >>> differences in behavior between a single :mailbox and multiple. >> >> One more thought: >> >> My Gnus talks to the imap server on localhost (davmail). Is it possible >> to look at this communication? Then I could try to find out in which >> way Emacs 27 is communicating differently with the imap server compared >> with Emacs 28. >> >> (I just convinced myself once more that the problems with duplicate mail >> downloads for multiple folders on the IMAP server go away when I use >> Emacs 27.) > > You can set `nnimap-record-commands' non-nil, and should get a buffer > containing the client-server conversation to look at. Sorry, this is only for nnimap servers. Robert's suggestion is the right one (imap-log no longer exists, but I think it's still there in Emacs 28.1?) From debbugs-submit-bounces@debbugs.gnu.org Fri Mar 18 13:55:39 2022 Received: (at 54158) by debbugs.gnu.org; 18 Mar 2022 17:55:39 +0000 Received: from localhost ([127.0.0.1]:58330 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVGp9-0006Pm-GI for submit@debbugs.gnu.org; Fri, 18 Mar 2022 13:55:39 -0400 Received: from eggs.gnu.org ([209.51.188.92]:48318) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVGp8-0006Pa-IO for 54158@debbugs.gnu.org; Fri, 18 Mar 2022 13:55:38 -0400 Received: from [2001:470:142:3::e] (port=57402 helo=fencepost.gnu.org) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nVGp3-0005QF-2N; Fri, 18 Mar 2022 13:55:33 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=RTyEXnOq+y4Iu7nVumrEPxGBpyo8pLf7nXbXi8zJAUw=; b=LIJ+AYR001q9PxMiH+eB ukmLoKFmqWqrCJsibDTQ/wrEuY2thausE1muqLAHi+ABSXGQ5RVzCDPOUvJihg51f9ZDwht0Ja8di mZ+KENNQR5cfQW2+Cmu/mn977GevlxjISfzmwuEfpxLT/YT5VIQj9CSx6gy4MRFEj9B7HP/ZRzhh3 RMGA2bIt/PzyAwS1gHoQ831jywQJ/nzirT1tpIIIqthG3uazIQs6K+5kfoFZ2bh2ghLzbMfuhoqtO 83hN/qQpCehFv54UBEHOjYNNMxA8dRvmUijUn3cYox/mGv/CZ3eqgvHRGQpjUWIgGwP2fZoPBVLW3 hHFeNjeI0Kw8EA==; Received: from [2600:1700:5650:f790::42] (port=37758 helo=regnitz) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nVGog-0003dM-6e; Fri, 18 Mar 2022 13:55:24 -0400 From: Roland Winkler To: Robert Pluim Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87mtiek67l.fsf@ericabrahamsen.net> <87v8x2ljbs.fsf@gnu.org> <87a6eejjbr.fsf@ericabrahamsen.net> <87a6e1n4n9.fsf@gnu.org> <87r1797g3r.fsf@ericabrahamsen.net> <87v8wi8li3.fsf@gnu.org> <874k3vutrl.fsf@gnu.org> <8735jfqllr.fsf@ericabrahamsen.net> <8735jfte26.fsf@gnu.org> <87wngr9plh.fsf@gmail.com> Date: Fri, 18 Mar 2022 12:55:09 -0500 In-Reply-To: <87wngr9plh.fsf@gmail.com> (Robert Pluim's message of "Fri, 18 Mar 2022 17:45:30 +0100") Message-ID: <87pmmjrvr6.fsf@gnu.org> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: Eric Abrahamsen , 54158@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) On Fri, Mar 18 2022, Robert Pluim wrote: > You mean (setq imap-log t)? YES, thank you! So finally I can be more specific: (1) When the message from Imap folder FOO is not properly deleted on the server, the log buffer says (Emacs 28) 11 OK UID FETCH completed%d 12 UID STORE 135750,27 +FLAGS (\Deleted)%d 12 OK STORE completed%d 13 CLOSE%d 13 OK CLOSE completed%d (2) When Emacs 28 does properly delete the message in Imap folder FOO, the log buffer says 9 OK UID FETCH completed%d 10 UID STORE 27 +FLAGS (\Deleted)%d * 1 FETCH (UID 27 FLAGS (\Deleted))%d 10 OK STORE completed%d 11 CLOSE%d 11 OK CLOSE completed%d The details are interesting: (1) I got the first snippet when Emacs 28 first downloaded and properly deleted a message from INBOX (this message had UID 135750), then things failed as shown for the message downloaded from folder FOO. It seems the UID of the message from INBOX reappeared when Gnus wanted to download the message from FOO. (2) In the second IMAP session, there was only the message in FOO and nothing in INBOX. Then Emacs 28 properly downloaded and deleted the message from folder FOO. From debbugs-submit-bounces@debbugs.gnu.org Sat Mar 19 00:54:05 2022 Received: (at 54158) by debbugs.gnu.org; 19 Mar 2022 04:54:05 +0000 Received: from localhost ([127.0.0.1]:58855 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVR6L-0002Dn-4t for submit@debbugs.gnu.org; Sat, 19 Mar 2022 00:54:05 -0400 Received: from mail-os0jpn01on2113.outbound.protection.outlook.com ([40.107.113.113]:25343 helo=JPN01-OS0-obe.outbound.protection.outlook.com) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVR6I-0002DD-VI for 54158@debbugs.gnu.org; Sat, 19 Mar 2022 00:54:03 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=BBFvn03o6ahXQoxfdTmVi9WL6PD96JBdmRRhr+n9RDX92+6qXoVThg9QRlcpOpAz7LvIotLMIe4/QlOnMa6IOFBato6uXlPhl7TlfW73ZFAvR6+M+8IIlWPP6nux9gdEi4OgiGA93JiCU5YcTxqS69F5figMLcgISeP+m3T7eFVknTA3R5nI0bdEzYZF3UoV5x50y/VNYUoOaG3G/j8WUm4XR1HR0guGxPHVuRR77RNjKNT8cObLWNb9ZNlTs0+1T7oZpvdK7jYZwCk1tJ2PCDqb4hHv70SwMrLHFmlNJB/fsk+Efb9LeahxJAxn2EJqaOa8Py9ptBU9TEKszqw3dQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=oFn3vCP7AE5Ig32RX+TS6E3CICOAc3HJcQnwD0BzLms=; b=Qp8XcUcC/jAsTjSACnWpdOq4BKZ5NXjVw7mTE1C8fAq9Tyg+QpvssrDRuRCShbtQCGLPDcFTSDaZqBBroqEtVH/wkZHxlvlL2gzV0h7xOo7gRTTd8KzSzXOYGEz9sZ77ct8zCdtq2wPgevggaRw2hA3XglhzlrXTnyzc/fU1DgAFYkAGIPLurzz+0CGRLm3gIcDaqpi31JaxiC0+S05FWmlg12akA5UjRIYbZqLf7MmMIelOLXu09IfP9+uGR4cD4saULMEFdp8sgUbQ6qfhgBf3mm8juJTtZ4CnhVu/rjjtzXfeBNgO0guGhfXnUylp+VxXnnoINyDNbA21aGWi+g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ust.hk; dmarc=pass action=none header.from=ust.hk; dkim=pass header.d=ust.hk; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ust.hk; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=oFn3vCP7AE5Ig32RX+TS6E3CICOAc3HJcQnwD0BzLms=; b=flhQRnGUKleJGRei9IffE9zhVwJVJGv0rXUKNggZfa/K5DyvlPBShuxga6vBe8jnf8njacgU2G+vIIn9ZBN0rK92eJnjGblFWODZtv5qbcJ8FXtNM4Hs1mL3LaESJ+Qc98Yw/TENVXQBGlVvCbEvPSQQ4nI2yQyEwR7iL3fZBAMlp6bYTpc0pmqXJU99e9q1FNiv4LWRJZz3q4Sh9h7Qwuz8X3kOsOfyW/ysyMLnQv39VCJvTlrux/a+WhMpFqhs/zYhAjNINOC6r+ASeVXazTrIRluIQOOR7GM/YjQkn2giLaWa0VBoTe7YGP7JM9H/ebBzOBHeMKVbN0JsYT8akA== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=ust.hk; Received: from OS3P286MB1877.JPNP286.PROD.OUTLOOK.COM (2603:1096:604:1bf::11) by TYCP286MB0911.JPNP286.PROD.OUTLOOK.COM (2603:1096:400:ad::5) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5081.14; Sat, 19 Mar 2022 04:53:55 +0000 Received: from OS3P286MB1877.JPNP286.PROD.OUTLOOK.COM ([fe80::255f:b27f:3eaf:717]) by OS3P286MB1877.JPNP286.PROD.OUTLOOK.COM ([fe80::255f:b27f:3eaf:717%4]) with mapi id 15.20.5081.019; Sat, 19 Mar 2022 04:53:54 +0000 From: Andrew Cohen To: 54158@debbugs.gnu.org Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) Date: Sat, 19 Mar 2022 12:53:52 +0800 Message-ID: <87ee2ya6fz.fsf@ust.hk> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/29.0.50 (gnu/linux) Content-Type: text/plain X-ClientProxiedBy: HK2PR02CA0181.apcprd02.prod.outlook.com (2603:1096:201:21::17) To OS3P286MB1877.JPNP286.PROD.OUTLOOK.COM (2603:1096:604:1bf::11) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: c2590aa0-8423-447a-33ea-08da09647812 X-MS-TrafficTypeDiagnostic: TYCP286MB0911:EE_ X-Microsoft-Antispam-PRVS: X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: kkS0e9PRnYnz8J25eh1T2Ga1XGuIfeik6pNTNfAnkTe9ss8Ogls2PQMf/oNboBPwX2SSk03FJO/H3xn55rmxcwSM7+MLR5G9lpupAH0jvv8v8ITNNKbBAquDHv/LpJtfmgLajy0fuoHBG9RnaGUm4TcrFtloHzPkzR4/xFe5UsHwZKF4or29Qu9S8ewGXr1p/UKDQF0unVvGUZ1wZwvVMAi71sWxr34QXf6OEybu46xo2cqHEabwqIxHfVrSsLOSTENlHV5Enru6nSACJDqenVSHZbggB9CX7TcNCggY66rR8pJu92ys0HmRq4kDMUdpr7w8cE8NhV5BeqbQOdUJZMKGmvSMgp8SjMgOQCzUFGiAQsOZChuebNyRPFlI4y40hZBub772cGAv3dbzrsyoiBVHIW8hb7DrgKb9ULucAvvJ1wRX0ggVRcKTAkQxk/epmzY5UbPYvcLrYX8J+SvGlIsL1cLD8aCov7Zg3DflDtSJrA3kM49XXBPyqzxgXg4k1orILOfDpsnCFL1a99wU0SLJ+LVwiZosVCDkHuVrBLc6JJelD4HAJCzRYKfYSZq8NB2A0UL7KcPwYc5UYv2bh9PW0VBQCo05+0W024RkgMlFeG6FZgYi40lCFJHROxPPeps1HWqG8pgcKre+9Rxbqw== X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:OS3P286MB1877.JPNP286.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(13230001)(4636009)(366004)(6506007)(36756003)(508600001)(2616005)(26005)(6486002)(6512007)(86362001)(186003)(786003)(316002)(8936002)(2906002)(5660300002)(6916009)(66476007)(66556008)(8676002)(66946007)(38100700002)(83380400001); DIR:OUT; SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?XmTjc7JPpQcTNbf/D/JqqaO8Aq6MnGrm5iPnXHykthFRLz6t4GlL1LRTvHgh?= =?us-ascii?Q?9jNLAqtVnieiyVUZnASjl/ZCh6pWM5h/Ph+WGUYBy/DuBC/i9Hg6uL6NEswh?= =?us-ascii?Q?eodoEw2LL3vUceepssu15YUBMmnTs0IbQvk4a1mRz1Nw6vh8j+Nu9FQKdTG1?= =?us-ascii?Q?WgFfFBmRwfxy4uIIA5gCdHd8x4YRFII2JbgQr65vjW4eQhjRZSl/hMwnQMXp?= =?us-ascii?Q?7QQS9bU/TV0a+9ij5c/RHYpzRi01YCvflx6pgPQVrqAzowrMsCjafAJmV1jb?= =?us-ascii?Q?CtMZWc72n1A3QxS+HB4GMQVC8WteRCkpuwrHdYNTFVeT27CBkgo3sLYqgeLB?= =?us-ascii?Q?hH/g0dbbzmk0yCSJtBVtRX1SXqET7tGvKgV4o5veG/rXXZsiEmQQc19oMwdR?= =?us-ascii?Q?tiLMIqY203tEgJEXWy5kPlQN5GO2xXx3bTTdnzOi8btOZHmPXlFRGmAlsdav?= =?us-ascii?Q?O2ikSz1nD2OGvLUeWoq1FA0H7dojU+SMLBIXBWGTz9kmiD85Qqm1lPkFluhh?= =?us-ascii?Q?QZ165zSMuf5PvPPUqfi3H4krGtWE0IDXuWRQT4t5glJ30KcTRq0iiRFuwuEQ?= =?us-ascii?Q?+nllpvo+V7HHwsPXZ7/aqatdBDEwDFHGg/EhykmOkeD+5wdXcWc58RFQrmSf?= =?us-ascii?Q?QG7j60bWyu7d0Sca8HDBXLrcb+DApn01XKZoV5vam9cBuU+AUf4ZxM5Etem5?= =?us-ascii?Q?PWKIZ+vXqvd52f2nESSKKn0g9Z9sgZAEDBvf3FoTcPh75Heo+/RkkGEf052P?= =?us-ascii?Q?UOW6vyC5FQkSf3d7vW8JXsyPyMJp4oRbp1AYXS6nFkkLnsPlUGgQUt5ftbC7?= =?us-ascii?Q?gm+LonQrXK/c9Fq7L7czjvLXG68kQJpCh6qcutAhdqrcGocZpOGcKDBKU32M?= =?us-ascii?Q?OVKFbrTddn68pZA74YvIcuekwnSGGPA1AcWcWQFO6PpUOmSTcH/nG4A1SGzZ?= =?us-ascii?Q?GM6kX1cWr3cNdriMVtNwqQvIyAW/QqpU0FcVXwOLVUc3GvGShhU+wFQTeUJM?= =?us-ascii?Q?FJFXuFkIIvGOHc0VBOFaDixS8MHO5WsVb2NcoodilAvjEIAdXufTZmDDKV/K?= =?us-ascii?Q?uUMbbiJsW3GboVSwDBONOxWZra1ejTXafYNFoLIGr3+Q0m2TQth4Bwfa8m3p?= =?us-ascii?Q?TcuH0m9EVBJ/s1ZYaLPTdvJxwGG4tOKkWj0EoMAEluo4K2jdvnJaga4f52JH?= =?us-ascii?Q?bJXvjTAKslKq3Dmr10PlEAFnCNVh6SLUkU9JGyBPTDq7PS0s8R8o8dKSTI0N?= =?us-ascii?Q?aUuWKoVhdjlMLjt4nYKIsW+EfVKIk4bqhDUR91vtmfXC0wQYyn78+/TGL8ye?= =?us-ascii?Q?PWBjG22P8MHPj6k8J9UiceJu5joXEB9e6b78LYtNivQwv9/l2v/lBLqDgTjC?= =?us-ascii?Q?xbEKhzklI5ZEKBOZeWPBfycl+tjcyQ7Ba0GpoGFRvwpU4X1JF0yBlHIyzF6O?= =?us-ascii?Q?VMGKbFN9JVRGFg2An2UOKYeOeLG3S2Mh?= X-OriginatorOrg: ust.hk X-MS-Exchange-CrossTenant-Network-Message-Id: c2590aa0-8423-447a-33ea-08da09647812 X-MS-Exchange-CrossTenant-AuthSource: OS3P286MB1877.JPNP286.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 19 Mar 2022 04:53:54.8902 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: c917f3e2-9322-4926-9bb3-daca730413ca X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: mYSNxc20kYFezBBrbwIggZaUWM50awDsjSdJR/a7gWljLll8GQZSW2NnJBoxVc7X X-MS-Exchange-Transport-CrossTenantHeadersStamped: TYCP286MB0911 X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 54158 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) (I sent this to Roland directly since I'm a bit shy about communicating on public lists, but here goes anyway) I think the problem is that the code in mail-source-fetch-imap doesn't handle a list of mailboxes properly (I don't know why it would have worked in emacs-27 though). Adam added a loop over a list of mailboxes way back in 2015, but it seems to me that some of the variables bound outside the loop should be bound inside (imap usually works on a per mailbox basis) So I think this might fix it (although I don't have a setup available to test it). Of course I might be totally off-base. If so, sorry in advance. diff --git a/lisp/gnus/mail-source.el b/lisp/gnus/mail-source.el index 5d0c0e2654..01cca831f2 100644 --- a/lisp/gnus/mail-source.el +++ b/lisp/gnus/mail-source.el @@ -1066,9 +1066,7 @@ mail-source-fetch-imap (let ((from (format "%s:%s:%s" server user port)) (found 0) (buf (generate-new-buffer " *imap source*")) - (mail-source-string (format "imap:%s:%s" server mailbox)) - (imap-shell-program (or (list program) imap-shell-program)) - remove) + (imap-shell-program (or (list program) imap-shell-program))) (if (and (imap-open server port stream authentication buf) (imap-authenticate user (or (cdr (assoc from mail-source-password-cache)) @@ -1078,7 +1076,8 @@ mail-source-fetch-imap (dolist (mailbox mailbox-list) (when (imap-mailbox-select mailbox nil buf) (let ((coding-system-for-write mail-source-imap-file-coding-system) - str) + (mail-source-string (format "imap:%s:%s" server mailbox)) + str remove) (message "Fetching from %s..." mailbox) (with-temp-file mail-source-crash-box ;; Avoid converting 8-bit chars from inserted strings to -- Andrew Cohen From debbugs-submit-bounces@debbugs.gnu.org Sat Mar 19 12:26:38 2022 Received: (at submit) by debbugs.gnu.org; 19 Mar 2022 16:26:38 +0000 Received: from localhost ([127.0.0.1]:60502 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVbuX-0005LU-Oq for submit@debbugs.gnu.org; Sat, 19 Mar 2022 12:26:37 -0400 Received: from lists.gnu.org ([209.51.188.17]:39834) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVbuV-0005LJ-Sq for submit@debbugs.gnu.org; Sat, 19 Mar 2022 12:26:36 -0400 Received: from eggs.gnu.org ([209.51.188.92]:41224) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nVbuV-0006Wx-Nf for bug-gnu-emacs@gnu.org; Sat, 19 Mar 2022 12:26:35 -0400 Received: from ciao.gmane.io ([116.202.254.214]:35210) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nVbuU-0001iJ-CB for bug-gnu-emacs@gnu.org; Sat, 19 Mar 2022 12:26:35 -0400 Received: from list by ciao.gmane.io with local (Exim 4.92) (envelope-from ) id 1nVbuR-00008Y-BQ for bug-gnu-emacs@gnu.org; Sat, 19 Mar 2022 17:26:31 +0100 X-Injected-Via-Gmane: http://gmane.org/ To: bug-gnu-emacs@gnu.org From: Roland Winkler Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) Date: Sat, 19 Mar 2022 11:25:28 -0500 Message-ID: <871qyx3o5j.fsf@gnu.org> References: <87tucmc2y4.fsf@gnu.org> <87ee2ya6fz.fsf@ust.hk> Mime-Version: 1.0 Content-Type: text/plain Cancel-Lock: sha1:t3I18v34PSD+fJXF/p9F7rwZZDI= Received-SPF: pass client-ip=116.202.254.214; envelope-from=geb-bug-gnu-emacs@m.gmane-mx.org; helo=ciao.gmane.io X-Spam_score_int: -16 X-Spam_score: -1.7 X-Spam_bar: - X-Spam_report: (-1.7 / 5.0 requ) BAYES_00=-1.9, HEADER_FROM_DIFFERENT_DOMAINS=0.249, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=no autolearn_force=no X-Spam_action: no action X-Spam-Score: -1.1 (-) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.1 (--) On Sat, Mar 19 2022, Andrew Cohen wrote: > I think the problem is that the code in mail-source-fetch-imap doesn't > handle a list of mailboxes properly (I don't know why it would have > worked in emacs-27 though). Adam added a loop over a list of mailboxes > way back in 2015, but it seems to me that some of the variables bound > outside the loop should be bound inside (imap usually works on a per > mailbox basis) > > So I think this might fix it (although I don't have a setup available > to test it). Thank you! I can confirm: I identified one scenario with emails I send to myself such that they go into different folders on the IMAP server. Then downloading these messages with Gnus from Emacs 28.0.91 gives me reproducibly the duplicate mail downloads as described in the original post. When I apply Andrew's patch to `mail-source-fetch-imap' the downloads happen as expected, properly deleting the messages on the server after download, as confirmed also with imap-log bound to to. So for this one test case the patch appears to solve the problem. The patch may require more testing and also checking the code by someone who knows what is supposed to happen in such an imap session. I am surprised that `mail-source-fetch-imap' in Gnus from Emacs 27.2 and from Emacs 28.0.91 are essentially the same (from all I can tell). So I am wondering why `mail-source-fetch-imap' in Gnus from Emacs 27.2 was behaving as expected; but the bug showed up only in Emacs 28. Can this be in subtle ways related to the fact that mail-source.el in Emacs 27 used dynamic binding, whereas in Emacs 28 it uses lexical binding, as speculated previously by Eric? From debbugs-submit-bounces@debbugs.gnu.org Sat Mar 19 17:52:22 2022 Received: (at 54158) by debbugs.gnu.org; 19 Mar 2022 21:52:22 +0000 Received: from localhost ([127.0.0.1]:60721 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVgzl-0005jo-SK for submit@debbugs.gnu.org; Sat, 19 Mar 2022 17:52:22 -0400 Received: from mail-os0jpn01on2137.outbound.protection.outlook.com ([40.107.113.137]:15109 helo=JPN01-OS0-obe.outbound.protection.outlook.com) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVgzj-0005jY-EF for 54158@debbugs.gnu.org; Sat, 19 Mar 2022 17:52:20 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=oNF5wG6VvJUtGKKzuLCGpjSVLH/RPGuu3F9ynFIgIdatPP1vL+xopql2iKrhFsKtWSH0te5NVoUsSsGCB5g4ngNtjOJiTwmwuQsMmaVm7/dAL+RIIH5hrru4D3tMGrDJEbb1mWS7iS8gVbRIf8CYs8NeZYMiFIchIZDJly+e2ZyLtdEicxRJc5mgkXZrR32T5ndo2nBFAY2UTn8q08w0VxEBe+ug19lG8R5Hr0IE2F6s7d+icuTWLCKIuLcmcRQWeB+9ythea0ZWqUN3LY9srbNlNoEnBpmWjjwyBWB68qBk0sENLSn/x29JBuBK2SMM4BeH18cRCf1lHGgOHgySgg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=whDugnyQidplgevFmiCVC5d9FZkN/QwHwe7wA+d7Z5Y=; b=MxaDnj/Eli50szJeRJWI2JpNlWjUd0TM7x4Y2FukwoPZL2xCno3yVCjrsptkPgdXdsNH1wdq9xPPGNEFM627oNQ0IYJI4e1YaLLZBOVzqjnzj9n3sGu1kufMfDFWzX+gGcPk87o+wMxIN/8vB/Svp0pHR6Iz0MHjI2PNx3CLnFfLhPl45Rnz3cm729/wSCuWmC0cG/Xt0/y+LVK5jim4zmA2VIRtRyVjAYAHOK6dbvgvm+kTlbl7kWqeTbvJApJ/9AvBu3PYfK54HZGh2NJJVYz7LtrBj68xQw1+ABcKpS8Dddc1GQR5EjC7QrXGZCn0R9Rd1yoWOGyLKOgiMq/Rog== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ust.hk; dmarc=pass action=none header.from=ust.hk; dkim=pass header.d=ust.hk; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ust.hk; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=whDugnyQidplgevFmiCVC5d9FZkN/QwHwe7wA+d7Z5Y=; b=rBKPGohf0PwVS2DxBM4tNGUHV3TDHMa5rfIeD8hyiBZmj4v4ut2kbYLEgC4w8jYx5esn81qPA+QUQB2NLSFl9v7w7n/8GtHJvF6cxDSEZsLvmTP22oiw85bGdjIa/gI/kd1I4N02IIechoArpb7jLflesTNBYL9ztrDDCaOUhHS2RXeVlygfgDFTQ/yNI58VFOoDGAkTvOrhSlHMFbrpMPSzW1PBCSQ/52uUqweTb2trZVe7Imi1FoDa4lXgiWA4+BpniPb4y/e0tuFwGiwB+eJo73kWqAzVzHiu2qa8rC1v/bInjzTTjbFBVAK9qxdfcEGEthcDKyKyzMIC3o9Hyw== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=ust.hk; Received: from OS3P286MB1877.JPNP286.PROD.OUTLOOK.COM (2603:1096:604:1bf::11) by OSZP286MB1848.JPNP286.PROD.OUTLOOK.COM (2603:1096:604:165::6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5081.18; Sat, 19 Mar 2022 21:52:09 +0000 Received: from OS3P286MB1877.JPNP286.PROD.OUTLOOK.COM ([fe80::255f:b27f:3eaf:717]) by OS3P286MB1877.JPNP286.PROD.OUTLOOK.COM ([fe80::255f:b27f:3eaf:717%4]) with mapi id 15.20.5081.019; Sat, 19 Mar 2022 21:52:08 +0000 From: Andrew Cohen To: 54158@debbugs.gnu.org Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) Date: Sun, 20 Mar 2022 05:52:04 +0800 Message-ID: <87lex5mwzf.fsf@ust.hk> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/29.0.50 (gnu/linux) Content-Type: text/plain X-ClientProxiedBy: HK2PR02CA0200.apcprd02.prod.outlook.com (2603:1096:201:20::12) To OS3P286MB1877.JPNP286.PROD.OUTLOOK.COM (2603:1096:604:1bf::11) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 12f92b0f-0083-4e4e-d9aa-08da09f2b6ed X-MS-TrafficTypeDiagnostic: OSZP286MB1848:EE_ X-Microsoft-Antispam-PRVS: X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: aFPfOZm8kuMYGwaA9R/oEdTdLUxQnx5+pmKkUg671eJtM75+F/OifojdYDzTY+CokAyCfwAaUA/6UHgnPO4X+ZWhN55wQHIvxgA7A1XNzGWEIHL0mw9GBmvVa8rJ4AwBGRbh61iCoMztlVE/hzOMC3oxHLTczLjiJ+mUdVIUf/PHeKhu+jqP4RJrPdtCYNVF3PiAncnSOI78oh0J7GkymrzMvUlvevY4KAVwJfdRqzgmizXxhY625ztSQ3uM1lKbapV/7nXk35tkJljJtVEjrzj0cwDuGx5AgR1Jij7VF4PyWvUv5g2lKC/0GHHzuW8LOtFQEW38Wgom/QCdtp/CI31IZOGQLR360fqbHwUTW2JUm7r8bCrit91UowDmWUsAYI0k7nwAZZ+787XoePyPwip+lhrNKXMC1JJ3P+/w/Md9OzGyGRAk4jdPPJX/AOEkgT2MotFB/EJGRAsLEgbVuu/Tb++cD0kxLTjmvY9yykt2ZXo4HTMdr53cFipIEHmTsc48B6AbfcfUQqoXxaY6aTNID00U6Cc8oRNLj0D3aebGUWQ7So3Udfke969TH1/h75fbDBpcMHSd2tmEUH0lQV8/CL7kdkXAXPgqlYku+7gWNW0DAe4fEQ7GrpN1aB198RjWm9aMcUudx0LBXDBFCQ== X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:OS3P286MB1877.JPNP286.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(13230001)(4636009)(366004)(83380400001)(26005)(186003)(6916009)(8676002)(36756003)(6512007)(2616005)(316002)(786003)(38100700002)(6506007)(6666004)(2906002)(6486002)(86362001)(5660300002)(508600001)(8936002)(66476007)(66946007)(66556008); DIR:OUT; SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?tBpxtQzyrCGc2kiRo+7uiWS/bOlj9oDvCE+CHR5vrqgM60CtWeGZzIQ5zZ44?= =?us-ascii?Q?wnPVv/QwQE03HI9nvIM+TU+iy5ZW2cyYYXRvcxF6cIGkwuZU+mYg3ZLWtULF?= =?us-ascii?Q?XiH+U+n4JPJXatcO2Ep38rxzGZ1B788e/7VVt5K5si5QnYuSoWibZ63rXTVJ?= =?us-ascii?Q?wdjWvNUtz+FTWFPC+zRYfASIWIKgct7bD8+dDMco4DXXqL/oN1nxvA3RCLxS?= =?us-ascii?Q?HtQ8pMZeR5KGwxhWIkKu2TV/D28w2MXTYwN6q/FcIUATDpsYK33ouZYxiiqR?= =?us-ascii?Q?bbPF7CqteWJufjUjrd5PNJ2y7UFN4jHCAAZW8FPSahuBtj4J7K35BrCL10pd?= =?us-ascii?Q?2cTOHus7AEkcPaWCX4AxQDCbaCYo7bdOSeWJxhyz74Tf0RNM0hbv/bwW9G88?= =?us-ascii?Q?N7AfOyPE+U3ZDIgoSWqPRs5J8vlVXxU81PfbDusV0htH9qowzd/1ziR96AlQ?= =?us-ascii?Q?h/pYqqq31bFnVGyZizks9ZdKPUg+u3POWBWAvepsToC6LSLZvxPJOq/d/hEE?= =?us-ascii?Q?0Ip1b5e4VWlIpiCUYZO9JSawfzwUkhtKAKhQN3WkkiBPAnQBy/XfdIKX2bOc?= =?us-ascii?Q?DjVpKiNDnZHKWAA9Sr3ljRzFv/KhnNjHIJPBbjvv34mBwpruZjZ4pSEr64qd?= =?us-ascii?Q?+ieku/i3FLjw4xmtGA/HJFSvVUCnxc2HEML+Dwtj2/PE5bgKFULxekLExTbN?= =?us-ascii?Q?DU69pPoSWYEXyh1+21TSKY04gNC9J1JpEX/hevKDXyvmOkqlBxF9FeFRN7Lx?= =?us-ascii?Q?ooUKdPp3QucdIP3pah8UTTJHbTfvd1LOrFIfHGtBscMXiYx00DQq7jDlqztn?= =?us-ascii?Q?By49Hh6xx4Ibxzn+8WvEryTCknK1Gb6KTdSRdOxbho1vuXiFFrpEFi3x+GnQ?= =?us-ascii?Q?7nxkhLazq8eCMMqOsSflHwJoYzbQdXaLXt6d9r9Lcm9Yk9lJeH+ihMb0cwC9?= =?us-ascii?Q?7z8h5cISNS+XB454uxPuB32c8xJ/Uig32wuqROe5+bcMp9VgsR4jsf7ImM8o?= =?us-ascii?Q?kzgrqWykrYxDmX8qsdv1sRG0IVU9NvWA0Fkt2khWqkmOfi0HpUN7Hv/Xyt/P?= =?us-ascii?Q?N7tANRtwnSlpeRrTuZ5GOuyKwTc18f4RYnBuJvsQ67fdE+bXRxImbihIrIpS?= =?us-ascii?Q?0a9lTSzo9/9x63KcWbubR1dfsPbSwqWDQLKPCMiGlwxjbAgd2pm7k5+0VYQv?= =?us-ascii?Q?FSgWprYPgjK4t7XTgociNw2N4XZYhOU7ILINHglz3ZxHmEofClb1oNh8Cjsv?= =?us-ascii?Q?dB5oB4UizeLbCb7paSLsrlHicXD+VvhGMN09HFHM/GpMKOEaZttz1mdIr5HU?= =?us-ascii?Q?t9k7s1ZA1BxEMgiWjeZbc1cURk2ivNZ39rZJQi45Emvv6QrQPudk9unBeYNJ?= =?us-ascii?Q?qSu/SVOowfQq0Mq633IJpQ02VAFDJcFEg2AxpKmszvYMPVUHlGP/321N6YtC?= =?us-ascii?Q?gLRblPi604frU5GyLTnJPynL1QsfT40d?= X-OriginatorOrg: ust.hk X-MS-Exchange-CrossTenant-Network-Message-Id: 12f92b0f-0083-4e4e-d9aa-08da09f2b6ed X-MS-Exchange-CrossTenant-AuthSource: OS3P286MB1877.JPNP286.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 19 Mar 2022 21:52:08.5560 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: c917f3e2-9322-4926-9bb3-daca730413ca X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: yfAChbdx5s/jPlWHIu1s6cGJb69ZZ5x50Jig/u/qDr1v3meLbZzw6OSNXvPRqt9e X-MS-Exchange-Transport-CrossTenantHeadersStamped: OSZP286MB1848 X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 54158 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) On Sat, Mar 19 2022, Roland Winkler wrote: >On Sat, Mar 19 2022, Andrew Cohen wrote: [...] >> So I think this might fix it (although I don't have a setup available >> to test it). > Thank you! I can confirm: I identified one scenario with emails I send >to myself such that they go into different folders on the IMAP server. >Then downloading these messages with Gnus from Emacs 28.0.91 gives me >reproducibly the duplicate mail downloads as described in the original >post. When I apply Andrew's patch to `mail-source-fetch-imap' the >downloads happen as expected, properly deleting the messages on the >server after download, as confirmed also with imap-log bound to to. >So for this one test case the patch appears to solve the problem. Great! >The patch may require more testing and also checking the code by someone >who knows what is supposed to happen in such an imap session. More testing would be good---but I suspect the number of users of a list of mailboxes with imap is small :) Fortunately the patch is quite minor and I'm pretty confident that this change is the right thing. My patch also fixes another bug---the header identifying the originating mailbox was getting set improperly (to the list of mailboxes rather than the actual mailbox). >I am surprised that `mail-source-fetch-imap' in Gnus from Emacs 27.2 >and from Emacs 28.0.91 are essentially the same (from all I can tell). >So I am wondering why `mail-source-fetch-imap' in Gnus from Emacs 27.2 >was behaving as expected; but the bug showed up only in Emacs 28. Can >this be in subtle ways related to the fact that mail-source.el in Emacs >27 used dynamic binding, whereas in Emacs 28 it uses lexical binding, >as speculated previously by Eric? This is indeed a mystery. If you are excited about getting to the bottom of it you could try enabling the log with emacs-27 and post the result of your scenario. The problem was the variable 'remove was accumulating UIDs from prior iterations of the loop. -- Andrew Cohen From debbugs-submit-bounces@debbugs.gnu.org Sat Mar 19 23:50:55 2022 Received: (at submit) by debbugs.gnu.org; 20 Mar 2022 03:50:55 +0000 Received: from localhost ([127.0.0.1]:60919 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVmal-0006kH-27 for submit@debbugs.gnu.org; Sat, 19 Mar 2022 23:50:55 -0400 Received: from lists.gnu.org ([209.51.188.17]:57942) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nVmaj-0006k9-Gc for submit@debbugs.gnu.org; Sat, 19 Mar 2022 23:50:53 -0400 Received: from eggs.gnu.org ([209.51.188.92]:33084) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nVmaj-0003B4-4E for bug-gnu-emacs@gnu.org; Sat, 19 Mar 2022 23:50:53 -0400 Received: from ciao.gmane.io ([116.202.254.214]:60622) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nVmah-0007Pd-I8 for bug-gnu-emacs@gnu.org; Sat, 19 Mar 2022 23:50:52 -0400 Received: from list by ciao.gmane.io with local (Exim 4.92) (envelope-from ) id 1nVmaf-0002IK-5k for bug-gnu-emacs@gnu.org; Sun, 20 Mar 2022 04:50:49 +0100 X-Injected-Via-Gmane: http://gmane.org/ To: bug-gnu-emacs@gnu.org From: Roland Winkler Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) Date: Sat, 19 Mar 2022 22:50:44 -0500 Message-ID: <87czihuvsb.fsf@gnu.org> References: <87tucmc2y4.fsf@gnu.org> <87lex5mwzf.fsf@ust.hk> Mime-Version: 1.0 Content-Type: text/plain Cancel-Lock: sha1:QbzC6Eb3h7C/Iklg9UFbD/su844= Received-SPF: pass client-ip=116.202.254.214; envelope-from=geb-bug-gnu-emacs@m.gmane-mx.org; helo=ciao.gmane.io X-Spam_score_int: -16 X-Spam_score: -1.7 X-Spam_bar: - X-Spam_report: (-1.7 / 5.0 requ) BAYES_00=-1.9, HEADER_FROM_DIFFERENT_DOMAINS=0.249, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=no autolearn_force=no X-Spam_action: no action X-Spam-Score: -1.1 (-) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.1 (--) On Sun, Mar 20 2022, Andrew Cohen wrote: >>I am surprised that `mail-source-fetch-imap' in Gnus from Emacs 27.2 >>and from Emacs 28.0.91 are essentially the same (from all I can tell). >>So I am wondering why `mail-source-fetch-imap' in Gnus from Emacs 27.2 >>was behaving as expected; but the bug showed up only in Emacs 28. Can >>this be in subtle ways related to the fact that mail-source.el in Emacs >>27 used dynamic binding, whereas in Emacs 28 it uses lexical binding, >>as speculated previously by Eric? > > This is indeed a mystery. If you are excited about getting to the bottom > of it you could try enabling the log with emacs-27 and post the result > of your scenario. The problem was the variable 'remove was accumulating > UIDs from prior iterations of the loop. I am perplexed: Certainly, I struggled for the longest time to identify a reproducible recipe for this bug till I learned about the variable imap-log (see my earlier posts in this thread). Indeed, with this recipe the bug does show up both with Emacs 28.0.91 and Emacs 27.2. So I need to take back what I said before that this bug is a regression. Reading the code of `mail-source-fetch-imap' more carefully, I agree with you: it would be a mystery if the code had ever worked as intended. A possible explanation from my side is: while I started using Gnus about mid of last year when I had Emacs 27.2, I added a second IMAP folder to my `mail-sources' configuration more recently, possibly around the time when I switched from 27.2 to 28.0.91. Then I got fooled by this bug because I didn't know its actual cause. While I went back temporarily from 28.0.91 to 27.2 to see whether this changed anything, I may have done that for too short an amount of time to run into the particular situation that triggers this bug. Oh well. Thanks to everyone who has helped to find the cause of this bug! From debbugs-submit-bounces@debbugs.gnu.org Mon Mar 21 15:33:59 2022 Received: (at 54158) by debbugs.gnu.org; 21 Mar 2022 19:33:59 +0000 Received: from localhost ([127.0.0.1]:38358 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nWNmx-0005oz-2N for submit@debbugs.gnu.org; Mon, 21 Mar 2022 15:33:59 -0400 Received: from mail.ericabrahamsen.net ([52.70.2.18]:59986) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nWNmv-0005ol-2v for 54158@debbugs.gnu.org; Mon, 21 Mar 2022 15:33:57 -0400 Received: from localhost (c-71-197-232-41.hsd1.wa.comcast.net [71.197.232.41]) (Authenticated sender: eric@ericabrahamsen.net) by mail.ericabrahamsen.net (Postfix) with ESMTPSA id AEECAFA0B2; Mon, 21 Mar 2022 19:33:50 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericabrahamsen.net; s=mail; t=1647891231; bh=iR5P5bJIWyIuX4bicDQpiFwhvXCdwqgL8IP8DWnE88s=; h=From:To:Cc:Subject:References:Date:In-Reply-To:From; b=BQjnE33waCUnqW3dDzKF1ewudGxReVKdEPuNnwhZ7YQjppJIefFLa/C8KVDNHiVxZ Jg68nXf8wK0+4VG0iBUJnCiryOgEe9sad9UlRMX9OMGzbFCG/Ym5Zl6kgA+0QEOHtq 6BklYei2Xb1w7aRB6ZDtqsGRWB4BQTy3ibnLvdMY= From: Eric Abrahamsen To: Roland Winkler , Andrew Cohen Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87ee2ya6fz.fsf@ust.hk> <871qyx3o5j.fsf@gnu.org> Date: Mon, 21 Mar 2022 12:33:49 -0700 In-Reply-To: <871qyx3o5j.fsf@gnu.org> (Roland Winkler's message of "Sat, 19 Mar 2022 11:25:28 -0500") Message-ID: <87lex3ksma.fsf@ericabrahamsen.net> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/29.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: 54158@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Roland Winkler writes: > On Sat, Mar 19 2022, Andrew Cohen wrote: >> I think the problem is that the code in mail-source-fetch-imap doesn't >> handle a list of mailboxes properly (I don't know why it would have >> worked in emacs-27 though). Adam added a loop over a list of mailboxes >> way back in 2015, but it seems to me that some of the variables bound >> outside the loop should be bound inside (imap usually works on a per >> mailbox basis) >> >> So I think this might fix it (although I don't have a setup available >> to test it). > > Thank you! I can confirm: I identified one scenario with emails I send > to myself such that they go into different folders on the IMAP server. > Then downloading these messages with Gnus from Emacs 28.0.91 gives me > reproducibly the duplicate mail downloads as described in the original > post. When I apply Andrew's patch to `mail-source-fetch-imap' the > downloads happen as expected, properly deleting the messages on the > server after download, as confirmed also with imap-log bound to to. > So for this one test case the patch appears to solve the problem. > > The patch may require more testing and also checking the code by someone > who knows what is supposed to happen in such an imap session. I am > surprised that `mail-source-fetch-imap' in Gnus from Emacs 27.2 and from > Emacs 28.0.91 are essentially the same (from all I can tell). So I am > wondering why `mail-source-fetch-imap' in Gnus from Emacs 27.2 was > behaving as expected; but the bug showed up only in Emacs 28. Can this > be in subtle ways related to the fact that mail-source.el in Emacs 27 > used dynamic binding, whereas in Emacs 28 it uses lexical binding, as > speculated previously by Eric? FWIW this patch looks right to me, thanks to Andy for figuring it out. Is someone going to push this? It would be nice at the same time to fix the indentation of the mailbox loop so it's clearer what's actually happening. From debbugs-submit-bounces@debbugs.gnu.org Mon Mar 21 15:38:12 2022 Received: (at 54158) by debbugs.gnu.org; 21 Mar 2022 19:38:12 +0000 Received: from localhost ([127.0.0.1]:38430 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nWNr2-0005yl-3d for submit@debbugs.gnu.org; Mon, 21 Mar 2022 15:38:12 -0400 Received: from quimby.gnus.org ([95.216.78.240]:54326) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nWNr1-0005yZ-5U for 54158@debbugs.gnu.org; Mon, 21 Mar 2022 15:38:11 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnus.org; s=20200322; h=Content-Type:MIME-Version:Message-ID:In-Reply-To:Date: References:Subject:Cc:To:From:Sender:Reply-To:Content-Transfer-Encoding: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=crHMMTgfj0Kxm4aLW7z5l+H5QaWB/KpDi9HYCKIvOhg=; b=eJrS/niNAsTqu58L0biMIRrtpn XmyUP9UElJsNOJZQmb49jDIM2WWd3w9A8h5QfYEwR6ozxHZpVdOdfa5Pv2MhSCEMuIE0oSKc/HR7U 39k2hpOrOKDNlJUbI0aZbzdAbDSU36L4cmy5LNoIjYdh5KWZkoC8JsWtQRW98OdPEGT4=; Received: from 109.179.236.69.tmi.telenormobil.no ([109.179.236.69] helo=xo) by quimby.gnus.org with esmtpsa (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nWNqr-000379-TF; Mon, 21 Mar 2022 20:38:04 +0100 From: Lars Ingebrigtsen To: Eric Abrahamsen Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87ee2ya6fz.fsf@ust.hk> <871qyx3o5j.fsf@gnu.org> <87lex3ksma.fsf@ericabrahamsen.net> Date: Mon, 21 Mar 2022 20:38:00 +0100 In-Reply-To: <87lex3ksma.fsf@ericabrahamsen.net> (Eric Abrahamsen's message of "Mon, 21 Mar 2022 12:33:49 -0700") Message-ID: <871qyvp04n.fsf@gnus.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/29.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Report: Spam detection software, running on the system "quimby.gnus.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see @@CONTACT_ADDRESS@@ for details. Content preview: Eric Abrahamsen writes: > FWIW this patch looks right to me, thanks to Andy for figuring it out. > Is someone going to push this? It would be nice at the same time to fix > the indentation of the mailbox loop so it's clearer [...] Content analysis details: (-2.9 points, 5.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP 0.0 TVD_RCVD_IP Message was received from an IP address -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: Andrew Cohen , 54158@debbugs.gnu.org, Roland Winkler X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Eric Abrahamsen writes: > FWIW this patch looks right to me, thanks to Andy for figuring it out. > Is someone going to push this? It would be nice at the same time to fix > the indentation of the mailbox loop so it's clearer what's actually > happening. I think Andrew pushed it in 01336a2582? (To the trunk.) -- (domestic pets only, the antidote for overdose, milk.) bloggy blog: http://lars.ingebrigtsen.no From debbugs-submit-bounces@debbugs.gnu.org Mon Mar 21 15:38:34 2022 Received: (at control) by debbugs.gnu.org; 21 Mar 2022 19:38:34 +0000 Received: from localhost ([127.0.0.1]:38433 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nWNrO-0005zP-Bu for submit@debbugs.gnu.org; Mon, 21 Mar 2022 15:38:34 -0400 Received: from quimby.gnus.org ([95.216.78.240]:54344) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nWNrN-0005zD-6L for control@debbugs.gnu.org; Mon, 21 Mar 2022 15:38:33 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnus.org; s=20200322; h=Subject:From:To:Message-Id:Date:Sender:Reply-To:Cc: MIME-Version:Content-Type:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:In-Reply-To:References:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=CVdsKdleeI1VA/+cH6X2Sd0SpXv4WFgy6YlBBet3GBU=; b=pJWq6Oa+0Ivz5rFDSM8uJZAAz5 KGXYZkfiCNrz/iJWmZvXjSSsFRONTQa2crDyVlTa3tulixwHYTFZg3DwfRfJSpO4yZNcUjf2sacxg eEaKf19/KdJzQAgFyJ8EIVY2ErFjAA2Ab7Vej2FUrIgHvSxby3kEcxrbr0vZcRNvfUpI=; Received: from 109.179.236.69.tmi.telenormobil.no ([109.179.236.69] helo=xo) by quimby.gnus.org with esmtpsa (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nWNrF-00037b-K5 for control@debbugs.gnu.org; Mon, 21 Mar 2022 20:38:27 +0100 Date: Mon, 21 Mar 2022 20:38:24 +0100 Message-Id: <87zgljnljj.fsf@gnus.org> To: control@debbugs.gnu.org From: Lars Ingebrigtsen Subject: control message for bug #54158 X-Spam-Report: Spam detection software, running on the system "quimby.gnus.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see @@CONTACT_ADDRESS@@ for details. Content preview: close 54158 29.1 quit Content analysis details: (-2.9 points, 5.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP 0.0 TVD_RCVD_IP Message was received from an IP address -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) close 54158 29.1 quit From debbugs-submit-bounces@debbugs.gnu.org Mon Mar 21 15:48:41 2022 Received: (at 54158) by debbugs.gnu.org; 21 Mar 2022 19:48:41 +0000 Received: from localhost ([127.0.0.1]:38457 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nWO1A-0008Rz-Rr for submit@debbugs.gnu.org; Mon, 21 Mar 2022 15:48:41 -0400 Received: from mail.ericabrahamsen.net ([52.70.2.18]:60656) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nWO19-0008Rk-SG for 54158@debbugs.gnu.org; Mon, 21 Mar 2022 15:48:40 -0400 Received: from localhost (c-71-197-232-41.hsd1.wa.comcast.net [71.197.232.41]) (Authenticated sender: eric@ericabrahamsen.net) by mail.ericabrahamsen.net (Postfix) with ESMTPSA id 95112FA0B2; Mon, 21 Mar 2022 19:48:33 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericabrahamsen.net; s=mail; t=1647892114; bh=DAF3W0kisyj1anWspYvJqjb1Xs9wdRzg7xD7Jhrfxto=; h=From:To:Cc:Subject:References:Date:In-Reply-To:From; b=Bc0z0SutKcagGqfsIlcVZzt7Ie5Srt7XSXwcNI/Odg2VA2wwTR7TIF1VQIE2f0Gsw 7r6EnQly3lfPzMPwAoy3BKF81egwWWL+rRDZCiSSheCCt09nQ9GEqTLV6ydImB4SC9 wc/F1bryGWGwjfZ44YHCxBz9X+0MbBKq9BzErjbA= From: Eric Abrahamsen To: Lars Ingebrigtsen Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87ee2ya6fz.fsf@ust.hk> <871qyx3o5j.fsf@gnu.org> <87lex3ksma.fsf@ericabrahamsen.net> <871qyvp04n.fsf@gnus.org> Date: Mon, 21 Mar 2022 12:48:32 -0700 In-Reply-To: <871qyvp04n.fsf@gnus.org> (Lars Ingebrigtsen's message of "Mon, 21 Mar 2022 20:38:00 +0100") Message-ID: <87h77rkrxr.fsf@ericabrahamsen.net> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/29.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: Andrew Cohen , 54158@debbugs.gnu.org, Roland Winkler X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) On 03/21/22 20:38 PM, Lars Ingebrigtsen wrote: > Eric Abrahamsen writes: > >> FWIW this patch looks right to me, thanks to Andy for figuring it out. >> Is someone going to push this? It would be nice at the same time to fix >> the indentation of the mailbox loop so it's clearer what's actually >> happening. > > I think Andrew pushed it in 01336a2582? (To the trunk.) Oh! I didn't look far enough back. Didn't we want it in 28.1, too? From debbugs-submit-bounces@debbugs.gnu.org Mon Mar 21 15:50:48 2022 Received: (at 54158) by debbugs.gnu.org; 21 Mar 2022 19:50:48 +0000 Received: from localhost ([127.0.0.1]:38470 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nWO3E-0008WF-KB for submit@debbugs.gnu.org; Mon, 21 Mar 2022 15:50:48 -0400 Received: from quimby.gnus.org ([95.216.78.240]:54432) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nWO3C-0008W1-Q2 for 54158@debbugs.gnu.org; Mon, 21 Mar 2022 15:50:47 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnus.org; s=20200322; h=Content-Transfer-Encoding:Content-Type:MIME-Version:Message-ID :In-Reply-To:Date:References:Subject:Cc:To:From:Sender:Reply-To:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=I0YVlL2W6yy6TN3lC5MG50aBnQ0NBbSp9HfMs9WrDdU=; b=PbNH929RRtXCSAqscCqCZSZYPU Vj/uJLfsDh5fSZPVGH+vVVxUTBfcA3oqnSDFaT89lCiAqwufQuPeoqwZ0V1Hwo0OYSyet4mRl9fe7 ieZoXRTqM2FBtSkS6ufa7hqHWHikPKtqub2BQl/Mi9nMDFKC9+6VxMWje0KeKaIh14dI=; Received: from 109.179.236.69.tmi.telenormobil.no ([109.179.236.69] helo=xo) by quimby.gnus.org with esmtpsa (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nWO33-0003JK-JB; Mon, 21 Mar 2022 20:50:39 +0100 From: Lars Ingebrigtsen To: Eric Abrahamsen Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87ee2ya6fz.fsf@ust.hk> <871qyx3o5j.fsf@gnu.org> <87lex3ksma.fsf@ericabrahamsen.net> <871qyvp04n.fsf@gnus.org> <87h77rkrxr.fsf@ericabrahamsen.net> Date: Mon, 21 Mar 2022 20:50:36 +0100 In-Reply-To: <87h77rkrxr.fsf@ericabrahamsen.net> (Eric Abrahamsen's message of "Mon, 21 Mar 2022 12:48:32 -0700") Message-ID: <87v8w7nkz7.fsf@gnus.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/29.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Report: Spam detection software, running on the system "quimby.gnus.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see @@CONTACT_ADDRESS@@ for details. Content preview: Eric Abrahamsen writes: > Oh! I didn't look far enough back. Didn't we want it in 28.1, too? Since this didn't work in Emacs 27, either, it's not a regression, so in Emacs 29 it goes. 😀 Content analysis details: (-2.9 points, 5.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP 0.0 TVD_RCVD_IP Message was received from an IP address -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: Andrew Cohen , 54158@debbugs.gnu.org, Roland Winkler X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Eric Abrahamsen writes: > Oh! I didn't look far enough back. Didn't we want it in 28.1, too? Since this didn't work in Emacs 27, either, it's not a regression, so in Emacs 29 it goes. =F0=9F=98=80 --=20 (domestic pets only, the antidote for overdose, milk.) bloggy blog: http://lars.ingebrigtsen.no From debbugs-submit-bounces@debbugs.gnu.org Mon Mar 21 16:40:53 2022 Received: (at 54158) by debbugs.gnu.org; 21 Mar 2022 20:40:53 +0000 Received: from localhost ([127.0.0.1]:38519 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nWOpg-0001MA-Pm for submit@debbugs.gnu.org; Mon, 21 Mar 2022 16:40:52 -0400 Received: from eggs.gnu.org ([209.51.188.92]:60920) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nWOpf-0001Lx-90 for 54158@debbugs.gnu.org; Mon, 21 Mar 2022 16:40:51 -0400 Received: from [2001:470:142:3::e] (port=48960 helo=fencepost.gnu.org) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nWOpZ-00080x-HC; Mon, 21 Mar 2022 16:40:45 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To: From; bh=Ao5oBFtzReFdFfJylxN3+WuDbnF+QoiekQkNkz2pLdo=; b=hh7ID0LC3PEUHxS1ewmE rfbRjCf+xT7PPEVrNlrSfRUKwraP2326FUI+o++rATQipuoDkKxujvSS2JMqdeN5su8cgGpWek0nj WzR6ZiMGX81R8oHqezf8AWQ0jyAM9TJoeUCsgkXh/Z8s2UrMwy3F8b873FDiziXMyD7AI2FOD424+ Etv+7mhg7rGs3UHrB3JPxct3buyjjHmg2rTXBOmdEhVWbliOloS7/4QdLHdcWJBW5uzA+iGEiO6Er HmTlpI/OdwyNIN33vQvAVSs1QsmksR0d8E7NBalT38fSfiEJ+zOfTBypLY6iuy6glrH1igHoW4/Co LnCl4+42n+WOyQ==; Received: from [2600:1700:5650:f790::42] (port=49158 helo=regnitz) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nWOpZ-0005XB-7C; Mon, 21 Mar 2022 16:40:45 -0400 From: Roland Winkler To: Eric Abrahamsen Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87ee2ya6fz.fsf@ust.hk> <871qyx3o5j.fsf@gnu.org> <87lex3ksma.fsf@ericabrahamsen.net> Date: Mon, 21 Mar 2022 15:40:44 -0500 In-Reply-To: <87lex3ksma.fsf@ericabrahamsen.net> (Eric Abrahamsen's message of "Mon, 21 Mar 2022 12:33:49 -0700") Message-ID: <87h77r3upf.fsf@gnu.org> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: Andrew Cohen , 54158@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) On Mon, Mar 21 2022, Eric Abrahamsen wrote: > It would be nice at the same time to fix the indentation of the > mailbox loop so it's clearer what's actually happening. Much agreed! Can you do that, Eric? From debbugs-submit-bounces@debbugs.gnu.org Mon Mar 21 19:18:50 2022 Received: (at 54158) by debbugs.gnu.org; 21 Mar 2022 23:18:50 +0000 Received: from localhost ([127.0.0.1]:38737 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nWRIX-00046H-VG for submit@debbugs.gnu.org; Mon, 21 Mar 2022 19:18:50 -0400 Received: from mail.ericabrahamsen.net ([52.70.2.18]:41946) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nWRIW-000461-F7 for 54158@debbugs.gnu.org; Mon, 21 Mar 2022 19:18:48 -0400 Received: from localhost (c-71-197-232-41.hsd1.wa.comcast.net [71.197.232.41]) (Authenticated sender: eric@ericabrahamsen.net) by mail.ericabrahamsen.net (Postfix) with ESMTPSA id E24ECFA02C; Mon, 21 Mar 2022 23:18:41 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericabrahamsen.net; s=mail; t=1647904722; bh=Wa/kVckQVl3WRG2kYf4MK7xMKciwuYvsokMHddOLTWk=; h=From:To:Cc:Subject:References:Date:In-Reply-To:From; b=SOhRc+aNglXPdnoutptQOk5QjqAupW8GJXeWqJNTwSuKbD670aQXoOphkRs+5mqT/ KsY0M0EhGLX6px0n7YxplH26uY9HtxtLB1e762hD6Gm0k7GRzufD8e2UdTn5tIMwUL ifSbOASoVeFFvr8+CBPhmSysv/mM9LnyGAeHozSY= From: Eric Abrahamsen To: Lars Ingebrigtsen Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87ee2ya6fz.fsf@ust.hk> <871qyx3o5j.fsf@gnu.org> <87lex3ksma.fsf@ericabrahamsen.net> <871qyvp04n.fsf@gnus.org> <87h77rkrxr.fsf@ericabrahamsen.net> <87v8w7nkz7.fsf@gnus.org> Date: Mon, 21 Mar 2022 16:18:33 -0700 In-Reply-To: <87v8w7nkz7.fsf@gnus.org> (Lars Ingebrigtsen's message of "Mon, 21 Mar 2022 20:50:36 +0100") Message-ID: <87czielws6.fsf@ericabrahamsen.net> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/29.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: Andrew Cohen , 54158@debbugs.gnu.org, Roland Winkler X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) On 03/21/22 20:50 PM, Lars Ingebrigtsen wrote: > Eric Abrahamsen writes: > >> Oh! I didn't look far enough back. Didn't we want it in 28.1, too? > > Since this didn't work in Emacs 27, either, it's not a regression, so in > Emacs 29 it goes. =F0=9F=98=80 Spoken like a true maintainer :) From debbugs-submit-bounces@debbugs.gnu.org Mon Mar 21 19:27:16 2022 Received: (at 54158) by debbugs.gnu.org; 21 Mar 2022 23:27:16 +0000 Received: from localhost ([127.0.0.1]:38742 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nWRQh-0004Md-Rz for submit@debbugs.gnu.org; Mon, 21 Mar 2022 19:27:16 -0400 Received: from mail.ericabrahamsen.net ([52.70.2.18]:42332) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nWRQg-0004MQ-1O for 54158@debbugs.gnu.org; Mon, 21 Mar 2022 19:27:14 -0400 Received: from localhost (c-71-197-232-41.hsd1.wa.comcast.net [71.197.232.41]) (Authenticated sender: eric@ericabrahamsen.net) by mail.ericabrahamsen.net (Postfix) with ESMTPSA id 4AD1AFA02C; Mon, 21 Mar 2022 23:27:08 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericabrahamsen.net; s=mail; t=1647905228; bh=2gbpkUYVP030i4Lz9AQcdNq6UZrsag/nh9bnKVNAxyQ=; h=From:To:Cc:Subject:References:Date:In-Reply-To:From; b=NdVJuK++6Gy65PvS5I2bLRnMn4QGcHedFFDAlzs16C3YU5Fwt1qXUETFCrpG32afN 7yZEBxAwxO1lEvDOsMdeVgh4cUaanbDqsVrzBpzkNmUZ981kBGiNB8TWFP5Dl/ervG Y54OqOexc/40ldQ7ROmqEJtPIilq4k4V6i4x/bBw= From: Eric Abrahamsen To: Roland Winkler Subject: Re: bug#54158: 28.0.91; duplicate mail downloads in Gnus (IMAP) References: <87tucmc2y4.fsf@gnu.org> <87ee2ya6fz.fsf@ust.hk> <871qyx3o5j.fsf@gnu.org> <87lex3ksma.fsf@ericabrahamsen.net> <87h77r3upf.fsf@gnu.org> Date: Mon, 21 Mar 2022 16:27:07 -0700 In-Reply-To: <87h77r3upf.fsf@gnu.org> (Roland Winkler's message of "Mon, 21 Mar 2022 15:40:44 -0500") Message-ID: <878rt2lwdw.fsf@ericabrahamsen.net> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/29.0.50 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 54158 Cc: Andrew Cohen , 54158@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Roland Winkler writes: > On Mon, Mar 21 2022, Eric Abrahamsen wrote: >> It would be nice at the same time to fix the indentation of the >> mailbox loop so it's clearer what's actually happening. > > Much agreed! Can you do that, Eric? Sure, will do in a bit. From unknown Sun Aug 17 22:01:51 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Tue, 19 Apr 2022 11:24:06 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator