From unknown Wed Jun 18 23:09:24 2025 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.509 (Entity 5.509) Content-Type: text/plain; charset=utf-8 From: bug#20765 <20765@debbugs.gnu.org> To: bug#20765 <20765@debbugs.gnu.org> Subject: Status: Python .egg files must not be compressed Reply-To: bug#20765 <20765@debbugs.gnu.org> Date: Thu, 19 Jun 2025 06:09:24 +0000 retitle 20765 Python .egg files must not be compressed reassign 20765 guix submitter 20765 ludo@gnu.org (Ludovic Court=C3=A8s) severity 20765 serious thanks From debbugs-submit-bounces@debbugs.gnu.org Sun Jun 07 16:37:43 2015 Received: (at submit) by debbugs.gnu.org; 7 Jun 2015 20:37:43 +0000 Received: from localhost ([127.0.0.1]:44344 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Z1hKA-0000YB-VU for submit@debbugs.gnu.org; Sun, 07 Jun 2015 16:37:43 -0400 Received: from eggs.gnu.org ([208.118.235.92]:57384) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Z1hK9-0000Xx-FA for submit@debbugs.gnu.org; Sun, 07 Jun 2015 16:37:42 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Z1hK2-00068f-Tn for submit@debbugs.gnu.org; Sun, 07 Jun 2015 16:37:36 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,T_RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([2001:4830:134:3::11]:49036) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Z1hK2-00068b-R9 for submit@debbugs.gnu.org; Sun, 07 Jun 2015 16:37:34 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:42637) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Z1hJz-000276-Kg for bug-guix@gnu.org; Sun, 07 Jun 2015 16:37:34 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Z1hJy-00067E-KS for bug-guix@gnu.org; Sun, 07 Jun 2015 16:37:31 -0400 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:39222) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Z1hJq-00063c-Eg; Sun, 07 Jun 2015 16:37:22 -0400 Received: from reverse-83.fdn.fr ([80.67.176.83]:39171 helo=pluto) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_128_CBC_SHA1:128) (Exim 4.82) (envelope-from ) id 1Z1hJp-0007tu-QJ; Sun, 07 Jun 2015 16:37:22 -0400 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: bug-guix@gnu.org Subject: Python .egg files must not be compressed X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 19 Prairial an 223 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x3D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-unknown-linux-gnu Date: Sun, 07 Jun 2015 22:37:19 +0200 Message-ID: <87zj4btfuo.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.5 (gnu/linux) MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=-=-=" X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address (bad octet value). X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address (bad octet value). X-Received-From: 2001:4830:134:3::11 X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: submit Cc: Ricardo Wurmus , iyzsong@gmail.com X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable The other day on IRC Ricardo and =E5=AE=8B=E6=96=87=E6=AD=A6 noted that pyt= hon-pillow currently comes with a compressed egg. Because it is compressed, the daemon=E2=80=99s conservative scanning fails to see what store items it ref= ers to; in particular Ricardo noted that on his machine, python-pillow refers to a non-existent store item for OpenJPEG. To fix that, python-build-system must be tweaked to ask for uncompressed eggs. I tried the attached patch, which uses the =E2=80=98--always-unzip= =E2=80=99 option of easyinstall. Unfortunately, that option is unsupported by some setup.py, such as that of setuptools itself. What would be the right way to do that? TIA. :-) Ludo=E2=80=99. --=-=-= Content-Type: text/x-patch Content-Disposition: inline --- a/guix/build/python-build-system.scm +++ b/guix/build/python-build-system.scm @@ -60,14 +60,20 @@ #:allow-other-keys) "Install a given Python package." (let* ((out (assoc-ref outputs "out")) - (params (append (list (string-append "--prefix=" out)) + (params (cons* (string-append "--prefix=" out) + + ;; Make sure the .egg files are kept unzipped, + ;; otherwise the daemon's conservative scanning may + ;; not find store references embedded in it. + "--always-unzip" + configure-flags)) (python-version (get-python-version (assoc-ref inputs "python"))) (old-path (getenv "PYTHONPATH")) (add-path (string-append out "/lib/python" python-version "/site-packages/"))) - ;; create the module installation directory and add it to PYTHONPATH - ;; to make setuptools happy + ;; Create the module installation directory and add it to PYTHONPATH + ;; to make setuptools happy. (mkdir-p add-path) (setenv "PYTHONPATH" (string-append (if old-path --=-=-=-- From debbugs-submit-bounces@debbugs.gnu.org Wed Jul 01 04:24:03 2015 Received: (at control) by debbugs.gnu.org; 1 Jul 2015 08:24:03 +0000 Received: from localhost ([127.0.0.1]:35176 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1ZADJK-0004jS-4t for submit@debbugs.gnu.org; Wed, 01 Jul 2015 04:24:02 -0400 Received: from eggs.gnu.org ([208.118.235.92]:54712) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1ZADJI-0004j9-JK for control@debbugs.gnu.org; Wed, 01 Jul 2015 04:24:00 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ZADJA-0002Ki-V7 for control@debbugs.gnu.org; Wed, 01 Jul 2015 04:23:55 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-2.5 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:38876) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ZADJA-0002Ke-Re for control@debbugs.gnu.org; Wed, 01 Jul 2015 04:23:52 -0400 Received: from reverse-83.fdn.fr ([80.67.176.83]:35922 helo=pluto) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_128_CBC_SHA1:128) (Exim 4.82) (envelope-from ) id 1ZADJA-0003o9-9U for control@debbugs.gnu.org; Wed, 01 Jul 2015 04:23:52 -0400 Date: Wed, 01 Jul 2015 10:23:48 +0200 Message-Id: <87h9poxp4b.fsf@gnu.org> To: control@debbugs.gnu.org From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) Subject: control message for bug #20765 MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address (bad octet value). X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.6 (-----) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.6 (-----) severity 20765 serious From debbugs-submit-bounces@debbugs.gnu.org Mon Jul 20 17:23:06 2015 Received: (at 20765) by debbugs.gnu.org; 20 Jul 2015 21:23:06 +0000 Received: from localhost ([127.0.0.1]:54858 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1ZHIWg-0003mL-CC for submit@debbugs.gnu.org; Mon, 20 Jul 2015 17:23:06 -0400 Received: from eggs.gnu.org ([208.118.235.92]:60029) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1ZHIWe-0003lm-KH for 20765@debbugs.gnu.org; Mon, 20 Jul 2015 17:23:05 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ZHIWQ-00047H-JR for 20765@debbugs.gnu.org; Mon, 20 Jul 2015 17:22:59 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-3.1 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:50487) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ZHIWH-00045Y-0L; Mon, 20 Jul 2015 17:22:41 -0400 Received: from reverse-83.fdn.fr ([80.67.176.83]:36807 helo=pluto) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_128_CBC_SHA1:128) (Exim 4.82) (envelope-from ) id 1ZHIWG-0007CG-3c; Mon, 20 Jul 2015 17:22:40 -0400 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: 20765@debbugs.gnu.org Subject: Re: bug#20765: Python .egg files must not be compressed References: <87zj4btfuo.fsf@gnu.org> Date: Mon, 20 Jul 2015 23:22:35 +0200 In-Reply-To: <87zj4btfuo.fsf@gnu.org> ("Ludovic \=\?utf-8\?Q\?Court\=C3\=A8s\=22'\?\= \=\?utf-8\?Q\?s\?\= message of "Sun, 07 Jun 2015 22:37:19 +0200") Message-ID: <87zj2qcyn8.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.5 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address (bad octet value). X-Received-From: 2001:4830:134:3::e X-Spam-Score: -6.2 (------) X-Debbugs-Envelope-To: 20765 Cc: Ricardo Wurmus , iyzsong@gmail.com X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -6.2 (------) Commit e5358a6 disables egg compression by augmenting =E2=80=98setup.cfg=E2= =80=99 for python-pillow only. After: --8<---------------cut here---------------start------------->8--- $ guix gc --references /gnu/store/jx7dmdrsgndzic0jqqs9hsljgxgs95kw-python-p= illow-2.8.1 /gnu/store/1hcg2k1lfz7z64p27cjm156jj8y6ia1s-python-3.4.3 /gnu/store/29s2a1hfc47qa292pf9kd0k8m9djd3hf-libwebp-0.4.3 /gnu/store/61c1h5zlxcjq55z13i1n7inm0d1nfv0w-libtiff-4.0.3 /gnu/store/cpx9iibpdwi3wb81glpnnlxr9zra2iiv-bash-4.3.39 /gnu/store/fsy5s8wn2l542q05jn54lzp9wx5l9fdj-freetype-2.6 /gnu/store/j4w3bddy32p14mrd1a9d80435y50s3yz-zlib-1.2.7 /gnu/store/jawh8qxz9s9pn7mafq1gw9khpmq14qvl-python-setuptools-12.1 /gnu/store/jx7dmdrsgndzic0jqqs9hsljgxgs95kw-python-pillow-2.8.1 /gnu/store/jyk2nxd922wmls7xarx0npy11cvi2848-lcms-2.6 /gnu/store/lcsm84qj11fbg3wqwnpsl3x0p3b22f8s-python-wrapper-3.4.3 /gnu/store/mq8kb3z2qga5jb8vc3s832yp9pr4knm6-openjpeg-2.1.0 /gnu/store/n3xi1hzh43hz2i1qq78ajr1mrapif2pa-libjpeg-9a /gnu/store/v7bvaklf40mmm9pq9bc3hilwvyj7dlwk-python-nose-1.3.4 /gnu/store/w29667jfv02s1hgmv0yp7nqyywvdv1fz-glibc-2.21 /gnu/store/z8xw06ns2xjc9v5iza2n7gprjhi7dda0-gcc-4.9.3-lib --8<---------------cut here---------------end--------------->8--- Before: --8<---------------cut here---------------start------------->8--- $ guix gc --references $(guix build python-pillow) /gnu/store/1hcg2k1lfz7z64p27cjm156jj8y6ia1s-python-3.4.3 /gnu/store/cpx9iibpdwi3wb81glpnnlxr9zra2iiv-bash-4.3.39 /gnu/store/imi7gz1779h6559d5kh8w94p7kqx5fqv-python-pillow-2.8.1 /gnu/store/jawh8qxz9s9pn7mafq1gw9khpmq14qvl-python-setuptools-12.1 /gnu/store/lcsm84qj11fbg3wqwnpsl3x0p3b22f8s-python-wrapper-3.4.3 /gnu/store/v7bvaklf40mmm9pq9bc3hilwvyj7dlwk-python-nose-1.3.4 --8<---------------cut here---------------end--------------->8--- So clearly, I=E2=80=99d expect python-pillow to be more reliable now. Now the question is how many packages end up installing compressed eggs, and whether we can generalize that solution. I think we should try doing the =E2=80=98setup.cfg=E2=80=99 dance in python-build-system.scm after 0.8.3. Thoughts? Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Tue Oct 13 09:38:54 2015 Received: (at 20765) by debbugs.gnu.org; 13 Oct 2015 13:38:54 +0000 Received: from localhost ([127.0.0.1]:37917 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Zlzn3-0006NN-CY for submit@debbugs.gnu.org; Tue, 13 Oct 2015 09:38:53 -0400 Received: from pegasus.bbbm.mdc-berlin.de ([141.80.25.20]:51463) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Zlzmv-0006N0-Sy for 20765@debbugs.gnu.org; Tue, 13 Oct 2015 09:38:46 -0400 Received: from localhost (localhost [127.0.0.1]) by pegasus.bbbm.mdc-berlin.de (Postfix) with ESMTP id D2A4338113F; Tue, 13 Oct 2015 15:38:44 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=mdc-berlin.de; h= content-transfer-encoding:content-type:content-type:mime-version :message-id:date:date:subject:subject:from:from:received :received:received; s=mdc; t=1444743519; x=1446557920; bh=TgBlcA D2B94rtlpqDsjBBMunwa/EX9ieZvju1imXcog=; b=BsoTnfKG++QrRL6kapBABX trEGu/DtolzMfQrxe8Q/I29mpuNi83o8LDfglVbCygFPEXEtci3WX5A8eTFh6vqI e+XEHukDuxZWyKra7JccMf0BNytbMi3O3Ji5K+hVvUnqFub0AIZHucddJVEfoY6X BhcBCbA9rBA/UaqC+AREY= X-Virus-Scanned: amavisd-new at mdc-berlin.de Received: from pegasus.bbbm.mdc-berlin.de ([127.0.0.1]) by localhost (pegasus.bbbm.mdc-berlin.de [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 2fQU5sSBRxVR; Tue, 13 Oct 2015 15:38:39 +0200 (CEST) Received: from HTCAONE.mdc-berlin.net (mab.citx.mdc-berlin.de [141.80.36.102]) by pegasus.bbbm.mdc-berlin.de (Postfix) with ESMTP; Tue, 13 Oct 2015 15:38:39 +0200 (CEST) Received: from localhost (141.80.180.135) by HTCAONE.mdc-berlin.net (141.80.180.125) with Microsoft SMTP Server (TLS) id 14.3.235.1; Tue, 13 Oct 2015 15:38:38 +0200 From: Ricardo Wurmus To: <20765@debbugs.gnu.org> Subject: Python .egg files must not be compressed Date: Tue, 13 Oct 2015 15:38:38 +0200 Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit X-Originating-IP: [141.80.180.135] X-TM-AS-Product-Ver: SMEX-10.0.0.4211-7.500.1018-21876.006 X-TM-AS-Result: No--0.779900-0.000000-31 X-TM-AS-User-Approved-Sender: Yes X-TM-AS-User-Blocked-Sender: No X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 20765 Cc: ludo@gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) I stumbled upon a similar problem when building other Python packages. For ‘python-patsy’, for example, I found that an egg archive is produced no matter what I put in ‘setup.cfg’. As far as I can tell, “zip_ok” defaults to “0” in recent versions of setuptools, so I don’t think the fix you used on ‘python-pillow’ would have much effect in general. I could only coerce the build system to install plain files by adding a build phase like this: (add-after 'unpack 'prevent-generation-of-egg-archive (lambda _ (substitute* "setup.py" (("from setuptools import setup") "from distutils.core import setup")) #t)) It turns out that when ‘setuptools.setup’ is used egg archives are built, when ‘distutils.core.setup’ is used, however, this does not happen. ~~ Ricardo From debbugs-submit-bounces@debbugs.gnu.org Tue Oct 13 10:10:23 2015 Received: (at 20765) by debbugs.gnu.org; 13 Oct 2015 14:10:23 +0000 Received: from localhost ([127.0.0.1]:38838 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Zm0HW-0007Ik-Ko for submit@debbugs.gnu.org; Tue, 13 Oct 2015 10:10:22 -0400 Received: from eggs.gnu.org ([208.118.235.92]:37918) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Zm0HV-0007Id-6D for 20765@debbugs.gnu.org; Tue, 13 Oct 2015 10:10:21 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Zm0HR-0003nf-Ss for 20765@debbugs.gnu.org; Tue, 13 Oct 2015 10:10:20 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,T_RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:34901) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Zm0HR-0003nb-QJ; Tue, 13 Oct 2015 10:10:17 -0400 Received: from pluto.bordeaux.inria.fr ([193.50.110.57]:45796 helo=pluto) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_128_CBC_SHA1:128) (Exim 4.82) (envelope-from ) id 1Zm0HR-0006sj-3Y; Tue, 13 Oct 2015 10:10:17 -0400 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: Ricardo Wurmus Subject: Re: Python .egg files must not be compressed References: X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 22 =?utf-8?Q?Vend=C3=A9miaire?= an 224 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x3D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-unknown-linux-gnu Date: Tue, 13 Oct 2015 16:10:14 +0200 In-Reply-To: (Ricardo Wurmus's message of "Tue, 13 Oct 2015 15:38:38 +0200") Message-ID: <87612aq2pl.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.5 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: Error: Malformed IPv6 address (bad octet value). X-Received-From: 2001:4830:134:3::e X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 20765 Cc: 20765@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Ricardo Wurmus skribis: > I stumbled upon a similar problem when building other Python packages. > For =E2=80=98python-patsy=E2=80=99, for example, I found that an egg arch= ive is produced > no matter what I put in =E2=80=98setup.cfg=E2=80=99. As far as I can tel= l, =E2=80=9Czip_ok=E2=80=9D > defaults to =E2=80=9C0=E2=80=9D in recent versions of setuptools, so I do= n=E2=80=99t think the > fix you used on =E2=80=98python-pillow=E2=80=99 would have much effect in= general. OK. > I could only coerce the build system to install plain files by adding a > build phase like this: > > (add-after 'unpack 'prevent-generation-of-egg-archive > (lambda _ > (substitute* "setup.py" > (("from setuptools import setup") > "from distutils.core import setup")) > #t)) > > It turns out that when =E2=80=98setuptools.setup=E2=80=99 is used egg arc= hives are > built, when =E2=80=98distutils.core.setup=E2=80=99 is used, however, this= does not > happen. But are distutils.core and setuptools the same thing? Replacing one by the other sounds a bit scary, no? Still it would be nice to have a generic solution. Maybe we should patch setuptools itself to change its defaults? Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Tue Oct 13 10:32:32 2015 Received: (at 20765) by debbugs.gnu.org; 13 Oct 2015 14:32:32 +0000 Received: from localhost ([127.0.0.1]:38864 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Zm0cy-0007x8-54 for submit@debbugs.gnu.org; Tue, 13 Oct 2015 10:32:32 -0400 Received: from venus.bbbm.mdc-berlin.de ([141.80.25.30]:60789) by debbugs.gnu.org with esmtp (Exim 4.80) (envelope-from ) id 1Zm0cw-0007x0-Nn for 20765@debbugs.gnu.org; Tue, 13 Oct 2015 10:32:31 -0400 Received: from localhost (localhost [127.0.0.1]) by venus.bbbm.mdc-berlin.de (Postfix) with ESMTP id 7D73B380954; Tue, 13 Oct 2015 16:32:29 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=mdc-berlin.de; h= content-transfer-encoding:content-type:content-type:mime-version :message-id:date:date:in-reply-to:subject:subject:from:from :references:received:received:received; s=mdc; t=1444746743; x= 1446561144; bh=9TNXy4a9+RyBeFPQxuRMdfTlJuUq+hZGmn1kjZNA9y8=; b=E Ahes8poCFqLCOmPQpIugmL76gateVGRctateXNy2+oqZr0FTd4hkbKBcbD7DwOJc DbIuV7YQ9m+ICQMAvJmVJzeG27xYuZi+PHPBJ7hMKZRg8+1WQ20CHitRQXGbT9f1 j69XGBeOodxA9Am5BlVrM62XCSk+wmAP5fg8ql9e+Y= X-Virus-Scanned: amavisd-new at mdc-berlin.de Received: from venus.bbbm.mdc-berlin.de ([127.0.0.1]) by localhost (venus.bbbm.mdc-berlin.de [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id p2Eu28f9dXY7; Tue, 13 Oct 2015 16:32:23 +0200 (CEST) Received: from HTCAONE.mdc-berlin.net (mab.citx.mdc-berlin.de [141.80.36.102]) by venus.bbbm.mdc-berlin.de (Postfix) with ESMTP; Tue, 13 Oct 2015 16:32:23 +0200 (CEST) Received: from localhost (141.80.180.135) by HTCAONE.mdc-berlin.net (141.80.180.125) with Microsoft SMTP Server (TLS) id 14.3.235.1; Tue, 13 Oct 2015 16:32:19 +0200 References: <87612aq2pl.fsf@gnu.org> From: Ricardo Wurmus To: Ludovic =?utf-8?Q?Court=C3=A8s?= Subject: Re: Python .egg files must not be compressed In-Reply-To: <87612aq2pl.fsf@gnu.org> Date: Tue, 13 Oct 2015 16:32:19 +0200 Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit X-Originating-IP: [141.80.180.135] X-TM-AS-Product-Ver: SMEX-10.0.0.4211-7.500.1018-21876.006 X-TM-AS-Result: No--2.772500-0.000000-31 X-TM-AS-User-Approved-Sender: Yes X-TM-AS-User-Blocked-Sender: No X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 20765 Cc: 20765@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) Ludovic Courtès writes: >> I could only coerce the build system to install plain files by adding a >> build phase like this: >> >> (add-after 'unpack 'prevent-generation-of-egg-archive >> (lambda _ >> (substitute* "setup.py" >> (("from setuptools import setup") >> "from distutils.core import setup")) >> #t)) >> >> It turns out that when ‘setuptools.setup’ is used egg archives are >> built, when ‘distutils.core.setup’ is used, however, this does not >> happen. > > But are distutils.core and setuptools the same thing? Replacing one by > the other sounds a bit scary, no? I’m not familiar with Python packaging. From what I understand, distutils has much fewer features than setuptools; but in the few cases that I tried replacing it did work out just fine. > Still it would be nice to have a generic solution. Maybe we should > patch setuptools itself to change its defaults? This would probably be best, but I don’t understand setuptools enough to propose a patch. ~~ Ricardo From debbugs-submit-bounces@debbugs.gnu.org Mon Feb 08 23:54:46 2016 Received: (at 20765) by debbugs.gnu.org; 9 Feb 2016 04:54:46 +0000 Received: from localhost ([127.0.0.1]:60886 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84) (envelope-from ) id 1aT0K6-0006lV-Lx for submit@debbugs.gnu.org; Mon, 08 Feb 2016 23:54:46 -0500 Received: from out2-smtp.messagingengine.com ([66.111.4.26]:46667) by debbugs.gnu.org with esmtp (Exim 4.84) (envelope-from ) id 1aT0K4-0006lM-Rb for 20765@debbugs.gnu.org; Mon, 08 Feb 2016 23:54:45 -0500 Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.nyi.internal (Postfix) with ESMTP id 9D60F20907; Mon, 8 Feb 2016 23:54:42 -0500 (EST) Received: from frontend1 ([10.202.2.160]) by compute5.internal (MEProxy); Mon, 08 Feb 2016 23:54:42 -0500 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=famulari.name; h= content-type:date:from:message-id:mime-version:to:x-sasl-enc :x-sasl-enc; s=mesmtp; bh=ZGIkPoIKxSoA8mJd+lTXmkjXcyg=; b=jm7JVV YvNHUWlGBtbfqcxKbQNGq7ICix6Fv78wekzPSayo0so9jDwYv6vuKC2gEkVjpY+M PHij1PtgqwVIgzSGI1CpBc6WfmyALvQzqPy1NrJr7qJ6ME91tJ2IHi+y0u5zbNfI zvIqlZHV9RwrCF85B1slz9j44BqIGw5Cfs89o= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:message-id :mime-version:to:x-sasl-enc:x-sasl-enc; s=smtpout; bh=ZGIkPoIKxS oA8mJd+lTXmkjXcyg=; b=gIqq1NN6TWoHksF6af+6+04bqF9fQT4s72zcu4UglG u+jfCaQ5A5q9SdP3RkdWC2unne0RBgsm2WgIJThV+J6N27ilY71QoRJlg0jWi0ip uNjvMilZbdKFxmnXZhDUOWmY381qevLTyjvFI/nyki3RuNKCZ42r6tTVZm3JmTuG U= X-Sasl-enc: 22rXizlVGcsX74hx9ugZDY5e1E8QZhLlhqt7UmgvAQv2 1454993682 Received: from localhost (c-69-249-5-231.hsd1.pa.comcast.net [69.249.5.231]) by mail.messagingengine.com (Postfix) with ESMTPA id 51AD6C0001D for <20765@debbugs.gnu.org>; Mon, 8 Feb 2016 23:54:42 -0500 (EST) Date: Mon, 8 Feb 2016 23:54:42 -0500 From: Leo Famulari To: 20765@debbugs.gnu.org Message-ID: <20160209045442.GA29136@jasmine> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.24 (2015-08-30) X-Spam-Score: 1.3 (+) X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see the administrator of that system for details. Content preview: Another reason to not compress Python eggs is that the contents of the zip archives introduce non-determinism through their timestamps. You can see it in action: $ git checkout fe17fb4a2c897fd9186f91887f5af63dd00d227a $ ./pre-inst-env guix build --rounds=2 acme [...] Content analysis details: (1.3 points, 10.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low trust [66.111.4.26 listed in list.dnswl.org] -0.0 SPF_PASS SPF: sender matches SPF record -0.0 RCVD_IN_MSPIKE_H3 RBL: Good reputation (+3) [66.111.4.26 listed in wl.mailspike.net] 0.0 T_DKIM_INVALID DKIM-Signature header exists but is not valid 1.8 MISSING_SUBJECT Missing Subject: header 0.2 NO_SUBJECT Extra score for no subject -0.0 RCVD_IN_MSPIKE_WL Mailspike good senders X-Debbugs-Envelope-To: 20765 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.3 (+) X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see the administrator of that system for details. Content preview: Another reason to not compress Python eggs is that the contents of the zip archives introduce non-determinism through their timestamps. You can see it in action: $ git checkout fe17fb4a2c897fd9186f91887f5af63dd00d227a $ ./pre-inst-env guix build --rounds=2 acme [...] Content analysis details: (1.3 points, 10.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low trust [66.111.4.26 listed in list.dnswl.org] -0.0 RCVD_IN_MSPIKE_H3 RBL: Good reputation (+3) [66.111.4.26 listed in wl.mailspike.net] -0.0 SPF_PASS SPF: sender matches SPF record 0.0 T_DKIM_INVALID DKIM-Signature header exists but is not valid 1.8 MISSING_SUBJECT Missing Subject: header 0.2 NO_SUBJECT Extra score for no subject -0.0 RCVD_IN_MSPIKE_WL Mailspike good senders Another reason to not compress Python eggs is that the contents of the zip archives introduce non-determinism through their timestamps. You can see it in action: $ git checkout fe17fb4a2c897fd9186f91887f5af63dd00d227a $ ./pre-inst-env guix build --rounds=2 acme If you save the output between rounds, you can use diffoscope to confirm that the differences between the rounds are the timestamps of the contents of the eggs. From debbugs-submit-bounces@debbugs.gnu.org Tue Feb 09 16:37:48 2016 Received: (at 20765) by debbugs.gnu.org; 9 Feb 2016 21:37:48 +0000 Received: from localhost ([127.0.0.1]:33971 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84) (envelope-from ) id 1aTFym-0008Mu-8R for submit@debbugs.gnu.org; Tue, 09 Feb 2016 16:37:48 -0500 Received: from eggs.gnu.org ([208.118.235.92]:36026) by debbugs.gnu.org with esmtp (Exim 4.84) (envelope-from ) id 1aTFyk-0008Mh-8e for 20765@debbugs.gnu.org; Tue, 09 Feb 2016 16:37:46 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1aTFyb-00078n-Tj for 20765@debbugs.gnu.org; Tue, 09 Feb 2016 16:37:40 -0500 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-2.2 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:49185) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1aTFyb-00078j-QI; Tue, 09 Feb 2016 16:37:37 -0500 Received: from reverse-83.fdn.fr ([80.67.176.83]:54720 helo=pluto) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_128_CBC_SHA1:128) (Exim 4.82) (envelope-from ) id 1aTFyb-0001uc-5h; Tue, 09 Feb 2016 16:37:37 -0500 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: Leo Famulari Subject: Re: bug#20765: (no subject) References: <87zj4btfuo.fsf@gnu.org> <20160209045442.GA29136@jasmine> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 21 =?utf-8?Q?Pluvi=C3=B4se?= an 224 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x3D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-unknown-linux-gnu Date: Tue, 09 Feb 2016 22:37:35 +0100 In-Reply-To: <20160209045442.GA29136@jasmine> (Leo Famulari's message of "Mon, 8 Feb 2016 23:54:42 -0500") Message-ID: <87oabppnts.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.5 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -3.3 (---) X-Debbugs-Envelope-To: 20765 Cc: 20765@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Leo Famulari skribis: > Another reason to not compress Python eggs is that the contents of the > zip archives introduce non-determinism through their timestamps. Indeed, good catch! Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Wed Apr 06 14:17:38 2016 Received: (at 20765) by debbugs.gnu.org; 6 Apr 2016 18:17:38 +0000 Received: from localhost ([127.0.0.1]:52053 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ans1K-0006yp-AL for submit@debbugs.gnu.org; Wed, 06 Apr 2016 14:17:38 -0400 Received: from mailrelay2.public.one.com ([91.198.169.125]:45683) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ans1I-0006yb-9T for 20765@debbugs.gnu.org; Wed, 06 Apr 2016 14:17:36 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=enge.fr; s=20140924; h=from:subject:date:message-id:to:cc:mime-version:content-type:in-reply-to: references; bh=zIZ6GzZJrD1f5QZNRkmvo8enjxy3BVzWY3uEK6SmYnM=; b=En/N61Nf6prqReNJnZ3PEOt+ux8Oo6htyPddzdrgtH5H21KNs65X64UqTGSd6L2yU/xwOzvGjdR3D uFGx37DfuglYwuTu95AvPnKIegJVeK26cinqUVsUUkIeKSideEiM8b9wnjlIBUCKTAFt1ZhiRF4Lm7 46RopIIBi5gN17Wc= X-HalOne-Cookie: 04ef3145291f060120b439b5b6cf243b1bb34e04 X-HalOne-ID: d12e19d6-fc23-11e5-8278-b82a72d03b9b Received: from bugis (unknown [88.174.56.78]) by smtpfilter2.public.one.com (Halon Mail Gateway) with ESMTPSA; Wed, 6 Apr 2016 18:17:26 +0000 (UTC) Date: Wed, 6 Apr 2016 20:17:24 +0200 From: Andreas Enge To: Ludovic =?iso-8859-15?Q?Court=E8s?= Subject: Re: bug#20765: (no subject) Message-ID: <20160406181724.GA18933@bugis> References: <87zj4btfuo.fsf@gnu.org> <20160209045442.GA29136@jasmine> <87oabppnts.fsf@gnu.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <87oabppnts.fsf@gnu.org> User-Agent: Mutt/1.5.24 (2015-08-30) X-Spam-Score: 2.0 (++) X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see the administrator of that system for details. Content preview: I have stumbled over the same issue for another python package: python-pkgconfig (just committed) makes a system call to pkg-config. I rewrote the system call to use an absolute path, but the non-scanning of the compressed egg means that no reference to pkg-config is returned. [...] Content analysis details: (2.0 points, 10.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- 2.0 SLIGHTLY_BAD_SUBJECT Subject contains something slightly spammy -0.0 RCVD_IN_MSPIKE_H3 RBL: Good reputation (+3) [91.198.169.125 listed in wl.mailspike.net] 0.0 T_DKIM_INVALID DKIM-Signature header exists but is not valid -0.0 RCVD_IN_MSPIKE_WL Mailspike good senders X-Debbugs-Envelope-To: 20765 Cc: 20765@debbugs.gnu.org, Leo Famulari X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 2.0 (++) X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see the administrator of that system for details. Content preview: I have stumbled over the same issue for another python package: python-pkgconfig (just committed) makes a system call to pkg-config. I rewrote the system call to use an absolute path, but the non-scanning of the compressed egg means that no reference to pkg-config is returned. [...] Content analysis details: (2.0 points, 10.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- -0.0 RCVD_IN_MSPIKE_H3 RBL: Good reputation (+3) [91.198.169.125 listed in wl.mailspike.net] 2.0 SLIGHTLY_BAD_SUBJECT Subject contains something slightly spammy 0.0 T_DKIM_INVALID DKIM-Signature header exists but is not valid -0.0 RCVD_IN_MSPIKE_WL Mailspike good senders I have stumbled over the same issue for another python package: python-pkgconfig (just committed) makes a system call to pkg-config. I rewrote the system call to use an absolute path, but the non-scanning of the compressed egg means that no reference to pkg-config is returned. Spending a week with Python wizards, I asked around and got the following advice, implemented in the package as #:configure-flags '("--single-version-externally-managed" "--root=/") Our Python build system adds these flags only to the install phase. We could do this automatically in our Python build system, but we would need to make sure to add these flags only when python-setuptools or python2-setuptools are part of the input, since the flags are not recognised by the setup.py from distutils. Another advice was to replace the call to "python setup.py install" by "pip install .", which apparently is becoming the standard approach of installing Python packages, not only over the Internet, but also locally (for which the "." stands). What do you think? Andreas From debbugs-submit-bounces@debbugs.gnu.org Wed Apr 06 16:52:19 2016 Received: (at 20765) by debbugs.gnu.org; 6 Apr 2016 20:52:19 +0000 Received: from localhost ([127.0.0.1]:52143 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1anuR1-0002SG-0Z for submit@debbugs.gnu.org; Wed, 06 Apr 2016 16:52:19 -0400 Received: from eggs.gnu.org ([208.118.235.92]:46076) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1anuQz-0002Rx-7Y for 20765@debbugs.gnu.org; Wed, 06 Apr 2016 16:52:17 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1anuQq-0005ra-0X for 20765@debbugs.gnu.org; Wed, 06 Apr 2016 16:52:12 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.0 required=5.0 tests=BAYES_20,RP_MATCHES_RCVD autolearn=disabled version=3.3.2 Received: from fencepost.gnu.org ([2001:4830:134:3::e]:48639) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1anuQp-0005rW-TI; Wed, 06 Apr 2016 16:52:07 -0400 Received: from reverse-83.fdn.fr ([80.67.176.83]:44226 helo=pluto) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_128_CBC_SHA1:128) (Exim 4.82) (envelope-from ) id 1anuQp-000579-8G; Wed, 06 Apr 2016 16:52:07 -0400 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) To: Andreas Enge Subject: Compressed eggs (Python) References: <87zj4btfuo.fsf@gnu.org> <20160209045442.GA29136@jasmine> <87oabppnts.fsf@gnu.org> <20160406181724.GA18933@bugis> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 18 Germinal an 224 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x3D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-unknown-linux-gnu Date: Wed, 06 Apr 2016 22:52:04 +0200 In-Reply-To: <20160406181724.GA18933@bugis> (Andreas Enge's message of "Wed, 6 Apr 2016 20:17:24 +0200") Message-ID: <87oa9m4g0b.fsf_-_@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.5 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2001:4830:134:3::e X-Spam-Score: -6.0 (------) X-Debbugs-Envelope-To: 20765 Cc: 20765@debbugs.gnu.org, Leo Famulari X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -6.0 (------) Andreas Enge skribis: > Spending a week with Python wizards, I asked around and got the following > advice, implemented in the package as > #:configure-flags '("--single-version-externally-managed" "--root=3D/") Woow, I wouldn=E2=80=99t have guessed that this has something to do with .e= gg compression. :-) > Our Python build system adds these flags only to the install phase. > > We could do this automatically in our Python build system, but we would > need to make sure to add these flags only when python-setuptools or > python2-setuptools are part of the input, since the flags are not recogni= sed > by the setup.py from distutils. OK. If the above flags do the trick, then why not. The difficulty will be to find a nice way to determine whether those flags can be passed. > Another advice was to replace the call to "python setup.py install" > by "pip install .", which apparently is becoming the standard approach > of installing Python packages, not only over the Internet, but also local= ly > (for which the "." stands). Dunno, but that=E2=80=99s a different story. :-) Thanks! Ludo=E2=80=99. From debbugs-submit-bounces@debbugs.gnu.org Mon Apr 18 15:28:20 2016 Received: (at 20765) by debbugs.gnu.org; 18 Apr 2016 19:28:20 +0000 Received: from localhost ([127.0.0.1]:39672 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1asEqJ-0007BY-KY for submit@debbugs.gnu.org; Mon, 18 Apr 2016 15:28:19 -0400 Received: from mail-out.m-online.net ([212.18.0.10]:33844) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1asEja-00071I-Ls for 20765@debbugs.gnu.org; Mon, 18 Apr 2016 15:21:23 -0400 Received: from frontend01.mail.m-online.net (unknown [192.168.8.182]) by mail-out.m-online.net (Postfix) with ESMTP id 3qpdKs4h3Sz3hjZM for <20765@debbugs.gnu.org>; Mon, 18 Apr 2016 21:21:21 +0200 (CEST) Received: from localhost (dynscan1.mnet-online.de [192.168.6.68]) by mail.m-online.net (Postfix) with ESMTP id 3qpdKs3SJTzvh2J for <20765@debbugs.gnu.org>; Mon, 18 Apr 2016 21:21:21 +0200 (CEST) X-Virus-Scanned: amavisd-new at mnet-online.de Received: from mail.mnet-online.de ([192.168.8.182]) by localhost (dynscan1.mail.m-online.net [192.168.6.68]) (amavisd-new, port 10024) with ESMTP id FyhfgHpzUeWY for <20765@debbugs.gnu.org>; Mon, 18 Apr 2016 21:21:20 +0200 (CEST) Received: from hermia.goebel-consult.de (ppp-188-174-151-28.dynamic.mnet-online.de [188.174.151.28]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mail.mnet-online.de (Postfix) with ESMTPS for <20765@debbugs.gnu.org>; Mon, 18 Apr 2016 21:21:20 +0200 (CEST) Received: from thisbe.goebel-consult.de (hermia.goebel-consult.de [192.168.110.7]) by hermia.goebel-consult.de (Postfix) with ESMTP id 5B0496010E for <20765@debbugs.gnu.org>; Mon, 18 Apr 2016 21:21:19 +0200 (CEST) To: 20765@debbugs.gnu.org From: Hartmut Goebel Subject: Compressed eggs (Python) X-Enigmail-Draft-Status: N1110 Organization: crazy-compilers.com Message-ID: <571533AF.3040801@crazy-compilers.com> Date: Mon, 18 Apr 2016 21:21:19 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.7.2 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 20765 X-Mailman-Approved-At: Mon, 18 Apr 2016 15:28:18 -0400 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) Hi, I support the proposal for switching to pip. Switching to pip should be save, since this is the proposed standard way for installing - and thus it should be save in the long run, too. I suggest calling pip with this options (valid as of pip 8.1.1) --no-deps Don't install package dependencies. --no-binary :all: Do not use binary packages. --no-index Ignore package index --disable-pip-version-check Since in the internet one can find issues with --single-version-externally-managed I verified that pip will even work for packages using distutils instead of setuptools. I did a test and inspecting the software. Here is what I did: I used a simply Python package which imports distutils instead of setuptools. Installing the via pip in verbose-mode shows this line (you do not need to look at the details): Running command /tmp/myvenv/bin/python2.7 -u -c "import setuptools, tokenize;__file__=3D'/tmp/pip-Biwi3y-build/setup.py';exec(compile(getattr= (tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-KcE_9O-record/install-record.txt --single-version-externally-managed --compile --install-headers /tmp/myvenv/include/site/python2.7/sample This basically runs the setup.py =E2=80=9Cwrapped=E2=80=9D into setuptool= s [1]. The source code of setuptools reviled that it is monkey-pathing distutils (esp. distutils.dist.Distribution) to objects from setuptools. So the more elaborate stuff of setuptools is used even if the setup.py only import distutils. Additionally I checked what --single-version-externally-managed does (since the documentation [2] is not that clear): it simply makes `install` use the "original" distutils install command, which was/is not able to create zipped eggs. So here we are on the save side, too. Tested with pip 8.1.1 and setuptools 20.3, but this same code is in pip 6.0 and setuptools 18.0 already (which are older than what is in guix 0.10.0) [1] Technically this line is executing a command which import setuptools and then executes setup.py the it the same scope/context. [2] https://pythonhosted.org/setuptools/setuptools.html#install-run-easy-inst= all-or-old-style-installation. --=20 Regards Hartmut Goebel | Hartmut Goebel | h.goebel@crazy-compilers.com | | www.crazy-compilers.com | compilers which you thought are impossible | From debbugs-submit-bounces@debbugs.gnu.org Sat Dec 17 13:43:37 2016 Received: (at 20765-done) by debbugs.gnu.org; 17 Dec 2016 18:43:37 +0000 Received: from localhost ([127.0.0.1]:45147 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cIJxJ-0003lW-IL for submit@debbugs.gnu.org; Sat, 17 Dec 2016 13:43:37 -0500 Received: from out1-smtp.messagingengine.com ([66.111.4.25]:46431) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cIJxI-0003lQ-K0 for 20765-done@debbugs.gnu.org; Sat, 17 Dec 2016 13:43:36 -0500 Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 55414202F4; Sat, 17 Dec 2016 13:43:36 -0500 (EST) Received: from frontend2 ([10.202.2.161]) by compute4.internal (MEProxy); Sat, 17 Dec 2016 13:43:36 -0500 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=famulari.name; h= cc:content-type:date:from:in-reply-to:message-id:mime-version :references:subject:to:x-me-sender:x-me-sender:x-sasl-enc :x-sasl-enc; s=mesmtp; bh=fjJqB46niTKzuBT0agHv/aqzfW4=; b=zK0k6m 2yqv0FULu1vzmgQOiqppm0EldWhxFL5UXTlxPxJ9Vja0eq3c/YJQhabSrGzrkjp9 nY5YF+jhs9rKSMwcoNf3xEAa5Atup0jz5BcFkjNL7daJsDQsfa38J9sEPcAEvMAs mtJ8PDUVq2wqpNKwL7vgyM67/56P6kTZPNAmQ= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-sender :x-me-sender:x-sasl-enc:x-sasl-enc; s=smtpout; bh=fjJqB46niTKzuB T0agHv/aqzfW4=; b=FUK9UjX5KgwljOdW9dmcHitvmabGGd6SRg4ttFUB1ol+cZ 7/wasjxYjRDP/XWp+hLyLjEq/KF74NcoGbgjtgyeysryIvy221DJyYW5UWjhQ6Y9 vrrzFaG95i6DVuK+t4aPtqptOqz55PIHs9vJDc+RyoXEtdkn7zX5GFIONhVeU= X-ME-Sender: X-Sasl-enc: 0HwMMIB4SiqNzT85F1skS0OuexHjp5V65lTg4FVHn3zm 1482000216 Received: from localhost (c-73-188-17-148.hsd1.pa.comcast.net [73.188.17.148]) by mail.messagingengine.com (Postfix) with ESMTPA id 1437724240; Sat, 17 Dec 2016 13:43:36 -0500 (EST) Date: Sat, 17 Dec 2016 13:43:34 -0500 From: Leo Famulari To: Hartmut Goebel Subject: Re: bug#20765: Compressed eggs (Python) Message-ID: <20161217184334.GA1726@jasmine> References: <87zj4btfuo.fsf@gnu.org> <571533AF.3040801@crazy-compilers.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <571533AF.3040801@crazy-compilers.com> User-Agent: Mutt/1.7.1 (2016-10-04) X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 20765-done Cc: 20765-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) >From what I can see, this bug is fixed by the new Python build system introduced in commit 03e856ddf5d28bc61144effb1a393b73cb4a2d9f. Please re-open the bug if I am mistaken. From unknown Wed Jun 18 23:09:24 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Sun, 15 Jan 2017 12:24:04 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator