From debbugs-submit-bounces@debbugs.gnu.org Mon Jun 05 12:32:29 2017 Received: (at submit) by debbugs.gnu.org; 5 Jun 2017 16:32:30 +0000 Received: from localhost ([127.0.0.1]:57958 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dHuvd-0003Wm-NN for submit@debbugs.gnu.org; Mon, 05 Jun 2017 12:32:29 -0400 Received: from eggs.gnu.org ([208.118.235.92]:58558) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dHuvc-0003WZ-F4 for submit@debbugs.gnu.org; Mon, 05 Jun 2017 12:32:28 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dHuvW-0002tU-CX for submit@debbugs.gnu.org; Mon, 05 Jun 2017 12:32:23 -0400 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=0.8 required=5.0 tests=BAYES_50,HTML_MESSAGE autolearn=disabled version=3.3.2 Received: from lists.gnu.org ([2001:4830:134:3::11]:46183) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1dHuvW-0002tI-9f for submit@debbugs.gnu.org; Mon, 05 Jun 2017 12:32:22 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:49507) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dHuvV-0005oN-4m for bug-guix@gnu.org; Mon, 05 Jun 2017 12:32:22 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dHuvT-0002qF-Vd for bug-guix@gnu.org; Mon, 05 Jun 2017 12:32:21 -0400 Received: from mail.fsfe.org ([2001:aa8:ffed::3:102]:51190) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1dHuvT-0002m3-DC for bug-guix@gnu.org; Mon, 05 Jun 2017 12:32:19 -0400 Received: from localhost (localhost [127.0.0.1]) by mail.fsfe.org (Postfix) with ESMTP id 6B94363BD13 for ; Mon, 5 Jun 2017 18:32:17 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at mail.fsfe.org Received: from mail.fsfe.org ([127.0.0.1]) by localhost (cavendish.fsfeurope.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 3JvdMkFXs7K6 for ; Mon, 5 Jun 2017 18:32:17 +0200 (CEST) Received: by mail-it0-f47.google.com with SMTP id m47so67362590iti.1 for ; Mon, 05 Jun 2017 09:32:16 -0700 (PDT) X-Gm-Message-State: AODbwcD5lpBPyIulpTlDaOc2HpTCJuDLERXXwJpLO7xxyEneXzHkqY0j JE6lE/hkGbD1L/SciKMQNioKiiN2YA== X-Received: by 10.107.148.17 with SMTP id w17mr20259963iod.60.1496680331071; Mon, 05 Jun 2017 09:32:11 -0700 (PDT) MIME-Version: 1.0 Received: by 10.107.9.150 with HTTP; Mon, 5 Jun 2017 09:32:10 -0700 (PDT) From: Jelle Licht Date: Mon, 5 Jun 2017 18:32:10 +0200 X-Gmail-Original-Message-ID: Message-ID: Subject: python-apsw bundles a version of SQLite To: bug-guix@gnu.org Content-Type: multipart/alternative; boundary="001a1140a96679f4ef0551390b33" X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-Received-From: 2001:4830:134:3::11 X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) --001a1140a96679f4ef0551390b33 Content-Type: text/plain; charset="UTF-8" The version of python-apsw (and of course python2-apsw) come with a bundled copy of SQLite. The bundled version seems to be a special single-source-file version [1]. I have tried deleting the bundled copy in a new phase, and this allows python-apsw to build with the system SQLite libraries instead (someone prematurely added sqlite as an input already, it was just never used). This leads to a new problem, where that one of the VFS tests uses about 14 gigs of memory, and seems to hang as well. I am not sure if this is indicative of any real issues when using python-apsw, and as such I am not confident that just deleting the bundled copy of SQLite will help us, as it might lead to an unusable package. Some possible directions on resolving this issue: - Debug the multiple thousand lines of test code to see exactly where/how the test fails when using the system SQLite library - Package the right version of the SQLite amalgation [1] that is now bundled, although the amalgation should be functionally equivalent to the normal SQLite version. Thanks, Jelle [1]: https://www.sqlite.org/amalgamation.html --001a1140a96679f4ef0551390b33 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
The version of python-apsw (and of course p= ython2-apsw) come with a bundled copy of SQLite.
The bundled versi= on seems to be a special single-source-file version [1].

I hav= e tried deleting the bundled copy in a new phase, and this allows python-ap= sw to build with the system SQLite libraries instead (someone prematurely a= dded sqlite as an input already, it was just never used).

This leads to a new problem, where that one of the VFS tests uses about 1= 4 gigs of memory, and seems to hang as well. I am not sure if this is indic= ative of any real issues when using python-apsw, and as such I am not confi= dent that just deleting the bundled copy of SQLite will help us, as it migh= t lead to an unusable package.

Some possible directions o= n resolving this issue:
- Debug the multiple thousand lines of test code= to see exactly where/how the test fails when using the system SQLite libra= ry
- Package the right version of the SQLite amalgation [1] t= hat is now bundled, although the amalgation should be functionally equivale= nt to the normal SQLite version.

--001a1140a96679f4ef0551390b33-- From debbugs-submit-bounces@debbugs.gnu.org Mon Jun 05 13:27:34 2017 Received: (at 27257) by debbugs.gnu.org; 5 Jun 2017 17:27:34 +0000 Received: from localhost ([127.0.0.1]:58004 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dHvmv-0004kJ-UG for submit@debbugs.gnu.org; Mon, 05 Jun 2017 13:27:34 -0400 Received: from dd1012.kasserver.com ([85.13.128.8]:35354) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dHvmu-0004kB-7K for 27257@debbugs.gnu.org; Mon, 05 Jun 2017 13:27:32 -0400 Received: from localhost (77.118.242.17.wireless.dyn.drei.com [77.118.242.17]) by dd1012.kasserver.com (Postfix) with ESMTPSA id B9EB71CA0026; Mon, 5 Jun 2017 19:27:29 +0200 (CEST) Date: Mon, 5 Jun 2017 19:27:24 +0200 From: Danny Milosavljevic To: Jelle Licht Subject: Re: bug#27257: python-apsw bundles a version of SQLite Message-ID: <20170605192724.51a810de@scratchpost.org> In-Reply-To: References: X-Mailer: Claws Mail 3.14.1 (GTK+ 2.24.31; x86_64-unknown-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 27257 Cc: 27257@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) Hi Jelle, On Mon, 5 Jun 2017 18:32:10 +0200 Jelle Licht wrote: > Some possible directions on resolving this issue: > - Debug the multiple thousand lines of test code to see exactly where/how > the test fails when using the system SQLite library > - Package the right version of the SQLite amalgation [1] that is now > bundled, although the amalgation should be functionally equivalent to the > normal SQLite version. I see that apsw bundles SQLite 3.9.2. Does it work when you replace it with the external version 3.9.2 - amalgation or not ? I don't necessarily mean permanently - just to find out whether the tests work normally then. Also, maybe diff the bundled SQLite 3.9.2 and the released SQLite 3.9.2 amalgation of the same version ? The apsw setup.py seems to do some serious config flags magic. Are those the same? It seems that the bundled package was not done by the original apsw author. See details and . On the first page it says that it will only work with "specific" SQLite versions - which is why the original author provided the setup.py which figures out what to do instead of bundling a random version like that person did. All in all it would be much better for apsw to become part of sqlite upstream. It even uses sqlite's configure script and parses sqlite's config flags. Why not just make it part of the sqlite release then? *shakes head* From debbugs-submit-bounces@debbugs.gnu.org Sun Sep 10 19:50:41 2017 Received: (at 27257) by debbugs.gnu.org; 10 Sep 2017 23:50:41 +0000 Received: from localhost ([127.0.0.1]:59982 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1drBzs-0005OF-PV for submit@debbugs.gnu.org; Sun, 10 Sep 2017 19:50:41 -0400 Received: from mail.fsfe.org ([217.69.89.162]:44769) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1drBzq-0005O3-T4 for 27257@debbugs.gnu.org; Sun, 10 Sep 2017 19:50:39 -0400 Received: from localhost (localhost [127.0.0.1]) by mail.fsfe.org (Postfix) with ESMTP id 3FDE363928E for <27257@debbugs.gnu.org>; Mon, 11 Sep 2017 01:50:33 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at mail.fsfe.org Received: from mail.fsfe.org ([127.0.0.1]) by localhost (cavendish.fsfeurope.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id JyUAkx7H3aA4 for <27257@debbugs.gnu.org>; Mon, 11 Sep 2017 01:50:33 +0200 (CEST) Received: by mail-ua0-f177.google.com with SMTP id q29so9511918uaf.3 for <27257@debbugs.gnu.org>; Sun, 10 Sep 2017 16:50:32 -0700 (PDT) X-Gm-Message-State: AHPjjUjWw6iIbLUypD63nGUAQv7G4S6alXHpwyzRTNRdteHXZLMArJ49 T1nkRTipGfO7ovCjMdJ0pcoZrUoOSA== X-Google-Smtp-Source: AOwi7QApQ8+nB374uA6bjyX+jxE0/4KI1UFc2ZrV9htjcHE7G1QFjJB+FJtPQ1+GinRbarwt0BBQx6uXXbHjg+Gn0Bc= X-Received: by 10.176.73.169 with SMTP id e38mr7637578uad.132.1505087429474; Sun, 10 Sep 2017 16:50:29 -0700 (PDT) MIME-Version: 1.0 Received: by 10.103.122.81 with HTTP; Sun, 10 Sep 2017 16:50:28 -0700 (PDT) In-Reply-To: <20170605192724.51a810de@scratchpost.org> References: <20170605192724.51a810de@scratchpost.org> From: Jelle Licht Date: Mon, 11 Sep 2017 01:50:28 +0200 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: bug#27257: python-apsw bundles a version of SQLite To: Danny Milosavljevic Content-Type: multipart/alternative; boundary="001a1144f6789707fe0558de79ec" X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: 27257 Cc: 27257@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) --001a1144f6789707fe0558de79ec Content-Type: text/plain; charset="UTF-8" 2017-06-05 19:27 GMT+02:00 Danny Milosavljevic : > Hi Jelle, > > On Mon, 5 Jun 2017 18:32:10 +0200 > Jelle Licht wrote: > > > Some possible directions on resolving this issue: > > - Debug the multiple thousand lines of test code to see exactly where/how > > the test fails when using the system SQLite library > > - Package the right version of the SQLite amalgation [1] that is now > > bundled, although the amalgation should be functionally equivalent to the > > normal SQLite version. > > I see that apsw bundles SQLite 3.9.2. Does it work when you replace it > with the external version 3.9.2 - amalgation or not ? > Getting version 3.9.2 to build turned out to be a bit of a hassle; some nonsense about a fossil(?) generated manifest missing or what not. > > I don't necessarily mean permanently - just to find out whether the tests > work normally then. > > Also, Perhaps diff the bundled SQLite 3.9.2 and the released SQLite 3.9.2 > amalgation of the same version ? > A diff between bundled SQLite 3.9.2 and release 3.9.2. amalgation reveals no (functional) differences, so at least there will be no extra set of patches to maintain. > [...] > It seems that the actual upstream for apsw at [1] has continued development since we packaged it. Incidentally, our sqlite package is a bit outdated. If I update sqlite to the latest version (3.20.1), as well as change the python-apsw upstream to [1], the package seems to build and pass the `check' phase with no issues. [1] : https://github.com/rogerbinns/apsw --001a1144f6789707fe0558de79ec Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


2017-06-05 19:27 GMT+02:00 Danny Milosavljevic <dannym@scratchpos= t.org>:
= Hi Jelle,

On Mon, 5 Jun 2017 18:32:10 +0200
Jelle Licht <jlicht= @fsfe.org> wrote:

> Some possible directions on resolving this issue:
> - Debug the multiple thousand lines of test code to see exactly where/= how
> the test fails when using the system SQLite library
> - Package the right version of the SQLite amalgation [1] that is now > bundled, although the amalgation should be functionally equivalent to = the
> normal SQLite version.

I see that apsw bundles SQLite 3.9.2.=C2=A0 Does it work when you re= place it with the external version 3.9.2 - amalgation or not ?
Getting version 3.9.2 to build turned out to be a bit of a hassle;= some nonsense about a fossil(?) generated manifest missing or what not.

I don't necessarily mean permanently - just to find out whether the tes= ts work normally then.

Also, Perhaps diff the bundled SQLite 3.9.2 and the released SQLite 3.9.2 a= malgation of the same version ?
A diff between bundled= SQLite 3.9.2 and release 3.9.2. amalgation reveals no (functional) differe= nces, so at least there will be no extra set of patches to maintain.
[...]

It seems that the actual upstream for = apsw at [1] has continued development since we packaged it.
Incidentally, our sqlite package is a bit outdated. If I u= pdate sqlite to the latest version (3.20.1), as well as change the python-a= psw upstream to [1], the package seems to build and pass the `check' ph= ase with no issues.

[1] : https://= github.com/rogerbinns/apsw
--001a1144f6789707fe0558de79ec-- From debbugs-submit-bounces@debbugs.gnu.org Wed Sep 13 04:51:48 2017 Received: (at control) by debbugs.gnu.org; 13 Sep 2017 08:51:48 +0000 Received: from localhost ([127.0.0.1]:37096 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ds3Oe-0003J6-Gn for submit@debbugs.gnu.org; Wed, 13 Sep 2017 04:51:48 -0400 Received: from mail.fsfe.org ([217.69.89.162]:58463) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ds3Oc-0003Ir-Fy for control@debbugs.gnu.org; Wed, 13 Sep 2017 04:51:46 -0400 Received: from localhost (localhost [127.0.0.1]) by mail.fsfe.org (Postfix) with ESMTP id 57CAF63BB03 for ; Wed, 13 Sep 2017 10:51:40 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at mail.fsfe.org Received: from mail.fsfe.org ([127.0.0.1]) by localhost (cavendish.fsfeurope.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id DMGp62+HtNTo for ; Wed, 13 Sep 2017 10:51:40 +0200 (CEST) Date: Wed, 13 Sep 2017 10:51:37 +0200 Message-Id: <87wp53x9pi.fsf@fsfe.org> To: control@debbugs.gnu.org From: Jelle Licht Subject: control message for bug #27257 X-Spam-Score: -5.0 (-----) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -5.0 (-----) close 27257 From unknown Sat Sep 13 15:36:55 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Wed, 11 Oct 2017 11:24:05 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator