From unknown Sat Aug 16 23:46:38 2025 X-Loop: help-debbugs@gnu.org Subject: [bug#62443] LLaMA.cpp Resent-From: Nicolas Graves Original-Sender: "Debbugs-submit" Resent-CC: guix-patches@gnu.org Resent-Date: Sat, 25 Mar 2023 15:06:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 62443 X-GNU-PR-Package: guix-patches X-GNU-PR-Keywords: To: 62443@debbugs.gnu.org X-Debbugs-Original-To: guix-patches@gnu.org Received: via spool by submit@debbugs.gnu.org id=B.16797567234263 (code B ref -1); Sat, 25 Mar 2023 15:06:02 +0000 Received: (at submit) by debbugs.gnu.org; 25 Mar 2023 15:05:23 +0000 Received: from localhost ([127.0.0.1]:43228 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pg5SJ-00016b-Tm for submit@debbugs.gnu.org; Sat, 25 Mar 2023 11:05:23 -0400 Received: from lists.gnu.org ([209.51.188.17]:45402) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pg5SE-00016R-MM for submit@debbugs.gnu.org; Sat, 25 Mar 2023 11:05:18 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pg5SE-0001SU-7S for guix-patches@gnu.org; Sat, 25 Mar 2023 11:05:14 -0400 Received: from 10.mo576.mail-out.ovh.net ([46.105.73.241]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pg5SC-0006do-Hf for guix-patches@gnu.org; Sat, 25 Mar 2023 11:05:13 -0400 Received: from director1.ghost.mail-out.ovh.net (unknown [10.109.138.131]) by mo576.mail-out.ovh.net (Postfix) with ESMTP id D7808236E4 for ; Sat, 25 Mar 2023 15:05:06 +0000 (UTC) Received: from ghost-submission-6684bf9d7b-6jjgk (unknown [10.109.143.77]) by director1.ghost.mail-out.ovh.net (Postfix) with ESMTPS id 4F1491FD15 for ; Sat, 25 Mar 2023 15:05:05 +0000 (UTC) Received: from ngraves.fr ([37.59.142.107]) by ghost-submission-6684bf9d7b-6jjgk with ESMTPSA id KNEYKaENH2RaYQMA+nXfqg (envelope-from ) for ; Sat, 25 Mar 2023 15:05:05 +0000 Authentication-Results: garm.ovh; auth=pass (GARM-107S0014ae313e9-387c-485e-8807-9899abc89618, 6FD3C7460AE388A97E4C058CE803011BF627B91A) smtp.auth=ngraves@ngraves.fr X-OVh-ClientIp: 90.45.24.108 From: Nicolas Graves Date: Sat, 25 Mar 2023 16:05:04 +0100 Message-ID: <875yaoc1nj.fsf@ngraves.fr> MIME-Version: 1.0 Content-Type: text/plain X-Ovh-Tracer-Id: 982347671269401338 X-VR-SPAMSTATE: OK X-VR-SPAMSCORE: 0 X-VR-SPAMCAUSE: gggruggvucftvghtrhhoucdtuddrgedvhedrvdegkedgjeefucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecuqfggjfdpvefjgfevmfevgfenuceurghilhhouhhtmecuhedttdenucenucfjughrpefhvffufffkgggtsehttdertddttddtnecuhfhrohhmpefpihgtohhlrghsucfirhgrvhgvshcuoehnghhrrghvvghssehnghhrrghvvghsrdhfrheqnecuggftrfgrthhtvghrnhepueejleeileejfffhleetjedtleejheevudffleevgfdufeekhefgvddvveegveefnecukfhppeduvdejrddtrddtrddupdefjedrheelrddugedvrddutdejnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehinhgvthepuddvjedrtddrtddruddpmhgrihhlfhhrohhmpeeonhhgrhgrvhgvshesnhhgrhgrvhgvshdrfhhrqedpnhgspghrtghpthhtohepuddprhgtphhtthhopehguhhigidqphgrthgthhgvshesghhnuhdrohhrghdpoffvtefjohhsthepmhhoheejiedpmhhouggvpehsmhhtphhouhht Received-SPF: pass client-ip=46.105.73.241; envelope-from=ngraves@ngraves.fr; helo=10.mo576.mail-out.ovh.net X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Here are 3 patches introducing the LLaMA CPP implementation. Since weights are available as torrent download, this makes the whole model usable with a local config. Basic information for preparing the model are available in the README. -- Best regards, Nicolas Graves From unknown Sat Aug 16 23:46:38 2025 X-Loop: help-debbugs@gnu.org Subject: [bug#62443] [PATCH 1/3] gnu: Add sentencepiece. References: <875yaoc1nj.fsf@ngraves.fr> In-Reply-To: <875yaoc1nj.fsf@ngraves.fr> Resent-From: Nicolas Graves Original-Sender: "Debbugs-submit" Resent-CC: guix-patches@gnu.org Resent-Date: Sat, 25 Mar 2023 15:33:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 62443 X-GNU-PR-Package: guix-patches X-GNU-PR-Keywords: To: 62443@debbugs.gnu.org Cc: ngraves@ngraves.fr Received: via spool by 62443-submit@debbugs.gnu.org id=B62443.16797583556931 (code B ref 62443); Sat, 25 Mar 2023 15:33:01 +0000 Received: (at 62443) by debbugs.gnu.org; 25 Mar 2023 15:32:35 +0000 Received: from localhost ([127.0.0.1]:43264 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pg5sh-0001ni-8x for submit@debbugs.gnu.org; Sat, 25 Mar 2023 11:32:35 -0400 Received: from 2.mo582.mail-out.ovh.net ([46.105.76.65]:49849) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pg5se-0001nW-P0 for 62443@debbugs.gnu.org; Sat, 25 Mar 2023 11:32:34 -0400 Received: from director2.ghost.mail-out.ovh.net (unknown [10.109.143.3]) by mo582.mail-out.ovh.net (Postfix) with ESMTP id 24A0424641 for <62443@debbugs.gnu.org>; Sat, 25 Mar 2023 15:32:29 +0000 (UTC) Received: from ghost-submission-6684bf9d7b-wpl9d (unknown [10.110.171.1]) by director2.ghost.mail-out.ovh.net (Postfix) with ESMTPS id 8AB871FD83; Sat, 25 Mar 2023 15:32:29 +0000 (UTC) Received: from ngraves.fr ([37.59.142.105]) by ghost-submission-6684bf9d7b-wpl9d with ESMTPSA id pgB1Gw0UH2Q8sTYA+2z0Pg (envelope-from ); Sat, 25 Mar 2023 15:32:29 +0000 Authentication-Results: garm.ovh; auth=pass (GARM-105G0065630b9cf-cf54-4d94-9992-27b536c367a9, 6FD3C7460AE388A97E4C058CE803011BF627B91A) smtp.auth=ngraves@ngraves.fr X-OVh-ClientIp: 90.45.24.108 From: Nicolas Graves Date: Sat, 25 Mar 2023 16:32:18 +0100 Message-Id: <20230325153220.26027-1-ngraves@ngraves.fr> X-Mailer: git-send-email 2.39.2 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Ovh-Tracer-Id: 1444811059201434338 X-VR-SPAMSTATE: OK X-VR-SPAMSCORE: 0 X-VR-SPAMCAUSE: gggruggvucftvghtrhhoucdtuddrgedvhedrvdegkedgjeelucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecuqfggjfdpvefjgfevmfevgfenuceurghilhhouhhtmecuhedttdenucenucfjughrpefhvfevufffkffoggfgsedtkeertdertddtnecuhfhrohhmpefpihgtohhlrghsucfirhgrvhgvshcuoehnghhrrghvvghssehnghhrrghvvghsrdhfrheqnecuggftrfgrthhtvghrnhepteeffefhfffhjeevleeuvdehgffgveekheeuhfekhfehuefgheffhedugfegleeinecuffhomhgrihhnpehgihhthhhusgdrtghomhenucfkphepuddvjedrtddrtddruddpfeejrdehledrudegvddruddtheenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepihhnvghtpeduvdejrddtrddtrddupdhmrghilhhfrhhomhepoehnghhrrghvvghssehnghhrrghvvghsrdhfrheqpdhnsggprhgtphhtthhopedupdhrtghpthhtohepiedvgeegfeesuggvsggsuhhgshdrghhnuhdrohhrghdpoffvtefjohhsthepmhhoheekvddpmhhouggvpehsmhhtphhouhht X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) * gnu/packages/machine-learning.scm (sentencepiece): New variable. --- gnu/packages/machine-learning.scm | 27 +++++++++++++++++++++++++++ 1 file changed, 27 insertions(+) diff --git a/gnu/packages/machine-learning.scm b/gnu/packages/machine-learning.scm index 37d4ef78ad..f6996af77b 100644 --- a/gnu/packages/machine-learning.scm +++ b/gnu/packages/machine-learning.scm @@ -583,6 +583,33 @@ (define openfst-for-vosk '("--enable-shared" "--enable-far" "--enable-ngram-fsts" "--enable-lookahead-fsts" "--with-pic" "--disable-bin"))))) +(define-public sentencepiece + (package + (name "sentencepiece") + (version "0.1.97") + (source + (origin + (method git-fetch) + (uri (git-reference + (url "https://github.com/google/sentencepiece") + (commit (string-append "v" version)))) + (file-name (git-file-name name version)) + (sha256 + (base32 "1kzfkp2pk0vabyw3wmkh16h11chzq63mzc20ddhsag5fp6s91ajg")))) + (build-system cmake-build-system) + (arguments '(#:tests? #f)) + (native-inputs (list gperftools)) + (home-page "https://github.com/google/sentencepiece") + (synopsis "Unsupervised tokenizer for Neural Network-based text generation") + (description "SentencePiece is an unsupervised text tokenizer and +detokenizer mainly for Neural Network-based text generation systems where the +vocabulary size is predetermined prior to the neural model training. +SentencePiece implements subword units (e.g., byte-pair-encoding +(BPE) and unigram language model) with the extension of direct training from +raw sentences. SentencePiece allows us to make a purely end-to-end system +that does not depend on language-specific pre/postprocessing.") + (license license:asl2.0))) + (define-public shogun (package (name "shogun") -- 2.39.2 From unknown Sat Aug 16 23:46:38 2025 X-Loop: help-debbugs@gnu.org Subject: [bug#62443] [PATCH 2/3] gnu: Add python-sentencepiece. Resent-From: Nicolas Graves Original-Sender: "Debbugs-submit" Resent-CC: guix-patches@gnu.org Resent-Date: Sat, 25 Mar 2023 15:33:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 62443 X-GNU-PR-Package: guix-patches X-GNU-PR-Keywords: To: 62443@debbugs.gnu.org Cc: ngraves@ngraves.fr Received: via spool by 62443-submit@debbugs.gnu.org id=B62443.16797583606954 (code B ref 62443); Sat, 25 Mar 2023 15:33:02 +0000 Received: (at 62443) by debbugs.gnu.org; 25 Mar 2023 15:32:40 +0000 Received: from localhost ([127.0.0.1]:43268 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pg5sl-0001o5-Jy for submit@debbugs.gnu.org; Sat, 25 Mar 2023 11:32:39 -0400 Received: from 9.mo575.mail-out.ovh.net ([46.105.78.111]:42889) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pg5si-0001nh-82 for 62443@debbugs.gnu.org; Sat, 25 Mar 2023 11:32:37 -0400 Received: from director6.ghost.mail-out.ovh.net (unknown [10.109.143.146]) by mo575.mail-out.ovh.net (Postfix) with ESMTP id 47E60244B7 for <62443@debbugs.gnu.org>; Sat, 25 Mar 2023 15:32:33 +0000 (UTC) Received: from ghost-submission-6684bf9d7b-4924x (unknown [10.110.115.102]) by director6.ghost.mail-out.ovh.net (Postfix) with ESMTPS id B44A51FDCE; Sat, 25 Mar 2023 15:32:31 +0000 (UTC) Received: from ngraves.fr ([37.59.142.107]) by ghost-submission-6684bf9d7b-4924x with ESMTPSA id AdqMMA8UH2Rk3QEAlXm1Hw (envelope-from ); Sat, 25 Mar 2023 15:32:31 +0000 Authentication-Results: garm.ovh; auth=pass (GARM-107S001a076da55-dad2-4593-ba9e-2851fd1916e4, 6FD3C7460AE388A97E4C058CE803011BF627B91A) smtp.auth=ngraves@ngraves.fr X-OVh-ClientIp: 90.45.24.108 From: Nicolas Graves Date: Sat, 25 Mar 2023 16:32:19 +0100 Message-Id: <20230325153220.26027-2-ngraves@ngraves.fr> X-Mailer: git-send-email 2.39.2 In-Reply-To: <20230325153220.26027-1-ngraves@ngraves.fr> References: <20230325153220.26027-1-ngraves@ngraves.fr> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Ovh-Tracer-Id: 1445936955928732386 X-VR-SPAMSTATE: OK X-VR-SPAMSCORE: 0 X-VR-SPAMCAUSE: gggruggvucftvghtrhhoucdtuddrgedvhedrvdegkedgjeelucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecuqfggjfdpvefjgfevmfevgfenuceurghilhhouhhtmecuhedttdenucenucfjughrpefhvfevufffkffojghfggfgsedtkeertdertddtnecuhfhrohhmpefpihgtohhlrghsucfirhgrvhgvshcuoehnghhrrghvvghssehnghhrrghvvghsrdhfrheqnecuggftrfgrthhtvghrnhepvdehleeiffehtedvlefhffffjeefgfduhfetkeevheeiteduiedugfekuedtheejnecuffhomhgrihhnpehgihhthhhusgdrtghomhenucfkphepuddvjedrtddrtddruddpfeejrdehledrudegvddruddtjeenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepihhnvghtpeduvdejrddtrddtrddupdhmrghilhhfrhhomhepoehnghhrrghvvghssehnghhrrghvvghsrdhfrheqpdhnsggprhgtphhtthhopedupdhrtghpthhtohepiedvgeegfeesuggvsggsuhhgshdrghhnuhdrohhrghdpoffvtefjohhsthepmhhoheejhedpmhhouggvpehsmhhtphhouhht X-Spam-Score: -0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) * gnu/packages/machine-learning.scm (python-sentencepiece): New variable. --- gnu/packages/machine-learning.scm | 19 +++++++++++++++++++ 1 file changed, 19 insertions(+) diff --git a/gnu/packages/machine-learning.scm b/gnu/packages/machine-learning.scm index f6996af77b..df1989d316 100644 --- a/gnu/packages/machine-learning.scm +++ b/gnu/packages/machine-learning.scm @@ -610,6 +610,25 @@ (define-public sentencepiece that does not depend on language-specific pre/postprocessing.") (license license:asl2.0))) +(define-public python-sentencepiece + (package + (name "python-sentencepiece") + (version "0.1.97") + (source + (origin + (method url-fetch) + (uri (pypi-uri "sentencepiece" version)) + (sha256 + (base32 "0v0z9ryl66432zajp099bcbnwkkldzlpjvgnjv9bq2vi19g300f9")))) + (build-system python-build-system) + (propagated-inputs (list sentencepiece)) + (native-inputs (list pkg-config)) + (home-page "https://github.com/google/sentencepiece") + (synopsis "SentencePiece python wrapper") + (description "This package provides a python wrapper for the SentencePiece +unsupervised text tokenizer.") + (license license:asl2.0))) + (define-public shogun (package (name "shogun") -- 2.39.2 From unknown Sat Aug 16 23:46:38 2025 X-Loop: help-debbugs@gnu.org Subject: [bug#62443] [PATCH 3/3] gnu: Add llama-cpp. Resent-From: Nicolas Graves Original-Sender: "Debbugs-submit" Resent-CC: guix-patches@gnu.org Resent-Date: Sat, 25 Mar 2023 15:33:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 62443 X-GNU-PR-Package: guix-patches X-GNU-PR-Keywords: To: 62443@debbugs.gnu.org Cc: ngraves@ngraves.fr Received: via spool by 62443-submit@debbugs.gnu.org id=B62443.16797583606961 (code B ref 62443); Sat, 25 Mar 2023 15:33:02 +0000 Received: (at 62443) by debbugs.gnu.org; 25 Mar 2023 15:32:40 +0000 Received: from localhost ([127.0.0.1]:43270 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pg5sl-0001o7-Vp for submit@debbugs.gnu.org; Sat, 25 Mar 2023 11:32:40 -0400 Received: from 3.mo576.mail-out.ovh.net ([188.165.52.203]:41773) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pg5si-0001nj-Gl for 62443@debbugs.gnu.org; Sat, 25 Mar 2023 11:32:37 -0400 Received: from director5.ghost.mail-out.ovh.net (unknown [10.108.1.68]) by mo576.mail-out.ovh.net (Postfix) with ESMTP id 0D2E9240BE for <62443@debbugs.gnu.org>; Sat, 25 Mar 2023 15:32:34 +0000 (UTC) Received: from ghost-submission-6684bf9d7b-qsfm8 (unknown [10.110.115.59]) by director5.ghost.mail-out.ovh.net (Postfix) with ESMTPS id 83D181FD5A; Sat, 25 Mar 2023 15:32:34 +0000 (UTC) Received: from ngraves.fr ([37.59.142.108]) by ghost-submission-6684bf9d7b-qsfm8 with ESMTPSA id OzTnGBIUH2Qh/wEA0T1X6A (envelope-from ); Sat, 25 Mar 2023 15:32:34 +0000 Authentication-Results: garm.ovh; auth=pass (GARM-108S002d70db66a-80e7-41ba-942b-74fc6b9a0b85, 6FD3C7460AE388A97E4C058CE803011BF627B91A) smtp.auth=ngraves@ngraves.fr X-OVh-ClientIp: 90.45.24.108 From: Nicolas Graves Date: Sat, 25 Mar 2023 16:32:20 +0100 Message-Id: <20230325153220.26027-3-ngraves@ngraves.fr> X-Mailer: git-send-email 2.39.2 In-Reply-To: <20230325153220.26027-1-ngraves@ngraves.fr> References: <20230325153220.26027-1-ngraves@ngraves.fr> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Ovh-Tracer-Id: 1446218431806431970 X-VR-SPAMSTATE: OK X-VR-SPAMSCORE: 0 X-VR-SPAMCAUSE: gggruggvucftvghtrhhoucdtuddrgedvhedrvdegkedgjeelucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecuqfggjfdpvefjgfevmfevgfenuceurghilhhouhhtmecuhedttdenucenucfjughrpefhvfevufffkffojghfggfgsedtkeertdertddtnecuhfhrohhmpefpihgtohhlrghsucfirhgrvhgvshcuoehnghhrrghvvghssehnghhrrghvvghsrdhfrheqnecuggftrfgrthhtvghrnhepvdehleeiffehtedvlefhffffjeefgfduhfetkeevheeiteduiedugfekuedtheejnecuffhomhgrihhnpehgihhthhhusgdrtghomhenucfkphepuddvjedrtddrtddruddpfeejrdehledrudegvddruddtkeenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepihhnvghtpeduvdejrddtrddtrddupdhmrghilhhfrhhomhepoehnghhrrghvvghssehnghhrrghvvghsrdhfrheqpdhnsggprhgtphhtthhopedupdhrtghpthhtohepiedvgeegfeesuggvsggsuhhgshdrghhnuhdrohhrghdpoffvtefjohhsthepmhhoheejiedpmhhouggvpehsmhhtphhouhht X-Spam-Score: 1.3 (+) X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see the administrator of that system for details. Content preview: * gnu/packages/machine-learning.scm (llama-cpp): New variable. --- gnu/packages/machine-learning.scm | 64 +++++++++++++++++++++++++++++++ 1 file changed, 64 insertions(+) diff --git a/gnu/packages/machine-learning.scm b/gnu/packages/machine-learning.scm index df1989d316..6c78b14fc6 100644 --- a/gnu/packages/machine-learning.scm +++ b/gnu/packages/machine-learning.scm @ [...] Content analysis details: (1.3 points, 10.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- 1.3 RCVD_IN_VALIDITY_RPBL RBL: Relay in Validity RPBL, https://senderscore.org/blocklistlookup/ [188.165.52.203 listed in bl.score.senderscore.com] 0.0 SPF_HELO_NONE SPF: HELO does not publish an SPF Record -0.0 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2) [188.165.52.203 listed in wl.mailspike.net] -0.0 RCVD_IN_DNSWL_NONE RBL: Sender listed at https://www.dnswl.org/, no trust [188.165.52.203 listed in list.dnswl.org] -0.0 SPF_PASS SPF: sender matches SPF record X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.3 (/) * gnu/packages/machine-learning.scm (llama-cpp): New variable. --- gnu/packages/machine-learning.scm | 64 +++++++++++++++++++++++++++++++ 1 file changed, 64 insertions(+) diff --git a/gnu/packages/machine-learning.scm b/gnu/packages/machine-learning.scm index df1989d316..6c78b14fc6 100644 --- a/gnu/packages/machine-learning.scm +++ b/gnu/packages/machine-learning.scm @@ -400,6 +400,70 @@ (define-public guile-aiscm (define-public guile-aiscm-next (deprecated-package "guile-aiscm-next" guile-aiscm)) +(define-public llama-cpp + (let ((commit "3cd8dde0d1357b7f11bdd25c45d5bf5e97e284a0") + (revision "0")) + (package + (name "llama-cpp") + (version (git-version "0.0.0" revision commit)) + (source + (origin + (method git-fetch) + (uri (git-reference + (url "https://github.com/ggerganov/llama.cpp") + (commit (string-append "master-" (string-take commit 7))))) + (file-name (git-file-name name version)) + (sha256 + (base32 "0i7c92cxqs31xklrn688978kk29agivgxjgvsb45wzm65gc6hm5c")))) + (build-system cmake-build-system) + (arguments + (list + #:modules '((ice-9 textual-ports) + (guix build utils) + ((guix build python-build-system) #:prefix python:) + (guix build cmake-build-system)) + #:imported-modules `(,@%cmake-build-system-modules + (guix build python-build-system)) + #:phases + #~(modify-phases %standard-phases + (add-before 'install 'install-python-scripts + (lambda _ + (let ((bin (string-append #$output "/bin/"))) + (define (make-script script) + (let ((suffix (if (string-suffix? ".py" script) "" ".py"))) + (call-with-input-file + (string-append "../source/" script suffix) + (lambda (input) + (call-with-output-file (string-append bin script) + (lambda (output) + (format output "#!~a/bin/python3\n~a" + #$(this-package-input "python") + (get-string-all input)))))) + (chmod (string-append bin script) #o555))) + (mkdir-p bin) + (make-script "convert-pth-to-ggml") + (make-script "convert-gptq-to-ggml") + (make-script "quantize.py") + (substitute* (string-append bin "quantize.py") + (("os\\.getcwd\\(\\), quantize_script_binary") + (string-append "\"" bin "\", quantize_script_binary")))))) + (add-after 'install-python-scripts 'wrap-python-scripts + (assoc-ref python:%standard-phases 'wrap)) + (replace 'install + (lambda _ + (let ((bin (string-append #$output "/bin/"))) + (install-file "bin/quantize" bin) + (copy-file "bin/main" (string-append bin "llama")))))))) + (propagated-inputs + (list python-pytorch python-sentencepiece python-numpy)) + (inputs (list python)) + (home-page "https://github.com/ggerganov/llama.cpp") + (synopsis "Port of Facebook's LLaMA model in C/C++") + (description "This package provides a port to Facebook's LLaMA collection +of foundation language models. It requires models parameters to be downloaded +independently to be able to run a LLaMA model.") + (license license:expat)))) + (define-public mcl (package (name "mcl") -- 2.39.2 From debbugs-submit-bounces@debbugs.gnu.org Thu Mar 30 19:00:16 2023 Received: (at control) by debbugs.gnu.org; 30 Mar 2023 23:00:16 +0000 Received: from localhost ([127.0.0.1]:59814 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pi1Fg-0005Sr-1G for submit@debbugs.gnu.org; Thu, 30 Mar 2023 19:00:16 -0400 Received: from smtpm1.myservices.hosting ([185.26.105.232]:37158) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pi1Ff-0005Sk-1j for control@debbugs.gnu.org; Thu, 30 Mar 2023 19:00:15 -0400 Received: from mail1.netim.hosting (unknown [185.26.106.173]) by smtpm1.myservices.hosting (Postfix) with ESMTP id 1B898207FC for ; Fri, 31 Mar 2023 01:00:13 +0200 (CEST) Received: from localhost (localhost [127.0.0.1]) by mail1.netim.hosting (Postfix) with ESMTP id A3D0B8009A for ; Fri, 31 Mar 2023 01:00:10 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at mail1.netim.hosting Received: from mail1.netim.hosting ([127.0.0.1]) by localhost (mail1-2.netim.hosting [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id quAab374MQkf for ; Fri, 31 Mar 2023 01:00:10 +0200 (CEST) Received: from [192.168.1.239] (unknown [10.192.1.83]) (Authenticated sender: lumen@makinata.eu) by mail1.netim.hosting (Postfix) with ESMTPSA id 53A0380098 for ; Fri, 31 Mar 2023 01:00:10 +0200 (CEST) Message-ID: <74912071-f536-c8bc-4711-db295b4da0e6@makinata.eu> Date: Fri, 31 Mar 2023 00:00:01 +0100 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.9.0 Content-Language: en-US To: control From: Bruno Victal Subject: control-msg Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) # done with 5c131aff691fa1cb0fafe71b5f2795902ae056a7 close 55819 # control fail? close 45449 # no longer relevant close 33078 # tags tags 62551 patch tags 62503 patch tags 62461 patch tags 62443 patch tags 62428 patch tags 61226 patch tags 59893 patch tags 59852 patch tags 49451 patch tags 49207 patch tags 44258 patch quit From unknown Sat Aug 16 23:46:38 2025 X-Loop: help-debbugs@gnu.org Subject: [bug#62443] LLaMA.cpp Resent-From: Nicolas Goaziou Original-Sender: "Debbugs-submit" Resent-CC: guix-patches@gnu.org Resent-Date: Sat, 08 Apr 2023 12:08:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 62443 X-GNU-PR-Package: guix-patches X-GNU-PR-Keywords: patch To: 62443@debbugs.gnu.org Cc: Nicolas Graves , 62443-done@debbugs.gnu.org X-Debbugs-Original-To: Nicolas Graves via Guix-patches via Received: via spool by submit@debbugs.gnu.org id=B.168095565327213 (code B ref -1); Sat, 08 Apr 2023 12:08:02 +0000 Received: (at submit) by debbugs.gnu.org; 8 Apr 2023 12:07:33 +0000 Received: from localhost ([127.0.0.1]:57861 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pl7Lx-00074r-4D for submit@debbugs.gnu.org; Sat, 08 Apr 2023 08:07:33 -0400 Received: from lists.gnu.org ([209.51.188.17]:57706) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pl7Lu-00074b-JH for submit@debbugs.gnu.org; Sat, 08 Apr 2023 08:07:30 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pl7Lu-0002EQ-CP for guix-patches@gnu.org; Sat, 08 Apr 2023 08:07:30 -0400 Received: from relay1-d.mail.gandi.net ([2001:4b98:dc4:8::221]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pl7Lt-0005ZZ-0m for guix-patches@gnu.org; Sat, 08 Apr 2023 08:07:30 -0400 Received: (Authenticated sender: admin@nicolasgoaziou.fr) by mail.gandi.net (Postfix) with ESMTPSA id A79D3240002; Sat, 8 Apr 2023 12:07:23 +0000 (UTC) From: Nicolas Goaziou References: <875yaoc1nj.fsf@ngraves.fr> Date: Sat, 08 Apr 2023 14:07:22 +0200 In-Reply-To: <875yaoc1nj.fsf@ngraves.fr> (Nicolas Graves via Guix-patches via's message of "Sat, 25 Mar 2023 16:05:04 +0100") Message-ID: <87v8i6lgqt.fsf@nicolasgoaziou.fr> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain Received-SPF: pass client-ip=2001:4b98:dc4:8::221; envelope-from=mail@nicolasgoaziou.fr; helo=relay1-d.mail.gandi.net X-Spam_score_int: -25 X-Spam_score: -2.6 X-Spam_bar: -- X-Spam_report: (-2.6 / 5.0 requ) BAYES_00=-1.9, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -1.6 (-) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.6 (--) Hello, Nicolas Graves via Guix-patches via writes: > Here are 3 patches introducing the LLaMA CPP implementation. Since > weights are available as torrent download, this makes the whole model > usable with a local config. Applied. Thank you. Regards, -- Nicolas Goaziou From unknown Sat Aug 16 23:46:38 2025 MIME-Version: 1.0 X-Mailer: MIME-tools 5.505 (Entity 5.505) X-Loop: help-debbugs@gnu.org From: help-debbugs@gnu.org (GNU bug Tracking System) To: Nicolas Graves Subject: bug#62443: closed (Re: [bug#62443] LLaMA.cpp) Message-ID: References: <87v8i6lgqt.fsf@nicolasgoaziou.fr> <875yaoc1nj.fsf@ngraves.fr> X-Gnu-PR-Message: they-closed 62443 X-Gnu-PR-Package: guix-patches X-Gnu-PR-Keywords: patch Reply-To: 62443@debbugs.gnu.org Date: Sat, 08 Apr 2023 12:08:03 +0000 Content-Type: multipart/mixed; boundary="----------=_1680955683-27289-1" This is a multi-part message in MIME format... ------------=_1680955683-27289-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" Your bug report #62443: LLaMA.cpp which was filed against the guix-patches package, has been closed. The explanation is attached below, along with your original report. If you require more details, please reply to 62443@debbugs.gnu.org. --=20 62443: https://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D62443 GNU Bug Tracking System Contact help-debbugs@gnu.org with problems ------------=_1680955683-27289-1 Content-Type: message/rfc822 Content-Disposition: inline Content-Transfer-Encoding: 7bit Received: (at 62443-done) by debbugs.gnu.org; 8 Apr 2023 12:07:31 +0000 Received: from localhost ([127.0.0.1]:57859 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pl7Lu-00074c-RB for submit@debbugs.gnu.org; Sat, 08 Apr 2023 08:07:31 -0400 Received: from relay1-d.mail.gandi.net ([217.70.183.193]:36809) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pl7Lu-00074M-29 for 62443-done@debbugs.gnu.org; Sat, 08 Apr 2023 08:07:30 -0400 Received: (Authenticated sender: admin@nicolasgoaziou.fr) by mail.gandi.net (Postfix) with ESMTPSA id A79D3240002; Sat, 8 Apr 2023 12:07:23 +0000 (UTC) From: Nicolas Goaziou To: Nicolas Graves via Guix-patches via Subject: Re: [bug#62443] LLaMA.cpp References: <875yaoc1nj.fsf@ngraves.fr> Date: Sat, 08 Apr 2023 14:07:22 +0200 In-Reply-To: <875yaoc1nj.fsf@ngraves.fr> (Nicolas Graves via Guix-patches via's message of "Sat, 25 Mar 2023 16:05:04 +0100") Message-ID: <87v8i6lgqt.fsf@nicolasgoaziou.fr> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 62443-done Cc: Nicolas Graves , 62443-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.7 (-) Hello, Nicolas Graves via Guix-patches via writes: > Here are 3 patches introducing the LLaMA CPP implementation. Since > weights are available as torrent download, this makes the whole model > usable with a local config. Applied. Thank you. Regards, -- Nicolas Goaziou ------------=_1680955683-27289-1 Content-Type: message/rfc822 Content-Disposition: inline Content-Transfer-Encoding: 7bit Received: (at submit) by debbugs.gnu.org; 25 Mar 2023 15:05:23 +0000 Received: from localhost ([127.0.0.1]:43228 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pg5SJ-00016b-Tm for submit@debbugs.gnu.org; Sat, 25 Mar 2023 11:05:23 -0400 Received: from lists.gnu.org ([209.51.188.17]:45402) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pg5SE-00016R-MM for submit@debbugs.gnu.org; Sat, 25 Mar 2023 11:05:18 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pg5SE-0001SU-7S for guix-patches@gnu.org; Sat, 25 Mar 2023 11:05:14 -0400 Received: from 10.mo576.mail-out.ovh.net ([46.105.73.241]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pg5SC-0006do-Hf for guix-patches@gnu.org; Sat, 25 Mar 2023 11:05:13 -0400 Received: from director1.ghost.mail-out.ovh.net (unknown [10.109.138.131]) by mo576.mail-out.ovh.net (Postfix) with ESMTP id D7808236E4 for ; Sat, 25 Mar 2023 15:05:06 +0000 (UTC) Received: from ghost-submission-6684bf9d7b-6jjgk (unknown [10.109.143.77]) by director1.ghost.mail-out.ovh.net (Postfix) with ESMTPS id 4F1491FD15 for ; Sat, 25 Mar 2023 15:05:05 +0000 (UTC) Received: from ngraves.fr ([37.59.142.107]) by ghost-submission-6684bf9d7b-6jjgk with ESMTPSA id KNEYKaENH2RaYQMA+nXfqg (envelope-from ) for ; Sat, 25 Mar 2023 15:05:05 +0000 Authentication-Results: garm.ovh; auth=pass (GARM-107S0014ae313e9-387c-485e-8807-9899abc89618, 6FD3C7460AE388A97E4C058CE803011BF627B91A) smtp.auth=ngraves@ngraves.fr X-OVh-ClientIp: 90.45.24.108 From: Nicolas Graves To: guix-patches@gnu.org Subject: LLaMA.cpp Date: Sat, 25 Mar 2023 16:05:04 +0100 Message-ID: <875yaoc1nj.fsf@ngraves.fr> MIME-Version: 1.0 Content-Type: text/plain X-Ovh-Tracer-Id: 982347671269401338 X-VR-SPAMSTATE: OK X-VR-SPAMSCORE: 0 X-VR-SPAMCAUSE: gggruggvucftvghtrhhoucdtuddrgedvhedrvdegkedgjeefucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecuqfggjfdpvefjgfevmfevgfenuceurghilhhouhhtmecuhedttdenucenucfjughrpefhvffufffkgggtsehttdertddttddtnecuhfhrohhmpefpihgtohhlrghsucfirhgrvhgvshcuoehnghhrrghvvghssehnghhrrghvvghsrdhfrheqnecuggftrfgrthhtvghrnhepueejleeileejfffhleetjedtleejheevudffleevgfdufeekhefgvddvveegveefnecukfhppeduvdejrddtrddtrddupdefjedrheelrddugedvrddutdejnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehinhgvthepuddvjedrtddrtddruddpmhgrihhlfhhrohhmpeeonhhgrhgrvhgvshesnhhgrhgrvhgvshdrfhhrqedpnhgspghrtghpthhtohepuddprhgtphhtthhopehguhhigidqphgrthgthhgvshesghhnuhdrohhrghdpoffvtefjohhsthepmhhoheejiedpmhhouggvpehsmhhtphhouhht Received-SPF: pass client-ip=46.105.73.241; envelope-from=ngraves@ngraves.fr; helo=10.mo576.mail-out.ovh.net X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Here are 3 patches introducing the LLaMA CPP implementation. Since weights are available as torrent download, this makes the whole model usable with a local config. Basic information for preparing the model are available in the README. -- Best regards, Nicolas Graves ------------=_1680955683-27289-1--