From debbugs-submit-bounces@debbugs.gnu.org Sat Mar 25 11:05:23 2023 Received: (at submit) by debbugs.gnu.org; 25 Mar 2023 15:05:23 +0000 Received: from localhost ([127.0.0.1]:43228 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pg5SJ-00016b-Tm for submit@debbugs.gnu.org; Sat, 25 Mar 2023 11:05:23 -0400 Received: from lists.gnu.org ([209.51.188.17]:45402) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pg5SE-00016R-MM for submit@debbugs.gnu.org; Sat, 25 Mar 2023 11:05:18 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pg5SE-0001SU-7S for guix-patches@gnu.org; Sat, 25 Mar 2023 11:05:14 -0400 Received: from 10.mo576.mail-out.ovh.net ([46.105.73.241]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pg5SC-0006do-Hf for guix-patches@gnu.org; Sat, 25 Mar 2023 11:05:13 -0400 Received: from director1.ghost.mail-out.ovh.net (unknown [10.109.138.131]) by mo576.mail-out.ovh.net (Postfix) with ESMTP id D7808236E4 for ; Sat, 25 Mar 2023 15:05:06 +0000 (UTC) Received: from ghost-submission-6684bf9d7b-6jjgk (unknown [10.109.143.77]) by director1.ghost.mail-out.ovh.net (Postfix) with ESMTPS id 4F1491FD15 for ; Sat, 25 Mar 2023 15:05:05 +0000 (UTC) Received: from ngraves.fr ([37.59.142.107]) by ghost-submission-6684bf9d7b-6jjgk with ESMTPSA id KNEYKaENH2RaYQMA+nXfqg (envelope-from ) for ; Sat, 25 Mar 2023 15:05:05 +0000 Authentication-Results: garm.ovh; auth=pass (GARM-107S0014ae313e9-387c-485e-8807-9899abc89618, 6FD3C7460AE388A97E4C058CE803011BF627B91A) smtp.auth=ngraves@ngraves.fr X-OVh-ClientIp: 90.45.24.108 From: Nicolas Graves To: guix-patches@gnu.org Subject: LLaMA.cpp Date: Sat, 25 Mar 2023 16:05:04 +0100 Message-ID: <875yaoc1nj.fsf@ngraves.fr> MIME-Version: 1.0 Content-Type: text/plain X-Ovh-Tracer-Id: 982347671269401338 X-VR-SPAMSTATE: OK X-VR-SPAMSCORE: 0 X-VR-SPAMCAUSE: gggruggvucftvghtrhhoucdtuddrgedvhedrvdegkedgjeefucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecuqfggjfdpvefjgfevmfevgfenuceurghilhhouhhtmecuhedttdenucenucfjughrpefhvffufffkgggtsehttdertddttddtnecuhfhrohhmpefpihgtohhlrghsucfirhgrvhgvshcuoehnghhrrghvvghssehnghhrrghvvghsrdhfrheqnecuggftrfgrthhtvghrnhepueejleeileejfffhleetjedtleejheevudffleevgfdufeekhefgvddvveegveefnecukfhppeduvdejrddtrddtrddupdefjedrheelrddugedvrddutdejnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehinhgvthepuddvjedrtddrtddruddpmhgrihhlfhhrohhmpeeonhhgrhgrvhgvshesnhhgrhgrvhgvshdrfhhrqedpnhgspghrtghpthhtohepuddprhgtphhtthhopehguhhigidqphgrthgthhgvshesghhnuhdrohhrghdpoffvtefjohhsthepmhhoheejiedpmhhouggvpehsmhhtphhouhht Received-SPF: pass client-ip=46.105.73.241; envelope-from=ngraves@ngraves.fr; helo=10.mo576.mail-out.ovh.net X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -3.3 (---) Here are 3 patches introducing the LLaMA CPP implementation. Since weights are available as torrent download, this makes the whole model usable with a local config. Basic information for preparing the model are available in the README. -- Best regards, Nicolas Graves From debbugs-submit-bounces@debbugs.gnu.org Sat Mar 25 11:32:35 2023 Received: (at 62443) by debbugs.gnu.org; 25 Mar 2023 15:32:35 +0000 Received: from localhost ([127.0.0.1]:43264 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pg5sh-0001ni-8x for submit@debbugs.gnu.org; Sat, 25 Mar 2023 11:32:35 -0400 Received: from 2.mo582.mail-out.ovh.net ([46.105.76.65]:49849) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pg5se-0001nW-P0 for 62443@debbugs.gnu.org; Sat, 25 Mar 2023 11:32:34 -0400 Received: from director2.ghost.mail-out.ovh.net (unknown [10.109.143.3]) by mo582.mail-out.ovh.net (Postfix) with ESMTP id 24A0424641 for <62443@debbugs.gnu.org>; Sat, 25 Mar 2023 15:32:29 +0000 (UTC) Received: from ghost-submission-6684bf9d7b-wpl9d (unknown [10.110.171.1]) by director2.ghost.mail-out.ovh.net (Postfix) with ESMTPS id 8AB871FD83; Sat, 25 Mar 2023 15:32:29 +0000 (UTC) Received: from ngraves.fr ([37.59.142.105]) by ghost-submission-6684bf9d7b-wpl9d with ESMTPSA id pgB1Gw0UH2Q8sTYA+2z0Pg (envelope-from ); Sat, 25 Mar 2023 15:32:29 +0000 Authentication-Results: garm.ovh; auth=pass (GARM-105G0065630b9cf-cf54-4d94-9992-27b536c367a9, 6FD3C7460AE388A97E4C058CE803011BF627B91A) smtp.auth=ngraves@ngraves.fr X-OVh-ClientIp: 90.45.24.108 From: Nicolas Graves To: 62443@debbugs.gnu.org Subject: [PATCH 1/3] gnu: Add sentencepiece. Date: Sat, 25 Mar 2023 16:32:18 +0100 Message-Id: <20230325153220.26027-1-ngraves@ngraves.fr> X-Mailer: git-send-email 2.39.2 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Ovh-Tracer-Id: 1444811059201434338 X-VR-SPAMSTATE: OK X-VR-SPAMSCORE: 0 X-VR-SPAMCAUSE: gggruggvucftvghtrhhoucdtuddrgedvhedrvdegkedgjeelucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecuqfggjfdpvefjgfevmfevgfenuceurghilhhouhhtmecuhedttdenucenucfjughrpefhvfevufffkffoggfgsedtkeertdertddtnecuhfhrohhmpefpihgtohhlrghsucfirhgrvhgvshcuoehnghhrrghvvghssehnghhrrghvvghsrdhfrheqnecuggftrfgrthhtvghrnhepteeffefhfffhjeevleeuvdehgffgveekheeuhfekhfehuefgheffhedugfegleeinecuffhomhgrihhnpehgihhthhhusgdrtghomhenucfkphepuddvjedrtddrtddruddpfeejrdehledrudegvddruddtheenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepihhnvghtpeduvdejrddtrddtrddupdhmrghilhhfrhhomhepoehnghhrrghvvghssehnghhrrghvvghsrdhfrheqpdhnsggprhgtphhtthhopedupdhrtghpthhtohepiedvgeegfeesuggvsggsuhhgshdrghhnuhdrohhrghdpoffvtefjohhsthepmhhoheekvddpmhhouggvpehsmhhtphhouhht X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 62443 Cc: ngraves@ngraves.fr X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) * gnu/packages/machine-learning.scm (sentencepiece): New variable. --- gnu/packages/machine-learning.scm | 27 +++++++++++++++++++++++++++ 1 file changed, 27 insertions(+) diff --git a/gnu/packages/machine-learning.scm b/gnu/packages/machine-learning.scm index 37d4ef78ad..f6996af77b 100644 --- a/gnu/packages/machine-learning.scm +++ b/gnu/packages/machine-learning.scm @@ -583,6 +583,33 @@ (define openfst-for-vosk '("--enable-shared" "--enable-far" "--enable-ngram-fsts" "--enable-lookahead-fsts" "--with-pic" "--disable-bin"))))) +(define-public sentencepiece + (package + (name "sentencepiece") + (version "0.1.97") + (source + (origin + (method git-fetch) + (uri (git-reference + (url "https://github.com/google/sentencepiece") + (commit (string-append "v" version)))) + (file-name (git-file-name name version)) + (sha256 + (base32 "1kzfkp2pk0vabyw3wmkh16h11chzq63mzc20ddhsag5fp6s91ajg")))) + (build-system cmake-build-system) + (arguments '(#:tests? #f)) + (native-inputs (list gperftools)) + (home-page "https://github.com/google/sentencepiece") + (synopsis "Unsupervised tokenizer for Neural Network-based text generation") + (description "SentencePiece is an unsupervised text tokenizer and +detokenizer mainly for Neural Network-based text generation systems where the +vocabulary size is predetermined prior to the neural model training. +SentencePiece implements subword units (e.g., byte-pair-encoding +(BPE) and unigram language model) with the extension of direct training from +raw sentences. SentencePiece allows us to make a purely end-to-end system +that does not depend on language-specific pre/postprocessing.") + (license license:asl2.0))) + (define-public shogun (package (name "shogun") -- 2.39.2 From debbugs-submit-bounces@debbugs.gnu.org Sat Mar 25 11:32:39 2023 Received: (at 62443) by debbugs.gnu.org; 25 Mar 2023 15:32:40 +0000 Received: from localhost ([127.0.0.1]:43268 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pg5sl-0001o5-Jy for submit@debbugs.gnu.org; Sat, 25 Mar 2023 11:32:39 -0400 Received: from 9.mo575.mail-out.ovh.net ([46.105.78.111]:42889) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pg5si-0001nh-82 for 62443@debbugs.gnu.org; Sat, 25 Mar 2023 11:32:37 -0400 Received: from director6.ghost.mail-out.ovh.net (unknown [10.109.143.146]) by mo575.mail-out.ovh.net (Postfix) with ESMTP id 47E60244B7 for <62443@debbugs.gnu.org>; Sat, 25 Mar 2023 15:32:33 +0000 (UTC) Received: from ghost-submission-6684bf9d7b-4924x (unknown [10.110.115.102]) by director6.ghost.mail-out.ovh.net (Postfix) with ESMTPS id B44A51FDCE; Sat, 25 Mar 2023 15:32:31 +0000 (UTC) Received: from ngraves.fr ([37.59.142.107]) by ghost-submission-6684bf9d7b-4924x with ESMTPSA id AdqMMA8UH2Rk3QEAlXm1Hw (envelope-from ); Sat, 25 Mar 2023 15:32:31 +0000 Authentication-Results: garm.ovh; auth=pass (GARM-107S001a076da55-dad2-4593-ba9e-2851fd1916e4, 6FD3C7460AE388A97E4C058CE803011BF627B91A) smtp.auth=ngraves@ngraves.fr X-OVh-ClientIp: 90.45.24.108 From: Nicolas Graves To: 62443@debbugs.gnu.org Subject: [PATCH 2/3] gnu: Add python-sentencepiece. Date: Sat, 25 Mar 2023 16:32:19 +0100 Message-Id: <20230325153220.26027-2-ngraves@ngraves.fr> X-Mailer: git-send-email 2.39.2 In-Reply-To: <20230325153220.26027-1-ngraves@ngraves.fr> References: <20230325153220.26027-1-ngraves@ngraves.fr> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Ovh-Tracer-Id: 1445936955928732386 X-VR-SPAMSTATE: OK X-VR-SPAMSCORE: 0 X-VR-SPAMCAUSE: gggruggvucftvghtrhhoucdtuddrgedvhedrvdegkedgjeelucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecuqfggjfdpvefjgfevmfevgfenuceurghilhhouhhtmecuhedttdenucenucfjughrpefhvfevufffkffojghfggfgsedtkeertdertddtnecuhfhrohhmpefpihgtohhlrghsucfirhgrvhgvshcuoehnghhrrghvvghssehnghhrrghvvghsrdhfrheqnecuggftrfgrthhtvghrnhepvdehleeiffehtedvlefhffffjeefgfduhfetkeevheeiteduiedugfekuedtheejnecuffhomhgrihhnpehgihhthhhusgdrtghomhenucfkphepuddvjedrtddrtddruddpfeejrdehledrudegvddruddtjeenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepihhnvghtpeduvdejrddtrddtrddupdhmrghilhhfrhhomhepoehnghhrrghvvghssehnghhrrghvvghsrdhfrheqpdhnsggprhgtphhtthhopedupdhrtghpthhtohepiedvgeegfeesuggvsggsuhhgshdrghhnuhdrohhrghdpoffvtefjohhsthepmhhoheejhedpmhhouggvpehsmhhtphhouhht X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 62443 Cc: ngraves@ngraves.fr X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) * gnu/packages/machine-learning.scm (python-sentencepiece): New variable. --- gnu/packages/machine-learning.scm | 19 +++++++++++++++++++ 1 file changed, 19 insertions(+) diff --git a/gnu/packages/machine-learning.scm b/gnu/packages/machine-learning.scm index f6996af77b..df1989d316 100644 --- a/gnu/packages/machine-learning.scm +++ b/gnu/packages/machine-learning.scm @@ -610,6 +610,25 @@ (define-public sentencepiece that does not depend on language-specific pre/postprocessing.") (license license:asl2.0))) +(define-public python-sentencepiece + (package + (name "python-sentencepiece") + (version "0.1.97") + (source + (origin + (method url-fetch) + (uri (pypi-uri "sentencepiece" version)) + (sha256 + (base32 "0v0z9ryl66432zajp099bcbnwkkldzlpjvgnjv9bq2vi19g300f9")))) + (build-system python-build-system) + (propagated-inputs (list sentencepiece)) + (native-inputs (list pkg-config)) + (home-page "https://github.com/google/sentencepiece") + (synopsis "SentencePiece python wrapper") + (description "This package provides a python wrapper for the SentencePiece +unsupervised text tokenizer.") + (license license:asl2.0))) + (define-public shogun (package (name "shogun") -- 2.39.2 From debbugs-submit-bounces@debbugs.gnu.org Sat Mar 25 11:32:40 2023 Received: (at 62443) by debbugs.gnu.org; 25 Mar 2023 15:32:40 +0000 Received: from localhost ([127.0.0.1]:43270 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pg5sl-0001o7-Vp for submit@debbugs.gnu.org; Sat, 25 Mar 2023 11:32:40 -0400 Received: from 3.mo576.mail-out.ovh.net ([188.165.52.203]:41773) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pg5si-0001nj-Gl for 62443@debbugs.gnu.org; Sat, 25 Mar 2023 11:32:37 -0400 Received: from director5.ghost.mail-out.ovh.net (unknown [10.108.1.68]) by mo576.mail-out.ovh.net (Postfix) with ESMTP id 0D2E9240BE for <62443@debbugs.gnu.org>; Sat, 25 Mar 2023 15:32:34 +0000 (UTC) Received: from ghost-submission-6684bf9d7b-qsfm8 (unknown [10.110.115.59]) by director5.ghost.mail-out.ovh.net (Postfix) with ESMTPS id 83D181FD5A; Sat, 25 Mar 2023 15:32:34 +0000 (UTC) Received: from ngraves.fr ([37.59.142.108]) by ghost-submission-6684bf9d7b-qsfm8 with ESMTPSA id OzTnGBIUH2Qh/wEA0T1X6A (envelope-from ); Sat, 25 Mar 2023 15:32:34 +0000 Authentication-Results: garm.ovh; auth=pass (GARM-108S002d70db66a-80e7-41ba-942b-74fc6b9a0b85, 6FD3C7460AE388A97E4C058CE803011BF627B91A) smtp.auth=ngraves@ngraves.fr X-OVh-ClientIp: 90.45.24.108 From: Nicolas Graves To: 62443@debbugs.gnu.org Subject: [PATCH 3/3] gnu: Add llama-cpp. Date: Sat, 25 Mar 2023 16:32:20 +0100 Message-Id: <20230325153220.26027-3-ngraves@ngraves.fr> X-Mailer: git-send-email 2.39.2 In-Reply-To: <20230325153220.26027-1-ngraves@ngraves.fr> References: <20230325153220.26027-1-ngraves@ngraves.fr> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Ovh-Tracer-Id: 1446218431806431970 X-VR-SPAMSTATE: OK X-VR-SPAMSCORE: 0 X-VR-SPAMCAUSE: gggruggvucftvghtrhhoucdtuddrgedvhedrvdegkedgjeelucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecuqfggjfdpvefjgfevmfevgfenuceurghilhhouhhtmecuhedttdenucenucfjughrpefhvfevufffkffojghfggfgsedtkeertdertddtnecuhfhrohhmpefpihgtohhlrghsucfirhgrvhgvshcuoehnghhrrghvvghssehnghhrrghvvghsrdhfrheqnecuggftrfgrthhtvghrnhepvdehleeiffehtedvlefhffffjeefgfduhfetkeevheeiteduiedugfekuedtheejnecuffhomhgrihhnpehgihhthhhusgdrtghomhenucfkphepuddvjedrtddrtddruddpfeejrdehledrudegvddruddtkeenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepihhnvghtpeduvdejrddtrddtrddupdhmrghilhhfrhhomhepoehnghhrrghvvghssehnghhrrghvvghsrdhfrheqpdhnsggprhgtphhtthhopedupdhrtghpthhtohepiedvgeegfeesuggvsggsuhhgshdrghhnuhdrohhrghdpoffvtefjohhsthepmhhoheejiedpmhhouggvpehsmhhtphhouhht X-Spam-Score: 1.3 (+) X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see the administrator of that system for details. Content preview: * gnu/packages/machine-learning.scm (llama-cpp): New variable. --- gnu/packages/machine-learning.scm | 64 +++++++++++++++++++++++++++++++ 1 file changed, 64 insertions(+) diff --git a/gnu/packages/machine-learning.scm b/gnu/packages/machine-learning.scm index df1989d316..6c78b14fc6 100644 --- a/gnu/packages/machine-learning.scm +++ b/gnu/packages/machine-learning.scm @ [...] Content analysis details: (1.3 points, 10.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- 1.3 RCVD_IN_VALIDITY_RPBL RBL: Relay in Validity RPBL, https://senderscore.org/blocklistlookup/ [188.165.52.203 listed in bl.score.senderscore.com] 0.0 SPF_HELO_NONE SPF: HELO does not publish an SPF Record -0.0 RCVD_IN_MSPIKE_H2 RBL: Average reputation (+2) [188.165.52.203 listed in wl.mailspike.net] -0.0 RCVD_IN_DNSWL_NONE RBL: Sender listed at https://www.dnswl.org/, no trust [188.165.52.203 listed in list.dnswl.org] -0.0 SPF_PASS SPF: sender matches SPF record X-Debbugs-Envelope-To: 62443 Cc: ngraves@ngraves.fr X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 0.3 (/) * gnu/packages/machine-learning.scm (llama-cpp): New variable. --- gnu/packages/machine-learning.scm | 64 +++++++++++++++++++++++++++++++ 1 file changed, 64 insertions(+) diff --git a/gnu/packages/machine-learning.scm b/gnu/packages/machine-learning.scm index df1989d316..6c78b14fc6 100644 --- a/gnu/packages/machine-learning.scm +++ b/gnu/packages/machine-learning.scm @@ -400,6 +400,70 @@ (define-public guile-aiscm (define-public guile-aiscm-next (deprecated-package "guile-aiscm-next" guile-aiscm)) +(define-public llama-cpp + (let ((commit "3cd8dde0d1357b7f11bdd25c45d5bf5e97e284a0") + (revision "0")) + (package + (name "llama-cpp") + (version (git-version "0.0.0" revision commit)) + (source + (origin + (method git-fetch) + (uri (git-reference + (url "https://github.com/ggerganov/llama.cpp") + (commit (string-append "master-" (string-take commit 7))))) + (file-name (git-file-name name version)) + (sha256 + (base32 "0i7c92cxqs31xklrn688978kk29agivgxjgvsb45wzm65gc6hm5c")))) + (build-system cmake-build-system) + (arguments + (list + #:modules '((ice-9 textual-ports) + (guix build utils) + ((guix build python-build-system) #:prefix python:) + (guix build cmake-build-system)) + #:imported-modules `(,@%cmake-build-system-modules + (guix build python-build-system)) + #:phases + #~(modify-phases %standard-phases + (add-before 'install 'install-python-scripts + (lambda _ + (let ((bin (string-append #$output "/bin/"))) + (define (make-script script) + (let ((suffix (if (string-suffix? ".py" script) "" ".py"))) + (call-with-input-file + (string-append "../source/" script suffix) + (lambda (input) + (call-with-output-file (string-append bin script) + (lambda (output) + (format output "#!~a/bin/python3\n~a" + #$(this-package-input "python") + (get-string-all input)))))) + (chmod (string-append bin script) #o555))) + (mkdir-p bin) + (make-script "convert-pth-to-ggml") + (make-script "convert-gptq-to-ggml") + (make-script "quantize.py") + (substitute* (string-append bin "quantize.py") + (("os\\.getcwd\\(\\), quantize_script_binary") + (string-append "\"" bin "\", quantize_script_binary")))))) + (add-after 'install-python-scripts 'wrap-python-scripts + (assoc-ref python:%standard-phases 'wrap)) + (replace 'install + (lambda _ + (let ((bin (string-append #$output "/bin/"))) + (install-file "bin/quantize" bin) + (copy-file "bin/main" (string-append bin "llama")))))))) + (propagated-inputs + (list python-pytorch python-sentencepiece python-numpy)) + (inputs (list python)) + (home-page "https://github.com/ggerganov/llama.cpp") + (synopsis "Port of Facebook's LLaMA model in C/C++") + (description "This package provides a port to Facebook's LLaMA collection +of foundation language models. It requires models parameters to be downloaded +independently to be able to run a LLaMA model.") + (license license:expat)))) + (define-public mcl (package (name "mcl") -- 2.39.2 From debbugs-submit-bounces@debbugs.gnu.org Thu Mar 30 19:00:16 2023 Received: (at control) by debbugs.gnu.org; 30 Mar 2023 23:00:16 +0000 Received: from localhost ([127.0.0.1]:59814 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pi1Fg-0005Sr-1G for submit@debbugs.gnu.org; Thu, 30 Mar 2023 19:00:16 -0400 Received: from smtpm1.myservices.hosting ([185.26.105.232]:37158) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pi1Ff-0005Sk-1j for control@debbugs.gnu.org; Thu, 30 Mar 2023 19:00:15 -0400 Received: from mail1.netim.hosting (unknown [185.26.106.173]) by smtpm1.myservices.hosting (Postfix) with ESMTP id 1B898207FC for ; Fri, 31 Mar 2023 01:00:13 +0200 (CEST) Received: from localhost (localhost [127.0.0.1]) by mail1.netim.hosting (Postfix) with ESMTP id A3D0B8009A for ; Fri, 31 Mar 2023 01:00:10 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at mail1.netim.hosting Received: from mail1.netim.hosting ([127.0.0.1]) by localhost (mail1-2.netim.hosting [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id quAab374MQkf for ; Fri, 31 Mar 2023 01:00:10 +0200 (CEST) Received: from [192.168.1.239] (unknown [10.192.1.83]) (Authenticated sender: lumen@makinata.eu) by mail1.netim.hosting (Postfix) with ESMTPSA id 53A0380098 for ; Fri, 31 Mar 2023 01:00:10 +0200 (CEST) Message-ID: <74912071-f536-c8bc-4711-db295b4da0e6@makinata.eu> Date: Fri, 31 Mar 2023 00:00:01 +0100 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.9.0 Content-Language: en-US To: control From: Bruno Victal Subject: control-msg Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) # done with 5c131aff691fa1cb0fafe71b5f2795902ae056a7 close 55819 # control fail? close 45449 # no longer relevant close 33078 # tags tags 62551 patch tags 62503 patch tags 62461 patch tags 62443 patch tags 62428 patch tags 61226 patch tags 59893 patch tags 59852 patch tags 49451 patch tags 49207 patch tags 44258 patch quit From debbugs-submit-bounces@debbugs.gnu.org Sat Apr 08 08:07:33 2023 Received: (at submit) by debbugs.gnu.org; 8 Apr 2023 12:07:33 +0000 Received: from localhost ([127.0.0.1]:57861 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pl7Lx-00074r-4D for submit@debbugs.gnu.org; Sat, 08 Apr 2023 08:07:33 -0400 Received: from lists.gnu.org ([209.51.188.17]:57706) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1pl7Lu-00074b-JH for submit@debbugs.gnu.org; Sat, 08 Apr 2023 08:07:30 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pl7Lu-0002EQ-CP for guix-patches@gnu.org; Sat, 08 Apr 2023 08:07:30 -0400 Received: from relay1-d.mail.gandi.net ([2001:4b98:dc4:8::221]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pl7Lt-0005ZZ-0m for guix-patches@gnu.org; Sat, 08 Apr 2023 08:07:30 -0400 Received: (Authenticated sender: admin@nicolasgoaziou.fr) by mail.gandi.net (Postfix) with ESMTPSA id A79D3240002; Sat, 8 Apr 2023 12:07:23 +0000 (UTC) From: Nicolas Goaziou To: Nicolas Graves via Guix-patches via Subject: Re: [bug#62443] LLaMA.cpp References: <875yaoc1nj.fsf@ngraves.fr> Date: Sat, 08 Apr 2023 14:07:22 +0200 In-Reply-To: <875yaoc1nj.fsf@ngraves.fr> (Nicolas Graves via Guix-patches via's message of "Sat, 25 Mar 2023 16:05:04 +0100") Message-ID: <87v8i6lgqt.fsf@nicolasgoaziou.fr> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain Received-SPF: pass client-ip=2001:4b98:dc4:8::221; envelope-from=mail@nicolasgoaziou.fr; helo=relay1-d.mail.gandi.net X-Spam_score_int: -25 X-Spam_score: -2.6 X-Spam_bar: -- X-Spam_report: (-2.6 / 5.0 requ) BAYES_00=-1.9, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -1.6 (-) X-Debbugs-Envelope-To: submit Cc: Nicolas Graves , 62443-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.6 (--) Hello, Nicolas Graves via Guix-patches via writes: > Here are 3 patches introducing the LLaMA CPP implementation. Since > weights are available as torrent download, this makes the whole model > usable with a local config. Applied. Thank you. Regards, -- Nicolas Goaziou From unknown Fri Jun 20 19:52:54 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Sun, 07 May 2023 11:24:06 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator