From unknown Fri Jun 20 07:22:58 2025 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.509 (Entity 5.509) Content-Type: text/plain; charset=utf-8 From: bug#68455 <68455@debbugs.gnu.org> To: bug#68455 <68455@debbugs.gnu.org> Subject: Status: [PATCH] gnu: llama-cpp: Update to 1873. Reply-To: bug#68455 <68455@debbugs.gnu.org> Date: Fri, 20 Jun 2025 14:22:58 +0000 retitle 68455 [PATCH] gnu: llama-cpp: Update to 1873. reassign 68455 guix-patches submitter 68455 David Pflug severity 68455 normal tag 68455 patch thanks From debbugs-submit-bounces@debbugs.gnu.org Sun Jan 14 15:33:46 2024 Received: (at submit) by debbugs.gnu.org; 14 Jan 2024 20:33:46 +0000 Received: from localhost ([127.0.0.1]:44130 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1rP7Aw-0003ps-1r for submit@debbugs.gnu.org; Sun, 14 Jan 2024 15:33:46 -0500 Received: from lists.gnu.org ([2001:470:142::17]:53944) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1rP7As-0003pe-Or for submit@debbugs.gnu.org; Sun, 14 Jan 2024 15:33:44 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rP7An-0006AL-MY for guix-patches@gnu.org; Sun, 14 Jan 2024 15:33:37 -0500 Received: from mail-yw1-x112f.google.com ([2607:f8b0:4864:20::112f]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1rP7Al-0005WB-HA for guix-patches@gnu.org; Sun, 14 Jan 2024 15:33:37 -0500 Received: by mail-yw1-x112f.google.com with SMTP id 00721157ae682-5edfcba97e3so85198057b3.2 for ; Sun, 14 Jan 2024 12:33:34 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tpflug-com.20230601.gappssmtp.com; s=20230601; t=1705264413; x=1705869213; darn=gnu.org; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=3KCupbun9P+ig6od2iEITjV79dNbwvuswU9yKmLDQeg=; b=yB+sHgrdAoxOEszdYGS2neVE4675u6qH1tObJGZun7iLVq9BNJ8wDGZDbFq/LuMafk t4YWB/ZVUNMt9Xx2owAIM+DNr/e+itkQYCTqSPOw9FQtYL0TdSQO0WRcHU5cMiaowcpM wCuKM+vLumNUwNVYy8dmvQBrKJaU4YPvP9xCqpnUDjVgm1szBMu/roBItVFeLQPwerXN /MFxf6bFv/J/IZKzUepZK9BtR//YqLj2x6S50yVG84stRKA1cgqG4JR3kbvpk9RcEWw2 6Gj6KHCP6k9vd/0uQyf7MK9FgPlbjsEwi/FK6jK6IybLA5dzKsk/EbSJJWj1W/YQ26jv 2X5A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1705264413; x=1705869213; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=3KCupbun9P+ig6od2iEITjV79dNbwvuswU9yKmLDQeg=; b=NAsrc2U6HBWqFUTS9qWRso+aKt49xgYegmRG5YPAv5TbOkdwWBqNeD0Ct1hh1njdOL ZRa2xJC++j9nyb2hKBVF2z5PMEjldJjUK2LetZdpx/LsDTU/QsZtxE9VCpkUDRdtnSv0 3w19H4HGSDzB3Jsx8BOBpw2hxRZuV4VcKEctFEiWxYCTFY3di8nrfUpPAOTlEyWk8KRz oiryAqVwLotNjpuSDSZZAlV2zHbALtl0TVlwkauwzTdfuOb7oqZvBy1IKiR61gK3utEj 7s0HDL8gOEKhCHrkMRLmLCoLWQdU5VKY+qnkMFREH88gltX3wwIJAhTG1wq4mNQWiGyU FgSg== X-Gm-Message-State: AOJu0YwAKP2rGqciA4kk1xv70gkgXa8UZEYe4YTEo2/uoFexlM/TrF+3 SPt7/o+osaNEzV4xEnmofOimdQn1TrI9IfwOrXjlEs/8nYI= X-Google-Smtp-Source: AGHT+IH13l+30ZB7JlUxpx5E0tCXSQeKdz6rUx6IY6z5yR/+QXuPH/Wx1+oueUPS8VbUQ6Fdw8L20A== X-Received: by 2002:a05:690c:b08:b0:5ee:381a:3b33 with SMTP id cj8-20020a05690c0b0800b005ee381a3b33mr3485154ywb.94.1705264412860; Sun, 14 Jan 2024 12:33:32 -0800 (PST) Received: from localhost.localdomain (2603-9001-0600-4cc0-6e0b-84ff-fe93-fcd5.inf6.spectrum.com. [2603:9001:600:4cc0:6e0b:84ff:fe93:fcd5]) by smtp.gmail.com with ESMTPSA id cn7-20020a05690c0d0700b005f445345522sm3376470ywb.3.2024.01.14.12.33.31 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 14 Jan 2024 12:33:32 -0800 (PST) From: David Pflug To: guix-patches@gnu.org Subject: [PATCH] gnu: llama-cpp: Update to 1873. Date: Sun, 14 Jan 2024 15:32:45 -0500 Message-ID: <20240114203255.26500-1-david@pflug.io> X-Mailer: git-send-email 2.41.0 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Received-SPF: pass client-ip=2607:f8b0:4864:20::112f; envelope-from=david@tpflug.com; helo=mail-yw1-x112f.google.com X-Spam_score_int: -15 X-Spam_score: -1.6 X-Spam_bar: - X-Spam_report: (-1.6 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.249, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01, URIBL_SBL_A=0.1 autolearn=no autolearn_force=no X-Spam_action: no action X-Spam-Score: 2.0 (++) X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see the administrator of that system for details. Content preview: * gnu/packages/machine-learning.scm (llama-cpp): Update to 1873. Change-Id: I091cd20192743c87b497ea3c5fd18a75ada75d9d --- gnu/packages/machine-learning.scm | 133 ++++++++++++++++++ 1 file changed, 78 insertions(+), 55 deletions(-) Content analysis details: (2.0 points, 10.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- 0.1 URIBL_SBL_A Contains URL's A record listed in the Spamhaus SBL blocklist [URIs: ggml.ai] 0.6 URIBL_SBL Contains an URL's NS IP listed in the Spamhaus SBL blocklist [URIs: ggml.ai] 0.2 HEADER_FROM_DIFFERENT_DOMAINS From and EnvelopeFrom 2nd level mail domains are different -0.0 SPF_HELO_PASS SPF: HELO matches SPF record 1.0 SPF_SOFTFAIL SPF: sender does not match SPF record (softfail) -0.0 T_SCC_BODY_TEXT_LINE No description available. X-Debbugs-Envelope-To: submit Cc: David Pflug X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: 1.0 (+) * gnu/packages/machine-learning.scm (llama-cpp): Update to 1873. Change-Id: I091cd20192743c87b497ea3c5fd18a75ada75d9d --- gnu/packages/machine-learning.scm | 133 ++++++++++++++++++------------ 1 file changed, 78 insertions(+), 55 deletions(-) diff --git a/gnu/packages/machine-learning.scm b/gnu/packages/machine-learning.scm index 1616738399..0cdfe7bb08 100644 --- a/gnu/packages/machine-learning.scm +++ b/gnu/packages/machine-learning.scm @@ -22,6 +22,7 @@ ;;; Copyright © 2023 Navid Afkhami ;;; Copyright © 2023 Zheng Junjie <873216071@qq.com> ;;; Copyright © 2023 Troy Figiel +;;; Copyright © 2023 David Pflug ;;; ;;; This file is part of GNU Guix. ;;; @@ -517,63 +518,63 @@ (define-public guile-aiscm-next (deprecated-package "guile-aiscm-next" guile-aiscm)) (define-public llama-cpp - (let ((commit "f31b5397143009d682db90fd2a6cde83f1ef00eb") - (revision "0")) - (package - (name "llama-cpp") - (version (git-version "0.0.0" revision commit)) - (source - (origin - (method git-fetch) - (uri (git-reference - (url "https://github.com/ggerganov/llama.cpp") - (commit (string-append "master-" (string-take commit 7))))) - (file-name (git-file-name name version)) - (sha256 - (base32 "0ys6n53n032zq1ll9f3vgxk8sw0qq7x3fi7awsyy13adzp3hn08p")))) - (build-system cmake-build-system) - (arguments - (list - #:modules '((ice-9 textual-ports) - (guix build utils) - ((guix build python-build-system) #:prefix python:) - (guix build cmake-build-system)) - #:imported-modules `(,@%cmake-build-system-modules - (guix build python-build-system)) - #:phases - #~(modify-phases %standard-phases - (add-before 'install 'install-python-scripts - (lambda _ - (let ((bin (string-append #$output "/bin/"))) - (define (make-script script) - (let ((suffix (if (string-suffix? ".py" script) "" ".py"))) - (call-with-input-file - (string-append "../source/" script suffix) - (lambda (input) - (call-with-output-file (string-append bin script) - (lambda (output) - (format output "#!~a/bin/python3\n~a" - #$(this-package-input "python") - (get-string-all input)))))) - (chmod (string-append bin script) #o555))) - (mkdir-p bin) - (make-script "convert-pth-to-ggml") - (make-script "convert-lora-to-ggml") - (make-script "convert")))) - (add-after 'install-python-scripts 'wrap-python-scripts - (assoc-ref python:%standard-phases 'wrap)) - (replace 'install - (lambda _ - (copy-file "bin/main" (string-append #$output "/bin/llama"))))))) - (inputs (list python)) - (propagated-inputs - (list python-numpy python-pytorch python-sentencepiece)) - (home-page "https://github.com/ggerganov/llama.cpp") - (synopsis "Port of Facebook's LLaMA model in C/C++") - (description "This package provides a port to Facebook's LLaMA collection + (package + (name "llama-cpp") + (version "1873") + (source + (origin + (method git-fetch) + (uri (git-reference + (url "https://github.com/ggerganov/llama.cpp") + (commit (string-append "b" version)))) + (file-name (git-file-name name version)) + (sha256 + (base32 "11may9gkafg5bfma5incijvkypjgx9778gmygxp3x2dz1140809d")))) + (build-system cmake-build-system) + (arguments + (list + #:modules '((ice-9 textual-ports) + (guix build utils) + ((guix build python-build-system) #:prefix python:) + (guix build cmake-build-system)) + #:imported-modules `(,@%cmake-build-system-modules + (guix build python-build-system)) + #:phases + #~(modify-phases %standard-phases + (add-before 'install 'install-python-scripts + (lambda _ + (let ((bin (string-append #$output "/bin/"))) + (define (make-script script) + (let ((suffix (if (string-suffix? ".py" script) "" ".py"))) + (call-with-input-file + (string-append "../source/" script suffix) + (lambda (input) + (call-with-output-file (string-append bin script) + (lambda (output) + (format output "#!~a/bin/python3\n~a" + #$(this-package-input "python") + (get-string-all input)))))) + (chmod (string-append bin script) #o555))) + (mkdir-p bin) + (make-script "convert-hf-to-gguf") + (make-script "convert-llama-ggml-to-gguf") + (make-script "convert-lora-to-ggml") + (make-script "convert-persimmon-to-gguf") + (make-script "convert")))) + (add-after 'install-python-scripts 'wrap-python-scripts + (assoc-ref python:%standard-phases 'wrap)) + (replace 'install + (lambda _ + (copy-file "bin/main" (string-append #$output "/bin/llama"))))))) + (inputs (list python)) + (propagated-inputs + (list python-numpy python-pytorch python-sentencepiece python-gguf)) + (home-page "https://github.com/ggerganov/llama.cpp") + (synopsis "Port of Facebook's LLaMA model in C/C++") + (description "This package provides a port to Facebook's LLaMA collection of foundation language models. It requires models parameters to be downloaded independently to be able to run a LLaMA model.") - (license license:expat)))) + (license license:expat))) (define-public mcl (package @@ -5257,3 +5258,25 @@ (define-public oneapi-dnnl "OneAPI Deep Neural Network Library (oneDNN) is a cross-platform performance library of basic building blocks for deep learning applications.") (license license:asl2.0))) + +(define-public python-gguf + (package + (name "python-gguf") + (version "0.6.0") + (source + (origin + (method url-fetch) + (uri (pypi-uri "gguf" version)) + (sha256 + (base32 "0rbyc2h3kpqnrvbyjvv8a69l577jv55a31l12jnw21m1lamjxqmj")))) + (build-system pyproject-build-system) + (arguments + `(#:phases + (modify-phases %standard-phases + (delete 'check)))) + (inputs (list poetry python-pytest)) + (propagated-inputs (list python-numpy)) + (home-page "https://ggml.ai") + (synopsis "Read and write ML models in GGUF for GGML") + (description "Read and write ML models in GGUF for GGML") + (license license:expat))) base-commit: 18393fcdddf5c3d834fa89ebf5f3925fc5b166ed -- 2.41.0 From debbugs-submit-bounces@debbugs.gnu.org Wed Jan 17 12:29:46 2024 Received: (at 68455) by debbugs.gnu.org; 17 Jan 2024 17:29:46 +0000 Received: from localhost ([127.0.0.1]:53257 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1rQ9jV-0004ec-TF for submit@debbugs.gnu.org; Wed, 17 Jan 2024 12:29:46 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:46660) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1rQ9jU-0004eI-27 for 68455@debbugs.gnu.org; Wed, 17 Jan 2024 12:29:44 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rQ9jN-0003b1-BM; Wed, 17 Jan 2024 12:29:37 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=nNU9rzECqw4QNIasyvRu+jwaFQkb1hVX/nmgKrObsIQ=; b=d27/YtZbrR5QLoTu9d8V Uw0a80TxVs4n5jxUhwm0N/pJELefHHwYMUkRO06OKLOsiMCHWmzCeT0KDJPhDGXgaqftrrnYDfY6W wesViMwRhHtRGD0bVmklht/s9X6+JxyDDYpQqv6tGqTSc68JlY3JNNJZU9KEy9cUgaxyA6CTMUw2V 2h7j0EEpVpCjmUIv1MF3vbZ1APrufKrNnjSYsrpfCpUyeFMeg6vhaFQBy4wu+Lu+CNILNGaOVdlw5 Ppv3WdrtmQkEAT4RsBs++NTxJj07QjAYYKFQcb6FTXG4PPbClVCgv3kJwCuTvnwR9U41y403sCRTZ jInLeyl9gd8ZcQ==; From: Mathieu Othacehe To: David Pflug Subject: Re: [bug#68455] [PATCH] gnu: llama-cpp: Update to 1873. In-Reply-To: <20240114203255.26500-1-david@pflug.io> (David Pflug's message of "Sun, 14 Jan 2024 15:32:45 -0500") References: <20240114203255.26500-1-david@pflug.io> Date: Wed, 17 Jan 2024 18:29:35 +0100 Message-ID: <87o7djj2bk.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -1.6 (-) X-Debbugs-Envelope-To: 68455 Cc: 68455@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.6 (--) Hello David, > +(define-public python-gguf > + (package > + (name "python-gguf") > + (version "0.6.0") > + (source > + (origin > + (method url-fetch) > + (uri (pypi-uri "gguf" version)) > + (sha256 > + (base32 "0rbyc2h3kpqnrvbyjvv8a69l577jv55a31l12jnw21m1lamjxqmj")))) > + (build-system pyproject-build-system) > + (arguments > + `(#:phases > + (modify-phases %standard-phases > + (delete 'check)))) > + (inputs (list poetry python-pytest)) > + (propagated-inputs (list python-numpy)) > + (home-page "https://ggml.ai") > + (synopsis "Read and write ML models in GGUF for GGML") > + (description "Read and write ML models in GGUF for GGML") > + (license license:expat))) This should be part of a separate patch. Can you send a v2? Thanks, Mathieu From debbugs-submit-bounces@debbugs.gnu.org Fri Jan 26 07:21:42 2024 Received: (at 68455) by debbugs.gnu.org; 26 Jan 2024 12:21:42 +0000 Received: from localhost ([127.0.0.1]:50605 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1rTLDK-0004ae-3n for submit@debbugs.gnu.org; Fri, 26 Jan 2024 07:21:42 -0500 Received: from mail-ua1-x92b.google.com ([2607:f8b0:4864:20::92b]:51608) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1rTLDI-0004aP-Cr for 68455@debbugs.gnu.org; Fri, 26 Jan 2024 07:21:41 -0500 Received: by mail-ua1-x92b.google.com with SMTP id a1e0cc1a2514c-7d2e1a0337bso149247241.3 for <68455@debbugs.gnu.org>; Fri, 26 Jan 2024 04:21:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tpflug-com.20230601.gappssmtp.com; s=20230601; t=1706271687; x=1706876487; darn=debbugs.gnu.org; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=XZn10jdVCmsw6A0ehl/2OLgchbq4BGNZ6tssIna3fI0=; b=lSaLoYcFyo8oWDTDKVQPUOf9NZvfTBT4y2NM8JsfHe2XJao/At7iEPldFl9O8zIT1b PUSES/t+6Dr9CvRj7sDJeMzE8iPGm8gDIRlf9A9pQbnFyfRu4kvQhPeyVh8Vqkj5xyE4 Ujgk5vDhhvl3QVII09CK9qiJib4LFpNc4z2goaTZqSdCukxgSSRhW30mNLIbLNegwNus r/lb9ULp2qXcD4E7zaBTZzw0X4nrlZ/2AUbz6sdURdRFGngZ9cJlic5afvYJ7TmT6YMb xZtPwMfXKIEYncnqsAK3pqNf1bMyEuN69RFZmC0zzJy7p5vAwo6k34X+b6c+sFHp6+F5 zkQA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1706271687; x=1706876487; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=XZn10jdVCmsw6A0ehl/2OLgchbq4BGNZ6tssIna3fI0=; b=M8RHqlXMckSKeicxFQ0M8YyYTynaqednIYXRp7U7jPW2uhzpXjSsqyuQ9Vfzrp/aiw REJLClSuzVsW3uqVEuOhqBo6dRJpo03Jy0JZpo3pVy1ZjFodouUUUlqznKXTVcHLn8kN L6AUCG4pP4RM++OiLY/rGEhbOkZi+IfMzQMNYPDVa7NEV5Xq+Vzx5UlpiPbI/GnxxyTM JHKT8/NuKOTvJyikHg0yYmcKilFVJDlrpgSID1AJ6rBKOOKcn0RA+HnxNSmQtPCsA6rf mFYz0zRZnZO3HtUb5uxlVtjIS+HoyoDS+uiOHTvp3CSjmy9IRGhE4nOEevx1RsKYcVyt j80A== X-Gm-Message-State: AOJu0YzacF1PwMro3jyGniy4fQzNsVAlzu+ruKJDmYTqzqV/Tca+kdgw H23UyubmkJ8QwVZ684km3r7bWvFgqp2eYveDTBSgXtihuI1+bpO+OsQGmbra/AGlUZIup5Z8z/L b X-Google-Smtp-Source: AGHT+IGyrictmipIbQ3IHlA/aNxAm1ei6oOVNEzJtRc3/kznzphG93NnY+WcvXmduv5MQxQTgnmfUg== X-Received: by 2002:a05:6122:4782:b0:4b7:363d:89fd with SMTP id ee2-20020a056122478200b004b7363d89fdmr626441vkb.33.1706271686940; Fri, 26 Jan 2024 04:21:26 -0800 (PST) Received: from localhost.localdomain (2603-9001-0600-4cc0-6a05-caff-fe36-28a4.inf6.spectrum.com. [2603:9001:600:4cc0:6a05:caff:fe36:28a4]) by smtp.gmail.com with ESMTPSA id cb11-20020a056122408b00b004b71167e54dsm128174vkb.50.2024.01.26.04.21.25 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 26 Jan 2024 04:21:26 -0800 (PST) From: David Pflug To: 68455@debbugs.gnu.org Subject: [PATCH v2] gnu: llama-cpp: Update to 1873. Date: Fri, 26 Jan 2024 07:20:21 -0500 Message-ID: <20240126122110.10991-1-david@pflug.io> X-Mailer: git-send-email 2.41.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Score: 0.2 (/) X-Debbugs-Envelope-To: 68455 Cc: David Pflug X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.8 (/) * gnu/packages/machine-learning.scm (llama-cpp): Update to 1873. python-gguf added by #68735 Change-Id: I091cd20192743c87b497ea3c5fd18a75ada75d9d --- gnu/packages/machine-learning.scm | 110 +++++++++++++++--------------- 1 file changed, 55 insertions(+), 55 deletions(-) diff --git a/gnu/packages/machine-learning.scm b/gnu/packages/machine-learning.scm index 0e88f7265b..1d590d1c1b 100644 --- a/gnu/packages/machine-learning.scm +++ b/gnu/packages/machine-learning.scm @@ -519,63 +519,63 @@ (define-public guile-aiscm-next (deprecated-package "guile-aiscm-next" guile-aiscm)) (define-public llama-cpp - (let ((commit "f31b5397143009d682db90fd2a6cde83f1ef00eb") - (revision "0")) - (package - (name "llama-cpp") - (version (git-version "0.0.0" revision commit)) - (source - (origin - (method git-fetch) - (uri (git-reference - (url "https://github.com/ggerganov/llama.cpp") - (commit (string-append "master-" (string-take commit 7))))) - (file-name (git-file-name name version)) - (sha256 - (base32 "0ys6n53n032zq1ll9f3vgxk8sw0qq7x3fi7awsyy13adzp3hn08p")))) - (build-system cmake-build-system) - (arguments - (list - #:modules '((ice-9 textual-ports) - (guix build utils) - ((guix build python-build-system) #:prefix python:) - (guix build cmake-build-system)) - #:imported-modules `(,@%cmake-build-system-modules - (guix build python-build-system)) - #:phases - #~(modify-phases %standard-phases - (add-before 'install 'install-python-scripts - (lambda _ - (let ((bin (string-append #$output "/bin/"))) - (define (make-script script) - (let ((suffix (if (string-suffix? ".py" script) "" ".py"))) - (call-with-input-file - (string-append "../source/" script suffix) - (lambda (input) - (call-with-output-file (string-append bin script) - (lambda (output) - (format output "#!~a/bin/python3\n~a" - #$(this-package-input "python") - (get-string-all input)))))) - (chmod (string-append bin script) #o555))) - (mkdir-p bin) - (make-script "convert-pth-to-ggml") - (make-script "convert-lora-to-ggml") - (make-script "convert")))) - (add-after 'install-python-scripts 'wrap-python-scripts - (assoc-ref python:%standard-phases 'wrap)) - (replace 'install - (lambda _ - (copy-file "bin/main" (string-append #$output "/bin/llama"))))))) - (inputs (list python)) - (propagated-inputs - (list python-numpy python-pytorch python-sentencepiece)) - (home-page "https://github.com/ggerganov/llama.cpp") - (synopsis "Port of Facebook's LLaMA model in C/C++") - (description "This package provides a port to Facebook's LLaMA collection + (package + (name "llama-cpp") + (version "1873") + (source + (origin + (method git-fetch) + (uri (git-reference + (url "https://github.com/ggerganov/llama.cpp") + (commit (string-append "b" version)))) + (file-name (git-file-name name version)) + (sha256 + (base32 "11may9gkafg5bfma5incijvkypjgx9778gmygxp3x2dz1140809d")))) + (build-system cmake-build-system) + (arguments + (list + #:modules '((ice-9 textual-ports) + (guix build utils) + ((guix build python-build-system) #:prefix python:) + (guix build cmake-build-system)) + #:imported-modules `(,@%cmake-build-system-modules + (guix build python-build-system)) + #:phases + #~(modify-phases %standard-phases + (add-before 'install 'install-python-scripts + (lambda _ + (let ((bin (string-append #$output "/bin/"))) + (define (make-script script) + (let ((suffix (if (string-suffix? ".py" script) "" ".py"))) + (call-with-input-file + (string-append "../source/" script suffix) + (lambda (input) + (call-with-output-file (string-append bin script) + (lambda (output) + (format output "#!~a/bin/python3\n~a" + #$(this-package-input "python") + (get-string-all input)))))) + (chmod (string-append bin script) #o555))) + (mkdir-p bin) + (make-script "convert-hf-to-gguf") + (make-script "convert-llama-ggml-to-gguf") + (make-script "convert-lora-to-ggml") + (make-script "convert-persimmon-to-gguf") + (make-script "convert")))) + (add-after 'install-python-scripts 'wrap-python-scripts + (assoc-ref python:%standard-phases 'wrap)) + (replace 'install + (lambda _ + (copy-file "bin/main" (string-append #$output "/bin/llama"))))))) + (inputs (list python)) + (propagated-inputs + (list python-numpy python-pytorch python-sentencepiece python-gguf)) + (home-page "https://github.com/ggerganov/llama.cpp") + (synopsis "Port of Facebook's LLaMA model in C/C++") + (description "This package provides a port to Facebook's LLaMA collection of foundation language models. It requires models parameters to be downloaded independently to be able to run a LLaMA model.") - (license license:expat)))) + (license license:expat))) (define-public mcl (package base-commit: c5453fbfeb0dbd19cb402199fe1e5ad51a051e56 -- 2.41.0 From debbugs-submit-bounces@debbugs.gnu.org Fri Nov 22 20:27:51 2024 Received: (at 68455) by debbugs.gnu.org; 23 Nov 2024 01:27:51 +0000 Received: from localhost ([127.0.0.1]:56103 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1tEewA-0005t8-Pg for submit@debbugs.gnu.org; Fri, 22 Nov 2024 20:27:51 -0500 Received: from mail-wr1-f53.google.com ([209.85.221.53]:59687) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1tEew7-0005su-Ty for 68455@debbugs.gnu.org; Fri, 22 Nov 2024 20:27:49 -0500 Received: by mail-wr1-f53.google.com with SMTP id ffacd0b85a97d-382588b7a5cso1806210f8f.3 for <68455@debbugs.gnu.org>; Fri, 22 Nov 2024 17:27:47 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tpflug-com.20230601.gappssmtp.com; s=20230601; t=1732325206; x=1732930006; darn=debbugs.gnu.org; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=u+d/WU4FD2DlRAIJfckLJbrTk2MU/BOd9/p1sAbg3Fw=; b=AMNstkNypoURJxxwZ2SOHn7UhheanTSEjKfdt1RIezZglrxUaw3D+Rqz7PxSGg1Lft f6iU9aNZYZP61U4hDG/wnVQTOBBWmvlW3joYRvMJxezLoDOkPHr5lRL6S4YzHnhLd8Sh qqctvDUReNNroeweISE6D2KyaoVcLYhkMsYVzuagphono6jqjuNkxbXfZvqiIpjaKlhZ vujY1Cu/4a00qwKT3nKVWi6DKev+6rApglaIUAVJmK0LmxlECSCsdXuvpFmYqSLar6Qi HyaFxat2KvYLB5dln8Us6rBdciFqoOuSZyhJ2TF074xcKOLDIvrK51hHDMWV3MO4TwTR nm+Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1732325206; x=1732930006; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=u+d/WU4FD2DlRAIJfckLJbrTk2MU/BOd9/p1sAbg3Fw=; b=fIeaoVNLVbxq0Gyfgk01NaK7rJai42OoLJFz+ibDI4A1Un8oO6NySYu+ZF7XclBx5Y 9AudNBOivMak++1nGDTZ/5L5TsrMoiOrtmNk2o4/XVVP6cZcMui4NWCTktD+42ifQ3Fe 1J1oc+5i2+5WvOmEyqFSSN2yRKs36VhJ0K/RbOAs2pXxrhO3o7uAFJ+gIOOA70XK9T98 S8NVhIhbZuU9lbLF//4fvdoO3ZMDkik5oPDghiUTuxYiQq64EfuuK1HIayHMhBcUmB2G ciQlloY3WySw26s0BWSVxYSzu/yIA2CYPifh75nuh80jYkZ5rxcsEk0PknlRFSZmjcYB /E0w== X-Gm-Message-State: AOJu0Yzjj6BVbSYjoSS6f/d24w+DVAv0chvTT3UQvO5JEn8a9sq7WwHa cw5rp6I0i2rlSLSgZ3d20eW/8sDkKI405HK/LuKO4wHMB2Lhw+cUGvmHSVdbWdWeze24XNLf9oa BNFaH7huUtbzYlqg7uqDQrFvWxRCtYV1zALVBx6sUEtB/BR/WRsA= X-Gm-Gg: ASbGnctOqesTY9Vv/3QRHrnryeWPpVOMBwlRmX3RzfjQSzcI4oRrBnCmoj+hI0Q4rwz YIdaRjHHMxVdvulTkTkm2DCIs/IaEuZkqvtn5o5K+M8ImOXB1vD6+01ElNQx8g3nR X-Google-Smtp-Source: AGHT+IHK0glD3tAeiLov0quz7Si0ttEJwOInDZoC3Afgq5WDMSpuW0/NopW0vYB62XzHvvpmztnRKckwEK5jf4Sbcb0= X-Received: by 2002:a05:6000:178b:b0:382:488d:dfd1 with SMTP id ffacd0b85a97d-38260bcb8e6mr4309748f8f.44.1732325206507; Fri, 22 Nov 2024 17:26:46 -0800 (PST) MIME-Version: 1.0 From: David Pflug Date: Fri, 22 Nov 2024 20:26:35 -0500 Message-ID: Subject: Re: [bug#68455] [PATCH] gnu: llama-cpp: Update to 1873. To: 68455@debbugs.gnu.org Content-Type: text/plain; charset="UTF-8" X-Spam-Score: 0.3 (/) X-Debbugs-Envelope-To: 68455 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -0.7 (/) This can be closed. The package has moved on well beyond this commit. See #70883. Thanks, From debbugs-submit-bounces@debbugs.gnu.org Thu Dec 05 16:14:53 2024 Received: (at 68455-done) by debbugs.gnu.org; 5 Dec 2024 21:14:53 +0000 Received: from localhost ([127.0.0.1]:41180 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1tJJBV-0003l4-15 for submit@debbugs.gnu.org; Thu, 05 Dec 2024 16:14:53 -0500 Received: from mx0.riseup.net ([198.252.153.6]:38330) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1tJJBS-0003ko-7U for 68455-done@debbugs.gnu.org; Thu, 05 Dec 2024 16:14:51 -0500 Received: from fews02-sea.riseup.net (fews02-sea-pn.riseup.net [10.0.1.112]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mx0.riseup.net (Postfix) with ESMTPS id 4Y46bS20hzz9wgN; Thu, 5 Dec 2024 21:14:44 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=riseup.net; s=squak; t=1733433284; bh=HUTUaLVm2sR8g93B1tvdZtEWCv7wynV3GjLSVLcg+zU=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=kJJAqbSVnWi2f23NoivFFzuOXeF5jzkN1+rPZ4Jj9XNSgEt2hfiCEfp7sDhC2Xfmv htqOSkFKRdyjjTnAjie2QaWqy4824K/deMGPZiLDMn8rV6gEu6r7autpNobG7OLAmG /OCXZQURXr9hciJCPxzWQ6fjFUJSqj3oxXKQ058I= X-Riseup-User-ID: 452362E3D2D4D9E89DB7C199D74202D56AE9C37A69DBD8B7CFEB5B476C9A61D8 Received: from [127.0.0.1] (localhost [127.0.0.1]) by fews02-sea.riseup.net (Postfix) with ESMTPSA id 4Y46bR1yTSzFvFv; Thu, 5 Dec 2024 21:14:43 +0000 (UTC) Date: Thu, 5 Dec 2024 18:14:34 -0300 From: =?iso-8859-1?Q?Andr=E9?= Batista To: David Pflug Subject: Re: [bug#68455] Close. Message-ID: References: <20240114203255.26500-1-david@pflug.io> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Spam-Score: -0.7 (/) X-Debbugs-Envelope-To: 68455-done Cc: 68455-done@debbugs.gnu.org X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.7 (-) Hi David, sex 22 nov 2024 às 20:26:35 (1732317995), david@pflug.io enviou: > This can be closed. The package has moved on well beyond this commit. > See #70883. > You can close your own bug reports by adding "-done" in between the bug number and the "@" char on the email address, such as I've done here. See for more info. Thanks From unknown Fri Jun 20 07:22:58 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Fri, 03 Jan 2025 12:24:08 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator