GNU bug report logs - #31432
[PATCH 0/2] gnu: Add lightgbm and vowpal-wabbit.

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 31432 in the body.
You can then email your comments to 31432 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Fis Trivial <ybbs.daans <at> hotmail.com>
To: "guix-patches <at> gnu.org" <guix-patches <at> gnu.org>
Subject: [PATCH 0/2] gnu: Add lightgbm and vowpal-wabbit.
Date: Sat, 12 May 2018 15:19:06 +0000

Language bindings are not enabled for vowpal-wabbit, it requires
rewritting the build code. Anyway, it has a fully featured command line
interface, so the language bindings can wait.

GPU support is not enabled for lightgbm, as GUIX doesn't have GPU
toolchain. I put this in the package features description.

I will send the two packages in one thread although they are not related
in the dependency tree. If you prefer me to send those with different
thread, just tell me. :)

Message #8 received at 31432 <at> debbugs.gnu.org (full text, mbox):

From: Fis Trivial <ybbs.daans <at> hotmail.com>
To: "31432 <at> debbugs.gnu.org" <31432 <at> debbugs.gnu.org>
Subject: [PATCH 1/2] gnu: Add lightgbm.
Date: Sat, 12 May 2018 15:21:20 +0000

* gnu/packages/machine-learning.scm (lightgbm): New variable.
---
 gnu/packages/machine-learning.scm | 48 +++++++++++++++++++++++++++++++++++++++
 1 file changed, 48 insertions(+)

diff --git a/gnu/packages/machine-learning.scm b/gnu/packages/machine-learning.scm
index f0d35484e..ac4fa8129 100644
--- a/gnu/packages/machine-learning.scm
+++ b/gnu/packages/machine-learning.scm
@@ -45,6 +45,7 @@
   #:use-module (gnu packages gcc)
   #:use-module (gnu packages image)
   #:use-module (gnu packages maths)
+  #:use-module (gnu packages mpi)
   #:use-module (gnu packages ocaml)
   #:use-module (gnu packages perl)
   #:use-module (gnu packages pkg-config)
@@ -732,3 +733,50 @@ main intended application of Autograd is gradient-based optimization.")
 
 (define-public python2-autograd
   (package-with-python2 python-autograd))
+
+(define-public lightgbm
+  (package
+    (name "lightgbm")
+    (version "2.0.12")
+    (source (origin
+              (method url-fetch)
+              (uri (string-append
+                    "https://github.com/Microsoft/LightGBM/archive/v"
+                    version ".tar.gz"))
+              (sha256
+               (base32
+                "132zf0yk0545mg72hyzxm102g3hpb6ixx9hnf8zd2k55gas6cjj1"))
+              (file-name (string-append name "-" version ".tar.gz"))))
+    (native-inputs
+     `(("python-nose" ,python-nose)
+       ("python-pytest" ,python-pytest)))
+    (inputs
+     `(("openmpi" ,openmpi)))
+    (propagated-inputs
+     `(("python-numpy" ,python-numpy)
+       ("python-scipy" ,python-scipy)))
+    (arguments
+     `(#:configure-flags
+       '("-DUSE_MPI=ON")
+       #:phases
+       (modify-phases %standard-phases
+         (replace 'check
+           (lambda* (#:key outputs #:allow-other-keys)
+             (chdir "../LightGBM-2.0.12/")
+             (invoke "pytest" "tests/c_api_test/test_.py")
+             (chdir "../build"))))))
+    (build-system cmake-build-system)
+    (home-page "https://github.com/Microsoft/LightGBM")
+    (synopsis "Gradient boosting framework based on decision tree algorithms")
+    (description "LightGBM is a gradient boosting framework that uses tree
+based learning algorithms.  It is designed to be distributed and efficient with
+the following advantages:
+
+@itemize
+@item Faster training speed and higher efficiency
+@item Lower memory usage
+@item Better accuracy
+@item Parallel and GPU learning supported (not enabled in this package)
+@item Capable of handling large-scale data
+@end itemize\n")
+    (license license:expat)))
-- 
2.14.3

Message #11 received at 31432 <at> debbugs.gnu.org (full text, mbox):

From: Fis Trivial <ybbs.daans <at> hotmail.com>
To: "31432 <at> debbugs.gnu.org" <31432 <at> debbugs.gnu.org>
Subject: [PATCH 2/2] gnu: Add vowpal-wabbit.
Date: Sat, 12 May 2018 15:22:01 +0000

* gnu/packages/machine-learning.scm (vowpal-wabbit): New variable.
---
 gnu/packages/machine-learning.scm | 30 ++++++++++++++++++++++++++++++
 1 file changed, 30 insertions(+)

diff --git a/gnu/packages/machine-learning.scm b/gnu/packages/machine-learning.scm
index ac4fa8129..57e308e66 100644
--- a/gnu/packages/machine-learning.scm
+++ b/gnu/packages/machine-learning.scm
@@ -780,3 +780,33 @@ the following advantages:
 @item Capable of handling large-scale data
 @end itemize\n")
     (license license:expat)))
+
+(define-public vowpal-wabbit
+  ;; Language bindings not included.
+  (package
+    (name "vowpal-wabbit")
+    (version "8.5.0")
+    (source (origin
+              (method url-fetch)
+              (uri (string-append
+                    "https://github.com/JohnLangford/vowpal_wabbit/archive/"
+                    version ".tar.gz"))
+              (sha256
+               (base32
+                "0clp2kb7rk5sckhllxjr5a651awf4s8dgzg4659yh4hf5cqnf0gr"))
+              (file-name (string-append name "-" version ".tar.gz"))))
+    (inputs
+     `(("boost" ,boost)
+       ("zlib" ,zlib)))
+    (arguments
+     `(#:configure-flags
+       (list (string-append "--with-boost="
+                            (assoc-ref %build-inputs "boost")))))
+    (build-system gnu-build-system)
+    (home-page "https://github.com/JohnLangford/vowpal_wabbit")
+    (synopsis "Machine learning system which pushes the frontier of machine
+learning")
+    (description "Vowpal Wabbit is a machine learning system which pushes the
+frontier of machine learning with techniques such as online, hashing,
+allreduce, reductions, learning2search, active, and interactive learning. ")
+    (license license:bsd-3)))
-- 
2.14.3

Message #14 received at 31432 <at> debbugs.gnu.org (full text, mbox):

From: Fis Trivial <ybbs.daans <at> hotmail.com>
To: "31432 <at> debbugs.gnu.org" <31432 <at> debbugs.gnu.org>
Subject: Resend the patches (lightgbm and vowpal-wabbit).
Date: Tue, 12 Jun 2018 09:58:26 +0000

The new patches rephrase synopsis, use `with-directory-excursion'.

fis (2):
  gnu: Add lightgbm.
  gnu: Add vowpal-wabbit.

 gnu/packages/machine-learning.scm | 76 +++++++++++++++++++++++++++++++++++++++
 1 file changed, 76 insertions(+)

--
2.14.4

Message #17 received at 31432 <at> debbugs.gnu.org (full text, mbox):

From: Fis Trivial <ybbs.daans <at> hotmail.com>
To: Fis Trivial <ybbs.daans <at> hotmail.com>
Cc: "31432 <at> debbugs.gnu.org" <31432 <at> debbugs.gnu.org>
Subject: [PATCH 1/2] gnu: Add lightgbm.
Date: Tue, 12 Jun 2018 10:01:16 +0000

* gnu/packages/machine-learning.scm (lightgbm): New variable.
---
 gnu/packages/machine-learning.scm | 47 +++++++++++++++++++++++++++++++++++++++
 1 file changed, 47 insertions(+)

diff --git a/gnu/packages/machine-learning.scm b/gnu/packages/machine-learning.scm
index 15e4d4574..499248965 100644
--- a/gnu/packages/machine-learning.scm
+++ b/gnu/packages/machine-learning.scm
@@ -47,6 +47,7 @@
   #:use-module (gnu packages gcc)
   #:use-module (gnu packages image)
   #:use-module (gnu packages maths)
+  #:use-module (gnu packages mpi)
   #:use-module (gnu packages ocaml)
   #:use-module (gnu packages perl)
   #:use-module (gnu packages pkg-config)
@@ -786,3 +787,49 @@ main intended application of Autograd is gradient-based optimization.")

 (define-public python2-autograd
   (package-with-python2 python-autograd))
+
+(define-public lightgbm
+  (package
+    (name "lightgbm")
+    (version "2.0.12")
+    (source (origin
+              (method url-fetch)
+              (uri (string-append
+                    "https://github.com/Microsoft/LightGBM/archive/v"
+                    version ".tar.gz"))
+              (sha256
+               (base32
+                "132zf0yk0545mg72hyzxm102g3hpb6ixx9hnf8zd2k55gas6cjj1"))
+              (file-name (string-append name "-" version ".tar.gz"))))
+    (native-inputs
+     `(("python-pytest" ,python-pytest)
+       ("python-nose" ,python-nose)))
+    (inputs
+     `(("openmpi" ,openmpi)))
+    (propagated-inputs
+     `(("python-numpy" ,python-numpy)
+       ("python-scipy" ,python-scipy)))
+    (arguments
+     `(#:configure-flags
+       '("-DUSE_MPI=ON")
+       #:phases
+       (modify-phases %standard-phases
+         (replace 'check
+           (lambda* (#:key outputs #:allow-other-keys)
+             (with-directory-excursion ,(string-append "../LightGBM-" version)
+               (invoke "pytest" "tests/c_api_test/test_.py")))))))
+    (build-system cmake-build-system)
+    (home-page "https://github.com/Microsoft/LightGBM")
+    (synopsis "Gradient boosting framework based on decision tree algorithms")
+    (description "LightGBM is a gradient boosting framework that uses tree
+based learning algorithms.  It is designed to be distributed and efficient with
+the following advantages:
+
+@itemize
+@item Faster training speed and higher efficiency
+@item Lower memory usage
+@item Better accuracy
+@item Parallel and GPU learning supported
+@item Capable of handling large-scale data
+@end itemize\n")
+    (license license:expat)))
--
2.14.4

Message #20 received at 31432 <at> debbugs.gnu.org (full text, mbox):

From: Fis Trivial <ybbs.daans <at> hotmail.com>
To: Fis Trivial <ybbs.daans <at> hotmail.com>
Cc: "31432 <at> debbugs.gnu.org" <31432 <at> debbugs.gnu.org>
Subject: [PATCH 2/2] gnu: Add vowpal-wabbit.
Date: Tue, 12 Jun 2018 10:02:15 +0000

* gnu/packages/machine-learning.scm (vowpal-wabbit): New variable.
---
 gnu/packages/machine-learning.scm | 29 +++++++++++++++++++++++++++++
 1 file changed, 29 insertions(+)

diff --git a/gnu/packages/machine-learning.scm b/gnu/packages/machine-learning.scm
index 499248965..6ed5d20ef 100644
--- a/gnu/packages/machine-learning.scm
+++ b/gnu/packages/machine-learning.scm
@@ -833,3 +833,32 @@ the following advantages:
 @item Capable of handling large-scale data
 @end itemize\n")
     (license license:expat)))
+
+(define-public vowpal-wabbit
+  ;; Language bindings not included.
+  (package
+    (name "vowpal-wabbit")
+    (version "8.5.0")
+    (source (origin
+              (method url-fetch)
+              (uri (string-append
+                    "https://github.com/JohnLangford/vowpal_wabbit/archive/"
+                    version ".tar.gz"))
+              (sha256
+               (base32
+                "0clp2kb7rk5sckhllxjr5a651awf4s8dgzg4659yh4hf5cqnf0gr"))
+              (file-name (string-append name "-" version ".tar.gz"))))
+    (inputs
+     `(("boost" ,boost)
+       ("zlib" ,zlib)))
+    (arguments
+     `(#:configure-flags
+       (list (string-append "--with-boost="
+                            (assoc-ref %build-inputs "boost")))))
+    (build-system gnu-build-system)
+    (home-page "https://github.com/JohnLangford/vowpal_wabbit")
+    (synopsis "Fast machine learning library for online learning")
+    (description "Vowpal Wabbit is a machine learning system with techniques
+such as online, hashing, allreduce, reductions, learning2search, active, and
+interactive learning.")
+    (license license:bsd-3)))
--
2.14.4

Message #25 received at 31432-done <at> debbugs.gnu.org (full text, mbox):

From: ludo <at> gnu.org (Ludovic Courtès)
To: Fis Trivial <ybbs.daans <at> hotmail.com>
Cc: "31432 <at> debbugs.gnu.org" <31432-done <at> debbugs.gnu.org>
Subject: Re: [bug#31432] Resend the patches (lightgbm and vowpal-wabbit).
Date: Thu, 14 Jun 2018 22:19:30 +0200

Hello,

Fis Trivial <ybbs.daans <at> hotmail.com> skribis:

> The new patches rephrase synopsis, use `with-directory-excursion'.
>
> fis (2):
>   gnu: Add lightgbm.
>   gnu: Add vowpal-wabbit.

Sorry for the looong delay.  Applied now, thanks!

Ludo’.

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.