From unknown Wed Jun 18 23:15:58 2025 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.509 (Entity 5.509) Content-Type: text/plain; charset=utf-8 From: bug#56330 <56330@debbugs.gnu.org> To: bug#56330 <56330@debbugs.gnu.org> Subject: Status: [PATCH] services: Add anonip-service-type. Reply-To: bug#56330 <56330@debbugs.gnu.org> Date: Thu, 19 Jun 2025 06:15:58 +0000 retitle 56330 [PATCH] services: Add anonip-service-type. reassign 56330 guix-patches submitter 56330 Ricardo Wurmus severity 56330 normal tag 56330 patch thanks From debbugs-submit-bounces@debbugs.gnu.org Thu Jun 30 19:16:15 2022 Received: (at submit) by debbugs.gnu.org; 30 Jun 2022 23:16:15 +0000 Received: from localhost ([127.0.0.1]:35902 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1o73OM-000148-3H for submit@debbugs.gnu.org; Thu, 30 Jun 2022 19:16:15 -0400 Received: from lists.gnu.org ([209.51.188.17]:56210) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1o73OH-00013w-K4 for submit@debbugs.gnu.org; Thu, 30 Jun 2022 19:16:08 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:49328) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1o73OH-0005JK-EB for guix-patches@gnu.org; Thu, 30 Jun 2022 19:16:05 -0400 Received: from sender4-of-o51.zoho.com ([136.143.188.51]:21166) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1o73OF-0002Uo-3J for guix-patches@gnu.org; Thu, 30 Jun 2022 19:16:05 -0400 ARC-Seal: i=1; a=rsa-sha256; t=1656630959; cv=none; d=zohomail.com; s=zohoarc; b=YCVmBBIj0AKXVxHZBC7chiN470Se9EPy2NKc2hYV1nGH5ntX1/GNHOpUQRHV+A+vGI6Ffz6UwjvFQPa+BgVPcCNAksOB3u65KUhOPla//I4DiQBPhNYBwmsL8N6zQp6P0tQBmMmHj9n8Jjf7adcFqPDtVrP/Nnrcn9f9QR9Jcw4= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1656630959; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:MIME-Version:Message-ID:Subject:To; bh=5i69xYd7vWnfsAKV2fcics6NtUo1Vl9CzSByb/KQHpU=; b=PQt/0fkuJ2sMSt4lh85dGxlTMj27R3sKeBtfYTvbNXYAtZ1Oi9p8RHYBLmsLJKb/rBsT59PxCGlOkFGzp81MjamGi8b+1O7BWNWtQ9odubomKSmi1GdVFifmHbRbWgtF/s8yN16pi5pcGFgiKrHHK5dWSKtVAZMi+A/jiWMno4c= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass header.i=elephly.net; spf=pass smtp.mailfrom=rekado@elephly.net; dmarc=pass header.from= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1656630959; s=zoho; d=elephly.net; i=rekado@elephly.net; h=From:From:To:To:Cc:Cc:Subject:Subject:Date:Date:Message-Id:Message-Id:MIME-Version:Content-Type:Content-Transfer-Encoding:Reply-To; bh=5i69xYd7vWnfsAKV2fcics6NtUo1Vl9CzSByb/KQHpU=; b=VVcTYR1WFqVTwcUC6GI/tE2pfDSTTiHeQwx2aDUDv/XffnzPmlM3t3dsYoQGNTdM thJznJ20ExqkdbOQUn5vTjxrQyfd5TUbGp+0JUlvMqF8GiSY97qgPSz9x4TsJX5MptB B+mlU5HDeewvCk/gRmh4bgqm+D0+ixxADcuz46Mw= Received: from localhost (72-109-142-46.pool.kielnet.net [46.142.109.72]) by mx.zohomail.com with SMTPS id 1656630956919398.26272021632406; Thu, 30 Jun 2022 16:15:56 -0700 (PDT) From: Ricardo Wurmus To: guix-patches@gnu.org Subject: [PATCH] services: Add anonip-service-type. Date: Fri, 1 Jul 2022 01:15:51 +0200 Message-Id: <20220630231551.16188-1-rekado@elephly.net> X-Mailer: git-send-email 2.36.1 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-ZohoMailClient: External Received-SPF: pass client-ip=136.143.188.51; envelope-from=rekado@elephly.net; helo=sender4-of-o51.zoho.com X-Spam_score_int: -16 X-Spam_score: -1.7 X-Spam_bar: - X-Spam_report: (-1.7 / 5.0 requ) BAYES_00=-1.9, DKIM_INVALID=0.1, DKIM_SIGNED=0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=no autolearn_force=no X-Spam_action: no action X-Spam-Score: -1.3 (-) X-Debbugs-Envelope-To: submit Cc: Ricardo Wurmus X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -2.3 (--) * gnu/services/web.scm (anonip-configuration): New record type. (anonip-configuration?, anonip-configuration-anonip, anonip-configuration-log-file, anonip-configuration-fifo-directory, anonip-configuration-output-directory): New procedures. (anonip-service-type): New service type. * doc/guix.texi (Log Rotation): Add subheading for Anonip Service. --- doc/guix.texi | 58 +++++++++++++++++++++++++++++++++- gnu/services/web.scm | 74 +++++++++++++++++++++++++++++++++++++++++++- 2 files changed, 130 insertions(+), 2 deletions(-) diff --git a/doc/guix.texi b/doc/guix.texi index b8c49099a4..d23d3b1fbc 100644 --- a/doc/guix.texi +++ b/doc/guix.texi @@ -30,7 +30,7 @@ Copyright @copyright{} 2015, 2016 Mathieu Lirzin@* Copyright @copyright{} 2014 Pierre-Antoine Rault@* Copyright @copyright{} 2015 Taylan Ulrich Bayırlı/Kammer@* Copyright @copyright{} 2015, 2016, 2017, 2019, 2020, 2021 Leo Famulari@* -Copyright @copyright{} 2015, 2016, 2017, 2018, 2019, 2020, 2021 Ricardo Wurmus@* +Copyright @copyright{} 2015, 2016, 2017, 2018, 2019, 2020, 2021, 2022 Ricardo Wurmus@* Copyright @copyright{} 2016 Ben Woodcroft@* Copyright @copyright{} 2016, 2017, 2018, 2021 Chris Marusich@* Copyright @copyright{} 2016, 2017, 2018, 2019, 2020, 2021, 2022 Efraim Flashner@* @@ -18700,6 +18700,62 @@ String or gexp denoting the corresponding mcron job schedule @end table @end deftp +@cindex logging, anonymization +@subheading Anonip Service + +Anonip is a privacy filter that removes IP address from web server logs. +This service creates a FIFO and filters any written lines with anonip +before writing the filtered log to a target file. + +The following example sets up the FIFO +@file{/var/run/anonip/https.access.log} and writes the filtered log file +@file{/var/log/anonip/https.access.log}. + +@lisp +(service anonip-service-type + (anonip-configuration + (log-file "https.access.log"))) +@end lisp + +The directories to store the FIFO and the filtered log can be changed +with @code{fifo-directory} and @code{output-directory}, respectively. +In the following example the filtered log file would be written to +@file{/var/web-logs/https.access.log}. + +@lisp +(service anonip-service-type + (anonip-configuration + (log-file "https.access.log") + (output-directory "/var/web-logs/https.access.log"))) +@end lisp + +Configure your web server to write its logs to the FIFO at +@file{/var/run/anonip/https.access.log} and collect the anonymized log +file at @file{/var/web-logs/https.access.log}. + +@deftp {Data Type} anonip-configuration +This data type represents the configuration of anonip. +It has the following parameters: + +@table @asis +@item @code{anonip} (default: @code{anonip}) +The anonip package to use. + +@item @code{log-file} +The file name of the log file to process. This name is used in the FIFO +as well as in the filtered log file. This must not be an absolute file +name. + +@item @code{fifo-directory} (default: @code{"/var/run/anonip"}) +The directory where the FIFO file is created. + +@item @code{output-directory} (default: @code{"/var/log/anonip"}) +The directory to which the filtered log file will be written. + +@end table +@end deftp + + @node Networking Setup @subsection Networking Setup diff --git a/gnu/services/web.scm b/gnu/services/web.scm index 4f06d4e0bb..641a928e41 100644 --- a/gnu/services/web.scm +++ b/gnu/services/web.scm @@ -9,7 +9,7 @@ ;;; Copyright © 2018 Pierre-Antoine Rouby ;;; Copyright © 2018 Marius Bakke ;;; Copyright © 2019, 2020 Florian Pelz -;;; Copyright © 2020 Ricardo Wurmus +;;; Copyright © 2020, 2022 Ricardo Wurmus ;;; Copyright © 2020 Tobias Geerinckx-Rice ;;; Copyright © 2020 Arun Isaac ;;; Copyright © 2020 Oleg Pykhalov @@ -204,6 +204,14 @@ (define-module (gnu services web) tailon-service-type + anonip-configuration + anonip-configuration? + anonip-configuration-anonip + anonip-configuration-log-file + anonip-configuration-fifo-directory + anonip-configuration-output-directory + anonip-service-type + varnish-configuration varnish-configuration? varnish-configuration-package @@ -1343,6 +1351,70 @@ (define tailon-service-type files)))))))) (default-value (tailon-configuration)))) + + +;;; +;;; Log anonymization +;;; + +(define-record-type* + anonip-configuration make-anonip-configuration + anonip-configuration? + (anonip anonip-configuration-anonip ;file-like + (default anonip)) + (log-file anonip-configuration-log-file) ;string + (fifo-directory anonip-configuration-fifo-directory + (default "/var/run/anonip")) ;string + (output-directory anonip-configuration-output-directory + (default "/var/log/anonip"))) ;string + +(define (anonip-activation config) + (with-imported-modules '((guix build utils)) + #~(begin + (use-modules (guix build utils)) + (for-each + (lambda (directory) + (mkdir-p directory) + (chmod directory #o755)) + (list #$(anonip-configuration-output-directory config) + #$(anonip-configuration-fifo-directory config)))))) + +(define (anonip-shepherd-service config) + (let ((log-file (anonip-configuration-log-file config)) + (fifos (anonip-configuration-fifo-directory config)) + (outputs (anonip-configuration-output-directory config))) + (list (shepherd-service + (provision (list (symbol-append 'anonip- (string->symbol log-file)))) + (requirement '(user-processes)) + (documentation "Anonimyze the given log file location with anonip.") + (start #~(lambda _ + (let ((fifo #$(format #false "~a/~a" fifos log-file))) + (unless (file-exists? fifo) + (mknod fifo 'fifo #o600 0)) + (let ((pid (fork+exec-command + (list #$(file-append (anonip-configuration-anonip config) + "/bin/anonip") + (string-append "--input=" fifo) + (string-append "--output=" #$(format #false "~a/~a" outputs log-file))) + ;; Run in a UTF-8 locale + #:environment-variables + (list (string-append "GUIX_LOCPATH=" #$glibc-utf8-locales + "/lib/locale") + "LC_ALL=en_US.utf8")))) + pid)))) + (stop #~(make-kill-destructor)))))) + +(define anonip-service-type + (service-type + (name 'anonip) + (extensions + (list (service-extension shepherd-root-service-type + anonip-shepherd-service) + (service-extension activation-service-type + anonip-activation))) + (description + "Provide web server log anonymization with @command{anonip}."))) + ;;; ;;; Varnish -- 2.36.1 From debbugs-submit-bounces@debbugs.gnu.org Sun Jul 03 06:52:38 2022 Received: (at 56330) by debbugs.gnu.org; 3 Jul 2022 10:52:38 +0000 Received: from localhost ([127.0.0.1]:43397 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1o7xDN-0005F0-Ip for submit@debbugs.gnu.org; Sun, 03 Jul 2022 06:52:38 -0400 Received: from sender4-of-o51.zoho.com ([136.143.188.51]:21163) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1o7xDL-0005Eo-1U for 56330@debbugs.gnu.org; Sun, 03 Jul 2022 06:52:32 -0400 ARC-Seal: i=1; a=rsa-sha256; t=1656845547; cv=none; d=zohomail.com; s=zohoarc; b=cnJnhLPnDUfmLN/5hSZfrYJ+yPpnqGEoMXw/MwWa3LopCrRH0v/ZSU9QzKi2k7sLJSLoM+5/SS522xVsoqgzwPpQKO8M1PS0tnYG/2jAUbzdFhnvVn71/vn0ppREzQSo2B7BcVdA8TVWdKTnmh6k2d8qboUAjrdf7zTJEnIpk/s= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1656845547; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:MIME-Version:Message-ID:Subject:To; bh=EN6eK1sXXKFKMUH5Q7g9OboipZh/Z48K2+eakavv0Ds=; b=mub7Xs/Xv92qyIZKcH5RjbrfLrJx4ySDx7OgeEoKphXV+0RZOuBrbQW6dxn1oHiuu5HQYQhg7VWY99TkxmBOYNxyZk4F8J0rt/MoyGYFRn1eiqlVg4PHh/M6qf7zi4IUN082mQKTtvCkhUPNrm5kmR0WqeIyD/iRezhqUbUostQ= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass header.i=elephly.net; spf=pass smtp.mailfrom=rekado@elephly.net; dmarc=pass header.from= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1656845547; s=zoho; d=elephly.net; i=rekado@elephly.net; h=From:From:To:To:Cc:Cc:Subject:Subject:Date:Date:Message-Id:Message-Id:MIME-Version:Content-Type:Content-Transfer-Encoding:Reply-To; bh=EN6eK1sXXKFKMUH5Q7g9OboipZh/Z48K2+eakavv0Ds=; b=H8qgVrjdwQEAcHd1kDgez329i3NcOfM9U6hwiBNjQHblHkHzGB9p/KyemWB7nkPQ 4O8PS4u4gU0Y8WITQYqimNRw1zjDAm5btIZhLC3Jj9fqh3LLViZ50V4j/WZpbl0bzGf 5KBBrurmyjVXwXQDl2Ipy3lZ96AvANWRx499Pejk= Received: from localhost (104-110-142-46.pool.kielnet.net [46.142.110.104]) by mx.zohomail.com with SMTPS id 1656845543815240.46853199210238; Sun, 3 Jul 2022 03:52:23 -0700 (PDT) From: Ricardo Wurmus To: 56330@debbugs.gnu.org Subject: [PATCH v2] services: Add anonip-service-type. Date: Sun, 3 Jul 2022 12:52:16 +0200 Message-Id: <20220703105216.8843-1-rekado@elephly.net> X-Mailer: git-send-email 2.36.1 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-ZohoMailClient: External X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 56330 Cc: Ricardo Wurmus X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) * gnu/services/web.scm (anonip-configuration): New record type. (anonip-configuration?, anonip-configuration-anonip, anonip-configuration-input, anonip-configuration-output, anonip-configuration-skip-private?, anonip-configuration-column, anonip-configuration-replacement, anonip-configuration-ipv4mask, anonip-configuration-ipv6mask, anonip-configuration-increment, anonip-configuration-delimiter, anonip-configuration-regex): New procedures. (anonip-service-type): New service type. * doc/guix.texi (Log Rotation): Add subheading for Anonip Service. --- doc/guix.texi | 71 +++++++++++++++++++++++++++- gnu/services/web.scm | 110 ++++++++++++++++++++++++++++++++++++++++++- 2 files changed, 179 insertions(+), 2 deletions(-) diff --git a/doc/guix.texi b/doc/guix.texi index cf373b6cbd..a22a7f59ec 100644 --- a/doc/guix.texi +++ b/doc/guix.texi @@ -30,7 +30,7 @@ Copyright @copyright{} 2015, 2016 Mathieu Lirzin@* Copyright @copyright{} 2014 Pierre-Antoine Rault@* Copyright @copyright{} 2015 Taylan Ulrich Bayırlı/Kammer@* Copyright @copyright{} 2015, 2016, 2017, 2019, 2020, 2021 Leo Famulari@* -Copyright @copyright{} 2015, 2016, 2017, 2018, 2019, 2020, 2021 Ricardo Wurmus@* +Copyright @copyright{} 2015, 2016, 2017, 2018, 2019, 2020, 2021, 2022 Ricardo Wurmus@* Copyright @copyright{} 2016 Ben Woodcroft@* Copyright @copyright{} 2016, 2017, 2018, 2021 Chris Marusich@* Copyright @copyright{} 2016, 2017, 2018, 2019, 2020, 2021, 2022 Efraim Flashner@* @@ -18700,6 +18700,75 @@ String or gexp denoting the corresponding mcron job schedule @end table @end deftp +@cindex logging, anonymization +@subheading Anonip Service + +Anonip is a privacy filter that removes IP address from web server logs. +This service creates a FIFO and filters any written lines with anonip +before writing the filtered log to a target file. + +The following example sets up the FIFO +@file{/var/run/anonip/https.access.log} and writes the filtered log file +@file{/var/log/anonip/https.access.log}. + +@lisp +(service anonip-service-type + (anonip-configuration + (input "/var/run/anonip/https.access.log") + (output "/var/log/anonip/https.access.log"))) +@end lisp + +Configure your web server to write its logs to the FIFO at +@file{/var/run/anonip/https.access.log} and collect the anonymized log +file at @file{/var/web-logs/https.access.log}. + +@deftp {Data Type} anonip-configuration +This data type represents the configuration of anonip. +It has the following parameters: + +@table @asis +@item @code{anonip} (default: @code{anonip}) +The anonip package to use. + +@item @code{input} +The file name of the input log file to process. The service creates a +FIFO of this name. The web server should write its logs to this FIFO. + +@item @code{output} +The file name of the processed log file. +@end table + +The following optional settings may be provided: + +@table @asis +@item @code{skip-private?} +When @code{#true} do not mask addresses in private ranges. + +@item @code{column} +A 1-based indexed column number. Assume IP address is in the specified +column (default is 1). + +@item @code{replacement} +Replacement string in case address parsing fails, e.g. @code{"0.0.0.0"}. + +@item @code{ipv4mask} +Number of bits to mask in IPv4 addresses. + +@item @code{ipv6mask} +Number of bits to mask in IPv6 addresses. + +@item @code{increment} +Increment the IP address by the given number. By default this is zero. + +@item @code{delimiter} +Log delimiter string. + +@item @code{regex} +Regular expression for detecting IP addresses. Use this instead of @code{column}. +@end table +@end deftp + + @node Networking Setup @subsection Networking Setup diff --git a/gnu/services/web.scm b/gnu/services/web.scm index 4434fecf02..1480a751e2 100644 --- a/gnu/services/web.scm +++ b/gnu/services/web.scm @@ -9,7 +9,7 @@ ;;; Copyright © 2018 Pierre-Antoine Rouby ;;; Copyright © 2018 Marius Bakke ;;; Copyright © 2019, 2020 Florian Pelz -;;; Copyright © 2020 Ricardo Wurmus +;;; Copyright © 2020, 2022 Ricardo Wurmus ;;; Copyright © 2020 Tobias Geerinckx-Rice ;;; Copyright © 2020 Arun Isaac ;;; Copyright © 2020 Oleg Pykhalov @@ -205,6 +205,21 @@ (define-module (gnu services web) tailon-service-type + anonip-configuration + anonip-configuration? + anonip-configuration-anonip + anonip-configuration-input + anonip-configuration-output + anonip-configuration-skip-private? + anonip-configuration-column + anonip-configuration-replacement + anonip-configuration-ipv4mask + anonip-configuration-ipv6mask + anonip-configuration-increment + anonip-configuration-delimiter + anonip-configuration-regex + anonip-service-type + varnish-configuration varnish-configuration? varnish-configuration-package @@ -1355,6 +1370,99 @@ (define tailon-service-type files)))))))) (default-value (tailon-configuration)))) + + +;;; +;;; Log anonymization +;;; + +(define-record-type* + anonip-configuration make-anonip-configuration + anonip-configuration? + (anonip anonip-configuration-anonip ;file-like + (default anonip)) + (input anonip-configuration-input) ;string + (output anonip-configuration-output) ;string + (skip-private? anonip-configuration-skip-private? ;boolean + (default #f)) + (column anonip-configuration-column ;number + (default #f)) + (replacement anonip-configuration-replacement ;string + (default #f)) + (ipv4mask anonip-configuration-ipv4mask ;number + (default #f)) + (ipv6mask anonip-configuration-ipv6mask ;number + (default #f)) + (increment anonip-configuration-increment ;number + (default #f)) + (delimiter anonip-configuration-delimiter ;string + (default #f)) + (regex anonip-configuration-regex ;string + (default #f))) + +(define (anonip-activation config) + (with-imported-modules '((guix build utils)) + #~(begin + (use-modules (guix build utils)) + (for-each + (lambda (directory) + (mkdir-p directory) + (chmod directory #o755)) + (list (dirname #$(anonip-configuration-input config)) + (dirname #$(anonip-configuration-output config))))))) + +(define (anonip-shepherd-service config) + (let ((input (anonip-configuration-input config)) + (output (anonip-configuration-output config))) + (list (shepherd-service + (provision (list (symbol-append 'anonip- (string->symbol output)))) + (requirement '(user-processes)) + (documentation "Anonimyze the given log file location with anonip.") + (start #~(lambda _ + (let ((optional + (lambda (accessor option) + (or (and=> (accessor config) + (lambda (value) + (list + (format #false "~a=~a" + option (accessor config))))) + (list))))) + (unless (file-exists? input) + (mknod input 'fifo #o600 0)) + (let ((pid (fork+exec-command + (append + (list #$(file-append (anonip-configuration-anonip config) + "/bin/anonip") + (string-append "--input=" input) + (string-append "--output=" output)) + (if (anonip-configuration-skip-private? config) + '("--skip-private") (list)) + (optional anonip-configuration-column "--column") + (optional anonip-configuration-ipv4mask "--ipv4mask") + (optional anonip-configuration-ipv6mask "--ipv6mask") + (optional anonip-configuration-increment "--increment") + (optional anonip-configuration-replacement "--replacement") + (optional anonip-configuration-delimiter "--delimiter") + (optional anonip-configuration-regex "--regex")) + ;; Run in a UTF-8 locale + #:environment-variables + (list (string-append "GUIX_LOCPATH=" #$glibc-utf8-locales + "/lib/locale") + "LC_ALL=en_US.utf8")))) + pid)))) + (stop #~(make-kill-destructor)))))) + +(define anonip-service-type + (service-type + (name 'anonip) + (extensions + (list (service-extension shepherd-root-service-type + anonip-shepherd-service) + (service-extension activation-service-type + anonip-activation))) + (description + "Provide web server log anonymization with @command{anonip}."))) + ;;; ;;; Varnish -- 2.36.1 From debbugs-submit-bounces@debbugs.gnu.org Sun Jul 03 07:54:18 2022 Received: (at 56330) by debbugs.gnu.org; 3 Jul 2022 11:54:18 +0000 Received: from localhost ([127.0.0.1]:43456 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1o7yB3-0000g1-6X for submit@debbugs.gnu.org; Sun, 03 Jul 2022 07:54:18 -0400 Received: from sender4-of-o51.zoho.com ([136.143.188.51]:21139) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1o7yAy-0000fo-7S for 56330@debbugs.gnu.org; Sun, 03 Jul 2022 07:54:11 -0400 ARC-Seal: i=1; a=rsa-sha256; t=1656849245; cv=none; d=zohomail.com; s=zohoarc; b=hr3v4A/hn65t/ANHnIE0TZZozqrdCTy4na5FVbytHZIKNTH/xXz04gAWAX7K1YkiJ73jv3KWW9pjMStWKabDc8sfXQ/010X5dosvd/Ch5M9W0/fkP9QFv1G744rg8h2sPR8OJLQJFuLQQqpcV7soRqK0PIXSR4g9XmlXbZJm/W8= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1656849245; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:MIME-Version:Message-ID:Subject:To; bh=pbCL3VOxVUNoNgzIOoGEl9kWcoE5LKR/LqLO8mR/xjs=; b=hCq00uVKFdskq9L/AZS0N3l0angEfEwqTUkMMQkIK65cYEBzxcqNxAbpeFwurWnESPDigxIZDoA42eXNPmtrxzClx9nf7e4QyvTdl+hk6ken4X1+PcW5JTpJfuj788dAlmkXYkg7AdqVQLlnmPqVNnhLrhuD+TKObyXswDhDLfM= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass header.i=elephly.net; spf=pass smtp.mailfrom=rekado@elephly.net; dmarc=pass header.from= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1656849245; s=zoho; d=elephly.net; i=rekado@elephly.net; h=From:From:To:To:Cc:Cc:Subject:Subject:Date:Date:Message-Id:Message-Id:MIME-Version:Content-Type:Content-Transfer-Encoding:Reply-To; bh=pbCL3VOxVUNoNgzIOoGEl9kWcoE5LKR/LqLO8mR/xjs=; b=WgDbzXiRNrTYP7SwhTuo9P7ncZQ7azLZExnlz3l5w5wBzRBcopB4EKGOVnrrb2bj honkAZej9rbAAlQOjo89GSQN5sT/3Xvlq5nPtXqLgEkq6hpAZMzNG31wTGWqjrALQDV f2tPw3SSbbfTWsmK30Ro7FUwN1Wt6ZqpMBbT+GvQ= Received: from localhost (104-110-142-46.pool.kielnet.net [46.142.110.104]) by mx.zohomail.com with SMTPS id 1656849242987880.6441678963376; Sun, 3 Jul 2022 04:54:02 -0700 (PDT) From: Ricardo Wurmus To: 56330@debbugs.gnu.org Subject: [PATCH v3] services: Add anonip-service-type. Date: Sun, 3 Jul 2022 13:53:57 +0200 Message-Id: <20220703115357.20195-1-rekado@elephly.net> X-Mailer: git-send-email 2.36.1 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-ZohoMailClient: External X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 56330 Cc: Ricardo Wurmus X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) * gnu/services/web.scm (anonip-configuration): New record type. (anonip-configuration?, anonip-configuration-anonip, anonip-configuration-input, anonip-configuration-output, anonip-configuration-skip-private?, anonip-configuration-column, anonip-configuration-replacement, anonip-configuration-ipv4mask, anonip-configuration-ipv6mask, anonip-configuration-increment, anonip-configuration-delimiter, anonip-configuration-regex): New procedures. (anonip-service-type): New service type. * doc/guix.texi (Log Rotation): Add subheading for Anonip Service. --- doc/guix.texi | 71 +++++++++++++++++++++++++++- gnu/services/web.scm | 110 ++++++++++++++++++++++++++++++++++++++++++- 2 files changed, 179 insertions(+), 2 deletions(-) diff --git a/doc/guix.texi b/doc/guix.texi index cf373b6cbd..a22a7f59ec 100644 --- a/doc/guix.texi +++ b/doc/guix.texi @@ -30,7 +30,7 @@ Copyright @copyright{} 2015, 2016 Mathieu Lirzin@* Copyright @copyright{} 2014 Pierre-Antoine Rault@* Copyright @copyright{} 2015 Taylan Ulrich Bayırlı/Kammer@* Copyright @copyright{} 2015, 2016, 2017, 2019, 2020, 2021 Leo Famulari@* -Copyright @copyright{} 2015, 2016, 2017, 2018, 2019, 2020, 2021 Ricardo Wurmus@* +Copyright @copyright{} 2015, 2016, 2017, 2018, 2019, 2020, 2021, 2022 Ricardo Wurmus@* Copyright @copyright{} 2016 Ben Woodcroft@* Copyright @copyright{} 2016, 2017, 2018, 2021 Chris Marusich@* Copyright @copyright{} 2016, 2017, 2018, 2019, 2020, 2021, 2022 Efraim Flashner@* @@ -18700,6 +18700,75 @@ String or gexp denoting the corresponding mcron job schedule @end table @end deftp +@cindex logging, anonymization +@subheading Anonip Service + +Anonip is a privacy filter that removes IP address from web server logs. +This service creates a FIFO and filters any written lines with anonip +before writing the filtered log to a target file. + +The following example sets up the FIFO +@file{/var/run/anonip/https.access.log} and writes the filtered log file +@file{/var/log/anonip/https.access.log}. + +@lisp +(service anonip-service-type + (anonip-configuration + (input "/var/run/anonip/https.access.log") + (output "/var/log/anonip/https.access.log"))) +@end lisp + +Configure your web server to write its logs to the FIFO at +@file{/var/run/anonip/https.access.log} and collect the anonymized log +file at @file{/var/web-logs/https.access.log}. + +@deftp {Data Type} anonip-configuration +This data type represents the configuration of anonip. +It has the following parameters: + +@table @asis +@item @code{anonip} (default: @code{anonip}) +The anonip package to use. + +@item @code{input} +The file name of the input log file to process. The service creates a +FIFO of this name. The web server should write its logs to this FIFO. + +@item @code{output} +The file name of the processed log file. +@end table + +The following optional settings may be provided: + +@table @asis +@item @code{skip-private?} +When @code{#true} do not mask addresses in private ranges. + +@item @code{column} +A 1-based indexed column number. Assume IP address is in the specified +column (default is 1). + +@item @code{replacement} +Replacement string in case address parsing fails, e.g. @code{"0.0.0.0"}. + +@item @code{ipv4mask} +Number of bits to mask in IPv4 addresses. + +@item @code{ipv6mask} +Number of bits to mask in IPv6 addresses. + +@item @code{increment} +Increment the IP address by the given number. By default this is zero. + +@item @code{delimiter} +Log delimiter string. + +@item @code{regex} +Regular expression for detecting IP addresses. Use this instead of @code{column}. +@end table +@end deftp + + @node Networking Setup @subsection Networking Setup diff --git a/gnu/services/web.scm b/gnu/services/web.scm index 4434fecf02..f0c7e90cbf 100644 --- a/gnu/services/web.scm +++ b/gnu/services/web.scm @@ -9,7 +9,7 @@ ;;; Copyright © 2018 Pierre-Antoine Rouby ;;; Copyright © 2018 Marius Bakke ;;; Copyright © 2019, 2020 Florian Pelz -;;; Copyright © 2020 Ricardo Wurmus +;;; Copyright © 2020, 2022 Ricardo Wurmus ;;; Copyright © 2020 Tobias Geerinckx-Rice ;;; Copyright © 2020 Arun Isaac ;;; Copyright © 2020 Oleg Pykhalov @@ -205,6 +205,21 @@ (define-module (gnu services web) tailon-service-type + anonip-configuration + anonip-configuration? + anonip-configuration-anonip + anonip-configuration-input + anonip-configuration-output + anonip-configuration-skip-private? + anonip-configuration-column + anonip-configuration-replacement + anonip-configuration-ipv4mask + anonip-configuration-ipv6mask + anonip-configuration-increment + anonip-configuration-delimiter + anonip-configuration-regex + anonip-service-type + varnish-configuration varnish-configuration? varnish-configuration-package @@ -1355,6 +1370,99 @@ (define tailon-service-type files)))))))) (default-value (tailon-configuration)))) + + +;;; +;;; Log anonymization +;;; + +(define-record-type* + anonip-configuration make-anonip-configuration + anonip-configuration? + (anonip anonip-configuration-anonip ;file-like + (default anonip)) + (input anonip-configuration-input) ;string + (output anonip-configuration-output) ;string + (skip-private? anonip-configuration-skip-private? ;boolean + (default #f)) + (column anonip-configuration-column ;number + (default #f)) + (replacement anonip-configuration-replacement ;string + (default #f)) + (ipv4mask anonip-configuration-ipv4mask ;number + (default #f)) + (ipv6mask anonip-configuration-ipv6mask ;number + (default #f)) + (increment anonip-configuration-increment ;number + (default #f)) + (delimiter anonip-configuration-delimiter ;string + (default #f)) + (regex anonip-configuration-regex ;string + (default #f))) + +(define (anonip-activation config) + (with-imported-modules '((guix build utils)) + #~(begin + (use-modules (guix build utils)) + (for-each + (lambda (directory) + (mkdir-p directory) + (chmod directory #o755)) + (list (dirname #$(anonip-configuration-input config)) + (dirname #$(anonip-configuration-output config))))))) + +(define (anonip-shepherd-service config) + (let ((input (anonip-configuration-input config)) + (output (anonip-configuration-output config)) + (optional + (lambda (accessor option) + (or (and=> (accessor config) + (lambda (value) + (list + (format #false "~a=~a" + option value)))) + (list))))) + (list (shepherd-service + (provision (list (symbol-append 'anonip- (string->symbol output)))) + (requirement '(user-processes)) + (documentation "Anonimyze the given log file location with anonip.") + (start #~(lambda _ + (unless (file-exists? #$input) + (mknod #$input 'fifo #o600 0)) + (let ((pid (fork+exec-command + (append + (list #$(file-append (anonip-configuration-anonip config) + "/bin/anonip") + (string-append "--input=" #$input) + (string-append "--output=" #$output)) + (if #$(anonip-configuration-skip-private? config) + '("--skip-private") (list)) + '#$(optional anonip-configuration-column "--column") + '#$(optional anonip-configuration-ipv4mask "--ipv4mask") + '#$(optional anonip-configuration-ipv6mask "--ipv6mask") + '#$(optional anonip-configuration-increment "--increment") + '#$(optional anonip-configuration-replacement "--replacement") + '#$(optional anonip-configuration-delimiter "--delimiter") + '#$(optional anonip-configuration-regex "--regex")) + ;; Run in a UTF-8 locale + #:environment-variables + (list (string-append "GUIX_LOCPATH=" #$glibc-utf8-locales + "/lib/locale") + "LC_ALL=en_US.utf8")))) + pid))) + (stop #~(make-kill-destructor)))))) + +(define anonip-service-type + (service-type + (name 'anonip) + (extensions + (list (service-extension shepherd-root-service-type + anonip-shepherd-service) + (service-extension activation-service-type + anonip-activation))) + (description + "Provide web server log anonymization with @command{anonip}."))) + ;;; ;;; Varnish -- 2.36.1 From debbugs-submit-bounces@debbugs.gnu.org Sun Jul 03 09:03:43 2022 Received: (at 56330-done) by debbugs.gnu.org; 3 Jul 2022 13:03:44 +0000 Received: from localhost ([127.0.0.1]:43600 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1o7zGJ-0006zH-Nm for submit@debbugs.gnu.org; Sun, 03 Jul 2022 09:03:43 -0400 Received: from sender4-of-o51.zoho.com ([136.143.188.51]:21168) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1o7zGE-0006z6-Vt for 56330-done@debbugs.gnu.org; Sun, 03 Jul 2022 09:03:41 -0400 ARC-Seal: i=1; a=rsa-sha256; t=1656853415; cv=none; d=zohomail.com; s=zohoarc; b=AFz8fd9LW53Qwh/VQMZSfO8nd1CUVYmGsnbqtneGdtHnBlCDu6AEZHYOI7qgNc5GAfnfnS55Y/pdlXSVlZGvbouEM+Cv0gguxAE6dAemlp7V5FrrqfXKZMOK2zSXscO2bLRxPM7zgklZwooFSFuvytSATqCfnlJPblS9vl6bvhE= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1656853415; h=Content-Type:Date:From:In-Reply-To:MIME-Version:Message-ID:References:Subject:To; bh=Dw9rrkr+5g4VLJMantw/QcW9lWhQcKns1cAFQJ0YuZU=; b=W1lDgJt0U274HAoqBP1bfhVe1Hw7hN9gd44VpBcE0nUprCk0/rPnmlyRYZPm+5X0KYdDOrgGtvXZ1gxCoHDBeNcxDif2Ilr18d59qVdJ7QoGT4nKFvvE63YvVplQhESxWhujiBg6RpDp5BqOWwiu4TnWfrs9mLXi9+08D0O1RRM= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass header.i=elephly.net; spf=pass smtp.mailfrom=rekado@elephly.net; dmarc=pass header.from= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1656853415; s=zoho; d=elephly.net; i=rekado@elephly.net; h=References:From:From:To:To:Subject:Subject:Date:Date:In-reply-to:Message-ID:MIME-Version:Content-Type:Message-Id:Reply-To:Cc; bh=Dw9rrkr+5g4VLJMantw/QcW9lWhQcKns1cAFQJ0YuZU=; b=PrsDayXhax/hoKn2L9ZaZQZGu65clei+gsmZYeD9fGmkAu8O1cSgoPahhAs/nols o10+V2c2A3Z0VSK1ds9kpL+L/tmcS/SQtUyr4h3LihWOF0ITcavRZIDwCaNeu6iEY+E OnY1R2NFjXQyhuRmO0rshGj1Y3ZZ+dSXakz/HW34= Received: from localhost (104-110-142-46.pool.kielnet.net [46.142.110.104]) by mx.zohomail.com with SMTPS id 1656853414967665.1597455044446; Sun, 3 Jul 2022 06:03:34 -0700 (PDT) References: <20220703115357.20195-1-rekado@elephly.net> User-agent: mu4e 1.6.11; emacs 28.1 From: Ricardo Wurmus To: 56330-done@debbugs.gnu.org Subject: Re: [PATCH v3] services: Add anonip-service-type. Date: Sun, 03 Jul 2022 15:03:19 +0200 In-reply-to: <20220703115357.20195-1-rekado@elephly.net> X-URL: https://elephly.net X-PGP-Key: https://elephly.net/rekado.pubkey X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC Message-ID: <871qv25ows.fsf@elephly.net> MIME-Version: 1.0 Content-Type: text/plain X-ZohoMailClient: External X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 56330-done X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: debbugs-submit-bounces@debbugs.gnu.org Sender: "Debbugs-submit" X-Spam-Score: -1.0 (-) Ricardo Wurmus writes: > * gnu/services/web.scm (anonip-configuration): New record type. > (anonip-configuration?, anonip-configuration-anonip, > anonip-configuration-input, anonip-configuration-output, > anonip-configuration-skip-private?, anonip-configuration-column, > anonip-configuration-replacement, anonip-configuration-ipv4mask, > anonip-configuration-ipv6mask, anonip-configuration-increment, > anonip-configuration-delimiter, anonip-configuration-regex): New procedures. > (anonip-service-type): New service type. > * doc/guix.texi (Log Rotation): Add subheading for Anonip Service. Merged. -- Ricardo From unknown Wed Jun 18 23:15:58 2025 Received: (at fakecontrol) by fakecontrolmessage; To: internal_control@debbugs.gnu.org From: Debbugs Internal Request Subject: Internal Control Message-Id: bug archived. Date: Mon, 01 Aug 2022 11:24:04 +0000 User-Agent: Fakemail v42.6.9 # This is a fake control message. # # The action: # bug archived. thanks # This fakemail brought to you by your local debbugs # administrator