GNU bug report logs - #62493
xelatex won't render fonts correctly without full texlive

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 62493 in the body.
You can then email your comments to 62493 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: John Kehayias <john.kehayias <at> protonmail.com>
To: Guix Bugs <bug-guix <at> gnu.org>
Subject: xelatex won't render fonts correctly without full texlive
Date: Tue, 28 Mar 2023 04:14:08 +0000

[Message part 1 (text/plain, inline)]

Hi TeX Guixers,

Ran into a curious problem today of xelatex not properly rendering what I think is a mapping/ligature issue: the usual TeX ``something'' quote syntax should become proper double quotes (for English at least) but don't.

Here is a simple test tex file:

--8<---------------cut here---------------start------------->8---
\documentclass{article}
\begin{document}
``test quote''
\end{document}
--8<---------------cut here---------------end--------------->8---

If you compile it with

--8<---------------cut here---------------start------------->8---
guix shell texlive-base texlive-fontspec -- xelatex test.tex
--8<---------------cut here---------------end--------------->8---

you'll see the same quotes as in the tex file. Full log (test-bad.log) attached but the relevant line looks to me like

--8<---------------cut here---------------start------------->8---
Document Class: article 2020/04/10 v1.4m Standard LaTeX document class
(/gnu/store/npkjqvkgzj3pfhqwbcc504kgp1z6fj8s-profile/share/texmf-dist/tex/latex/base/size10.clo
File: size10.clo 2020/04/10 v1.4m Standard LaTeX file (size option)
Font mapping `tex-text.tec' for font `[lmroman10-regular]:mapping=tex-text;' not found.
)
--8<---------------cut here---------------end--------------->8---

I did try adding various packages, changing fonts and font settings, but to no avail.

Meanwhile, using

--8<---------------cut here---------------start------------->8---
guix shell texlive -- xelatex test.tex
--8<---------------cut here---------------end--------------->8---

gives a nicely rendered double quote mark. The log (also attached as test.log) shows no such similar message.

Some searching the most succinct and relevant summary I think is here <https://tex.stackexchange.com/questions/193412/what-is-happening-to-the-quotes>

Anyway, seems like something is missing when we use the minimal packages, but I can't seem to find what to add to guix shell to change the output of the pdf. Probably it is not captured in a package or is otherwise lost?

Any ideas?

Thanks!
John

PS: I don't think it is related, but xelatex will complain about not finding a fontspec.cfg either. I made one locally from what it used to be, but didn't change the output for me. I think it went missing here:

<https://git.savannah.gnu.org/cgit/guix.git/commit/?id=ad5dddc610fa19e78aaa1885106a419e55f0322b>

[test.log (application/octet-stream, attachment)]

[test-bad.log (application/octet-stream, attachment)]

Message #8 received at 62493 <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: 62493 <at> debbugs.gnu.org
Subject: xelatex won't render fonts correctly without full texlive
Date: Tue, 28 Mar 2023 12:12:28 +0200

FWIW, it does work with lualatex:

  guix shell --container texlive-base texlive-fontspec -- lualatex test.tex

-- 
Ricardo

Message #11 received at 62493 <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: 62493 <at> debbugs.gnu.org
Subject: Re: xelatex won't render fonts correctly without full texlive
Date: Tue, 28 Mar 2023 13:51:11 +0200

We seem to be missing the xetex package that provides files for font mapping:

--8<---------------cut here---------------start------------->8---
$ info tex-text.tec
tlmgr.pl: cannot find package tex-text.tec, searching for other matches:

Packages containing `tex-text.tec' in their title/description:

Packages containing files matching `tex-text.tec':
xepersian:
	texmf-dist/fonts/misc/xetex/fontmapping/xepersian/persian-tex-text.tec
xetex:
	texmf-dist/fonts/misc/xetex/fontmapping/base/tex-text.tec
--8<---------------cut here---------------end--------------->8---

I was under the impression that we did have a xetex package, but I can’t
find it now.

-- 
Ricardo

Message #14 received at 62493 <at> debbugs.gnu.org (full text, mbox):

From: John Kehayias <john.kehayias <at> protonmail.com>
To: Ricardo Wurmus <rekado <at> elephly.net>
Cc: 62493 <at> debbugs.gnu.org
Subject: Re: bug#62493: xelatex won't render fonts correctly without full
 texlive
Date: Wed, 29 Mar 2023 15:21:55 +0000

Hi Ricardo,

Note that I didn't get your replies as it was sent just to the debbugs
email (I always find it strange that the bug email alias doesn't send to
the submitter by default). This message from Simon was helpful for me,
at least via Emacs: https://issues.guix.gnu.org/59855#2 (perhaps you
already know or have some other method, but thought I'd mention it and
I'm open to more such tricks!)

Ricardo Wurmus <rekado <at> elephly.net> writes:

> We seem to be missing the xetex package that provides files for font mapping:
>
> $ info tex-text.tec
> tlmgr.pl: cannot find package tex-text.tec, searching for other matches:
>
> Packages containing `tex-text.tec' in their title/description:
>
> Packages containing files matching `tex-text.tec':
> xepersian:
> 	texmf-dist/fonts/misc/xetex/fontmapping/xepersian/persian-tex-text.tec
> xetex:
> 	texmf-dist/fonts/misc/xetex/fontmapping/base/tex-text.tec
>

Ah, that's good to know, thanks for figuring that out.

> I was under the impression that we did have a xetex package, but I can’t
> find it now.

I also don't see any record of such a package. Trying

--8<---------------cut here---------------start------------->8---
guix shell subversion -- guix import texlive xetex
[...]
Exported revision 59745.
A    /tmp/guix-directory.cKaqWd/doc/xetex/base
A    /tmp/guix-directory.cKaqWd/doc/xetex/base/NEWS
A    /tmp/guix-directory.cKaqWd/doc/xetex/base/README
A    /tmp/guix-directory.cKaqWd/doc/xetex/base/XeTeX-notes.pdf
A    /tmp/guix-directory.cKaqWd/doc/xetex/base/XeTeX-notes.tex
Exported revision 59745.
A    /tmp/guix-directory.cKaqWd/fonts/misc/xetex/fontmapping/base
A    /tmp/guix-directory.cKaqWd/fonts/misc/xetex/fontmapping/base/qx-unicode.map
A    /tmp/guix-directory.cKaqWd/fonts/misc/xetex/fontmapping/base/qx-unicode.tec
A    /tmp/guix-directory.cKaqWd/fonts/misc/xetex/fontmapping/base/tex-text.map
A    /tmp/guix-directory.cKaqWd/fonts/misc/xetex/fontmapping/base/tex-text.tec
Exported revision 59745.
svn: E160013: File not found: revision 66702, path '/tags/texlive-2021.3/Master/texmf-dist/tcode'
command "svn" "export" "--non-interactive" "--trust-server-cert" "-r" "59745" "svn://www.tug.org/texlive/tags/texlive-2021.3/Master/texmf-dist/tcode/" "/tmp/guix-directory.cKaqWd/tcode/" failed with status 1
guix import: error: failed to download description for package 'xetex'
--8<---------------cut here---------------end--------------->8---

or with a -r as well:

--8<---------------cut here---------------start------------->8---
Exported revision 59745.
A    /tmp/guix-directory.XcAtR6/doc/xetex/base
A    /tmp/guix-directory.XcAtR6/doc/xetex/base/NEWS
A    /tmp/guix-directory.XcAtR6/doc/xetex/base/README
A    /tmp/guix-directory.XcAtR6/doc/xetex/base/XeTeX-notes.pdf
A    /tmp/guix-directory.XcAtR6/doc/xetex/base/XeTeX-notes.tex
Exported revision 59745.
A    /tmp/guix-directory.XcAtR6/fonts/misc/xetex/fontmapping/base
A    /tmp/guix-directory.XcAtR6/fonts/misc/xetex/fontmapping/base/qx-unicode.map
A    /tmp/guix-directory.XcAtR6/fonts/misc/xetex/fontmapping/base/qx-unicode.tec
A    /tmp/guix-directory.XcAtR6/fonts/misc/xetex/fontmapping/base/tex-text.map
A    /tmp/guix-directory.XcAtR6/fonts/misc/xetex/fontmapping/base/tex-text.tec
Exported revision 59745.
svn: E160013: File not found: revision 66702, path '/tags/texlive-2021.3/Master/texmf-dist/tcode'
command "svn" "export" "--non-interactive" "--trust-server-cert" "-r" "59745" "svn://www.tug.org/texlive/tags/texlive-2021.3/Master/texmf-dist/tcode/" "/tmp/guix-directory.XcAtR6/tcode/" failed with status 1
Backtrace:
           8 (primitive-load "/home/john/.config/guix/current/bin/gu…")
In guix/ui.scm:
   2300:7  7 (run-guix . _)
  2263:10  6 (run-guix-command _ . _)
In guix/scripts/import.scm:
    89:11  5 (guix-import . _)
In ice-9/boot-9.scm:
  1752:10  4 (with-exception-handler _ _ #:unwind? _ # _)
In guix/scripts/import/texlive.scm:
    92:38  3 (_)
In guix/import/utils.scm:
   638:27  2 (recursive-import _ #:repo->guix-package _ #:guix-name . #)
   630:33  1 (lookup-node "xetex" #f)
In ice-9/boot-9.scm:
  1685:16  0 (raise-exception _ #:continuable? _)

ice-9/boot-9.scm:1685:16: In procedure raise-exception:
Wrong number of values returned to continuation (expected 2)
--8<---------------cut here---------------end--------------->8---

I'm not up to with texlive packaging, any tips? Or perhaps someone we
can ask for input here?

Thanks!
John

Message #17 received at 62493 <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: John Kehayias <john.kehayias <at> protonmail.com>
Cc: 62493 <at> debbugs.gnu.org
Subject: Re: bug#62493: xelatex won't render fonts correctly without full
 texlive
Date: Wed, 29 Mar 2023 17:32:22 +0200

John Kehayias <john.kehayias <at> protonmail.com> writes:

> Exported revision 59745.
> svn: E160013: File not found: revision 66702, path '/tags/texlive-2021.3/Master/texmf-dist/tcode'
> command "svn" "export" "--non-interactive" "--trust-server-cert" "-r" "59745" "svn://www.tug.org/texlive/tags/texlive-2021.3/Master/texmf-dist/tcode/" "/tmp/guix-directory.XcAtR6/tcode/" failed with status 1

The importer is naive and assumes that any file in tlpdb starts with
“texmf-dist/”.  For the xetex package there’s a file
“tlpkg/tlpostcode/xetex.pl” and if you drop the same number of
characters that you would for “texmf-dist/” you end up with
“tcode/xetex.pl”.

Oops!

-- 
Ricardo

Message #20 received at 62493 <at> debbugs.gnu.org (full text, mbox):

From: John Kehayias <john.kehayias <at> protonmail.com>
To: Ricardo Wurmus <rekado <at> elephly.net>
Cc: 62493 <at> debbugs.gnu.org
Subject: Re: bug#62493: xelatex won't render fonts correctly without full
 texlive
Date: Wed, 29 Mar 2023 16:35:21 +0000

"Ricardo Wurmus" <rekado <at> elephly.net> writes:

> John Kehayias <john.kehayias <at> protonmail.com> writes:
>
>> Exported revision 59745.
>> svn: E160013: File not found: revision 66702, path
>> '/tags/texlive-2021.3/Master/texmf-dist/tcode'
>> command "svn" "export" "--non-interactive" "--trust-server-cert"
>> "-r" "59745"
>> "svn://www.tug.org/texlive/tags/texlive-2021.3/Master/texmf-dist/tcode/"
>> "/tmp/guix-directory.XcAtR6/tcode/" failed with status 1
>
> The importer is naive and assumes that any file in tlpdb starts with
> “texmf-dist/”.  For the xetex package there’s a file
> “tlpkg/tlpostcode/xetex.pl” and if you drop the same number of
> characters that you would for “texmf-dist/” you end up with
> “tcode/xetex.pl”.
>
> Oops!

Unfortunately that leaves me at a bit of a loss for making a
texlive-xetex package as I'm not understanding the whole texlive package
structure at first glance. I've tried something similar to other
packages I see but haven't gotten anywhere.

Any pointers or similar package to look at?

Thanks!

Message #25 received at 62493-done <at> debbugs.gnu.org (full text, mbox):

From: John Kehayias <john.kehayias <at> protonmail.com>
To: Ricardo Wurmus <rekado <at> elephly.net>
Cc: 62493-done <at> debbugs.gnu.org
Subject: Re: bug#62493: xelatex won't render fonts correctly without full
 texlive
Date: Wed, 29 Mar 2023 19:35:40 +0000

Hi Ricardo,

On Wed, Mar 29, 2023 at 05:32 PM, Ricardo Wurmus wrote:

> John Kehayias <john.kehayias <at> protonmail.com> writes:
>
>> Exported revision 59745.
>> svn: E160013: File not found: revision 66702, path
>> '/tags/texlive-2021.3/Master/texmf-dist/tcode'
>> command "svn" "export" "--non-interactive" "--trust-server-cert"
>> "-r" "59745"
>> "svn://www.tug.org/texlive/tags/texlive-2021.3/Master/texmf-dist/tcode/"
>> "/tmp/guix-directory.XcAtR6/tcode/" failed with status 1
>
> The importer is naive and assumes that any file in tlpdb starts with
> “texmf-dist/”.  For the xetex package there’s a file
> “tlpkg/tlpostcode/xetex.pl” and if you drop the same number of
> characters that you would for “texmf-dist/” you end up with
> “tcode/xetex.pl”.
>
> Oops!

I see you pushed some fixes for this (I didn't try with -r as that kept running for a while and might have tried to generate a whole lot of the dependency tree), thanks! I do get an import for xetex now.

And on that note I see cbf731ae481b434e657b05c80b4a32282e5d112b which adds texlive-xetex.

I can confirm with guix shell texlive-base texlive-fontspec texlive-xetex -- xelatex test.tex the output pdf has proper quotation marks and the log looks clean.

Many thanks!
John

Message #28 received at 62493-done <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: John Kehayias <john.kehayias <at> protonmail.com>
Cc: 62493-done <at> debbugs.gnu.org
Subject: Re: bug#62493: xelatex won't render fonts correctly without full
 texlive
Date: Wed, 29 Mar 2023 22:18:35 +0200

John Kehayias <john.kehayias <at> protonmail.com> writes:

> "Ricardo Wurmus" <rekado <at> elephly.net> writes:
>
>> John Kehayias <john.kehayias <at> protonmail.com> writes:
>>
>>> Exported revision 59745.
>>> svn: E160013: File not found: revision 66702, path
>>> '/tags/texlive-2021.3/Master/texmf-dist/tcode'
>>> command "svn" "export" "--non-interactive" "--trust-server-cert"
>>> "-r" "59745"
>>> "svn://www.tug.org/texlive/tags/texlive-2021.3/Master/texmf-dist/tcode/"
>>> "/tmp/guix-directory.XcAtR6/tcode/" failed with status 1
>>
>> The importer is naive and assumes that any file in tlpdb starts with
>> “texmf-dist/”.  For the xetex package there’s a file
>> “tlpkg/tlpostcode/xetex.pl” and if you drop the same number of
>> characters that you would for “texmf-dist/” you end up with
>> “tcode/xetex.pl”.
>>
>> Oops!
>
> Unfortunately that leaves me at a bit of a loss for making a
> texlive-xetex package as I'm not understanding the whole texlive package
> structure at first glance. I've tried something similar to other
> packages I see but haven't gotten anywhere.

Commit cbf731ae481b434e657b05c80b4a32282e5d112b adds texlive-xetex.  Now
the quotes look fine.

I adjusted the importer in a few commits after that, but generally the
recursive texlive importer suffers from the fact that we have a lot of
inconsistent package names.

-- 
Ricardo

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.