I found a workaround or a possible fix. The slowdown goes away if I add to font-encoding-alist an entry for the registry ksx1001.1998. A patch is attached.