IronPort-PHdr: =?us-ascii?q?9a23=3AHgYIKxy9VX2rjB7XCy+N+z0kezQntrPoPwUc9p?=
               =?us-ascii?q?sgjfd0f7+++4j5ZRyPt+9giFbYB8PG7fMBi+fXv63kU2Ea7tCNvSNKa4RCAj?=
               =?us-ascii?q?kCj8hehAk8GIidE0SuLvnxYjQ6WttYVVBl41m+NlJTGcDxfEHbuCf05jlUBx?=
               =?us-ascii?q?asfRFtKLHTHYjfx9+yy/j0/pTSZwtSgz/oY7RpIQ226xrLt8YWnaNnLbw3yx?=
               =?us-ascii?q?3GuWdBYb4QzmQuOFHA1w3k6JKW+5huuz9Vp+pn98NEVvDieL8kSLVDEDk8G2?=
               =?us-ascii?q?U85cmuqhyaCAXTvT0TVWIZlhcOCA/AtUuoZJr6vyrku+Y44xG0ZpGsH5YzXz?=
               =?us-ascii?q?nqr71mTBb50mEaMT988GzWhsF0hq9Br1Stqk43xYmce4yTOPdkG8GVNdoHWW?=
               =?us-ascii?q?pMWNpQXC1dE8u9aYUIFe8IIedfqcH0uVIPqRK0AQTkCvnoz3dEgXr/3Kty1O?=
               =?us-ascii?q?pEc0mO3gs7EsoO9mvOrdr1KI8XVvqzza/H1inKdakQ0jC79YuJOhEtrPeQXK?=
               =?us-ascii?q?5hJNLLwBpKdUuNhVGRpIr5ejKNg75V4i7Lsqw5D7Lp1zV04xt8qTWu2Mo235?=
               =?us-ascii?q?PEgosEkBbZ8yQ8wIs0KdC8QkNhbpioHcg11WnSOo1oT8clW2wttjw9z+hMu5?=
               =?us-ascii?q?mgcTAKjos9xhHfd9SCdJKO4xTsT/qYO20+j3UjZbH11HPQuQCwj/bxUMW5yg?=
               =?us-ascii?q?MArC1en8HM8G8X1hPT9uCCTeF7/0GuwiqGzVqV4eYCPEN+xs+5Y9Yxh7U3kJ?=
               =?us-ascii?q?QUq0HKGCT7zV73gKGhfUIh4uG06u7jb+y89KWRPIJ1lAzyd58WtJfjXrYeNQ?=
               =?us-ascii?q?4DFyiB9OC1xeel4Ev4BbVHj/E7lqPUqp+cKclJ7qi+SxRY1Iou8XPdR3+vzc?=
               =?us-ascii?q?gYkH8bLVlEZAPPjo7nPEvLKez5CvH3ikqlkTNizfTLdrP7BZCFIn/GmbbnNb?=
               =?us-ascii?q?FzjiwUgAg01t1H59RLELAOIO7bX0jrst3eAQQlOhbuhe3gTsh+l8sfVW+JHq?=
               =?us-ascii?q?6FIfbXuF6M6PgoJrrpBsddszL8Jv45ov/22CVhyBlNIO/wh8tRNCvrVu5rKE?=
               =?us-ascii?q?iYf3f2180MFW4b5EwjSu2viFCDXTNXbXuoUOQw62JeasruAIHdS4SqmLHE0j?=
               =?us-ascii?q?28G8gcZGddB0iMV2jydoqER98JbziUI8luiSANT+LnQIhnyBLk52qYg/J3a/?=
               =?us-ascii?q?HZ/CEVr8ep1t9u6vXT0w4o9DN0E+yY1HuLTmd7hX8BXWVw16c5vE83mTLhme?=
               =?us-ascii?q?BoxvdfE9JU/fZAVAw3YIXdw+JNANf3Qgvdf92NRQ/8EO+rCjwwUN89huQ2TR?=
               =?us-ascii?q?0hRIeEiRbOl2qwDrschubNGZo1t6LR3nT8I8xw0XmA2KRzx18hCtBCM2GrnM?=
               =?us-ascii?q?sdv0DaGpLJnkOFlq2rabVU3SjD832GxHaPu0cQWRB5UKHMV3QSLkXMqtGx6k?=
               =?us-ascii?q?THRr6oQbMpV2kJgdaFMbdPY8b1gE9uQf7iPJHBZjv0lTvrQxmPwbyIYczhfG?=
               =?us-ascii?q?BclCTRBU4YkhwCqHaLMQ9tY0Xp62naDTFoCRfuexa2qbg4+C79FxVkiV3RPA?=
               =?us-ascii?q?V72rG4+wAYn6mGRvcaz+hCpSEg7jV5HVqw29jbEdXGqwcyGccUKd47/lpD0n?=
               =?us-ascii?q?rU8gJnOZn1ZaJlnVMGc0JopULh1wlfD4Jal8kso2g2xRAob6mflk5CPWD9v9?=
               =?us-ascii?q?i4KvjMJ2/+8Qr6IbbRwU3b2c2K970n7f05rxD8uVjsGBZ5tXpg1NZR3j2X4Z?=
               =?us-ascii?q?CAX29wGdrhF00w8RZ9vbTTZCIwspjV2XNbOq6xqjbe2tgtCbJ5mCblRM9WNe?=
               =?us-ascii?q?a/LCG3C9cTXZD8LeswnVmvYQkYNfoIsqUzed6lJaPfifybed14lTfjtlxppY?=
               =?us-ascii?q?V000aC7S15ELaa2pEfxfCe0RCbXi2mylym9N30y9gdOGMiW1GnwC2hP7Z/I6?=
               =?us-ascii?q?1/eYFRVDWrKsyzg8p73tvjByUe+1mkCFcLnsSufEjKYg=3D=3D?=
References: <3939613963363954.WA.kellysmith12.21gmail.com@listserv.uni-heidelberg.de>
            <924058d3-d3a3-7e40-d799-fe0bc0e20ffb@morningstar2.co.uk>
            <20200316202737.k6wghfvw3hgtidv6@vento15post8>
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:68.0) Gecko/20100101
            Thunderbird/68.5.0
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Language: en-GB
Content-Transfer-Encoding: 7bit
Message-ID:  <9725bfd1-9f7b-4afc-a77c-0f54f43593ea@morningstar2.co.uk>
Date:         Mon, 16 Mar 2020 21:14:30 +0000
Reply-To:     Mailing list for the LaTeX3 project
              <LATEX-L@LISTSERV.UNI-HEIDELBERG.DE>
Sender:       Mailing list for the LaTeX3 project <LATEX-L@LISTSERV.UNI-HEIDELBERG.DE>
From:         Joseph Wright <joseph.wright@MORNINGSTAR2.CO.UK>
Subject: Re: Using Lua to Preprocess Unicode Data
To:           LATEX-L@LISTSERV.UNI-HEIDELBERG.DE
In-Reply-To:  <20200316202737.k6wghfvw3hgtidv6@vento15post8>
Precedence: list
Envelope-To: <rainer.schoepf@gmx.net>
Status: R

On 16/03/2020 20:27, Henri Menke wrote:
>> Now, there is more data being loaded today than when I did that work, and
>> some of it is in LuaTeX so could be done Lua-only. It's also possible that
>> the Perl script was sub-optimal, or that as part of a general 'install'
>> function the time would not really show. However, XeTeX needs the data, so
>> one is still looking at having to explicitly pre-process in Lua. Moreover,
>> most of the time taken for format-building is not about reading Unicode
>> data. With LuaTeX, pre-loading expl3 does cut out a slight 'stall' when
>> loading everything for case-changing, but having a LuaTeX and a XeTeX path
>> separately is not attractive.
> 
> Is there any distribution that doesn't have LuaTeX in the default
> installation?  (Apart from exotic things like TeX Live infra-only)  Then
> it would be conceivable to just make LuaTeX a hard requirement and
> process the Unicode data on the fly instead of going via CTAN.

There's KerTeX ... but that's not got XeTeX either I think (and doesn't 
have the pdfTeX utility primitives). Certainly one could pre-digest at 
the format-building stage, or perhaps as a post-update action for the 
Unicode data files. However, there's still the fact that even reading a 
'pre-digested' file takes non-zero time.

>> As format-building is all about saving time for 'normal' runs, I'm not
>> seeing there is a massive need to speed up the process. I know there is one
>> engine in development that doesn't use format files, so that might be a
>> place to consider things, but I think we'd need a strong case to alter the
>> approach for XeTeX/LuaTeX (pdfTeX, ...).
> 
> Are you referring to JSBox?  I doubt that this will every be public.

Yes, JSBox is what I have in mind.

Joseph