localedef(1): Remove GCC pragmas on two source files

Taken-from: FreeBSD

localedef: Replace avl tree (cddl) with RB tree, plus ...

When FreeBSD adopted DragonFly's locales, the AVL tree code was replaced
with an RB tree equivalent. While cddl wasn't an issue here, let's

localedef: Replace avl tree (cddl) with RB tree, plus ...

When FreeBSD adopted DragonFly's locales, the AVL tree code was replaced
with an RB tree equivalent. While cddl wasn't an issue here, let's bring
in FreeBSD's changes since they did the work.

Some other changes:
* replace (safe) strcpy+strncat with snprintf
* rework charmap types/prototypes to remove GCC pragmas
* Support case where wchar_t is an unsigned int (ARM)
* Change -D "DragonFly-style" option description to -D "BSD-style"

show more ...

localedef(1): Update license of 12 source files (CDDL => BSD2)

The localdef sources were relicensed to 2-clause BSD by Illumos project
on 4 July 2014:

https://github.com/Nexenta/illumos-nexenta/com

localedef(1): Update license of 12 source files (CDDL => BSD2)

The localdef sources were relicensed to 2-clause BSD by Illumos project
on 4 July 2014:

https://github.com/Nexenta/illumos-nexenta/commit/cf17542a37fc83d0ae093777e30d480423858c29

It was done for the benefit of the BSD community. It is a nice gesture,
but I don't see this being much of a change.

1) The bundled avl files are still CDDL licensed, so that may spread to
the entire program.

2) Even as CDDL, I didn't see this being an issue since localedef is
self-contained so CDDL is limited to it. (IANAL)

show more ...

localedef(1): Better bootstrap fix

We don't need to build localedef in ctools as well as bootstrap tools.
Moreover, when I removed from bootstrap tools, it built but segfaulted
on use. The COLL_WEI

localedef(1): Better bootstrap fix

We don't need to build localedef in ctools as well as bootstrap tools.
Moreover, when I removed from bootstrap tools, it built but segfaulted
on use. The COLL_WEIGHTS_MAX file needs to be in the header because
it affects the structure definition. When it's moved there, the build
on older platforms will succeed.

show more ...

localedef - Fix buildworld bootstrapping issue

* When running buildworld on an older system the localedef built in
BTOOLS using /usr/include/limits.h will fail building the locales.

* Fix the pro

localedef - Fix buildworld bootstrapping issue

* When running buildworld on an older system the localedef built in
BTOOLS using /usr/include/limits.h will fail building the locales.

* Fix the problem by adding localedef to CTOOLS.

* Also fix a problem where the old limits.h defines COLL_WEIGHTS_MAX as 0
and breaks the building of localedef itself. Check for the case in
collate.c.

show more ...

Add localedef(1), a locale definition generator tool

The localedef tool can read entire (and unmodified) CLDR posix definition
files, and generate all 6 LC categories: LC_COLLATE, LC_CTYPE, LC_TIME,

Add localedef(1), a locale definition generator tool

The localedef tool can read entire (and unmodified) CLDR posix definition
files, and generate all 6 LC categories: LC_COLLATE, LC_CTYPE, LC_TIME,
LC_NUMERIC, LC_MONETARY and LC_MESSAGES.

The last 4 of those aren't needed. We already have a tool that generates
msgdef, timedef, moneydef and numericdef. In the immediate future,
localedef will only be used generate LC_COLLATE files in a new format.
This will render colldef files unreadable, thus colldef will be removed
when this happens.

In the future, localedef will be tasked to generate LC_CTYPE files as
well. When that happens, the mklocale tool will be retired.

While localedef *can* read pristine POSIX files (which causes 6 files
to be generated), it will given files with only the LC_COLLATE part,
which will also have all the white space removed as well. Remove just
the spaces can save megabytes.

This tool has a long history with Solaris [1]. The Nexenta developers
modified it to read CLDR files and created the much richer collation
formats. The libc collation functions have to be modified to read the
new format (called "DragonFly-4.4") and to handle the new data structures.

The result will be that locale-sensitive tools and functions will now
properly sort multibyte and unicode strings. Our "BSD" sort is not locale
sensitive, so it will probably have to be replaced with GNU sort in order
to leverage our new collation capabilities.

This can't be hooked into the build yet. It needs the new header for
collate.c to define the data structures. Until that happens, this is
actually unbuildable.

[1] Linux also has a tool called localdef, but I do know know if it shares
a common history or if it uses CLDR POSIX files. It seems to have the
same purpose though.

show more ...