Adjust headers for <machine/stdint.h> visibility.

This also reduces namespace pollution a bit. Include <machine/stdint.h>
where <stdint.h> is used too. External compiler under -ffreestanding
(_

Adjust headers for <machine/stdint.h> visibility.

This also reduces namespace pollution a bit. Include <machine/stdint.h>
where <stdint.h> is used too. External compiler under -ffreestanding
(__STDC_HOSTED__ == 0) will use their own <stdint.h> version and will
not include <machine/stdint.h>.

show more ...

<wchar.h>: Remove limits pollution.

The <wchar.h> now should properly only define WCHAR_MIN/WCHAR_MAX as per
opengroups. Fix fallout in col(1) that makes use of INT_MIN/INT_MAX.

No binary diffe

<wchar.h>: Remove limits pollution.

The <wchar.h> now should properly only define WCHAR_MIN/WCHAR_MAX as per
opengroups. Fix fallout in col(1) that makes use of INT_MIN/INT_MAX.

No binary differences for buildworld.

While there, add comment why <ctype.h> is in <wchar.h>.

show more ...

<wchar.h>: Implement correct limits for different wchar_t flavors.

Try best to select correct limits while always using handpicked standard
C wchar_t bounds that match internal rune_t and standard

<wchar.h>: Implement correct limits for different wchar_t flavors.

Try best to select correct limits while always using handpicked standard
C wchar_t bounds that match internal rune_t and standard wint_t types.
It might be worth to switch to using compiler provided limits for all.
The <stdint.h> header should provide limits for all types in standard
headers, so provide wint_t (<wchar.h>, <wctype.h>) limits too.
The <machine/wchar_limits.h> idea taken from NetBSD.

show more ...

<wchar.h>: Refactor wchar_t/wint_t/mb_state setup.

Kernel has no wchar support functions (except for VKERNEL64).

* Extract wide-character types setup to common <machine/wchar.h>.
* Avoid using _

<wchar.h>: Refactor wchar_t/wint_t/mb_state setup.

Kernel has no wchar support functions (except for VKERNEL64).

* Extract wide-character types setup to common <machine/wchar.h>.
* Avoid using __wchar_t for clang -fms-extensions issue.
* Add more handling for c++ and -fshort-wchar (not supported in libc).

This essentially removes these types from kernel namespace and paves
the way for further both userland/kernelland visibility cleanup by
making <sys/stdint.h> clean.
The WCHAR_MAX/WCHAR_MIN limits will be addressed in separate commit.

show more ...

Use recently added attributes in few standard headers.

There attributes are to assits compiler making better analysis
doring compilation time. Like branch prediction and hinting.

While there, for n

Use recently added attributes in few standard headers.

There attributes are to assits compiler making better analysis
doring compilation time. Like branch prediction and hinting.

While there, for now prefer to use __attribute__((__noreturn__)) to
_Noreturn, since neither OpenBSD or NetBSD has it at all and in our
variant we don't handle it in c++ case ([[noreturn]]) anyway.
Looks to be only a workaround for some old clang++ version.

show more ...

<wchar.h>: Fix namespace pollution from <stdio.h>

Quite cleaner way.
TODO: FILE should be only visible SUSv2 and POSIX.1-2001

<wchar.h>: Explicitly add va_list definition.

Looks like there are serious namespace pollution going on in wchar.h.
Still this header should provide va_list definition as per POSIX and not
rely on p

<wchar.h>: Explicitly add va_list definition.

Looks like there are serious namespace pollution going on in wchar.h.
Still this header should provide va_list definition as per POSIX and not
rely on pollution that once gets fixed the defintion would be still there.

While there, add empty #ifdef va_start block to prevent dports gcc compilers
from "fixing" this header and causing header shadowing (current variant is fine).

show more ...

<wchar.h>: Reduce namespace pollution in <wchar.h>.

Revert "<stdio.h>/<wchar.h>: Reduce namespace pollution in <wchar.h>."

This reverts commit 69e6516956c27905b4070759b0c597e6ab8b1ba5.

It looks like something in our C++ headers causes breakage in so

Revert "<stdio.h>/<wchar.h>: Reduce namespace pollution in <wchar.h>."

This reverts commit 69e6516956c27905b4070759b0c597e6ab8b1ba5.

It looks like something in our C++ headers causes breakage in some
dports when <wchar.h> doesn't also include <stdio.h>, specifically,
including <iostream> does not seem to bring in <stdio.h>
automatically, as it is on FreeBSD and Linux.

Since it is legal (per standard) for <wchar.h> to also provide the
symbols of <stdio.h>, revert this change for now.

show more ...

<stdio.h>/<wchar.h>: Reduce namespace pollution in <wchar.h>.

Instead of including the whole of <stdio.h> in <wchar.h>, just define
FILE there too, which is all it needs.

Based on FreeBSD's similar

<stdio.h>/<wchar.h>: Reduce namespace pollution in <wchar.h>.

Instead of including the whole of <stdio.h> in <wchar.h>, just define
FILE there too, which is all it needs.

Based on FreeBSD's similar definitions.

show more ...

libc: Sync open_memstream(3) with FreeBSD. Also add open_wmemstream(3).

Their open_memstream(3) implementation is more compliant than ours was.

Taken-from: FreeBSD

Update some more symbols maps for libc

This continues the work towards versioning libc. I found that a wchar
function, open_wmemstream(), had a prototype but was not implemented on
DragonFly (but i

Update some more symbols maps for libc

This continues the work towards versioning libc. I found that a wchar
function, open_wmemstream(), had a prototype but was not implemented on
DragonFly (but it is on FreeBSD) so I filtered it out with #if 0 block.

show more ...

locale - Add two new API functions

* Add wcrtombin() and mbintowcr(), powerful buffer-to-buffer functions
to translate UTF8, which can also perform escaping and de-escaping,
allow legacy parsing

locale - Add two new API functions

* Add wcrtombin() and mbintowcr(), powerful buffer-to-buffer functions
to translate UTF8, which can also perform escaping and de-escaping,
allow legacy parsing, and do checks with varying levels of strictness.

NOTE: If no locale or "C" locale, these functions are 1:1 (do not do
UTF8 processing). A UTF8 locale must be used to access these
functions.

* Add wcrtoutf8() and utf8towcr(). These work exactly the same as
the above functions but are locale-agnostic. They always operate in
UTF8 and locale initialization is not necessary.

* Escaping and de-escaping for 8-bit-clean round-trips with two of the
modes.

* Can construct UTF8B from unescaped 8-bit-clean data, can deconstruct
UTF8B (restore the original clean data), and can also be flagged
generically to take already-escaped UTF8B or wchars as input.

* Can be used to perform strict checks.

* Very powerful incremental buffer validation and processing capabilities.
Far more visibility to the caller rather than hiding state in a tracking
state structure. No tracking state structure.

* Does not do idiotic nul buffer termination. Caller passes explicitly
sized data, can opt to include or not include a terminator (depending
on what is desired), and the byte buffers can contain any 8-bit code
including 0x00.

show more ...

Remove redundant __BSD_VISIBLE checks in various header files.

When __BSD_VISIBLE is set to 1, we also set (in <sys/cdefs.h>):

#define __POSIX_VISIBLE 200809
#define __XSI_VISIBLE 700
#define __I

Remove redundant __BSD_VISIBLE checks in various header files.

When __BSD_VISIBLE is set to 1, we also set (in <sys/cdefs.h>):

#define __POSIX_VISIBLE 200809
#define __XSI_VISIBLE 700
#define __ISO_C_VISIBLE 2011

show more ...

locales, libconv: Sync with FreeBSD (extensive reach)

What started out as a relatively simply upgrade to libiconv finally
resulted in a simultaneous overhaul to locales, strings, and stdio.
All of t

locales, libconv: Sync with FreeBSD (extensive reach)

What started out as a relatively simply upgrade to libiconv finally
resulted in a simultaneous overhaul to locales, strings, and stdio.
All of these are interdependent and there is no way to upgrade them
individually or in steps.

These cases are similar to what happened with libm where significant
syncing came from NetBSD previously, rendering contributions from
FreeBSD difficult. Libiconv and locales (both ancient) are now in
sync with FreeBSD HEAD.

As several headers were signficantly updated and the mtree was updated
to accommodate the new include/xlocale directory, this commit will
require a full world build. It also may cause some dports to no longer
build due to prototype differences, but the dports will be adjusted.

The regexp library was not being used. It was removed from FreeBSD four
years ago. Since it required collate updates, I took the opportunity to
remove it completely by adding re_comp functionality to 4.3 compat
library like FreeBSD did.

__DragonFly_version has been bumped to 500300.

show more ...

<wchar.h>: We don't have wcswcs(), so remove prototype.

Initial import of binutils 2.22 on the new vendor branch

Future versions of binutils will also reside on this branch rather
than continuing to create new binutils branches for each new version.

libc: Add wcsncasecmp function

This function performs a case-insensitive string comparison test of
not more than a specified number of wide characters. It is a GNU
extension, not POSIX. Some packa

libc: Add wcsncasecmp function

This function performs a case-insensitive string comparison test of
not more than a specified number of wide characters. It is a GNU
extension, not POSIX. Some packages in pkgsrc may require it.

show more ...

libc: Add wcscasecmp function

This function performs a case-insensitive string comparison test on
wide characters. It is a GNU extension, not POSIX. Some packages
in pkgsrc require it.

Add the wcsnlen() function.

Obtained-from: FreeBSD

Add wcstof() and wcstold() functions.

Obtained-from: NetBSD

Include <sys/_null.h> for the definition of NULL.

Remove #ifndef __cplusplus around wchar related stuff in include/wchar.h
and sys/sys/stdint.h headers. It allows to build libstdc++ with std::w*
(wstring, wint_t etc) support.

Amongst others fixes b

Remove #ifndef __cplusplus around wchar related stuff in include/wchar.h
and sys/sys/stdint.h headers. It allows to build libstdc++ with std::w*
(wstring, wint_t etc) support.

Amongst others fixes building boost libraries with g++41.

Approved-by: corecode@

show more ...

Add declaration of struct tm to suppress a warning.

Add wcsftime(3).

Obtained-from: FreeBSD