dsynth - Enable ccache support

* Get ccache support working

Tested-by: kworr, dillon

dsynth - Properly set __MAKE_CONF for pkglist scan

* Properly set __MAKE_CONF to /dev/null for bulk scna (outside of
chroot) operations, we don't want dsynth to use the system's
/etc/make.conf.

dsynth - Properly set __MAKE_CONF for pkglist scan

* Properly set __MAKE_CONF to /dev/null for bulk scna (outside of
chroot) operations, we don't want dsynth to use the system's
/etc/make.conf.

Reported-by: zrj

show more ...

dsynth - Stabilization, improve compatibility

* Disable /etc/make.conf for the bulk scan (__MAKE_CONF=/dev/null)

* Add -D to turn on developer mode (from zrj)

* Add a little infrastructure to cach

dsynth - Stabilization, improve compatibility

* Disable /etc/make.conf for the bulk scan (__MAKE_CONF=/dev/null)

* Add -D to turn on developer mode (from zrj)

* Add a little infrastructure to cache ports variables, starting
with _PERL5_FROM_BIN.

show more ...

dsynth - Stabilization

* Rejigger the dynamic load management calculations and fix bugs in
how the restrictions based on pkgdep memory use are calculated.

The pkgdep memory mechanism now suppor

dsynth - Stabilization

* Rejigger the dynamic load management calculations and fix bugs in
how the restrictions based on pkgdep memory use are calculated.

The pkgdep memory mechanism now supports both slow-start and
slow-approach. The slow-approach mechanism begins when pkgdep
memory use goes about 1/2 the target (typically 1/4 physical memory).

In slow-approach mode, the number of workers is increased at a
rate of 1 every 30 seconds instead of 1 every 5 seconds in order
to give workers time to install the packages and fill in the estimated
memory use. The idea is that this then allows paging to ramp up
more slowly instead of getting 'shocked' by a dozen slots all
issuing install-pkgs at the same time.

* Add -m gb (in gigabytes), to override the default pkgdep memory
target.

* For now stop mounting /usr/src in the workers.

* NCurses disablement now works as expected.

* Calculate 1 gigabyte as 1GiB.

* Fix a bug in bulk accounting that could sometimes cause the bulk
scans to block indefinitely.

show more ...

dsynth - Get skips working, etc

* Get 'Skipped' working, and print a nice depdency chain for the reason
why a packge got skipped.

* Added swap% to the dynamic worker reduction algorithm. It star

dsynth - Get skips working, etc

* Get 'Skipped' working, and print a nice depdency chain for the reason
why a packge got skipped.

* Added swap% to the dynamic worker reduction algorithm. It startsr at
10% swap used and maxes out at a 75% reduction with 40% of swap used.

* Add a slow-start feature so dsynth does not try to load all workers
at startup simultaneously. This gives the swap% and loadavg worker
reduction code a chance to activate before the system becomes totally
smashed.

* Cache the 0*.log logfile descirptors instead of open/write/close.

show more ...

dsynth - Initial commit (unhooked from buildworld)

* DSynth is basically synth written in C, from scratch. It is designed
to give us a bulk builder in base and be friendly to porting and jails

dsynth - Initial commit (unhooked from buildworld)

* DSynth is basically synth written in C, from scratch. It is designed
to give us a bulk builder in base and be friendly to porting and jails
down the line (for now its uses chroot's).

The original synth was written by John R. Marino and its basic flow
was used in writing this program, but as it was written in ada no
code was directly copied.

* The intent is to make dsynth compatible with synth's configuration
files and directory structure.

* This is a work in progress and not yet ready for prime-time. Pushing
so we can get some more eyeballs. Most of the directives do not yet
work (everything, and build works, and 'cleanup' can be used to clean
up any dangling mounts).

* Not connected to the build yet. A great deal more work is needed.
As-of this commit, these areas need work:

- Uname/architecture/release-versioning stuff.

- Possibly additional environment variables or make variables
for certain cases and situations.

- The repo building step.

- Web interface.

- Dynamic load management (reduce the number of workers dynamically
based on load/ncpus).

- curses cleanup and window resizing.

show more ...