xref: /freebsd/usr.sbin/jail/jail.8 (revision 1edb7116)
1.\" Copyright (c) 2000, 2003 Robert N. M. Watson
2.\" Copyright (c) 2008-2012 James Gritton
3.\" All rights reserved.
4.\"
5.\" Redistribution and use in source and binary forms, with or without
6.\" modification, are permitted provided that the following conditions
7.\" are met:
8.\" 1. Redistributions of source code must retain the above copyright
9.\"    notice, this list of conditions and the following disclaimer.
10.\" 2. Redistributions in binary form must reproduce the above copyright
11.\"    notice, this list of conditions and the following disclaimer in the
12.\"    documentation and/or other materials provided with the distribution.
13.\"
14.\" THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS ``AS IS'' AND
15.\" ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
16.\" IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
17.\" ARE DISCLAIMED.  IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS BE LIABLE
18.\" FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
19.\" DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS
20.\" OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
21.\" HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
22.\" LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
23.\" OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF
24.\" SUCH DAMAGE.
25.\"
26.Dd January 17, 2024
27.Dt JAIL 8
28.Os
29.Sh NAME
30.Nm jail
31.Nd "manage system jails"
32.Sh SYNOPSIS
33.Ss From Configuration File
34.Nm
35.Op Fl cm
36.Op Fl dqv
37.Op Fl f Ar conf_file
38.Op Fl p Ar limit
39.Op Ar jail
40.Nm
41.Op Fl r
42.Op Fl qv
43.Op Fl f Ar conf_file
44.Op Fl p Ar limit
45.Op Cm * | Ar jail ...
46.Ss Without Configuration File
47.Nm
48.Op Fl cm
49.Op Fl dhilqv
50.Op Fl J Ar jid_file
51.Op Fl u Ar username
52.Op Fl U Ar username
53.Ar param Ns = Ns Ar value ...
54.Op Cm command Ns = Ns Ar command ...
55.Nm
56.Op Fl rR
57.Op Fl qv
58.Op Cm * | Ar jail ...
59.Ss Show Parameters
60.Nm
61.Op Fl f Ar conf_file
62.Fl e
63.Ar separator
64.Ss Backward Compatibility
65.Nm
66.Op Fl dhilqv
67.Op Fl J Ar jid_file
68.Op Fl u Ar username
69.Op Fl U Ar username
70.Op Fl n Ar jailname
71.Op Fl s Ar securelevel
72.Ar path hostname ip Ns Op Cm \&, Ns Ar ...
73.Ar command ...
74.Sh DESCRIPTION
75The
76.Nm
77utility creates new jails, or modifies or removes existing jails.
78It can also print a list of configured jails and their parameters.
79A jail
80.Pq or Dq prison
81is specified via parameters on the command line, or in the
82.Xr jail.conf 5
83file.
84.Pp
85At least one of the options
86.Fl c ,
87.Fl e ,
88.Fl m
89or
90.Fl r
91must be specified.
92These options are used alone or in combination to describe the operation to
93perform:
94.Bl -tag -width indent
95.It Fl c
96Create a new jail.
97The jail
98.Va jid
99and
100.Va name
101parameters (if specified on the command line)
102must not refer to an existing jail.
103.It Fl e Ar separator
104Exhibit a list of all configured non-wildcard jails and their parameters.
105No jail creation, modification or removal performed if this option is used.
106The
107.Ar separator
108string is used to separate parameters.
109Use
110.Xr jls 8
111utility to list running jails.
112.It Fl m
113Modify an existing jail.
114One of the
115.Va jid
116or
117.Va name
118parameters must exist and refer to an existing jail.
119Some parameters may not be changed on a running jail.
120.It Fl r
121Remove the
122.Ar jail
123specified by jid or name.
124All jailed processes are killed, and all jails that are
125children of this jail are also
126removed.
127.It Fl rc
128Restart an existing jail.
129The jail is first removed and then re-created, as if
130.Dq Nm Fl r
131and
132.Dq Nm Fl c
133were run in succession.
134.It Fl cm
135Create a jail if it does not exist, or modify the jail if it does exist.
136.It Fl mr
137Modify an existing jail.
138The jail may be restarted if necessary to modify parameters than could
139not otherwise be changed.
140.It Fl cmr
141Create a jail if it doesn't exist, or modify (and possibly restart) the
142jail if it does exist.
143.El
144.Pp
145Other available options are:
146.Bl -tag -width indent
147.It Fl f Ar conf_file
148Use configuration file
149.Ar conf_file
150instead of the default
151.Pa /etc/jail.conf .
152.It Fl h
153Resolve the
154.Va host.hostname
155parameter (or
156.Va hostname )
157and add all IP addresses returned by the resolver
158to the list of addresses for this jail.
159This is equivalent to the
160.Va ip_hostname
161parameter.
162.It Fl i
163Output (only) the jail identifier of the newly created jail(s).
164This implies the
165.Fl q
166option.
167.It Fl J Ar jid_file
168Write a
169.Ar jid_file
170file, containing the parameters used to start the jail.
171.It Fl l
172Run commands in a clean environment.
173This is deprecated and is equivalent to the exec.clean parameter.
174.It Fl n Ar jailname
175Set the jail's name.
176This is deprecated and is equivalent to the
177.Va name
178parameter.
179.It Fl p Ar limit
180Limit the number of commands from
181.Va  exec.*
182that can run simultaneously.
183.It Fl q
184Suppress the message printed whenever a jail is created, modified or removed.
185Only error messages will be printed.
186.It Fl R
187A variation of the
188.Fl r
189option that removes an existing jail without using the configuration file.
190No removal-related parameters for this jail will be used \(em the jail will
191simply be removed.
192.It Fl s Ar securelevel
193Set the
194.Va kern.securelevel
195MIB entry to the specified value inside the newly created jail.
196This is deprecated and is equivalent to the
197.Va securelevel
198parameter.
199.It Fl u Ar username
200The user name from host environment as whom jailed commands should run.
201This is deprecated and is equivalent to the
202.Va exec.jail_user
203and
204.Va exec.system_jail_user
205parameters.
206.It Fl U Ar username
207The user name from the jailed environment as whom jailed commands should run.
208This is deprecated and is equivalent to the
209.Va exec.jail_user
210parameter.
211.It Fl v
212Print a message on every operation, such as running commands and
213mounting filesystems.
214.It Fl d
215This is deprecated and is equivalent to the
216.Va allow.dying
217parameter, which is also deprecated.
218It used to allow making changes to a
219.Va dying
220jail.
221Now such jails are always replaced when a new jail is created with the same
222.Va jid
223or
224.Va name .
225.El
226.Pp
227If no arguments are given after the options, the operation (except
228remove) will be performed on all jails specified in the
229.Xr jail.conf 5
230file.
231A single argument of a jail name will operate only on the specified jail.
232The
233.Fl r
234and
235.Fl R
236options can also remove running jails that aren't in the
237.Xr jail.conf 5
238file, specified by name or jid.
239.Pp
240An argument of
241.Dq *
242is a wildcard that will operate on all jails, regardless of whether
243they appear in
244.Xr jail.conf 5 ;
245this is the surest way for
246.Fl r
247to remove all jails.
248If hierarchical jails exist, a partial-matching wildcard definition may
249be specified.
250For example, an argument of
251.Dq foo.*
252would apply to jails with names like
253.Dq foo.bar
254and
255.Dq foo.bar.baz .
256.Pp
257A jail may also be specified via parameters directly on the command line in
258.Dq name=value
259form, ignoring the contents of
260.Xr jail.conf 5 .
261For backward compatibility, the command line may also have four fixed
262parameters, without names:
263.Ar path ,
264.Ar hostname ,
265.Ar ip ,
266and
267.Ar command .
268.Ss Jail Parameters
269Parameters in the
270.Xr jail.conf 5
271file, or on the command line, are generally of the form
272.Dq name=value .
273Some parameters are boolean, and do not have a value but are set by the
274name alone with or without a
275.Dq no
276prefix, e.g.
277.Va persist
278or
279.Va nopersist .
280They can also be given the values
281.Dq true
282and
283.Dq false .
284Other parameters may have more than one value, specified as a
285comma-separated list or with
286.Dq +=
287in the configuration file (see
288.Xr jail.conf 5
289for details).
290.Pp
291The
292.Nm
293utility recognizes two classes of parameters.
294There are the true jail
295parameters that are passed to the kernel when the jail is created,
296which can be seen with
297.Xr jls 8 ,
298and can (usually) be changed with
299.Dq Nm Fl m .
300Then there are pseudo-parameters that are only used by
301.Nm
302itself.
303.Pp
304Jails have a set of core parameters, and kernel modules can add their own
305jail parameters.
306The current set of available parameters can be retrieved via
307.Dq Nm sysctl Fl d Va security.jail.param .
308Any parameters not set will be given default values, often based on the
309current environment.
310The core parameters are:
311.Bl -tag -width indent
312.It Va jid
313The jail identifier.
314This will be assigned automatically to a new jail (or can be explicitly
315set), and can be used to identify the jail for later modification, or
316for such commands as
317.Xr jls 8
318or
319.Xr jexec 8 .
320.It Va name
321The jail name.
322This is an arbitrary string that identifies a jail (except it may not
323contain a
324.Sq \&. ) .
325Like the
326.Va jid ,
327it can be passed to later
328.Nm
329commands, or to
330.Xr jls 8
331or
332.Xr jexec 8 .
333If no
334.Va name
335is supplied, a default is assumed that is the same as the
336.Va jid .
337The
338.Va name
339parameter is implied by the
340.Xr jail.conf 5
341file format, and need not be explicitly set when using the configuration
342file.
343.It Va path
344The directory which is to be the root of the jail.
345Any commands run inside the jail, either by
346.Nm
347or from
348.Xr jexec 8 ,
349are run from this directory.
350.It Va ip4.addr
351A list of IPv4 addresses assigned to the jail.
352If this is set, the jail is restricted to using only these addresses.
353Any attempts to use other addresses fail, and attempts to use wildcard
354addresses silently use the jailed address instead.
355For IPv4 the first address given will be used as the source address
356when source address selection on unbound sockets cannot find a better
357match.
358It is only possible to start multiple jails with the same IP address
359if none of the jails has more than this single overlapping IP address
360assigned to itself.
361.It Va ip4.saddrsel
362A boolean option to change the formerly mentioned behaviour and disable
363IPv4 source address selection for the jail in favour of the primary
364IPv4 address of the jail.
365Source address selection is enabled by default for all jails and the
366.Va ip4.nosaddrsel
367setting of a parent jail is not inherited for any child jails.
368.It Va ip4
369Control the availability of IPv4 addresses.
370Possible values are
371.Dq inherit
372to allow unrestricted access to all system addresses,
373.Dq new
374to restrict addresses via
375.Va ip4.addr ,
376and
377.Dq disable
378to stop the jail from using IPv4 entirely.
379Setting the
380.Va ip4.addr
381parameter implies a value of
382.Dq new .
383.It Va ip6.addr , Va ip6.saddrsel , Va ip6
384A set of IPv6 options for the jail, the counterparts to
385.Va ip4.addr ,
386.Va ip4.saddrsel
387and
388.Va ip4
389above.
390.It Va vnet
391Create the jail with its own virtual network stack,
392with its own network interfaces, addresses, routing table, etc.
393The kernel must have been compiled with the
394.Sy VIMAGE option
395for this to be available.
396Possible values are
397.Dq inherit
398to use the system network stack, possibly with restricted IP addresses,
399and
400.Dq new
401to create a new network stack.
402.It Va host.hostname
403The hostname of the jail.
404Other similar parameters are
405.Va host.domainname ,
406.Va host.hostuuid
407and
408.Va host.hostid .
409.It Va host
410Set the origin of hostname and related information.
411Possible values are
412.Dq inherit
413to use the system information and
414.Dq new
415for the jail to use the information from the above fields.
416Setting any of the above fields implies a value of
417.Dq new .
418.It Va securelevel
419The value of the jail's
420.Va kern.securelevel
421sysctl.
422A jail never has a lower securelevel than its parent system, but by
423setting this parameter it may have a higher one.
424If the system securelevel is changed, any jail securelevels will be at
425least as secure.
426.It Va devfs_ruleset
427The number of the devfs ruleset that is enforced for mounting devfs in
428this jail.
429A value of zero (default) means no ruleset is enforced.
430Descendant jails inherit the parent jail's devfs ruleset enforcement.
431Mounting devfs inside a jail is possible only if the
432.Va allow.mount
433and
434.Va allow.mount.devfs
435permissions are effective and
436.Va enforce_statfs
437is set to a value lower than 2.
438Devfs rules and rulesets cannot be viewed or modified from inside a jail.
439.Pp
440NOTE: It is important that only appropriate device nodes in devfs be
441exposed to a jail; access to disk devices in the jail may permit processes
442in the jail to bypass the jail sandboxing by modifying files outside of
443the jail.
444See
445.Xr devfs 8
446for information on how to use devfs rules to limit access to entries
447in the per-jail devfs.
448A simple devfs ruleset for jails is available as ruleset #4 in
449.Pa /etc/defaults/devfs.rules .
450.It Va children.max
451The number of child jails allowed to be created by this jail (or by
452other jails under this jail).
453This limit is zero by default, indicating the jail is not allowed to
454create child jails.
455See the
456.Sx "Hierarchical Jails"
457section for more information.
458.It Va children.cur
459The number of descendants of this jail, including its own child jails
460and any jails created under them.
461.It Va enforce_statfs
462This determines what information processes in a jail are able to get
463about mount points.
464It affects the behaviour of the following syscalls:
465.Xr statfs 2 ,
466.Xr fstatfs 2 ,
467.Xr getfsstat 2 ,
468and
469.Xr fhstatfs 2
470(as well as similar compatibility syscalls).
471When set to 0, all mount points are available without any restrictions.
472When set to 1, only mount points below the jail's chroot directory are
473visible.
474In addition to that, the path to the jail's chroot directory is removed
475from the front of their pathnames.
476When set to 2 (default), above syscalls can operate only on a mount-point
477where the jail's chroot directory is located.
478.It Va persist
479Setting this boolean parameter allows a jail to exist without any
480processes.
481Normally, a command is run as part of jail creation, and then the jail
482is destroyed as its last process exits.
483A new jail must have either the
484.Va persist
485parameter or
486.Va exec.start
487or
488.Va command
489pseudo-parameter set.
490.It Va cpuset.id
491The ID of the cpuset associated with this jail (read-only).
492.It Va dying
493This is true if the jail is in the process of shutting down (read-only).
494.It Va parent
495The
496.Va jid
497of the parent of this jail, or zero if this is a top-level jail
498(read-only).
499.It Va osrelease
500The string for the jail's
501.Va kern.osrelease
502sysctl and uname -r.
503.It Va osreldate
504The number for the jail's
505.Va kern.osreldate
506and uname -K.
507.It Va allow.*
508Some restrictions of the jail environment may be set on a per-jail
509basis.
510With the exception of
511.Va allow.set_hostname
512and
513.Va allow.reserved_ports ,
514these boolean parameters are off by default.
515.Bl -tag -width indent
516.It Va allow.set_hostname
517The jail's hostname may be changed via
518.Xr hostname 1
519or
520.Xr sethostname 3 .
521.It Va allow.sysvipc
522A process within the jail has access to System V IPC primitives.
523This is deprecated in favor of the per-module parameters (see below).
524When this parameter is set, it is equivalent to setting
525.Va sysvmsg ,
526.Va sysvsem ,
527and
528.Va sysvshm
529all to
530.Dq inherit .
531.It Va allow.raw_sockets
532The jail root is allowed to create raw sockets.
533Setting this parameter allows utilities like
534.Xr ping 8
535and
536.Xr traceroute 8
537to operate inside the jail.
538If this is set, the source IP addresses are enforced to comply
539with the IP address bound to the jail, regardless of whether or not
540the
541.Dv IP_HDRINCL
542flag has been set on the socket.
543Since raw sockets can be used to configure and interact with various
544network subsystems, extra caution should be used where privileged access
545to jails is given out to untrusted parties.
546.It Va allow.chflags
547Normally, privileged users inside a jail are treated as unprivileged by
548.Xr chflags 2 .
549When this parameter is set, such users are treated as privileged, and
550may manipulate system file flags subject to the usual constraints on
551.Va kern.securelevel .
552.It Va allow.mount
553privileged users inside the jail will be able to mount and unmount file
554system types marked as jail-friendly.
555The
556.Xr lsvfs 1
557command can be used to find file system types available for mount from
558within a jail.
559This permission is effective only if
560.Va enforce_statfs
561is set to a value lower than 2.
562.It Va allow.mount.devfs
563privileged users inside the jail will be able to mount and unmount the
564devfs file system.
565This permission is effective only together with
566.Va allow.mount
567and only when
568.Va enforce_statfs
569is set to a value lower than 2.
570The devfs ruleset should be restricted from the default by using the
571.Va devfs_ruleset
572option.
573.It Va allow.quotas
574The jail root may administer quotas on the jail's filesystem(s).
575This includes filesystems that the jail may share with other jails or
576with non-jailed parts of the system.
577.It Va allow.read_msgbuf
578Jailed users may read the kernel message buffer.
579If the
580.Va security.bsd.unprivileged_read_msgbuf
581MIB entry is zero, this will be restricted to the root user.
582.It Va allow.socket_af
583Sockets within a jail are normally restricted to IPv4, IPv6, local
584(UNIX), and route.
585This allows access to other protocol stacks that have not had jail
586functionality added to them.
587.It Va allow.mlock
588Locking or unlocking physical pages in memory are normally not available
589within a jail.
590When this parameter is set, users may
591.Xr mlock 2
592or
593.Xr munlock 2
594memory subject to
595.Va security.bsd.unprivileged_mlock
596and resource limits.
597.It Va allow.nfsd
598The
599.Xr mountd 8 ,
600.Xr nfsd 8 ,
601.Xr nfsuserd 8 ,
602.Xr gssd 8
603and
604.Xr rpc.tlsservd 8
605daemons are permitted to run inside a properly configured vnet-enabled jail.
606The jail's root must be a file system mount point and
607.Va enforce_statfs
608must not be set to 0, so that
609.Xr mountd 8
610can export file systems visible within the jail.
611.Va enforce_statfs
612must be set to 1 if file systems mounted under the
613jail's file system need to be exported by
614.Xr mount 8 .
615For exporting only the jail's file system, a setting of 2
616is sufficient.
617If the kernel configuration does not include the
618.Sy NFSD
619option,
620.Pa nfsd.ko
621must be loaded outside of the jails.
622This is normally done by adding
623.Dq nfsd
624to
625.Va kld_list
626in the
627.Xr rc.conf 5
628file outside of the jails.
629Similarily, if the
630.Xr gssd 8
631is to be run in a jail, either the kernel
632.Sy KGSSAPI
633option needs to be specified or
634.Dq kgssapi
635and
636.Dq kgssapi_krb5
637need to be in
638.Va kld_list
639in the
640.Xr rc.conf 5
641file outside of the jails.
642.It Va allow.reserved_ports
643The jail root may bind to ports lower than 1024.
644.It Va allow.unprivileged_proc_debug
645Unprivileged processes in the jail may use debugging facilities.
646.It Va allow.suser
647The value of the jail's
648.Va security.bsd.suser_enabled
649sysctl.
650The super-user will be disabled automatically if its parent system has it
651disabled.
652The super-user is enabled by default.
653.It Va allow.extattr
654Allow privileged process in the jail to manipulate filesystem extended
655attributes in the system namespace.
656.El
657.El
658.Pp
659Kernel modules may add their own parameters, which only exist when the
660module is loaded.
661These are typically headed under a parameter named after the module,
662with values of
663.Dq inherit
664to give the jail full use of the module,
665.Dq new
666to encapsulate the jail in some module-specific way,
667and
668.Dq disable
669to make the module unavailable to the jail.
670There also may be other parameters to define jail behavior within the module.
671Module-specific parameters include:
672.Bl -tag -width indent
673.It Va allow.mount.fdescfs
674privileged users inside the jail will be able to mount and unmount the
675fdescfs file system.
676This permission is effective only together with
677.Va allow.mount
678and only when
679.Va enforce_statfs
680is set to a value lower than 2.
681.It Va allow.mount.fusefs
682privileged users inside the jail will be able to mount and unmount
683fuse-based file systems.
684This permission is effective only together with
685.Va allow.mount
686and only when
687.Va enforce_statfs
688is set to a value lower than 2.
689.It Va allow.mount.nullfs
690privileged users inside the jail will be able to mount and unmount the
691nullfs file system.
692This permission is effective only together with
693.Va allow.mount
694and only when
695.Va enforce_statfs
696is set to a value lower than 2.
697.It Va allow.mount.procfs
698privileged users inside the jail will be able to mount and unmount the
699procfs file system.
700This permission is effective only together with
701.Va allow.mount
702and only when
703.Va enforce_statfs
704is set to a value lower than 2.
705.It Va allow.mount.linprocfs
706privileged users inside the jail will be able to mount and unmount the
707linprocfs file system.
708This permission is effective only together with
709.Va allow.mount
710and only when
711.Va enforce_statfs
712is set to a value lower than 2.
713.It Va allow.mount.linsysfs
714privileged users inside the jail will be able to mount and unmount the
715linsysfs file system.
716This permission is effective only together with
717.Va allow.mount
718and only when
719.Va enforce_statfs
720is set to a value lower than 2.
721.It Va allow.mount.tmpfs
722privileged users inside the jail will be able to mount and unmount the
723tmpfs file system.
724This permission is effective only together with
725.Va allow.mount
726and only when
727.Va enforce_statfs
728is set to a value lower than 2.
729.It Va allow.mount.zfs
730privileged users inside the jail will be able to mount and unmount the
731ZFS file system.
732This permission is effective only together with
733.Va allow.mount
734and only when
735.Va enforce_statfs
736is set to a value lower than 2.
737See
738.Xr zfs 8
739for information on how to configure the ZFS filesystem to operate from
740within a jail.
741.It Va allow.vmm
742The jail may access
743.Xr vmm 4 .
744This flag is only available when the
745.Xr vmm 4
746kernel module is loaded.
747.It Va linux
748Determine how a jail's Linux emulation environment appears.
749A value of
750.Dq inherit
751will keep the same environment, and
752.Dq new
753will give the jail its own environment (still originally inherited when
754the jail is created).
755.It Va linux.osname , linux.osrelease , linux.oss_version
756The Linux OS name, OS release, and OSS version associated with this jail.
757.It Va sysvmsg
758Allow access to SYSV IPC message primitives.
759If set to
760.Dq inherit ,
761all IPC objects on the system are visible to this jail, whether they
762were created by the jail itself, the base system, or other jails.
763If set to
764.Dq new ,
765the jail will have its own key namespace, and can only see the objects
766that it has created;
767the system (or parent jail) has access to the jail's objects, but not to
768its keys.
769If set to
770.Dq disable ,
771the jail cannot perform any sysvmsg-related system calls.
772.It Va sysvsem, sysvshm
773Allow access to SYSV IPC semaphore and shared memory primitives, in the
774same manner as
775.Va sysvmsg .
776.El
777.Pp
778There are pseudo-parameters that are not passed to the kernel, but are
779used by
780.Nm
781to set up the jail environment, often by running specified commands
782when jails are created or removed.
783The
784.Va exec.*
785command parameters are
786.Xr sh 1
787command lines that are run in either the system or jail environment.
788They may be given multiple values, which would run the specified
789commands in sequence.
790All commands must succeed (return a zero exit status), or the jail will
791not be created or removed, as appropriate.
792.Pp
793The pseudo-parameters are:
794.Bl -tag -width indent
795.It Va exec.prepare
796Command(s) to run in the system environment to prepare a jail for creation.
797These commands are executed before assigning IP addresses and mounting
798filesystems, so they may be used to create a new jail filesystem if it does
799not already exist.
800.It Va exec.prestart
801Command(s) to run in the system environment before a jail is created.
802.It Va exec.created
803Command(s) to run in the system environment right after a jail has been
804created, but before commands (or services) get executed in the jail.
805.It Va exec.start
806Command(s) to run in the jail environment when a jail is created.
807A typical command to run is
808.Dq sh /etc/rc .
809.It Va command
810A synonym for
811.Va exec.start
812for use when specifying a jail directly on the command line.
813Unlike other parameters whose value is a single string,
814.Va command
815uses the remainder of the
816.Nm
817command line as its own arguments.
818.It Va exec.poststart
819Command(s) to run in the system environment after a jail is created,
820and after any
821.Va exec.start
822commands have completed.
823.It Va exec.prestop
824Command(s) to run in the system environment before a jail is removed.
825.It Va exec.stop
826Command(s) to run in the jail environment before a jail is removed,
827and after any
828.Va exec.prestop
829commands have completed.
830A typical command to run is
831.Dq sh /etc/rc.shutdown jail .
832.It Va exec.poststop
833Command(s) to run in the system environment after a jail is removed.
834.It Va exec.release
835Command(s) to run in the system environment after all other actions are done.
836These commands are executed after unmounting filesystems and removing IP
837addresses, so they may be used to remove a jail filesystem if it is no longer
838needed.
839.It Va exec.clean
840Run commands in a clean environment.
841The environment is discarded except for
842.Ev HOME , SHELL , TERM
843and
844.Ev USER .
845.Ev HOME
846and
847.Ev SHELL
848are set to the target login's default values.
849.Ev USER
850is set to the target login.
851.Ev TERM
852is imported from the current environment.
853The environment variables from the login class capability database for the
854target login are also set.
855.It Va exec.jail_user
856The user to run commands as, when running in the jail environment.
857The default is to run the commands as the current user.
858.It Va exec.system_jail_user
859This boolean option looks for the
860.Va exec.jail_user
861in the system
862.Xr passwd 5
863file, instead of in the jail's file.
864.It Va exec.system_user
865The user to run commands as, when running in the system environment.
866The default is to run the commands as the current user.
867.It Va exec.timeout
868The maximum amount of time to wait for a command to complete, in
869seconds.
870If a command is still running after this timeout has passed,
871the jail will not be created or removed, as appropriate.
872.It Va exec.consolelog
873A file to direct command output (stdout and stderr) to.
874.It Va exec.fib
875The FIB (routing table) to set when running commands inside the jail.
876.It Va stop.timeout
877The maximum amount of time to wait for a jail's processes to exit
878after sending them a
879.Dv SIGTERM
880signal (which happens after the
881.Va exec.stop
882commands have completed).
883After this many seconds have passed, the jail will be removed, which
884will kill any remaining processes.
885If this is set to zero, no
886.Dv SIGTERM
887is sent and the jail is immediately removed.
888The default is 10 seconds.
889.It Va interface
890A network interface to add the jail's IP addresses
891.Va ( ip4.addr
892and
893.Va ip6.addr )
894to.
895An alias for each address will be added to the interface before the
896jail is created, and will be removed from the interface after the
897jail is removed.
898.It Va ip4.addr
899In addition to the IP addresses that are passed to the kernel, an
900interface, netmask and additional parameters (as supported by
901.Xr ifconfig 8 Ns )
902may also be specified, in the form
903.Dq Ar interface Ns | Ns Ar ip-address Ns / Ns Ar netmask param ... .
904If an interface is given before the IP address, an alias for the address
905will be added to that interface, as it is with the
906.Va interface
907parameter.
908If a netmask in either dotted-quad or CIDR form is given
909after an IP address, it will be used when adding the IP alias.
910If additional parameters are specified then they will also be used when
911adding the IP alias.
912.It Va ip6.addr
913In addition to the IP addresses that are passed to the kernel,
914an interface, prefix and additional parameters (as supported by
915.Xr ifconfig 8 Ns )
916may also be specified, in the form
917.Dq Ar interface Ns | Ns Ar ip-address Ns / Ns Ar prefix param ... .
918.It Va vnet.interface
919A network interface to give to a vnet-enabled jail after is it created.
920The interface will automatically be released when the jail is removed.
921.It Va zfs.dataset
922A list of ZFS datasets to be attached to the jail.
923This requires
924.Va allow.mount.zfs
925to be set.
926See
927.Xr zfs-jail 8
928for information on how to configure a ZFS dataset to be operated from
929within a jail.
930.It Va ip_hostname
931Resolve the
932.Va host.hostname
933parameter and add all IP addresses returned by the resolver
934to the list of addresses
935.Po Va ip4.addr
936or
937.Va ip6.addr Pc
938for this jail.
939This may affect default address selection for outgoing IPv4 connections
940from jails.
941The address first returned by the resolver for each address family
942will be used as the primary address.
943.It Va mount
944A filesystem to mount before creating the jail (and to unmount after
945removing it), given as a single
946.Xr fstab 5
947line.
948.It Va mount.fstab
949An
950.Xr fstab 5
951format file containing filesystems to mount before creating a jail.
952.It Va mount.devfs
953Mount a
954.Xr devfs 5
955filesystem on the chrooted
956.Pa /dev
957directory, and apply the ruleset in the
958.Va devfs_ruleset
959parameter (or a default of ruleset 4: devfsrules_jail)
960to restrict the devices visible inside the jail.
961.It Va mount.fdescfs
962Mount a
963.Xr fdescfs 5
964filesystem on the chrooted
965.Pa /dev/fd
966directory.
967.It Va mount.procfs
968Mount a
969.Xr procfs 5
970filesystem on the chrooted
971.Pa /proc
972directory.
973.It Va allow.dying
974This is deprecated and has no effect.
975It used to allow making changes to a
976.Va dying
977jail.
978Now such jails are always replaced when a new jail is created with the same
979.Va jid
980or
981.Va name .
982.It Va depend
983Specify a jail (or jails) that this jail depends on.
984When this jail is to be created, any jail(s) it depends on must already exist.
985If not, they will be created automatically, up to the completion of the last
986.Va exec.poststart
987command, before any action will taken to create this jail.
988When jails are removed the opposite is true:
989this jail will be removed, up to the last
990.Va exec.poststop
991command, before any jail(s) it depends on are stopped.
992.El
993.Sh EXAMPLES
994Jails are typically set up using one of two philosophies: either to
995constrain a specific application (possibly running with privilege), or
996to create a
997.Dq "virtual system image"
998running a variety of daemons and services.
999In both cases, a fairly complete file system install of
1000.Fx
1001is
1002required, so as to provide the necessary command line tools, daemons,
1003libraries, application configuration files, etc.
1004However, for a virtual server configuration, a fair amount of
1005additional work is required so as to replace the
1006.Dq boot
1007process.
1008This manual page documents the configuration steps necessary to support
1009either of these steps, although the configuration steps may need to be
1010refined based on local requirements.
1011.Ss "Setting up a Jail Directory Tree"
1012To set up a jail directory tree containing an entire
1013.Fx
1014distribution, the following
1015.Xr sh 1
1016command script can be used:
1017.Bd -literal -offset indent
1018D=/here/is/the/jail
1019cd /usr/src
1020mkdir -p $D
1021make world DESTDIR=$D
1022make distribution DESTDIR=$D
1023.Ed
1024.Pp
1025In many cases this example would put far more in the jail than needed.
1026In the other extreme case a jail might contain only one file:
1027the executable to be run in the jail.
1028.Pp
1029We recommend experimentation, and caution that it is a lot easier to
1030start with a
1031.Dq fat
1032jail and remove things until it stops working,
1033than it is to start with a
1034.Dq thin
1035jail and add things until it works.
1036.Ss "Setting Up a Jail"
1037Do what was described in
1038.Sx "Setting Up a Jail Directory Tree"
1039to build the jail directory tree.
1040For the sake of this example, we will
1041assume you built it in
1042.Pa /data/jail/testjail ,
1043for a jail named
1044.Dq testjail .
1045Substitute below as needed with your
1046own directory, IP address, and hostname.
1047.Ss "Setting up the Host Environment"
1048First, set up the real system's environment to be
1049.Dq jail-friendly .
1050For consistency, we will refer to the parent box as the
1051.Dq "host environment" ,
1052and to the jailed virtual machine as the
1053.Dq "jail environment" .
1054Since jails are implemented using IP aliases, one of the first things to do
1055is to disable IP services on the host system that listen on all local
1056IP addresses for a service.
1057If a network service is present in the host environment that binds all
1058available IP addresses rather than specific IP addresses, it may service
1059requests sent to jail IP addresses if the jail did not bind the port.
1060This means changing
1061.Xr inetd 8
1062to only listen on the
1063appropriate IP address, and so forth.
1064Add the following to
1065.Pa /etc/rc.conf
1066in the host environment:
1067.Bd -literal -offset indent
1068sendmail_enable="NO"
1069inetd_flags="-wW -a 192.0.2.23"
1070rpcbind_enable="NO"
1071.Ed
1072.Pp
1073.Li 192.0.2.23
1074is the native IP address for the host system, in this example.
1075Daemons that run out of
1076.Xr inetd 8
1077can be easily configured to use only the specified host IP address.
1078Other daemons
1079will need to be manually configured \(em for some this is possible through
1080.Xr rc.conf 5
1081flags entries; for others it is necessary to modify per-application
1082configuration files, or to recompile the application.
1083The following frequently deployed services must have their individual
1084configuration files modified to limit the application to listening
1085to a specific IP address:
1086.Pp
1087To configure
1088.Xr sshd 8 ,
1089it is necessary to modify
1090.Pa /etc/ssh/sshd_config .
1091.Pp
1092To configure
1093.Xr sendmail 8 ,
1094it is necessary to modify
1095.Pa /etc/mail/sendmail.cf .
1096.Pp
1097In addition, a number of services must be recompiled in order to run
1098them in the host environment.
1099This includes most applications providing services using
1100.Xr rpc 3 ,
1101such as
1102.Xr rpcbind 8 ,
1103.Xr nfsd 8 ,
1104and
1105.Xr mountd 8 .
1106In general, applications for which it is not possible to specify which
1107IP address to bind should not be run in the host environment unless they
1108should also service requests sent to jail IP addresses.
1109Attempting to serve
1110NFS from the host environment may also cause confusion, and cannot be
1111easily reconfigured to use only specific IPs, as some NFS services are
1112hosted directly from the kernel.
1113Any third-party network software running
1114in the host environment should also be checked and configured so that it
1115does not bind all IP addresses, which would result in those services also
1116appearing to be offered by the jail environments.
1117.Pp
1118Once
1119these daemons have been disabled or fixed in the host environment, it is
1120best to reboot so that all daemons are in a known state, to reduce the
1121potential for confusion later (such as finding that when you send mail
1122to a jail, and its sendmail is down, the mail is delivered to the host,
1123etc.).
1124.Ss "Configuring the Jail"
1125Start any jail for the first time without configuring the network
1126interface so that you can clean it up a little and set up accounts.
1127As
1128with any machine (virtual or not), you will need to set a root password, time
1129zone, etc.
1130Some of these steps apply only if you intend to run a full virtual server
1131inside the jail; others apply both for constraining a particular application
1132or for running a virtual server.
1133.Pp
1134Start a shell in the jail:
1135.Bd -literal -offset indent
1136jail -c path=/data/jail/testjail mount.devfs \\
1137	host.hostname=testhostname ip4.addr=192.0.2.100 \\
1138	command=/bin/sh
1139.Ed
1140.Pp
1141Assuming no errors, you will end up with a shell prompt within the jail.
1142You can now run
1143.Xr bsdconfig 8
1144and do the post-install configuration to set various configuration options,
1145or perform these actions manually by editing
1146.Pa /etc/rc.conf ,
1147etc.
1148.Pp
1149.Bl -bullet -offset indent -compact
1150.It
1151Configure
1152.Pa /etc/resolv.conf
1153so that name resolution within the jail will work correctly.
1154.It
1155Run
1156.Xr newaliases 1
1157to quell
1158.Xr sendmail 8
1159warnings.
1160.It
1161Set a root password, probably different from the real host system.
1162.It
1163Set the timezone.
1164.It
1165Add accounts for users in the jail environment.
1166.It
1167Install any packages the environment requires.
1168.El
1169.Pp
1170You may also want to perform any package-specific configuration (web servers,
1171SSH servers, etc), patch up
1172.Pa /etc/syslog.conf
1173so it logs as you would like, etc.
1174If you are not using a virtual server, you may wish to modify
1175.Xr syslogd 8
1176in the host environment to listen on the syslog socket in the jail
1177environment; in this example, the syslog socket would be stored in
1178.Pa /data/jail/testjail/var/run/log .
1179.Pp
1180Exit from the shell, and the jail will be shut down.
1181.Ss "Starting the Jail"
1182You are now ready to restart the jail and bring up the environment with
1183all of its daemons and other programs.
1184Create an entry for the jail in
1185.Pa /etc/jail.conf :
1186.Bd -literal -offset indent
1187testjail {
1188	path = /tmp/jail/testjail;
1189	mount.devfs;
1190	host.hostname = testhostname;
1191	ip4.addr = 192.0.2.100;
1192	interface = em0;
1193	exec.start = "/bin/sh /etc/rc";
1194	exec.stop = "/bin/sh /etc/rc.shutdown jail";
1195}
1196.Ed
1197.Pp
1198To start a virtual server environment,
1199.Pa /etc/rc
1200is run to launch various daemons and services, and
1201.Pa /etc/rc.shutdown
1202is run to shut them down when the jail is removed.
1203If you are running a single application in the jail,
1204substitute the command used to start the application for
1205.Dq /bin/sh /etc/rc ;
1206there may be some script available to cleanly shut down the application,
1207or it may be sufficient to go without a stop command, and have
1208.Nm
1209send
1210.Dv SIGTERM
1211to the application.
1212.Pp
1213Start the jail by running:
1214.Bd -literal -offset indent
1215jail -c testjail
1216.Ed
1217.Pp
1218A few warnings may be produced; however, it should all work properly.
1219You should be able to see
1220.Xr inetd 8 ,
1221.Xr syslogd 8 ,
1222and other processes running within the jail using
1223.Xr ps 1 ,
1224with the
1225.Ql J
1226flag appearing beside jailed processes.
1227To see an active list of jails, use
1228.Xr jls 8 .
1229If
1230.Xr sshd 8
1231is enabled in the jail environment, you should be able to
1232.Xr ssh 1
1233to the hostname or IP address of the jailed environment, and log
1234in using the accounts you created previously.
1235.Pp
1236It is possible to have jails started at boot time.
1237Please refer to the
1238.Dq jail_*
1239variables in
1240.Xr rc.conf 5
1241for more information.
1242.Ss "Managing the Jail"
1243Normal machine shutdown commands, such as
1244.Xr halt 8 ,
1245.Xr reboot 8 ,
1246and
1247.Xr shutdown 8 ,
1248cannot be used successfully within the jail.
1249To kill all processes from within a jail, you may use one of the
1250following commands, depending on what you want to accomplish:
1251.Bd -literal -offset indent
1252kill -TERM -1
1253kill -KILL -1
1254.Ed
1255.Pp
1256This will send the
1257.Dv SIGTERM
1258or
1259.Dv SIGKILL
1260signals to all processes in the jail \(em be careful not to run this from
1261the host environment!
1262Once all of the jail's processes have died, unless the jail was created
1263with the
1264.Va persist
1265parameter, the jail will be removed.
1266Depending on
1267the intended use of the jail, you may also want to run
1268.Pa /etc/rc.shutdown
1269from within the jail.
1270.Pp
1271To shut down the jail from the outside, simply remove it with:
1272.Bd -literal -offset indent
1273jail -r
1274.Ed
1275.Pp
1276which will run any commands specified by
1277.Va exec.stop ,
1278and then send
1279.Dv SIGTERM
1280and eventually
1281.Dv SIGKILL
1282to any remaining jailed processes.
1283.Pp
1284The
1285.Pa /proc/ Ns Ar pid Ns Pa /status
1286file contains, as its last field, the name of the jail in which the
1287process runs, or
1288.Dq Li -
1289to indicate that the process is not running within a jail.
1290The
1291.Xr ps 1
1292command also shows a
1293.Ql J
1294flag for processes in a jail.
1295.Pp
1296You can also list/kill processes based on their jail ID.
1297To show processes and their jail ID, use the following command:
1298.Pp
1299.Dl "ps ax -o pid,jid,args"
1300.Pp
1301To show and then kill processes in jail number 3 use the following commands:
1302.Bd -literal -offset indent
1303pgrep -lfj 3
1304pkill -j 3
1305.Ed
1306or:
1307.Pp
1308.Dl "killall -j 3"
1309.Ss "Jails and File Systems"
1310It is not possible to
1311.Xr mount 8
1312or
1313.Xr umount 8
1314any file system inside a jail unless the file system is marked
1315jail-friendly, the jail's
1316.Va allow.mount
1317parameter is set, and the jail's
1318.Va enforce_statfs
1319parameter is lower than 2.
1320.Pp
1321Multiple jails sharing the same file system can influence each other.
1322For example, a user in one jail can fill the file system,
1323leaving no space for processes in the other jail.
1324Trying to use
1325.Xr quota 1
1326to prevent this will not work either, as the file system quotas
1327are not aware of jails but only look at the user and group IDs.
1328This means the same user ID in two jails share a single file
1329system quota.
1330One would need to use one file system per jail to make this work.
1331.Ss "Sysctl MIB Entries"
1332The read-only entry
1333.Va security.jail.jailed
1334can be used to determine if a process is running inside a jail (value
1335is one) or not (value is zero).
1336.Pp
1337The variable
1338.Va security.jail.jail_max_af_ips
1339determines how may address per address family a jail may have.
1340The default is 255.
1341.Pp
1342Some MIB variables have per-jail settings.
1343Changes to these variables by a jailed process do not affect the host
1344environment, only the jail environment.
1345These variables are
1346.Va kern.securelevel ,
1347.Va security.bsd.suser_enabled ,
1348.Va kern.hostname ,
1349.Va kern.domainname ,
1350.Va kern.hostid ,
1351and
1352.Va kern.hostuuid .
1353.Ss "Hierarchical Jails"
1354By setting a jail's
1355.Va children.max
1356parameter, processes within a jail may be able to create jails of their own.
1357These child jails are kept in a hierarchy, with jails only able to see and/or
1358modify the jails they created (or those jails' children).
1359Each jail has a read-only
1360.Va parent
1361parameter, containing the
1362.Va jid
1363of the jail that created it; a
1364.Va jid
1365of 0 indicates the jail is a child of the current jail (or is a top-level
1366jail if the current process isn't jailed).
1367.Pp
1368Jailed processes are not allowed to confer greater permissions than they
1369themselves are given, e.g., if a jail is created with
1370.Va allow.nomount ,
1371it is not able to create a jail with
1372.Va allow.mount
1373set.
1374Similarly, such restrictions as
1375.Va ip4.addr
1376and
1377.Va securelevel
1378may not be bypassed in child jails.
1379.Pp
1380A child jail may in turn create its own child jails if its own
1381.Va children.max
1382parameter is set (remember it is zero by default).
1383These jails are visible to and can be modified by their parent and all
1384ancestors.
1385.Pp
1386Jail names reflect this hierarchy, with a full name being an MIB-type string
1387separated by dots.
1388For example, if a base system process creates a jail
1389.Dq foo ,
1390and a process under that jail creates another jail
1391.Dq bar ,
1392then the second jail will be seen as
1393.Dq foo.bar
1394in the base system (though it is only seen as
1395.Dq bar
1396to any processes inside jail
1397.Dq foo ) .
1398Jids on the other hand exist in a single space, and each jail must have a
1399unique jid.
1400.Pp
1401Like the names, a child jail's
1402.Va path
1403appears relative to its creator's own
1404.Va path .
1405This is by virtue of the child jail being created in the chrooted
1406environment of the first jail.
1407.Sh SEE ALSO
1408.Xr killall 1 ,
1409.Xr lsvfs 1 ,
1410.Xr newaliases 1 ,
1411.Xr pgrep 1 ,
1412.Xr pkill 1 ,
1413.Xr ps 1 ,
1414.Xr quota 1 ,
1415.Xr jail_set 2 ,
1416.Xr vmm 4 ,
1417.Xr devfs 5 ,
1418.Xr fdescfs 5 ,
1419.Xr jail.conf 5 ,
1420.Xr linprocfs 5 ,
1421.Xr linsysfs 5 ,
1422.Xr procfs 5 ,
1423.Xr rc.conf 5 ,
1424.Xr sysctl.conf 5 ,
1425.Xr bsdconfig 8 ,
1426.Xr chroot 8 ,
1427.Xr devfs 8 ,
1428.Xr halt 8 ,
1429.Xr ifconfig 8 ,
1430.Xr inetd 8 ,
1431.Xr jexec 8 ,
1432.Xr jls 8 ,
1433.Xr mount 8 ,
1434.Xr mountd 8 ,
1435.Xr nfsd 8 ,
1436.Xr reboot 8 ,
1437.Xr rpcbind 8 ,
1438.Xr sendmail 8 ,
1439.Xr shutdown 8 ,
1440.Xr sysctl 8 ,
1441.Xr syslogd 8 ,
1442.Xr umount 8 ,
1443.Xr zfs-jail 8 ,
1444.Xr extattr 9
1445.Sh HISTORY
1446The
1447.Nm
1448utility appeared in
1449.Fx 4.0 .
1450Hierarchical/extensible jails were introduced in
1451.Fx 8.0 .
1452The configuration file was introduced in
1453.Fx 9.1 .
1454.Sh AUTHORS
1455.An -nosplit
1456The jail feature was written by
1457.An Poul-Henning Kamp
1458for R&D Associates
1459who contributed it to
1460.Fx .
1461.Pp
1462.An Robert Watson
1463wrote the extended documentation, found a few bugs, added
1464a few new features, and cleaned up the userland jail environment.
1465.Pp
1466.An Bjoern A. Zeeb
1467added multi-IP jail support for IPv4 and IPv6 based on a patch
1468originally done by
1469.An Pawel Jakub Dawidek
1470for IPv4.
1471.Pp
1472.An James Gritton
1473added the extensible jail parameters, hierarchical jails,
1474and the configuration file.
1475.Sh BUGS
1476It might be a good idea to add an
1477address alias flag such that daemons listening on all IPs
1478.Pq Dv INADDR_ANY
1479will not bind on that address, which would facilitate building a safe
1480host environment such that host daemons do not impose on services offered
1481from within jails.
1482Currently, the simplest answer is to minimize services
1483offered on the host, possibly limiting it to services offered from
1484.Xr inetd 8
1485which is easily configurable.
1486.Sh NOTES
1487Great care should be taken when managing directories visible within the jail.
1488For example, if a jailed process has its current working directory set to a
1489directory that is moved out of the jail's chroot, then the process may gain
1490access to the file space outside of the jail.
1491It is recommended that directories always be copied, rather than moved, out
1492of a jail.
1493.Pp
1494In addition, there are several ways in which an unprivileged user
1495outside the jail can cooperate with a privileged user inside the jail
1496and thereby obtain elevated privileges in the host environment.
1497Most of these attacks can be mitigated by ensuring that the jail root
1498is not accessible to unprivileged users in the host environment.
1499Regardless, as a general rule, untrusted users with privileged access
1500to a jail should not be given access to the host environment.
1501