This is an old revision of the document!
FreeBSD Containers and Orchestration
Introduction
FreeBSD introduced its container, OS-level virtualization primitive in 1999 in the form of a security-oriented isolation framework and subsystem called Jails. Similar to OvenVZ Containers in 2005, Solaris Zones, LXC, Docker and other implementations, FreeBSD Jails allow isolation of applications or entire stacks with their own processes, filesystems and users, whilst using the same host operating system kernel.
Container Tools: Base System
Out of the box, FreeBSD provides:
Container Tools: Third-Party
These third-party tools aim to simplify and speed up the process of creating and managing FreeBSD jail-based containers on individual hosts, and many include additional support and integration for FreeBSD features such as bhyve virtualization, ZFS, Virtual Networks (VNET), Templating, Import/Export among others.
Bastille
Command-line (shell) tool and automation framework for jail-based containers.
Released: 2018 1)
Supports:
- FreeBSD Features: ZFS, VNET
- Other Features: Template Creation, Import, Export
- Has a container / template registry
ezjail
Command-line (shell) tool for jail-based containers.
Released: 2005 2)
Supports:
- FreeBSD Features: ZFS, VNET (via manual scripting)
- Other Features: Template Creation, Import, Export
iocage
Command-line (Python, originally shell) tool for jail-based containers.
Released: ~2016 3)
Supports:
- FreeBSD Features: ZFS (required), VNET
- Other Features: Template Creation, Import, Export
ioc
iocell
pot
Released: 2018 6)
Command-line (shell) tool for jail-based containers.
Supports:
- FreeBSD Features: ZFS, pf, rctl.
cbsd
Command-line and TUI (shell) tool for jail-based containers.
Released: ~2013 8)
Supports:
- FreeBSD Features: ZFS, VNET, bhyve, Xen
- Other Features: Templates and Profiles
None of the above orchestration tools have a “run a plain vanilla linux inside the container” feature, but the start/stop/templating feature of them does not prevent a manually created plain-vanilla-linux-jail.
Container Orchestration
The container tools above can be used as a base for multi-host orchestration, by exporting containers from one host, and either moving the container to another host, or by utilising shared storage (eg: SAN) or ZFS to switch container datasets from one host to another and importing it on the target host.
Additionally the following FreeBSD container orchestration tools are available:
- HashiCorp Nomad (jail-task driver)
Container Orchestration Distributions
XXX: add some FreeBSD derived distributions which have their focus (not only) on container virtualisation.
- CloneOS - WebUI for bhyve, jails, xen, …