This page notes what things are currently completed/in-progress for testing in FreeBSD.

Eventually this page will also note coverage in source code as a meaningful rubric for progress.

• ATF 0.16 has been imported into FreeBSD CURRENT and apart from some minor patches, all of the needed support has been added to FreeBSD (gcooper, marcel).
• ATF and Kyua ports have been created (asomers, bdrewery).
• MFCing ATF/bmake support (bmake is required by ATF) has been requested by developers (bapt, et al) to help regression test components on 9-STABLE; MFCing to 8.x was considered a bad idea, but all involved parties (bapt, bdrewery, davide, gcooper) agreed that having ports of ATF/bmake for 8.x was a good idea.

• Major build infrastructure pieces (atf.test.mk, bsd.test.mk) have been imported into FreeBSD in order to provide minimal overhead for developers when writing testcases, testing in-tree and out-of-tree. Minor usability improvements are queued for commit to FreeBSD current.
• A Test::Harness testcase shim (prove.test.mk) is queued for commit into FreeBSD.
• Official documentation (BSD.readme) is queued for commit.
• Automatic test “discovery”/handling logic is queued for commit.
• buildworld/installworld integration is queued for commit.
• Building a test release package and being able to install it via bsdinstall is incomplete, but work has been done on GitHub to make this come true.
• Getting the test infrastructure to run on stable/8 and stable/9 is possible, and all of the necessary bits have been pushed back to stable/8 and stable/9.

• Test fixtures (global cleanup/setup, per-testcase setup) need to be added to ATF to achieve feature parity with other test infrastructures (GNU libcheck, Python unittest testcases, Junit, etc).
• As JulioMerino has noted on his GoogleCodeIn page for ATF/Kyua, ATF was just the starting point, and Kyua is the evolution of ATF. So, with that in mind, the work that's being done here is just to provide some degree of feature parity with NetBSD, etc, and as time progresses, FreeBSD will catch up with Kyua (which is more evolved than ATF) and will use the test infrastructure layering that Julio Merino has proposed.

Rump is an extension to the NetBSD kernel that runs kernel code as a standalone user process for development and testing purposes. It is a great technology for isolating code and testing it using a whitebox method of testing, as opposed to having to use fuzzing techniques, failpoints, blackbox/graybox testing, etc, which ultimately allows developers and testers to write more code that isolates API calls and helps ensure that KPI contracts are sane without panicing a system or corrupting system state.