This is an old revision of the document!
Introduction
This page notes what things are currently completed/in-progress for testing in FreeBSD.
Eventually this page will also note coverage in source code as a meaningful rubric for progress.
ATF import status
- ATF 0.16 has been imported into FreeBSD CURRENT and apart from some minor patches, all of the needed support has been added to FreeBSD (gcooper, marcel).
- ATF and Kyua ports have been created (asomers, bdrewery).
- MFCing ATF/bmake support (bmake is required by ATF) has been requested by developers (bapt, et al) to help regression test components on 9-STABLE; MFCing to 8.x was considered a bad idea, but all involved parties (bapt, bdrewery, davide, gcooper) agreed that having ports of ATF/bmake for 8.x was a good idea.
Build infrastructure status
- Major build infrastructure pieces (atf.test.mk, bsd.test.mk) have been imported into FreeBSD in order to provide minimal overhead for developers when writing testcases, testing in-tree and out-of-tree. Minor usability improvements are queued for commit to FreeBSD current.
- A Test::Harness testcase shim (prove.test.mk) is queued for commit into FreeBSD.
- Official documentation (BSD.readme) is queued for commit.
- Automatic test “discovery”/handling logic is queued for commit.
- buildworld/installworld integration is queued for commit.
- Building a test release package and being able to install it via bsdinstall is underway (gcooper).
Testcase Status
ATF Testcases
| Directory | Repository | Owner | Status | Notes |
| bin/date | 1 | gcooper | complete | Ported from tools/regression. Research adding coverage from NetBSD. |
| bin/sh | 1 | gcooper | complete | Ported from tools/regression. Need to get jilles@ to stop committing files to tools/regression :P. |
| gnu/usr.bin/diff | 1 | gcooper | complete | Ported from NetBSD. |
| gnu/usr.bin/grep | 1 | gcooper | complete | Ported from NetBSD. |
| lib/libc | 1 | gcooper | in-progress | Ported from NetBSD. Needs greater coverage/porting. Throws false positives. |
| lib/libcrypt | 1 | gcooper | complete? | |
| lib/librt | 1 | gcooper | in-progress | Ported from NetBSD. Needs greater coverage/porting. Throws false positives. |
| lib/libthr | 1 | gcooper | in-progress | Ported from NetBSD. Needs greater coverage/porting. Throws false positives. |
| lib/msun | 1 | gcooper | in-progress | Ported from NetBSD. Needs greater coverage/porting. Throws false positives. |
| usr.bin/apply | 1 | gcooper | complete | Ported from tools/regression. Research adding coverage from NetBSD. |
| usr.bin/calendar | 1 | gcooper | complete | Ported from tools/regression. |
| usr.bin/comm | 1 | gcooper | complete | Ported from tools/regression. |
| usr.bin/cut | 1 | gcooper | complete | Ported from tools/regression. |
| usr.bin/file2c | 1 | gcooper | complete | Ported from tools/regression. |
| usr.bin/join | 1 | gcooper | complete | Ported from tools/regression. |
| usr.bin/jot | 1 | gcooper | complete | Ported from tools/regression. |
| usr.bin/m4 | 1 | gcooper | complete | Ported from tools/regression. |
| usr.bin/ncal | 1 | gcooper | complete | Ported from tools/regression. |
| usr.bin/printf | 1 | gcooper | complete | Ported from tools/regression. |
| usr.bin/sed | 1 | gcooper | complete | Ported from tools/regression. |
| usr.bin/tr | 1 | gcooper | complete | Ported from tools/regression. |
| usr.bin/uudecode | 1 | gcooper | complete | Ported from tools/regression. |
| usr.bin/uuencode | 1 | gcooper | complete | Ported from tools/regression. |
| usr.bin/xargs | 1 | gcooper | complete | Ported from tools/regression. |
| usr.bin/yacc | 1 | gcooper | complete | Ported from tools/regression. |
| usr.sbin/nmtree | 1 | gcooper | complete | Ported from NetBSD. Adjusted slightly to match sha256sum string. |
| tests/contrib/atf | 1 | gcooper | complete | Ported from NetBSD. All test issues have been pushed back via GoogleCode page for the contrib/atf issues; the build issues and adjustments are all remaining local to FreeBSD for now.. |
Test::Harness Testcases
| Directory | Repository | Owner | Status | Notes |
| bin/mv | 1 | gcooper | in-progress | From tools/regression. Convert to ATF. |
| bin/pax | 1 | gcooper | in-progress | From tools/regression. Convert to ATF. |
| bin/pkill | 1 | gcooper | in-progress | From tools/regression. Convert to ATF. |
| bin/test | 1 | gcooper | in-progress | From tools/regression. Convert to ATF. |
| sbin/geom | 1 | gcooper | in-progress | From tools/regression. Global tests, mirror, and raid3 testcases have been ported over. Convert to ATF. |
| tests/sys/pjdfstest | 1 | gcooper | in-progress | From tools/regression. Need to shim in support for ATF. |
| usr.bin/lastcomm | 1 | gcooper | in-progress | From tools/regression. Convert to ATF. |
| usr.sbin/newsyslog | 1 | gcooper | in-progress | From tools/regression. Convert to ATF. Need to investigate failures. |
| usr.sbin/sa | 1 | gcooper | in-progress | From tools/regression. Convert to ATF. Need to investigate failures. |