Session Leader: lwhsu

https://hackmd.io/WXWU02hPSvaKH_XYuL_Fvg?both (content has been migrated to this page)

• https://docs.google.com/presentation/d/1bfNbh44MyIXRhf6bluGPmJSsZP_6otNDYAdgM0eGMN8/edit
• need to reduce latency between test failure and fix or revert
  • what is the threshold to allow a revert?
  • revert on lower tier (e.g. MIPS) failure?
    • we care about gcc, newer versions
  • a proposal to core?

• how to integrate more tests
  • Capsicum tests
  • Many external projects have tests suites that, as a side effect, test a lot of FreeBSD, we should use them.

• ports tests
  • let ports committers run poudriere easier locally
  • people have problem that building llvm taks very long time (theraven: we use ninja and people should be alble to access fast machine)

• minimal requirement of bootstrap FreeBSD?
  • X can be built by X-1
  • including LINT kernel
    • what's the failure?

• PXE env for testing on real hardware
  • ask brd@

• doc to setup a test/jenkins env

• release engineering check list

• Portable USB stick for auto-testing
  • write test results to FAT partition on disk
  • user uploads to ??? on freebsd.org somehow

• Syzkaller?
  • kcov support not yet merged – soc student back at school, waiting on review
  • Google run Syzkaller CI (https://syzkaller.appspot.com), could get them to pull snapshots once prerequisites are merged