Ideas list entry: http://www.freebsd.org/projects/ideas/#p-performancetracking

The Performance Tracker entry is meant to monitor the performance of FreeBSD itself over the development time, e.g. someone makes a change to the kernel and the tracking system is able to show the performance impact to various subsystems (microbenchmarks) or to real world applications like apache or mysql (macrobenchmarks).

The tracking system should be able to do this with multiple machines and multiple configurations (while the goal is not to compare configurations or machines (but different FreeBSD versions) we would not mind if it is also able to do this.

ErikCederstrand is working on this project as part of his thesis. Currently, a test environment has been set up, and a script has been written to produce FreeBSD snapshots for benchmarking slaves to install. Next step is to compile ports for the snapshots and write a script that runs the benchmarks and parses the output. A database and a website frontend are also on the drawing board. The intent is to have a working system by early 2008.