This is an old revision of the document!
Test Cluster Reservations
The FreeBSD Test Cluster is used for a variety of FreeBSD kernel development, much oriented towards performance measurement and enhancement. This page can be used to register use of a machine for testing purposes to help prevent toe-treading. When you're done using a system for a purpose, please do put a note in the past users table so that we can keep track of the sorts of work being done. This information comes in really handy when looking for donations to help pay for new hardware to add to the cluster!
You can visit the TestClusterOnePointers page for more information on using the test cluster.
DO NOT EDIT THIS PAGE IN GUI MODE, IT WILL SCREW UP THE TABLE
PREVIEW BEFORE YOU SAVE!
Cluster Management Machine Configurations
| Machine | pm25 port | pm25 port speed | PMC port | IP | CPU | Cores | RAM | Notes |
|---|---|---|---|---|---|---|---|---|
| pm25 | - | - | - | 192.168.5.25 | - | - | - | Livingston PortMaster PM-25 |
| apc2 | 2003 | 19200 | - | 192.168.5.99 | - | - | - | APC power switch |
| apc4 | - | - | - | 192.168.5.96 | - | - | - | APC power switch - telnet to apc4 |
| apc5 | cuau0 | - | - | 192.168.5.84 | - | - | - | SYS power switch - telnet to apc5 |
| zoo | - | - | 4-1 | 192.168.5.1 | 2.2 GHz AMD 4200 X2 | 2 | 1GB | Cluster access and build host |
| devnull | 2019? | - | - | 192.169.5.3 | - | - | - | NetApp filer NAS - console is cuad1 on sloth |
| sloth2 | 2015? | - | - | 192.168.5.4 | AMD/Xeon? | 1 | 512 MB | Off-site backup host and devnull management |
| gigax2 | ? | ? | ? | 192.168.5.10 | - | - | - | Arista 10GigE switch, ssh admin@, no pass |
| gigax3 | 2020 | ? | ? | 192.168.5.155 | - | - | - | Second Arista 10GigE switch, ssh admin@, no pass |
| switch | - | - | - | 192.168.5.98 | - | - | - | netgear GS724T (port 80) |
| switch1 | - | - | - | 192.168.5.5 | - | - | - | NetApp ↔ Netperf link switch (NetApp end) |
| switch2 | - | - | - | 192.168.5.6 | - | - | - | NetApp ↔ Netperf link switch (Netperf end) |
| LANTime m600 | - | - | - | 192.168.5.17 | - | - | - | Meinberg PTPv2 Grandmaster GPS Clock 192.168.5.200 is source of packets |
Cluster Test Machine Configurations
apc2 is stupid. Port 1 is command 2, port 2 is command 3, etc. The other APCs are not afflicted.
✔ Ready to vacate
| Machine | Reserved By | pm25 port | pm25 port speed | PMC port | IP | CPU | Cores | RAM | IPMI | 10G Port (Arista or Cisco or X-over) | Notes |
| cavium1 | - | 192.168.5.167 | 48 core CN8890 ThunderX | 1P x 48C | 128GB | 192.168.5.166 | |||||
| cavium3 | - | 192.168.5.169 | 48 core CN8890 ThunderX | 1P x 48C | 128GB | 192.168.5.168 | |||||
| cavium4 | andrew | 192.168.5.159 | 2S ThunderX | 2P x 48C | 128GB | 192.168.5.170 | |||||
| fox1 | - | ??? | 115.2 | ipmi | 192.168.5.148 | Xeon E5-2643 3.3Ghz | 2x4x2 | 32 GB | |||
| fox2 | jhb | ??? | 115.2 | ipmi | 192.168.5.149 | Xeon E5-2643 3.3Ghz | 2x4x2 | 32 GB | |||
| lama1 | - | cuau3 | 38400 | - | 192.168.5.32 | RMI XLR MIPS | 32 | 4 GB | - | ||
| lion1 | oshogbo | 2021 | 9600 | 2-4 | 192.168.5.81 | 3.00 GHz Xeon | 8 | 8 GB | ix0:10(A), ix1:11(A) | 1 disk | |
| lion2 | - | 2022 | 9600 | 5-6 | 192.168.5.82 | 3.00 GHz Xeon | 4 | 4 GB | 1x 10GE (Intel), 1 disk (ahd errors?) | ||
| lion3 | emaste | 2023 | 9600 | 5-4 | 192.168.6.83 | 3.00 GHz Xeon | 4 | 8 GB | ix0:3(A), ix1:4(A) | 1 ATA scratch disk | |
| lynx1 | - | - | - | 192.168.5.151 | 2.80 GHz Xeon | 2P x 10C x 2HTT | 32 GB | 192.168.7.151 | cxl | Network Testing | |
| lynx2 | - | - | - | 192.168.5.152 | 2.80 GHz Xeon | 2P x 10C x 2HTT | 32 GB | 192.168.7.156 | sfxge | fails to POST | |
| lynx3 | pjd | - | - | 192.168.5.153 | 2.80 GHz Xeon | 2P x 10C x 2HTT | 32 GB | 192.168.7.153 | cxl | ZFS testing | |
| lynx4 | mjg | - | - | 192.168.5.154 | 2.80 GHz Xeon | 2P x 10C x 2HTT | 128 GB | 192.168.7.154 | sfxge | ||
| mercat1 | pho | - | - | - | 192.168.5.171 | 3.50 GHz Xeon E5-1650-v3 | 1P x 6C x 2HTT | 32 GB | 192.168.7.171 | mlx5 | Mellanox 100G |
| mercat2 | andrew | - | - | - | 192.168.5.172 | 3.50 GHz Xeon E5-1650-v3 | 1P x 6C x 2HTT | 32 GB | 192.168.7.172 | mlx5 | Mellanox 100G |
| mercat3 | andrew | - | - | - | 192.168.5.173 | 3.50 GHz Xeon E5-1650-v3 | 1P x 6C x 2HTT | 32 GB | 192.168.7.173 | bxe | QLogic 8442 |
| mercat4 | costin | - | - | - | 192.168.5.174 | 3.50 GHz Xeon E5-1650-v3 | 1P x 6C x 2HTT | 32 GB | 192.168.7.174 | Exablaze, Intel P3700 NVMe | |
| mercat5 | bz | - | - | - | 192.168.5.175 | 3.50 GHz Xeon E5-1650-v3 | 1P x 6C x 2HTT | 32 GB | 192.168.7.175 | cxl | Chelsio T62100-LP-CR 2x100G, Chelsio T6225-CR 2x25G, b-t-b w/ mercat 6 |
| mercat6 | bz | - | - | - | 192.168.5.176 | 3.50 GHz Xeon E5-1650-v3 | 1P x 6C x 2HTT | 32 GB | 192.168.7.176 | cxl | Chelsio T62100-LP-CR 2x100G, Chelsio T6225-CR 2x25G, b-t-b w/ mercat 5 |
| mercat7 | - | - | - | - | 192.168.5.177 | 3.50 GHz Xeon E5-1650-v3 | 1P x 6C x 2HTT | 32 GB | 192.168.7.177 | bxe | Exalbaze , QLogic 8442 |
| mercat8 | - | - | - | - | 192.168.5.178 | 3.50 GHz Xeon E5-1650-v3 | 1P x 6C x 2HTT | 32 GB | 192.168.7.178 | cxl | SolarFlare 7122, Chelsio T-580 |
| rabbit1 | - | - | - | 192.168.5.161 | 3.50 GHz Xeon E5-2637 | 1P x 4C x 2HTT | 32 GB | 192.168.7.161 | lio | Cavium Liquid IO w/rabbit2 | |
| rabbit2 | - | - | - | 192.168.5.162 | 3.50 GHz Xeon E5-2637 | 1P x 4C x 2HTT | 32 GB | 192.168.7.162 | lio | Cavium Liquid IO w/rabbit1 | |
| rabbit3 | - | - | - | 192.168.5.163 | 3.50 GHz Xeon E5-2637 | 1P x 4C x 2HTT | 32 GB | 192.168.7.163 | cxl | Chelsio T520-LL-CR back to back with rabbit 4/Arista-SW | |
| rabbit4 | - | - | - | 192.168.5.164 | 3.50 GHz Xeon E5-2637 | 1P x 4C x 2HTT | 32 GB | 192.168.7.164 | cxl | Chelsio T520-CR back to back with rabbit 3/Arista-SW | |
| gibbon1 | - | 2009 | 115200 | - | - | ARM64 Seattle | 1P x 8C | 16 GB | |||
| millipede1 | cuau3 | 38400 | 2-8 | 192.168.5.16 | RMI XLS MIPS | 16 | 2 GB | 12(A) | - | ||
| pig1 | mjg | - | - | 192.168.5.160 | 4P x 10C x 2HTT | 1TB | 192.168.7.160 | ||||
| sloth | simon | 2015 | 9600 | 2-3 | 192.168.5.202 | 500 MHz Geode LX | 1 | 512 MB | Soekris 5501 | ||
| worm2 | - | 2013 | 9600 | - | - | 2.2 GHz AMD | 16 | 16 GB | 22(A) | Exar/Neterion, IPMI on 192.168.5.152, user+pass: ADMIN | |
| giant-ape1 | attilio | 192.168.5.126 | Intel 80 Core Xeon | 4 | 32 GB | IPMI on 192.168.7.135 user+pass: ADMIN |
- Under maintenance or being replaced/upgraded in the immediate future, so may be offline or go offline without notice.
| lion4 | - | - | - | - | - | - | 4 | 4 GB | requires PCI-E bridge (en route) | ||
| lion5 | - | - | - | - | - | - | 4 | 4 GB | requires PCI-E bridge (en route) | ||
| lion6 | - | - | - | - | - | - | 4 | 4 GB | requires PCI-E bridge (en route) | ||
| lion7 | - | - | - | - | - | 4 | 4 GB | Being shipped | |||
| lion8 | - | - | - | - | - | 4 | 4 GB | Being shipped | |||
| lion9 | - | - | - | - | - | 4 | 4 GB | Being shipped | |||
| lion10 | - | - | - | - | - | 4 | 4 GB | Being shipped | |||
| worm1 | - | - | - | - | - | - | - | shipped back to iX | |||
| orangutan | 2014 | 9600 | 2-4 | 192.168.5.105 | 2.2 GHz Xeon | 2 | 2 GB | Dell 2650 | |||
| sloth-2 | - | 9600 | 4-4 | 192.168.5.116 | 267 MHz Geode SC1100 | 1 | 128 MB | Soekris 4801, hifn | |||
| beaver1 | - | 2024 | 9600 | 2-1 | 192.168.5.112 | VIA 800MHz | 1 | 512MB | padlock(4), ubsec(4) | ||
| cheetah | - | 2012 | 9600 | 4-5 | 192.168.5.106 | 2.00 GHz Opteron HE | 2 | 4 GB | NetFPGA card | ||
| interlope | - | 2018 | - | - | 192.168.5.115 | AMD 3800 | 1 | 1 GB | Solaris 200805, hifn | ||
| leopard1 | - | 2001 | 9600 | 5-2 | 192.168.5.107 | 2.13 GHz Xeon 3050 | 2 | 2 GB | 3/3(C) | Chelsio | |
| leopard2 | - | 2005 | 9600 | 5-3 | 192.168.5.108 | 2.13 GHz Xeon 3050 | 2 | 2 GB | 2/2(C) | Myricom | |
| leopard3 | - | 2008 | 9600 | 5-1 | 192.168.5.109 | 2.13 GHz Xeon 3050 | 2 | 2 GB | 17(A) | Myricom | |
| octeon | - | cuau4 | 115200 | 4-7 | 192.168.5.19 | Cavium Octeon CN5230-SCP | 4 | 2 GB | Lanner MR-730 | ||
| elephant | - | 2016 | 9600 | 5-4?? 4-8?? | 192.168.5.104 | 800 MHz Pentium III | 2 | 256 MB | SGI |
Machines in italics are proposed for decommissioning.
Stash
- 2 x Chelsio T420
- Exblaze Exanic x2
- 2 x Chelsio T580 - lp - cr
- Solar flare 7122
Bears and IPMI Control
The IPMI cards are on the the 192.168.7.0/24 network, where the last octet matches the IP on 192.168.5.0/24. so bear3 is 192.168.5.124, the IPMI management NIC is 192.168.7.124
userid and passwd are the default ADMIN ADMIN (case SENSITIVE)
For serial redirection to work, in the BIOS you need to redirect to com port B and in /boot/device.hints you need hint.uart.1.flags=“0x10” and enable getty on cuau1
Then you can do ipmitool -U ADMIN -P ADMIN -I lanplus -H 192.168.7.124 sol activate and you will be able to see everything from bios screen boot up to serial console interaction.
If you are not using a box long term, powering it off would be great, as it saves us on the power bill :)
ipmitool -U ADMIN -P ADMIN -I lanplus -H 192.168.7.124 “power” “off”
eg
# ipmitool -U ADMIN -P ADMIN -I lanplus -H 192.168.7.124 “power” “status” Chassis Power is on
# ipmitool -U ADMIN -P ADMIN -I lanplus -H 192.168.7.124 “power” “off” Chassis Power Control: Down/Off
# ipmitool -U ADMIN -P ADMIN -I lanplus -H 192.168.7.124 “power” “status” Chassis Power is off
Past Uses
Some past past test cluster users, sorted roughly by inverse start date order. Entries are by-project rather than by-developer.
| Dates | User | Notes |
|---|---|---|
| Early 2020 | kp | if_bridge performance improvements |
| End 2018 | kp | pfsync performance improvements |
| Feb 2016 | AllanJude | NVMe testing for “FreeBSD Mastery: Advanced ZFS” |
| May/June 2014 | kib | PostgreSQL performance measurements and optimizations |
| Summer 2013 | kib | DMAR driver |
| 2012/2013 | bz | TCP-MD5, IPv6, PMC, benchmarking |
| March 2012 | flo | vmcontention testing |
| March 2012 | gnn | FUSE testing |
| February 2012 | brooks | LTO and external toolchain support testing. |
| 2011 | bz | IPSec NAT-T, pf, ipfw fwd IPv6, IPv6, carp, vnet, … |
| March 2010 | kib | FPU/XMM in-kernel use KPI development |
| January 2010 | bz | build_option_survey run |
| November-December 2009 | bz | IPsec bugfixing, hifn testing and netisr regression testing |
| September-November 2009 | bz | Networking and security testing |
| August-November 2009 | pjd | ZFS |
| July 2009 | lstewart | SMP panic debugging |
| May- 2009 | bz | VImage |
| May, 2009 - June 2011 | rwatson | netisr2 (parallel netisr) performance and stability testing, network stack profiling, TCP locking optimisation, TCP refactoring, connection groups, parallel network stack work distribution, RSS support |
| November, December 2008 | bz | VImage |
| September 2008 | bz | performace testing |
| August, September 2008 | bz | vimage testing |
| November 2007 - September 2008 | bz | TCP, IPv6, IPsec bughunting and patch testing, also for secteam |
| December, 2007 | simon | OpenSSL hardware acceleration testing. |
| November, 2007 - December, 2007 | rwatson | procstat development |
| September, 2007 - November, 2007 | rwatson | performance measurement of scheduler changes for IP forwarding. |
| August, September 2007 | silby | FreeBSD 7.0 TCP testing. |
| July 2007 - April 2009 | pho | long-term SMP stability and load-testing for FreeBSD 7.x and 8.x |
| April,June, July 2007 | bz | Testing and debugging IPv6 for fast_ipsec patches. |
| 2006-present | pjd | ZFS porting, GJournal development/testing, various GEOM classes development/testing, opencrypto development/testing. |
| November, 2006 | piso | Interrupt filter stability and performance testing. |
| April, 2006 - November 2006 | jb | dtrace |
| 2005-present | rwatson | MPSAFE network stack development and performance/stability testing. |
| 2005-2008 | rwatson | TrustedBSD audit, MAC, privilege development. |
| December, 2005 | jasone | jemalloc load testing. |
| February, 2005 | davidxu | libthr+MySQL performance testing and optimization. |
| January, 2005 - May, 2006 | jkoshy | HWPMC testing on a range of hardware. |
| bmilekic | A variety of testing and optimization for the network stack locking work, including mbuma. | |
| gnn | Network testing of various protocols. | |
| May, 2007 | zec | Virtual Network Stack. |