As of August 2022, Grid'5000 features 2 nodes, each equipped with one AMD/Xilinx FPGA.
Detailed specifications are provided here (cards with passive thermal cooling).
Technically, the installation of those FPGAs in the Servan nodes has the following characteristics:
- JTAG programming is provided on Xilinx Alveo U200 via a USB port on the card. In the Grid'5000 configuration, it is cabled back to hosting machine itself. Thus, programming of the FPGA of e.g. servan-1 can be done (e.g. with Vivado) from e.g. servan-1 itself.
- Both Ethernet ports of the FPGA are cabled to the site network along with all servers of the site (including the servan server NICs).
- Ethernet ports are not shown as NICs in the operating system of the hosting machine (unless FPGA is programmed as to do so).
- Ethernet ports are cabled to 100Gbps ports on Grenoble site router/switch. Switch ports are configured with Auto-Negotiation disabled and Speed forced to 100Gbps (not working otherwise, as far as we tested).
- Kavlan is supported on the FPGA Ethernet ports just like any NIC of a server of the site (including the servan servers NICs). FPGA ports are named servan-1-fpga0, servan-1-fpga1, servan-2-fpga0, servan-2-fpga1 in kavlan. IP addresses are provided via DHCP to the FPGA ports in kavlan where the DHCP service is available.
- Note: using the 100Gbps capability of the FPGA ports requires acquiring a free of charge Xilinx licence.
- The servan cluster is monitored by a wattmeter, providing the energy consumption of each server, including the FPGA.
- Energy consumption can also be retrieve using Xilinx tools (e.g. xbutil, xbtop)when FPGA are used with XRT (see below).