Difference between revisions of "FPGA"

From Grid5000
Jump to: navigation, search
(Hardware description)
(Hardware description)
Line 9: Line 9:
 
Technically, the installation of those FPGAs in the [[Grenoble:Hardware#servan|Servan]] nodes has the following characteristics:
 
Technically, the installation of those FPGAs in the [[Grenoble:Hardware#servan|Servan]] nodes has the following characteristics:
 
* JTAG
 
* JTAG
** JTAG programming is provided on Xilinx Alveo U200 via a USB port on the card. In the Grid'5000 configuration, it is cabled back to hosting machine itself. Thus, programming of the FPGA of e.g. servan-1 can be done (e.g. with Vivado) from e.g. servan-1 itself.
+
** JTAG programming is provided on Xilinx Alveo U200 via a USB port on the card. In the Grid'5000 installation, it is cabled back to the hosting machine itself. Thus, programming of the FPGA of e.g. servan-1 can be done (e.g. with Vivado) from e.g. servan-1 itself.
 
* Network
 
* Network
 
** Both Ethernet ports of the FPGA are cabled to the site network along with all servers of the site (including the servan server NICs). [[File:Grenoble-DC-IMAG.png|thumb|right|Grenoble site's network]]
 
** Both Ethernet ports of the FPGA are cabled to the site network along with all servers of the site (including the servan server NICs). [[File:Grenoble-DC-IMAG.png|thumb|right|Grenoble site's network]]
Line 15: Line 15:
 
** Ethernet ports are cabled to 100Gbps ports on Grenoble site router/switch. Switch ports are configured with Auto-Negotiation disabled and Speed forced to 100Gbps (not working otherwise, as far as we tested).
 
** Ethernet ports are cabled to 100Gbps ports on Grenoble site router/switch. Switch ports are configured with Auto-Negotiation disabled and Speed forced to 100Gbps (not working otherwise, as far as we tested).
 
** Kavlan is supported on the FPGA Ethernet ports just like any NIC of a server of the site (including the servan servers NICs). FPGA ports are named ''servan-1-fpga0'', ''servan-1-fpga1'', ''servan-2-fpga0'', ''servan-2-fpga1'' in kavlan. IP addresses are provided via DHCP to the FPGA ports in kavlan where the DHCP service is available.
 
** Kavlan is supported on the FPGA Ethernet ports just like any NIC of a server of the site (including the servan servers NICs). FPGA ports are named ''servan-1-fpga0'', ''servan-1-fpga1'', ''servan-2-fpga0'', ''servan-2-fpga1'' in kavlan. IP addresses are provided via DHCP to the FPGA ports in kavlan where the DHCP service is available.
** Note: using the 100Gbps capability of the FPGA ports requires acquiring a free of charge Xilinx licence.
+
** Note: using the 100Gbps capability of the FPGA ports requires acquiring a free-of-charge Xilinx licence.
* Wattmetre
+
* Wattmeter
 
** Each servan node energy consumption is measured by a wattmeter. Measures are available in [[Monitoring Using Kwollect|Kwollect]]. (Work-in-progress)
 
** Each servan node energy consumption is measured by a wattmeter. Measures are available in [[Monitoring Using Kwollect|Kwollect]]. (Work-in-progress)
 
** Energy consumption can also be retrieved using Xilinx tools (e.g. xbutil, xbtop) from the host operating system when the FPGA is running XRT (see below).
 
** Energy consumption can also be retrieved using Xilinx tools (e.g. xbutil, xbtop) from the host operating system when the FPGA is running XRT (see below).
  
 
== Using the FPGA ==
 
== Using the FPGA ==

Revision as of 14:52, 2 September 2022

As of August 2022, Grid'5000 features 2 nodes, each equipped with one AMD/Xilinx FPGA.

AMD Xilinx Alveo U200

Hardware description

The Grenoble site of Grid'5000 hosts 2 servers (Servan cluster) equipped with an AMD/Xilinx FPGA. FPGA are AMD/Xilinx Alveo U200, which are PCIe Accelerator card.

Detailed specifications are provided here (cards with passive thermal cooling).

Technically, the installation of those FPGAs in the Servan nodes has the following characteristics:

  • JTAG
    • JTAG programming is provided on Xilinx Alveo U200 via a USB port on the card. In the Grid'5000 installation, it is cabled back to the hosting machine itself. Thus, programming of the FPGA of e.g. servan-1 can be done (e.g. with Vivado) from e.g. servan-1 itself.
  • Network
    • Both Ethernet ports of the FPGA are cabled to the site network along with all servers of the site (including the servan server NICs).
      Grenoble site's network
    • Ethernet ports are not shown as NICs in the operating system of the hosting machine (unless FPGA is programmed as to do so).
    • Ethernet ports are cabled to 100Gbps ports on Grenoble site router/switch. Switch ports are configured with Auto-Negotiation disabled and Speed forced to 100Gbps (not working otherwise, as far as we tested).
    • Kavlan is supported on the FPGA Ethernet ports just like any NIC of a server of the site (including the servan servers NICs). FPGA ports are named servan-1-fpga0, servan-1-fpga1, servan-2-fpga0, servan-2-fpga1 in kavlan. IP addresses are provided via DHCP to the FPGA ports in kavlan where the DHCP service is available.
    • Note: using the 100Gbps capability of the FPGA ports requires acquiring a free-of-charge Xilinx licence.
  • Wattmeter
    • Each servan node energy consumption is measured by a wattmeter. Measures are available in Kwollect. (Work-in-progress)
    • Energy consumption can also be retrieved using Xilinx tools (e.g. xbutil, xbtop) from the host operating system when the FPGA is running XRT (see below).

Using the FPGA