topic Re: Open Server - HCL for multi queue network cards in General Topics

Open Server - HCL for multi queue network cards

HeikoAnkenbrand — Wed, 20 Mar 2019 21:22:31 GMT

Where can I find a list of network cards that support multi-queue on open server?

Unfortunately, this is not apparent from the HCL here:
https://www.checkpoint.com/support-services/hcl/

PS:

I am aware of a few e.g. Intel X520. But a list would be nice.

Regards,

Heiko

Re: Open Server - HCL for multi queue network cards

Timothy_Hall — Mon, 19 Nov 2018 14:59:25 GMT

Any cards that use the following drivers should support Multi-Queue:

igb (Maximum 4 packet queues, for onboard l211 controllers maximum 2 queues - see sk114625: Multi-Queue does not work on 3200 / 5000 / 15000 / 23000 appliances when it is enabled for on-board interfaces)

ixgbe (Maximum 16 packet queues)

mlx5_core (Maximum 10 packet queues)

i40e (R80.20 only I think but this driver might have been bundled in a late R80.10 Jumbo HFA - Maximum 14 packet queues)

The "Maximum Packet Queues" limit dictates the largest number of SND/IRQ instances that can empty packet buffers for an individual interface using that driver that has Multi-Queue enabled. This is only relevant as a limitation if there are more SND/IRQ instances configured via the CoreXL split than the stated packet queue limit.

--
Second Edition of my "Max Power" Firewall Book
Now Available at http://www.maxpowerfirewalls.com

Re: Open Server - HCL for multi queue network cards

HeikoAnkenbrand — Mon, 19 Nov 2018 15:34:18 GMT

Hi Timothy ,

Thanks for this info. I know everything.

I need a list of network cards for open server that support multi-queue.

For example Intel X520,...

Which cards are still supported.

Regards

Heiko

Re: Open Server - HCL for multi queue network cards

HeikoAnkenbrand — Mon, 19 Nov 2018 18:22:14 GMT

Hi Dameon,

Hi Valeri,

Is there a list from Check Point for supported multi-queue interface card?

Regards

Heiko

Re: Open Server - HCL for multi queue network cards

PhoneBoy — Mon, 19 Nov 2018 19:20:46 GMT

I assume Intel cards that use the drivers mentioned by Timothy Hall above will support multiqueue.

Re: Open Server - HCL for multi queue network cards

HeikoAnkenbrand — Mon, 19 Nov 2018 20:33:31 GMT

The drivers are clear to me!

Which network cards would you recommend for open server?

Is there a list from Check Point here?

I had received a list from our German presales team. Unfortunately they also don't have a list or information about the network cards now.

Who else can help me at Check Point?

Regards

Heiko

Re: Open Server - HCL for multi queue network cards

Timothy_Hall — Tue, 20 Nov 2018 04:02:43 GMT

OK I was able to reverse-engineer this to some degree. For R80.20 kernel version 2.6.18-92cp here are the Intel driver versions and what cards they support. Note that for ixgbe and igb the the specific version in use by Gaia is not currently shown on Intel's website as far as what NICs it supports, but the closest version I could find is shown instead which *should* be pretty close. Any Intel NIC that has a release date after the date shown for its corresponding Gaia driver will almost certainly not work.

Note that these driver versions are likely to be much newer for the new 3.10 kernel for R80.20 and the list of supported NICs will probably be longer under that kernel version.

ixgbe 3.9.15 released 3/15/2012

This driver version is not currently listed on Intel's website, but version 3.16.1 released 5/14/2013 is and supports these NICs according to Intel:

    Intel® 10 Gigabit AT Server Adapter
    Intel® 82598EB 10 Gigabit Ethernet Controller
    Intel® 82599EB 10 Gigabit Ethernet Controller
    Intel® 82599EN 10 Gigabit Ethernet Controller
    Intel® 82599ES 10 Gigabit Ethernet Controller
    Intel® Ethernet Controller X540-AT2
    Intel® Ethernet Converged Network Adapter X520-DA1
    Intel® Ethernet Converged Network Adapter X520-DA2
    Intel® Ethernet Converged Network Adapter X520-LR1
    Intel® Ethernet Converged Network Adapter X520-QDA1
    Intel® Ethernet Converged Network Adapter X520-SR1
    Intel® Ethernet Converged Network Adapter X520-SR2
    Intel® Ethernet Converged Network Adapter X520-T2
    Intel® Ethernet Converged Network Adapter X540-T1
    Intel® Ethernet Converged Network Adapter X540-T2
    Sun Dual 10GbE PCIe 2.0 FEM*

igb 4.1.2 released 10/5/2012

This driver version is not currently listed on Intel's website, but version 4.3.0 released 6/14/2013 is and supports these NICs according to Intel:

    Intel® 82575EB Gigabit Ethernet Controller
    Intel® 82576EB Gigabit Ethernet Controller
    Intel® 82576NS Gigabit Ethernet Controller
    Intel® 82580EB Gigabit Ethernet Controller
    Intel® Ethernet Controller I210-AS
    Intel® Ethernet Controller I210-AT
    Intel® Ethernet Controller I210-CS
    Intel® Ethernet Controller I210-IS
    Intel® Ethernet Controller I210-IT
    Intel® Ethernet Controller I350-AM2
    Intel® Ethernet Controller I350-AM4
    Intel® Ethernet Controller I350-BT2
    Intel® Ethernet Server Adapter I210-T1
    Intel® Ethernet Server Adapter I340-F4
    Intel® Ethernet Server Adapter I340-T4
    Intel® Ethernet Server Adapter I350-F2
    Intel® Ethernet Server Adapter I350-F4
    Intel® Ethernet Server Adapter I350-T2
    Intel® Gigabit EF Dual Port Server Adapter
    Intel® Gigabit ET Dual Port Server Adapter
    Intel® Gigabit ET2 Quad Port Server Adapter
    Intel® Gigabit VT Quad Port Server Adapter

i40e 1.4.25 released 4/6/2016

Actual NICs supported by this driver version according to Intel:

    Intel® Ethernet Controller X710-AM2
    Intel® Ethernet Controller X710-BM2
    Intel® Ethernet Controller XL710-AM1
    Intel® Ethernet Controller XL710-AM2
    Intel® Ethernet Controller XL710-BM1
    Intel® Ethernet Controller XL710-BM2
    Intel® Ethernet Converged Network Adapter X710-DA2
    Intel® Ethernet Converged Network Adapter X710-DA4
    Intel® Ethernet Converged Network Adapter XL710-QDA1
    Intel® Ethernet Converged Network Adapter XL710-QDA2

--
Second Edition of my "Max Power" Firewall Book
Now Available at http://www.maxpowerfirewalls.com

Re: Open Server - HCL for multi queue network cards

PhoneBoy — Tue, 20 Nov 2018 04:27:32 GMT

I assume the testing we've done for Multiqueue was done mostly on Check Point appliances and not Open Server.

That said, it's technically supported on Open Server.

Maybe best to look at the hardware supported by the different drivers above and cross-reference our HCL.

Most of the drivers are Intel-based, except for mlx5_core, which is a Mellanox driver for 40GB.

We do not have any 40GB NIC certified for Open Server.

This also means we can eliminate i40e from consideration (an Intel 40GB driver).

That leaves us with igb and ixgbe drivers.

igb has a page on Intel that says what it supports: Linux igb* Base Driver Overview and Installation

The igb driver supports all 82575, 82576, 82580, and I350-based Intel® Gigabit Ethernet Network Connections, one of which is: Ethernet Server Adapter I340-T2

ixbge has a page on Intel: Linux ixgbe* Base Driver Overview and Installation

This driver supports 82598- and 82599-based PCI Express* 10 Gigabit Network Connections, one of which is: Ethernet Server Adapter X520 Series

This is, of course, not an exhaustive list.

I know other vendors than Intel use the above chipsets.

Re: Open Server - HCL for multi queue network cards

PhoneBoy — Tue, 20 Nov 2018 04:29:40 GMT

You beat me to it with a more complete answer.

Nice work

Re: Open Server - HCL for multi queue network cards

HeikoAnkenbrand — Tue, 20 Nov 2018 07:16:55 GMT

Hi Timothy,

Hi Dameon,

Thank you for your work. That must have been a lot of work to gather the facts. Thanks for that.

My problem is that we should recommend certain hardware for open server to customers in projects.

For example, if a customer is using HP server, I recommend the following components for open server.

- HP ProLitan DL 360 G9

- HP ProLitan DL 380 G9

and

- Intel X520-SR2 as 10 GB cards (driver ixgbe)

But I have more and more often the request to use other hardware. Now I'm looking for a card in HCL and look at the Intel driver page and try to establish a cross reverence. That usually works. But I already had problems. Customer had bought a re-labeled HP network card corresponding to the Intel X520. The network card could also be found in the HCL. When we installed R80.10, the network card was not recognized correctly. After some back and forth he had bought Intel X520 additionally. I'd like to avoid something like that.

Therefore my request to provide a list of Check Points supported network cards or to include this in the HCL.

Regards

Heiko

Re: Open Server - HCL for multi queue network cards

PhoneBoy — Tue, 20 Nov 2018 16:41:11 GMT

Personally think it makes sense to document somewhere what driver each NIC should be using.

I'll see what I can dig up.

Re: Open Server - HCL for multi queue network cards

HeikoAnkenbrand — Tue, 20 Nov 2018 18:26:55 GMT

Thanks. It'd be great if you could find something out.

Re: Open Server - HCL for multi queue network cards

HeikoAnkenbrand — Wed, 21 Nov 2018 00:50:15 GMT

Hi Timothy,

Hi Dameon,

I once referenced all network cards for 3 hours between Check Point HCL and Intel and wrote here an article with the Intel list:

R80.x Performance Tuning Tip – Multi Queue

Regards

Heiko

Re: Open Server - HCL for multi queue network cards

HeikoAnkenbrand — Thu, 22 Nov 2018 21:36:31 GMT

I used the LKDDb Database to identify the drivers. LKDDb is an attempt to build a comprensive database of hardware and protocols know by Linux kernels. The driver database includes numeric identifiers of hardware, the kernel configuration menu needed to build the driver and the driver filename. The database is build automagically from kernel sources, so it is very easy to have always the database updated. This was the basis of the cross-reverence between Check Point HCL and Intel drivers.

Link to LKDDb web database:
https://cateee.net/lkddb/web-lkddb/

Link to LKDDb database driver:

igb, ixgbe, i40e, mlx5_core