topic Re: R80.20 multi queue problem - interface pending reboot in General Topics

R80.20 multi queue problem - interface pending reboot

Richard_Carson — Wed, 22 Apr 2020 11:19:49 GMT

We a gateway and post reboot an interface that was previously working in MQ had popped out and was showing as 'pending on'

Active ixgbe interfaces:

eth1-01 [On]

eth1-02 [On]

eth1-03 [On]

eth1-04 [Pending On]

It is under investigation by TAC as to the cause of this.

However - does any one know a way of monitor the status of interfaces in MQ so that we can alert (trap\syslog) if this scenario has occurred?

Re: R80.20 multi queue problem - interface pending reboot

PhoneBoy — Thu, 23 Apr 2020 17:00:18 GMT

My question is: How did you get that information to begin with?
You could probably write up a quick monitoring script and send an snmptrap or whatever when the condition occurs.

Re: R80.20 multi queue problem - interface pending reboot

Richard_Carson — Fri, 24 Apr 2020 03:43:22 GMT

cpmq get

It does look like a script is the way to go, mq status not current available with any out of the box monitoring

Re: R80.20 multi queue problem - interface pending reboot

Kaspars_Zibarts — Wed, 07 Oct 2020 17:53:39 GMT

@Richard_Carson did you get a response why did it happen? I just got the same on R80.30 T215! Added more cores to MQ (10>12) and after that one of the interfaces would stay on Pending ON state

Re: R80.20 multi queue problem - interface pending reboot

Richard_Carson — Thu, 08 Oct 2020 07:59:47 GMT

Hi Kaspars

It was to do with the number of IRQs available to the kernel assign being exceeded. We fixed it by removing any unused interfaces that take up a IRQs assignments even though they are not being used (i.e expansion card interfaces), after doing this problem was resolved. Not helpful if you do not have unused cards to remove!

I believe this is addressed in the new kernel but not had the opportunity to find out yet

--risc

Re: R80.20 multi queue problem - interface pending reboot

_Val_ — Thu, 08 Oct 2020 08:06:19 GMT

You need 3.10 kernel. And most probably Dynamic Split with it 🙂