We've had a change of some bonds last night and few issues afterwards:
- some IPv6 routes went missing after changing bond configuration. We did few different changes with bond1, but some directly connected IPv6 routes were missing even from other bond interfaces.
- one SGM crashed after deleting one member of a bond. Once it came back, IPv6 routes on that SGM were fine, but two other SGMs lost some IPv6 routes (including connected ones).
- MAC addresses have changed on the bond we modified and were inconsistent between SGMs. Even SGM reboots (one at a time) did not fix it. We had to remove all except one bond members, reboot SGMs which had wrong MAC addresses (one at a time) and when all SGMs have agreed on MAC addresses, we have added remaining interfaces to bond. And we had to fix IPv6 again at the very end.
Fixing IPv6 routes for us involved doing state off / state on for IPv6 subinterfaces (luckily, just a handful of them)
This is single security group and security gateway (not a VSX), R81.10 JHF T66.