Ok. I configured this in the home lab. ClusterXL with VIP on different subnet; the physical interfaces were an arbitrary subnet and I configured the VIP with a /31. As documented in sk32073 I had to do the static route for the VIP's subnet (the /31 and real functional subnet) with the "scopelocal" option.
I applied Jumbo HFA 202 to address sk173048 with IKEv2. I had to configure IPsec VPN - Link Selection with:
* Always use: Main Address
* Outgoing Route Selection - When Initiating: use Operating System routing table
- [Setup] button for Responding Traffic: Reply from same interface
* [Source IP address settings] button: Manual - IP of chosen interface
That last one was the magic key.
In my topology, I have 2 external interfaces as I need for this scenario; no ISP redundancy for this. In CLISH, I can set static-routes for my VPN peer out whichever external interface I want to use. I used StrongSwan (or is it Libreswan now? meh...) and configured IKEv2 for AES-256 SHA-384 DH 20 (I couldn't get exactly VPN-Suite-B happy with the Swan; annoying but whatever, that wasn't the point anyway). I used my own Linux home router VM as the next-hop between all this, just so I'm using IPsec tunnel mode and not transport mode.
IPsec connection comes up, packets (finally!) flow between them. In CLISH, for the static-route, just use the typical next-hop address as you normally would. No need for 'scopelocal' on those routes like you did for the VIP subnet on different interface. Since the VIP here is an external interface, I didn't have to deal with the anti-spoofing and special grouping (per the SK and ClusterXL Admin guide). I later tested with both IKEv1 and IKEv2 (separately, of course).
Not that it matters, but this was just a pair of ClusterXL HA gateways and not VSX, but I did manage them from an MDS management domain, since I had it already available. I'm not doing anything SmartCenter couldn't do (I know, duh, but just stating the test environment).
Wow... complex, almost circular, but it works! I was hoping it would, but I half-expected it to be buggy and fail. You MUST use JHF 202 tho! Anything else absolutely is guaranteed to fail. I opened an SR about the IKEv2 SK above and they confirmed the hotfix was in JHF 202 (and now you notice that SK was updated "30-Jul-2021" which is the day I opened the SR 🙂 haha; thanks folks!). The SK now states "R80.20 JHF 202"; it didn't say that before 30-Jul tho.
So there ya have it folks... /31 subnet on ClusterXL with VIP on different subnet!