Define "instable" please..what is the precise behavior?
Please answer the question: "How precisely did you attempt to switch to another public IP?"
Usually, changing the IP used for VPN involves the Link Selection setting, which is configured on the relevant gateway object in IPSec VPN > Link Selection.
If you have more than one Internet-facing interface or NAT is being performed by a device other than the gateway, you will need to adjust this setting for VPN (Remote Access or otherwise) to work correctly.