This seems like a lot of effort for a topology which is unlikely to ever work very well.
You can use a ClusterXL cluster object for a cluster without state sync. Under the ClusterXL and VRRP section, uncheck Use State Synchronization. I think High Availability > VRRP should make all cluster members effectively active, so they'll process whatever traffic is sent to them. You could use Active-Active clustering, but it has some topology concerns.
You might need to tweak the cluster monitoring config to get it to stop the members from trying to talk to each other on their clustered interfaces.
A multicast load sharing cluster is likely to work much better, and would actually be supported.