The only problem you run into is anti-spoofing, taken that the server is responding on the IP it was addressed on.
So let's say we have a server on eth3 with IP 10.10.10.10 and the same server is connected to eth4 with IP 20.20.20.20 and you connect from a client to 10.10.10.10 and the default on that server is the IP of eth4, just make sure you allow 10.10.10.* also well in the anti spoofing on eth4.
Same for eth3 make sure to allow 10.10.10.* and 20.20.20.* in the anti spoofing.
As long as you do not setup the rulebase as a zone based policy the FW does not really care on which interface the traffic enters. Just take care of anti-spoofing to allow it.
Regards, Maarten