Have you tried the jBridge trick, of running B5 in a separate process using jBridge? It adds an extra buffer’s worth of latency, but you might find it allows it to run with more stability and no clicks/pops. I do that with Serum, which would otherwise be unusable for me live.
Neil