HI and welcome along!
Many of us have had experience with Voicemeeter, which is a great program but certainly not bullet proof. What you’ve described is something we have all experienced at one time or another.
A few months back I took a look at another VB Audio product, Matrix, which I think is more stable, extremely comprehensive in terms of patching between apps, and I found it significantly more stable.
Check out this topic: