Media Player performance problems

I noticed that the media player sometimes causes performance problems, despite the profiler only showing low cpu percentages for the player itself.
I have a song with two nearly identical parts, the only difference being that in the second part the media player plays an additional backing track. I often get dropouts in the second part, the cpu usage in the profiler goes from around 50-60% to 100% and above. Strangely, this is seemingly caused by other VSTs and not the media player, despite them receiving identical input like before.

If I play the same backing track file from a sampler (Kontakt 5), i have no problems at all, the cpu usage is only slightly higher.

The file is a wave with the same sample rate like the interface, so there shouldn’t be any problems because of that.

Has anyone an idea what could be the cause of this?