I have a meager 82 plugins in my standard setlist for my band. Loads in about 45 seconds, even without an SSD disk (but I use only very few large sample sets).
I have NO plugins in my individual songs; my songs are simply containers and wiring for the specific racks I use in that song; all my instruments and plugins are contained in re-usable racks. So no matter how many songs I add to a setlist, the number of plugins will not increase 
Of course there are a number of duplicates in the list of plugins: a number of racks contain the same EQ plugin (FabFilter Pro-Q) or volume control; I have various instances of M1, Wavestation and Hive in my Strings, MainSynth and SoloSynth racks, etc.
@So_Godly: if you only use 5 plugins, you might want to re-configure your setup to encapsulate them in racks, assign rack states to your song settings and re-build your songs to use these racks - will massively reduce both your memory usage and load time.
Same for @FredProgGH: you might want to try to build logical racks from your plugins, combining instruments and FX into a self-contained chain (like ePiano->chorus->flanger->tremolo->amp->EQ), build presets for specific sounds or even per song, and then use songs to simply load these racks, select presets (states), set rack volumes and configure keyboard settings and zones, plus controller bindings. For the typical “send” effects, you can build FX racks with presets; you can then create additional routes from your instrument racks to the FX racks and tune the FX level with the send route gain level. Makes for very clean songs and very efficient memory use - short loading times.
Cheers,
Torsten