Thing is, if they were actually eating a lot of resources, then I'd be able to see it. But I'm not seeing my CPU hit anywhere near 100% utilization, so it's not running out of processing power. It's either the subs themselves or vsfilter being a pain in the ass. I'll have to update vsfilter (my version is probably old) and see if that helps.
Thanks for everything, folks.