Slow Envoy init due to secret initialization

Our Envoy currently holds about 2000 secrets. On startup, it will begin initializing these secrets but won't serve traffic until all of them have been loaded.

On first start, it takes about 20-30 minutes to load them all. During this time, you could run curl localhost:19000/config_dump | grep "initialized" | wc -l and it will slowly count down. Once it reaches 0, it almost immediately.

We're currently using the Golang Control Plane Snapshot API.

I'm wondering if there's a faster way to load these secrets, or potentially even a way to lazily load them?

Envoy Version: 1.21.2

I suspect this is due to us having a single control plane with ADS but I'm only spitballing here