Context Deadline Error

Start with service@v0.123.0/service.go:264 and the scraperhelper error at obs_metrics.go:61, then inspect the listed controller.go scraping path. Reproduce the BIG-IP metric requests and determine why they exceed the context deadline; done means the affected endpoints scrape successfully without the reported deadline errors.

We've been able to work through most issues on our deployment. We are down to two and this is one of them. We built a script to test the ast and capture the actual bigip that's been scraped since some of the logs lack that information which is why each line has the name of the bigip we are connecting to.

bigip-02 2025-05-22T21:50:12.332Z info service@v0.123.0/service.go:264 Starting otelcol-custom... {"Version": "", "NumCPU": 8}
bigip-02 2025-05-22T21:50:12.332Z info extensions/extensions.go:41 Starting extensions...
bigip-02 2025-05-22T21:50:12.333Z info service@v0.123.0/service.go:287 Everything is ready. Begin running and processing data.
bigip-02 2025-05-22T21:52:12.334Z error scraperhelper@v0.119.0/obs_metrics.go:61 Error scraping metrics {"error": "failed to make http request: Get "https://172.10.10.10/mgmt/tm/ltm/node/stats?%24top=10
000": context deadline exceeded; failed to make http request: Get "https://172.10.10.10/mgmt/tm/ltm/pool/stats?%24top=10000\": context deadline exceeded; failed to make http request: Get "https://172.10.10.10/mgmt/tm/sys/l
icense?%24top=10000": context deadline exceeded; failed to make http request: Get "https://172.10.10.10/mgmt/tm/ltm/rule/stats?%24top=10000\": context deadline exceeded; failed to make http request: Get "https://172.20.20.20/mgmt/tm/sys/provision?%24top=10000\": context deadline exceeded; failed to make http request: Get "https://172.10.10.10/mgmt/tm/sys/file/ssl-cert?%24top=10000\": context deadline exceeded; failed to make http request: Get
"https://172.10.10.10/mgmt/tm/ltm/eviction-policy?%24select=fullPath%2Cgeneration%2CslowFlow%2Fenabled%2Cstrategies%2FlowPriorityVirtualServer%2Fenabled&%24top=10000\": context deadline exceeded; failed to make http request: Ge
t "https://172.10.10.10/mgmt/tm/net/bwc/policy?%24select=fullPath%2Cgeneration%2CmaxRate%2CmaxUserRate%2CmaxUserRatePps&%24top=10000\": context deadline exceeded; failed to make http request: Get "https://172.10.10.10/mgmt/
tm/ltm/profile/fastl4?%24select=fullPath%2Cgeneration%2CclientTimeout%2ChardwareSynCookie%2CidleTimeout%2ClooseInitialization%2ClooseClose%2CpvaAcceleration%2CmssOverride%2CreceiveWindowSize%2CresetOnTimeout%2CsoftwareSynCookie%2
CsynCookieEnable%2CtcpCloseTimeout%2CtcpHandshakeTimeout&%24top=10000": context deadline exceeded; failed to make http request: Get "https://172.10.10.10/mgmt/tm/ltm/profile/udp?%24select=fullPath%2Cgeneration%2CdefaultsFrom%
2CdatagramLoadBalancing%2CidleTimeout%2CnoChecksum%2CbufferMaxBytes%2CsendBufferSize&%24top=10000": context deadline exceeded; failed to make http request: Get "https://172.10.10.10/mgmt/tm/ltm/profile/fasthttp?%24select=full
Path%2Cgeneration%2CconnPoolMaxSize%2ChardwareSynCookie%2CidleTimeout%2CinsertXforwardedFor%2CserverCloseTimeout&%24top=10000": context deadline exceeded; failed to make http request: Get "https://172.10.10.10/mgmt/tm/ltm/pro
file/tcp?%24select=fullPath%2Cgeneration%2CdefaultsFrom%2CsynCookieEnable%2ChardwareSynCookie%2CfastOpen%2CidleTimeout%2CkeepAliveInterval%2CmaxSegmentSize%2Cmptcp%2Cnagle%2CslowStart%2CreceiveWindowSize%2CsendBufferSize%2CtcpOpt
ions&%24top=10000": context deadline exceeded; failed to make http request: Get "https://172.10.10.10/mgmt/tm/ltm/profile/http?%24top=10000\": context deadline exceeded; failed to make http request: Get "https://172.20.20.20/mgmt/tm/ltm/profile/http?%24select=fullPath%2Cgeneration%2CconcurrentStreamsPerConnection%2CenforceTlsRequirements&%24top=10000\": context deadline exceeded; failed to make http request: Get "https://172.10.10.10/mgmt/tm/lt
m/profile/http3?%24select=fullPath%2Cgeneration%2CdefaultsFrom%2CappService%2Cdescription%2CheaderTableSize&%24top=10000": context deadline exceeded; failed to make http request: Get "https://172.10.10.10/mgmt/tm/ltm/profile/
quic?%24select=fullPath%2Cgeneration%2CdefaultsFrom%2CuniConcurrentStreamsPerConnection%2CbidiConcurrentStreamsPerConnection&%24top=10000": context deadline exceeded; failed to make http request: Get "https://172.10.10.10/mgm
t/tm/ltm/profile/one-connect?%24select=fullPath%2Cgeneration%2CdefaultsFrom%2CuniConcurrentStreamsPerConnection%2CbidiConcurrentStreamsPerConnection&%24top=10000": context deadline exceeded; failed to make http request: Get "ht
tps://172.10.10.10/mgmt/tm/ltm/profile/client-ssl?%24top=10000": context deadline exceeded; failed to make http request: Get "https://172.10.10.10/mgmt/tm/ltm/profile/server-ssl?%24select=fullPath%2Cgeneration%2Ccert%2Cciph
ers%2CdefaultsFrom%2Cdescription%2Ckey%2CallowExpiredCrl%2Crenegotiation%2CmaxActiveHandshakes&%24top=10000": context deadline exceeded; failed to make http request: Get "https://172.10.10.10/mgmt/tm/ltm/profile/web-accelerat
ion?%24select=fullPath%2Cgeneration%2CdefaultsFrom%2CcacheSize%2CcacheMaxEntries%2CcacheMaxAge&%24top=10000": context deadline exceeded; failed to make http request: Get "https://172.10.10.10/mgmt/tm/sys/disk/logical-disk?%24
top=10000": context deadline exceeded"}
bigip-02 go.opentelemetry.io/collector/scraper/scraperhelper.wrapObsMetrics.func1
bigip-02 go.opentelemetry.io/collector/scraper/scraperhelper@v0.119.0/obs_metrics.go:61
bigip-02 go.opentelemetry.io/collector/scraper.ScrapeMetricsFunc.ScrapeMetrics
bigip-02 go.opentelemetry.io/collector/scraper@v0.119.0/metrics.go:24
bigip-02 go.opentelemetry.io/collector/scraper/scraperhelper.scrapeMetrics
bigip-02 go.opentelemetry.io/collector/scraper/scraperhelper@v0.119.0/controller.go:256
bigip-02 go.opentelemetry.io/collector/scraper/scraperhelper.NewMetricsController.func1
bigip-02 go.opentelemetry.io/collector/scraper/scraperhelper@v0.119.0/controller.go:228
bigip-02 go.opentelemetry.io/collector/scraper/scraperhelper.(*controller[...]).startScraping.func1
bigip-02 go.opentelemetry.io/collector/scraper/scraperhelper@v0.119.0/controller.go:171