Goal: Reduce Network Usage
Nobody has claimed this yet.
Assessment
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Newbie friendliness
- 30/100
- Issue type
- Bug
- Clarity
- Mostly clear
- Activity status
- Stale
- Tech stack
- go
- Domain
- infrastructure, networking
Research direction
Start by tracing KGW's schema polling and the deployment configuration that controls its interval. Confirm the current polling behavior, then verify that the interval is five minutes and that network usage is reduced without changing the documented deployment consequences.
Written by the indexing model from the issue text.
Description
detected our network usage was incredibly high (TB/day), and it was increasing proportionally with amount of streams
requests seemed to be coming from KGW since its outgoing data was low while incoming was high (eth0 interface)
Determined that the source is KGW polling all the schemas
We'll temporarily make this poll interval to 5 minutes. Consequence: we'll probably get dataset/schema/procedure not found errors right after creating streams. It only affects deployment. If desired, we can target nodes directly to avoid this error while deploying
Making the network usage lower, will reduce our cost on infrastructure
Problem:
- Dominant language
- Go
- Stars
- 7
- Forks
- 3
- Avg merge
- 3h 2m
- Merged PRs (30d)
- 13
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from trufnetwork/node
-
type: goal
Difficulty 5/5 Over a week Newbie friendliness 35/100
trufnetwork/node#1436 ·
-
trufnetwork/node#1435 · 1 assignee ·
-
trufnetwork/node#1429 · 2 comments · 1 assignee ·
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
trufnetwork/node#1313 · 2 comments · 1 reaction ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
trufnetwork/node#1200 · 1 comment ·
All issues in trufnetwork/node
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
-
acceptance-tests phase-coding schema-coverage testing triaged
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100