yugabyte/yugabyte-db
View on GitHub[DocDB] yb-admin command may return messy results during leader blacklisting completion check
Open
#12,395 opened on May 6, 2022
area/docdbgood first issuekind/bugpriority/medium
Repository metrics
- Stars
- (8,229 stars)
- PR merge metrics
- (Avg merge 17d 21h) (92 merged PRs in 30d)
Description
Jira Link: DB-1509
Description
Not reproduced every time, got this on master universe with following flags
instance_type='c5.xlarge',
master_gflags={
"load_balancer_max_concurrent_moves_per_table": "1",
"load_balancer_max_concurrent_moves": "1",
"ysql_num_shards_per_tserver": "50",
"yb_num_shards_per_tserver": "50",
},
tserver_gflags={
"ysql_num_shards_per_tserver": "50",
"yb_num_shards_per_tserver": "50",
}
Note that looks like 2509 is correct number, but sometimes we observe 3523 and other values. Command always evaluated on same node
yb-admin get_leader_blacklist_completion --master_addresses 172.151.27.112,172.151.31.78,172.151.29.81 2>&1
Percent complete = 48.5054 : 1292 remaining out of 2509
...
yb-admin get_leader_blacklist_completion --master_addresses 172.151.27.112,172.151.31.78,172.151.29.81 2>&1
Percent complete = 0 : 3523 remaining out of 3523
...
yb-admin get_leader_blacklist_completion --master_addresses 172.151.27.112,172.151.31.78,172.151.29.81 2>&1
Percent complete = 0 : 2509 remaining out of 2509
...
yb-admin get_leader_blacklist_completion --master_addresses 172.151.27.112,172.151.31.78,172.151.29.81 2>&1
Percent complete = 100 : 0 remaining out of 2509
Logs are to massive to be attached via GH