yugabyte/yugabyte-db

[DocDB] yb-admin command may return messy results during leader blacklisting completion check

Open

#12,395 创建于 2022年5月6日

在 GitHub 查看
 (1 评论) (0 反应) (0 负责人)C (1,003 fork)batch import
area/docdbgood first issuekind/bugpriority/medium

仓库指标

Star
 (8,229 star)
PR 合并指标
 (平均合并 17天 21小时) (30 天内合并 92 个 PR)

描述

Jira Link: DB-1509

Description

Not reproduced every time, got this on master universe with following flags

        instance_type='c5.xlarge',
        master_gflags={
            "load_balancer_max_concurrent_moves_per_table": "1",
            "load_balancer_max_concurrent_moves": "1",
            "ysql_num_shards_per_tserver": "50",
            "yb_num_shards_per_tserver": "50",
        },
        tserver_gflags={
            "ysql_num_shards_per_tserver": "50",
            "yb_num_shards_per_tserver": "50",
        }

Note that looks like 2509 is correct number, but sometimes we observe 3523 and other values. Command always evaluated on same node

yb-admin get_leader_blacklist_completion --master_addresses 172.151.27.112,172.151.31.78,172.151.29.81 2>&1
Percent complete = 48.5054 : 1292 remaining out of 2509
...
yb-admin get_leader_blacklist_completion --master_addresses 172.151.27.112,172.151.31.78,172.151.29.81 2>&1
Percent complete = 0 : 3523 remaining out of 3523
...
yb-admin get_leader_blacklist_completion --master_addresses 172.151.27.112,172.151.31.78,172.151.29.81 2>&1
Percent complete = 0 : 2509 remaining out of 2509
...
yb-admin get_leader_blacklist_completion --master_addresses 172.151.27.112,172.151.31.78,172.151.29.81 2>&1
Percent complete = 100 : 0 remaining out of 2509

Logs are to massive to be attached via GH

贡献者指南