Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

show zones,hosts zone is incorrect #252

Closed
jinyingsunny opened this issue Aug 28, 2023 · 2 comments
Closed

show zones,hosts zone is incorrect #252

jinyingsunny opened this issue Aug 28, 2023 · 2 comments
Assignees
Labels
affects/none PR/issue: this bug affects none version. process/done Process of bug severity/major Severity of bug type/bug Type: something is unexpected

Comments

@jinyingsunny
Copy link

jinyingsunny commented Aug 28, 2023

当前有3个host,3个storage,3个graph,当node2磁盘空间不足,两个storage节点分布在node1,一个storage节点分布在master。
而show zones展示的,却是3个storage分布在3个zone上。

image

image

当前上k8s上通过在三个node上打tag,来模拟三个不同的zone:
image

Your Environments (required)

operator:reg.vesoft-inc.com/cloud-dev/nebula-operator:snap-1.8
nebula-ent: reg.vesoft-inc.com/rc/nebula-storaged-ent:v3.5.0-sc
需要设置operator的sa等权限

- apiGroups:
    - rbac.authorization.k8s.io
  resources:
    - clusterrolebindings
    - clusterroles
  verbs:
    - create
    - delete
    - get
    - list
    - update 
    - watch   //这个是需要多配置的
- apiGroups:
    - ""
  resources:
    - nodes
  verbs:
    - get
    - list
- apiGroups:
    - ""
  resources:
    - serviceaccounts
  verbs:
    - create
    - delete
    - get
    - list
    - patch
    - update
    - watch

How To Reproduce(required)

其中一个node磁盘空间紧张时,创建集群nebula(1meta-3graph-3storage)

Expected behavior
display zone correctly

@jinyingsunny jinyingsunny added severity/major Severity of bug type/bug Type: something is unexpected labels Aug 28, 2023
@github-actions github-actions bot added the affects/none PR/issue: this bug affects none version. label Aug 28, 2023
@MegaByte875
Copy link
Contributor

MegaByte875 commented Sep 1, 2023

#251
#265

@jinyingsunny
Copy link
Author

当前的处理策略是,若某个zone中磁盘空间不足时,会创建pod失败,而不会去其他zone上寻找节点来创建pod。因此不会再出现本文中提到的问题:
image

(root@nebula) [(none)]> show zones
+--------------+---------------------------------------------------------------------------------+------+
| Name         | Host                                                                            | Port |
+--------------+---------------------------------------------------------------------------------+------+
| "us-east-2a" | ""                                                                              | 0    |
| "us-east-2b" | "nebulazcert-storaged-1.nebulazcert-storaged-headless.nebula.svc.cluster.local" | 9779 |
| "us-east-2c" | "nebulazcert-storaged-0.nebulazcert-storaged-headless.nebula.svc.cluster.local" | 9779 |
+--------------+---------------------------------------------------------------------------------+------+
Got 3 rows (time spent 1.4ms/2.542204ms)

Thu, 14 Sep 2023 14:14:42 CST

(root@nebula) [(none)]> show hosts
+---------------------------------------------------------------------------------+------+----------+--------------+----------------------+------------------------+----------------+
| Host                                                                            | Port | Status   | Leader count | Leader distribution  | Partition distribution | Version        |
+---------------------------------------------------------------------------------+------+----------+--------------+----------------------+------------------------+----------------+
| "nebulazcert-storaged-0.nebulazcert-storaged-headless.nebula.svc.cluster.local" | 9779 | "ONLINE" | 0            | "No valid partition" | "No valid partition"   | "3.5.0-sc-ent" |
| "nebulazcert-storaged-1.nebulazcert-storaged-headless.nebula.svc.cluster.local" | 9779 | "ONLINE" | 0            | "No valid partition" | "No valid partition"   | "3.5.0-sc-ent" |
+---------------------------------------------------------------------------------+------+----------+--------------+----------------------+------------------------+----------------+
Got 2 rows (time spent 1.311ms/2.189934ms)

Thu, 14 Sep 2023 14:14:44 CST

(root@nebula) [(none)]> show hosts storage
+---------------------------------------------------------------------------------+------+----------+-----------+--------------+----------------+
| Host                                                                            | Port | Status   | Role      | Git Info Sha | Version        |
+---------------------------------------------------------------------------------+------+----------+-----------+--------------+----------------+
| "nebulazcert-storaged-0.nebulazcert-storaged-headless.nebula.svc.cluster.local" | 9779 | "ONLINE" | "STORAGE" | "9f2c924"    | "3.5.0-sc-ent" |
| "nebulazcert-storaged-1.nebulazcert-storaged-headless.nebula.svc.cluster.local" | 9779 | "ONLINE" | "STORAGE" | "9f2c924"    | "3.5.0-sc-ent" |
+---------------------------------------------------------------------------------+------+----------+-----------+--------------+----------------+
Got 2 rows (time spent 1.375ms/2.447813ms)

Thu, 14 Sep 2023 14:15:01 CST

(root@nebula) [(none)]> show hosts graph
+------------------------------------------------------------------------+------+----------+---------+--------------+----------------+
| Host                                                                   | Port | Status   | Role    | Git Info Sha | Version        |
+------------------------------------------------------------------------+------+----------+---------+--------------+----------------+
| "nebulazcert-graphd-0.nebulazcert-graphd-svc.nebula.svc.cluster.local" | 9669 | "ONLINE" | "GRAPH" | "9f2c924"    | "3.5.0-sc-ent" |
| "nebulazcert-graphd-1.nebulazcert-graphd-svc.nebula.svc.cluster.local" | 9669 | "ONLINE" | "GRAPH" | "9f2c924"    | "3.5.0-sc-ent" |
+------------------------------------------------------------------------+------+----------+---------+--------------+----------------+
Got 2 rows (time spent 1.047ms/2.07836ms)

Thu, 14 Sep 2023 14:15:03 CST

(root@nebula) [(none)]> show hosts meta
+---------------------------------------------------------------------------+------+-----------+--------+--------------+----------------+
| Host                                                                      | Port | Status    | Role   | Git Info Sha | Version        |
+---------------------------------------------------------------------------+------+-----------+--------+--------------+----------------+
| "nebulazcert-metad-1.nebulazcert-metad-headless.nebula.svc.cluster.local" | 9559 | "ONLINE"  | "META" | "9f2c924"    | "3.5.0-sc-ent" |
| "nebulazcert-metad-0.nebulazcert-metad-headless.nebula.svc.cluster.local" | 9559 | "ONLINE"  | "META" | "9f2c924"    | "3.5.0-sc-ent" |
| "nebulazcert-metad-2.nebulazcert-metad-headless.nebula.svc.cluster.local" | 9559 | "OFFLINE" | "META" | "9f2c924"    | "3.5.0-sc-ent" |
+---------------------------------------------------------------------------+------+-----------+--------+--------------+----------------+
Got 3 rows (time spent 1.072ms/1.938091ms)

Thu, 14 Sep 2023 14:15:07 CST

(root@nebula) [(none)]> create space baske3s(partition_num=12,replica_factor=3,vid_type=fixed_string(30))
[ERROR (-1005)]: Invalid param!

Thu, 14 Sep 2023 14:16:56 CST

@github-actions github-actions bot added the process/fixed Process of bug label Sep 14, 2023
@jinyingsunny jinyingsunny added process/done Process of bug and removed process/fixed Process of bug labels Sep 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects/none PR/issue: this bug affects none version. process/done Process of bug severity/major Severity of bug type/bug Type: something is unexpected
Projects
None yet
Development

No branches or pull requests

2 participants