New OpenEBS Installation -- mayastor node list empty

[greg80303]

I have a new install of openebs and I have a full set of pods running:

NAME                                              READY   STATUS    RESTARTS   AGE
openebs-agent-core-7b74cf6b7c-zlhfk               2/2     Running   0          132m
openebs-agent-ha-node-52tbr                       1/1     Running   0          132m
openebs-agent-ha-node-67cmv                       1/1     Running   0          132m
openebs-agent-ha-node-fw4mh                       1/1     Running   0          132m
openebs-agent-ha-node-j2594                       1/1     Running   0          132m
openebs-agent-ha-node-ljktv                       1/1     Running   0          132m
openebs-agent-ha-node-pnkv7                       1/1     Running   0          132m
openebs-agent-ha-node-qsqkc                       1/1     Running   0          132m
openebs-agent-ha-node-wckbx                       1/1     Running   0          132m
openebs-agent-ha-node-xvj7m                       1/1     Running   0          132m
openebs-api-rest-7f6f99996c-hcb9k                 1/1     Running   0          10m
openebs-csi-controller-bd7c575bb-nsb4c            6/6     Running   0          132m
openebs-csi-node-7gxlp                            2/2     Running   0          132m
openebs-csi-node-9t85k                            2/2     Running   0          132m
openebs-csi-node-cn8fw                            2/2     Running   0          132m
openebs-csi-node-dnhr4                            2/2     Running   0          132m
openebs-csi-node-jj2fc                            2/2     Running   0          132m
openebs-csi-node-mc59f                            2/2     Running   0          132m
openebs-csi-node-tm75g                            2/2     Running   0          132m
openebs-csi-node-vnfkc                            2/2     Running   0          132m
openebs-csi-node-w5vlv                            2/2     Running   0          132m
openebs-etcd-0                                    1/1     Running   0          132m
openebs-etcd-1                                    1/1     Running   0          132m
openebs-etcd-2                                    1/1     Running   0          132m
openebs-localpv-provisioner-588759f89b-t88v4      1/1     Running   0          132m
openebs-loki-0                                    1/1     Running   0          132m
openebs-lvm-localpv-controller-84844f9c47-czcw6   5/5     Running   0          132m
openebs-lvm-localpv-node-7bnt2                    2/2     Running   0          132m
openebs-lvm-localpv-node-dd9fw                    2/2     Running   0          132m
openebs-lvm-localpv-node-g77fc                    2/2     Running   0          132m
openebs-lvm-localpv-node-jtzvj                    2/2     Running   0          132m
openebs-lvm-localpv-node-l6dfh                    2/2     Running   0          132m
openebs-lvm-localpv-node-n4pmw                    2/2     Running   0          132m
openebs-lvm-localpv-node-pcfdx                    2/2     Running   0          132m
openebs-lvm-localpv-node-skkcw                    2/2     Running   0          132m
openebs-lvm-localpv-node-wq5d7                    2/2     Running   0          132m
openebs-nats-0                                    3/3     Running   0          132m
openebs-nats-1                                    3/3     Running   0          132m
openebs-nats-2                                    3/3     Running   0          132m
openebs-obs-callhome-5467b899f7-7zqzf             2/2     Running   0          132m
openebs-operator-diskpool-568f9fcbf7-wdm8n        1/1     Running   0          132m
openebs-promtail-5zp2k                            1/1     Running   0          132m
openebs-promtail-65ssz                            1/1     Running   0          132m
openebs-promtail-8wkjr                            1/1     Running   0          132m
openebs-promtail-g5dmv                            1/1     Running   0          132m
openebs-promtail-qmxld                            1/1     Running   0          132m
openebs-promtail-tqxrr                            1/1     Running   0          132m
openebs-promtail-wq5cg                            1/1     Running   0          132m
openebs-promtail-zbdk4                            1/1     Running   0          132m
openebs-promtail-zv8lq                            1/1     Running   0          132m
openebs-zfs-localpv-controller-78d668b687-pbctg   5/5     Running   0          132m
openebs-zfs-localpv-node-4m4h5                    2/2     Running   0          132m
openebs-zfs-localpv-node-6vtjv                    2/2     Running   0          132m
openebs-zfs-localpv-node-827nw                    2/2     Running   0          132m
openebs-zfs-localpv-node-ccqjc                    2/2     Running   0          132m
openebs-zfs-localpv-node-ffzxl                    2/2     Running   0          132m
openebs-zfs-localpv-node-fngsh                    2/2     Running   0          132m
openebs-zfs-localpv-node-htmqh                    2/2     Running   0          132m
openebs-zfs-localpv-node-hvcz5                    2/2     Running   0          132m
openebs-zfs-localpv-node-nfnk9                    2/2     Running   0          132m

My kubectl mayastor get nodes command is returning an empty list. I don't see any obvious errors coming from any of the pod logs. I see this log in the openebs-api-rest pod:

2025-02-26T08:24:32.876992Z  INFO actix_web::middleware::logger: ::ffff:192.168.66.192 "GET /v0/nodes HTTP/1.1" 200 2 "-" "-" 0.001263
    at /build/cargo-vendor-dir/actix-web-4.9.0/src/middleware/logger.rs:424

But no logs coming from any of the other pods when I run the command. Any ideas how to troubleshoot this?

[avishnu]

Can you check if the prerequisites were setup correctly? Especially https://openebs.io/docs/user-guides/replicated-storage-user-guide/replicated-pv-mayastor/rs-installation#label-io-node-candidates

[greg80303]

Yes -- this was it. I actually thought about this while in the shower this morning and couldn't believe that I had forgotten to label my storage nodes. Thank you for your response!!!