跳转至

监控扩面 P0 前置只读实测 2026-09-29 22:40:23

目标主机 14 台(来源 env-inventory/inventory.yaml)

主机侧:包源与 firewalld

IP 主机名 firewalld 9100监听 NE包 epel 公网 dnf可用包 192.168.31.16 slurm-master-01 active 0 有 有 200 Error: No matching Packages to list 192.168.31.17 slurm-master-02 active 0 有 有 200 Error: No matching Packages to list 192.168.31.18 slurm-work-01 active 0 有 有 200 Error: No matching Packages to list 192.168.31.19 slurm-work-02 active 0 有 有 200 Error: No matching Packages to list 192.168.31.20 slurm-work-03 active 0 有 有 200 Error: No matching Packages to list 192.168.31.21 lustre-mgs-01 active 0 有 有 200 Error: No matching Packages to list 192.168.31.22 lustre-oss-01 active 0 有 有 200 Error: No matching Packages to list 192.168.31.23 lsf-master-01 inactive 0 有 有 200 Error: No matching Packages to list 192.168.31.24 lsf-master-02 inactive 0 有 有 200 Error: No matching Packages to list 192.168.31.25 lsf-work-01 failed 0 有 有 200 Error: No matching Packages to list 192.168.31.26 lsf-work-02 active 0 有 有 200 Error: No matching Packages to list 192.168.31.27 lsf-work-03 active 0 有 有 200 Error: No matching Packages to list 192.168.31.28 hpc-submit active 0 有 有 200 Error: No matching Packages to list 192.168.31.29 Flexlm active 0 有 有 200

主机侧明细:firewalld 与网络

  • 192.168.31.16 (slurm-master-01, slurm/controller-primary) OS=Rocky Linux 9.8 (Blue Onyx) | fw_state=running zone=public fw_ports=[6817/tcp,6818/tcp,6819/tcp] fw_services=[cockpit,dhcpv6-client,ssh] 公网: rocky=200 epel=200 github=200
  • 192.168.31.17 (slurm-master-02, slurm/controller-backup) OS=Rocky Linux 9.8 (Blue Onyx) | fw_state=running zone=public fw_ports=[6817/tcp,6818/tcp,6819/tcp] fw_services=[cockpit,dhcpv6-client,ssh] 公网: rocky=200 epel=200 github=200
  • 192.168.31.18 (slurm-work-01, slurm/compute) OS=Rocky Linux 9.8 (Blue Onyx) | fw_state=running zone=public fw_ports=[988/tcp,6817/tcp,6818/tcp,6819/tcp] fw_services=[cockpit,dhcpv6-client,ssh] 公网: rocky=200 epel=200 github=200
  • 192.168.31.19 (slurm-work-02, slurm/compute) OS=Rocky Linux 9.8 (Blue Onyx) | fw_state=running zone=public fw_ports=[988/tcp,6817/tcp,6818/tcp,6819/tcp] fw_services=[cockpit,dhcpv6-client,ssh] 公网: rocky=200 epel=200 github=200
  • 192.168.31.20 (slurm-work-03, slurm/compute) OS=Rocky Linux 9.8 (Blue Onyx) | fw_state=running zone=public fw_ports=[988/tcp,6817/tcp,6818/tcp,6819/tcp] fw_services=[cockpit,dhcpv6-client,ssh] 公网: rocky=200 epel=200 github=200
  • 192.168.31.21 (lustre-mgs-01, lustre/mgs-mds) OS=Rocky Linux 9.8 (Blue Onyx) | fw_state=running zone=public fw_ports=[988/tcp] fw_services=[cockpit,dhcpv6-client,ssh] 公网: rocky=200 epel=200 github=200
  • 192.168.31.22 (lustre-oss-01, lustre/oss) OS=Rocky Linux 9.8 (Blue Onyx) | fw_state=running zone=public fw_ports=[988/tcp] fw_services=[cockpit,dhcpv6-client,ssh] 公网: rocky=200 epel=200 github=200
  • 192.168.31.23 (lsf-master-01, lsf/master-primary) OS=Rocky Linux 9.8 (Blue Onyx) | fw_state=n/a zone=n/a fw_ports=[] fw_services=[] 公网: rocky=200 epel=200 github=200
  • 192.168.31.24 (lsf-master-02, lsf/master-backup) OS=Rocky Linux 9.8 (Blue Onyx) | fw_state=n/a zone=n/a fw_ports=[] fw_services=[] 公网: rocky=200 epel=200 github=200
  • 192.168.31.25 (lsf-work-01, lsf/compute) OS=Rocky Linux 9.8 (Blue Onyx) | fw_state=n/a zone=n/a fw_ports=[] fw_services=[] 公网: rocky=200 epel=200 github=200
  • 192.168.31.26 (lsf-work-02, lsf/compute) OS=Rocky Linux 9.8 (Blue Onyx) | fw_state=running zone=public fw_ports=[988/tcp] fw_services=[cockpit,dhcpv6-client,ssh] 公网: rocky=200 epel=200 github=200
  • 192.168.31.27 (lsf-work-03, lsf/compute) OS=Rocky Linux 9.8 (Blue Onyx) | fw_state=running zone=public fw_ports=[988/tcp] fw_services=[cockpit,dhcpv6-client,ssh] 公网: rocky=200 epel=200 github=200
  • 192.168.31.28 (hpc-submit, hpc/submit) OS=Rocky Linux 9.8 (Blue Onyx) | fw_state=running zone=public fw_ports=[988/tcp,6817/tcp,6818/tcp,6819/tcp] fw_services=[cockpit,dhcpv6-client,ssh] 公网: rocky=200 epel=200 github=200
  • 192.168.31.29 (Flexlm, license/license-server) OS=Rocky Linux 9.8 (Blue Onyx) | fw_state=running zone=public fw_ports=[2700/tcp,2701/tcp,5280/tcp,5281/tcp] fw_services=[cockpit,dhcpv6-client,ssh] 公网: rocky=200 epel=200 github=200

Prometheus 侧:序列与容量

prometheus pod = prometheus-kube-prometheus-stack-prometheus-0

head 序列数 : prometheus_tsdb_head_series=76135 采样速率(样本/秒) : =2680.014814814815; =0 TSDB 块字节 : prometheus_tsdb_storage_blocks_bytes=4311524617 TSDB head 块字节 : prometheus_tsdb_head_chunks_storage_size_bytes=22223855

monitoring 命名空间实际资源占用(kubectl top)

alertmanager-kube-prometheus-stack-alertmanager-0 1m 75Mi
kube-prometheus-stack-grafana-57cdd7cddf-n25gp 25m 529Mi
kube-prometheus-stack-kube-state-metrics-7b8b84ff4-c8k8f 5m 55Mi
kube-prometheus-stack-operator-7855b89cb9-hpc69 4m 29Mi
kube-prometheus-stack-prometheus-node-exporter-87n8k 8m 33Mi
kube-prometheus-stack-prometheus-node-exporter-h4j9g 1m 33Mi
kube-prometheus-stack-prometheus-node-exporter-l75vg 1m 31Mi
kube-prometheus-stack-prometheus-node-exporter-nnwkz 5m 33Mi
prometheus-kube-prometheus-stack-prometheus-0 245m 634Mi

monitoring PVC

alertmanager-kube-prometheus-stack-alertmanager-db-alertmanager-kube-prometheus-stack-alertmanager-0 nfs-csi 10Gi kube-prometheus-stack-grafana nfs-csi 10Gi prometheus-kube-prometheus-stack-prometheus-db-prometheus-kube-prometheus-stack-prometheus-0 nfs-csi-hdd 100Gi

节点 PodCIDR(firewalld 放行源网段参考)

k8s-master-01 10.244.0.0/24 k8s-node-01 10.244.3.0/24 k8s-node-02 10.244.4.0/24 k8s-node-03 10.244.5.0/24

Prometheus Pod IP:10.244.44.240


来源:/home/rain/Documents/k8s_ins/env-monitor-deploy/reports/probe-20260929-224023.md | 最后更新:2026-09-29 22:42(由 build/sync.py 同步,请勿在站点侧修改)