部署模式,4master 多worker 3etcd
现象 :
message:
kernel: IPVS: rr: UDP 10.233.0.3:53 - no destination available
csi_plugin.go:277] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: the server could not find the requested resource
installer日志:
FAILED - RETRYING: kubesphere-installer is ok (5 retries left).
fat日志
2020-06-04 19:45:45,844 p=21105 u=root | ...ignoring
2020-06-04 19:45:45,875 p=21105 u=root | fatal: [master4]: FAILED! => {
"changed": false,
"cmd": "/usr/local/bin/etcdctl --endpoints=https://172.23.186.81:2379,https://172.23.186.77:2379,https://172.23.186.80:2379 cluster-health | grep -q 'cluster is healthy'",
"delta": "0:00:00.087844",
"end": "2020-06-04 19:45:45.852174",
"rc": 1,
"start": "2020-06-04 19:45:45.764330"
}
STDERR:
Error: client: etcd cluster is unavailable or misconfigured; error #0: dial tcp 172.23.186.80:2379: getsockopt: connection refused
; error #1: dial tcp 172.23.186.77:2379: getsockopt: connection refused
; error #2: dial tcp 172.23.186.81:2379: getsockopt: connection refused
error #0: dial tcp 172.23.186.80:2379: getsockopt: connection refused
error #1: dial tcp 172.23.186.77:2379: getsockopt: connection refused
error #2: dial tcp 172.23.186.81:2379: getsockopt: connection refused
ks-installer处于pending状态:
NAMESPACE NAME READY STATUS RESTARTS AGE
kube-system calico-kube-controllers-dfb9cd87f-249fr 0/1 Pending 0 42m
kube-system calico-node-4q5gr 0/1 Running 1 43m
kube-system calico-node-5htwl 1/1 Running 1 43m
kube-system calico-node-7lr8s 1/1 Running 1 43m
kube-system calico-node-8kkjv 0/1 Running 1 43m
kube-system calico-node-8w2k4 1/1 Running 1 43m
kube-system calico-node-9fhn7 1/1 Running 1 43m
kube-system calico-node-cthjt 0/1 Running 1 43m
kube-system calico-node-dtnbn 1/1 Running 1 43m
kube-system calico-node-fvjlp 1/1 Running 1 43m
kube-system calico-node-fwwmf 0/1 Running 1 43m
kube-system calico-node-ghvdt 1/1 Running 1 43m
kube-system calico-node-gs2v7 1/1 Running 1 43m
kube-system calico-node-lkbpz 1/1 Running 1 43m
kube-system calico-node-lprwd 1/1 Running 1 43m
kube-system calico-node-mnxx9 1/1 Running 1 43m
kube-system calico-node-nxvtr 1/1 Running 1 43m
kube-system calico-node-s7jbt 1/1 Running 1 43m
kube-system calico-node-slrb7 0/1 Running 1 43m
kube-system calico-node-wbj6w 1/1 Running 1 43m
kube-system calico-node-x2z9g 1/1 Running 1 43m
kube-system calico-node-x97jt 1/1 Running 1 43m
kube-system calico-node-xgp6w 1/1 Running 1 43m
kube-system calico-node-xlvzg 0/1 Running 1 43m
kube-system calico-node-ztvgd 1/1 Running 1 43m
kube-system coredns-7f9d8dc6c8-lc9r5 0/1 Pending 0 42m
kube-system dns-autoscaler-5bf6989469-npsls 0/1 Pending 0 41m
kube-system kube-apiserver-master1 1/1 Running 0 46m
kube-system kube-apiserver-master2 1/1 Running 0 46m
kube-system kube-apiserver-master3 1/1 Running 0 46m
kube-system kube-apiserver-master4 1/1 Running 0 46m
kube-system kube-controller-manager-master1 1/1 Running 1 46m
kube-system kube-controller-manager-master2 1/1 Running 0 46m
kube-system kube-controller-manager-master3 1/1 Running 0 46m
kube-system kube-controller-manager-master4 1/1 Running 0 46m
kube-system kube-proxy-2djll 1/1 Running 0 45m
kube-system kube-proxy-2scfj 1/1 Running 0 45m
kube-system kube-proxy-4rsns 1/1 Running 0 46m
kube-system kube-proxy-8pc6c 1/1 Running 0 45m
kube-system kube-proxy-947zx 1/1 Running 0 45m
kube-system kube-proxy-98d8d 1/1 Running 0 46m
kube-system kube-proxy-9z4xs 1/1 Running 0 46m
kube-system kube-proxy-b9nx7 1/1 Running 0 45m
kube-system kube-proxy-cs87s 1/1 Running 0 45m
kube-system kube-proxy-ffm8p 1/1 Running 0 45m
kube-system kube-proxy-fqclb 1/1 Running 0 46m
kube-system kube-proxy-gctv9 1/1 Running 0 45m
kube-system kube-proxy-l45fg 1/1 Running 0 45m
kube-system kube-proxy-lnqsx 1/1 Running 0 45m
kube-system kube-proxy-nvg76 1/1 Running 0 45m
kube-system kube-proxy-ps87d 1/1 Running 0 45m
kube-system kube-proxy-rngst 1/1 Running 0 45m
kube-system kube-proxy-rqxw6 1/1 Running 0 45m
kube-system kube-proxy-t79mj 1/1 Running 0 45m
kube-system kube-proxy-t7grx 1/1 Running 0 45m
kube-system kube-proxy-wmbfq 1/1 Running 0 45m
kube-system kube-proxy-xh5s7 1/1 Running 0 45m
kube-system kube-proxy-z6p6d 1/1 Running 0 45m
kube-system kube-proxy-z9gkv 1/1 Running 0 45m
kube-system kube-scheduler-master1 1/1 Running 0 46m
kube-system kube-scheduler-master2 1/1 Running 0 46m
kube-system kube-scheduler-master3 1/1 Running 0 46m
kube-system kube-scheduler-master4 1/1 Running 0 46m
kube-system nodelocaldns-4dmzv 1/1 Running 0 41m
kube-system nodelocaldns-5zfj9 1/1 Running 0 41m
kube-system nodelocaldns-86mbs 1/1 Running 0 41m
kube-system nodelocaldns-88kp7 1/1 Running 0 41m
kube-system nodelocaldns-8nlfh 1/1 Running 0 41m
kube-system nodelocaldns-9wdkd 1/1 Running 0 41m
kube-system nodelocaldns-cmzhr 1/1 Running 0 41m
kube-system nodelocaldns-d94n8 1/1 Running 0 41m
kube-system nodelocaldns-ffxdg 1/1 Running 0 41m
kube-system nodelocaldns-g7r67 1/1 Running 0 41m
kube-system nodelocaldns-hgnr4 1/1 Running 0 41m
kube-system nodelocaldns-hwxjb 1/1 Running 0 41m
kube-system nodelocaldns-jhb8m 0/1 Running 0 41m
kube-system nodelocaldns-kj7r4 1/1 Running 0 41m
kube-system nodelocaldns-lhfwm 1/1 Running 0 41m
kube-system nodelocaldns-ls9fw 1/1 Running 0 41m
kube-system nodelocaldns-m47fd 0/1 Running 0 41m
kube-system nodelocaldns-pb7xs 0/1 Running 0 41m
kube-system nodelocaldns-r7rk4 1/1 Running 0 41m
kube-system nodelocaldns-smvfv 1/1 Running 0 41m
kube-system nodelocaldns-snl8b 1/1 Running 0 41m
kube-system nodelocaldns-tjlmh 1/1 Running 0 41m
kube-system nodelocaldns-xqnc2 1/1 Running 0 41m
kube-system nodelocaldns-zbrtm 0/1 Running 0 41m
kube-system openebs-localpv-provisioner-77fbd6858d-sds9p 0/1 Pending 0 29m
kube-system openebs-ndm-operator-59c75c96fc-ffvlh 0/1 Pending 0 29m
kube-system tiller-deploy-79b566b5ff-ww496 0/1 Pending 0 41m
kubesphere-system ks-installer-7d9fb945c7-bwvsc 0/1 Pending 0 29m
kubectl describe pod ks-installer-7d9fb945c7-bwvsc -n kubesphere-system
Name: ks-installer-7d9fb945c7-bwvsc
Namespace: kubesphere-system
Priority: 0
Node: <none>
Labels: app=ks-install
pod-template-hash=7d9fb945c7
Annotations: <none>
Status: Pending
IP:
IPs: <none>
Controlled By: ReplicaSet/ks-installer-7d9fb945c7
Containers:
installer:
Image: kubesphere/ks-installer:v2.1.1
Port: <none>
Host Port: <none>
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from ks-installer-token-rr9dc (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
ks-installer-token-rr9dc:
Type: Secret (a volume populated by a Secret)
SecretName: ks-installer-token-rr9dc
Optional: false
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s
node.kubernetes.io/unreachable:NoExecute for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling <unknown> default-scheduler 0/24 nodes are available: 24 node(s) had taints that the pod didn't tolerate.
Warning FailedScheduling <unknown> default-scheduler 0/24 nodes are available: 24 node(s) had taints that the pod didn't tolerate.
重新卸载过安装多次不行,有思路指点吗