------------恢复内容开始------------
k8s coredns ContainerCreating
failed: open /run/flannel/subnet.env: no such file or directory
kube-flannel-ds-kjtd8 CrashLoopBackOff
K8s23-公司自建环境 Swapoff Firewalld systemctl status firewalld Systemctl stop firewalld Systemctl disable firewalld selinux hfkmYL@58 k8s23-master 192.168.19.30 k8s23-node01 192.168.19.32 k8s23-node02 192.168.19.31 桥接ipv4流量传递到iptables链 net.ipv4.ip_forward = 1 net.ipv4.tcp_tw_recycle = 0 net.bridge.bridge-nf-call-ip6tables = 1 net.bridge.bridge-nf-call-iptables = 1 net.ipv4.neigh.default.gc_thresh1=2048 net.ipv4.neigh.default.gc_thresh2=4096 net.ipv4.neigh.default.gc_thresh3=8192 fs.inotify.max_user_watches=524288 fs.inotify.max_user_instances=8192 vm.max_map_count=262144 net.core.rmem_max=16777216 net.core.wmem_max=16777216 net.core.netdev_max_backlog=16384 net.core.somaxconn=32768 net.ipv4.tcp_max_syn_backlog=8096 net.netfilter.nf_conntrack_tcp_be_liberal=1 net.netfilter.nf_conntrack_udp_timeout_stream=90 Yum repo 查看指定软件有那些版本可用 yum --showduplicates list kubelet 软件包与预期下载的不符 yum install -y kubelet-1.23.5 kubeadm-1.23.5 kubectl-1.23.5 [root@k8s-master ~]# kubectl get pods -o wide The connection to the server localhost:8080 was refused - did you specify the right host or port? kubeadm init --apiserver-advertise-address=172.20.234.4 --image-repository registry.aliyuncs.com/google_containers --kubernetes-version v1.18.0 --service-cidr=10.1.0.0/16 --pod-network-cidr=10.244.0.0/16 kubeadm init \--kubernetes-version=v1.23.5 \--image-repository registry.aliyuncs.com/google_containers \--pod-network-cidr=10.20.0.0/16 \--service-cidr=172.26.0.0/16 \--apiserver-advertise-address=192.168.19.30 \--ignore-preflight-errors=Swap Docker 默认驱动 Kubenets 驱动 查看docker cgroupdriver docker info | grep -i “Cgroup Driver 查看k8s cgroupdriver systemctl show --property=Environment kubelet | cat . vim /etc/sysconfig/kubelet . . . KUBELET_EXTRA_ARGS="--cgroup-driver=systemd" . . KUBE_PROXY_MODE="ipvs" . curl -sSL http://localhost:10248/healthz kubeadm join 192.168.19.30:6443 --token rf0152.j8k0awgxa8zr37jg \ --discovery-token-ca-cert-hash sha256:c5a57c0b67112c28a08cc64c2bd7c6c53cc2cf65e716fce23e3e6209430fa38e kubectl apply -f [podnetwork].yaml https://192.168.19.30:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s kubeadm join 192.168.19.30:6443 --token rf0152.j8k0awgxa8zr37jg --discovery-token-ca-cert-hash sha256:c5a57c0b67112c28a08cc64c2bd7c6c53cc2cf65e716fce23e3e6209430fa38e --v=5 --ignore-preflight-errors=all kubectl apply -f https://raw.githubusercontent.com/coreos/flannel/master/Documentation/kube-flannel.yml https://github.com/flannel-io/flannel/blob/master/Documentation/kube-flannel.yml [root@k8s23-node01 ~]# kubectl apply -f https://raw.githubusercontent.com/coreos/flannel/master/Documentation/kube-flannel.yml The connection to the server localhost:8080 was refused - did you specify the right host or port? Node节点安装flannel kubectl api-resources -o wide --namespaced=true
kubectl -n kube-flannel logs kube-flannel-ds-kjtd8 I0423 00:49:32.318681 1 main.go:211] CLI flags config: {etcdEndpoints:http://127.0.0.1:4001,http://127.0.0.1:2379 etcdPrefix:/coreos.com/network etcdKeyfile: etcdCertfile: etcdCAFile: etcdUsername: etcdPassword: version:false kubeSubnetMgr:true kubeApiUrl: kubeAnnotationPrefix:flannel.alpha.coreos.com kubeConfigFile: iface:[] ifaceRegex:[] ipMasq:true ifaceCanReach: subnetFile:/run/flannel/subnet.env publicIP: publicIPv6: subnetLeaseRenewMargin:60 healthzIP:0.0.0.0 healthzPort:0 iptablesResyncSeconds:5 iptablesForwardRules:true netConfPath:/etc/kube-flannel/net-conf.json setNodeNetworkUnavailable:true useMultiClusterCidr:false} W0423 00:49:32.319455 1 client_config.go:617] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work. I0423 00:49:32.334341 1 kube.go:144] Waiting 10m0s for node controller to sync I0423 00:49:32.334459 1 kube.go:485] Starting kube subnet manager I0423 00:49:32.338381 1 kube.go:506] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.20.0.0/24] I0423 00:49:32.339012 1 kube.go:506] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.20.1.0/24] I0423 00:49:32.339033 1 kube.go:506] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.20.2.0/24] I0423 00:49:33.335022 1 kube.go:151] Node controller sync successful I0423 00:49:33.335063 1 main.go:231] Created subnet manager: Kubernetes Subnet Manager - k8s-master I0423 00:49:33.335068 1 main.go:234] Installing signal handlers I0423 00:49:33.335330 1 main.go:542] Found network config - Backend type: vxlan I0423 00:49:33.335350 1 match.go:206] Determining IP address of default interface I0423 00:49:33.335838 1 match.go:259] Using interface with name enp0s3 and address 192.168.19.30 I0423 00:49:33.335911 1 match.go:281] Defaulting external address to interface address (192.168.19.30) I0423 00:49:33.336022 1 vxlan.go:140] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false E0423 00:49:33.336377 1 main.go:334] Error registering network: failed to acquire lease: subnet "10.244.0.0/16" specified in the flannel net config doesn't contain "10.20.0.0/24" PodCIDR of the "k8s-master" node I0423 00:49:33.336509 1 main.go:522] Stopping shutdownHandler... W0423 00:49:33.336540 1 reflector.go:347] github.com/flannel-io/flannel/pkg/subnet/kube/kube.go:486: watch of *v1.Node ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding
kubectl logs kube-flannel-ds-kjtd8 -n kube-flannel | grep CIDR I0423 01:15:07.288694 1 kube.go:506] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.20.0.0/24] I0423 01:15:07.288796 1 kube.go:506] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.20.1.0/24] I0423 01:15:07.288819 1 kube.go:506] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.20.2.0/24] E0423 01:15:08.289698 1 main.go:334] Error registering network: failed to acquire lease: subnet "10.244.0.0/16" specified in the flannel net config doesn't contain "10.20.0.0/24" PodCIDR of the "k8s-master" node
------------恢复内容结束------------