ARM架构下Kubernetes与KubeSphere部署指南

1. ARM架构K8s环境部署概述在ARM架构设备上部署Kubernetes集群正成为边缘计算和混合云场景下的热门选择。相比x86环境ARM架构具有更高的能效比和性价比特别适合资源受限但需要稳定运行的场景。本次我们将从零开始在ARM平台上部署Kubernetes 1.34.5和KubeSphere 3.4.1涵盖在线和离线两种部署模式。提示ARM架构下的K8s部署与x86主要区别在于镜像兼容性和性能调优需要特别注意组件版本匹配2. 环境准备与前置条件2.1 硬件与系统要求部署前需要准备至少3台ARM架构服务器建议4核8G以上配置操作系统Ubuntu 22.04 LTS ARM版推荐或CentOS 8 Stream ARM版磁盘空间每节点50GB以上可用空间网络节点间互通无防火墙限制2.2 基础环境配置# 所有节点执行 sudo apt update sudo apt upgrade -y sudo swapoff -a sudo sed -i / swap / s/^/#/ /etc/fstab配置内核参数cat EOF | sudo tee /etc/modules-load.d/k8s.conf overlay br_netfilter EOF sudo modprobe overlay sudo modprobe br_netfilter cat EOF | sudo tee /etc/sysctl.d/k8s.conf net.bridge.bridge-nf-call-iptables 1 net.bridge.bridge-nf-call-ip6tables 1 net.ipv4.ip_forward 1 EOF sudo sysctl --system3. 容器运行时安装与配置3.1 Containerd安装# 在线安装 sudo apt install -y containerd sudo mkdir -p /etc/containerd containerd config default | sudo tee /etc/containerd/config.toml sudo sed -i s/SystemdCgroup false/SystemdCgroup true/ /etc/containerd/config.toml sudo systemctl restart containerd离线安装需提前下载containerd-1.7.12-linux-arm64.tar.gzrunc.arm64cni-plugins-linux-arm64-v1.3.0.tgz3.2 镜像仓库配置对于离线环境需要搭建私有镜像仓库docker run -d \ -p 5000:5000 \ --restartalways \ --name registry \ -v /data/registry:/var/lib/registry \ registry:2-arm644. Kubernetes集群部署4.1 在线部署流程# 所有节点安装kubeadm/kubelet/kubectl sudo apt-get install -y apt-transport-https ca-certificates curl curl -fsSL https://packages.cloud.google.com/apt/doc/apt-key.gpg | sudo gpg --dearmor -o /etc/apt/keyrings/kubernetes-archive-keyring.gpg echo deb [signed-by/etc/apt/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main | sudo tee /etc/apt/sources.list.d/kubernetes.list sudo apt-get update sudo apt-get install -y kubelet1.34.5-00 kubeadm1.34.5-00 kubectl1.34.5-00 sudo apt-mark hold kubelet kubeadm kubectl初始化控制平面sudo kubeadm init \ --kubernetes-versionv1.34.5 \ --pod-network-cidr10.244.0.0/16 \ --apiserver-advertise-addressMASTER_IP \ --image-repositoryregistry.aliyuncs.com/google_containers4.2 离线部署方案提前下载离线包kubeadm-arm64-v1.34.5.tar.gzkubelet-arm64-v1.34.5.tar.gzkubectl-arm64-v1.34.5.tar.gzpause-arm64-3.9.tar加载镜像docker load -i pause-arm64-3.9.tar使用离线配置文件初始化kubeadm init \ --configkubeadm-config.yaml5. KubeSphere部署与配置5.1 在线安装KubeSpherekubectl apply -f https://github.com/kubesphere/ks-installer/releases/download/v3.4.1/kubesphere-installer.yaml kubectl apply -f https://github.com/kubesphere/ks-installer/releases/download/v3.4.1/cluster-configuration.yaml5.2 离线安装准备需要提前下载kubesphere-installer-arm64-v3.4.1.tar.gzks-installer-arm64-v3.4.1.tar.gz所有依赖组件的ARM64镜像部署命令helm install kubesphere ./kubesphere \ --namespace kubesphere-system \ --create-namespace \ --set persistence.storageClassyour-storage-class6. 网络插件与存储配置6.1 Calico网络部署kubectl apply -f https://docs.projectcalico.org/manifests/calico-arm64.yaml6.2 本地存储方案apiVersion: storage.k8s.io/v1 kind: StorageClass metadata: name: local-storage provisioner: kubernetes.io/no-provisioner volumeBindingMode: WaitForFirstConsumer7. 常见问题排查7.1 ARM架构特有问题镜像兼容性问题# 检查镜像平台 docker inspect --format{{.Architecture}} image节点NotReady状态journalctl -u kubelet -f7.2 KubeSphere部署问题安装卡在Checking状态kubectl logs -n kubesphere-system $(kubectl get pod -n kubesphere-system -l appks-install -o jsonpath{.items[0].metadata.name}) -f资源不足导致组件无法启动kubectl describe pod -n kubesphere-system pod-name8. 性能优化建议kubelet配置优化cat EOF | sudo tee /etc/sysconfig/kubelet KUBELET_EXTRA_ARGS--max-pods50 --kube-api-qps20 --kube-api-burst30 EOF内核参数调优echo vm.swappiness 10 | sudo tee -a /etc/sysctl.conf echo vm.vfs_cache_pressure 50 | sudo tee -a /etc/sysctl.conf sudo sysctl -pContainerd性能优化[plugins.io.containerd.grpc.v1.cri.containerd] snapshotter overlayfs disable_snapshot_annotations true [plugins.io.containerd.grpc.v1.cri.containerd.runtimes.runc.options] SystemdCgroup true