Add beta stage test for NodeLocalCRISocket feature gate #3212

HirazawaUi · 2025-06-17T15:00:34Z

Update the tests to:

Disable the NodeLocalCRISocket feature gate and create a cluster.
Disable the NodeLocalCRISocket feature gate and upgrade the cluster.
Enable the NodeLocalCRISocket feature gate and upgrade the cluster.

Committing it for now, I'll review this again first tomorrow myself :)

neolit123

thanks for the update.
i haven't checked the order of tasks thoroughly but overall SGTM

neolit123 · 2025-06-17T15:20:37Z

kinder/ci/tools/update-workflows/templates/workflows/instance-config-tasks.yaml


        for node in $nodes; do
-          annotation=$(KUBECONFIG=/etc/kubernetes/admin.conf kubectl get node "$node" -o jsonpath="{.metadata.annotations['kubeadm\.alpha\.kubernetes\.io/cri-socket']}")
+          annotation=$(KUBECONFIG=/etc/kubernetes/admin.conf kubectl get node "$node" -o jsonpath="{.metadata.annotations.kubeadm\.alpha\.kubernetes\.io\/cri-socket}")


wasn't ['...'] the correct way to handle this?

I'm also quite surprised. I spent a lot of time interacting with it, and it's possible that our previous mistakes may have masked it, preventing it from throwing errors.

i think both are supposed to work - accessing a key by using [....] and by using ., no?

tested

# kubectl get node kind-control-plane -o jsonpath="{.metadata.annotations['kubeadm\.alpha\.kubernetes\.io/cri-socket']}" OUTPUT: unix:///run/containerd/containerd.sock # kubectl get node kind-control-plane -o jsonpath="{.metadata.annotations.kubeadm\.alpha\.kubernetes\.io\/cri-socket}" OUTPUT: unix:///run/containerd/containerd.sock

kinder/ci/tools/update-workflows/templates/workflows/instance-config-tasks.yaml

neolit123 · 2025-06-17T15:26:29Z

please xref the tracking issue too.

HirazawaUi · 2025-06-18T12:54:00Z

Below is the test log from my local execution. Due to network restrictions on my local machine, I couldn't create a highly available cluster using kind, so it only has a single controlPlane node. Other than this, there are no differences.

Testing Process

./kinder/ci/kinder-run.sh instance-config-latest
Starting the kinder workflow runner...
~/go/src/k8s.io/kubeadm/kinder ~/go/src/k8s.io/kubeadm
Building kinder...
go version go1.23.6 linux/amd64
~/go/src/k8s.io/kubeadm
Using instance-config-latest.yaml from the default workflow path...
# task-00-pull-base-image
docker pull kindest/base:v20221102-76f15095

v20221102-76f15095: Pulling from kindest/base
Digest: sha256:8f8f9b376efeb1b1d69650bc872dacf4f780505121be416fd8003b23d8ec63e9
Status: Image is up to date for kindest/base:v20221102-76f15095
docker.io/kindest/base:v20221102-76f15095
 completed!

# task-01-add-kubernetes-versions
kinder build node-image-variant --base-image=kindest/base:v20221102-76f15095 --image=kindest/node:test --with-init-artifacts=v1.34.0-alpha.1.44+bb2199f3923eb4 --with-upgrade-artifacts=v1.34.0-alpha.1.44+bb2199f3923eb4 --loglevel=debug

time="20:40:01" level=info msg="Altering node image in: /tmp/kinder-alter-image2318037208"
time="20:40:01" level=info msg="Preparing bits ..."
time="20:40:01" level=info msg="version file created"
time="20:40:01" level=info msg="Downloading https://storage.googleapis.com/k8s-release-dev/ci/v1.34.0-alpha.1.44+bb2199f3923eb4/bin/linux/amd64/kubelet\n"
time="20:40:10" level=info msg="Downloading https://storage.googleapis.com/k8s-release-dev/ci/v1.34.0-alpha.1.44+bb2199f3923eb4/bin/linux/amd64/kubectl\n"
time="20:40:21" level=info msg="Downloading https://storage.googleapis.com/k8s-release-dev/ci/v1.34.0-alpha.1.44+bb2199f3923eb4/bin/linux/amd64/kubeadm\n"
time="20:40:33" level=info msg="Downloading https://storage.googleapis.com/k8s-release-dev/ci/v1.34.0-alpha.1.44+bb2199f3923eb4/bin/linux/amd64/kube-apiserver.tar\n"
time="20:40:53" level=info msg="Downloading https://storage.googleapis.com/k8s-release-dev/ci/v1.34.0-alpha.1.44+bb2199f3923eb4/bin/linux/amd64/kube-controller-manager.tar\n"
time="20:41:07" level=info msg="Downloading https://storage.googleapis.com/k8s-release-dev/ci/v1.34.0-alpha.1.44+bb2199f3923eb4/bin/linux/amd64/kube-scheduler.tar\n"
time="20:41:17" level=info msg="Downloading https://storage.googleapis.com/k8s-release-dev/ci/v1.34.0-alpha.1.44+bb2199f3923eb4/bin/linux/amd64/kube-proxy.tar\n"
time="20:41:40" level=info msg="Downloaded files saved into /tmp/kinder-alter-image2318037208/bits/init"
time="20:41:40" level=info msg="fixing /tmp/kinder-alter-image2318037208/bits/init/kube-apiserver.tar"
fixed: registry.k8s.io/kube-apiserver-amd64 -> registry.k8s.io/kube-apiserver
fixed: registry.k8s.io/kube-apiserver-amd64 -> registry.k8s.io/kube-apiserver
time="20:41:40" level=info msg="fixing /tmp/kinder-alter-image2318037208/bits/init/kube-controller-manager.tar"
fixed: registry.k8s.io/kube-controller-manager-amd64 -> registry.k8s.io/kube-controller-manager
fixed: registry.k8s.io/kube-controller-manager-amd64 -> registry.k8s.io/kube-controller-manager
time="20:41:40" level=info msg="fixing /tmp/kinder-alter-image2318037208/bits/init/kube-scheduler.tar"
fixed: registry.k8s.io/kube-scheduler-amd64 -> registry.k8s.io/kube-scheduler
fixed: registry.k8s.io/kube-scheduler-amd64 -> registry.k8s.io/kube-scheduler
time="20:41:41" level=info msg="fixing /tmp/kinder-alter-image2318037208/bits/init/kube-proxy.tar"
fixed: registry.k8s.io/kube-proxy-amd64 -> registry.k8s.io/kube-proxy
fixed: registry.k8s.io/kube-proxy-amd64 -> registry.k8s.io/kube-proxy
time="20:41:41" level=info msg="Copying /tmp/kinder-alter-image2318037208/bits/init/kubelet"
time="20:41:41" level=info msg="Copying /tmp/kinder-alter-image2318037208/bits/init/kubectl"
time="20:41:41" level=info msg="Copying /tmp/kinder-alter-image2318037208/bits/init/kubeadm"
time="20:41:41" level=info msg="Copying /tmp/kinder-alter-image2318037208/bits/init/kube-apiserver.tar"
time="20:41:41" level=info msg="Copying /tmp/kinder-alter-image2318037208/bits/init/kube-controller-manager.tar"
time="20:41:41" level=info msg="Copying /tmp/kinder-alter-image2318037208/bits/init/kube-scheduler.tar"
time="20:41:41" level=info msg="Copying /tmp/kinder-alter-image2318037208/bits/init/kube-proxy.tar"
time="20:41:41" level=info msg="Copying /tmp/kinder-alter-image2318037208/bits/init/version"
time="20:41:41" level=info msg="Copied files saved into /tmp/kinder-alter-image2318037208/bits/upgrade"
time="20:41:41" level=info msg="fixing /tmp/kinder-alter-image2318037208/bits/upgrade/v1.34.0-alpha.1.44+bb2199f3923eb4/kube-apiserver.tar"
time="20:41:41" level=info msg="fixing /tmp/kinder-alter-image2318037208/bits/upgrade/v1.34.0-alpha.1.44+bb2199f3923eb4/kube-controller-manager.tar"
time="20:41:41" level=info msg="fixing /tmp/kinder-alter-image2318037208/bits/upgrade/v1.34.0-alpha.1.44+bb2199f3923eb4/kube-scheduler.tar"
time="20:41:41" level=info msg="fixing /tmp/kinder-alter-image2318037208/bits/upgrade/v1.34.0-alpha.1.44+bb2199f3923eb4/kube-proxy.tar"
time="20:41:41" level=debug msg="Running: docker run -d --entrypoint=sleep --name=kind-detect-e4503342-16f9-4db6-893f-b87d06d6da7e kindest/base:v20221102-76f15095 infinity"
time="20:41:41" level=debug msg="Running: docker exec kind-detect-e4503342-16f9-4db6-893f-b87d06d6da7e /bin/sh -c which docker || true"
time="20:41:41" level=debug msg="Running: docker rm -f kind-detect-e4503342-16f9-4db6-893f-b87d06d6da7e"
time="20:41:42" level=info msg="Detected containerd as container runtime"
time="20:41:42" level=debug msg="Starting alter container ..."
time="20:41:42" level=debug msg="Running: docker inspect --type=image kindest/base:v20221102-76f15095"
time="20:41:42" level=debug msg="Running: docker run -d -v /tmp/kinder-alter-image2318037208:/alter --name=kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 --privileged --entrypoint=/bin/sleep kindest/base:v20221102-76f15095 infinity"
time="20:41:42" level=debug msg="Starting image alter ..."
time="20:41:42" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 mkdir -p /kind/images"
time="20:41:42" level=info msg="Starting bits install ..."
time="20:41:42" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 mkdir -p /kind"
time="20:41:42" level=info msg="Adding /kind/version file to the image"
time="20:41:42" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 cp /alter/bits/init/version /kind/version"
time="20:41:42" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 chown -R root:root /kind/version"
time="20:41:42" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 mkdir -p /kind/images"
time="20:41:42" level=debug msg="Searching /tmp/kinder-alter-image2318037208/bits/init/*.tar"
time="20:41:42" level=debug msg="Found [/tmp/kinder-alter-image2318037208/bits/init/kube-apiserver.tar /tmp/kinder-alter-image2318037208/bits/init/kube-controller-manager.tar /tmp/kinder-alter-image2318037208/bits/init/kube-proxy.tar /tmp/kinder-alter-image2318037208/bits/init/kube-scheduler.tar]"
time="20:41:42" level=info msg="Adding /kind/images/kube-apiserver.tar image tarball to the image"
time="20:41:42" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 cp /alter/bits/init/kube-apiserver.tar /kind/images/kube-apiserver.tar"
time="20:41:42" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 chown -R root:root /kind/images/kube-apiserver.tar"
time="20:41:42" level=info msg="Adding /kind/images/kube-controller-manager.tar image tarball to the image"
time="20:41:42" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 cp /alter/bits/init/kube-controller-manager.tar /kind/images/kube-controller-manager.tar"
time="20:41:42" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 chown -R root:root /kind/images/kube-controller-manager.tar"
time="20:41:42" level=info msg="Adding /kind/images/kube-proxy.tar image tarball to the image"
time="20:41:42" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 cp /alter/bits/init/kube-proxy.tar /kind/images/kube-proxy.tar"
time="20:41:42" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 chown -R root:root /kind/images/kube-proxy.tar"
time="20:41:42" level=info msg="Adding /kind/images/kube-scheduler.tar image tarball to the image"
time="20:41:42" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 cp /alter/bits/init/kube-scheduler.tar /kind/images/kube-scheduler.tar"
time="20:41:42" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 chown -R root:root /kind/images/kube-scheduler.tar"
time="20:41:42" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 mkdir -p /kind/bin"
time="20:41:42" level=info msg="Adding /kind/bin/kubeadm binary to the image and symlink to /usr/bin/kubeadm"
time="20:41:42" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 cp /alter/bits/init/kubeadm /kind/bin/kubeadm"
time="20:41:42" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 chown -R root:root /kind/bin/kubeadm"
time="20:41:42" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 ln -sf /kind/bin/kubeadm /usr/bin/kubeadm"
time="20:41:42" level=info msg="Adding /kind/bin/kubelet binary to the image and symlink to /usr/bin/kubelet"
time="20:41:42" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 cp /alter/bits/init/kubelet /kind/bin/kubelet"
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 chown -R root:root /kind/bin/kubelet"
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 ln -sf /kind/bin/kubelet /usr/bin/kubelet"
time="20:41:43" level=info msg="Adding /kind/bin/kubectl binary to the image and symlink to /usr/bin/kubectl"
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 cp /alter/bits/init/kubectl /kind/bin/kubectl"
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 chown -R root:root /kind/bin/kubectl"
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 ln -sf /kind/bin/kubectl /usr/bin/kubectl"
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 mkdir -p /kind/systemd"
time="20:41:43" level=info msg="Adding /kind/systemd/kubelet.service to the image and enabling the kubelet service"
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 cp /alter/bits/systemd/kubelet.service /kind/systemd/kubelet.service"
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 chown -R root:root /kind/systemd/kubelet.service"
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 systemctl enable /kind/systemd/kubelet.service"
Removed /etc/systemd/system/multi-user.target.wants/kubelet.service.
Created symlink /etc/systemd/system/multi-user.target.wants/kubelet.service → /kind/systemd/kubelet.service.
Failed to enable unit, file /etc/systemd/system/kubelet.service already exists.
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 mkdir -p /etc/systemd/system/kubelet.service.d"
time="20:41:43" level=info msg="Adding /etc/systemd/system/kubelet.service.d/10-kubeadm.conf to the image"
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 cp /alter/bits/systemd/10-kubeadm.conf /etc/systemd/system/kubelet.service.d/10-kubeadm.conf"
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 chown -R root:root /etc/systemd/system/kubelet.service.d/10-kubeadm.conf"
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 mkdir -p /kinder"
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 rsync -r /alter/bits/upgrade /kinder"
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 chown -R root:root /kinder/upgrade"
time="20:41:43" level=info msg="Setup CRI ..."
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 bash -c /kind/bin/kubeadm config images list --kubernetes-version=$(/kind/bin/kubeadm version -o short) 2> /dev/null | grep pause"
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 bash -c if [ -f /etc/containerd/config.toml ]; then cp /etc/containerd/config.toml /alter/containerd-config.toml && chmod 0666 /alter/containerd-config.toml; fi"
time="20:41:43" level=info msg="updating the config file /alter/containerd-config.toml to use the recommended sandbox image registry.k8s.io/pause:3.10"
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 cp /alter/containerd-config.toml /etc/containerd/config.toml"
time="20:41:43" level=info msg="configured the containerd runtime to use the sandbox image registry.k8s.io/pause:3.10"
time="20:41:43" level=info msg="Start CRI ..."
time="20:41:43" level=info msg="starting containerd"
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 bash -c crictl ps &> /dev/null"
time="20:41:43" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 bash -c nohup containerd > /dev/null 2>&1 &"
time="20:41:44" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 bash -c crictl ps &> /dev/null"
time="20:41:44" level=info msg="containerd started"
time="20:41:44" level=info msg="Pre-loading images ..."
time="20:41:44" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 bash -c find /kind/images -name *.tar -print0 | xargs -0 -n 1 -P $(nproc) ctr --namespace=k8s.io images import --all-platforms --no-unpack && rm -rf /kind/images/*.tar"
time="20:41:48" level=info msg="Pre-pulling additional images ..."
time="20:41:48" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 bash -c /kind/bin/kubeadm config images list --kubernetes-version=$(/kind/bin/kubeadm version -o short) 2> /dev/null | grep -v 'kube-'"
time="20:41:48" level=info msg="Found the following extra images from the binary \"/kind/bin/kubeadm\": [registry.k8s.io/coredns/coredns:v1.12.1 registry.k8s.io/pause:3.10 registry.k8s.io/etcd:3.6.0-0]"
time="20:41:48" level=debug msg="Running: docker pull registry.k8s.io/coredns/coredns:v1.12.1"
time="20:41:50" level=debug msg="Running: docker save -o=/tmp/kinder-image-path1827140438/coredns.tar registry.k8s.io/coredns/coredns:v1.12.1"
time="20:41:50" level=debug msg="Running: docker cp /tmp/kinder-image-path1827140438/coredns.tar kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66:/kind/images"
time="20:41:50" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 ctr --namespace=k8s.io image import /kind/images/coredns.tar --no-unpack"
time="20:41:51" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 rm /kind/images/coredns.tar"
time="20:41:51" level=debug msg="Running: docker pull registry.k8s.io/pause:3.10"
time="20:41:57" level=debug msg="Running: docker save -o=/tmp/kinder-image-path1827140438/pause.tar registry.k8s.io/pause:3.10"
time="20:41:57" level=debug msg="Running: docker cp /tmp/kinder-image-path1827140438/pause.tar kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66:/kind/images"
time="20:41:57" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 ctr --namespace=k8s.io image import /kind/images/pause.tar --no-unpack"
time="20:41:57" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 rm /kind/images/pause.tar"
time="20:41:57" level=debug msg="Running: docker pull registry.k8s.io/etcd:3.6.0-0"
time="20:41:59" level=debug msg="Running: docker save -o=/tmp/kinder-image-path1827140438/etcd.tar registry.k8s.io/etcd:3.6.0-0"
time="20:42:00" level=debug msg="Running: docker cp /tmp/kinder-image-path1827140438/etcd.tar kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66:/kind/images"
time="20:42:00" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 ctr --namespace=k8s.io image import /kind/images/etcd.tar --no-unpack"
time="20:42:01" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 rm /kind/images/etcd.tar"
time="20:42:01" level=debug msg="Running: docker pull kindest/kindnetd:0.5.4"
time="20:42:04" level=debug msg="Running: docker save -o=/tmp/kinder-image-path1827140438/kindnetd.tar kindest/kindnetd:0.5.4"
time="20:42:05" level=debug msg="Running: docker cp /tmp/kinder-image-path1827140438/kindnetd.tar kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66:/kind/images"
time="20:42:05" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 ctr --namespace=k8s.io image import /kind/images/kindnetd.tar --no-unpack"
time="20:42:06" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 rm /kind/images/kindnetd.tar"
time="20:42:06" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 bash -c cat /kinder/upgrade/version 2> /dev/null"
time="20:42:06" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 bash -c /kinder/upgrade/v1.34.0-alpha.1.44+bb2199f3923eb4/kubeadm config images list --kubernetes-version=$(/kinder/upgrade/v1.34.0-alpha.1.44+bb2199f3923eb4/kubeadm version -o short) 2> /dev/null | grep -v 'kube-'"
time="20:42:06" level=info msg="Found the following extra images from the binary \"/kinder/upgrade/v1.34.0-alpha.1.44+bb2199f3923eb4/kubeadm\": [registry.k8s.io/coredns/coredns:v1.12.1 registry.k8s.io/pause:3.10 registry.k8s.io/etcd:3.6.0-0]"
time="20:42:06" level=debug msg="Running: docker pull registry.k8s.io/coredns/coredns:v1.12.1"
time="20:42:10" level=debug msg="Running: docker save -o=/tmp/kinder-image-path3253915429/coredns.tar registry.k8s.io/coredns/coredns:v1.12.1"
time="20:42:10" level=debug msg="Running: docker cp /tmp/kinder-image-path3253915429/coredns.tar kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66:/kinder/upgrade/v1.34.0-alpha.1.44+bb2199f3923eb4"
time="20:42:10" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 ctr --namespace=k8s.io image import /kinder/upgrade/v1.34.0-alpha.1.44+bb2199f3923eb4/coredns.tar --no-unpack"
time="20:42:11" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 rm /kinder/upgrade/v1.34.0-alpha.1.44+bb2199f3923eb4/coredns.tar"
time="20:42:11" level=debug msg="Running: docker pull registry.k8s.io/pause:3.10"
time="20:42:16" level=debug msg="Running: docker save -o=/tmp/kinder-image-path3253915429/pause.tar registry.k8s.io/pause:3.10"
time="20:42:16" level=debug msg="Running: docker cp /tmp/kinder-image-path3253915429/pause.tar kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66:/kinder/upgrade/v1.34.0-alpha.1.44+bb2199f3923eb4"
time="20:42:16" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 ctr --namespace=k8s.io image import /kinder/upgrade/v1.34.0-alpha.1.44+bb2199f3923eb4/pause.tar --no-unpack"
time="20:42:16" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 rm /kinder/upgrade/v1.34.0-alpha.1.44+bb2199f3923eb4/pause.tar"
time="20:42:16" level=debug msg="Running: docker pull registry.k8s.io/etcd:3.6.0-0"
time="20:42:20" level=debug msg="Running: docker save -o=/tmp/kinder-image-path3253915429/etcd.tar registry.k8s.io/etcd:3.6.0-0"
time="20:42:21" level=debug msg="Running: docker cp /tmp/kinder-image-path3253915429/etcd.tar kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66:/kinder/upgrade/v1.34.0-alpha.1.44+bb2199f3923eb4"
time="20:42:21" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 ctr --namespace=k8s.io image import /kinder/upgrade/v1.34.0-alpha.1.44+bb2199f3923eb4/etcd.tar --no-unpack"
time="20:42:22" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 rm /kinder/upgrade/v1.34.0-alpha.1.44+bb2199f3923eb4/etcd.tar"
time="20:42:22" level=info msg="Stop CRI ..."
time="20:42:22" level=debug msg="Running: docker exec kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66 pkill -f containerd"
time="20:42:22" level=info msg="Commit to kindest/node:test ..."
sha256:7d2ee8a7636c7b6c36e8f03eb60d08216b7847599014d44f3eec13259c04c322
time="20:42:25" level=info msg="Image alter completed."
time="20:42:25" level=debug msg="Running: docker rm -f -v kind-build-ac06fbb1-ba7c-46ae-8e18-401913dc9d66"
 completed!

# task-02-create-cluster
kinder create cluster --name=kinder-instance-config --image=kindest/node:test --control-plane-nodes=1 --worker-nodes=2 --loglevel=debug

time="20:42:25" level=debug msg="Running: docker ps -a --no-trunc --filter label=io.k8s.sigs.kind.cluster --format {{.Label \"io.k8s.sigs.kind.cluster\"}}"
Creating cluster "kinder-instance-config" ...
Ensuring node image (kindest/node:test) 🖼
time="20:42:25" level=debug msg="Running: docker inspect --type=image kindest/node:test"
Preparing nodes 📦📦📦
time="20:42:25" level=debug msg="Running: docker run -d --entrypoint=sleep --name=kind-detect-c543c6e5-906d-4856-b5c1-bedb5f61e11e kindest/node:test infinity"
time="20:42:26" level=debug msg="Running: docker exec kind-detect-c543c6e5-906d-4856-b5c1-bedb5f61e11e /bin/sh -c which docker || true"
time="20:42:26" level=debug msg="Running: docker rm -f kind-detect-c543c6e5-906d-4856-b5c1-bedb5f61e11e"
time="20:42:27" level=info msg="Detected containerd container runtime for image kindest/node:test"
time="20:42:27" level=info msg="Creating nodes..."
time="20:42:27" level=debug msg="Running: docker network inspect -f {{range (index (index . \"IPAM\") \"Config\")}}{{index . \"Subnet\"}} {{end}} bridge"
time="20:42:27" level=debug msg="Running: docker info --format '{{json .SecurityOptions}}'"
time="20:42:27" level=debug msg="Running: docker run --detach --tty --label io.x-k8s.kind.cluster=kinder-instance-config --label io.k8s.sigs.kind.cluster=kinder-instance-config --hostname kinder-instance-config-control-plane-1 --name kinder-instance-config-control-plane-1 --label io.x-k8s.kind.role=control-plane --label io.k8s.sigs.kind.role=control-plane -e HTTP_PROXY=http://192.168.31.150:7890 -e http_proxy=http://192.168.31.150:7890 -e HTTPS_PROXY=http://192.168.31.150:7890 -e https_proxy=http://192.168.31.150:7890 -e NO_PROXY=172.17.0.0/16,10.0.0.0/8,127.0.0.0/8, -e no_proxy=172.17.0.0/16,10.0.0.0/8,127.0.0.0/8, --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run --volume /var --volume /lib/modules:/lib/modules:ro --publish=35877:6443/TCP kindest/node:test"
time="20:42:28" level=debug msg="Running: docker network inspect -f {{range (index (index . \"IPAM\") \"Config\")}}{{index . \"Subnet\"}} {{end}} bridge"
time="20:42:28" level=debug msg="Running: docker info --format '{{json .SecurityOptions}}'"
time="20:42:28" level=debug msg="Running: docker run --detach --tty --label io.x-k8s.kind.cluster=kinder-instance-config --label io.k8s.sigs.kind.cluster=kinder-instance-config --hostname kinder-instance-config-worker-1 --name kinder-instance-config-worker-1 --label io.x-k8s.kind.role=worker --label io.k8s.sigs.kind.role=worker -e HTTPS_PROXY=http://192.168.31.150:7890 -e https_proxy=http://192.168.31.150:7890 -e NO_PROXY=172.17.0.0/16,10.0.0.0/8,127.0.0.0/8, -e no_proxy=172.17.0.0/16,10.0.0.0/8,127.0.0.0/8, -e HTTP_PROXY=http://192.168.31.150:7890 -e http_proxy=http://192.168.31.150:7890 --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run --volume /var --volume /lib/modules:/lib/modules:ro kindest/node:test"
time="20:42:29" level=debug msg="Running: docker network inspect -f {{range (index (index . \"IPAM\") \"Config\")}}{{index . \"Subnet\"}} {{end}} bridge"
time="20:42:29" level=debug msg="Running: docker info --format '{{json .SecurityOptions}}'"
time="20:42:29" level=debug msg="Running: docker run --detach --tty --label io.x-k8s.kind.cluster=kinder-instance-config --label io.k8s.sigs.kind.cluster=kinder-instance-config --hostname kinder-instance-config-worker-2 --name kinder-instance-config-worker-2 --label io.x-k8s.kind.role=worker --label io.k8s.sigs.kind.role=worker -e NO_PROXY=172.17.0.0/16,10.0.0.0/8,127.0.0.0/8, -e no_proxy=172.17.0.0/16,10.0.0.0/8,127.0.0.0/8, -e HTTP_PROXY=http://192.168.31.150:7890 -e http_proxy=http://192.168.31.150:7890 -e HTTPS_PROXY=http://192.168.31.150:7890 -e https_proxy=http://192.168.31.150:7890 --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run --volume /var --volume /lib/modules:/lib/modules:ro kindest/node:test"
time="20:42:31" level=info msg="Waiting for all nodes to start..."
time="20:42:31" level=info msg="Waiting for node kinder-instance-config-control-plane-1 to start..."
time="20:42:31" level=debug msg="Running: docker container inspect -f '{{.State.Running}}' kinder-instance-config-control-plane-1"
time="20:42:31" level=info msg="Waiting for node kinder-instance-config-worker-1 to start..."
time="20:42:31" level=debug msg="Running: docker container inspect -f '{{.State.Running}}' kinder-instance-config-worker-1"
time="20:42:31" level=info msg="Waiting for node kinder-instance-config-worker-2 to start..."
time="20:42:31" level=debug msg="Running: docker container inspect -f '{{.State.Running}}' kinder-instance-config-worker-2"
time="20:42:31" level=debug msg="Reading container list for cluster kinder-instance-config"
time="20:42:31" level=debug msg="Running: docker ps -a --no-trunc --filter label=io.k8s.sigs.kind.cluster=kinder-instance-config --format {{.Names}}"
time="20:42:31" level=debug msg="Adding node kinder-instance-config-worker-2 to the cluster"
time="20:42:31" level=debug msg="Running: docker inspect -f {{index .Config.Labels \"io.k8s.sigs.kind.role\"}} kinder-instance-config-worker-2"
time="20:42:31" level=debug msg="Adding node kinder-instance-config-worker-1 to the cluster"
time="20:42:31" level=debug msg="Running: docker inspect -f {{index .Config.Labels \"io.k8s.sigs.kind.role\"}} kinder-instance-config-worker-1"
time="20:42:31" level=debug msg="Adding node kinder-instance-config-control-plane-1 to the cluster"
time="20:42:31" level=debug msg="Running: docker inspect -f {{index .Config.Labels \"io.k8s.sigs.kind.role\"}} kinder-instance-config-control-plane-1"

Nodes creation complete. You can now continue creating a Kubernetes cluster using
kinder do, the kinder swiss knife 🚀!
 completed!

......

# task-17-cluster-info
kinder do cluster-info --name=kinder-instance-config --loglevel=debug

time="20:44:23" level=debug msg="Running: docker ps -a --no-trunc --filter label=io.k8s.sigs.kind.cluster --format {{.Label \"io.k8s.sigs.kind.cluster\"}}"
time="20:44:23" level=debug msg="Reading container list for cluster kinder-instance-config"
time="20:44:23" level=debug msg="Running: docker ps -a --no-trunc --filter label=io.k8s.sigs.kind.cluster=kinder-instance-config --format {{.Names}}"
time="20:44:23" level=debug msg="Adding node kinder-instance-config-worker-2 to the cluster"
time="20:44:23" level=debug msg="Running: docker inspect -f {{index .Config.Labels \"io.k8s.sigs.kind.role\"}} kinder-instance-config-worker-2"
time="20:44:23" level=debug msg="Adding node kinder-instance-config-worker-1 to the cluster"
time="20:44:23" level=debug msg="Running: docker inspect -f {{index .Config.Labels \"io.k8s.sigs.kind.role\"}} kinder-instance-config-worker-1"
time="20:44:23" level=debug msg="Adding node kinder-instance-config-control-plane-1 to the cluster"
time="20:44:23" level=debug msg="Running: docker inspect -f {{index .Config.Labels \"io.k8s.sigs.kind.role\"}} kinder-instance-config-control-plane-1"
time="20:44:23" level=debug msg="Reading cluster settings..."
time="20:44:23" level=info msg="Running action cluster-info..."

kinder-instance-config-control-plane-1:$ kubectl --kubeconfig=/etc/kubernetes/admin.conf get nodes -o=wide
time="20:44:23" level=debug msg="Running: docker exec kinder-instance-config-control-plane-1 kubectl --kubeconfig=/etc/kubernetes/admin.conf get nodes -o=wide"
NAME                                     STATUS   ROLES           AGE    VERSION                             INTERNAL-IP   EXTERNAL-IP   OS-IMAGE             KERNEL-VERSION           CONTAINER-RUNTIME
kinder-instance-config-control-plane-1   Ready    control-plane   106s   v1.34.0-alpha.1.44+bb2199f3923eb4   172.17.0.2    <none>        Ubuntu 22.04.1 LTS   6.10.6-100.fc39.x86_64   containerd://1.6.9
kinder-instance-config-worker-1          Ready    <none>          93s    v1.34.0-alpha.1.44+bb2199f3923eb4   172.17.0.3    <none>        Ubuntu 22.04.1 LTS   6.10.6-100.fc39.x86_64   containerd://1.6.9
kinder-instance-config-worker-2          Ready    <none>          88s    v1.34.0-alpha.1.44+bb2199f3923eb4   172.17.0.4    <none>        Ubuntu 22.04.1 LTS   6.10.6-100.fc39.x86_64   containerd://1.6.9

kinder-instance-config-control-plane-1:$ kubectl --kubeconfig=/etc/kubernetes/admin.conf get pods --all-namespaces -o=wide
time="20:44:23" level=debug msg="Running: docker exec kinder-instance-config-control-plane-1 kubectl --kubeconfig=/etc/kubernetes/admin.conf get pods --all-namespaces -o=wide"
NAMESPACE     NAME                                                             READY   STATUS    RESTARTS   AGE    IP            NODE                                     NOMINATED NODE   READINESS GATES
kube-system   coredns-6d8757d46-bhwfc                                          1/1     Running   0          97s    192.168.0.2   kinder-instance-config-control-plane-1   <none>           <none>
kube-system   coredns-6d8757d46-fldbw                                          1/1     Running   0          97s    192.168.0.3   kinder-instance-config-control-plane-1   <none>           <none>
kube-system   etcd-kinder-instance-config-control-plane-1                      0/1     Running   0          105s   172.17.0.2    kinder-instance-config-control-plane-1   <none>           <none>
kube-system   kindnet-895l7                                                    1/1     Running   0          97s    172.17.0.2    kinder-instance-config-control-plane-1   <none>           <none>
kube-system   kindnet-ch78n                                                    1/1     Running   0          93s    172.17.0.3    kinder-instance-config-worker-1          <none>           <none>
kube-system   kindnet-gmw29                                                    1/1     Running   0          88s    172.17.0.4    kinder-instance-config-worker-2          <none>           <none>
kube-system   kube-apiserver-kinder-instance-config-control-plane-1            0/1     Running   0          102s   172.17.0.2    kinder-instance-config-control-plane-1   <none>           <none>
kube-system   kube-controller-manager-kinder-instance-config-control-plane-1   0/1     Running   0          105s   172.17.0.2    kinder-instance-config-control-plane-1   <none>           <none>
kube-system   kube-proxy-5pxv6                                                 1/1     Running   0          97s    172.17.0.2    kinder-instance-config-control-plane-1   <none>           <none>
kube-system   kube-proxy-r6plr                                                 1/1     Running   0          93s    172.17.0.3    kinder-instance-config-worker-1          <none>           <none>
kube-system   kube-proxy-wmls4                                                 1/1     Running   0          88s    172.17.0.4    kinder-instance-config-worker-2          <none>           <none>
kube-system   kube-scheduler-kinder-instance-config-control-plane-1            0/1     Running   0          105s   172.17.0.2    kinder-instance-config-control-plane-1   <none>           <none>

kinder-instance-config-control-plane-1:$ kubectl --kubeconfig=/etc/kubernetes/admin.conf get pods --all-namespaces -o=jsonpath={range .items[*]}{"\n"}{.metadata.name}{" << "}{range .spec.containers[*]}{.image}{", "}{end}{end}
time="20:44:23" level=debug msg="Running: docker exec kinder-instance-config-control-plane-1 kubectl --kubeconfig=/etc/kubernetes/admin.conf get pods --all-namespaces -o=jsonpath={range .items[*]}{\"\\n\"}{.metadata.name}{\" << \"}{range .spec.containers[*]}{.image}{\", \"}{end}{end}"

coredns-6d8757d46-bhwfc << registry.k8s.io/coredns/coredns:v1.12.1,
coredns-6d8757d46-fldbw << registry.k8s.io/coredns/coredns:v1.12.1,
etcd-kinder-instance-config-control-plane-1 << registry.k8s.io/etcd:3.6.0-0,
kindnet-895l7 << kindest/kindnetd:0.5.4,
kindnet-ch78n << kindest/kindnetd:0.5.4,
kindnet-gmw29 << kindest/kindnetd:0.5.4,
kube-apiserver-kinder-instance-config-control-plane-1 << registry.k8s.io/kube-apiserver:v1.34.0-alpha.1.44_bb2199f3923eb4,
kube-controller-manager-kinder-instance-config-control-plane-1 << registry.k8s.io/kube-controller-manager:v1.34.0-alpha.1.44_bb2199f3923eb4,
kube-proxy-5pxv6 << registry.k8s.io/kube-proxy:v1.34.0-alpha.1.44_bb2199f3923eb4,
kube-proxy-r6plr << registry.k8s.io/kube-proxy:v1.34.0-alpha.1.44_bb2199f3923eb4,
kube-proxy-wmls4 << registry.k8s.io/kube-proxy:v1.34.0-alpha.1.44_bb2199f3923eb4,
kube-scheduler-kinder-instance-config-control-plane-1 << registry.k8s.io/kube-scheduler:v1.34.0-alpha.1.44_bb2199f3923eb4,

kinder-instance-config-control-plane-1:$ kubectl --request-timeout=2 --kubeconfig=/etc/kubernetes/admin.conf exec -n=kube-system etcd-kinder-instance-config-control-plane-1 -- etcd --version
time="20:44:23" level=debug msg="Running: docker exec kinder-instance-config-control-plane-1 kubectl --request-timeout=2 --kubeconfig=/etc/kubernetes/admin.conf exec -n=kube-system etcd-kinder-instance-config-control-plane-1 -- etcd --version"

kinder-instance-config-control-plane-1:$ Using etcdctl version: 3.6.0


kinder-instance-config-control-plane-1:$ kubectl --kubeconfig=/etc/kubernetes/admin.conf exec -n=kube-system etcd-kinder-instance-config-control-plane-1 -- etcdctl --endpoints=https://127.0.0.1:2379 --cacert=/etc/kubernetes/pki/etcd/ca.crt --cert=/etc/kubernetes/pki/etcd/peer.crt --key=/etc/kubernetes/pki/etcd/peer.key member list
time="20:44:23" level=debug msg="Running: docker exec kinder-instance-config-control-plane-1 kubectl --kubeconfig=/etc/kubernetes/admin.conf exec -n=kube-system etcd-kinder-instance-config-control-plane-1 -- etcdctl --endpoints=https://127.0.0.1:2379 --cacert=/etc/kubernetes/pki/etcd/ca.crt --cert=/etc/kubernetes/pki/etcd/peer.crt --key=/etc/kubernetes/pki/etcd/peer.key member list"
b8e14bda2255bc24, started, kinder-instance-config-control-plane-1, https://172.17.0.2:2380, https://172.17.0.2:2379, false
 completed!

# task-18-e2e-kubeadm
kinder test e2e-kubeadm --test-flags=--report-dir=/root/go/src/k8s.io/kubeadm/kinder-test-workflow3296165473 --report-prefix=e2e-kubeadm --name=kinder-instance-config --loglevel=debug

time="20:44:23" level=debug msg="Running: docker ps -a --no-trunc --filter label=io.k8s.sigs.kind.cluster --format {{.Label \"io.k8s.sigs.kind.cluster\"}}"
time="20:44:23" level=info msg="using Kubernetes checkout in /root/go/src/k8s.io/kubernetes folder"
time="20:44:23" level=info msg="using ginkgo binary: /root/go/src/k8s.io/kubernetes/_output/bin/ginkgo"
time="20:44:23" level=info msg="using e2e_kubeadm.test binary: /root/go/src/k8s.io/kubernetes/_output/bin/e2e_kubeadm.test"
time="20:44:23" level=debug msg="invoking ginkgo with following args: [--skip=\\[copy-certs\\] /root/go/src/k8s.io/kubernetes/_output/bin/e2e_kubeadm.test -- --report-prefix=e2e-kubeadm --kubeconfig=/root/.kube/kind-config-kinder-instance-config --report-dir=/root/go/src/k8s.io/kubeadm/kinder-test-workflow3296165473]"
time="20:44:23" level=debug msg="Running: /root/go/src/k8s.io/kubernetes/_output/bin/ginkgo --skip=\\[copy-certs\\] /root/go/src/k8s.io/kubernetes/_output/bin/e2e_kubeadm.test -- --report-prefix=e2e-kubeadm --kubeconfig=/root/.kube/kind-config-kinder-instance-config --report-dir=/root/go/src/k8s.io/kubeadm/kinder-test-workflow3296165473"
  I0618 20:44:23.711476 391156 test_context.go:564] The --provider flag is not set. Continuing as if --provider=skeleton had been used.
Running Suite: E2EKubeadm suite - /root/go/src/k8s.io/kubernetes/_output/bin
============================================================================
Random Seed: 1750250663 - will randomize all specs

Will run 33 of 36 specs
S•••••••••••••••••S•••••S••••••••••S

Ran 32 of 36 Specs in 0.136 seconds
SUCCESS! -- 32 Passed | 0 Failed | 0 Pending | 4 Skipped
PASS

Ginkgo ran 1 suite in 158.752134ms
Test Suite Passed
[--skip=\[copy-certs\] /root/go/src/k8s.io/kubernetes/_output/bin/e2e_kubeadm.test -- --report-prefix=e2e-kubeadm --kubeconfig=/root/.kube/kind-config-kinder-instance-config --report-dir=/root/go/src/k8s.io/kubeadm/kinder-test-workflow3296165473]
 completed!

# task-19-get-logs
kinder export logs --loglevel=debug --name=kinder-instance-config /root/go/src/k8s.io/kubeadm/kinder-test-workflow3296165473

/root/go/src/k8s.io/kubeadm/kinder-test-workflow3296165473
Exported logs for cluster "kinder-instance-config" to:
 completed!

# task-20-reset
kinder do kubeadm-reset --name=kinder-instance-config --loglevel=debug --kubeadm-verbosity=6

time="20:44:24" level=debug msg="Running: docker ps -a --no-trunc --filter label=io.k8s.sigs.kind.cluster --format {{.Label \"io.k8s.sigs.kind.cluster\"}}"
time="20:44:24" level=debug msg="Reading container list for cluster kinder-instance-config"
time="20:44:24" level=debug msg="Running: docker ps -a --no-trunc --filter label=io.k8s.sigs.kind.cluster=kinder-instance-config --format {{.Names}}"
time="20:44:24" level=debug msg="Adding node kinder-instance-config-worker-2 to the cluster"
time="20:44:24" level=debug msg="Running: docker inspect -f {{index .Config.Labels \"io.k8s.sigs.kind.role\"}} kinder-instance-config-worker-2"
time="20:44:24" level=debug msg="Adding node kinder-instance-config-worker-1 to the cluster"
time="20:44:24" level=debug msg="Running: docker inspect -f {{index .Config.Labels \"io.k8s.sigs.kind.role\"}} kinder-instance-config-worker-1"
time="20:44:24" level=debug msg="Adding node kinder-instance-config-control-plane-1 to the cluster"
time="20:44:24" level=debug msg="Running: docker inspect -f {{index .Config.Labels \"io.k8s.sigs.kind.role\"}} kinder-instance-config-control-plane-1"
time="20:44:24" level=debug msg="Reading cluster settings..."
time="20:44:24" level=info msg="Running action kubeadm-reset..."
time="20:44:24" level=debug msg="Running: docker exec kinder-instance-config-control-plane-1 kubeadm version -o=short"

kinder-instance-config-control-plane-1:$ cat /kind/version
time="20:44:24" level=debug msg="Running: docker exec kinder-instance-config-control-plane-1 cat /kind/version"
time="20:44:24" level=debug msg="Running: docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-instance-config-control-plane-1"
time="20:44:24" level=debug msg="Running: docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-instance-config-control-plane-1"

kinder-instance-config-control-plane-1:$ Preparing /kind/kubeadm.conf
time="20:44:24" level=debug msg="Running: docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-instance-config-control-plane-1"
time="20:44:24" level=debug msg="Running: docker exec kinder-instance-config-control-plane-1 kubeadm version -o=short"
time="20:44:24" level=debug msg="kubeadm version 1.34.0-alpha.1.44+bb2199f3923eb4"
time="20:44:24" level=debug msg="using kubeadm config version v1beta4"
time="20:44:24" level=debug msg="Preparing kubeadm config v1beta4"
time="20:44:24" level=debug msg="Running: docker exec kinder-instance-config-control-plane-1 /bin/sh -c which docker || true"
time="20:44:24" level=debug msg="Preparing automaticCopyCertsPatches for kubeadm config v1beta4"
time="20:44:24" level=debug msg="Preparing patches directory for kubeadm config v1beta4"
time="20:44:24" level=debug msg="generating config..."
apiServer:
  certSANs:
  - localhost
  - 172.17.0.2
apiVersion: kubeadm.k8s.io/v1beta4
clusterName: kinder-instance-config
controlPlaneEndpoint: 172.17.0.2:6443
controllerManager:
  extraArgs: null
kind: ClusterConfiguration
kubernetesVersion: v1.34.0-alpha.1.44+bb2199f3923eb4
networking:
  podSubnet: 192.168.0.0/16
  serviceSubnet: ""
scheduler:
  extraArgs: null
---
apiVersion: kubeadm.k8s.io/v1beta4
bootstrapTokens:
- token: abcdef.0123456789abcdef
certificateKey: "0123456789012345678901234567890123456789012345678901234567890123"
kind: InitConfiguration
localAPIEndpoint:
  advertiseAddress: 172.17.0.2
  bindPort: 6443
nodeRegistration:
  criSocket: /run/containerd/containerd.sock
  kubeletExtraArgs:
  - name: node-ip
    value: 172.17.0.2
patches:
  directory: /kinder/patches
---
apiVersion: kubeadm.k8s.io/v1beta4
apply:
  allowExperimentalUpgrades: true
  allowRCUpgrades: true
  forceUpgrade: true
  kubernetesVersion: v1.0.0
  patches:
    directory: /kinder/patches
diff:
  kubernetesVersion: v1.0.0
kind: UpgradeConfiguration
node:
  patches:
    directory: /kinder/patches
plan:
  allowExperimentalUpgrades: true
  allowRCUpgrades: true
  kubernetesVersion: v1.0.0
---
apiVersion: kubeadm.k8s.io/v1beta4
force: true
kind: ResetConfiguration
---
apiVersion: kubelet.config.k8s.io/v1beta1
cgroupDriver: systemd
evictionHard:
  imagefs.available: 0%
  nodefs.available: 0%
  nodefs.inodesFree: 0%
failSwapOn: false
imageGCHighThresholdPercent: 100
kind: KubeletConfiguration
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
conntrack:
  maxPerCore: 0
kind: KubeProxyConfiguration
time="20:44:24" level=debug msg="Running: docker cp /tmp/kinder-instance-config-control-plane-1-3730368241 kinder-instance-config-control-plane-1:/kind/kubeadm.conf"

kinder-instance-config-control-plane-1:$ kubeadm reset --v=6 --config /kind/kubeadm.conf
time="20:44:24" level=debug msg="Running: docker exec kinder-instance-config-control-plane-1 kubeadm reset --v=6 --config /kind/kubeadm.conf"
I0618 12:44:24.355159    3844 resetconfiguration.go:86] loading configuration from "/kind/kubeadm.conf"
W0618 12:44:24.355496    3844 resetconfiguration.go:116] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration
W0618 12:44:24.355503    3844 resetconfiguration.go:116] [config] WARNING: Ignored configuration document with GroupVersionKind kubeproxy.config.k8s.io/v1alpha1, Kind=KubeProxyConfiguration
W0618 12:44:24.355505    3844 resetconfiguration.go:116] [config] WARNING: Ignored configuration document with GroupVersionKind kubeadm.k8s.io/v1beta4, Kind=ClusterConfiguration
W0618 12:44:24.355506    3844 resetconfiguration.go:116] [config] WARNING: Ignored configuration document with GroupVersionKind kubeadm.k8s.io/v1beta4, Kind=InitConfiguration
W0618 12:44:24.355508    3844 resetconfiguration.go:116] [config] WARNING: Ignored configuration document with GroupVersionKind kubeadm.k8s.io/v1beta4, Kind=UpgradeConfiguration
I0618 12:44:24.355586    3844 resetconfiguration.go:50] detected and using CRI socket: unix:///var/run/containerd/containerd.sock
I0618 12:44:24.355859    3844 loader.go:402] Config loaded from file:  /etc/kubernetes/admin.conf
I0618 12:44:24.356052    3844 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false
I0618 12:44:24.356062    3844 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false
I0618 12:44:24.356065    3844 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
I0618 12:44:24.356067    3844 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true
I0618 12:44:24.356070    3844 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
I0618 12:44:24.356231    3844 reset.go:134] [reset] Loaded client set from kubeconfig file: /etc/kubernetes/admin.conf
[reset] Reading configuration from the "kubeadm-config" ConfigMap in namespace "kube-system"...
[reset] Use 'kubeadm init phase upload-config kubeadm --config your-config-file' to re-upload it.
I0618 12:44:24.360163    3844 round_trippers.go:632] "Response" verb="GET" url="https://172.17.0.2:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config?timeout=10s" status="200 OK" milliseconds=3
I0618 12:44:24.360516    3844 kubeproxy.go:55] attempting to download the KubeProxyConfiguration from ConfigMap "kube-proxy"
I0618 12:44:24.361194    3844 round_trippers.go:632] "Response" verb="GET" url="https://172.17.0.2:6443/api/v1/namespaces/kube-system/configmaps/kube-proxy?timeout=10s" status="200 OK" milliseconds=0
I0618 12:44:24.361842    3844 kubelet.go:73] attempting to download the KubeletConfiguration from ConfigMap "kubelet-config"
I0618 12:44:24.362388    3844 round_trippers.go:632] "Response" verb="GET" url="https://172.17.0.2:6443/api/v1/namespaces/kube-system/configmaps/kubelet-config?timeout=10s" status="200 OK" milliseconds=0
I0618 12:44:24.363199    3844 loader.go:402] Config loaded from file:  /etc/kubernetes/kubelet.conf
I0618 12:44:24.363493    3844 cert_rotation.go:141] "Starting client certificate rotation controller" logger="tls-transport-cache"
I0618 12:44:24.366483    3844 round_trippers.go:632] "Response" verb="POST" url="https://172.17.0.2:6443/apis/authentication.k8s.io/v1/selfsubjectreviews?timeout=10s" status="201 Created" milliseconds=2
I0618 12:44:24.367118    3844 round_trippers.go:632] "Response" verb="GET" url="https://172.17.0.2:6443/api/v1/nodes/kinder-instance-config-control-plane-1?timeout=10s" status="200 OK" milliseconds=0
I0618 12:44:24.368163    3844 round_trippers.go:632] "Response" verb="GET" url="https://172.17.0.2:6443/api/v1/namespaces/kube-system/pods?fieldSelector=spec.nodeName%3Dkinder-instance-config-control-plane-1&labelSelector=component%3Dkube-apiserver%2Ctier%3Dcontrol-plane" status="200 OK" milliseconds=0
[preflight] Running pre-flight checks
I0618 12:44:24.368326    3844 common.go:148] WARNING: tolerating control plane version v1.34.0-alpha.1.44+bb2199f3923eb4 as a pre-release version
I0618 12:44:24.368334    3844 reset.go:158] [reset] Using specified CRI socket: unix:///var/run/containerd/containerd.sock
I0618 12:44:24.368344    3844 removeetcdmember.go:59] [reset] Checking for etcd config
I0618 12:44:24.368352    3844 local.go:94] [etcd] creating etcd client that connects to etcd pods
I0618 12:44:24.368358    3844 etcd.go:215] retrieving etcd endpoints from "kubeadm.kubernetes.io/etcd.advertise-client-urls" annotation in etcd Pods
I0618 12:44:24.368924    3844 round_trippers.go:632] "Response" verb="GET" url="https://172.17.0.2:6443/api/v1/namespaces/kube-system/pods?labelSelector=component%3Detcd%2Ctier%3Dcontrol-plane" status="200 OK" milliseconds=0
I0618 12:44:24.369023    3844 etcd.go:149] etcd endpoints read from pods: https://172.17.0.2:2379
I0618 12:44:24.372492    3844 etcd.go:274] etcd endpoints read from etcd: https://172.17.0.2:2379
I0618 12:44:24.372497    3844 etcd.go:167] update etcd endpoints: https://172.17.0.2:2379
I0618 12:44:24.375351    3844 local.go:109] [etcd] This is the only remaining etcd member in the etcd cluster, skip removing it
[reset] Deleted contents of the etcd data directory: /var/lib/etcd
I0618 12:44:24.375541    3844 cleanupnode.go:64] [reset] Getting init system
[reset] Stopping the kubelet service
[reset] Unmounting mounted directories in "/var/lib/kubelet"
I0618 12:44:24.391461    3844 unmount_linux.go:71] [reset] Unmounting "/var/lib/kubelet/pods/394c6dd7-05ce-4eac-95dc-d9106fe3a87f/volumes/kubernetes.io~projected/kube-api-access-lhktn"
I0618 12:44:24.391492    3844 unmount_linux.go:71] [reset] Unmounting "/var/lib/kubelet/pods/7697a9a8-61e3-4c05-84ec-750a8239729d/volumes/kubernetes.io~projected/kube-api-access-98zb8"
I0618 12:44:24.391518    3844 unmount_linux.go:71] [reset] Unmounting "/var/lib/kubelet/pods/57bb543f-eb7c-458c-acff-00e44262acd5/volumes/kubernetes.io~projected/kube-api-access-t7lxb"
I0618 12:44:24.391555    3844 unmount_linux.go:71] [reset] Unmounting "/var/lib/kubelet/pods/7ebf8c5a-6b49-4872-a90f-767ad33cc2e1/volumes/kubernetes.io~projected/kube-api-access-zm6w2"
I0618 12:44:24.391583    3844 cleanupnode.go:102] [reset] Removing Kubernetes-managed containers
I0618 12:44:24.393537    3844 runtime.go:142] Attempting to remove container 3761671cad711e3d41bbeed939cd8a4e9b53509a54e2f50c02f44ad59e0e2af3
I0618 12:44:24.525213    3844 runtime.go:142] Attempting to remove container a15cc57420440498731fc61b642690989df32135a304451620a569cdb87e18a0
I0618 12:44:24.681144    3844 runtime.go:142] Attempting to remove container 07363cc2dc343364ab63ec0ba01d89ec6badec6a717c985edcb1cd1f3449beda
I0618 12:44:24.841093    3844 runtime.go:142] Attempting to remove container 15a41c58aece6502c6d344e145d3a176030518a7a84b670fb56232ec2b062329
I0618 12:44:24.940035    3844 runtime.go:142] Attempting to remove container f0e68995dfda9abb0fba4636c8fb7f880fa869d82662f6abc15c2d340703aca5
I0618 12:44:25.062986    3844 runtime.go:142] Attempting to remove container d58bd2b833020504c2625413d1e36a3b47f8547527f5bec89eef68fb14d1aaa3
I0618 12:44:25.244941    3844 runtime.go:142] Attempting to remove container b47bdb6b2e9d4e10e6e51be73ea0ed63553f3a5c57de1dc389e0d1a045235af2
I0618 12:44:25.397873    3844 runtime.go:142] Attempting to remove container 3d19db4595d3c6bb5f378c25670fa460e8cf8a01c0c088421c572be7bc3f8526
[reset] Deleting contents of directories: [/etc/kubernetes/manifests /var/lib/kubelet /etc/kubernetes/pki]
[reset] Deleting files: [/etc/kubernetes/admin.conf /etc/kubernetes/super-admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/bootstrap-kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf]

The reset process does not perform cleanup of CNI plugin configuration,
network filtering rules and kubeconfig files.

For information on how to perform this cleanup manually, please see:
    https://k8s.io/docs/reference/setup-tools/kubeadm/kubeadm-reset/

time="20:44:25" level=debug msg="Running: docker exec kinder-instance-config-worker-1 kubeadm version -o=short"

kinder-instance-config-control-plane-1:$ cat /kind/version
time="20:44:25" level=debug msg="Running: docker exec kinder-instance-config-control-plane-1 cat /kind/version"
time="20:44:25" level=debug msg="Running: docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-instance-config-control-plane-1"
time="20:44:25" level=debug msg="Running: docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-instance-config-control-plane-1"

kinder-instance-config-worker-1:$ Preparing /kind/kubeadm.conf
time="20:44:25" level=debug msg="Running: docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-instance-config-worker-1"
time="20:44:25" level=debug msg="Running: docker exec kinder-instance-config-worker-1 kubeadm version -o=short"
time="20:44:25" level=debug msg="kubeadm version 1.34.0-alpha.1.44+bb2199f3923eb4"
time="20:44:25" level=debug msg="using kubeadm config version v1beta4"
time="20:44:25" level=debug msg="Preparing kubeadm config v1beta4"
time="20:44:25" level=debug msg="Running: docker exec kinder-instance-config-worker-1 /bin/sh -c which docker || true"
time="20:44:25" level=debug msg="Preparing patches directory for kubeadm config v1beta4"
time="20:44:25" level=debug msg="generating config..."
apiVersion: kubeadm.k8s.io/v1beta4
discovery:
  bootstrapToken:
    apiServerEndpoint: 172.17.0.2:6443
    token: abcdef.0123456789abcdef
    unsafeSkipCAVerification: true
kind: JoinConfiguration
nodeRegistration:
  criSocket: /run/containerd/containerd.sock
  kubeletExtraArgs:
  - name: node-ip
    value: 172.17.0.3
patches:
  directory: /kinder/patches
---
apiVersion: kubeadm.k8s.io/v1beta4
apply:
  allowExperimentalUpgrades: true
  allowRCUpgrades: true
  forceUpgrade: true
  kubernetesVersion: v1.0.0
  patches:
    directory: /kinder/patches
diff:
  kubernetesVersion: v1.0.0
kind: UpgradeConfiguration
node:
  patches:
    directory: /kinder/patches
plan:
  allowExperimentalUpgrades: true
  allowRCUpgrades: true
  kubernetesVersion: v1.0.0
---
apiVersion: kubeadm.k8s.io/v1beta4
force: true
kind: ResetConfiguration
time="20:44:25" level=debug msg="Running: docker cp /tmp/kinder-instance-config-worker-1-1328904159 kinder-instance-config-worker-1:/kind/kubeadm.conf"

kinder-instance-config-worker-1:$ kubeadm reset --v=6 --config /kind/kubeadm.conf
time="20:44:25" level=debug msg="Running: docker exec kinder-instance-config-worker-1 kubeadm reset --v=6 --config /kind/kubeadm.conf"
I0618 12:44:25.819349    2699 resetconfiguration.go:86] loading configuration from "/kind/kubeadm.conf"
W0618 12:44:25.819502    2699 resetconfiguration.go:116] [config] WARNING: Ignored configuration document with GroupVersionKind kubeadm.k8s.io/v1beta4, Kind=JoinConfiguration
W0618 12:44:25.819509    2699 resetconfiguration.go:116] [config] WARNING: Ignored configuration document with GroupVersionKind kubeadm.k8s.io/v1beta4, Kind=UpgradeConfiguration
I0618 12:44:25.819643    2699 resetconfiguration.go:50] detected and using CRI socket: unix:///var/run/containerd/containerd.sock
I0618 12:44:25.819675    2699 reset.go:140] [reset] Could not obtain a client set from the kubeconfig file: /etc/kubernetes/admin.conf
I0618 12:44:25.819679    2699 reset.go:158] [reset] Using specified CRI socket: unix:///var/run/containerd/containerd.sock
I0618 12:44:25.819694    2699 removeetcdmember.go:59] [reset] Checking for etcd config
W0618 12:44:25.819700    2699 removeetcdmember.go:105] [reset] No kubeadm config, using etcd pod spec to get data directory
[preflight] Running pre-flight checks
[reset] Deleted contents of the etcd data directory: /var/lib/etcd
[reset] Stopping the kubelet service
I0618 12:44:25.819725    2699 cleanupnode.go:64] [reset] Getting init system
[reset] Unmounting mounted directories in "/var/lib/kubelet"
I0618 12:44:25.840099    2699 unmount_linux.go:71] [reset] Unmounting "/var/lib/kubelet/pods/d8cef45c-dc6c-4d12-8744-f3ab3e28344c/volumes/kubernetes.io~projected/kube-api-access-ppxhl"
I0618 12:44:25.840127    2699 unmount_linux.go:71] [reset] Unmounting "/var/lib/kubelet/pods/e6f59aab-efbc-4687-919a-b2e36ab34edb/volumes/kubernetes.io~projected/kube-api-access-pmj9m"
I0618 12:44:25.840165    2699 cleanupnode.go:102] [reset] Removing Kubernetes-managed containers
I0618 12:44:25.842109    2699 runtime.go:142] Attempting to remove container 6210e77b9239f2e0e41fbb1b1ccb096b11e6788e2e270c46ef0bac31fcf30b1b
I0618 12:44:25.868679    2699 runtime.go:142] Attempting to remove container 0263d37402e63ae78ad8653ceaf8b4cc7fa1cfeb0512338d045ae7dd485fc6c9
I0618 12:44:25.982613    2699 runtime.go:142] Attempting to remove container 61b12fd7d7e305ead1ba0d802471a7c08239c3acff683c130b91d75b00872a7a
I0618 12:44:26.101571    2699 runtime.go:142] Attempting to remove container c35612128a9949bb2385b1373e7187cfc1209b7699dfd8aa2a61a2da0e91df71
I0618 12:44:26.126560    2699 runtime.go:142] Attempting to remove container 4cdd387f471bb864fe4f0aacb3db6811caef2cd566343a26624115e0c26352fa
I0618 12:44:26.150538    2699 runtime.go:142] Attempting to remove container 18985962928e5557e71de46916d5c04a29a2cae852323d9cd8dad567071b2500
[reset] Deleting contents of directories: [/etc/kubernetes/manifests /var/lib/kubelet /etc/kubernetes/pki]
[reset] Deleting files: [/etc/kubernetes/admin.conf /etc/kubernetes/super-admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/bootstrap-kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf]

The reset process does not perform cleanup of CNI plugin configuration,
network filtering rules and kubeconfig files.

For information on how to perform this cleanup manually, please see:
    https://k8s.io/docs/reference/setup-tools/kubeadm/kubeadm-reset/

time="20:44:26" level=debug msg="Running: docker exec kinder-instance-config-worker-2 kubeadm version -o=short"

kinder-instance-config-control-plane-1:$ cat /kind/version
time="20:44:26" level=debug msg="Running: docker exec kinder-instance-config-control-plane-1 cat /kind/version"
time="20:44:26" level=debug msg="Running: docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-instance-config-control-plane-1"
time="20:44:26" level=debug msg="Running: docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-instance-config-control-plane-1"

kinder-instance-config-worker-2:$ Preparing /kind/kubeadm.conf
time="20:44:26" level=debug msg="Running: docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}} kinder-instance-config-worker-2"
time="20:44:26" level=debug msg="Running: docker exec kinder-instance-config-worker-2 kubeadm version -o=short"
time="20:44:26" level=debug msg="kubeadm version 1.34.0-alpha.1.44+bb2199f3923eb4"
time="20:44:26" level=debug msg="using kubeadm config version v1beta4"
time="20:44:26" level=debug msg="Preparing kubeadm config v1beta4"
time="20:44:26" level=debug msg="Running: docker exec kinder-instance-config-worker-2 /bin/sh -c which docker || true"
time="20:44:26" level=debug msg="Preparing patches directory for kubeadm config v1beta4"
time="20:44:26" level=debug msg="generating config..."
apiVersion: kubeadm.k8s.io/v1beta4
discovery:
  bootstrapToken:
    apiServerEndpoint: 172.17.0.2:6443
    token: abcdef.0123456789abcdef
    unsafeSkipCAVerification: true
kind: JoinConfiguration
nodeRegistration:
  criSocket: /run/containerd/containerd.sock
  kubeletExtraArgs:
  - name: node-ip
    value: 172.17.0.4
patches:
  directory: /kinder/patches
---
apiVersion: kubeadm.k8s.io/v1beta4
apply:
  allowExperimentalUpgrades: true
  allowRCUpgrades: true
  forceUpgrade: true
  kubernetesVersion: v1.0.0
  patches:
    directory: /kinder/patches
diff:
  kubernetesVersion: v1.0.0
kind: UpgradeConfiguration
node:
  patches:
    directory: /kinder/patches
plan:
  allowExperimentalUpgrades: true
  allowRCUpgrades: true
  kubernetesVersion: v1.0.0
---
apiVersion: kubeadm.k8s.io/v1beta4
force: true
kind: ResetConfiguration
time="20:44:26" level=debug msg="Running: docker cp /tmp/kinder-instance-config-worker-2-226190319 kinder-instance-config-worker-2:/kind/kubeadm.conf"

kinder-instance-config-worker-2:$ kubeadm reset --v=6 --config /kind/kubeadm.conf
time="20:44:26" level=debug msg="Running: docker exec kinder-instance-config-worker-2 kubeadm reset --v=6 --config /kind/kubeadm.conf"
I0618 12:44:26.431758    2005 resetconfiguration.go:86] loading configuration from "/kind/kubeadm.conf"
W0618 12:44:26.431934    2005 resetconfiguration.go:116] [config] WARNING: Ignored configuration document with GroupVersionKind kubeadm.k8s.io/v1beta4, Kind=UpgradeConfiguration
W0618 12:44:26.432002    2005 resetconfiguration.go:116] [config] WARNING: Ignored configuration document with GroupVersionKind kubeadm.k8s.io/v1beta4, Kind=JoinConfiguration
I0618 12:44:26.432090    2005 resetconfiguration.go:50] detected and using CRI socket: unix:///var/run/containerd/containerd.sock
I0618 12:44:26.432127    2005 reset.go:140] [reset] Could not obtain a client set from the kubeconfig file: /etc/kubernetes/admin.conf
I0618 12:44:26.432131    2005 reset.go:158] [reset] Using specified CRI socket: unix:///var/run/containerd/containerd.sock
[preflight] Running pre-flight checks
I0618 12:44:26.432144    2005 removeetcdmember.go:59] [reset] Checking for etcd config
W0618 12:44:26.432150    2005 removeetcdmember.go:105] [reset] No kubeadm config, using etcd pod spec to get data directory
[reset] Deleted contents of the etcd data directory: /var/lib/etcd
I0618 12:44:26.432176    2005 cleanupnode.go:64] [reset] Getting init system
[reset] Stopping the kubelet service
[reset] Unmounting mounted directories in "/var/lib/kubelet"
I0618 12:44:26.443639    2005 unmount_linux.go:71] [reset] Unmounting "/var/lib/kubelet/pods/e41bed4a-6e18-4625-a040-5edc1400aea6/volumes/kubernetes.io~projected/kube-api-access-m7dwl"
I0618 12:44:26.443672    2005 unmount_linux.go:71] [reset] Unmounting "/var/lib/kubelet/pods/30f12860-8082-42df-bf53-983ca921018c/volumes/kubernetes.io~projected/kube-api-access-4949t"
I0618 12:44:26.443702    2005 cleanupnode.go:102] [reset] Removing Kubernetes-managed containers
I0618 12:44:26.445240    2005 runtime.go:142] Attempting to remove container 6d875a79b5e9b75b94ad65211a84b0a6e5aefc964fa7dc593398dd2b67c9b15c
I0618 12:44:26.560439    2005 runtime.go:142] Attempting to remove container fb05c268896eeb07d34b42037e9e9270414bc5118478efadc50e798e5806f753
[reset] Deleting contents of directories: [/etc/kubernetes/manifests /var/lib/kubelet /etc/kubernetes/pki]
[reset] Deleting files: [/etc/kubernetes/admin.conf /etc/kubernetes/super-admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/bootstrap-kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf]

The reset process does not perform cleanup of CNI plugin configuration,
network filtering rules and kubeconfig files.

For information on how to perform this cleanup manually, please see:
    https://k8s.io/docs/reference/setup-tools/kubeadm/kubeadm-reset/

 completed!

# task-21-delete
kinder delete cluster --name=kinder-instance-config --loglevel=debug

Deleting cluster "kinder-instance-config" ...
 completed!

Ran 22 of 22 tasks in 0.000 seconds
SUCCESS! -- 22 tasks Passed | 0 Failed | 0 Skipped

see junit-runner.xml and task logs files for more details

neolit123

/lgtm
/hold

please, unhold the PR if ready to merge.

k8s-ci-robot · 2025-06-18T16:01:07Z

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: HirazawaUi, neolit123

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

~~OWNERS~~ [HirazawaUi,neolit123]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

HirazawaUi · 2025-06-19T02:01:49Z

/hold cancel

HirazawaUi · 2025-06-19T14:47:15Z

The tests are green, but it seems an test error occurred right at the time of this code merge. Let's keep an eye on it.
ref: https://testgrid.k8s.io/sig-cluster-lifecycle-kubeadm#kubeadm-kinder-instance-config-latest

k8s-ci-robot added the cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. label Jun 17, 2025

k8s-ci-robot requested a review from carlory June 17, 2025 15:00

k8s-ci-robot added the area/kinder Issues to track work in the kinder tool label Jun 17, 2025

k8s-ci-robot requested a review from SataQiu June 17, 2025 15:00

k8s-ci-robot added approved Indicates a PR has been approved by an approver from all required OWNERS files. size/L Denotes a PR that changes 100-499 lines, ignoring generated files. labels Jun 17, 2025

neolit123 reviewed Jun 17, 2025

View reviewed changes

neolit123 added this to the v1.34 milestone Jun 17, 2025

add NodeLocalCRISocket beta stage tests

70e0eea

HirazawaUi force-pushed the add-beta-stage-tests branch from c1451af to 70e0eea Compare June 18, 2025 12:55

HirazawaUi mentioned this pull request Jun 18, 2025

Add kubelet instance configuration to configure CRI socket for each node #3042

Open

neolit123 reviewed Jun 18, 2025

View reviewed changes

k8s-ci-robot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jun 18, 2025

k8s-ci-robot assigned neolit123 Jun 18, 2025

k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jun 18, 2025

k8s-ci-robot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jun 19, 2025

k8s-ci-robot merged commit 144fc7a into kubernetes:main Jun 19, 2025
4 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add beta stage test for NodeLocalCRISocket feature gate #3212

Add beta stage test for NodeLocalCRISocket feature gate #3212

HirazawaUi commented Jun 17, 2025 •

edited

Loading

Uh oh!

neolit123 left a comment

Uh oh!

neolit123 Jun 17, 2025

Uh oh!

HirazawaUi Jun 18, 2025

Uh oh!

neolit123 Jun 18, 2025

Uh oh!

SataQiu Jun 20, 2025

Uh oh!

Uh oh!

Uh oh!

neolit123 commented Jun 17, 2025

Uh oh!

HirazawaUi commented Jun 18, 2025

Testing Process

Uh oh!

neolit123 left a comment

Uh oh!

k8s-ci-robot commented Jun 18, 2025

Uh oh!

HirazawaUi commented Jun 19, 2025

Uh oh!

Uh oh!

HirazawaUi commented Jun 19, 2025

Uh oh!

Uh oh!

Add beta stage test for NodeLocalCRISocket feature gate #3212

Add beta stage test for NodeLocalCRISocket feature gate #3212

Conversation

HirazawaUi commented Jun 17, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

neolit123 left a comment

Choose a reason for hiding this comment

Uh oh!

neolit123 Jun 17, 2025

Choose a reason for hiding this comment

Uh oh!

HirazawaUi Jun 18, 2025

Choose a reason for hiding this comment

Uh oh!

neolit123 Jun 18, 2025

Choose a reason for hiding this comment

Uh oh!

SataQiu Jun 20, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

neolit123 commented Jun 17, 2025

Uh oh!

HirazawaUi commented Jun 18, 2025

Testing Process

Uh oh!

neolit123 left a comment

Choose a reason for hiding this comment

Uh oh!

k8s-ci-robot commented Jun 18, 2025

Uh oh!

HirazawaUi commented Jun 19, 2025

Uh oh!

Uh oh!

HirazawaUi commented Jun 19, 2025

Uh oh!

Uh oh!

HirazawaUi commented Jun 17, 2025 •

edited

Loading