+ export WORKSPACE=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release + WORKSPACE=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release + [[ windows2016-release =~ openshift-.* ]] + [[ windows2016-release =~ .*-1.10.4-.* ]] + export KUBEVIRT_PROVIDER=k8s-1.11.0 + KUBEVIRT_PROVIDER=k8s-1.11.0 + export KUBEVIRT_NUM_NODES=2 + KUBEVIRT_NUM_NODES=2 + export NFS_WINDOWS_DIR=/home/nfs/images/windows2016 + NFS_WINDOWS_DIR=/home/nfs/images/windows2016 + export NAMESPACE=kube-system + NAMESPACE=kube-system + trap '{ make cluster-down; }' EXIT SIGINT SIGTERM SIGSTOP + make cluster-down ./cluster/down.sh + make cluster-up ./cluster/up.sh Downloading ....... Downloading ....... Downloading ....... 2018/08/04 23:12:17 Waiting for host: 192.168.66.101:22 2018/08/04 23:12:20 Problem with dial: dial tcp 192.168.66.101:22: getsockopt: no route to host. Sleeping 5s 2018/08/04 23:12:32 Connected to tcp://192.168.66.101:22 ++ systemctl status docker ++ grep active ++ wc -l + [[ 1 -eq 0 ]] + kubeadm init --config /etc/kubernetes/kubeadm.conf [init] using Kubernetes version: v1.11.0 [preflight] running pre-flight checks I0804 23:12:32.759671 1254 feature_gate.go:230] feature gates: &{map[]} I0804 23:12:32.845418 1254 kernel_validator.go:81] Validating kernel version I0804 23:12:32.845671 1254 kernel_validator.go:96] Validating kernel config [preflight/images] Pulling images required for setting up a Kubernetes cluster [preflight/images] This might take a minute or two, depending on the speed of your internet connection [preflight/images] You can also perform this action in beforehand using 'kubeadm config images pull' [kubelet] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env" [kubelet] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml" [preflight] Activating the kubelet service [certificates] Generated ca certificate and key. [certificates] Generated apiserver certificate and key. [certificates] apiserver serving cert is signed for DNS names [node01 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 192.168.66.101] [certificates] Generated apiserver-kubelet-client certificate and key. [certificates] Generated sa key and public key. [certificates] Generated front-proxy-ca certificate and key. [certificates] Generated front-proxy-client certificate and key. [certificates] Generated etcd/ca certificate and key. [certificates] Generated etcd/server certificate and key. [certificates] etcd/server serving cert is signed for DNS names [node01 localhost] and IPs [127.0.0.1 ::1] [certificates] Generated etcd/peer certificate and key. [certificates] etcd/peer serving cert is signed for DNS names [node01 localhost] and IPs [192.168.66.101 127.0.0.1 ::1] [certificates] Generated etcd/healthcheck-client certificate and key. [certificates] Generated apiserver-etcd-client certificate and key. [certificates] valid certificates and keys now exist in "/etc/kubernetes/pki" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/admin.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/kubelet.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/controller-manager.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/scheduler.conf" [controlplane] wrote Static Pod manifest for component kube-apiserver to "/etc/kubernetes/manifests/kube-apiserver.yaml" [controlplane] wrote Static Pod manifest for component kube-controller-manager to "/etc/kubernetes/manifests/kube-controller-manager.yaml" [controlplane] wrote Static Pod manifest for component kube-scheduler to "/etc/kubernetes/manifests/kube-scheduler.yaml" [etcd] Wrote Static Pod manifest for a local etcd instance to "/etc/kubernetes/manifests/etcd.yaml" [init] waiting for the kubelet to boot up the control plane as Static Pods from directory "/etc/kubernetes/manifests" [init] this might take a minute or longer if the control plane images have to be pulled [apiclient] All control plane components are healthy after 58.506208 seconds [uploadconfig] storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace [kubelet] Creating a ConfigMap "kubelet-config-1.11" in namespace kube-system with the configuration for the kubelets in the cluster [markmaster] Marking the node node01 as master by adding the label "node-role.kubernetes.io/master=''" [markmaster] Marking the node node01 as master by adding the taints [node-role.kubernetes.io/master:NoSchedule] [patchnode] Uploading the CRI Socket information "/var/run/dockershim.sock" to the Node API object "node01" as an annotation [bootstraptoken] using token: abcdef.1234567890123456 [bootstraptoken] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials [bootstraptoken] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token [bootstraptoken] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster [bootstraptoken] creating the "cluster-info" ConfigMap in the "kube-public" namespace [addons] Applied essential addon: CoreDNS [addons] Applied essential addon: kube-proxy Your Kubernetes master has initialized successfully! To start using your cluster, you need to run the following as a regular user: mkdir -p $HOME/.kube sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config sudo chown $(id -u):$(id -g) $HOME/.kube/config You should now deploy a pod network to the cluster. Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at: https://kubernetes.io/docs/concepts/cluster-administration/addons/ You can now join any number of machines by running the following on each node as root: kubeadm join 192.168.66.101:6443 --token abcdef.1234567890123456 --discovery-token-ca-cert-hash sha256:dcc052f9fddc2ed7665cf7428925407d35f285f4317ed4d1fe0514553a2ded80 + kubectl --kubeconfig=/etc/kubernetes/admin.conf apply -f https://raw.githubusercontent.com/coreos/flannel/v0.9.1/Documentation/kube-flannel.yml clusterrole.rbac.authorization.k8s.io/flannel created clusterrolebinding.rbac.authorization.k8s.io/flannel created serviceaccount/flannel created configmap/kube-flannel-cfg created daemonset.extensions/kube-flannel-ds created + kubectl --kubeconfig=/etc/kubernetes/admin.conf taint nodes node01 node-role.kubernetes.io/master:NoSchedule- node/node01 untainted + kubectl --kubeconfig=/etc/kubernetes/admin.conf create -f /tmp/local-volume.yaml storageclass.storage.k8s.io/local created configmap/local-storage-config created clusterrolebinding.rbac.authorization.k8s.io/local-storage-provisioner-pv-binding created clusterrole.rbac.authorization.k8s.io/local-storage-provisioner-node-clusterrole created clusterrolebinding.rbac.authorization.k8s.io/local-storage-provisioner-node-binding created role.rbac.authorization.k8s.io/local-storage-provisioner-jobs-role created rolebinding.rbac.authorization.k8s.io/local-storage-provisioner-jobs-rolebinding created serviceaccount/local-storage-admin created daemonset.extensions/local-volume-provisioner created 2018/08/04 23:13:51 Waiting for host: 192.168.66.102:22 2018/08/04 23:13:54 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: no route to host. Sleeping 5s 2018/08/04 23:14:02 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: no route to host. Sleeping 5s 2018/08/04 23:14:07 Connected to tcp://192.168.66.102:22 ++ grep active ++ systemctl status docker ++ wc -l + [[ 0 -eq 0 ]] + sleep 2 ++ systemctl status docker ++ grep active ++ wc -l + [[ 1 -eq 0 ]] + kubeadm join --token abcdef.1234567890123456 192.168.66.101:6443 --ignore-preflight-errors=all --discovery-token-unsafe-skip-ca-verification=true [preflight] running pre-flight checks [WARNING RequiredIPVSKernelModulesAvailable]: the IPVS proxier will not be used, because the following required kernel modules are not loaded: [ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh] or no builtin kernel ipvs support: map[ip_vs:{} ip_vs_rr:{} ip_vs_wrr:{} ip_vs_sh:{} nf_conntrack_ipv4:{}] you can solve this problem with following methods: 1. Run 'modprobe -- ' to load missing kernel modules; 2. Provide the missing builtin kernel ipvs support I0804 23:14:10.967380 1262 kernel_validator.go:81] Validating kernel version I0804 23:14:10.967783 1262 kernel_validator.go:96] Validating kernel config [discovery] Trying to connect to API Server "192.168.66.101:6443" [discovery] Created cluster-info discovery client, requesting info from "https://192.168.66.101:6443" [discovery] Cluster info signature and contents are valid and no TLS pinning was specified, will use API Server "192.168.66.101:6443" [discovery] Successfully established connection with API Server "192.168.66.101:6443" [kubelet] Downloading configuration for the kubelet from the "kubelet-config-1.11" ConfigMap in the kube-system namespace [kubelet] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml" [kubelet] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env" [preflight] Activating the kubelet service [tlsbootstrap] Waiting for the kubelet to perform the TLS Bootstrap... [patchnode] Uploading the CRI Socket information "/var/run/dockershim.sock" to the Node API object "node02" as an annotation This node has joined the cluster: * Certificate signing request was sent to master and a response was received. * The Kubelet was informed of the new secure connection details. Run 'kubectl get nodes' on the master to see this node join the cluster. Sending file modes: C0755 38739968 kubectl Sending file modes: C0600 5450 admin.conf Cluster "kubernetes" set. Cluster "kubernetes" set. + set +e + kubectl get nodes --no-headers + cluster/kubectl.sh get nodes --no-headers node01 Ready master 52s v1.11.0 node02 Ready 20s v1.11.0 + kubectl_rc=0 + '[' 0 -ne 0 ']' ++ kubectl get nodes --no-headers ++ cluster/kubectl.sh get nodes --no-headers ++ grep NotReady + '[' -n '' ']' + set -e + echo 'Nodes are ready:' Nodes are ready: + kubectl get nodes + cluster/kubectl.sh get nodes NAME STATUS ROLES AGE VERSION node01 Ready master 53s v1.11.0 node02 Ready 21s v1.11.0 + make cluster-sync ./cluster/build.sh Building ... Untagged: localhost:33321/kubevirt/virt-controller:devel Untagged: localhost:33321/kubevirt/virt-controller@sha256:0399e9aa9e814b64b42cbdb040a11267bed366873a579dd22f64775d90741843 Deleted: sha256:98ad9ec8b9a50c1c0677fdb003a0f872c69d749203158418b17e9b56921afb2c Deleted: sha256:bb4c33e45839c5d5a2fcf89aa12abddece126ad92e5498bbc87f2d7f1f984fb1 Deleted: sha256:9dccb19e434f4dbecfe9c09882fa5513205bdcaf2ace5ce9b5589e9bcbb40803 Deleted: sha256:b780ec1dfb6b2f0d3806372695f8f1e94d0ed84913951aa0693b4010b1a7221a Untagged: localhost:33321/kubevirt/virt-launcher:devel Untagged: localhost:33321/kubevirt/virt-launcher@sha256:d72725605134838e0e473b3bf45a914e8c41de604a676f7219e79ec69266efc0 Deleted: sha256:ff3cade3ae3560e076cfe2dace89918e926454d3f0ca566bffecd2a438822fdc Deleted: sha256:00210e63b4f51e669000b88def0fd27166e30e3ae18734c8f458c8b6a8fb1d9a Deleted: sha256:2b84d32d8c2e0059db098d4dc5dd801d77f5b1e95df0d2fb452da2b57581b20e Deleted: sha256:73464f4b5aeeff8dd2c2593695ab1f7f651d2849ae4af23c81a688ab020e83da Deleted: sha256:9e3d7eaaf99723d821bf0451a403b878ac59e8767e514707b3fb784882bef3ab Deleted: sha256:7fe03335c267af0cb68cd62694a869f8a42cf8c1db934affc785cdb25e1254f8 Deleted: sha256:ccb456d36f413a56c23a2ca0daa1f9d2db31b127643a147c482e8c34c3d63d6e Deleted: sha256:fc490d96d2e70a2509d4b77cd24bc2d4c346b1c29880f4f119c4b95d17aab90c Deleted: sha256:1ec157924a1394abc1ed09560b5512cc84131452621327965862d84583e54d6e Deleted: sha256:a7ba22b78b779f9586233fc762306380aa0c7556ffa39854bd6bc2c61dc862c0 Deleted: sha256:948e85bca090eb693f79ee03bfe368796767a0db34e73a222a37af78ad9e7c6c Deleted: sha256:7a249c722dde9a9a1c6e860e64a92b1c9c92fb3a78d45066d1378e014741709c Untagged: localhost:33321/kubevirt/virt-handler:devel Untagged: localhost:33321/kubevirt/virt-handler@sha256:cd3c48f3205663a1a5839203c4aace56062ba38c58517115e52c8edef00d1b27 Deleted: sha256:1f2e68663cd1c8facc46dcfb20507aa0edf3e922cec2356aecca09c0642efc1b Deleted: sha256:5fe29344fa8c2681a118e491e2acb5f042fabdb9f78f5bc705f414ab702e228e Deleted: sha256:a0db4bc0197bee01f1b904cf05eb56d9cdade1b785f2c677e49f3644a5755d97 Deleted: sha256:1b0dbf58b618079f484df1a0cea35e321cf45a98326aa6939393069964d277fa Untagged: localhost:33321/kubevirt/virt-api:devel Untagged: localhost:33321/kubevirt/virt-api@sha256:d574b9694a0b9cc6f8dff928d9fc2aa55295baa8ea974a52585d8ac12f6a2600 Deleted: sha256:bd609812ced625987e4f6a6d5defedc3b42e547499a53183d72dea13b7071282 Deleted: sha256:d1f52fdcd60ab6033c3919ed9edf0534231dac981d6bae4a28fe3a200b423a95 Deleted: sha256:f544bff35ed66f426198ae50adc06ea8627ce44c780973161cdb53b348dbb3ac Deleted: sha256:a8bb858c6d5f81cbb0a5c899434debe7765a85bcc05e6291cfe897d2f6aa4a8b Untagged: localhost:33321/kubevirt/subresource-access-test:devel Untagged: localhost:33321/kubevirt/subresource-access-test@sha256:cabec12b3259add8aaf99034e44dd2f12e6dfe1e88a3726d37e22ad59ff9a296 Deleted: sha256:ab0e7edfe824848752f48ae54207b6e3906c5224506ce1d9e3ecd6031ab86b47 Deleted: sha256:608fb1bbe28974e1d0b947d13240e418b25232a9d45ba0932b6aa2344651cb12 Deleted: sha256:3e770bda34d7442a1c4053b373ad489737e5a7fe837cb9e2322350512e02dfd6 Deleted: sha256:1ce34fda92503325d886911a2d8d9a456c2d1219a662825b321c1efb691ee97f Untagged: localhost:33321/kubevirt/example-hook-sidecar:devel Untagged: localhost:33321/kubevirt/example-hook-sidecar@sha256:d458e9d7748e08c40b1044fe472ccfbcf64d56c66f41145f99794dc1a302ada4 Deleted: sha256:08230555743fcf8aed8b74a65b80eb094aaaf23a25c2c7a04072c3eb1394d2d6 Deleted: sha256:b820d82eb275310a6853878aa0a2eab1a572c7f38fdadea3a3eb521fd1b2eba2 Deleted: sha256:5e18f2a90a185ac28bff344a72591492db58db430d53f5f94ca01720d3694ea5 Deleted: sha256:e35200af68bb636c6e21cad4cc026aa82ec868c20d2bfaf592061d1e9f19d288 sha256:b69a3f94b2043cd36cc41eb5d9446480e0a640962e468ab72c3cc51f2b89386a go version go1.10 linux/amd64 go version go1.10 linux/amd64 make[1]: Entering directory `/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt' hack/dockerized "./hack/check.sh && KUBEVIRT_VERSION= ./hack/build-go.sh install " && ./hack/build-copy-artifacts.sh sha256:b69a3f94b2043cd36cc41eb5d9446480e0a640962e468ab72c3cc51f2b89386a go version go1.10 linux/amd64 go version go1.10 linux/amd64 find: '/root/go/src/kubevirt.io/kubevirt/_out/cmd': No such file or directory Compiling tests...