+ export WORKSPACE=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release + WORKSPACE=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release + [[ windows2016-release =~ openshift-.* ]] + [[ windows2016-release =~ .*-1.10.4-.* ]] + export KUBEVIRT_PROVIDER=k8s-1.11.0 + KUBEVIRT_PROVIDER=k8s-1.11.0 + export KUBEVIRT_NUM_NODES=2 + KUBEVIRT_NUM_NODES=2 + export NFS_WINDOWS_DIR=/home/nfs/images/windows2016 + NFS_WINDOWS_DIR=/home/nfs/images/windows2016 + export NAMESPACE=kube-system + NAMESPACE=kube-system + trap '{ make cluster-down; }' EXIT SIGINT SIGTERM SIGSTOP + make cluster-down ./cluster/down.sh + make cluster-up ./cluster/up.sh Downloading ....... Downloading ....... Downloading ....... 2018/08/12 15:16:53 Waiting for host: 192.168.66.101:22 2018/08/12 15:16:56 Problem with dial: dial tcp 192.168.66.101:22: getsockopt: no route to host. Sleeping 5s 2018/08/12 15:17:04 Problem with dial: dial tcp 192.168.66.101:22: getsockopt: no route to host. Sleeping 5s 2018/08/12 15:17:09 Connected to tcp://192.168.66.101:22 ++ systemctl status docker ++ grep active ++ wc -l + [[ 0 -eq 0 ]] + sleep 2 ++ systemctl status docker ++ grep active ++ wc -l + [[ 1 -eq 0 ]] + kubeadm init --config /etc/kubernetes/kubeadm.conf [init] using Kubernetes version: v1.11.0 [preflight] running pre-flight checks I0812 15:17:11.743057 1301 feature_gate.go:230] feature gates: &{map[]} I0812 15:17:11.858840 1301 kernel_validator.go:81] Validating kernel version I0812 15:17:11.859563 1301 kernel_validator.go:96] Validating kernel config [preflight/images] Pulling images required for setting up a Kubernetes cluster [preflight/images] This might take a minute or two, depending on the speed of your internet connection [preflight/images] You can also perform this action in beforehand using 'kubeadm config images pull' [kubelet] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env" [kubelet] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml" [preflight] Activating the kubelet service [certificates] Generated ca certificate and key. [certificates] Generated apiserver certificate and key. [certificates] apiserver serving cert is signed for DNS names [node01 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 192.168.66.101] [certificates] Generated apiserver-kubelet-client certificate and key. [certificates] Generated sa key and public key. [certificates] Generated front-proxy-ca certificate and key. [certificates] Generated front-proxy-client certificate and key. [certificates] Generated etcd/ca certificate and key. [certificates] Generated etcd/server certificate and key. [certificates] etcd/server serving cert is signed for DNS names [node01 localhost] and IPs [127.0.0.1 ::1] [certificates] Generated etcd/peer certificate and key. [certificates] etcd/peer serving cert is signed for DNS names [node01 localhost] and IPs [192.168.66.101 127.0.0.1 ::1] [certificates] Generated etcd/healthcheck-client certificate and key. [certificates] Generated apiserver-etcd-client certificate and key. [certificates] valid certificates and keys now exist in "/etc/kubernetes/pki" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/admin.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/kubelet.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/controller-manager.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/scheduler.conf" [controlplane] wrote Static Pod manifest for component kube-apiserver to "/etc/kubernetes/manifests/kube-apiserver.yaml" [controlplane] wrote Static Pod manifest for component kube-controller-manager to "/etc/kubernetes/manifests/kube-controller-manager.yaml" [controlplane] wrote Static Pod manifest for component kube-scheduler to "/etc/kubernetes/manifests/kube-scheduler.yaml" [etcd] Wrote Static Pod manifest for a local etcd instance to "/etc/kubernetes/manifests/etcd.yaml" [init] waiting for the kubelet to boot up the control plane as Static Pods from directory "/etc/kubernetes/manifests" [init] this might take a minute or longer if the control plane images have to be pulled [apiclient] All control plane components are healthy after 36.011905 seconds [uploadconfig] storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace [kubelet] Creating a ConfigMap "kubelet-config-1.11" in namespace kube-system with the configuration for the kubelets in the cluster [markmaster] Marking the node node01 as master by adding the label "node-role.kubernetes.io/master=''" [markmaster] Marking the node node01 as master by adding the taints [node-role.kubernetes.io/master:NoSchedule] [patchnode] Uploading the CRI Socket information "/var/run/dockershim.sock" to the Node API object "node01" as an annotation [bootstraptoken] using token: abcdef.1234567890123456 [bootstraptoken] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials [bootstraptoken] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token [bootstraptoken] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster [bootstraptoken] creating the "cluster-info" ConfigMap in the "kube-public" namespace [addons] Applied essential addon: CoreDNS [addons] Applied essential addon: kube-proxy Your Kubernetes master has initialized successfully! To start using your cluster, you need to run the following as a regular user: mkdir -p $HOME/.kube sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config sudo chown $(id -u):$(id -g) $HOME/.kube/config You should now deploy a pod network to the cluster. Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at: https://kubernetes.io/docs/concepts/cluster-administration/addons/ You can now join any number of machines by running the following on each node as root: kubeadm join 192.168.66.101:6443 --token abcdef.1234567890123456 --discovery-token-ca-cert-hash sha256:d65c10e9585c22891e0dda249b47384ec9dcc4e8e2fb170d95fe0e4effe11cfe + kubectl --kubeconfig=/etc/kubernetes/admin.conf apply -f https://raw.githubusercontent.com/coreos/flannel/v0.9.1/Documentation/kube-flannel.yml clusterrole.rbac.authorization.k8s.io/flannel created clusterrolebinding.rbac.authorization.k8s.io/flannel created serviceaccount/flannel created configmap/kube-flannel-cfg created daemonset.extensions/kube-flannel-ds created + kubectl --kubeconfig=/etc/kubernetes/admin.conf taint nodes node01 node-role.kubernetes.io/master:NoSchedule- node/node01 untainted + kubectl --kubeconfig=/etc/kubernetes/admin.conf create -f /tmp/local-volume.yaml storageclass.storage.k8s.io/local created configmap/local-storage-config created clusterrolebinding.rbac.authorization.k8s.io/local-storage-provisioner-pv-binding created clusterrole.rbac.authorization.k8s.io/local-storage-provisioner-node-clusterrole created clusterrolebinding.rbac.authorization.k8s.io/local-storage-provisioner-node-binding created role.rbac.authorization.k8s.io/local-storage-provisioner-jobs-role created rolebinding.rbac.authorization.k8s.io/local-storage-provisioner-jobs-rolebinding created serviceaccount/local-storage-admin created daemonset.extensions/local-volume-provisioner created 2018/08/12 15:18:13 Waiting for host: 192.168.66.102:22 2018/08/12 15:18:16 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: no route to host. Sleeping 5s 2018/08/12 15:18:24 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: no route to host. Sleeping 5s 2018/08/12 15:18:30 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: connection refused. Sleeping 5s 2018/08/12 15:18:35 Connected to tcp://192.168.66.102:22 ++ systemctl status docker ++ grep active ++ wc -l + [[ 1 -eq 0 ]] + kubeadm join --token abcdef.1234567890123456 192.168.66.101:6443 --ignore-preflight-errors=all --discovery-token-unsafe-skip-ca-verification=true [preflight] running pre-flight checks [WARNING RequiredIPVSKernelModulesAvailable]: the IPVS proxier will not be used, because the following required kernel modules are not loaded: [ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh] or no builtin kernel ipvs support: map[ip_vs_wrr:{} ip_vs_sh:{} nf_conntrack_ipv4:{} ip_vs:{} ip_vs_rr:{}] you can solve this problem with following methods: 1. Run 'modprobe -- ' to load missing kernel modules; 2. Provide the missing builtin kernel ipvs support I0812 15:18:37.118769 1301 kernel_validator.go:81] Validating kernel version I0812 15:18:37.119833 1301 kernel_validator.go:96] Validating kernel config [discovery] Trying to connect to API Server "192.168.66.101:6443" [discovery] Created cluster-info discovery client, requesting info from "https://192.168.66.101:6443" [discovery] Cluster info signature and contents are valid and no TLS pinning was specified, will use API Server "192.168.66.101:6443" [discovery] Successfully established connection with API Server "192.168.66.101:6443" [kubelet] Downloading configuration for the kubelet from the "kubelet-config-1.11" ConfigMap in the kube-system namespace [kubelet] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml" [kubelet] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env" [preflight] Activating the kubelet service [tlsbootstrap] Waiting for the kubelet to perform the TLS Bootstrap... [patchnode] Uploading the CRI Socket information "/var/run/dockershim.sock" to the Node API object "node02" as an annotation This node has joined the cluster: * Certificate signing request was sent to master and a response was received. * The Kubelet was informed of the new secure connection details. Run 'kubectl get nodes' on the master to see this node join the cluster. Sending file modes: C0755 38739968 kubectl Sending file modes: C0600 5450 admin.conf Cluster "kubernetes" set. Cluster "kubernetes" set. + set +e + kubectl get nodes --no-headers + cluster/kubectl.sh get nodes --no-headers node01 Ready master 56s v1.11.0 node02 Ready 21s v1.11.0 + kubectl_rc=0 + '[' 0 -ne 0 ']' ++ kubectl get nodes --no-headers ++ cluster/kubectl.sh get nodes --no-headers ++ grep NotReady + '[' -n '' ']' + set -e + echo 'Nodes are ready:' Nodes are ready: + kubectl get nodes + cluster/kubectl.sh get nodes NAME STATUS ROLES AGE VERSION node01 Ready master 57s v1.11.0 node02 Ready 22s v1.11.0 + make cluster-sync ./cluster/build.sh Building ... Untagged: localhost:33735/kubevirt/virt-controller:devel Untagged: localhost:33735/kubevirt/virt-controller@sha256:c8882022de358815077918632c09fdae793a2e863491f35435b4b61bb2a94a24 Untagged: localhost:33759/kubevirt/virt-controller:devel Untagged: localhost:33759/kubevirt/virt-controller@sha256:d83d5762aee5547f95c20695416c2bbdda52ddf7855c36136df0e8172bc11eda Deleted: sha256:65abd58f8141549569979dad4bf48d1c3bf63b91295ebd63e5a3278b9023d5c1 Deleted: sha256:9cf705ea5d9f22075d85e56aa119201a285f13688025aa9a71f5e8b745cbe29b Deleted: sha256:7fa97f496134ab173f8c1911bd160b04528576f4251a3fe4370ba00c75f0a794 Deleted: sha256:4569636fb402c0ee18a6a74eae78052c0db243c98f28cf1411cfb90d01ad3ed1 Untagged: localhost:33735/kubevirt/virt-launcher:devel Untagged: localhost:33735/kubevirt/virt-launcher@sha256:51e0de6abf792735015585b977240bbf0d7da4a8d5df2a7b004fccc48e0ac3ed Untagged: localhost:33700/kubevirt/virt-launcher:devel Untagged: localhost:33700/kubevirt/virt-launcher@sha256:3122cc0ccec7730d49376c0e8f80d6b06cc37d4726602c52b0adaaea9eda526b Deleted: sha256:944295d5075d8a9c3a4db4b49506cf17fb3594d214b1462709857ca8420628ae Deleted: sha256:0222f5401051436fabe7f21790b698f78a22a755e11d60d7a563e4ff59479497 Deleted: sha256:3f971571f5a23c7aa726712b00e0a1c9613adbf7c50494e7c32dacf01c7f066d Deleted: sha256:9531452c3a751426177f17bf0a143a4687df59d3f864d8f66ed54384d2622137 Deleted: sha256:7c1006d4588477d87a304379c0b03845f908f31c99301dc5dc12d090998967b7 Deleted: sha256:c454e3e2dffab7a449ca665974a49eb2e47c2142337d734e5c5acf4c12fd6dcb Deleted: sha256:bf2bd3654fc9821be1ed8f0dc12e4aaae56e10fc9bb91a8a6f09974989dcfca6 Deleted: sha256:88cd9848163802d43144e0ecaf40c76497c0dc965daf1b8d5829729dab80d1f0 Deleted: sha256:5c0bf5931080ce5c528318d72baacfd899c70997f268fd4b451d6c42d45e9424 Deleted: sha256:eb19169fb5d013db03712259a7d3e5c9d6e67c371e3e482823be20d7dacd78ed Deleted: sha256:bf5de992c901582ad75263d011b6c44d0250df70eb62cb85387ce265e18231c0 Deleted: sha256:9f3f5cd4ec918c8c803c945f791ba33357efcc3364750b8859e1200b27c0d49d Untagged: localhost:33735/kubevirt/virt-handler:devel Untagged: localhost:33735/kubevirt/virt-handler@sha256:405368ef4639f15a4df4bf1bf6dd7d5638683030510f7e9bfb22fbd6fe469278 Untagged: localhost:33759/kubevirt/virt-handler:devel Untagged: localhost:33759/kubevirt/virt-handler@sha256:907f264f7f3a1ce0c40021a5737986ec5d0fb78be47338a1f0f5902cc0b0944c Deleted: sha256:8da3dcd49fd76049f0ebc0e147fca6c1b32fdc28d8b954f767e2eded05fcdc95 Deleted: sha256:7569771f3b4bfac7d2920adaef3dd1a5aef8ab8e893b82fcb801b25313363f27 Deleted: sha256:ea0b6976014ac5779c5f0bc81779d1cb9b277ac57f85e51bb304d7ef28d3199d Deleted: sha256:71faa8a6e3c9cb4b7dab5276f01652daceb8d90962c447536a61e437e9128a67 Untagged: localhost:33735/kubevirt/virt-api:devel Untagged: localhost:33735/kubevirt/virt-api@sha256:f36910684d45e04494c319a17f437ae5f2aeb7ce29d21c2bb638030cd818f6d5 Untagged: localhost:33759/kubevirt/virt-api:devel Untagged: localhost:33759/kubevirt/virt-api@sha256:f1b3e1d5a67fc982fbc0751673eb7e82e6386ce7808837b7a3194e52ebbe5010 Deleted: sha256:d50f5bc625072da0d40c933f1323d96524a22a6c9b44275013b725b91e85aa34 Deleted: sha256:75aa873171c92558b1cab7d4a019efda78975123494cd61e59458ac195a1e1aa Deleted: sha256:368357245a45eab097cbbc84a9f8ac3cabdbdff556de2e94bbb105747a74f063 Deleted: sha256:2c64d7082d7f828339d88b49da3e31f18b8dd819af4861b2bfa7342fab78d39b Untagged: localhost:33791/kubevirt/subresource-access-test:devel Untagged: localhost:33791/kubevirt/subresource-access-test@sha256:680e38a3177cc7b2af9dfb0c63eb68b27e29daed08c41c5bbe64d5977a60609d Untagged: localhost:33759/kubevirt/subresource-access-test:devel Untagged: localhost:33759/kubevirt/subresource-access-test@sha256:756515132884448288eea0755bdad36becf710010bb072826037a9034bbc6bcd Deleted: sha256:4156bf5a7f6f2fd8744d9de3e3ec62292fc3073efc989f11aeb28fe1d344f637 Deleted: sha256:c6f66541e7e364b49d50f749a229039d326a1a78e205458bfd3bdc36968e90cd Deleted: sha256:43c5b4836ca8f07ff7eb7c6f6cafdd512648086becbdc2be0272c16b4c140396 Deleted: sha256:3ac02a3970df3c50ad0686b8eeb10da29f139258a1709204003293a3cbc3f358 sha256:0bec083f1c9e66baa107940ad909778a562a54db14b6a64ab117f1897e0697dd go version go1.10 linux/amd64 go version go1.10 linux/amd64 make[1]: Entering directory `/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt' hack/dockerized "./hack/check.sh && KUBEVIRT_VERSION= ./hack/build-go.sh install " && ./hack/build-copy-artifacts.sh sha256:0bec083f1c9e66baa107940ad909778a562a54db14b6a64ab117f1897e0697dd go version go1.10 linux/amd64 go version go1.10 linux/amd64 find: '/root/go/src/kubevirt.io/kubevirt/_out/cmd': No such file or directory Compiling tests... compiled tests.test hack/build-docker.sh build Sending build context to Docker daemon 36.22 MB Step 1/8 : FROM fedora:27 ---> 9110ae7f579f Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> cc296a71da13 Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virt-controller ---> Using cache ---> 2822515a72a1 Step 4/8 : WORKDIR /home/virt-controller ---> Using cache ---> 0e522f373cd1 Step 5/8 : USER 1001 ---> Using cache ---> c94440fde013 Step 6/8 : COPY virt-controller /usr/bin/virt-controller ---> b6033862ee16 Removing intermediate container e9577f9084b6 Step 7/8 : ENTRYPOINT /usr/bin/virt-controller ---> Running in 585b5f5d7993 ---> 4cfb1fa4485a Removing intermediate container 585b5f5d7993 Step 8/8 : LABEL "kubevirt-functional-tests-windows2016-release0" '' "virt-controller" '' ---> Running in fe8d754f052e ---> 0d87bfd36d56 Removing intermediate container fe8d754f052e Successfully built 0d87bfd36d56 Sending build context to Docker daemon 38.18 MB Step 1/9 : FROM kubevirt/libvirt:3.7.0 ---> c4e262d2dc3c Step 2/9 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> a3eeea6a19f7 Step 3/9 : RUN dnf -y install socat genisoimage util-linux libcgroup-tools ethtool sudo && dnf -y clean all && test $(id -u qemu) = 107 # make sure that the qemu user really is 107 ---> Using cache ---> 4e81f3f1ccb3 Step 4/9 : COPY virt-launcher /usr/bin/virt-launcher ---> fe4c0c6b11ed Removing intermediate container bc9d00b62974 Step 5/9 : COPY kubevirt-sudo /etc/sudoers.d/kubevirt ---> c6b1aa199c56 Removing intermediate container d775d2f71357 Step 6/9 : RUN mkdir -p /usr/share/kubevirt/virt-launcher ---> Running in af5ad72dbee7  ---> f0c0f6b0ad5e Removing intermediate container af5ad72dbee7 Step 7/9 : COPY entrypoint.sh libvirtd.sh sh.sh sock-connector /usr/share/kubevirt/virt-launcher/ ---> 455b78d75f27 Removing intermediate container ab7cfdae3fac Step 8/9 : ENTRYPOINT /usr/share/kubevirt/virt-launcher/entrypoint.sh ---> Running in f5fbf08c8a07 ---> 9fa96573e6e7 Removing intermediate container f5fbf08c8a07 Step 9/9 : LABEL "kubevirt-functional-tests-windows2016-release0" '' "virt-launcher" '' ---> Running in db7fb0d60459 ---> 918cf8de5c56 Removing intermediate container db7fb0d60459 Successfully built 918cf8de5c56 Sending build context to Docker daemon 38.28 MB Step 1/5 : FROM fedora:27 ---> 9110ae7f579f Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> cc296a71da13 Step 3/5 : COPY virt-handler /usr/bin/virt-handler ---> a400b5fcf896 Removing intermediate container 0ad73014a384 Step 4/5 : ENTRYPOINT /usr/bin/virt-handler ---> Running in adef599013a3 ---> 281977db2bf3 Removing intermediate container adef599013a3 Step 5/5 : LABEL "kubevirt-functional-tests-windows2016-release0" '' "virt-handler" '' ---> Running in 617e11df3f50 ---> b328731781aa Removing intermediate container 617e11df3f50 Successfully built b328731781aa Sending build context to Docker daemon 36.98 MB Step 1/8 : FROM fedora:27 ---> 9110ae7f579f Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> cc296a71da13 Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virt-api ---> Using cache ---> de2e6a870490 Step 4/8 : WORKDIR /home/virt-api ---> Using cache ---> a8e6f7bd6c45 Step 5/8 : USER 1001 ---> Using cache ---> 38bfe789bc15 Step 6/8 : COPY virt-api /usr/bin/virt-api ---> d93d59f4b803 Removing intermediate container 23ca35e085ab Step 7/8 : ENTRYPOINT /usr/bin/virt-api ---> Running in dc98ee6ed99c ---> dd8585b54790 Removing intermediate container dc98ee6ed99c Step 8/8 : LABEL "kubevirt-functional-tests-windows2016-release0" '' "virt-api" '' ---> Running in bd2afcdde2fb ---> 9891d177f657 Removing intermediate container bd2afcdde2fb Successfully built 9891d177f657 Sending build context to Docker daemon 4.096 kB Step 1/7 : FROM fedora:27 ---> 9110ae7f579f Step 2/7 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> cc296a71da13 Step 3/7 : ENV container docker ---> Using cache ---> 95752cc0f6e3 Step 4/7 : RUN mkdir -p /images/custom /images/alpine && truncate -s 64M /images/custom/disk.img && curl http://dl-cdn.alpinelinux.org/alpine/v3.7/releases/x86_64/alpine-virt-3.7.0-x86_64.iso > /images/alpine/disk.img ---> Using cache ---> 874ab482e353 Step 5/7 : ADD entrypoint.sh / ---> Using cache ---> 1547eaa29e05 Step 6/7 : CMD /entrypoint.sh ---> Using cache ---> 57014bb60130 Step 7/7 : LABEL "disks-images-provider" '' "kubevirt-functional-tests-windows2016-release0" '' ---> Using cache ---> cfde11e8271f Successfully built cfde11e8271f Sending build context to Docker daemon 2.56 kB Step 1/5 : FROM fedora:27 ---> 9110ae7f579f Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> cc296a71da13 Step 3/5 : ENV container docker ---> Using cache ---> 95752cc0f6e3 Step 4/5 : RUN dnf -y install procps-ng nmap-ncat && dnf -y clean all ---> Using cache ---> 58c89175cab8 Step 5/5 : LABEL "kubevirt-functional-tests-windows2016-release0" '' "vm-killer" '' ---> Using cache ---> 3c7ef25ba95c Successfully built 3c7ef25ba95c Sending build context to Docker daemon 5.12 kB Step 1/7 : FROM debian:sid ---> 68f33cf86aab Step 2/7 : MAINTAINER "David Vossel" \ ---> Using cache ---> 9ef1c0ce5d24 Step 3/7 : ENV container docker ---> Using cache ---> 9ad55e41ed61 Step 4/7 : RUN apt-get update && apt-get install -y bash curl bzip2 qemu-utils && mkdir -p /disk && rm -rf /var/lib/apt/lists/* ---> Using cache ---> 17a81fda7c2b Step 5/7 : ADD entry-point.sh / ---> Using cache ---> 681d01e165e6 Step 6/7 : CMD /entry-point.sh ---> Using cache ---> a79815fe82d9 Step 7/7 : LABEL "kubevirt-functional-tests-windows2016-release0" '' "registry-disk-v1alpha" '' ---> Using cache ---> e8afe9cc2449 Successfully built e8afe9cc2449 Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33888/kubevirt/registry-disk-v1alpha:devel ---> e8afe9cc2449 Step 2/4 : MAINTAINER "David Vossel" \ ---> Using cache ---> 41b568233ef0 Step 3/4 : RUN curl https://download.cirros-cloud.net/0.4.0/cirros-0.4.0-x86_64-disk.img > /disk/cirros.img ---> Using cache ---> 473e6f6184a1 Step 4/4 : LABEL "cirros-registry-disk-demo" '' "kubevirt-functional-tests-windows2016-release0" '' ---> Using cache ---> 8781bb0d05eb Successfully built 8781bb0d05eb Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33888/kubevirt/registry-disk-v1alpha:devel ---> e8afe9cc2449 Step 2/4 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> d04d45b84bfa Step 3/4 : RUN curl -g -L https://download.fedoraproject.org/pub/fedora/linux/releases/27/CloudImages/x86_64/images/Fedora-Cloud-Base-27-1.6.x86_64.qcow2 > /disk/fedora.qcow2 ---> Using cache ---> c3095df12e40 Step 4/4 : LABEL "fedora-cloud-registry-disk-demo" '' "kubevirt-functional-tests-windows2016-release0" '' ---> Using cache ---> 124b71df49de Successfully built 124b71df49de Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33888/kubevirt/registry-disk-v1alpha:devel ---> e8afe9cc2449 Step 2/4 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> d04d45b84bfa Step 3/4 : RUN curl http://dl-cdn.alpinelinux.org/alpine/v3.7/releases/x86_64/alpine-virt-3.7.0-x86_64.iso > /disk/alpine.iso ---> Using cache ---> 69071a98dd13 Step 4/4 : LABEL "alpine-registry-disk-demo" '' "kubevirt-functional-tests-windows2016-release0" '' ---> Using cache ---> 85d21ead9b3d Successfully built 85d21ead9b3d Sending build context to Docker daemon 34.03 MB Step 1/8 : FROM fedora:27 ---> 9110ae7f579f Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> cc296a71da13 Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virtctl ---> Using cache ---> 43dc6378f9e6 Step 4/8 : WORKDIR /home/virtctl ---> Using cache ---> e29a9816bce9 Step 5/8 : USER 1001 ---> Using cache ---> 0a3ae9e18938 Step 6/8 : COPY subresource-access-test /subresource-access-test ---> 0eebdfeb1514 Removing intermediate container 4115ecb8670e Step 7/8 : ENTRYPOINT /subresource-access-test ---> Running in 7d0c63dcbd8c ---> 18407d24bf40 Removing intermediate container 7d0c63dcbd8c Step 8/8 : LABEL "kubevirt-functional-tests-windows2016-release0" '' "subresource-access-test" '' ---> Running in 299239c1326b ---> 41be73fe516c Removing intermediate container 299239c1326b Successfully built 41be73fe516c Sending build context to Docker daemon 3.072 kB Step 1/9 : FROM fedora:27 ---> 9110ae7f579f Step 2/9 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> cc296a71da13 Step 3/9 : ENV container docker ---> Using cache ---> 95752cc0f6e3 Step 4/9 : RUN dnf -y install make git gcc && dnf -y clean all ---> Using cache ---> 23feff5b1edf Step 5/9 : ENV GIMME_GO_VERSION 1.9.2 ---> Using cache ---> 4770990ed1fc Step 6/9 : RUN mkdir -p /gimme && curl -sL https://raw.githubusercontent.com/travis-ci/gimme/master/gimme | HOME=/gimme bash >> /etc/profile.d/gimme.sh ---> Using cache ---> 0aaacf980e26 Step 7/9 : ENV GOPATH "/go" GOBIN "/usr/bin" ---> Using cache ---> 894fa40f5dab Step 8/9 : RUN mkdir -p /go && source /etc/profile.d/gimme.sh && go get github.com/masterzen/winrm-cli ---> Using cache ---> 0b5a3650fce1 Step 9/9 : LABEL "kubevirt-functional-tests-windows2016-release0" '' "winrmcli" '' ---> Using cache ---> 50542a28d0c5 Successfully built 50542a28d0c5 Sending build context to Docker daemon 2.048 kB Step 1/4 : FROM fedora:27 ---> 9110ae7f579f Step 2/4 : RUN dnf install -y iproute ---> Using cache ---> 023ec04a494f Step 3/4 : ENTRYPOINT ip link ---> Using cache ---> 03cc04a27bae Step 4/4 : LABEL "iproute" '' "kubevirt-functional-tests-windows2016-release0" '' ---> Running in ca85c9708982 ---> 7139f170872e Removing intermediate container ca85c9708982 Successfully built 7139f170872e hack/build-docker.sh push The push refers to a repository [localhost:33888/kubevirt/virt-controller] 44f0e281176a: Preparing 7d5157818b5e: Preparing 39bae602f753: Preparing 7d5157818b5e: Pushed 44f0e281176a: Pushed 39bae602f753: Pushed devel: digest: sha256:43ad235c491dd0ba169de09902c0225710f614866ebabf2336439f3c6d886c87 size: 948 The push refers to a repository [localhost:33888/kubevirt/virt-launcher] db9497ef31af: Preparing 0ff10e6da569: Preparing 9a427e10d7d0: Preparing f8b18c6372d3: Preparing 496ac61b2571: Preparing 9e20b26113ea: Preparing a1a99db27cd1: Preparing ec5be2616f4d: Preparing ffcfbc9458ac: Preparing 68e0ce966da1: Preparing 39bae602f753: Preparing 9e20b26113ea: Waiting ffcfbc9458ac: Waiting 68e0ce966da1: Waiting 39bae602f753: Waiting ec5be2616f4d: Waiting 0ff10e6da569: Pushed 9a427e10d7d0: Pushed db9497ef31af: Pushed 9e20b26113ea: Pushed a1a99db27cd1: Pushed ec5be2616f4d: Pushed 39bae602f753: Mounted from kubevirt/virt-controller ffcfbc9458ac: Pushed 496ac61b2571: Pushed f8b18c6372d3: Pushed 68e0ce966da1: Pushed devel: digest: sha256:9be38ae29451fdb6c64ba76c66c9d83f4cc8d95549c42b4003febdf33b680b78 size: 2617 The push refers to a repository [localhost:33888/kubevirt/virt-handler] 1dfb53aadd5a: Preparing 39bae602f753: Preparing 39bae602f753: Mounted from kubevirt/virt-launcher 1dfb53aadd5a: Pushed devel: digest: sha256:be5d9321a1189fdf3080f201d94484fe90a53f2959473fc87aa383c9822705f3 size: 740 The push refers to a repository [localhost:33888/kubevirt/virt-api] 50d077d53baf: Preparing 8e02b41e2e47: Preparing 39bae602f753: Preparing 39bae602f753: Mounted from kubevirt/virt-handler 8e02b41e2e47: Pushed 50d077d53baf: Pushed devel: digest: sha256:629d84224554645a1ef9c82a4eb19cd93b18922000fc2326df854ee69d9c3e93 size: 948 The push refers to a repository [localhost:33888/kubevirt/disks-images-provider] 6b28f682fe68: Preparing 60fe073622c0: Preparing 39bae602f753: Preparing 39bae602f753: Mounted from kubevirt/virt-api 6b28f682fe68: Pushed 60fe073622c0: Pushed devel: digest: sha256:9b13eb852135f0b89da3b1f8fa235814c65017fd38cad94b268891bc0d19786f size: 948 The push refers to a repository [localhost:33888/kubevirt/vm-killer] e8d99376fb84: Preparing 39bae602f753: Preparing 39bae602f753: Mounted from kubevirt/disks-images-provider e8d99376fb84: Pushed devel: digest: sha256:88fe172eb456231a2bf3bbb5632d0ebc25d64af618ab843e8d6be4467923f953 size: 740 The push refers to a repository [localhost:33888/kubevirt/registry-disk-v1alpha] c66b9a220e25: Preparing 4662bbc21c2d: Preparing 25edbec0eaea: Preparing c66b9a220e25: Pushed 4662bbc21c2d: Pushed 25edbec0eaea: Pushed devel: digest: sha256:2cf20d730b85e6b2b8f9ad90ac43696185e4943ef912d6554a0a35652f332f0e size: 948 The push refers to a repository [localhost:33888/kubevirt/cirros-registry-disk-demo] aa0f4fd12312: Preparing c66b9a220e25: Preparing 4662bbc21c2d: Preparing 25edbec0eaea: Preparing c66b9a220e25: Mounted from kubevirt/registry-disk-v1alpha 25edbec0eaea: Mounted from kubevirt/registry-disk-v1alpha 4662bbc21c2d: Mounted from kubevirt/registry-disk-v1alpha aa0f4fd12312: Pushed devel: digest: sha256:f51c0a43b65d10a93bc839ccf1c1ab8b0f9479f2c7f36041cb6cbb3569c784eb size: 1160 The push refers to a repository [localhost:33888/kubevirt/fedora-cloud-registry-disk-demo] 60074fafd7c2: Preparing c66b9a220e25: Preparing 4662bbc21c2d: Preparing 25edbec0eaea: Preparing c66b9a220e25: Mounted from kubevirt/cirros-registry-disk-demo 25edbec0eaea: Mounted from kubevirt/cirros-registry-disk-demo 4662bbc21c2d: Mounted from kubevirt/cirros-registry-disk-demo 60074fafd7c2: Pushed devel: digest: sha256:cb3a19b4a1eb3061d693d48282dd388763d5e81deb12776200648a56f21733ed size: 1161 The push refers to a repository [localhost:33888/kubevirt/alpine-registry-disk-demo] c419637b3f18: Preparing c66b9a220e25: Preparing 4662bbc21c2d: Preparing 25edbec0eaea: Preparing 25edbec0eaea: Mounted from kubevirt/fedora-cloud-registry-disk-demo c66b9a220e25: Mounted from kubevirt/fedora-cloud-registry-disk-demo 4662bbc21c2d: Mounted from kubevirt/fedora-cloud-registry-disk-demo c419637b3f18: Pushed devel: digest: sha256:2c787e1fe571b7fb7020c865281a6583f068b7cbb7d2bce7a2e2a325d02a655c size: 1160 The push refers to a repository [localhost:33888/kubevirt/subresource-access-test] c7e39d129ed4: Preparing e0bbf15a89b8: Preparing 39bae602f753: Preparing 39bae602f753: Mounted from kubevirt/vm-killer e0bbf15a89b8: Pushed c7e39d129ed4: Pushed devel: digest: sha256:db9d8dd4f64a8cfd93dc1542a09c1caf1200d4f5b1da1a4931a77108936d10ac size: 948 The push refers to a repository [localhost:33888/kubevirt/winrmcli] e874f7647382: Preparing 2b23514ed94b: Preparing 479fc5763b8f: Preparing 39bae602f753: Preparing 39bae602f753: Mounted from kubevirt/subresource-access-test e874f7647382: Pushed 479fc5763b8f: Pushed 2b23514ed94b: Pushed devel: digest: sha256:5e0831b2ba38ea5d0c8772501edd3639283159e3b1959549346525b7a734316d size: 1165 The push refers to a repository [localhost:33888/kubevirt/iproute] 109ef3898e21: Preparing 39bae602f753: Preparing 39bae602f753: Mounted from kubevirt/winrmcli 109ef3898e21: Pushed devel: digest: sha256:1a3c5f1ada244e79eba2de191528d396b2275f9c41eab88bbc21e811072239c0 size: 742 make[1]: Leaving directory `/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt' Done ./cluster/clean.sh + source hack/common.sh ++++ dirname 'hack/common.sh[0]' +++ cd hack/../ +++ pwd ++ KUBEVIRT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt ++ OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/_out ++ VENDOR_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/vendor ++ CMD_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/_out/cmd ++ TESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/_out/tests ++ APIDOCS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/_out/apidocs ++ MANIFESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/_out/manifests ++ MANIFEST_TEMPLATES_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/_out/templates/manifests ++ PYTHON_CLIENT_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/_out/client-python ++ KUBEVIRT_PROVIDER=k8s-1.11.0 ++ KUBEVIRT_PROVIDER=k8s-1.11.0 ++ KUBEVIRT_NUM_NODES=2 ++ KUBEVIRT_NUM_NODES=2 ++ '[' -z kubevirt-functional-tests-windows2016-release ']' ++ provider_prefix=kubevirt-functional-tests-windows2016-release0 ++ job_prefix=kubevirt-functional-tests-windows2016-release0 +++ kubevirt_version +++ '[' -n '' ']' +++ '[' -d /var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/.git ']' ++++ git describe --always --tags +++ echo v0.6.3-13-g1b8dc60 ++ KUBEVIRT_VERSION=v0.6.3-13-g1b8dc60 + source cluster/k8s-1.11.0/provider.sh ++ set -e ++ image=k8s-1.11.0@sha256:6c1caf5559eb02a144bf606de37eb0194c06ace4d77ad4561459f3bde876151c ++ source cluster/ephemeral-provider-common.sh +++ set -e +++ _cli='docker run --privileged --net=host --rm -v /var/run/docker.sock:/var/run/docker.sock kubevirtci/gocli@sha256:aa7f295a7908fa333ab5e98ef3af0bfafbabfd3cee2b83f9af47f722e3000f6a' + source hack/config.sh ++ unset binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig manifest_docker_prefix namespace ++ KUBEVIRT_PROVIDER=k8s-1.11.0 ++ KUBEVIRT_PROVIDER=k8s-1.11.0 ++ source hack/config-default.sh source hack/config-k8s-1.11.0.sh +++ binaries='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virtctl cmd/fake-qemu-process cmd/virt-api cmd/subresource-access-test' +++ docker_images='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virt-api images/disks-images-provider images/vm-killer cmd/registry-disk-v1alpha images/cirros-registry-disk-demo images/fedora-cloud-registry-disk-demo images/alpine-registry-disk-demo cmd/subresource-access-test images/winrmcli images/iproute' +++ docker_prefix=kubevirt +++ docker_tag=latest +++ master_ip=192.168.200.2 +++ network_provider=flannel +++ kubeconfig=cluster/vagrant/.kubeconfig +++ namespace=kube-system ++ test -f hack/config-provider-k8s-1.11.0.sh ++ source hack/config-provider-k8s-1.11.0.sh +++ master_ip=127.0.0.1 +++ docker_tag=devel +++ kubeconfig=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/cluster/k8s-1.11.0/.kubeconfig +++ kubectl=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/cluster/k8s-1.11.0/.kubectl +++ docker_prefix=localhost:33888/kubevirt +++ manifest_docker_prefix=registry:5000/kubevirt ++ test -f hack/config-local.sh ++ export binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig namespace + echo 'Cleaning up ...' Cleaning up ... + cluster/kubectl.sh get vmis --all-namespaces -o=custom-columns=NAME:.metadata.name,NAMESPACE:.metadata.namespace,FINALIZERS:.metadata.finalizers --no-headers + grep foregroundDeleteVirtualMachine + read p error: the server doesn't have a resource type "vmis" + _kubectl delete ds -l kubevirt.io -n kube-system --cascade=false --grace-period 0 No resources found + _kubectl delete pods -n kube-system -l=kubevirt.io=libvirt --force --grace-period 0 No resources found + _kubectl delete pods -n kube-system -l=kubevirt.io=virt-handler --force --grace-period 0 No resources found + namespaces=(default ${namespace}) + for i in '${namespaces[@]}' + _kubectl -n default delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete apiservices -l kubevirt.io No resources found + _kubectl -n default delete deployment -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete deployment -l kubevirt.io No resources found + _kubectl -n default delete rs -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete rs -l kubevirt.io No resources found + _kubectl -n default delete services -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete services -l kubevirt.io No resources found + _kubectl -n default delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete apiservices -l kubevirt.io No resources found + _kubectl -n default delete validatingwebhookconfiguration -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete validatingwebhookconfiguration -l kubevirt.io No resources found + _kubectl -n default delete secrets -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete secrets -l kubevirt.io No resources found + _kubectl -n default delete pv -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete pv -l kubevirt.io No resources found + _kubectl -n default delete pvc -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete pvc -l kubevirt.io No resources found + _kubectl -n default delete ds -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete ds -l kubevirt.io No resources found + _kubectl -n default delete customresourcedefinitions -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete customresourcedefinitions -l kubevirt.io No resources found + _kubectl -n default delete pods -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete pods -l kubevirt.io No resources found + _kubectl -n default delete clusterrolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete clusterrolebinding -l kubevirt.io No resources found + _kubectl -n default delete rolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete rolebinding -l kubevirt.io No resources found + _kubectl -n default delete roles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete roles -l kubevirt.io No resources found + _kubectl -n default delete clusterroles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete clusterroles -l kubevirt.io No resources found + _kubectl -n default delete serviceaccounts -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete serviceaccounts -l kubevirt.io No resources found ++ _kubectl -n default get crd offlinevirtualmachines.kubevirt.io ++ wc -l ++ export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig ++ KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig ++ cluster/k8s-1.11.0/.kubectl -n default get crd offlinevirtualmachines.kubevirt.io No resources found. Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "offlinevirtualmachines.kubevirt.io" not found + '[' 0 -gt 0 ']' + for i in '${namespaces[@]}' + _kubectl -n kube-system delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete apiservices -l kubevirt.io No resources found + _kubectl -n kube-system delete deployment -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete deployment -l kubevirt.io No resources found + _kubectl -n kube-system delete rs -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete rs -l kubevirt.io No resources found + _kubectl -n kube-system delete services -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete services -l kubevirt.io No resources found + _kubectl -n kube-system delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete apiservices -l kubevirt.io No resources found + _kubectl -n kube-system delete validatingwebhookconfiguration -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete validatingwebhookconfiguration -l kubevirt.io No resources found + _kubectl -n kube-system delete secrets -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete secrets -l kubevirt.io No resources found + _kubectl -n kube-system delete pv -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete pv -l kubevirt.io No resources found + _kubectl -n kube-system delete pvc -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete pvc -l kubevirt.io No resources found + _kubectl -n kube-system delete ds -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete ds -l kubevirt.io No resources found + _kubectl -n kube-system delete customresourcedefinitions -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete customresourcedefinitions -l kubevirt.io No resources found + _kubectl -n kube-system delete pods -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete pods -l kubevirt.io No resources found + _kubectl -n kube-system delete clusterrolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete clusterrolebinding -l kubevirt.io No resources found + _kubectl -n kube-system delete rolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete rolebinding -l kubevirt.io No resources found + _kubectl -n kube-system delete roles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete roles -l kubevirt.io No resources found + _kubectl -n kube-system delete clusterroles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete clusterroles -l kubevirt.io No resources found + _kubectl -n kube-system delete serviceaccounts -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete serviceaccounts -l kubevirt.io No resources found ++ _kubectl -n kube-system get crd offlinevirtualmachines.kubevirt.io ++ wc -l ++ export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig ++ KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig ++ cluster/k8s-1.11.0/.kubectl -n kube-system get crd offlinevirtualmachines.kubevirt.io No resources found. Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "offlinevirtualmachines.kubevirt.io" not found + '[' 0 -gt 0 ']' + sleep 2 + echo Done Done ./cluster/deploy.sh + source hack/common.sh ++++ dirname 'hack/common.sh[0]' +++ cd hack/../ +++ pwd ++ KUBEVIRT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt ++ OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/_out ++ VENDOR_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/vendor ++ CMD_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/_out/cmd ++ TESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/_out/tests ++ APIDOCS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/_out/apidocs ++ MANIFESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/_out/manifests ++ MANIFEST_TEMPLATES_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/_out/templates/manifests ++ PYTHON_CLIENT_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/_out/client-python ++ KUBEVIRT_PROVIDER=k8s-1.11.0 ++ KUBEVIRT_PROVIDER=k8s-1.11.0 ++ KUBEVIRT_NUM_NODES=2 ++ KUBEVIRT_NUM_NODES=2 ++ '[' -z kubevirt-functional-tests-windows2016-release ']' ++ provider_prefix=kubevirt-functional-tests-windows2016-release0 ++ job_prefix=kubevirt-functional-tests-windows2016-release0 +++ kubevirt_version +++ '[' -n '' ']' +++ '[' -d /var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/.git ']' ++++ git describe --always --tags +++ echo v0.6.3-13-g1b8dc60 ++ KUBEVIRT_VERSION=v0.6.3-13-g1b8dc60 + source cluster/k8s-1.11.0/provider.sh ++ set -e ++ image=k8s-1.11.0@sha256:6c1caf5559eb02a144bf606de37eb0194c06ace4d77ad4561459f3bde876151c ++ source cluster/ephemeral-provider-common.sh +++ set -e +++ _cli='docker run --privileged --net=host --rm -v /var/run/docker.sock:/var/run/docker.sock kubevirtci/gocli@sha256:aa7f295a7908fa333ab5e98ef3af0bfafbabfd3cee2b83f9af47f722e3000f6a' + source hack/config.sh ++ unset binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig manifest_docker_prefix namespace ++ KUBEVIRT_PROVIDER=k8s-1.11.0 ++ KUBEVIRT_PROVIDER=k8s-1.11.0 ++ source hack/config-default.sh source hack/config-k8s-1.11.0.sh +++ binaries='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virtctl cmd/fake-qemu-process cmd/virt-api cmd/subresource-access-test' +++ docker_images='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virt-api images/disks-images-provider images/vm-killer cmd/registry-disk-v1alpha images/cirros-registry-disk-demo images/fedora-cloud-registry-disk-demo images/alpine-registry-disk-demo cmd/subresource-access-test images/winrmcli images/iproute' +++ docker_prefix=kubevirt +++ docker_tag=latest +++ master_ip=192.168.200.2 +++ network_provider=flannel +++ kubeconfig=cluster/vagrant/.kubeconfig +++ namespace=kube-system ++ test -f hack/config-provider-k8s-1.11.0.sh ++ source hack/config-provider-k8s-1.11.0.sh +++ master_ip=127.0.0.1 +++ docker_tag=devel +++ kubeconfig=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/cluster/k8s-1.11.0/.kubeconfig +++ kubectl=/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/cluster/k8s-1.11.0/.kubectl +++ docker_prefix=localhost:33888/kubevirt +++ manifest_docker_prefix=registry:5000/kubevirt ++ test -f hack/config-local.sh ++ export binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig namespace + echo 'Deploying ...' Deploying ... + [[ -z windows2016-release ]] + [[ windows2016-release =~ .*-dev ]] + [[ windows2016-release =~ .*-release ]] + for manifest in '${MANIFESTS_OUT_DIR}/release/*' + [[ /var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/_out/manifests/release/demo-content.yaml =~ .*demo.* ]] + continue + for manifest in '${MANIFESTS_OUT_DIR}/release/*' + [[ /var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/_out/manifests/release/kubevirt.yaml =~ .*demo.* ]] + _kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/_out/manifests/release/kubevirt.yaml + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/_out/manifests/release/kubevirt.yaml clusterrole.rbac.authorization.k8s.io/kubevirt.io:admin created clusterrole.rbac.authorization.k8s.io/kubevirt.io:edit created clusterrole.rbac.authorization.k8s.io/kubevirt.io:view created serviceaccount/kubevirt-apiserver created clusterrolebinding.rbac.authorization.k8s.io/kubevirt-apiserver created clusterrolebinding.rbac.authorization.k8s.io/kubevirt-apiserver-auth-delegator created rolebinding.rbac.authorization.k8s.io/kubevirt-apiserver created role.rbac.authorization.k8s.io/kubevirt-apiserver created clusterrole.rbac.authorization.k8s.io/kubevirt-apiserver created clusterrole.rbac.authorization.k8s.io/kubevirt-controller created serviceaccount/kubevirt-controller created serviceaccount/kubevirt-privileged created clusterrolebinding.rbac.authorization.k8s.io/kubevirt-controller created clusterrolebinding.rbac.authorization.k8s.io/kubevirt-controller-cluster-admin created clusterrolebinding.rbac.authorization.k8s.io/kubevirt-privileged-cluster-admin created clusterrole.rbac.authorization.k8s.io/kubevirt.io:default created clusterrolebinding.rbac.authorization.k8s.io/kubevirt.io:default created service/virt-api created deployment.extensions/virt-api created deployment.extensions/virt-controller created daemonset.extensions/virt-handler created error: error validating "/var/lib/swarm/workspace/kubevirt-functional-tests-windows2016-release/go/src/kubevirt.io/kubevirt/_out/manifests/release/kubevirt.yaml": error validating data: [ValidationError(CustomResourceDefinition.status): missing required field "conditions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1beta1.CustomResourceDefinitionStatus, ValidationError(CustomResourceDefinition.status): missing required field "storedVersions" in io.k8s.apiextensions-apiserver.pkg.apis.apiextensions.v1beta1.CustomResourceDefinitionStatus]; if you choose to ignore these errors, turn validation off with --validate=false make: *** [cluster-deploy] Error 1 + make cluster-down ./cluster/down.sh