+ export WORKSPACE=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev + WORKSPACE=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev + [[ k8s-1.11.0-dev =~ openshift-.* ]] + [[ k8s-1.11.0-dev =~ .*-1.10.4-.* ]] + export KUBEVIRT_PROVIDER=k8s-1.11.0 + KUBEVIRT_PROVIDER=k8s-1.11.0 + export KUBEVIRT_NUM_NODES=2 + KUBEVIRT_NUM_NODES=2 + export NFS_WINDOWS_DIR=/home/nfs/images/windows2016 + NFS_WINDOWS_DIR=/home/nfs/images/windows2016 + export NAMESPACE=kube-system + NAMESPACE=kube-system + trap '{ make cluster-down; }' EXIT SIGINT SIGTERM SIGSTOP + make cluster-down ./cluster/down.sh + make cluster-up ./cluster/up.sh Downloading ....... Downloading ....... 2018/08/07 17:53:52 Waiting for host: 192.168.66.101:22 2018/08/07 17:53:55 Problem with dial: dial tcp 192.168.66.101:22: getsockopt: no route to host. Sleeping 5s 2018/08/07 17:54:03 Problem with dial: dial tcp 192.168.66.101:22: getsockopt: no route to host. Sleeping 5s 2018/08/07 17:54:08 Connected to tcp://192.168.66.101:22 ++ grep active ++ systemctl status docker ++ wc -l + [[ 0 -eq 0 ]] + sleep 2 ++ systemctl status docker ++ grep active ++ wc -l + [[ 1 -eq 0 ]] + kubeadm init --config /etc/kubernetes/kubeadm.conf [init] using Kubernetes version: v1.11.0 [preflight] running pre-flight checks I0807 17:54:12.503467 1301 feature_gate.go:230] feature gates: &{map[]} I0807 17:54:12.577186 1301 kernel_validator.go:81] Validating kernel version I0807 17:54:12.577450 1301 kernel_validator.go:96] Validating kernel config [preflight/images] Pulling images required for setting up a Kubernetes cluster [preflight/images] This might take a minute or two, depending on the speed of your internet connection [preflight/images] You can also perform this action in beforehand using 'kubeadm config images pull' [kubelet] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env" [kubelet] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml" [preflight] Activating the kubelet service [certificates] Generated ca certificate and key. [certificates] Generated apiserver certificate and key. [certificates] apiserver serving cert is signed for DNS names [node01 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 192.168.66.101] [certificates] Generated apiserver-kubelet-client certificate and key. [certificates] Generated sa key and public key. [certificates] Generated front-proxy-ca certificate and key. [certificates] Generated front-proxy-client certificate and key. [certificates] Generated etcd/ca certificate and key. [certificates] Generated etcd/server certificate and key. [certificates] etcd/server serving cert is signed for DNS names [node01 localhost] and IPs [127.0.0.1 ::1] [certificates] Generated etcd/peer certificate and key. [certificates] etcd/peer serving cert is signed for DNS names [node01 localhost] and IPs [192.168.66.101 127.0.0.1 ::1] [certificates] Generated etcd/healthcheck-client certificate and key. [certificates] Generated apiserver-etcd-client certificate and key. [certificates] valid certificates and keys now exist in "/etc/kubernetes/pki" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/admin.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/kubelet.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/controller-manager.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/scheduler.conf" [controlplane] wrote Static Pod manifest for component kube-apiserver to "/etc/kubernetes/manifests/kube-apiserver.yaml" [controlplane] wrote Static Pod manifest for component kube-controller-manager to "/etc/kubernetes/manifests/kube-controller-manager.yaml" [controlplane] wrote Static Pod manifest for component kube-scheduler to "/etc/kubernetes/manifests/kube-scheduler.yaml" [etcd] Wrote Static Pod manifest for a local etcd instance to "/etc/kubernetes/manifests/etcd.yaml" [init] waiting for the kubelet to boot up the control plane as Static Pods from directory "/etc/kubernetes/manifests" [init] this might take a minute or longer if the control plane images have to be pulled [apiclient] All control plane components are healthy after 47.505202 seconds [uploadconfig] storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace [kubelet] Creating a ConfigMap "kubelet-config-1.11" in namespace kube-system with the configuration for the kubelets in the cluster [markmaster] Marking the node node01 as master by adding the label "node-role.kubernetes.io/master=''" [markmaster] Marking the node node01 as master by adding the taints [node-role.kubernetes.io/master:NoSchedule] [patchnode] Uploading the CRI Socket information "/var/run/dockershim.sock" to the Node API object "node01" as an annotation [bootstraptoken] using token: abcdef.1234567890123456 [bootstraptoken] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials [bootstraptoken] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token [bootstraptoken] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster [bootstraptoken] creating the "cluster-info" ConfigMap in the "kube-public" namespace [addons] Applied essential addon: CoreDNS [addons] Applied essential addon: kube-proxy Your Kubernetes master has initialized successfully! To start using your cluster, you need to run the following as a regular user: mkdir -p $HOME/.kube sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config sudo chown $(id -u):$(id -g) $HOME/.kube/config You should now deploy a pod network to the cluster. Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at: https://kubernetes.io/docs/concepts/cluster-administration/addons/ You can now join any number of machines by running the following on each node as root: kubeadm join 192.168.66.101:6443 --token abcdef.1234567890123456 --discovery-token-ca-cert-hash sha256:80966367a215230a1771a9815b2f44e2494d39df40eb2f21d99792558871ea0b + kubectl --kubeconfig=/etc/kubernetes/admin.conf apply -f https://raw.githubusercontent.com/coreos/flannel/v0.9.1/Documentation/kube-flannel.yml clusterrole.rbac.authorization.k8s.io/flannel created clusterrolebinding.rbac.authorization.k8s.io/flannel created serviceaccount/flannel created configmap/kube-flannel-cfg created daemonset.extensions/kube-flannel-ds created + kubectl --kubeconfig=/etc/kubernetes/admin.conf taint nodes node01 node-role.kubernetes.io/master:NoSchedule- node/node01 untainted + kubectl --kubeconfig=/etc/kubernetes/admin.conf create -f /tmp/local-volume.yaml storageclass.storage.k8s.io/local created configmap/local-storage-config created clusterrolebinding.rbac.authorization.k8s.io/local-storage-provisioner-pv-binding created clusterrole.rbac.authorization.k8s.io/local-storage-provisioner-node-clusterrole created clusterrolebinding.rbac.authorization.k8s.io/local-storage-provisioner-node-binding created role.rbac.authorization.k8s.io/local-storage-provisioner-jobs-role created rolebinding.rbac.authorization.k8s.io/local-storage-provisioner-jobs-rolebinding created serviceaccount/local-storage-admin created daemonset.extensions/local-volume-provisioner created 2018/08/07 17:55:13 Waiting for host: 192.168.66.102:22 2018/08/07 17:55:16 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: no route to host. Sleeping 5s 2018/08/07 17:55:28 Connected to tcp://192.168.66.102:22 ++ systemctl status docker ++ grep active ++ wc -l + [[ 1 -eq 0 ]] + kubeadm join --token abcdef.1234567890123456 192.168.66.101:6443 --ignore-preflight-errors=all --discovery-token-unsafe-skip-ca-verification=true [preflight] running pre-flight checks [WARNING RequiredIPVSKernelModulesAvailable]: the IPVS proxier will not be used, because the following required kernel modules are not loaded: [ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh] or no builtin kernel ipvs support: map[ip_vs:{} ip_vs_rr:{} ip_vs_wrr:{} ip_vs_sh:{} nf_conntrack_ipv4:{}] you can solve this problem with following methods: 1. Run 'modprobe -- ' to load missing kernel modules; 2. Provide the missing builtin kernel ipvs support I0807 17:55:28.938363 1294 kernel_validator.go:81] Validating kernel version I0807 17:55:28.938651 1294 kernel_validator.go:96] Validating kernel config [discovery] Trying to connect to API Server "192.168.66.101:6443" [discovery] Created cluster-info discovery client, requesting info from "https://192.168.66.101:6443" [discovery] Cluster info signature and contents are valid and no TLS pinning was specified, will use API Server "192.168.66.101:6443" [discovery] Successfully established connection with API Server "192.168.66.101:6443" [kubelet] Downloading configuration for the kubelet from the "kubelet-config-1.11" ConfigMap in the kube-system namespace [kubelet] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml" [kubelet] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env" [preflight] Activating the kubelet service [tlsbootstrap] Waiting for the kubelet to perform the TLS Bootstrap... [patchnode] Uploading the CRI Socket information "/var/run/dockershim.sock" to the Node API object "node02" as an annotation This node has joined the cluster: * Certificate signing request was sent to master and a response was received. * The Kubelet was informed of the new secure connection details. Run 'kubectl get nodes' on the master to see this node join the cluster. Sending file modes: C0755 38739968 kubectl Sending file modes: C0600 5454 admin.conf Cluster "kubernetes" set. Cluster "kubernetes" set. + set +e + kubectl get nodes --no-headers + cluster/kubectl.sh get nodes --no-headers node01 Ready master 38s v1.11.0 node02 Ready 15s v1.11.0 + kubectl_rc=0 + '[' 0 -ne 0 ']' ++ kubectl get nodes --no-headers ++ grep NotReady ++ cluster/kubectl.sh get nodes --no-headers + '[' -n '' ']' + set -e + echo 'Nodes are ready:' Nodes are ready: + kubectl get nodes + cluster/kubectl.sh get nodes NAME STATUS ROLES AGE VERSION node01 Ready master 38s v1.11.0 node02 Ready 15s v1.11.0 + make cluster-sync ./cluster/build.sh Building ... Untagged: localhost:32864/kubevirt/virt-controller:devel Untagged: localhost:32864/kubevirt/virt-controller@sha256:4873e8e2ac10edc22842ebd4254cd9616a8335123d8614ef9cc6ccb4958e5da0 Deleted: sha256:9fcc081e28c19bc1d93a1e764700895c1027ce7ac7777f0f2f419a6417a588c5 Deleted: sha256:8d45c9561a39246ca09094c260be997e1716323fd326235bdce6061e899a3f67 Deleted: sha256:f83604fb8987b918a3edb9cbfe058c28b159c515ea0341d2daaffd864224c0aa Deleted: sha256:4ed31869dae0bc565dc6cab5488ab9ee6510b61d8980a83cd9089873bd380a84 Untagged: localhost:32864/kubevirt/virt-launcher:devel Untagged: localhost:32864/kubevirt/virt-launcher@sha256:02e9d8889d3deb9f1b12822139a314af007ae4e43a46d15fe97e80f534c30397 Deleted: sha256:9c29451dcc438f245abd968eb884b75580a158353ace6b4ad060e1d6eee7a7d5 Deleted: sha256:519b350e976d6c119c1134b38e5ccfdbb8e9eded868f2a5bcf8833dfa0aebd41 Deleted: sha256:7a3ffa35c6a886e93c52b9b846292d74df3136c00eb6d7bdfa7b594b915c6187 Deleted: sha256:acb4c91d459ae9109505fa41e30e3d861eee83e3d9d532c0977b9f2e3b7371ac Deleted: sha256:b4494c7a3dc77a9484c947e925631599c59581b7736906e99609f2ed41fed702 Deleted: sha256:56963f1df6bc63dfa1f39107bed6a8ac8e145e7ba4e2d725cc9d00fb7dc49056 Deleted: sha256:0109c84fd17b6194152852f3b2f3ec853fdf7028500b72202696b7687de4820b Deleted: sha256:40360aaddf55bd90f8aebe5334245a304c7fc87798fe84076c527f05b8ce3caa Deleted: sha256:0a01a664a130eb12063d3a7803d601c955f8f2acf4a19a343d1b2fb2e3497fdd Deleted: sha256:425a1f759f3b9257647227bac96b17d5f6913f6a8d2f567a0d715e5f73cc5884 Deleted: sha256:2c8dc4024be59be1598313c76befc8f40214365c6213b9805fe5a13a48b218f7 Deleted: sha256:4cb47269bfb6ca09055ccff724b1a0c4b24d5ef296a3fee840254cff7abd4fcd Untagged: localhost:32864/kubevirt/virt-handler:devel Untagged: localhost:32864/kubevirt/virt-handler@sha256:0181c1346d5601460f0e202abf12f8a7e3d8d1809f06a0efebc00148f81d15a7 Deleted: sha256:446a177d5212f02d369b81e11714064266680357ac829ec9921c7063e0c8bb18 Deleted: sha256:7ce6dfe57ec5b54dcdbc561163a076b1ae57a8c8ac91c220f79459e9b6bec0fc Deleted: sha256:706ce3562a385d09b132a0304d50d829d0dd62826689cdc90d4cfb78ff2d5344 Deleted: sha256:f64b02fb46785909d8b13a1cfd236d53c034848c56ec9e76eb6dee08bbc6bb1f Untagged: localhost:32864/kubevirt/virt-api:devel Untagged: localhost:32864/kubevirt/virt-api@sha256:3562a4842866b7f767676e77dbf4cc2435055afc79a7bc66b4c19656cee666ab Deleted: sha256:54780166f68f558697788163991cb361d384acf9900c2f9d45b548e1f4b02e06 Deleted: sha256:ba521643a98f03e182cacf3da0a5ea28b1767a459165f15156c1d5618146067f Deleted: sha256:c0c03d53236f4750160bd32fc0d2a01cb1813a1c40ee7b8ea8e56621a8e34fd9 Deleted: sha256:1ac47f64d0925587c6930513f91f64677866f64efc913ef74c73a22281ad2a17 Untagged: localhost:32864/kubevirt/subresource-access-test:devel Untagged: localhost:32864/kubevirt/subresource-access-test@sha256:2ec7eee99fcb6d9ab18c101aa15a567783ed36bec6e01d1d7535b5a56187e589 Deleted: sha256:676ee13658fdeb780554d879c5509f2ea4d07c158f1b24cfca1a0a626592d961 Deleted: sha256:bd13c2d95843bdf57f16ca75d042f1cde7f7972e1ba7f0b21521a3854964fda9 Deleted: sha256:e3e2ee3fc4f2447c776e89f288d8081db29d29d8b7d807a0c13db530dff962ad Deleted: sha256:362eb8ab7f79aafd4283a10a07a4da727a182bbbe1f49d3954386e631bf7c47d Untagged: localhost:32864/kubevirt/example-hook-sidecar:devel Untagged: localhost:32864/kubevirt/example-hook-sidecar@sha256:a4bddad4d5530c2e819c7b7734bc1fe9234d3a7ac888d2a735eee9f782981b8a Deleted: sha256:e6099d8f65681880e354eb41012b5b5cbe1925094189c01c8cd784aa250590f8 Deleted: sha256:22591cb7e7666a4d0242aa31f92fd047c7af953ec4cc43d301d750dad1371f67 Deleted: sha256:e99d83845b37401e4b12c0cbd0d4526eb235f116825755dbe2e9d945286b3511 Deleted: sha256:f65a8881eb3a7e4d0d02d44e9d5a49c5e20774badf4c566eae0b9b6a2e17f9fd Sending build context to Docker daemon 5.632 kB Step 1/12 : FROM fedora:28 ---> cc510acfcd70 Step 2/12 : ENV LIBVIRT_VERSION 4.2.0 ---> Using cache ---> 2c20d91d48e6 Step 3/12 : RUN curl --output /etc/yum.repos.d/fedora-virt-preview.repo https://fedorapeople.org/groups/virt/virt-preview/fedora-virt-preview.repo ---> Using cache ---> b7c63cc1ff31 Step 4/12 : RUN dnf -y install libvirt-devel-${LIBVIRT_VERSION} make git mercurial sudo gcc findutils gradle rsync-daemon rsync qemu-img protobuf-compiler && dnf -y clean all ---> Using cache ---> 784786580231 Step 5/12 : ENV GIMME_GO_VERSION 1.10 ---> Using cache ---> e6c3df647782 Step 6/12 : RUN mkdir -p /gimme && curl -sL https://raw.githubusercontent.com/travis-ci/gimme/master/gimme | HOME=/gimme bash >> /etc/profile.d/gimme.sh ---> Using cache ---> aa4d2ed226ed Step 7/12 : ENV GOPATH "/go" GOBIN "/usr/bin" ---> Using cache ---> 9d8471eeeed9 Step 8/12 : ADD rsyncd.conf /etc/rsyncd.conf ---> Using cache ---> 35522f6166d0 Step 9/12 : RUN mkdir -p /go && source /etc/profile.d/gimme.sh && go get github.com/mattn/goveralls && go get -u github.com/Masterminds/glide && go get golang.org/x/tools/cmd/goimports && git clone https://github.com/mvdan/sh.git $GOPATH/src/mvdan.cc/sh && cd /go/src/mvdan.cc/sh/cmd/shfmt && git checkout v2.5.0 && go get mvdan.cc/sh/cmd/shfmt && go install && go get -u github.com/golang/mock/gomock && go get -u github.com/rmohr/mock/mockgen && go get -u github.com/rmohr/go-swagger-utils/swagger-doc && go get -u github.com/onsi/ginkgo/ginkgo && go get -u -d k8s.io/code-generator/cmd/deepcopy-gen && go get -u -d k8s.io/code-generator/cmd/defaulter-gen && go get -u -d k8s.io/code-generator/cmd/openapi-gen && cd /go/src/k8s.io/code-generator/cmd/deepcopy-gen && git checkout release-1.9 && go install && cd /go/src/k8s.io/code-generator/cmd/defaulter-gen && git checkout release-1.9 && go install && cd /go/src/k8s.io/code-generator/cmd/openapi-gen && git checkout release-1.9 && go install && go get -u -d github.com/golang/protobuf/protoc-gen-go && cd /go/src/github.com/golang/protobuf/protoc-gen-go && git checkout 1643683e1b54a9e88ad26d98f81400c8c9d9f4f9 && go install ---> Using cache ---> a36d9a9a5e01 Step 10/12 : RUN pip install j2cli ---> Using cache ---> 87206820d410 Step 11/12 : ADD entrypoint.sh /entrypoint.sh ---> Using cache ---> b3a27a114600 Step 12/12 : ENTRYPOINT /entrypoint.sh ---> Using cache ---> ceba12cbc33e Successfully built ceba12cbc33e go version go1.10 linux/amd64 go version go1.10 linux/amd64 make[1]: Entering directory `/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt' hack/dockerized "./hack/check.sh && KUBEVIRT_VERSION= ./hack/build-go.sh install " && ./hack/build-copy-artifacts.sh Sending build context to Docker daemon 5.632 kB Step 1/12 : FROM fedora:28 ---> cc510acfcd70 Step 2/12 : ENV LIBVIRT_VERSION 4.2.0 ---> Using cache ---> 2c20d91d48e6 Step 3/12 : RUN curl --output /etc/yum.repos.d/fedora-virt-preview.repo https://fedorapeople.org/groups/virt/virt-preview/fedora-virt-preview.repo ---> Using cache ---> b7c63cc1ff31 Step 4/12 : RUN dnf -y install libvirt-devel-${LIBVIRT_VERSION} make git mercurial sudo gcc findutils gradle rsync-daemon rsync qemu-img protobuf-compiler && dnf -y clean all ---> Using cache ---> 784786580231 Step 5/12 : ENV GIMME_GO_VERSION 1.10 ---> Using cache ---> e6c3df647782 Step 6/12 : RUN mkdir -p /gimme && curl -sL https://raw.githubusercontent.com/travis-ci/gimme/master/gimme | HOME=/gimme bash >> /etc/profile.d/gimme.sh ---> Using cache ---> aa4d2ed226ed Step 7/12 : ENV GOPATH "/go" GOBIN "/usr/bin" ---> Using cache ---> 9d8471eeeed9 Step 8/12 : ADD rsyncd.conf /etc/rsyncd.conf ---> Using cache ---> 35522f6166d0 Step 9/12 : RUN mkdir -p /go && source /etc/profile.d/gimme.sh && go get github.com/mattn/goveralls && go get -u github.com/Masterminds/glide && go get golang.org/x/tools/cmd/goimports && git clone https://github.com/mvdan/sh.git $GOPATH/src/mvdan.cc/sh && cd /go/src/mvdan.cc/sh/cmd/shfmt && git checkout v2.5.0 && go get mvdan.cc/sh/cmd/shfmt && go install && go get -u github.com/golang/mock/gomock && go get -u github.com/rmohr/mock/mockgen && go get -u github.com/rmohr/go-swagger-utils/swagger-doc && go get -u github.com/onsi/ginkgo/ginkgo && go get -u -d k8s.io/code-generator/cmd/deepcopy-gen && go get -u -d k8s.io/code-generator/cmd/defaulter-gen && go get -u -d k8s.io/code-generator/cmd/openapi-gen && cd /go/src/k8s.io/code-generator/cmd/deepcopy-gen && git checkout release-1.9 && go install && cd /go/src/k8s.io/code-generator/cmd/defaulter-gen && git checkout release-1.9 && go install && cd /go/src/k8s.io/code-generator/cmd/openapi-gen && git checkout release-1.9 && go install && go get -u -d github.com/golang/protobuf/protoc-gen-go && cd /go/src/github.com/golang/protobuf/protoc-gen-go && git checkout 1643683e1b54a9e88ad26d98f81400c8c9d9f4f9 && go install ---> Using cache ---> a36d9a9a5e01 Step 10/12 : RUN pip install j2cli ---> Using cache ---> 87206820d410 Step 11/12 : ADD entrypoint.sh /entrypoint.sh ---> Using cache ---> b3a27a114600 Step 12/12 : ENTRYPOINT /entrypoint.sh ---> Using cache ---> ceba12cbc33e Successfully built ceba12cbc33e go version go1.10 linux/amd64 go version go1.10 linux/amd64 find: '/root/go/src/kubevirt.io/kubevirt/_out/cmd': No such file or directory Compiling tests... compiled tests.test hack/build-docker.sh build Sending build context to Docker daemon 40.4 MB Step 1/8 : FROM fedora:28 ---> cc510acfcd70 Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 84920e004a40 Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virt-controller ---> Using cache ---> b4f3251c6468 Step 4/8 : WORKDIR /home/virt-controller ---> Using cache ---> 813752072d9d Step 5/8 : USER 1001 ---> Using cache ---> 88b3556f36b4 Step 6/8 : COPY virt-controller /usr/bin/virt-controller ---> d44aa6e1bc75 Removing intermediate container 0a86f5aa681c Step 7/8 : ENTRYPOINT /usr/bin/virt-controller ---> Running in f2dbd2d9afd0 ---> d8dbdbd1684e Removing intermediate container f2dbd2d9afd0 Step 8/8 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev1" '' "virt-controller" '' ---> Running in 0ac9a46eebcf ---> 5a86847821eb Removing intermediate container 0ac9a46eebcf Successfully built 5a86847821eb Sending build context to Docker daemon 43.32 MB Step 1/10 : FROM kubevirt/libvirt:4.2.0 ---> 5f0bfe81a3e0 Step 2/10 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 09010a005182 Step 3/10 : RUN dnf -y install socat genisoimage util-linux libcgroup-tools ethtool net-tools sudo && dnf -y clean all && test $(id -u qemu) = 107 # make sure that the qemu user really is 107 ---> Using cache ---> fc9481693838 Step 4/10 : COPY virt-launcher /usr/bin/virt-launcher ---> 83c9ac4a181f Removing intermediate container 2b9643f82d33 Step 5/10 : COPY kubevirt-sudo /etc/sudoers.d/kubevirt ---> 539f8e84ae46 Removing intermediate container c2337407d3ee Step 6/10 : RUN setcap CAP_NET_BIND_SERVICE=+eip /usr/bin/qemu-system-x86_64 ---> Running in ab004c019bbe  ---> 9e02e822a0f8 Removing intermediate container ab004c019bbe Step 7/10 : RUN mkdir -p /usr/share/kubevirt/virt-launcher ---> Running in 0f30c84f85f3  ---> b418daa52e99 Removing intermediate container 0f30c84f85f3 Step 8/10 : COPY entrypoint.sh libvirtd.sh sock-connector /usr/share/kubevirt/virt-launcher/ ---> 11a08fe5633b Removing intermediate container 39e597a8d8a1 Step 9/10 : ENTRYPOINT /usr/share/kubevirt/virt-launcher/entrypoint.sh ---> Running in 0b0ded3eac56 ---> e93a368d1522 Removing intermediate container 0b0ded3eac56 Step 10/10 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev1" '' "virt-launcher" '' ---> Running in 218df59d5cfa ---> 509c0de70537 Removing intermediate container 218df59d5cfa Successfully built 509c0de70537 Sending build context to Docker daemon 41.7 MB Step 1/5 : FROM fedora:28 ---> cc510acfcd70 Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 84920e004a40 Step 3/5 : COPY virt-handler /usr/bin/virt-handler ---> ad1a7f674082 Removing intermediate container 00918a284dd4 Step 4/5 : ENTRYPOINT /usr/bin/virt-handler ---> Running in aed18a0f621d ---> 227ae309ea18 Removing intermediate container aed18a0f621d Step 5/5 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev1" '' "virt-handler" '' ---> Running in be6720887b8b ---> d721ab9aed0b Removing intermediate container be6720887b8b Successfully built d721ab9aed0b Sending build context to Docker daemon 38.81 MB Step 1/8 : FROM fedora:28 ---> cc510acfcd70 Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 84920e004a40 Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virt-api ---> Using cache ---> 3cff23506e80 Step 4/8 : WORKDIR /home/virt-api ---> Using cache ---> e94c5606b96b Step 5/8 : USER 1001 ---> Using cache ---> af16317199f5 Step 6/8 : COPY virt-api /usr/bin/virt-api ---> f52d0acc4504 Removing intermediate container f044e58c5c61 Step 7/8 : ENTRYPOINT /usr/bin/virt-api ---> Running in d63fec7253f2 ---> 19356d375e38 Removing intermediate container d63fec7253f2 Step 8/8 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev1" '' "virt-api" '' ---> Running in 680aa926a697 ---> 46999c7a374d Removing intermediate container 680aa926a697 Successfully built 46999c7a374d Sending build context to Docker daemon 4.096 kB Step 1/7 : FROM fedora:28 ---> cc510acfcd70 Step 2/7 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 84920e004a40 Step 3/7 : ENV container docker ---> Using cache ---> aed3ca4ac3a3 Step 4/7 : RUN mkdir -p /images/custom /images/alpine && truncate -s 64M /images/custom/disk.img && curl http://dl-cdn.alpinelinux.org/alpine/v3.7/releases/x86_64/alpine-virt-3.7.0-x86_64.iso > /images/alpine/disk.img ---> Using cache ---> c7d0cf8fc982 Step 5/7 : ADD entrypoint.sh / ---> Using cache ---> 0393e5ee0c37 Step 6/7 : CMD /entrypoint.sh ---> Using cache ---> 23798f49dea3 Step 7/7 : LABEL "disks-images-provider" '' "kubevirt-functional-tests-k8s-1.11.0-dev1" '' ---> Using cache ---> 3ab858e83f5f Successfully built 3ab858e83f5f Sending build context to Docker daemon 2.56 kB Step 1/5 : FROM fedora:28 ---> cc510acfcd70 Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 84920e004a40 Step 3/5 : ENV container docker ---> Using cache ---> aed3ca4ac3a3 Step 4/5 : RUN dnf -y install procps-ng nmap-ncat && dnf -y clean all ---> Using cache ---> d8c990eaf575 Step 5/5 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev1" '' "vm-killer" '' ---> Using cache ---> fb39ada92bc4 Successfully built fb39ada92bc4 Sending build context to Docker daemon 5.12 kB Step 1/7 : FROM debian:sid ---> 68f33cf86aab Step 2/7 : MAINTAINER "David Vossel" \ ---> Using cache ---> 50fc79ebe51c Step 3/7 : ENV container docker ---> Using cache ---> b8e063496923 Step 4/7 : RUN apt-get update && apt-get install -y bash curl bzip2 qemu-utils && mkdir -p /disk && rm -rf /var/lib/apt/lists/* ---> Using cache ---> 8adb1572b35c Step 5/7 : ADD entry-point.sh / ---> Using cache ---> 8c0c5a52e4df Step 6/7 : CMD /entry-point.sh ---> Using cache ---> 1a4b838e5dee Step 7/7 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev1" '' "registry-disk-v1alpha" '' ---> Using cache ---> 2140dd571c2c Successfully built 2140dd571c2c Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33432/kubevirt/registry-disk-v1alpha:devel ---> 2140dd571c2c Step 2/4 : MAINTAINER "David Vossel" \ ---> Using cache ---> d03302a8d943 Step 3/4 : RUN curl https://download.cirros-cloud.net/0.4.0/cirros-0.4.0-x86_64-disk.img > /disk/cirros.img ---> Using cache ---> 43ba33b466fd Step 4/4 : LABEL "cirros-registry-disk-demo" '' "kubevirt-functional-tests-k8s-1.11.0-dev1" '' ---> Using cache ---> fcf6905c1d06 Successfully built fcf6905c1d06 Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33432/kubevirt/registry-disk-v1alpha:devel ---> 2140dd571c2c Step 2/4 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 4a89770d4a13 Step 3/4 : RUN curl -g -L https://download.fedoraproject.org/pub/fedora/linux/releases/27/CloudImages/x86_64/images/Fedora-Cloud-Base-27-1.6.x86_64.qcow2 > /disk/fedora.qcow2 ---> Using cache ---> 3db226e217b1 Step 4/4 : LABEL "fedora-cloud-registry-disk-demo" '' "kubevirt-functional-tests-k8s-1.11.0-dev1" '' ---> Using cache ---> d0936d988e80 Successfully built d0936d988e80 Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33432/kubevirt/registry-disk-v1alpha:devel ---> 2140dd571c2c Step 2/4 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 4a89770d4a13 Step 3/4 : RUN curl http://dl-cdn.alpinelinux.org/alpine/v3.7/releases/x86_64/alpine-virt-3.7.0-x86_64.iso > /disk/alpine.iso ---> Using cache ---> 5f6799836682 Step 4/4 : LABEL "alpine-registry-disk-demo" '' "kubevirt-functional-tests-k8s-1.11.0-dev1" '' ---> Using cache ---> 12c4e6a8d751 Successfully built 12c4e6a8d751 Sending build context to Docker daemon 35.59 MB Step 1/8 : FROM fedora:28 ---> cc510acfcd70 Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 84920e004a40 Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virtctl ---> Using cache ---> d74088d7a4fc Step 4/8 : WORKDIR /home/virtctl ---> Using cache ---> c8c857bf8d96 Step 5/8 : USER 1001 ---> Using cache ---> 36730a67b946 Step 6/8 : COPY subresource-access-test /subresource-access-test ---> 1ce2d34d6ab7 Removing intermediate container 62225c43b8a0 Step 7/8 : ENTRYPOINT /subresource-access-test ---> Running in 9cb457fe01fb ---> b2aecc00a910 Removing intermediate container 9cb457fe01fb Step 8/8 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev1" '' "subresource-access-test" '' ---> Running in b6c5b7204739 ---> 9d5c5e56fd09 Removing intermediate container b6c5b7204739 Successfully built 9d5c5e56fd09 Sending build context to Docker daemon 3.072 kB Step 1/9 : FROM fedora:28 ---> cc510acfcd70 Step 2/9 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 84920e004a40 Step 3/9 : ENV container docker ---> Using cache ---> aed3ca4ac3a3 Step 4/9 : RUN dnf -y install make git gcc && dnf -y clean all ---> Using cache ---> 6050b24a5d85 Step 5/9 : ENV GIMME_GO_VERSION 1.9.2 ---> Using cache ---> 0447d2178073 Step 6/9 : RUN mkdir -p /gimme && curl -sL https://raw.githubusercontent.com/travis-ci/gimme/master/gimme | HOME=/gimme bash >> /etc/profile.d/gimme.sh ---> Using cache ---> 291db82d955f Step 7/9 : ENV GOPATH "/go" GOBIN "/usr/bin" ---> Using cache ---> 793556477837 Step 8/9 : RUN mkdir -p /go && source /etc/profile.d/gimme.sh && go get github.com/masterzen/winrm-cli ---> Using cache ---> fd5c6e1f9461 Step 9/9 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev1" '' "winrmcli" '' ---> Using cache ---> 0e3c88ca2e2b Successfully built 0e3c88ca2e2b Sending build context to Docker daemon 36.8 MB Step 1/5 : FROM fedora:27 ---> 9110ae7f579f Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 71a8c548e503 Step 3/5 : COPY example-hook-sidecar /example-hook-sidecar ---> f28b6677bd6d Removing intermediate container 7e738138ac2b Step 4/5 : ENTRYPOINT /example-hook-sidecar ---> Running in a3aa34e72944 ---> f380757b5733 Removing intermediate container a3aa34e72944 Step 5/5 : LABEL "example-hook-sidecar" '' "kubevirt-functional-tests-k8s-1.11.0-dev1" '' ---> Running in b88e918dcef3 ---> c82cbe3bc9a8 Removing intermediate container b88e918dcef3 Successfully built c82cbe3bc9a8 hack/build-docker.sh push The push refers to a repository [localhost:33432/kubevirt/virt-controller] 0123450213a5: Preparing b2f5abdac324: Preparing 891e1e4ef82a: Preparing b2f5abdac324: Pushed 0123450213a5: Pushed 891e1e4ef82a: Pushed devel: digest: sha256:4197eb73941d1a4acaeb70aca9097c0fb9b7e43aaf20b27f3a03288ab5a5deae size: 949 The push refers to a repository [localhost:33432/kubevirt/virt-launcher] 0f1081c3bc82: Preparing 887b69d60399: Preparing e645a9c7c836: Preparing 6e40f43f745a: Preparing ee6f9bf5c78e: Preparing 0b99c4111657: Preparing da38cf808aa5: Preparing b83399358a92: Preparing 186d8b3e4fd8: Preparing fa6154170bf5: Preparing 5eefb9960a36: Preparing 891e1e4ef82a: Preparing 0b99c4111657: Waiting da38cf808aa5: Waiting b83399358a92: Waiting 186d8b3e4fd8: Waiting fa6154170bf5: Waiting 5eefb9960a36: Waiting 891e1e4ef82a: Waiting 0f1081c3bc82: Pushed 887b69d60399: Pushed 6e40f43f745a: Pushed da38cf808aa5: Pushed b83399358a92: Pushed 186d8b3e4fd8: Pushed fa6154170bf5: Pushed 891e1e4ef82a: Mounted from kubevirt/virt-controller e645a9c7c836: Pushed ee6f9bf5c78e: Pushed 0b99c4111657: Pushed 5eefb9960a36: Pushed devel: digest: sha256:306ee289d3ea8eafb7e586a0b03960934b0351b39a267e8920415797bbda6226 size: 2828 The push refers to a repository [localhost:33432/kubevirt/virt-handler] 2ac4ec09dfdd: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/virt-launcher 2ac4ec09dfdd: Pushed devel: digest: sha256:2ed3649ac514f52258424eaf94c17648482ab81f25717ebfa24b94f188099631 size: 741 The push refers to a repository [localhost:33432/kubevirt/virt-api] c81e7e5111ce: Preparing afd1d781e4d1: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/virt-handler afd1d781e4d1: Pushed c81e7e5111ce: Pushed devel: digest: sha256:c9461e8968cafb733000146c33aa33c2d332a07bff15e8bd57b7811e0eb6c76c size: 948 The push refers to a repository [localhost:33432/kubevirt/disks-images-provider] dc0875c44573: Preparing 8fc77a44094f: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/virt-api dc0875c44573: Pushed 8fc77a44094f: Pushed devel: digest: sha256:4adc82f44c4222228a7930ac68eb940135861f3b390df82fd493b34719b17395 size: 948 The push refers to a repository [localhost:33432/kubevirt/vm-killer] d1b69e768421: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/disks-images-provider d1b69e768421: Pushed devel: digest: sha256:9b400d02d2dbdfef19c1ee9350810756f6c48311b8da49e6039ea6c9741880c3 size: 740 The push refers to a repository [localhost:33432/kubevirt/registry-disk-v1alpha] 2a15632f54d4: Preparing 91a924e03d7c: Preparing 25edbec0eaea: Preparing 2a15632f54d4: Pushed 91a924e03d7c: Pushed 25edbec0eaea: Pushed devel: digest: sha256:ae9e3df36ecb8ff92369c1528e51201145f53db9cfec2a501af171073fd84c7f size: 948 The push refers to a repository [localhost:33432/kubevirt/cirros-registry-disk-demo] 0f38e1a82d29: Preparing 2a15632f54d4: Preparing 91a924e03d7c: Preparing 25edbec0eaea: Preparing 2a15632f54d4: Mounted from kubevirt/registry-disk-v1alpha 91a924e03d7c: Mounted from kubevirt/registry-disk-v1alpha 25edbec0eaea: Mounted from kubevirt/registry-disk-v1alpha 0f38e1a82d29: Pushed devel: digest: sha256:e83cc3d9bf9f3b13808d5188261f0084bd175e682d95bb97c9db361b46bcf357 size: 1160 The push refers to a repository [localhost:33432/kubevirt/fedora-cloud-registry-disk-demo] da380ddf255b: Preparing 2a15632f54d4: Preparing 91a924e03d7c: Preparing 25edbec0eaea: Preparing 91a924e03d7c: Mounted from kubevirt/cirros-registry-disk-demo 2a15632f54d4: Mounted from kubevirt/cirros-registry-disk-demo 25edbec0eaea: Mounted from kubevirt/cirros-registry-disk-demo da380ddf255b: Pushed devel: digest: sha256:9a614c3b8040fbe500365278ad22fe8cebae250cfb6ba1530a6720a8fdf2c09e size: 1161 The push refers to a repository [localhost:33432/kubevirt/alpine-registry-disk-demo] 0934ac235ed3: Preparing 2a15632f54d4: Preparing 91a924e03d7c: Preparing 25edbec0eaea: Preparing 91a924e03d7c: Mounted from kubevirt/fedora-cloud-registry-disk-demo 25edbec0eaea: Mounted from kubevirt/fedora-cloud-registry-disk-demo 2a15632f54d4: Mounted from kubevirt/fedora-cloud-registry-disk-demo 0934ac235ed3: Pushed devel: digest: sha256:5e9e64016614776b436c406762d17b93e3130a8cc871807185f08c900812cb8b size: 1160 The push refers to a repository [localhost:33432/kubevirt/subresource-access-test] b12aeb64909f: Preparing 4052ce9d0aff: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/vm-killer 4052ce9d0aff: Pushed b12aeb64909f: Pushed devel: digest: sha256:f6d52ab2f71f3ecc2654a948f5e7737a74f545ffad61e270356cfa5581e64dce size: 948 The push refers to a repository [localhost:33432/kubevirt/winrmcli] 64ccc7ac4271: Preparing 4242962b50c3: Preparing 0e374d8c733e: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Waiting 891e1e4ef82a: Mounted from kubevirt/subresource-access-test 64ccc7ac4271: Pushed 0e374d8c733e: Pushed 4242962b50c3: Pushed devel: digest: sha256:9839cdf62d05a776b476afdcbe481598849b063d8ca01f053ee8d2dc682fc124 size: 1165 The push refers to a repository [localhost:33432/kubevirt/example-hook-sidecar] 6d079f64a400: Preparing 39bae602f753: Preparing 6d079f64a400: Pushed 39bae602f753: Pushed devel: digest: sha256:2f5523bf095eaa0e62de3dba976c7e43312d6b1a015023d0458ec2d5e38d4b50 size: 740 make[1]: Leaving directory `/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt' Done ./cluster/clean.sh + source hack/common.sh ++++ dirname 'hack/common.sh[0]' +++ cd hack/../ +++ pwd ++ KUBEVIRT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt ++ OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out ++ VENDOR_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/vendor ++ CMD_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/cmd ++ TESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/tests ++ APIDOCS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/apidocs ++ MANIFESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/manifests ++ MANIFEST_TEMPLATES_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/templates/manifests ++ PYTHON_CLIENT_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/client-python ++ KUBEVIRT_PROVIDER=k8s-1.11.0 ++ KUBEVIRT_NUM_NODES=2 ++ '[' -z kubevirt-functional-tests-k8s-1.11.0-dev ']' ++ provider_prefix=kubevirt-functional-tests-k8s-1.11.0-dev1 ++ job_prefix=kubevirt-functional-tests-k8s-1.11.0-dev1 +++ kubevirt_version +++ '[' -n '' ']' +++ '[' -d /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/.git ']' ++++ git describe --always --tags +++ echo v0.7.0-200-g25fa194 ++ KUBEVIRT_VERSION=v0.7.0-200-g25fa194 + source cluster/k8s-1.11.0/provider.sh ++ set -e ++ image=k8s-1.11.0@sha256:6c1caf5559eb02a144bf606de37eb0194c06ace4d77ad4561459f3bde876151c ++ source cluster/ephemeral-provider-common.sh +++ set -e +++ _cli='docker run --privileged --net=host --rm -v /var/run/docker.sock:/var/run/docker.sock kubevirtci/gocli@sha256:aa7f295a7908fa333ab5e98ef3af0bfafbabfd3cee2b83f9af47f722e3000f6a' + source hack/config.sh ++ unset binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig manifest_docker_prefix namespace image_pull_policy ++ KUBEVIRT_PROVIDER=k8s-1.11.0 ++ source hack/config-default.sh source hack/config-k8s-1.11.0.sh +++ binaries='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virtctl cmd/fake-qemu-process cmd/virt-api cmd/subresource-access-test cmd/example-hook-sidecar' +++ docker_images='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virt-api images/disks-images-provider images/vm-killer cmd/registry-disk-v1alpha images/cirros-registry-disk-demo images/fedora-cloud-registry-disk-demo images/alpine-registry-disk-demo cmd/subresource-access-test images/winrmcli cmd/example-hook-sidecar' +++ docker_prefix=kubevirt +++ docker_tag=latest +++ master_ip=192.168.200.2 +++ network_provider=flannel +++ namespace=kube-system +++ image_pull_policy=IfNotPresent ++ test -f hack/config-provider-k8s-1.11.0.sh ++ source hack/config-provider-k8s-1.11.0.sh +++ master_ip=127.0.0.1 +++ docker_tag=devel +++ kubeconfig=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/cluster/k8s-1.11.0/.kubeconfig +++ kubectl=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/cluster/k8s-1.11.0/.kubectl +++ docker_prefix=localhost:33432/kubevirt +++ manifest_docker_prefix=registry:5000/kubevirt ++ test -f hack/config-local.sh ++ export binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig namespace image_pull_policy + echo 'Cleaning up ...' Cleaning up ... + cluster/kubectl.sh get vmis --all-namespaces -o=custom-columns=NAME:.metadata.name,NAMESPACE:.metadata.namespace,FINALIZERS:.metadata.finalizers --no-headers + grep foregroundDeleteVirtualMachine + read p error: the server doesn't have a resource type "vmis" + _kubectl delete ds -l kubevirt.io -n kube-system --cascade=false --grace-period 0 No resources found + _kubectl delete pods -n kube-system -l=kubevirt.io=libvirt --force --grace-period 0 No resources found + _kubectl delete pods -n kube-system -l=kubevirt.io=virt-handler --force --grace-period 0 No resources found + namespaces=(default ${namespace}) + for i in '${namespaces[@]}' + _kubectl -n default delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete apiservices -l kubevirt.io No resources found + _kubectl -n default delete deployment -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete deployment -l kubevirt.io No resources found + _kubectl -n default delete rs -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete rs -l kubevirt.io No resources found + _kubectl -n default delete services -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete services -l kubevirt.io No resources found + _kubectl -n default delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete apiservices -l kubevirt.io No resources found + _kubectl -n default delete validatingwebhookconfiguration -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete validatingwebhookconfiguration -l kubevirt.io No resources found + _kubectl -n default delete secrets -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete secrets -l kubevirt.io No resources found + _kubectl -n default delete pv -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete pv -l kubevirt.io No resources found + _kubectl -n default delete pvc -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete pvc -l kubevirt.io No resources found + _kubectl -n default delete ds -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete ds -l kubevirt.io No resources found + _kubectl -n default delete customresourcedefinitions -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete customresourcedefinitions -l kubevirt.io No resources found + _kubectl -n default delete pods -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete pods -l kubevirt.io No resources found + _kubectl -n default delete clusterrolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete clusterrolebinding -l kubevirt.io No resources found + _kubectl -n default delete rolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete rolebinding -l kubevirt.io No resources found + _kubectl -n default delete roles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete roles -l kubevirt.io No resources found + _kubectl -n default delete clusterroles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete clusterroles -l kubevirt.io No resources found + _kubectl -n default delete serviceaccounts -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete serviceaccounts -l kubevirt.io No resources found ++ _kubectl -n default get crd offlinevirtualmachines.kubevirt.io ++ export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig ++ KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig ++ cluster/k8s-1.11.0/.kubectl -n default get crd offlinevirtualmachines.kubevirt.io ++ wc -l No resources found. Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "offlinevirtualmachines.kubevirt.io" not found + '[' 0 -gt 0 ']' + for i in '${namespaces[@]}' + _kubectl -n kube-system delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete apiservices -l kubevirt.io No resources found + _kubectl -n kube-system delete deployment -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete deployment -l kubevirt.io No resources found + _kubectl -n kube-system delete rs -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete rs -l kubevirt.io No resources found + _kubectl -n kube-system delete services -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete services -l kubevirt.io No resources found + _kubectl -n kube-system delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete apiservices -l kubevirt.io No resources found + _kubectl -n kube-system delete validatingwebhookconfiguration -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete validatingwebhookconfiguration -l kubevirt.io No resources found + _kubectl -n kube-system delete secrets -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete secrets -l kubevirt.io No resources found + _kubectl -n kube-system delete pv -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete pv -l kubevirt.io No resources found + _kubectl -n kube-system delete pvc -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete pvc -l kubevirt.io No resources found + _kubectl -n kube-system delete ds -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete ds -l kubevirt.io No resources found + _kubectl -n kube-system delete customresourcedefinitions -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete customresourcedefinitions -l kubevirt.io No resources found + _kubectl -n kube-system delete pods -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete pods -l kubevirt.io No resources found + _kubectl -n kube-system delete clusterrolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete clusterrolebinding -l kubevirt.io No resources found + _kubectl -n kube-system delete rolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete rolebinding -l kubevirt.io No resources found + _kubectl -n kube-system delete roles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete roles -l kubevirt.io No resources found + _kubectl -n kube-system delete clusterroles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete clusterroles -l kubevirt.io No resources found + _kubectl -n kube-system delete serviceaccounts -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete serviceaccounts -l kubevirt.io No resources found ++ _kubectl -n kube-system get crd offlinevirtualmachines.kubevirt.io ++ wc -l ++ export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig ++ KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig ++ cluster/k8s-1.11.0/.kubectl -n kube-system get crd offlinevirtualmachines.kubevirt.io No resources found. Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "offlinevirtualmachines.kubevirt.io" not found + '[' 0 -gt 0 ']' + sleep 2 + echo Done Done ./cluster/deploy.sh + source hack/common.sh ++++ dirname 'hack/common.sh[0]' +++ cd hack/../ +++ pwd ++ KUBEVIRT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt ++ OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out ++ VENDOR_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/vendor ++ CMD_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/cmd ++ TESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/tests ++ APIDOCS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/apidocs ++ MANIFESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/manifests ++ MANIFEST_TEMPLATES_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/templates/manifests ++ PYTHON_CLIENT_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/client-python ++ KUBEVIRT_PROVIDER=k8s-1.11.0 ++ KUBEVIRT_NUM_NODES=2 ++ '[' -z kubevirt-functional-tests-k8s-1.11.0-dev ']' ++ provider_prefix=kubevirt-functional-tests-k8s-1.11.0-dev1 ++ job_prefix=kubevirt-functional-tests-k8s-1.11.0-dev1 +++ kubevirt_version +++ '[' -n '' ']' +++ '[' -d /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/.git ']' ++++ git describe --always --tags +++ echo v0.7.0-200-g25fa194 ++ KUBEVIRT_VERSION=v0.7.0-200-g25fa194 + source cluster/k8s-1.11.0/provider.sh ++ set -e ++ image=k8s-1.11.0@sha256:6c1caf5559eb02a144bf606de37eb0194c06ace4d77ad4561459f3bde876151c ++ source cluster/ephemeral-provider-common.sh +++ set -e +++ _cli='docker run --privileged --net=host --rm -v /var/run/docker.sock:/var/run/docker.sock kubevirtci/gocli@sha256:aa7f295a7908fa333ab5e98ef3af0bfafbabfd3cee2b83f9af47f722e3000f6a' + source hack/config.sh ++ unset binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig manifest_docker_prefix namespace image_pull_policy ++ KUBEVIRT_PROVIDER=k8s-1.11.0 ++ source hack/config-default.sh source hack/config-k8s-1.11.0.sh +++ binaries='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virtctl cmd/fake-qemu-process cmd/virt-api cmd/subresource-access-test cmd/example-hook-sidecar' +++ docker_images='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virt-api images/disks-images-provider images/vm-killer cmd/registry-disk-v1alpha images/cirros-registry-disk-demo images/fedora-cloud-registry-disk-demo images/alpine-registry-disk-demo cmd/subresource-access-test images/winrmcli cmd/example-hook-sidecar' +++ docker_prefix=kubevirt +++ docker_tag=latest +++ master_ip=192.168.200.2 +++ network_provider=flannel +++ namespace=kube-system +++ image_pull_policy=IfNotPresent ++ test -f hack/config-provider-k8s-1.11.0.sh ++ source hack/config-provider-k8s-1.11.0.sh +++ master_ip=127.0.0.1 +++ docker_tag=devel +++ kubeconfig=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/cluster/k8s-1.11.0/.kubeconfig +++ kubectl=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/cluster/k8s-1.11.0/.kubectl +++ docker_prefix=localhost:33432/kubevirt +++ manifest_docker_prefix=registry:5000/kubevirt ++ test -f hack/config-local.sh ++ export binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig namespace image_pull_policy + echo 'Deploying ...' Deploying ... + [[ -z k8s-1.11.0-dev ]] + [[ k8s-1.11.0-dev =~ .*-dev ]] + _kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/manifests/dev -R + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/manifests/dev -R serviceaccount/kubevirt-apiserver created clusterrolebinding.rbac.authorization.k8s.io/kubevirt-apiserver created clusterrolebinding.rbac.authorization.k8s.io/kubevirt-apiserver-auth-delegator created rolebinding.rbac.authorization.k8s.io/kubevirt-apiserver created role.rbac.authorization.k8s.io/kubevirt-apiserver created clusterrole.rbac.authorization.k8s.io/kubevirt-apiserver created clusterrole.rbac.authorization.k8s.io/kubevirt-controller created serviceaccount/kubevirt-controller created serviceaccount/kubevirt-privileged created clusterrolebinding.rbac.authorization.k8s.io/kubevirt-controller created clusterrolebinding.rbac.authorization.k8s.io/kubevirt-controller-cluster-admin created clusterrolebinding.rbac.authorization.k8s.io/kubevirt-privileged-cluster-admin created clusterrole.rbac.authorization.k8s.io/kubevirt.io:admin created clusterrole.rbac.authorization.k8s.io/kubevirt.io:edit created clusterrole.rbac.authorization.k8s.io/kubevirt.io:view created clusterrole.rbac.authorization.k8s.io/kubevirt.io:default created clusterrolebinding.rbac.authorization.k8s.io/kubevirt.io:default created customresourcedefinition.apiextensions.k8s.io/virtualmachineinstancereplicasets.kubevirt.io created service/virt-api created deployment.extensions/virt-api created service/virt-controller created deployment.extensions/virt-controller created daemonset.extensions/virt-handler created customresourcedefinition.apiextensions.k8s.io/virtualmachines.kubevirt.io created customresourcedefinition.apiextensions.k8s.io/virtualmachineinstances.kubevirt.io created customresourcedefinition.apiextensions.k8s.io/virtualmachineinstancepresets.kubevirt.io created + _kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/manifests/testing -R + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/manifests/testing -R persistentvolumeclaim/disk-alpine created persistentvolume/host-path-disk-alpine created persistentvolumeclaim/disk-custom created persistentvolume/host-path-disk-custom created daemonset.extensions/disks-images-provider created serviceaccount/kubevirt-testing created clusterrolebinding.rbac.authorization.k8s.io/kubevirt-testing-cluster-admin created + [[ k8s-1.11.0 =~ os-* ]] + echo Done Done + namespaces=(kube-system default) + [[ kube-system != \k\u\b\e\-\s\y\s\t\e\m ]] + timeout=300 + sample=30 + for i in '${namespaces[@]}' + current_time=0 ++ kubectl get pods -n kube-system --no-headers ++ cluster/kubectl.sh get pods -n kube-system --no-headers ++ grep -v Running + '[' -n 'virt-api-7d79975b94-lqc2d 0/1 ContainerCreating 0 2s virt-controller-67dcdd8464-9bb4x 0/1 ContainerCreating 0 2s virt-controller-67dcdd8464-j4f48 0/1 ContainerCreating 0 2s virt-handler-6h725 0/1 ContainerCreating 0 1s virt-handler-9ppmp 0/1 ContainerCreating 0 1s' ']' + echo 'Waiting for kubevirt pods to enter the Running state ...' Waiting for kubevirt pods to enter the Running state ... + kubectl get pods -n kube-system --no-headers + cluster/kubectl.sh get pods -n kube-system --no-headers + grep -v Running virt-api-7d79975b94-lqc2d 0/1 ContainerCreating 0 2s virt-controller-67dcdd8464-9bb4x 0/1 ContainerCreating 0 2s virt-controller-67dcdd8464-j4f48 0/1 ContainerCreating 0 2s virt-handler-6h725 0/1 ContainerCreating 0 1s virt-handler-9ppmp 0/1 ContainerCreating 0 1s + sleep 30 + current_time=30 + '[' 30 -gt 300 ']' ++ kubectl get pods -n kube-system --no-headers ++ grep -v Running ++ cluster/kubectl.sh get pods -n kube-system --no-headers + '[' -n '' ']' + current_time=0 ++ kubectl get pods -n kube-system '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers ++ cluster/kubectl.sh get pods -n kube-system '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers ++ grep false + '[' -n '' ']' + kubectl get pods -n kube-system + cluster/kubectl.sh get pods -n kube-system NAME READY STATUS RESTARTS AGE coredns-78fcdf6894-9f5gj 1/1 Running 0 8m coredns-78fcdf6894-bcv9v 1/1 Running 0 8m disks-images-provider-76k5d 1/1 Running 0 31s disks-images-provider-fcxmf 1/1 Running 0 30s etcd-node01 1/1 Running 0 7m kube-apiserver-node01 1/1 Running 0 7m kube-controller-manager-node01 1/1 Running 0 7m kube-flannel-ds-fq5lm 1/1 Running 0 8m kube-flannel-ds-hdhv6 1/1 Running 0 8m kube-proxy-d5ddd 1/1 Running 0 8m kube-proxy-d8vsn 1/1 Running 0 8m kube-scheduler-node01 1/1 Running 0 7m virt-api-7d79975b94-lqc2d 1/1 Running 0 33s virt-controller-67dcdd8464-9bb4x 1/1 Running 0 33s virt-controller-67dcdd8464-j4f48 1/1 Running 0 33s virt-handler-6h725 1/1 Running 0 32s virt-handler-9ppmp 1/1 Running 0 32s + for i in '${namespaces[@]}' + current_time=0 ++ kubectl get pods -n default --no-headers ++ cluster/kubectl.sh get pods -n default --no-headers ++ grep -v Running + '[' -n '' ']' + current_time=0 ++ kubectl get pods -n default '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers ++ grep false ++ cluster/kubectl.sh get pods -n default '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers + '[' -n '' ']' + kubectl get pods -n default + cluster/kubectl.sh get pods -n default NAME READY STATUS RESTARTS AGE local-volume-provisioner-6799m 1/1 Running 0 8m local-volume-provisioner-rcq4m 1/1 Running 0 8m + kubectl version + cluster/kubectl.sh version Client Version: version.Info{Major:"1", Minor:"11", GitVersion:"v1.11.0", GitCommit:"91e7b4fd31fcd3d5f436da26c980becec37ceefe", GitTreeState:"clean", BuildDate:"2018-06-27T20:17:28Z", GoVersion:"go1.10.2", Compiler:"gc", Platform:"linux/amd64"} Server Version: version.Info{Major:"1", Minor:"11", GitVersion:"v1.11.0", GitCommit:"91e7b4fd31fcd3d5f436da26c980becec37ceefe", GitTreeState:"clean", BuildDate:"2018-06-27T20:08:34Z", GoVersion:"go1.10.2", Compiler:"gc", Platform:"linux/amd64"} + ginko_params='--ginkgo.noColor --junit-output=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/junit.xml' + [[ k8s-1.11.0-dev =~ windows.* ]] + FUNC_TEST_ARGS='--ginkgo.noColor --junit-output=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/junit.xml' + make functest hack/dockerized "hack/build-func-tests.sh" Sending build context to Docker daemon 5.632 kB Step 1/12 : FROM fedora:28 ---> cc510acfcd70 Step 2/12 : ENV LIBVIRT_VERSION 4.2.0 ---> Using cache ---> 2c20d91d48e6 Step 3/12 : RUN curl --output /etc/yum.repos.d/fedora-virt-preview.repo https://fedorapeople.org/groups/virt/virt-preview/fedora-virt-preview.repo ---> Using cache ---> b7c63cc1ff31 Step 4/12 : RUN dnf -y install libvirt-devel-${LIBVIRT_VERSION} make git mercurial sudo gcc findutils gradle rsync-daemon rsync qemu-img protobuf-compiler && dnf -y clean all ---> Using cache ---> 784786580231 Step 5/12 : ENV GIMME_GO_VERSION 1.10 ---> Using cache ---> e6c3df647782 Step 6/12 : RUN mkdir -p /gimme && curl -sL https://raw.githubusercontent.com/travis-ci/gimme/master/gimme | HOME=/gimme bash >> /etc/profile.d/gimme.sh ---> Using cache ---> aa4d2ed226ed Step 7/12 : ENV GOPATH "/go" GOBIN "/usr/bin" ---> Using cache ---> 9d8471eeeed9 Step 8/12 : ADD rsyncd.conf /etc/rsyncd.conf ---> Using cache ---> 35522f6166d0 Step 9/12 : RUN mkdir -p /go && source /etc/profile.d/gimme.sh && go get github.com/mattn/goveralls && go get -u github.com/Masterminds/glide && go get golang.org/x/tools/cmd/goimports && git clone https://github.com/mvdan/sh.git $GOPATH/src/mvdan.cc/sh && cd /go/src/mvdan.cc/sh/cmd/shfmt && git checkout v2.5.0 && go get mvdan.cc/sh/cmd/shfmt && go install && go get -u github.com/golang/mock/gomock && go get -u github.com/rmohr/mock/mockgen && go get -u github.com/rmohr/go-swagger-utils/swagger-doc && go get -u github.com/onsi/ginkgo/ginkgo && go get -u -d k8s.io/code-generator/cmd/deepcopy-gen && go get -u -d k8s.io/code-generator/cmd/defaulter-gen && go get -u -d k8s.io/code-generator/cmd/openapi-gen && cd /go/src/k8s.io/code-generator/cmd/deepcopy-gen && git checkout release-1.9 && go install && cd /go/src/k8s.io/code-generator/cmd/defaulter-gen && git checkout release-1.9 && go install && cd /go/src/k8s.io/code-generator/cmd/openapi-gen && git checkout release-1.9 && go install && go get -u -d github.com/golang/protobuf/protoc-gen-go && cd /go/src/github.com/golang/protobuf/protoc-gen-go && git checkout 1643683e1b54a9e88ad26d98f81400c8c9d9f4f9 && go install ---> Using cache ---> a36d9a9a5e01 Step 10/12 : RUN pip install j2cli ---> Using cache ---> 87206820d410 Step 11/12 : ADD entrypoint.sh /entrypoint.sh ---> Using cache ---> b3a27a114600 Step 12/12 : ENTRYPOINT /entrypoint.sh ---> Using cache ---> ceba12cbc33e Successfully built ceba12cbc33e go version go1.10 linux/amd64 Waiting for rsyncd to be ready. go version go1.10 linux/amd64 Compiling tests... compiled tests.test hack/functests.sh Running Suite: Tests Suite ========================== Random Seed: 1533665139 Will run 151 of 151 specs • [SLOW TEST:71.481 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 with Alpine PVC /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:71 should be successfully started /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 with Disk PVC /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:53.310 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 with Alpine PVC /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:71 should be successfully started /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 with CDRom PVC /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:171.924 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 with Alpine PVC /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:71 should be successfully started and stopped multiple times /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 with Disk PVC /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:165.551 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 with Alpine PVC /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:71 should be successfully started and stopped multiple times /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 with CDRom PVC /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running level=info timestamp=2018-08-07T18:15:34.917582Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:15:36.170394Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:15:38 http: TLS handshake error from 10.244.1.1:51482: EOF level=info timestamp=2018-08-07T18:15:40.594351Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:15:48 http: TLS handshake error from 10.244.1.1:51488: EOF level=info timestamp=2018-08-07T18:15:58.341293Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:15:58 http: TLS handshake error from 10.244.1.1:51494: EOF level=info timestamp=2018-08-07T18:15:58.802619Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:16:04.921251Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:16:06.199821Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:16:08 http: TLS handshake error from 10.244.1.1:51500: EOF level=info timestamp=2018-08-07T18:16:09.954694Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:16:09.955829Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:16:10.647727Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:16:18 http: TLS handshake error from 10.244.1.1:51506: EOF Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T18:08:36.924658Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij7d2hb6n5vmcztxllgxld74w27brzfkgk99ksrkcsh2c952zwz544mrr8tm4snw kind= uid=e7b1f795-9a6c-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:09:17.078895Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij7d2hb6n5vmcztxllgxld74w27brzfkgk99ksrkcsh2c952zwz544mrr8tm4snw kind= uid=ffa136ab-9a6c-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:09:17.080613Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij7d2hb6n5vmcztxllgxld74w27brzfkgk99ksrkcsh2c952zwz544mrr8tm4snw kind= uid=ffa136ab-9a6c-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:09:17.157967Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij7d2hb6n5vmcztxllgxld74w27brzfkgk99ksrkcsh2c952zwz544mrr8tm4snw\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij7d2hb6n5vmcztxllgxld74w27brzfkgk99ksrkcsh2c952zwz544mrr8tm4snw" level=info timestamp=2018-08-07T18:10:41.122299Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=31b91e6d-9a6d-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:10:41.123592Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=31b91e6d-9a6d-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:10:41.165607Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc" level=info timestamp=2018-08-07T18:11:17.451181Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=475ed36c-9a6d-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:11:17.452186Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=475ed36c-9a6d-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:11:56.399263Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=5e9759bb-9a6d-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:11:56.401106Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=5e9759bb-9a6d-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:11:56.457299Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc" level=info timestamp=2018-08-07T18:13:26.681443Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi569ssksk2zzr9v84bx8ldh8wrrb4m2crz92wxkz7wzm6rq55dcffj9jv7z7dnbp kind= uid=9465bb31-9a6d-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:13:26.682711Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi569ssksk2zzr9v84bx8ldh8wrrb4m2crz92wxkz7wzm6rq55dcffj9jv7z7dnbp kind= uid=9465bb31-9a6d-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:13:26.803517Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi569ssksk2zzr9v84bx8ldh8wrrb4m2crz92wxkz7wzm6rq55dcffj9jv7z7dnbp\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi569ssksk2zzr9v84bx8ldh8wrrb4m2crz92wxkz7wzm6rq55dcffj9jv7z7dnbp" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:12:48.114100Z pos=vm.go:390 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=5e9759bb-9a6d-11e8-8d82-525500d15501 msg="Removing domain and ephemeral data for finalized vmi." level=info timestamp=2018-08-07T18:12:48.114125Z pos=vm.go:417 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=5e9759bb-9a6d-11e8-8d82-525500d15501 msg="Processing deletion." level=info timestamp=2018-08-07T18:12:48.115672Z pos=vm.go:588 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=5e9759bb-9a6d-11e8-8d82-525500d15501 msg="Signaled deletion for testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc" level=info timestamp=2018-08-07T18:12:48.120800Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=5e9759bb-9a6d-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:13:26.118390Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc, existing: false\n" level=info timestamp=2018-08-07T18:13:26.118627Z pos=vm.go:336 component=virt-handler msg="Domain: existing: true\n" level=info timestamp=2018-08-07T18:13:26.118653Z pos=vm.go:338 component=virt-handler msg="Domain status: Shutoff, reason: Destroyed\n" level=info timestamp=2018-08-07T18:13:26.118756Z pos=vm.go:365 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-08-07T18:13:26.118785Z pos=vm.go:417 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind=VirtualMachineInstance uid= msg="Processing deletion." level=info timestamp=2018-08-07T18:13:26.119048Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:13:41.569718Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:13:41.570772Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc, existing: false\n" level=info timestamp=2018-08-07T18:13:41.570814Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:13:41.570884Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:13:41.571000Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi569ssksk2zzr9v84bx8ldh8wrrb4m2crz92wxpvmmq Pod phase: Pending level=info timestamp=2018-08-07T18:13:31.453411Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:13:31.453684Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:13:31.456013Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:13:41.475336Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:13:42.047740Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi569ssksk2zzr9v84bx8ldh8wrrb4m2crz92wxkz7wzm6rq55dcffj9jv7z7dnbp" level=info timestamp=2018-08-07T18:13:42.049772Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:13:42.049943Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.326 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 With an emptyDisk defined /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:113 should create a writeable emptyDisk with the right capacity [It] /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:115 Timed out after 90.015s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1088 ------------------------------ STEP: Starting a VirtualMachineInstance STEP: Waiting until the VirtualMachineInstance will start level=info timestamp=2018-08-07T18:13:26.935776Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi569ssksk2zzr9v84bx8ldh8wrrb4m2crz92wxkz7wzm6rq55dcffj9jv7z7dnbp kind=VirtualMachineInstance uid=9465bb31-9a6d-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi569ssksk2zzr9v84bx8ldh8wrrb4m2crz92wxpvmmq" Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running 2018/08/07 18:18:28 http: TLS handshake error from 10.244.1.1:51584: EOF level=info timestamp=2018-08-07T18:18:29.063817Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:18:34.915780Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:18:36.302462Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:18:38 http: TLS handshake error from 10.244.1.1:51590: EOF level=info timestamp=2018-08-07T18:18:40.924335Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:18:48 http: TLS handshake error from 10.244.1.1:51596: EOF 2018/08/07 18:18:58 http: TLS handshake error from 10.244.1.1:51602: EOF level=info timestamp=2018-08-07T18:18:58.652636Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:18:59.116250Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:19:04.908312Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:19:06.326216Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:19:08 http: TLS handshake error from 10.244.1.1:51608: EOF level=info timestamp=2018-08-07T18:19:10.978360Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:19:18 http: TLS handshake error from 10.244.1.1:51614: EOF Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T18:09:17.080613Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij7d2hb6n5vmcztxllgxld74w27brzfkgk99ksrkcsh2c952zwz544mrr8tm4snw kind= uid=ffa136ab-9a6c-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:09:17.157967Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij7d2hb6n5vmcztxllgxld74w27brzfkgk99ksrkcsh2c952zwz544mrr8tm4snw\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij7d2hb6n5vmcztxllgxld74w27brzfkgk99ksrkcsh2c952zwz544mrr8tm4snw" level=info timestamp=2018-08-07T18:10:41.122299Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=31b91e6d-9a6d-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:10:41.123592Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=31b91e6d-9a6d-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:10:41.165607Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc" level=info timestamp=2018-08-07T18:11:17.451181Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=475ed36c-9a6d-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:11:17.452186Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=475ed36c-9a6d-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:11:56.399263Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=5e9759bb-9a6d-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:11:56.401106Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=5e9759bb-9a6d-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:11:56.457299Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc" level=info timestamp=2018-08-07T18:13:26.681443Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi569ssksk2zzr9v84bx8ldh8wrrb4m2crz92wxkz7wzm6rq55dcffj9jv7z7dnbp kind= uid=9465bb31-9a6d-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:13:26.682711Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi569ssksk2zzr9v84bx8ldh8wrrb4m2crz92wxkz7wzm6rq55dcffj9jv7z7dnbp kind= uid=9465bb31-9a6d-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:13:26.803517Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi569ssksk2zzr9v84bx8ldh8wrrb4m2crz92wxkz7wzm6rq55dcffj9jv7z7dnbp\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi569ssksk2zzr9v84bx8ldh8wrrb4m2crz92wxkz7wzm6rq55dcffj9jv7z7dnbp" level=info timestamp=2018-08-07T18:16:27.160829Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9n8lp68clr6wmhs7qh8rgrzxvn77vwwvxqsq7ff69vdmms4fjk8hnw8bg9prq6f kind= uid=fffa35e2-9a6d-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:16:27.162326Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9n8lp68clr6wmhs7qh8rgrzxvn77vwwvxqsq7ff69vdmms4fjk8hnw8bg9prq6f kind= uid=fffa35e2-9a6d-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:12:48.114100Z pos=vm.go:390 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=5e9759bb-9a6d-11e8-8d82-525500d15501 msg="Removing domain and ephemeral data for finalized vmi." level=info timestamp=2018-08-07T18:12:48.114125Z pos=vm.go:417 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=5e9759bb-9a6d-11e8-8d82-525500d15501 msg="Processing deletion." level=info timestamp=2018-08-07T18:12:48.115672Z pos=vm.go:588 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=5e9759bb-9a6d-11e8-8d82-525500d15501 msg="Signaled deletion for testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc" level=info timestamp=2018-08-07T18:12:48.120800Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind= uid=5e9759bb-9a6d-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:13:26.118390Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc, existing: false\n" level=info timestamp=2018-08-07T18:13:26.118627Z pos=vm.go:336 component=virt-handler msg="Domain: existing: true\n" level=info timestamp=2018-08-07T18:13:26.118653Z pos=vm.go:338 component=virt-handler msg="Domain status: Shutoff, reason: Destroyed\n" level=info timestamp=2018-08-07T18:13:26.118756Z pos=vm.go:365 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-08-07T18:13:26.118785Z pos=vm.go:417 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind=VirtualMachineInstance uid= msg="Processing deletion." level=info timestamp=2018-08-07T18:13:26.119048Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:13:41.569718Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:13:41.570772Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc, existing: false\n" level=info timestamp=2018-08-07T18:13:41.570814Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:13:41.570884Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:13:41.571000Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi9n8lp68clr6wmhs7qh8rgrzxvn77vwwvxqsq7r6rjb Pod phase: Pending level=info timestamp=2018-08-07T18:16:30.511539Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:16:30.511796Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:16:30.515082Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:16:40.523971Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:16:40.569302Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi9n8lp68clr6wmhs7qh8rgrzxvn77vwwvxqsq7ff69vdmms4fjk8hnw8bg9prq6f" level=info timestamp=2018-08-07T18:16:40.571776Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:16:40.571973Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.458 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 With an emptyDisk defined and a specified serial number /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:163 should create a writeable emptyDisk with the specified serial number [It] /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:165 Timed out after 90.006s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1088 ------------------------------ STEP: Starting a VirtualMachineInstance STEP: Waiting until the VirtualMachineInstance will start level=info timestamp=2018-08-07T18:16:27.372252Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi9n8lp68clr6wmhs7qh8rgrzxvn77vwwvxqsq7ff69vdmms4fjk8hnw8bg9prq6f kind=VirtualMachineInstance uid=fffa35e2-9a6d-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi9n8lp68clr6wmhs7qh8rgrzxvn77vwwvxqsq7r6rjb" • [SLOW TEST:54.260 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 With ephemeral alpine PVC /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:205 should be successfully started /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:207 ------------------------------ Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running level=info timestamp=2018-08-07T18:22:34.925934Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:22:36.498607Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:22:38 http: TLS handshake error from 10.244.1.1:51738: EOF level=info timestamp=2018-08-07T18:22:41.359437Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:22:48 http: TLS handshake error from 10.244.1.1:51744: EOF 2018/08/07 18:22:58 http: TLS handshake error from 10.244.1.1:51750: EOF level=info timestamp=2018-08-07T18:22:59.074269Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:22:59.538921Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:23:04.924743Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:23:06.521110Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:23:08 http: TLS handshake error from 10.244.1.1:51756: EOF level=info timestamp=2018-08-07T18:23:10.684630Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:23:10.686009Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:23:11.415120Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:23:18 http: TLS handshake error from 10.244.1.1:51762: EOF Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T18:11:56.457299Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixmrh2kwmvcr4rc4dbc9ptl4rjsnwv9nfgw6bkjx9424hp2s5t8fkwvpsfd95mhc" level=info timestamp=2018-08-07T18:13:26.681443Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi569ssksk2zzr9v84bx8ldh8wrrb4m2crz92wxkz7wzm6rq55dcffj9jv7z7dnbp kind= uid=9465bb31-9a6d-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:13:26.682711Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi569ssksk2zzr9v84bx8ldh8wrrb4m2crz92wxkz7wzm6rq55dcffj9jv7z7dnbp kind= uid=9465bb31-9a6d-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:13:26.803517Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi569ssksk2zzr9v84bx8ldh8wrrb4m2crz92wxkz7wzm6rq55dcffj9jv7z7dnbp\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi569ssksk2zzr9v84bx8ldh8wrrb4m2crz92wxkz7wzm6rq55dcffj9jv7z7dnbp" level=info timestamp=2018-08-07T18:16:27.160829Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9n8lp68clr6wmhs7qh8rgrzxvn77vwwvxqsq7ff69vdmms4fjk8hnw8bg9prq6f kind= uid=fffa35e2-9a6d-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:16:27.162326Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9n8lp68clr6wmhs7qh8rgrzxvn77vwwvxqsq7ff69vdmms4fjk8hnw8bg9prq6f kind= uid=fffa35e2-9a6d-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:19:27.463723Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9n8lp68clr6wmhs7qh8rgrzxvn77vwwvxqsq7ff69vdmms4fjk8hnw8bg9prq6f\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi9n8lp68clr6wmhs7qh8rgrzxvn77vwwvxqsq7ff69vdmms4fjk8hnw8bg9prq6f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: fffa35e2-9a6d-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9n8lp68clr6wmhs7qh8rgrzxvn77vwwvxqsq7ff69vdmms4fjk8hnw8bg9prq6f" level=info timestamp=2018-08-07T18:19:27.610269Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvminbdkbtzjxjbbqcxznzxq299clzdq9pj9br75j5xk5pwq2n5nrh7ml4lvsxjbwsv kind= uid=6b89358b-9a6e-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:19:27.610463Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvminbdkbtzjxjbbqcxznzxq299clzdq9pj9br75j5xk5pwq2n5nrh7ml4lvsxjbwsv kind= uid=6b89358b-9a6e-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:19:27.713890Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvminbdkbtzjxjbbqcxznzxq299clzdq9pj9br75j5xk5pwq2n5nrh7ml4lvsxjbwsv\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvminbdkbtzjxjbbqcxznzxq299clzdq9pj9br75j5xk5pwq2n5nrh7ml4lvsxjbwsv" level=info timestamp=2018-08-07T18:20:21.880549Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind= uid=8be149d1-9a6e-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:20:21.881807Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind= uid=8be149d1-9a6e-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:20:21.967886Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v" level=info timestamp=2018-08-07T18:21:56.392630Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind= uid=c437173a-9a6e-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:21:56.394348Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind= uid=c437173a-9a6e-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:21:16.080228Z pos=vm.go:338 component=virt-handler msg="Domain status: Shutoff, reason: Destroyed\n" level=info timestamp=2018-08-07T18:21:16.080569Z pos=vm.go:380 component=virt-handler namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind= uid=8be149d1-9a6e-11e8-8d82-525500d15501 msg="Deleting domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-08-07T18:21:16.080598Z pos=vm.go:390 component=virt-handler namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind= uid=8be149d1-9a6e-11e8-8d82-525500d15501 msg="Removing domain and ephemeral data for finalized vmi." level=info timestamp=2018-08-07T18:21:16.080619Z pos=vm.go:417 component=virt-handler namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind= uid=8be149d1-9a6e-11e8-8d82-525500d15501 msg="Processing deletion." level=info timestamp=2018-08-07T18:21:16.081864Z pos=vm.go:588 component=virt-handler namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind= uid=8be149d1-9a6e-11e8-8d82-525500d15501 msg="Signaled deletion for testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v" level=info timestamp=2018-08-07T18:21:16.085715Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind= uid=8be149d1-9a6e-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:21:56.117404Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v, existing: false\n" level=info timestamp=2018-08-07T18:21:56.117489Z pos=vm.go:336 component=virt-handler msg="Domain: existing: true\n" level=info timestamp=2018-08-07T18:21:56.117511Z pos=vm.go:338 component=virt-handler msg="Domain status: Shutoff, reason: Destroyed\n" level=info timestamp=2018-08-07T18:21:56.117596Z pos=vm.go:365 component=virt-handler namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-08-07T18:21:56.117635Z pos=vm.go:417 component=virt-handler namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind=VirtualMachineInstance uid= msg="Processing deletion." level=info timestamp=2018-08-07T18:21:56.117877Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:22:11.716545Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v, existing: true\n" level=info timestamp=2018-08-07T18:22:11.716633Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-07T18:22:11.716664Z pos=vm.go:332 component=virt-handler namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind= uid=c437173a-9a6e-11e8-8d82-525500d15501 msg="Ignoring domain from an older VMI, will be handled by its own VMI." Pod name: virt-launcher-testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f6k8r7 Pod phase: Running level=info timestamp=2018-08-07T18:21:59.878342Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:21:59.879479Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:21:59.880804Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:22:09.887867Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:22:09.929095Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v" level=info timestamp=2018-08-07T18:22:09.931918Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:22:09.932124Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [185.069 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 With ephemeral alpine PVC /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:205 should not persist data [It] /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:218 Timed out after 90.172s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1088 ------------------------------ 2018/08/07 14:20:21 read closing down: EOF STEP: Starting the VirtualMachineInstance STEP: Starting a VirtualMachineInstance STEP: Waiting until the VirtualMachineInstance will start level=info timestamp=2018-08-07T18:20:22.079197Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind=VirtualMachineInstance uid=8be149d1-9a6e-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6fpt2l4" level=info timestamp=2018-08-07T18:20:37.293339Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind=VirtualMachineInstance uid=8be149d1-9a6e-11e8-8d82-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6fpt2l4" level=info timestamp=2018-08-07T18:20:38.509263Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind=VirtualMachineInstance uid=8be149d1-9a6e-11e8-8d82-525500d15501 msg="VirtualMachineInstance defined." level=info timestamp=2018-08-07T18:20:38.521547Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind=VirtualMachineInstance uid=8be149d1-9a6e-11e8-8d82-525500d15501 msg="VirtualMachineInstance started." STEP: Writing an arbitrary file to it's EFI partition STEP: Killing a VirtualMachineInstance STEP: Starting the VirtualMachineInstance again STEP: Starting a VirtualMachineInstance STEP: Waiting until the VirtualMachineInstance will start level=info timestamp=2018-08-07T18:21:56.558965Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind=VirtualMachineInstance uid=8be149d1-9a6e-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6fpt2l4" level=info timestamp=2018-08-07T18:21:56.559094Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind=VirtualMachineInstance uid=8be149d1-9a6e-11e8-8d82-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6fpt2l4" level=info timestamp=2018-08-07T18:21:56.559420Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind=VirtualMachineInstance uid=8be149d1-9a6e-11e8-8d82-525500d15501 msg="VirtualMachineInstance defined." level=info timestamp=2018-08-07T18:21:56.559526Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi865rthntl8ppxznjh2z4trmjg992mbfgvnm6f7lwlmtg5vfssjmsw8gfrqdk58v kind=VirtualMachineInstance uid=8be149d1-9a6e-11e8-8d82-525500d15501 msg="VirtualMachineInstance started." 2018/08/07 14:23:26 read closing down: EOF • [SLOW TEST:136.323 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 With VirtualMachineInstance with two PVCs /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:266 should start vmi multiple times /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:278 ------------------------------ •• Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running level=info timestamp=2018-08-07T18:28:00.066383Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:28:04.921357Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:28:06.819790Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:28:08 http: TLS handshake error from 10.244.1.1:51938: EOF level=info timestamp=2018-08-07T18:28:10.023527Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:28:10.024724Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:28:11.964126Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:28:18 http: TLS handshake error from 10.244.1.1:51944: EOF 2018/08/07 18:28:28 http: TLS handshake error from 10.244.1.1:51950: EOF level=info timestamp=2018-08-07T18:28:29.654742Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:28:30.120607Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:28:34.932270Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:28:36.851012Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:28:38 http: TLS handshake error from 10.244.1.1:51956: EOF level=info timestamp=2018-08-07T18:28:42.018101Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T18:24:07.050857Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=121866c6-9a6f-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:24:07.052370Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=121866c6-9a6f-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:24:47.024110Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:24:47.025264Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:25:43.112226Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiclqvftrl7h8w2gh82jf76jc2ljk9bnm6rx6d8v6pmdf5dk4dsg5mv6tstnq2ns4 kind= uid=4b59e9f4-9a6f-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:25:43.113675Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiclqvftrl7h8w2gh82jf76jc2ljk9bnm6rx6d8v6pmdf5dk4dsg5mv6tstnq2ns4 kind= uid=4b59e9f4-9a6f-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:25:43.157221Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiclqvftrl7h8w2gh82jf76jc2ljk9bnm6rx6d8v6pmdf5dk4dsg5mv6tstnq2ns4\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiclqvftrl7h8w2gh82jf76jc2ljk9bnm6rx6d8v6pmdf5dk4dsg5mv6tstnq2ns4" level=info timestamp=2018-08-07T18:25:43.173607Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiclqvftrl7h8w2gh82jf76jc2ljk9bnm6rx6d8v6pmdf5dk4dsg5mv6tstnq2ns4\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiclqvftrl7h8w2gh82jf76jc2ljk9bnm6rx6d8v6pmdf5dk4dsg5mv6tstnq2ns4" level=info timestamp=2018-08-07T18:25:43.358448Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivrvcwfvb886r52hzdj6fggd2tbnq9kgvthbkn6v58wh5thnm5d5v2tnv7pd86p8 kind= uid=4b7fc58a-9a6f-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:25:43.358608Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivrvcwfvb886r52hzdj6fggd2tbnq9kgvthbkn6v58wh5thnm5d5v2tnv7pd86p8 kind= uid=4b7fc58a-9a6f-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:25:43.454244Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivrvcwfvb886r52hzdj6fggd2tbnq9kgvthbkn6v58wh5thnm5d5v2tnv7pd86p8\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmivrvcwfvb886r52hzdj6fggd2tbnq9kgvthbkn6v58wh5thnm5d5v2tnv7pd86p8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4b7fc58a-9a6f-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivrvcwfvb886r52hzdj6fggd2tbnq9kgvthbkn6v58wh5thnm5d5v2tnv7pd86p8" level=info timestamp=2018-08-07T18:25:43.637611Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs kind= uid=4baa18fa-9a6f-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:25:43.637794Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs kind= uid=4baa18fa-9a6f-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:25:43.717531Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs" level=info timestamp=2018-08-07T18:25:44.119245Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:25:40.035873Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:25:40.035923Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: true\n" level=info timestamp=2018-08-07T18:25:40.036466Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:25:40.036504Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:40.036581Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:40.044204Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:25:40.044292Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: true\n" level=info timestamp=2018-08-07T18:25:40.044319Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:25:40.044340Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:40.044389Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:40.044458Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:25:42.567879Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: false\n" level=info timestamp=2018-08-07T18:25:42.567990Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:42.568068Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:42.568140Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwq976f Pod phase: Pending level=info timestamp=2018-08-07T18:25:46.598953Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:25:46.599262Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:25:46.601717Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:25:56.608733Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:25:56.647591Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs" level=info timestamp=2018-08-07T18:25:56.649465Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:25:56.649809Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure [180.404 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 should start it [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:80 Timed out after 90.005s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T18:25:43.880505Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs kind=VirtualMachineInstance uid=4baa18fa-9a6f-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwq976f" Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running level=info timestamp=2018-08-07T18:31:00.378329Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:31:04.928926Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:31:06.990516Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:31:08 http: TLS handshake error from 10.244.1.1:52046: EOF level=info timestamp=2018-08-07T18:31:09.914675Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:31:09.915972Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:31:12.301825Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:31:18 http: TLS handshake error from 10.244.1.1:52052: EOF 2018/08/07 18:31:28 http: TLS handshake error from 10.244.1.1:52058: EOF level=info timestamp=2018-08-07T18:31:29.966570Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:31:30.429810Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:31:34.918242Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:31:37.011953Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:31:38 http: TLS handshake error from 10.244.1.1:52064: EOF level=info timestamp=2018-08-07T18:31:42.355670Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T18:24:47.025264Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:25:43.112226Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiclqvftrl7h8w2gh82jf76jc2ljk9bnm6rx6d8v6pmdf5dk4dsg5mv6tstnq2ns4 kind= uid=4b59e9f4-9a6f-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:25:43.113675Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiclqvftrl7h8w2gh82jf76jc2ljk9bnm6rx6d8v6pmdf5dk4dsg5mv6tstnq2ns4 kind= uid=4b59e9f4-9a6f-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:25:43.157221Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiclqvftrl7h8w2gh82jf76jc2ljk9bnm6rx6d8v6pmdf5dk4dsg5mv6tstnq2ns4\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiclqvftrl7h8w2gh82jf76jc2ljk9bnm6rx6d8v6pmdf5dk4dsg5mv6tstnq2ns4" level=info timestamp=2018-08-07T18:25:43.173607Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiclqvftrl7h8w2gh82jf76jc2ljk9bnm6rx6d8v6pmdf5dk4dsg5mv6tstnq2ns4\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiclqvftrl7h8w2gh82jf76jc2ljk9bnm6rx6d8v6pmdf5dk4dsg5mv6tstnq2ns4" level=info timestamp=2018-08-07T18:25:43.358448Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivrvcwfvb886r52hzdj6fggd2tbnq9kgvthbkn6v58wh5thnm5d5v2tnv7pd86p8 kind= uid=4b7fc58a-9a6f-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:25:43.358608Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivrvcwfvb886r52hzdj6fggd2tbnq9kgvthbkn6v58wh5thnm5d5v2tnv7pd86p8 kind= uid=4b7fc58a-9a6f-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:25:43.454244Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivrvcwfvb886r52hzdj6fggd2tbnq9kgvthbkn6v58wh5thnm5d5v2tnv7pd86p8\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmivrvcwfvb886r52hzdj6fggd2tbnq9kgvthbkn6v58wh5thnm5d5v2tnv7pd86p8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4b7fc58a-9a6f-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivrvcwfvb886r52hzdj6fggd2tbnq9kgvthbkn6v58wh5thnm5d5v2tnv7pd86p8" level=info timestamp=2018-08-07T18:25:43.637611Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs kind= uid=4baa18fa-9a6f-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:25:43.637794Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs kind= uid=4baa18fa-9a6f-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:25:43.717531Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs" level=info timestamp=2018-08-07T18:25:44.119245Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs" level=info timestamp=2018-08-07T18:28:43.874528Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4baa18fa-9a6f-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs" level=info timestamp=2018-08-07T18:28:44.043957Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigjxbkx7zcfl7cxjp29l62hs9cm7bz6cfn5l59mfzhv7zfmj852rlsp5g7bks4k7 kind= uid=b731b05b-9a6f-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:28:44.044125Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigjxbkx7zcfl7cxjp29l62hs9cm7bz6cfn5l59mfzhv7zfmj852rlsp5g7bks4k7 kind= uid=b731b05b-9a6f-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:25:40.035873Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:25:40.035923Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: true\n" level=info timestamp=2018-08-07T18:25:40.036466Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:25:40.036504Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:40.036581Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:40.044204Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:25:40.044292Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: true\n" level=info timestamp=2018-08-07T18:25:40.044319Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:25:40.044340Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:40.044389Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:40.044458Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:25:42.567879Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: false\n" level=info timestamp=2018-08-07T18:25:42.567990Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:42.568068Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:42.568140Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmigjxbkx7zcfl7cxjp29l62hs9cm7bz6cfn5l59565kl Pod phase: Pending level=info timestamp=2018-08-07T18:28:46.741549Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:28:46.741828Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:28:46.744566Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:28:56.756498Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:28:56.791051Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmigjxbkx7zcfl7cxjp29l62hs9cm7bz6cfn5l59mfzhv7zfmj852rlsp5g7bks4k7" level=info timestamp=2018-08-07T18:28:56.793041Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:28:56.793626Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.358 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 should attach virt-launcher to it [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:86 Timed out after 90.005s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T18:28:44.227658Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmigjxbkx7zcfl7cxjp29l62hs9cm7bz6cfn5l59mfzhv7zfmj852rlsp5g7bks4k7 kind=VirtualMachineInstance uid=b731b05b-9a6f-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmigjxbkx7zcfl7cxjp29l62hs9cm7bz6cfn5l59565kl" •••• Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running 2018/08/07 18:33:58 http: TLS handshake error from 10.244.1.1:52148: EOF level=info timestamp=2018-08-07T18:34:00.223750Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:34:00.691844Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:34:04.926103Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:34:07.123664Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:34:08 http: TLS handshake error from 10.244.1.1:52154: EOF level=info timestamp=2018-08-07T18:34:12.627817Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:34:18 http: TLS handshake error from 10.244.1.1:52160: EOF 2018/08/07 18:34:28 http: TLS handshake error from 10.244.1.1:52166: EOF level=info timestamp=2018-08-07T18:34:30.275034Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:34:30.744599Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:34:34.923745Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:34:37.144775Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:34:38 http: TLS handshake error from 10.244.1.1:52172: EOF level=info timestamp=2018-08-07T18:34:42.682402Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T18:25:43.637794Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs kind= uid=4baa18fa-9a6f-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:25:43.717531Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs" level=info timestamp=2018-08-07T18:25:44.119245Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs" level=info timestamp=2018-08-07T18:28:43.874528Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4baa18fa-9a6f-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs" level=info timestamp=2018-08-07T18:28:44.043957Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigjxbkx7zcfl7cxjp29l62hs9cm7bz6cfn5l59mfzhv7zfmj852rlsp5g7bks4k7 kind= uid=b731b05b-9a6f-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:28:44.044125Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigjxbkx7zcfl7cxjp29l62hs9cm7bz6cfn5l59mfzhv7zfmj852rlsp5g7bks4k7 kind= uid=b731b05b-9a6f-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:31:44.212583Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmigjxbkx7zcfl7cxjp29l62hs9cm7bz6cfn5l59mfzhv7zfmj852rlsp5g7bks4k7\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmigjxbkx7zcfl7cxjp29l62hs9cm7bz6cfn5l59mfzhv7zfmj852rlsp5g7bks4k7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b731b05b-9a6f-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmigjxbkx7zcfl7cxjp29l62hs9cm7bz6cfn5l59mfzhv7zfmj852rlsp5g7bks4k7" level=info timestamp=2018-08-07T18:31:44.572279Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilpd2rs6n859cvtk94z2cd4h25wksrkxkcc6dfr4fz8ncdzz6tb2l9r9ts7r9sp9 kind= uid=22cbe6f4-9a70-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:31:44.572465Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilpd2rs6n859cvtk94z2cd4h25wksrkxkcc6dfr4fz8ncdzz6tb2l9r9ts7r9sp9 kind= uid=22cbe6f4-9a70-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:31:44.674580Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpd2rs6n859cvtk94z2cd4h25wksrkxkcc6dfr4fz8ncdzz6tb2l9r9ts7r9sp9\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmilpd2rs6n859cvtk94z2cd4h25wksrkxkcc6dfr4fz8ncdzz6tb2l9r9ts7r9sp9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 22cbe6f4-9a70-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmilpd2rs6n859cvtk94z2cd4h25wksrkxkcc6dfr4fz8ncdzz6tb2l9r9ts7r9sp9" level=info timestamp=2018-08-07T18:31:44.831496Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixdd62vd87r69spl8hqlw9mclpqj5v65pmk45m454f5jqtx8vw2zhnmjsk9mqc9t kind= uid=22f45d08-9a70-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:31:44.831606Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixdd62vd87r69spl8hqlw9mclpqj5v65pmk45m454f5jqtx8vw2zhnmjsk9mqc9t kind= uid=22f45d08-9a70-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:31:44.859021Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixdd62vd87r69spl8hqlw9mclpqj5v65pmk45m454f5jqtx8vw2zhnmjsk9mqc9t\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixdd62vd87r69spl8hqlw9mclpqj5v65pmk45m454f5jqtx8vw2zhnmjsk9mqc9t" level=info timestamp=2018-08-07T18:31:45.097886Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitcdm72knjmtmwr4qknz42p7zjp2gv85chvjh2s2cf8t2gh4728bplp25w5rfq7f kind= uid=231cd5bd-9a70-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:31:45.098032Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitcdm72knjmtmwr4qknz42p7zjp2gv85chvjh2s2cf8t2gh4728bplp25w5rfq7f kind= uid=231cd5bd-9a70-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:25:40.035873Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:25:40.035923Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: true\n" level=info timestamp=2018-08-07T18:25:40.036466Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:25:40.036504Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:40.036581Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:40.044204Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:25:40.044292Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: true\n" level=info timestamp=2018-08-07T18:25:40.044319Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:25:40.044340Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:40.044389Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:40.044458Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:25:42.567879Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: false\n" level=info timestamp=2018-08-07T18:25:42.567990Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:42.568068Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:42.568140Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmitcdm72knjmtmwr4qknz42p7zjp2gv85chvjh22lx4l Pod phase: Pending level=info timestamp=2018-08-07T18:31:48.272999Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:31:48.273307Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:31:48.275341Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:31:58.285594Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:31:58.316616Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmitcdm72knjmtmwr4qknz42p7zjp2gv85chvjh2s2cf8t2gh4728bplp25w5rfq7f" level=info timestamp=2018-08-07T18:31:58.319500Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:31:58.319831Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure [180.397 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with boot order /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:174 should be able to boot from selected disk /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 Alpine as first boot [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.005s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: defining a VirtualMachineInstance with an Alpine disk STEP: adding a Cirros Disk STEP: setting boot order STEP: starting VirtualMachineInstance STEP: Waiting the VirtualMachineInstance start level=info timestamp=2018-08-07T18:31:45.306960Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmitcdm72knjmtmwr4qknz42p7zjp2gv85chvjh2s2cf8t2gh4728bplp25w5rfq7f kind=VirtualMachineInstance uid=231cd5bd-9a70-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmitcdm72knjmtmwr4qknz42p7zjp2gv85chvjh22lx4l" Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running 2018/08/07 18:36:58 http: TLS handshake error from 10.244.1.1:52256: EOF level=info timestamp=2018-08-07T18:37:00.536370Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:37:01.010402Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:37:04.914397Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:37:07.265475Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:37:08 http: TLS handshake error from 10.244.1.1:52262: EOF level=info timestamp=2018-08-07T18:37:12.954788Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:37:18 http: TLS handshake error from 10.244.1.1:52268: EOF 2018/08/07 18:37:28 http: TLS handshake error from 10.244.1.1:52274: EOF level=info timestamp=2018-08-07T18:37:30.586632Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:37:31.065462Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:37:34.921787Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:37:37.289015Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:37:38 http: TLS handshake error from 10.244.1.1:52280: EOF level=info timestamp=2018-08-07T18:37:43.008802Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T18:28:43.874528Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4baa18fa-9a6f-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidj5rznk69flpssj48x6smn8gbgv62jdb4rnlwk42kjggvhqcx9mzd5h6tmsjlcs" level=info timestamp=2018-08-07T18:28:44.043957Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigjxbkx7zcfl7cxjp29l62hs9cm7bz6cfn5l59mfzhv7zfmj852rlsp5g7bks4k7 kind= uid=b731b05b-9a6f-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:28:44.044125Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigjxbkx7zcfl7cxjp29l62hs9cm7bz6cfn5l59mfzhv7zfmj852rlsp5g7bks4k7 kind= uid=b731b05b-9a6f-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:31:44.212583Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmigjxbkx7zcfl7cxjp29l62hs9cm7bz6cfn5l59mfzhv7zfmj852rlsp5g7bks4k7\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmigjxbkx7zcfl7cxjp29l62hs9cm7bz6cfn5l59mfzhv7zfmj852rlsp5g7bks4k7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b731b05b-9a6f-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmigjxbkx7zcfl7cxjp29l62hs9cm7bz6cfn5l59mfzhv7zfmj852rlsp5g7bks4k7" level=info timestamp=2018-08-07T18:31:44.572279Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilpd2rs6n859cvtk94z2cd4h25wksrkxkcc6dfr4fz8ncdzz6tb2l9r9ts7r9sp9 kind= uid=22cbe6f4-9a70-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:31:44.572465Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilpd2rs6n859cvtk94z2cd4h25wksrkxkcc6dfr4fz8ncdzz6tb2l9r9ts7r9sp9 kind= uid=22cbe6f4-9a70-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:31:44.674580Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpd2rs6n859cvtk94z2cd4h25wksrkxkcc6dfr4fz8ncdzz6tb2l9r9ts7r9sp9\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmilpd2rs6n859cvtk94z2cd4h25wksrkxkcc6dfr4fz8ncdzz6tb2l9r9ts7r9sp9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 22cbe6f4-9a70-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmilpd2rs6n859cvtk94z2cd4h25wksrkxkcc6dfr4fz8ncdzz6tb2l9r9ts7r9sp9" level=info timestamp=2018-08-07T18:31:44.831496Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixdd62vd87r69spl8hqlw9mclpqj5v65pmk45m454f5jqtx8vw2zhnmjsk9mqc9t kind= uid=22f45d08-9a70-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:31:44.831606Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixdd62vd87r69spl8hqlw9mclpqj5v65pmk45m454f5jqtx8vw2zhnmjsk9mqc9t kind= uid=22f45d08-9a70-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:31:44.859021Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixdd62vd87r69spl8hqlw9mclpqj5v65pmk45m454f5jqtx8vw2zhnmjsk9mqc9t\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixdd62vd87r69spl8hqlw9mclpqj5v65pmk45m454f5jqtx8vw2zhnmjsk9mqc9t" level=info timestamp=2018-08-07T18:31:45.097886Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitcdm72knjmtmwr4qknz42p7zjp2gv85chvjh2s2cf8t2gh4728bplp25w5rfq7f kind= uid=231cd5bd-9a70-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:31:45.098032Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitcdm72knjmtmwr4qknz42p7zjp2gv85chvjh2s2cf8t2gh4728bplp25w5rfq7f kind= uid=231cd5bd-9a70-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:34:45.495149Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhc8s2hdglq47fxsp7q67mkrmnppv kind= uid=8ea2f530-9a70-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:34:45.495371Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhc8s2hdglq47fxsp7q67mkrmnppv kind= uid=8ea2f530-9a70-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:34:45.559367Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhc8s2hdglq47fxsp7q67mkrmnppv\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhc8s2hdglq47fxsp7q67mkrmnppv" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:25:40.035873Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:25:40.035923Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: true\n" level=info timestamp=2018-08-07T18:25:40.036466Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:25:40.036504Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:40.036581Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:40.044204Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:25:40.044292Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: true\n" level=info timestamp=2018-08-07T18:25:40.044319Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:25:40.044340Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:40.044389Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:40.044458Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:25:42.567879Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: false\n" level=info timestamp=2018-08-07T18:25:42.567990Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:42.568068Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:42.568140Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhcfmj4w Pod phase: Pending level=info timestamp=2018-08-07T18:34:48.723295Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:34:48.723582Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:34:48.726016Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:34:58.732948Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:34:58.759789Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhc8s2hdglq47fxsp7q67mkrmnppv" level=info timestamp=2018-08-07T18:34:58.762684Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:34:58.762874Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.379 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with boot order /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:174 should be able to boot from selected disk /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 Cirros as first boot [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.005s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: defining a VirtualMachineInstance with an Alpine disk STEP: adding a Cirros Disk STEP: setting boot order STEP: starting VirtualMachineInstance STEP: Waiting the VirtualMachineInstance start level=info timestamp=2018-08-07T18:34:45.719242Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhc8s2hdglq47fxsp7q67mkrmnppv kind=VirtualMachineInstance uid=8ea2f530-9a70-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhcfmj4w" • [SLOW TEST:60.249 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with user-data /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:205 without k8s secret /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:206 should retry starting the VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:207 ------------------------------ •! Panic [60.261 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with user-data /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:205 without k8s secret /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:206 should log warning and proceed once the secret is there [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:237 Test Panicked runtime error: invalid memory address or nil pointer dereference /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/panic.go:505 Full Stack Trace /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/panic.go:505 +0x229 kubevirt.io/kubevirt/tests_test.glob..func16.3.9.1.2() /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:258 +0x431 kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).runSync(0xc4209326c0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/tests/tests_suite_test.go:43 +0xaa testing.tRunner(0xc420493d10, 0x1432278) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:777 +0xd0 created by testing.(*T).Run /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:824 +0x2e0 ------------------------------ STEP: Starting a VirtualMachineInstance STEP: Checking that VirtualMachineInstance start failed level=info timestamp=2018-08-07T18:38:46.329581Z pos=utils.go:257 component=tests namespace=kubevirt-test-default name=testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9h5k7kw6dqlrgtwktwjnhc58ltc4 kind=VirtualMachineInstance uid=1e1021ba-9a71-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9hcbkk4" Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running 2018/08/07 18:41:58 http: TLS handshake error from 10.244.1.1:52436: EOF level=info timestamp=2018-08-07T18:42:01.060071Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:42:01.536197Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:42:04.928267Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:42:07.516219Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:42:08 http: TLS handshake error from 10.244.1.1:52442: EOF level=info timestamp=2018-08-07T18:42:13.520493Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:42:18 http: TLS handshake error from 10.244.1.1:52448: EOF 2018/08/07 18:42:28 http: TLS handshake error from 10.244.1.1:52454: EOF level=info timestamp=2018-08-07T18:42:31.111813Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:42:31.584262Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:42:34.928783Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:42:37.538907Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:42:38 http: TLS handshake error from 10.244.1.1:52460: EOF level=info timestamp=2018-08-07T18:42:43.573897Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T18:31:44.859021Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixdd62vd87r69spl8hqlw9mclpqj5v65pmk45m454f5jqtx8vw2zhnmjsk9mqc9t\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixdd62vd87r69spl8hqlw9mclpqj5v65pmk45m454f5jqtx8vw2zhnmjsk9mqc9t" level=info timestamp=2018-08-07T18:31:45.097886Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitcdm72knjmtmwr4qknz42p7zjp2gv85chvjh2s2cf8t2gh4728bplp25w5rfq7f kind= uid=231cd5bd-9a70-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:31:45.098032Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitcdm72knjmtmwr4qknz42p7zjp2gv85chvjh2s2cf8t2gh4728bplp25w5rfq7f kind= uid=231cd5bd-9a70-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:34:45.495149Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhc8s2hdglq47fxsp7q67mkrmnppv kind= uid=8ea2f530-9a70-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:34:45.495371Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhc8s2hdglq47fxsp7q67mkrmnppv kind= uid=8ea2f530-9a70-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:34:45.559367Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhc8s2hdglq47fxsp7q67mkrmnppv\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhc8s2hdglq47fxsp7q67mkrmnppv" level=info timestamp=2018-08-07T18:37:45.689510Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhc8s2hdglq47fxsp7q67mkrmnppv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhc8s2hdglq47fxsp7q67mkrmnppv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8ea2f530-9a70-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhc8s2hdglq47fxsp7q67mkrmnppv" level=info timestamp=2018-08-07T18:37:45.874999Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijf4bsn54gmrv4nj656r65brcs7xrsrf486bhjp6hrzlp897zfxbtml6z5vpw244 kind= uid=fa2698c5-9a70-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:37:45.875148Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijf4bsn54gmrv4nj656r65brcs7xrsrf486bhjp6hrzlp897zfxbtml6z5vpw244 kind= uid=fa2698c5-9a70-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:38:46.136715Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9h5k7kw6dqlrgtwktwjnhc58ltc4 kind= uid=1e1021ba-9a71-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:38:46.138743Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9h5k7kw6dqlrgtwktwjnhc58ltc4 kind= uid=1e1021ba-9a71-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:38:46.191704Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9h5k7kw6dqlrgtwktwjnhc58ltc4\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9h5k7kw6dqlrgtwktwjnhc58ltc4" level=info timestamp=2018-08-07T18:38:46.212473Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9h5k7kw6dqlrgtwktwjnhc58ltc4\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9h5k7kw6dqlrgtwktwjnhc58ltc4" level=info timestamp=2018-08-07T18:39:46.391483Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht9ksbzvnnffwwfx6szjz6pfdksjh kind= uid=41fbd7d0-9a71-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:39:46.391849Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht9ksbzvnnffwwfx6szjz6pfdksjh kind= uid=41fbd7d0-9a71-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:25:40.035873Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:25:40.035923Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: true\n" level=info timestamp=2018-08-07T18:25:40.036466Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:25:40.036504Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:40.036581Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:40.044204Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:25:40.044292Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: true\n" level=info timestamp=2018-08-07T18:25:40.044319Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:25:40.044340Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:40.044389Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:40.044458Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:25:42.567879Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: false\n" level=info timestamp=2018-08-07T18:25:42.567990Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:42.568068Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:42.568140Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht974974 Pod phase: Pending level=info timestamp=2018-08-07T18:39:48.811021Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:39:48.811334Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:39:48.813776Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:39:58.825712Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:39:58.857852Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht9ksbzvnnffwwfx6szjz6pfdksjh" level=info timestamp=2018-08-07T18:39:58.860416Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:39:58.860745Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.375 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 when virt-launcher crashes /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:285 should be stopped and have Failed phase [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:286 Timed out after 90.004s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T18:39:46.579007Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht9ksbzvnnffwwfx6szjz6pfdksjh kind=VirtualMachineInstance uid=41fbd7d0-9a71-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht974974" Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running level=info timestamp=2018-08-07T18:45:04.894005Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:45:04.923694Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:45:07.664592Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:45:08 http: TLS handshake error from 10.244.1.1:52550: EOF level=info timestamp=2018-08-07T18:45:09.926205Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:45:09.927337Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:45:13.846791Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:45:18 http: TLS handshake error from 10.244.1.1:52556: EOF 2018/08/07 18:45:28 http: TLS handshake error from 10.244.1.1:52562: EOF level=info timestamp=2018-08-07T18:45:31.427722Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:45:31.905135Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:45:34.932211Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:45:37.689077Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:45:38 http: TLS handshake error from 10.244.1.1:52568: EOF level=info timestamp=2018-08-07T18:45:43.900451Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T18:34:45.495371Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhc8s2hdglq47fxsp7q67mkrmnppv kind= uid=8ea2f530-9a70-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:34:45.559367Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhc8s2hdglq47fxsp7q67mkrmnppv\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhc8s2hdglq47fxsp7q67mkrmnppv" level=info timestamp=2018-08-07T18:37:45.689510Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhc8s2hdglq47fxsp7q67mkrmnppv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhc8s2hdglq47fxsp7q67mkrmnppv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8ea2f530-9a70-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi87crsdckz58fgmvbbjszvrrgsgb2nhf28cdhc8s2hdglq47fxsp7q67mkrmnppv" level=info timestamp=2018-08-07T18:37:45.874999Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijf4bsn54gmrv4nj656r65brcs7xrsrf486bhjp6hrzlp897zfxbtml6z5vpw244 kind= uid=fa2698c5-9a70-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:37:45.875148Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijf4bsn54gmrv4nj656r65brcs7xrsrf486bhjp6hrzlp897zfxbtml6z5vpw244 kind= uid=fa2698c5-9a70-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:38:46.136715Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9h5k7kw6dqlrgtwktwjnhc58ltc4 kind= uid=1e1021ba-9a71-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:38:46.138743Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9h5k7kw6dqlrgtwktwjnhc58ltc4 kind= uid=1e1021ba-9a71-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:38:46.191704Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9h5k7kw6dqlrgtwktwjnhc58ltc4\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9h5k7kw6dqlrgtwktwjnhc58ltc4" level=info timestamp=2018-08-07T18:38:46.212473Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9h5k7kw6dqlrgtwktwjnhc58ltc4\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9h5k7kw6dqlrgtwktwjnhc58ltc4" level=info timestamp=2018-08-07T18:39:46.391483Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht9ksbzvnnffwwfx6szjz6pfdksjh kind= uid=41fbd7d0-9a71-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:39:46.391849Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht9ksbzvnnffwwfx6szjz6pfdksjh kind= uid=41fbd7d0-9a71-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:42:46.582137Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht9ksbzvnnffwwfx6szjz6pfdksjh\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht9ksbzvnnffwwfx6szjz6pfdksjh, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 41fbd7d0-9a71-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht9ksbzvnnffwwfx6szjz6pfdksjh" level=info timestamp=2018-08-07T18:42:46.773829Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh kind= uid=ad7e6109-9a71-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:42:46.774045Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh kind= uid=ad7e6109-9a71-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:42:46.818694Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:25:40.035873Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:25:40.035923Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: true\n" level=info timestamp=2018-08-07T18:25:40.036466Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:25:40.036504Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:40.036581Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:40.044204Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:25:40.044292Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: true\n" level=info timestamp=2018-08-07T18:25:40.044319Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:25:40.044340Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:40.044389Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:40.044458Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:25:42.567879Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: false\n" level=info timestamp=2018-08-07T18:25:42.567990Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:42.568068Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:42.568140Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74gbrfp Pod phase: Pending level=info timestamp=2018-08-07T18:42:49.626837Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:42:49.627129Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:42:49.629608Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:42:59.644678Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:42:59.716863Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh" level=info timestamp=2018-08-07T18:42:59.720505Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:42:59.720930Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.378 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 when virt-handler crashes /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:309 should recover and continue management [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:310 Timed out after 90.005s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T18:42:47.019667Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh kind=VirtualMachineInstance uid=ad7e6109-9a71-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74gbrfp" • [SLOW TEST:58.426 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 when virt-handler is responsive /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:340 should indicate that a node is ready for vmis /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:341 ------------------------------ Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running 2018/08/07 18:48:58 http: TLS handshake error from 10.244.1.1:52688: EOF level=info timestamp=2018-08-07T18:49:01.785935Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:49:02.266501Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:49:04.921524Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:49:07.864544Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:49:08 http: TLS handshake error from 10.244.1.1:52694: EOF level=info timestamp=2018-08-07T18:49:14.278507Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:49:18 http: TLS handshake error from 10.244.1.1:52700: EOF 2018/08/07 18:49:28 http: TLS handshake error from 10.244.1.1:52706: EOF level=info timestamp=2018-08-07T18:49:31.840648Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:49:32.318782Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:49:34.926219Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:49:37.888492Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:49:38 http: TLS handshake error from 10.244.1.1:52712: EOF level=info timestamp=2018-08-07T18:49:44.332744Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T18:37:45.875148Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijf4bsn54gmrv4nj656r65brcs7xrsrf486bhjp6hrzlp897zfxbtml6z5vpw244 kind= uid=fa2698c5-9a70-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:38:46.136715Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9h5k7kw6dqlrgtwktwjnhc58ltc4 kind= uid=1e1021ba-9a71-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:38:46.138743Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9h5k7kw6dqlrgtwktwjnhc58ltc4 kind= uid=1e1021ba-9a71-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:38:46.191704Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9h5k7kw6dqlrgtwktwjnhc58ltc4\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9h5k7kw6dqlrgtwktwjnhc58ltc4" level=info timestamp=2018-08-07T18:38:46.212473Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9h5k7kw6dqlrgtwktwjnhc58ltc4\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmisd6hjhx85rwrnvflx4q42gcfcsh4bw96dqn9h5k7kw6dqlrgtwktwjnhc58ltc4" level=info timestamp=2018-08-07T18:39:46.391483Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht9ksbzvnnffwwfx6szjz6pfdksjh kind= uid=41fbd7d0-9a71-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:39:46.391849Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht9ksbzvnnffwwfx6szjz6pfdksjh kind= uid=41fbd7d0-9a71-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:42:46.582137Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht9ksbzvnnffwwfx6szjz6pfdksjh\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht9ksbzvnnffwwfx6szjz6pfdksjh, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 41fbd7d0-9a71-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht9ksbzvnnffwwfx6szjz6pfdksjh" level=info timestamp=2018-08-07T18:42:46.773829Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh kind= uid=ad7e6109-9a71-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:42:46.774045Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh kind= uid=ad7e6109-9a71-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:42:46.818694Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh" level=info timestamp=2018-08-07T18:45:46.953688Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ad7e6109-9a71-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh" level=info timestamp=2018-08-07T18:46:45.397383Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiqvzws5bxwh4dmjfq7rs54pjghqntqq7h4rmj462l4mcbr5w8hrdchpnf5cc6z5c kind= uid=3bbb752f-9a72-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:46:45.397540Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiqvzws5bxwh4dmjfq7rs54pjghqntqq7h4rmj462l4mcbr5w8hrdchpnf5cc6z5c kind= uid=3bbb752f-9a72-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:46:45.439230Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiqvzws5bxwh4dmjfq7rs54pjghqntqq7h4rmj462l4mcbr5w8hrdchpnf5cc6z5c\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiqvzws5bxwh4dmjfq7rs54pjghqntqq7h4rmj462l4mcbr5w8hrdchpnf5cc6z5c" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:25:40.035873Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:25:40.035923Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: true\n" level=info timestamp=2018-08-07T18:25:40.036466Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:25:40.036504Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:40.036581Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:40.044204Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:25:40.044292Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: true\n" level=info timestamp=2018-08-07T18:25:40.044319Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:25:40.044340Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:40.044389Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:40.044458Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:25:42.567879Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: false\n" level=info timestamp=2018-08-07T18:25:42.567990Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:42.568068Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:42.568140Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmiqvzws5bxwh4dmjfq7rs54pjghqntqq7h4rmj4j8bmg Pod phase: Pending level=info timestamp=2018-08-07T18:46:48.246068Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:46:48.246362Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:46:48.247788Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:46:58.255626Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:46:58.319243Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiqvzws5bxwh4dmjfq7rs54pjghqntqq7h4rmj462l4mcbr5w8hrdchpnf5cc6z5c" level=info timestamp=2018-08-07T18:46:58.321779Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:46:58.322044Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [180.223 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 when virt-handler is not responsive /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:371 the node controller should react [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:410 Timed out after 90.004s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T18:46:45.652757Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmiqvzws5bxwh4dmjfq7rs54pjghqntqq7h4rmj462l4mcbr5w8hrdchpnf5cc6z5c kind=VirtualMachineInstance uid=3bbb752f-9a72-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmiqvzws5bxwh4dmjfq7rs54pjghqntqq7h4rmj4j8bmg" Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running 2018/08/07 18:51:58 http: TLS handshake error from 10.244.1.1:52796: EOF level=info timestamp=2018-08-07T18:52:02.098642Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:52:02.582107Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:52:04.946715Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:52:08.007545Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:52:08 http: TLS handshake error from 10.244.1.1:52802: EOF level=info timestamp=2018-08-07T18:52:14.608448Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:52:18 http: TLS handshake error from 10.244.1.1:52808: EOF 2018/08/07 18:52:28 http: TLS handshake error from 10.244.1.1:52814: EOF level=info timestamp=2018-08-07T18:52:32.159489Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:52:32.627953Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:52:34.921733Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:52:38.032382Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:52:38 http: TLS handshake error from 10.244.1.1:52820: EOF level=info timestamp=2018-08-07T18:52:44.662904Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T18:39:46.391483Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht9ksbzvnnffwwfx6szjz6pfdksjh kind= uid=41fbd7d0-9a71-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:39:46.391849Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht9ksbzvnnffwwfx6szjz6pfdksjh kind= uid=41fbd7d0-9a71-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:42:46.582137Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht9ksbzvnnffwwfx6szjz6pfdksjh\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht9ksbzvnnffwwfx6szjz6pfdksjh, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 41fbd7d0-9a71-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixgghvls8r8vvslvncdv7f6h7xpxpg66t5sht9ksbzvnnffwwfx6szjz6pfdksjh" level=info timestamp=2018-08-07T18:42:46.773829Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh kind= uid=ad7e6109-9a71-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:42:46.774045Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh kind= uid=ad7e6109-9a71-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:42:46.818694Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh" level=info timestamp=2018-08-07T18:45:46.953688Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ad7e6109-9a71-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiw9vfnrl7xkd6ftv2546lz9ngrkxtcqv4wft74cf7xt9qm4qgqvlt9429lvp8tqh" level=info timestamp=2018-08-07T18:46:45.397383Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiqvzws5bxwh4dmjfq7rs54pjghqntqq7h4rmj462l4mcbr5w8hrdchpnf5cc6z5c kind= uid=3bbb752f-9a72-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:46:45.397540Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiqvzws5bxwh4dmjfq7rs54pjghqntqq7h4rmj462l4mcbr5w8hrdchpnf5cc6z5c kind= uid=3bbb752f-9a72-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:46:45.439230Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiqvzws5bxwh4dmjfq7rs54pjghqntqq7h4rmj462l4mcbr5w8hrdchpnf5cc6z5c\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiqvzws5bxwh4dmjfq7rs54pjghqntqq7h4rmj462l4mcbr5w8hrdchpnf5cc6z5c" level=info timestamp=2018-08-07T18:49:45.600801Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiqvzws5bxwh4dmjfq7rs54pjghqntqq7h4rmj462l4mcbr5w8hrdchpnf5cc6z5c\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiqvzws5bxwh4dmjfq7rs54pjghqntqq7h4rmj462l4mcbr5w8hrdchpnf5cc6z5c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3bbb752f-9a72-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiqvzws5bxwh4dmjfq7rs54pjghqntqq7h4rmj462l4mcbr5w8hrdchpnf5cc6z5c" level=info timestamp=2018-08-07T18:49:45.815586Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijlwlfdgfmt5gvwfn5wjbvbp2xq8zmzrctjb78dvg9pfbmpt2hq5vqcprsdk7jkx kind= uid=a7441793-9a72-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:49:45.815729Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijlwlfdgfmt5gvwfn5wjbvbp2xq8zmzrctjb78dvg9pfbmpt2hq5vqcprsdk7jkx kind= uid=a7441793-9a72-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:49:45.874513Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijlwlfdgfmt5gvwfn5wjbvbp2xq8zmzrctjb78dvg9pfbmpt2hq5vqcprsdk7jkx\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijlwlfdgfmt5gvwfn5wjbvbp2xq8zmzrctjb78dvg9pfbmpt2hq5vqcprsdk7jkx" level=info timestamp=2018-08-07T18:49:45.903341Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijlwlfdgfmt5gvwfn5wjbvbp2xq8zmzrctjb78dvg9pfbmpt2hq5vqcprsdk7jkx\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijlwlfdgfmt5gvwfn5wjbvbp2xq8zmzrctjb78dvg9pfbmpt2hq5vqcprsdk7jkx" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:25:40.035873Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:25:40.035923Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: true\n" level=info timestamp=2018-08-07T18:25:40.036466Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:25:40.036504Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:40.036581Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:40.044204Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:25:40.044292Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: true\n" level=info timestamp=2018-08-07T18:25:40.044319Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:25:40.044340Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:40.044389Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:40.044458Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind= uid=29eb8bb4-9a6f-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:25:42.567879Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv, existing: false\n" level=info timestamp=2018-08-07T18:25:42.567990Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:25:42.568068Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:25:42.568140Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-default name=testvmit6vtkbhmvbrccqwfnljxfdkkv4q4cq2kn9fxgpmphkt2sw87bpv4x5mwxsff4pv kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmijlwlfdgfmt5gvwfn5wjbvbp2xq8zmzrctjb78fw24c Pod phase: Pending level=info timestamp=2018-08-07T18:49:49.618561Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:49:49.618837Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:49:49.621610Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:49:59.629298Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:49:59.660190Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmijlwlfdgfmt5gvwfn5wjbvbp2xq8zmzrctjb78dvg9pfbmpt2hq5vqcprsdk7jkx" level=info timestamp=2018-08-07T18:49:59.662542Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:49:59.662860Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.420 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with node tainted /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:463 the vmi with tolerations should be scheduled [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:485 Timed out after 90.005s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T18:49:46.040463Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmijlwlfdgfmt5gvwfn5wjbvbp2xq8zmzrctjb78dvg9pfbmpt2hq5vqcprsdk7jkx kind=VirtualMachineInstance uid=a7441793-9a72-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmijlwlfdgfmt5gvwfn5wjbvbp2xq8zmzrctjb78fw24c" • ------------------------------ • [SLOW TEST:39.808 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with non default namespace /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:535 should log libvirt start and stop lifecycle events of the domain /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 kubevirt-test-default /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:39.772 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with non default namespace /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:535 should log libvirt start and stop lifecycle events of the domain /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 kubevirt-test-alternative /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.077 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 VirtualMachineInstance Emulation Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:592 should enable emulation in virt-launcher [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:604 Software emulation is not enabled on this cluster /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:600 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.064 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 VirtualMachineInstance Emulation Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:592 should be reflected in domain XML [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:641 Software emulation is not enabled on this cluster /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:600 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.087 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 VirtualMachineInstance Emulation Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:592 should request a TUN device but not KVM [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:685 Software emulation is not enabled on this cluster /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:600 ------------------------------ •••• Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running level=info timestamp=2018-08-07T18:56:09.957523Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:56:15.039796Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:56:18 http: TLS handshake error from 10.244.1.1:52952: EOF 2018/08/07 18:56:28 http: TLS handshake error from 10.244.1.1:52958: EOF level=info timestamp=2018-08-07T18:56:32.573934Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:56:33.049596Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:56:34.923570Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:56:38.226374Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:56:38 http: TLS handshake error from 10.244.1.1:52964: EOF level=info timestamp=2018-08-07T18:56:45.093465Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:56:48 http: TLS handshake error from 10.244.1.1:52970: EOF 2018/08/07 18:56:58 http: TLS handshake error from 10.244.1.1:52976: EOF level=info timestamp=2018-08-07T18:57:02.627829Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:57:03.101996Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:57:04.940783Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T18:52:47.641609Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibpnjkfrnlrgljhg822nsfr8smdftqkch7h78mkq5pzjg6rfztmx97zsq6p6vv7q\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibpnjkfrnlrgljhg822nsfr8smdftqkch7h78mkq5pzjg6rfztmx97zsq6p6vv7q" level=info timestamp=2018-08-07T18:52:47.658529Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibpnjkfrnlrgljhg822nsfr8smdftqkch7h78mkq5pzjg6rfztmx97zsq6p6vv7q\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibpnjkfrnlrgljhg822nsfr8smdftqkch7h78mkq5pzjg6rfztmx97zsq6p6vv7q" level=info timestamp=2018-08-07T18:53:27.279518Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:53:27.280899Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:53:27.388447Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-alternative/testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t" level=info timestamp=2018-08-07T18:54:07.226783Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvminhngxqdtj29zzv6s4dqh4967mzfhc92zmv26stbnlb5mpk76gwqxcjtpwmbm4t5 kind= uid=43145945-9a73-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:54:07.228854Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvminhngxqdtj29zzv6s4dqh4967mzfhc92zmv26stbnlb5mpk76gwqxcjtpwmbm4t5 kind= uid=43145945-9a73-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:54:07.321757Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvminhngxqdtj29zzv6s4dqh4967mzfhc92zmv26stbnlb5mpk76gwqxcjtpwmbm4t5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvminhngxqdtj29zzv6s4dqh4967mzfhc92zmv26stbnlb5mpk76gwqxcjtpwmbm4t5" level=info timestamp=2018-08-07T18:54:07.818454Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvminhngxqdtj29zzv6s4dqh4967mzfhc92zmv26stbnlb5mpk76gwqxcjtpwmbm4t5\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvminhngxqdtj29zzv6s4dqh4967mzfhc92zmv26stbnlb5mpk76gwqxcjtpwmbm4t5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 43145945-9a73-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvminhngxqdtj29zzv6s4dqh4967mzfhc92zmv26stbnlb5mpk76gwqxcjtpwmbm4t5" level=info timestamp=2018-08-07T18:54:07.983426Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv5zxrjj94d4hrzml46kqbvv4pnsh4b7fvdbffs5db7pb76ghmzdxcdw52xvc97s kind= uid=43891ad1-9a73-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:54:07.983578Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv5zxrjj94d4hrzml46kqbvv4pnsh4b7fvdbffs5db7pb76ghmzdxcdw52xvc97s kind= uid=43891ad1-9a73-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:54:08.073545Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiv5zxrjj94d4hrzml46kqbvv4pnsh4b7fvdbffs5db7pb76ghmzdxcdw52xvc97s\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiv5zxrjj94d4hrzml46kqbvv4pnsh4b7fvdbffs5db7pb76ghmzdxcdw52xvc97s, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 43891ad1-9a73-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiv5zxrjj94d4hrzml46kqbvv4pnsh4b7fvdbffs5db7pb76ghmzdxcdw52xvc97s" level=info timestamp=2018-08-07T18:54:08.390189Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q kind= uid=43c7337e-9a73-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:54:08.390313Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q kind= uid=43c7337e-9a73-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:54:08.433028Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:54:00.452465Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:54:00.452560Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.452587Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.452620Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.452692Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.452888Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:00.453673Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.453708Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.453737Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.453823Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.454286Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:06.122246Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: false\n" level=info timestamp=2018-08-07T18:54:06.122317Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:06.122393Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:06.122464Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jkpzbmk Pod phase: Pending level=info timestamp=2018-08-07T18:54:11.370105Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:54:11.370881Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:54:11.372949Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:54:21.381563Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:54:21.418823Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q" level=info timestamp=2018-08-07T18:54:21.420660Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:54:21.420867Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure [180.225 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance's Pod /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:837 should result in the VirtualMachineInstance moving to a finalized state [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:838 Timed out after 90.008s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-07T18:54:08.597893Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q kind=VirtualMachineInstance uid=43c7337e-9a73-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jkpzbmk" Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running 2018/08/07 18:59:08 http: TLS handshake error from 10.244.1.1:53054: EOF level=info timestamp=2018-08-07T18:59:15.364364Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:59:18 http: TLS handshake error from 10.244.1.1:53060: EOF 2018/08/07 18:59:28 http: TLS handshake error from 10.244.1.1:53066: EOF level=info timestamp=2018-08-07T18:59:32.884131Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:59:33.366275Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:59:34.941833Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:59:38.396033Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:59:38 http: TLS handshake error from 10.244.1.1:53072: EOF level=info timestamp=2018-08-07T18:59:45.417970Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:59:48 http: TLS handshake error from 10.244.1.1:53078: EOF 2018/08/07 18:59:58 http: TLS handshake error from 10.244.1.1:53084: EOF level=info timestamp=2018-08-07T19:00:02.937736Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:00:03.420687Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:00:04.959072Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T18:53:27.280899Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:53:27.388447Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-alternative/testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t" level=info timestamp=2018-08-07T18:54:07.226783Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvminhngxqdtj29zzv6s4dqh4967mzfhc92zmv26stbnlb5mpk76gwqxcjtpwmbm4t5 kind= uid=43145945-9a73-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:54:07.228854Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvminhngxqdtj29zzv6s4dqh4967mzfhc92zmv26stbnlb5mpk76gwqxcjtpwmbm4t5 kind= uid=43145945-9a73-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:54:07.321757Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvminhngxqdtj29zzv6s4dqh4967mzfhc92zmv26stbnlb5mpk76gwqxcjtpwmbm4t5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvminhngxqdtj29zzv6s4dqh4967mzfhc92zmv26stbnlb5mpk76gwqxcjtpwmbm4t5" level=info timestamp=2018-08-07T18:54:07.818454Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvminhngxqdtj29zzv6s4dqh4967mzfhc92zmv26stbnlb5mpk76gwqxcjtpwmbm4t5\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvminhngxqdtj29zzv6s4dqh4967mzfhc92zmv26stbnlb5mpk76gwqxcjtpwmbm4t5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 43145945-9a73-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvminhngxqdtj29zzv6s4dqh4967mzfhc92zmv26stbnlb5mpk76gwqxcjtpwmbm4t5" level=info timestamp=2018-08-07T18:54:07.983426Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv5zxrjj94d4hrzml46kqbvv4pnsh4b7fvdbffs5db7pb76ghmzdxcdw52xvc97s kind= uid=43891ad1-9a73-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:54:07.983578Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv5zxrjj94d4hrzml46kqbvv4pnsh4b7fvdbffs5db7pb76ghmzdxcdw52xvc97s kind= uid=43891ad1-9a73-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:54:08.073545Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiv5zxrjj94d4hrzml46kqbvv4pnsh4b7fvdbffs5db7pb76ghmzdxcdw52xvc97s\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiv5zxrjj94d4hrzml46kqbvv4pnsh4b7fvdbffs5db7pb76ghmzdxcdw52xvc97s, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 43891ad1-9a73-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiv5zxrjj94d4hrzml46kqbvv4pnsh4b7fvdbffs5db7pb76ghmzdxcdw52xvc97s" level=info timestamp=2018-08-07T18:54:08.390189Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q kind= uid=43c7337e-9a73-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:54:08.390313Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q kind= uid=43c7337e-9a73-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:54:08.433028Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q" level=info timestamp=2018-08-07T18:57:08.595648Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 43c7337e-9a73-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q" level=info timestamp=2018-08-07T18:57:08.798497Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b kind= uid=af4d1257-9a73-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:57:08.798662Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b kind= uid=af4d1257-9a73-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:54:00.452465Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:54:00.452560Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.452587Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.452620Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.452692Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.452888Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:00.453673Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.453708Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.453737Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.453823Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.454286Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:06.122246Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: false\n" level=info timestamp=2018-08-07T18:54:06.122317Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:06.122393Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:06.122464Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmwxrhw7 Pod phase: Pending level=info timestamp=2018-08-07T18:57:11.183668Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:57:11.185510Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:57:11.187667Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:57:21.207987Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:57:21.233570Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b" level=info timestamp=2018-08-07T18:57:21.237452Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:57:21.237644Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.410 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:869 with an active pod. /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:870 should result in pod being terminated [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:871 Timed out after 90.009s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-07T18:57:08.986466Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b kind=VirtualMachineInstance uid=af4d1257-9a73-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmwxrhw7" Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running 2018/08/07 19:02:18 http: TLS handshake error from 10.244.1.1:53168: EOF 2018/08/07 19:02:28 http: TLS handshake error from 10.244.1.1:53174: EOF level=info timestamp=2018-08-07T19:02:33.198594Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:02:33.683489Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:02:34.950691Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:02:38.549820Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:02:38 http: TLS handshake error from 10.244.1.1:53180: EOF level=info timestamp=2018-08-07T19:02:45.784387Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:02:48 http: TLS handshake error from 10.244.1.1:53186: EOF 2018/08/07 19:02:58 http: TLS handshake error from 10.244.1.1:53192: EOF level=info timestamp=2018-08-07T19:03:03.250850Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:03:03.732926Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:03:04.950003Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:03:08.573358Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:03:08 http: TLS handshake error from 10.244.1.1:53198: EOF Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T18:54:07.321757Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvminhngxqdtj29zzv6s4dqh4967mzfhc92zmv26stbnlb5mpk76gwqxcjtpwmbm4t5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvminhngxqdtj29zzv6s4dqh4967mzfhc92zmv26stbnlb5mpk76gwqxcjtpwmbm4t5" level=info timestamp=2018-08-07T18:54:07.818454Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvminhngxqdtj29zzv6s4dqh4967mzfhc92zmv26stbnlb5mpk76gwqxcjtpwmbm4t5\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvminhngxqdtj29zzv6s4dqh4967mzfhc92zmv26stbnlb5mpk76gwqxcjtpwmbm4t5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 43145945-9a73-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvminhngxqdtj29zzv6s4dqh4967mzfhc92zmv26stbnlb5mpk76gwqxcjtpwmbm4t5" level=info timestamp=2018-08-07T18:54:07.983426Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv5zxrjj94d4hrzml46kqbvv4pnsh4b7fvdbffs5db7pb76ghmzdxcdw52xvc97s kind= uid=43891ad1-9a73-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:54:07.983578Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv5zxrjj94d4hrzml46kqbvv4pnsh4b7fvdbffs5db7pb76ghmzdxcdw52xvc97s kind= uid=43891ad1-9a73-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:54:08.073545Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiv5zxrjj94d4hrzml46kqbvv4pnsh4b7fvdbffs5db7pb76ghmzdxcdw52xvc97s\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiv5zxrjj94d4hrzml46kqbvv4pnsh4b7fvdbffs5db7pb76ghmzdxcdw52xvc97s, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 43891ad1-9a73-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiv5zxrjj94d4hrzml46kqbvv4pnsh4b7fvdbffs5db7pb76ghmzdxcdw52xvc97s" level=info timestamp=2018-08-07T18:54:08.390189Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q kind= uid=43c7337e-9a73-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:54:08.390313Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q kind= uid=43c7337e-9a73-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:54:08.433028Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q" level=info timestamp=2018-08-07T18:57:08.595648Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 43c7337e-9a73-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q" level=info timestamp=2018-08-07T18:57:08.798497Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b kind= uid=af4d1257-9a73-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:57:08.798662Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b kind= uid=af4d1257-9a73-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:00:09.036617Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: af4d1257-9a73-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b" level=info timestamp=2018-08-07T19:00:09.201635Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz kind= uid=1ad58ecc-9a74-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:00:09.203037Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz kind= uid=1ad58ecc-9a74-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:00:09.242763Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:54:00.452465Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:54:00.452560Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.452587Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.452620Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.452692Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.452888Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:00.453673Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.453708Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.453737Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.453823Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.454286Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:06.122246Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: false\n" level=info timestamp=2018-08-07T18:54:06.122317Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:06.122393Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:06.122464Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn42gdcd Pod phase: Pending level=info timestamp=2018-08-07T19:00:12.129534Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:00:12.129854Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:00:12.132598Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:00:22.142349Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:00:22.161424Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz" level=info timestamp=2018-08-07T19:00:22.163508Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:00:22.163677Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.371 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:869 with ACPI and 0 grace period seconds /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:895 should result in vmi status failed [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:896 Timed out after 90.005s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-07T19:00:09.414607Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz kind=VirtualMachineInstance uid=1ad58ecc-9a74-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn42gdcd" Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running 2018/08/07 19:05:18 http: TLS handshake error from 10.244.1.1:53276: EOF 2018/08/07 19:05:28 http: TLS handshake error from 10.244.1.1:53282: EOF level=info timestamp=2018-08-07T19:05:33.525693Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:05:33.992247Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:05:34.937875Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:05:38 http: TLS handshake error from 10.244.1.1:53288: EOF level=info timestamp=2018-08-07T19:05:38.686702Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:05:46.107653Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:05:48 http: TLS handshake error from 10.244.1.1:53294: EOF 2018/08/07 19:05:58 http: TLS handshake error from 10.244.1.1:53300: EOF level=info timestamp=2018-08-07T19:06:03.577586Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:06:04.043494Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:06:04.948578Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:06:08 http: TLS handshake error from 10.244.1.1:53306: EOF level=info timestamp=2018-08-07T19:06:08.710905Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T18:54:07.983578Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv5zxrjj94d4hrzml46kqbvv4pnsh4b7fvdbffs5db7pb76ghmzdxcdw52xvc97s kind= uid=43891ad1-9a73-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:54:08.073545Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiv5zxrjj94d4hrzml46kqbvv4pnsh4b7fvdbffs5db7pb76ghmzdxcdw52xvc97s\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiv5zxrjj94d4hrzml46kqbvv4pnsh4b7fvdbffs5db7pb76ghmzdxcdw52xvc97s, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 43891ad1-9a73-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiv5zxrjj94d4hrzml46kqbvv4pnsh4b7fvdbffs5db7pb76ghmzdxcdw52xvc97s" level=info timestamp=2018-08-07T18:54:08.390189Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q kind= uid=43c7337e-9a73-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:54:08.390313Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q kind= uid=43c7337e-9a73-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:54:08.433028Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q" level=info timestamp=2018-08-07T18:57:08.595648Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 43c7337e-9a73-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q" level=info timestamp=2018-08-07T18:57:08.798497Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b kind= uid=af4d1257-9a73-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:57:08.798662Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b kind= uid=af4d1257-9a73-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:00:09.036617Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: af4d1257-9a73-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b" level=info timestamp=2018-08-07T19:00:09.201635Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz kind= uid=1ad58ecc-9a74-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:00:09.203037Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz kind= uid=1ad58ecc-9a74-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:00:09.242763Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz" level=info timestamp=2018-08-07T19:03:09.379389Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1ad58ecc-9a74-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz" level=info timestamp=2018-08-07T19:03:09.566181Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85bkqks4nclw8zg47f5wqqljt966 kind= uid=8657b7ad-9a74-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:03:09.566359Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85bkqks4nclw8zg47f5wqqljt966 kind= uid=8657b7ad-9a74-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:54:00.452465Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:54:00.452560Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.452587Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.452620Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.452692Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.452888Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:00.453673Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.453708Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.453737Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.453823Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.454286Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:06.122246Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: false\n" level=info timestamp=2018-08-07T18:54:06.122317Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:06.122393Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:06.122464Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85v226z Pod phase: Pending level=info timestamp=2018-08-07T19:03:12.637474Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:03:12.637751Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:03:12.641053Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:03:22.649053Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:03:22.697467Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85bkqks4nclw8zg47f5wqqljt966" level=info timestamp=2018-08-07T19:03:22.699781Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:03:22.699953Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.374 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:869 with ACPI and some grace period seconds /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:920 should result in vmi status succeeded [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:921 Timed out after 90.005s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-07T19:03:09.750975Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85bkqks4nclw8zg47f5wqqljt966 kind=VirtualMachineInstance uid=8657b7ad-9a74-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85v226z" Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running 2018/08/07 19:08:18 http: TLS handshake error from 10.244.1.1:53384: EOF 2018/08/07 19:08:28 http: TLS handshake error from 10.244.1.1:53390: EOF level=info timestamp=2018-08-07T19:08:33.833841Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:08:34.316489Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:08:34.958901Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:08:38 http: TLS handshake error from 10.244.1.1:53396: EOF level=info timestamp=2018-08-07T19:08:38.829792Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:08:46.434662Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:08:48 http: TLS handshake error from 10.244.1.1:53402: EOF 2018/08/07 19:08:58 http: TLS handshake error from 10.244.1.1:53408: EOF level=info timestamp=2018-08-07T19:09:03.888106Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:09:04.363380Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:09:04.938864Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:09:08 http: TLS handshake error from 10.244.1.1:53414: EOF level=info timestamp=2018-08-07T19:09:08.850717Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T18:54:08.390313Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q kind= uid=43c7337e-9a73-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:54:08.433028Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q" level=info timestamp=2018-08-07T18:57:08.595648Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 43c7337e-9a73-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi228nkvwlv2dgcvq7kpx9jrxnlrvqsrdkn28jk2fxkvjf5hrm59j4zj2gctkxr2q" level=info timestamp=2018-08-07T18:57:08.798497Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b kind= uid=af4d1257-9a73-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:57:08.798662Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b kind= uid=af4d1257-9a73-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:00:09.036617Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: af4d1257-9a73-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b" level=info timestamp=2018-08-07T19:00:09.201635Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz kind= uid=1ad58ecc-9a74-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:00:09.203037Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz kind= uid=1ad58ecc-9a74-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:00:09.242763Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz" level=info timestamp=2018-08-07T19:03:09.379389Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1ad58ecc-9a74-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz" level=info timestamp=2018-08-07T19:03:09.566181Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85bkqks4nclw8zg47f5wqqljt966 kind= uid=8657b7ad-9a74-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:03:09.566359Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85bkqks4nclw8zg47f5wqqljt966 kind= uid=8657b7ad-9a74-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:06:09.759392Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85bkqks4nclw8zg47f5wqqljt966\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85bkqks4nclw8zg47f5wqqljt966, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8657b7ad-9a74-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85bkqks4nclw8zg47f5wqqljt966" level=info timestamp=2018-08-07T19:06:09.956563Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9hgdn9zhrc5zbbxnthcnkzcj2fgbbzp84wgq5s68fmssxd67rf9kdd4dzwb9qdh kind= uid=f1dce510-9a74-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:06:09.956735Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9hgdn9zhrc5zbbxnthcnkzcj2fgbbzp84wgq5s68fmssxd67rf9kdd4dzwb9qdh kind= uid=f1dce510-9a74-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:54:00.452465Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:54:00.452560Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.452587Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.452620Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.452692Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.452888Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:00.453673Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.453708Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.453737Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.453823Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.454286Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:06.122246Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: false\n" level=info timestamp=2018-08-07T18:54:06.122317Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:06.122393Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:06.122464Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi9hgdn9zhrc5zbbxnthcnkzcj2fgbbzp84wgq5ch4s9 Pod phase: Pending level=info timestamp=2018-08-07T19:06:13.544852Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:06:13.545284Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:06:13.546718Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:06:23.555368Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:06:23.604333Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi9hgdn9zhrc5zbbxnthcnkzcj2fgbbzp84wgq5s68fmssxd67rf9kdd4dzwb9qdh" level=info timestamp=2018-08-07T19:06:23.607324Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:06:23.607569Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.412 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:869 with grace period greater than 0 /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:945 should run graceful shutdown [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:946 Timed out after 90.004s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Setting a VirtualMachineInstance termination grace period to 5 STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-07T19:06:10.147804Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi9hgdn9zhrc5zbbxnthcnkzcj2fgbbzp84wgq5s68fmssxd67rf9kdd4dzwb9qdh kind=VirtualMachineInstance uid=f1dce510-9a74-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi9hgdn9zhrc5zbbxnthcnkzcj2fgbbzp84wgq5ch4s9" Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running 2018/08/07 19:11:18 http: TLS handshake error from 10.244.1.1:53492: EOF 2018/08/07 19:11:28 http: TLS handshake error from 10.244.1.1:53498: EOF level=info timestamp=2018-08-07T19:11:34.144087Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:11:34.626065Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:11:34.945976Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:11:38 http: TLS handshake error from 10.244.1.1:53504: EOF level=info timestamp=2018-08-07T19:11:38.970864Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:11:46.820743Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:11:48 http: TLS handshake error from 10.244.1.1:53510: EOF 2018/08/07 19:11:58 http: TLS handshake error from 10.244.1.1:53516: EOF level=info timestamp=2018-08-07T19:12:04.197899Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:12:04.678414Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:12:04.947178Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:12:08 http: TLS handshake error from 10.244.1.1:53522: EOF level=info timestamp=2018-08-07T19:12:08.994244Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T18:57:08.798662Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b kind= uid=af4d1257-9a73-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:00:09.036617Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: af4d1257-9a73-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiw2fnhfmtvsp8g4h9h6s9p9fzhvqnd98fd7gmw2dc978l4hnccv8zxvcfxqrpg6b" level=info timestamp=2018-08-07T19:00:09.201635Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz kind= uid=1ad58ecc-9a74-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:00:09.203037Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz kind= uid=1ad58ecc-9a74-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:00:09.242763Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz" level=info timestamp=2018-08-07T19:03:09.379389Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1ad58ecc-9a74-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz" level=info timestamp=2018-08-07T19:03:09.566181Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85bkqks4nclw8zg47f5wqqljt966 kind= uid=8657b7ad-9a74-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:03:09.566359Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85bkqks4nclw8zg47f5wqqljt966 kind= uid=8657b7ad-9a74-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:06:09.759392Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85bkqks4nclw8zg47f5wqqljt966\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85bkqks4nclw8zg47f5wqqljt966, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8657b7ad-9a74-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85bkqks4nclw8zg47f5wqqljt966" level=info timestamp=2018-08-07T19:06:09.956563Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9hgdn9zhrc5zbbxnthcnkzcj2fgbbzp84wgq5s68fmssxd67rf9kdd4dzwb9qdh kind= uid=f1dce510-9a74-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:06:09.956735Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9hgdn9zhrc5zbbxnthcnkzcj2fgbbzp84wgq5s68fmssxd67rf9kdd4dzwb9qdh kind= uid=f1dce510-9a74-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:09:10.184425Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9hgdn9zhrc5zbbxnthcnkzcj2fgbbzp84wgq5s68fmssxd67rf9kdd4dzwb9qdh\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi9hgdn9zhrc5zbbxnthcnkzcj2fgbbzp84wgq5s68fmssxd67rf9kdd4dzwb9qdh, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f1dce510-9a74-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9hgdn9zhrc5zbbxnthcnkzcj2fgbbzp84wgq5s68fmssxd67rf9kdd4dzwb9qdh" level=info timestamp=2018-08-07T19:09:10.356625Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5 kind= uid=5d63ee7d-9a75-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:09:10.356785Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5 kind= uid=5d63ee7d-9a75-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:09:10.392742Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:54:00.452465Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:54:00.452560Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.452587Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.452620Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.452692Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.452888Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:00.453673Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.453708Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.453737Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.453823Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.454286Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:06.122246Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: false\n" level=info timestamp=2018-08-07T18:54:06.122317Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:06.122393Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:06.122464Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5x8kzb Pod phase: Pending level=info timestamp=2018-08-07T19:09:13.020716Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:09:13.020986Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:09:13.024044Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:09:23.033557Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:09:23.053894Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5" level=info timestamp=2018-08-07T19:09:23.057086Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:09:23.057351Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.353 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Killed VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:997 should be in Failed phase [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:998 Timed out after 90.004s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Starting a VirtualMachineInstance level=info timestamp=2018-08-07T19:09:10.552605Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5 kind=VirtualMachineInstance uid=5d63ee7d-9a75-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5x8kzb" Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running level=info timestamp=2018-08-07T19:14:34.944464Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:14:38 http: TLS handshake error from 10.244.1.1:53612: EOF level=info timestamp=2018-08-07T19:14:39.104323Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:14:47.148588Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:14:48 http: TLS handshake error from 10.244.1.1:53618: EOF 2018/08/07 19:14:58 http: TLS handshake error from 10.244.1.1:53624: EOF level=info timestamp=2018-08-07T19:15:04.509027Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:15:04.884927Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:15:04.894441Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:15:04.941654Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:15:04.985543Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:15:08 http: TLS handshake error from 10.244.1.1:53630: EOF level=info timestamp=2018-08-07T19:15:09.125896Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:15:09.963784Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:15:09.964719Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T19:00:09.203037Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz kind= uid=1ad58ecc-9a74-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:00:09.242763Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz" level=info timestamp=2018-08-07T19:03:09.379389Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1ad58ecc-9a74-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicmxd2nzwk69wjdj26fv2s9ftljkq8m85h9tn4w8gwgds6f4hcpx2jkxflfjlxrz" level=info timestamp=2018-08-07T19:03:09.566181Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85bkqks4nclw8zg47f5wqqljt966 kind= uid=8657b7ad-9a74-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:03:09.566359Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85bkqks4nclw8zg47f5wqqljt966 kind= uid=8657b7ad-9a74-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:06:09.759392Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85bkqks4nclw8zg47f5wqqljt966\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85bkqks4nclw8zg47f5wqqljt966, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8657b7ad-9a74-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimwk58cxc9rv695q59s4w8clhbvqn7x498mj85bkqks4nclw8zg47f5wqqljt966" level=info timestamp=2018-08-07T19:06:09.956563Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9hgdn9zhrc5zbbxnthcnkzcj2fgbbzp84wgq5s68fmssxd67rf9kdd4dzwb9qdh kind= uid=f1dce510-9a74-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:06:09.956735Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9hgdn9zhrc5zbbxnthcnkzcj2fgbbzp84wgq5s68fmssxd67rf9kdd4dzwb9qdh kind= uid=f1dce510-9a74-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:09:10.184425Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9hgdn9zhrc5zbbxnthcnkzcj2fgbbzp84wgq5s68fmssxd67rf9kdd4dzwb9qdh\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi9hgdn9zhrc5zbbxnthcnkzcj2fgbbzp84wgq5s68fmssxd67rf9kdd4dzwb9qdh, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f1dce510-9a74-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9hgdn9zhrc5zbbxnthcnkzcj2fgbbzp84wgq5s68fmssxd67rf9kdd4dzwb9qdh" level=info timestamp=2018-08-07T19:09:10.356625Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5 kind= uid=5d63ee7d-9a75-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:09:10.356785Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5 kind= uid=5d63ee7d-9a75-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:09:10.392742Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5" level=info timestamp=2018-08-07T19:12:10.526125Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5d63ee7d-9a75-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5" level=info timestamp=2018-08-07T19:12:10.714256Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8zrdrgbwkx2jsbp8wgm7m29mj5hwbrjk5dhtfghzcqcrmwlx9r9b22jvbvn29cp kind= uid=c8e44bd9-9a75-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:12:10.714419Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8zrdrgbwkx2jsbp8wgm7m29mj5hwbrjk5dhtfghzcqcrmwlx9r9b22jvbvn29cp kind= uid=c8e44bd9-9a75-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:54:00.452465Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:54:00.452560Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.452587Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.452620Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.452692Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.452888Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:00.453673Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.453708Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.453737Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.453823Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.454286Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:06.122246Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: false\n" level=info timestamp=2018-08-07T18:54:06.122317Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:06.122393Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:06.122464Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi8zrdrgbwkx2jsbp8wgm7m29mj5hwbrjk5dhtfxl2pg Pod phase: Pending level=info timestamp=2018-08-07T19:12:13.986286Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:12:13.986781Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:12:13.988626Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:12:23.995921Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:12:24.034790Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi8zrdrgbwkx2jsbp8wgm7m29mj5hwbrjk5dhtfghzcqcrmwlx9r9b22jvbvn29cp" level=info timestamp=2018-08-07T19:12:24.036614Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:12:24.036786Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.381 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Killed VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:997 should be left alone by virt-handler [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:1025 Timed out after 90.004s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Starting a VirtualMachineInstance level=info timestamp=2018-08-07T19:12:10.947361Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi8zrdrgbwkx2jsbp8wgm7m29mj5hwbrjk5dhtfghzcqcrmwlx9r9b22jvbvn29cp kind=VirtualMachineInstance uid=c8e44bd9-9a75-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi8zrdrgbwkx2jsbp8wgm7m29mj5hwbrjk5dhtfxl2pg" • [SLOW TEST:6.450 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given a vmi /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:5.147 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given an vm /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:5.242 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given a vmi preset /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:5.090 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given a vmi replica set /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running 2018/08/07 19:17:38 http: TLS handshake error from 10.244.1.1:53720: EOF level=info timestamp=2018-08-07T19:17:39.241248Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:17:47.482007Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:17:48 http: TLS handshake error from 10.244.1.1:53726: EOF 2018/08/07 19:17:58 http: TLS handshake error from 10.244.1.1:53732: EOF level=info timestamp=2018-08-07T19:18:04.823697Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:18:04.952592Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:18:05.298859Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:18:08 http: TLS handshake error from 10.244.1.1:53738: EOF level=info timestamp=2018-08-07T19:18:09.262280Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:18:09.970132Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:18:09.971556Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:18:17.536857Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:18:18 http: TLS handshake error from 10.244.1.1:53744: EOF 2018/08/07 19:18:28 http: TLS handshake error from 10.244.1.1:53750: EOF Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T19:09:10.356625Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5 kind= uid=5d63ee7d-9a75-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:09:10.356785Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5 kind= uid=5d63ee7d-9a75-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:09:10.392742Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5" level=info timestamp=2018-08-07T19:12:10.526125Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5d63ee7d-9a75-11e8-8d82-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmippntdr2gfct2995jp5bvfr4z94whr28k2rxd5llntfthdw6hh84qjr4zmw4grj5" level=info timestamp=2018-08-07T19:12:10.714256Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8zrdrgbwkx2jsbp8wgm7m29mj5hwbrjk5dhtfghzcqcrmwlx9r9b22jvbvn29cp kind= uid=c8e44bd9-9a75-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:12:10.714419Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8zrdrgbwkx2jsbp8wgm7m29mj5hwbrjk5dhtfghzcqcrmwlx9r9b22jvbvn29cp kind= uid=c8e44bd9-9a75-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:15:32.870077Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmir95tjrtwv6l9j5kt98p6n88dt66phnzz9bjqzc5mnl9sjv5nlh6knmfz27m4zsw kind= uid=416290ac-9a76-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:15:32.870236Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmir95tjrtwv6l9j5kt98p6n88dt66phnzz9bjqzc5mnl9sjv5nlh6knmfz27m4zsw kind= uid=416290ac-9a76-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:15:32.890579Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin42n5m2rpjwrw9jdlhzxr6g82hfm6g47vntwhkt2vgqbj9w2xvg9qzrv2dhml9s kind= uid=4165ad6f-9a76-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:15:32.891273Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin42n5m2rpjwrw9jdlhzxr6g82hfm6g47vntwhkt2vgqbj9w2xvg9qzrv2dhml9s kind= uid=4165ad6f-9a76-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:15:32.900504Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4h7nc6p72gh2r2ftqjzw4p8l9hn4bggbmc2p9r5dj9274whqqd9dhnp9gmpwfw9 kind= uid=41675bc0-9a76-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:15:32.900657Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4h7nc6p72gh2r2ftqjzw4p8l9hn4bggbmc2p9r5dj9274whqqd9dhnp9gmpwfw9 kind= uid=41675bc0-9a76-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:15:32.931246Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8kssqjm6ztc2g2bz7vstlmwm7x5ch52r5x5qdhs266lctnqbwmsx658p2cbf5zs kind= uid=41689be2-9a76-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:15:32.931364Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8kssqjm6ztc2g2bz7vstlmwm7x5ch52r5x5qdhs266lctnqbwmsx658p2cbf5zs kind= uid=41689be2-9a76-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:15:32.941103Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmir95tjrtwv6l9j5kt98p6n88dt66phnzz9bjqzc5mnl9sjv5nlh6knmfz27m4zsw\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmir95tjrtwv6l9j5kt98p6n88dt66phnzz9bjqzc5mnl9sjv5nlh6knmfz27m4zsw" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:54:00.452465Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:54:00.452560Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.452587Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.452620Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.452692Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.452888Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:00.453673Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.453708Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.453737Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.453823Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.454286Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:06.122246Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: false\n" level=info timestamp=2018-08-07T18:54:06.122317Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:06.122393Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:06.122464Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi4h7nc6p72gh2r2ftqjzw4p8l9hn4bggbmc2p985blq Pod phase: Pending level=info timestamp=2018-08-07T19:15:37.264843Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:15:37.267742Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:15:37.270367Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:15:47.276017Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:15:47.302691Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi4h7nc6p72gh2r2ftqjzw4p8l9hn4bggbmc2p9r5dj9274whqqd9dhnp9gmpwfw9" level=info timestamp=2018-08-07T19:15:47.305232Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:15:47.305538Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmi8kssqjm6ztc2g2bz7vstlmwm7x5ch52r5x5qdkg27r Pod phase: Pending level=info timestamp=2018-08-07T19:15:37.408731Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:15:37.409474Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:15:37.418438Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:15:47.438362Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:15:47.463923Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi8kssqjm6ztc2g2bz7vstlmwm7x5ch52r5x5qdhs266lctnqbwmsx658p2cbf5zs" level=info timestamp=2018-08-07T19:15:47.466758Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:15:47.466941Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmin42n5m2rpjwrw9jdlhzxr6g82hfm6g47vntwhfrq6l Pod phase: Pending level=info timestamp=2018-08-07T19:15:36.356281Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:15:36.356750Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:15:36.359094Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:15:46.366561Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:15:46.417627Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmin42n5m2rpjwrw9jdlhzxr6g82hfm6g47vntwhkt2vgqbj9w2xvg9qzrv2dhml9s" level=info timestamp=2018-08-07T19:15:46.426030Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:15:46.426248Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmir95tjrtwv6l9j5kt98p6n88dt66phnzz9bjqzjjbtg Pod phase: Pending level=info timestamp=2018-08-07T19:15:36.002327Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:15:36.002606Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:15:36.004553Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:15:46.043677Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:15:46.071508Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmir95tjrtwv6l9j5kt98p6n88dt66phnzz9bjqzc5mnl9sjv5nlh6knmfz27m4zsw" level=info timestamp=2018-08-07T19:15:46.075000Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:15:46.075195Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [180.758 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be able to reach [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 the Inbound VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.004s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:15:33.086190Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmir95tjrtwv6l9j5kt98p6n88dt66phnzz9bjqzc5mnl9sjv5nlh6knmfz27m4zsw kind=VirtualMachineInstance uid=416290ac-9a76-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmir95tjrtwv6l9j5kt98p6n88dt66phnzz9bjqzjjbtg" Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running 2018/08/07 19:20:38 http: TLS handshake error from 10.244.1.1:53828: EOF level=info timestamp=2018-08-07T19:20:39.374386Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:20:47.817871Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:20:48 http: TLS handshake error from 10.244.1.1:53834: EOF 2018/08/07 19:20:58 http: TLS handshake error from 10.244.1.1:53840: EOF level=info timestamp=2018-08-07T19:21:04.953276Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:21:05.271273Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:21:05.637407Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:21:08 http: TLS handshake error from 10.244.1.1:53846: EOF level=info timestamp=2018-08-07T19:21:09.392993Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:21:10.148071Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:21:10.149697Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:21:17.872514Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:21:18 http: TLS handshake error from 10.244.1.1:53852: EOF 2018/08/07 19:21:28 http: TLS handshake error from 10.244.1.1:53858: EOF Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T19:15:32.900504Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4h7nc6p72gh2r2ftqjzw4p8l9hn4bggbmc2p9r5dj9274whqqd9dhnp9gmpwfw9 kind= uid=41675bc0-9a76-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:15:32.900657Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4h7nc6p72gh2r2ftqjzw4p8l9hn4bggbmc2p9r5dj9274whqqd9dhnp9gmpwfw9 kind= uid=41675bc0-9a76-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:15:32.931246Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8kssqjm6ztc2g2bz7vstlmwm7x5ch52r5x5qdhs266lctnqbwmsx658p2cbf5zs kind= uid=41689be2-9a76-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:15:32.931364Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8kssqjm6ztc2g2bz7vstlmwm7x5ch52r5x5qdhs266lctnqbwmsx658p2cbf5zs kind= uid=41689be2-9a76-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:15:32.941103Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmir95tjrtwv6l9j5kt98p6n88dt66phnzz9bjqzc5mnl9sjv5nlh6knmfz27m4zsw\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmir95tjrtwv6l9j5kt98p6n88dt66phnzz9bjqzc5mnl9sjv5nlh6knmfz27m4zsw" level=info timestamp=2018-08-07T19:18:34.381830Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimkpr2trvqfkqzw94qpjzmgvg6q6sw4tjggq8t2d88jvvtjt7qgjrxxq5vqd2g6x kind= uid=ad932fd2-9a76-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:18:34.382466Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimkpr2trvqfkqzw94qpjzmgvg6q6sw4tjggq8t2d88jvvtjt7qgjrxxq5vqd2g6x kind= uid=ad932fd2-9a76-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:18:34.396255Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih6vjcqwxcqqt82h8z7xqcffqcl9l79g775bst87472tpsh58ctnpbf8dp87pcz6 kind= uid=ad94f90f-9a76-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:18:34.396414Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih6vjcqwxcqqt82h8z7xqcffqcl9l79g775bst87472tpsh58ctnpbf8dp87pcz6 kind= uid=ad94f90f-9a76-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:18:34.409777Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmic6fwnt7bbrbv259pzsmcp9fsz52v45flnz5fk26btqr54f8p46bgr9k9h5fzdhh kind= uid=ad96cca0-9a76-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:18:34.413313Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmic6fwnt7bbrbv259pzsmcp9fsz52v45flnz5fk26btqr54f8p46bgr9k9h5fzdhh kind= uid=ad96cca0-9a76-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:18:34.435376Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigw665xblzfvnwfcstqkbllq4g5rx7h2pcjc6kv75mc7rrw8mkj5fs9hpjqjklkh kind= uid=ad9860de-9a76-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:18:34.435574Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigw665xblzfvnwfcstqkbllq4g5rx7h2pcjc6kv75mc7rrw8mkj5fs9hpjqjklkh kind= uid=ad9860de-9a76-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:18:34.508580Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimkpr2trvqfkqzw94qpjzmgvg6q6sw4tjggq8t2d88jvvtjt7qgjrxxq5vqd2g6x\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimkpr2trvqfkqzw94qpjzmgvg6q6sw4tjggq8t2d88jvvtjt7qgjrxxq5vqd2g6x" level=info timestamp=2018-08-07T19:18:34.513803Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmih6vjcqwxcqqt82h8z7xqcffqcl9l79g775bst87472tpsh58ctnpbf8dp87pcz6\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmih6vjcqwxcqqt82h8z7xqcffqcl9l79g775bst87472tpsh58ctnpbf8dp87pcz6" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:54:00.452465Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:54:00.452560Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.452587Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.452620Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.452692Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.452888Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:00.453673Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.453708Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.453737Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.453823Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.454286Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:06.122246Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: false\n" level=info timestamp=2018-08-07T18:54:06.122317Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:06.122393Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:06.122464Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmic6fwnt7bbrbv259pzsmcp9fsz52v45flnz5fkb49n5 Pod phase: Pending level=info timestamp=2018-08-07T19:18:38.405545Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:18:38.405903Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:18:38.408398Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:18:48.415545Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:18:48.491263Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmic6fwnt7bbrbv259pzsmcp9fsz52v45flnz5fk26btqr54f8p46bgr9k9h5fzdhh" level=info timestamp=2018-08-07T19:18:48.496490Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:18:48.496660Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmigw665xblzfvnwfcstqkbllq4g5rx7h2pcjc6knf84p Pod phase: Pending level=info timestamp=2018-08-07T19:18:38.857165Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:18:38.857774Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:18:38.861131Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:18:48.872841Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:18:48.932911Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmigw665xblzfvnwfcstqkbllq4g5rx7h2pcjc6kv75mc7rrw8mkj5fs9hpjqjklkh" level=info timestamp=2018-08-07T19:18:48.934868Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:18:48.935048Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmih6vjcqwxcqqt82h8z7xqcffqcl9l79g775bstkh8vw Pod phase: Pending level=info timestamp=2018-08-07T19:18:38.323109Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:18:38.323388Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:18:38.327561Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:18:48.336909Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:18:48.392322Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmih6vjcqwxcqqt82h8z7xqcffqcl9l79g775bst87472tpsh58ctnpbf8dp87pcz6" level=info timestamp=2018-08-07T19:18:48.394411Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:18:48.394710Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmimkpr2trvqfkqzw94qpjzmgvg6q6sw4tjggq8txkmzv Pod phase: Pending level=info timestamp=2018-08-07T19:18:38.338455Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:18:38.339269Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:18:38.342578Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:18:48.350854Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:18:48.387530Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmimkpr2trvqfkqzw94qpjzmgvg6q6sw4tjggq8t2d88jvvtjt7qgjrxxq5vqd2g6x" level=info timestamp=2018-08-07T19:18:48.390708Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:18:48.391132Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [181.516 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be able to reach [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 the Inbound VirtualMachineInstance with pod network connectivity explicitly set /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.004s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:18:34.604954Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmimkpr2trvqfkqzw94qpjzmgvg6q6sw4tjggq8t2d88jvvtjt7qgjrxxq5vqd2g6x kind=VirtualMachineInstance uid=ad932fd2-9a76-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmimkpr2trvqfkqzw94qpjzmgvg6q6sw4tjggq8txkmzv" Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running 2018/08/07 19:23:38 http: TLS handshake error from 10.244.1.1:53936: EOF level=info timestamp=2018-08-07T19:23:39.585650Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:23:48.164401Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:23:48 http: TLS handshake error from 10.244.1.1:53942: EOF 2018/08/07 19:23:58 http: TLS handshake error from 10.244.1.1:53948: EOF level=info timestamp=2018-08-07T19:24:04.957505Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:24:05.589616Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:24:05.949929Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:24:08 http: TLS handshake error from 10.244.1.1:53954: EOF level=info timestamp=2018-08-07T19:24:09.608347Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:24:18.219501Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:24:18 http: TLS handshake error from 10.244.1.1:53960: EOF 2018/08/07 19:24:28 http: TLS handshake error from 10.244.1.1:53966: EOF level=info timestamp=2018-08-07T19:24:34.991215Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:24:35.647014Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T19:18:34.435376Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigw665xblzfvnwfcstqkbllq4g5rx7h2pcjc6kv75mc7rrw8mkj5fs9hpjqjklkh kind= uid=ad9860de-9a76-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:18:34.435574Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigw665xblzfvnwfcstqkbllq4g5rx7h2pcjc6kv75mc7rrw8mkj5fs9hpjqjklkh kind= uid=ad9860de-9a76-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:18:34.508580Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimkpr2trvqfkqzw94qpjzmgvg6q6sw4tjggq8t2d88jvvtjt7qgjrxxq5vqd2g6x\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimkpr2trvqfkqzw94qpjzmgvg6q6sw4tjggq8t2d88jvvtjt7qgjrxxq5vqd2g6x" level=info timestamp=2018-08-07T19:18:34.513803Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmih6vjcqwxcqqt82h8z7xqcffqcl9l79g775bst87472tpsh58ctnpbf8dp87pcz6\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmih6vjcqwxcqqt82h8z7xqcffqcl9l79g775bst87472tpsh58ctnpbf8dp87pcz6" level=info timestamp=2018-08-07T19:21:35.896261Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmims5lc4k7frt4wstkt2rxzbf8jc8qbnh79bt8rd6x768zp2x7klgr257s9s5dbpl kind= uid=19c44dc2-9a77-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:21:35.897541Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmims5lc4k7frt4wstkt2rxzbf8jc8qbnh79bt8rd6x768zp2x7klgr257s9s5dbpl kind= uid=19c44dc2-9a77-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:21:35.904924Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixf6cd9gjc9wwn5b99mpnj9fhsckj8dfqxcqsmfpstks4d8lb7d25m4cng7r9w5n kind= uid=19c5b003-9a77-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:21:35.905362Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixf6cd9gjc9wwn5b99mpnj9fhsckj8dfqxcqsmfpstks4d8lb7d25m4cng7r9w5n kind= uid=19c5b003-9a77-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:21:35.914111Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6dtwtbphpsgwx2h4q4w4f6gxlzx9dlqxxct64z2pzzh5hgpvm5rqzlsqscl869t kind= uid=19c70cb6-9a77-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:21:35.914210Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6dtwtbphpsgwx2h4q4w4f6gxlzx9dlqxxct64z2pzzh5hgpvm5rqzlsqscl869t kind= uid=19c70cb6-9a77-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:21:35.924979Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6gpdbqjhsprr6bjqd9hq9sdpsmplksk8bkccgpxmxfblbw6xnvfmrpvwkbhnqhr kind= uid=19c89460-9a77-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:21:35.925105Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6gpdbqjhsprr6bjqd9hq9sdpsmplksk8bkccgpxmxfblbw6xnvfmrpvwkbhnqhr kind= uid=19c89460-9a77-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:21:35.999718Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixf6cd9gjc9wwn5b99mpnj9fhsckj8dfqxcqsmfpstks4d8lb7d25m4cng7r9w5n\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixf6cd9gjc9wwn5b99mpnj9fhsckj8dfqxcqsmfpstks4d8lb7d25m4cng7r9w5n" level=info timestamp=2018-08-07T19:21:36.530117Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmims5lc4k7frt4wstkt2rxzbf8jc8qbnh79bt8rd6x768zp2x7klgr257s9s5dbpl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmims5lc4k7frt4wstkt2rxzbf8jc8qbnh79bt8rd6x768zp2x7klgr257s9s5dbpl" level=info timestamp=2018-08-07T19:21:36.937271Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi6gpdbqjhsprr6bjqd9hq9sdpsmplksk8bkccgpxmxfblbw6xnvfmrpvwkbhnqhr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi6gpdbqjhsprr6bjqd9hq9sdpsmplksk8bkccgpxmxfblbw6xnvfmrpvwkbhnqhr" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:54:00.452465Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:54:00.452560Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.452587Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.452620Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.452692Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.452888Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:00.453673Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.453708Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.453737Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.453823Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.454286Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:06.122246Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: false\n" level=info timestamp=2018-08-07T18:54:06.122317Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:06.122393Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:06.122464Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi6dtwtbphpsgwx2h4q4w4f6gxlzx9dlqxxct6425h6m Pod phase: Pending level=info timestamp=2018-08-07T19:21:40.573017Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:21:40.573677Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:21:40.576875Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:21:50.586797Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:21:50.647496Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi6dtwtbphpsgwx2h4q4w4f6gxlzx9dlqxxct64z2pzzh5hgpvm5rqzlsqscl869t" level=info timestamp=2018-08-07T19:21:50.651018Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:21:50.651325Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmi6gpdbqjhsprr6bjqd9hq9sdpsmplksk8bkccgkm825 Pod phase: Pending level=info timestamp=2018-08-07T19:21:39.753573Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:21:39.754096Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:21:39.755971Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:21:49.761830Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:21:49.800114Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi6gpdbqjhsprr6bjqd9hq9sdpsmplksk8bkccgpxmxfblbw6xnvfmrpvwkbhnqhr" level=info timestamp=2018-08-07T19:21:49.802404Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:21:49.802629Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmims5lc4k7frt4wstkt2rxzbf8jc8qbnh79bt8r5zms4 Pod phase: Pending level=info timestamp=2018-08-07T19:21:39.307849Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:21:39.308140Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:21:39.311374Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:21:49.318724Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:21:49.371440Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmims5lc4k7frt4wstkt2rxzbf8jc8qbnh79bt8rd6x768zp2x7klgr257s9s5dbpl" level=info timestamp=2018-08-07T19:21:49.373682Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:21:49.373883Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmixf6cd9gjc9wwn5b99mpnj9fhsckj8dfqxcqsm2x56d Pod phase: Pending level=info timestamp=2018-08-07T19:21:39.258060Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:21:39.258663Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:21:39.260360Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:21:49.266675Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:21:49.310800Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmixf6cd9gjc9wwn5b99mpnj9fhsckj8dfqxcqsmfpstks4d8lb7d25m4cng7r9w5n" level=info timestamp=2018-08-07T19:21:49.313270Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:21:49.313515Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [181.628 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be able to reach [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 the Inbound VirtualMachineInstance with custom MAC address /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.129s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:21:36.096662Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmims5lc4k7frt4wstkt2rxzbf8jc8qbnh79bt8rd6x768zp2x7klgr257s9s5dbpl kind=VirtualMachineInstance uid=19c44dc2-9a77-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmims5lc4k7frt4wstkt2rxzbf8jc8qbnh79bt8r5zms4" Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running level=info timestamp=2018-08-07T19:26:39.800428Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:26:48.600067Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:26:48 http: TLS handshake error from 10.244.1.1:54050: EOF 2018/08/07 19:26:58 http: TLS handshake error from 10.244.1.1:54056: EOF level=info timestamp=2018-08-07T19:27:04.973752Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:27:05.918287Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:27:06.292614Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:27:08 http: TLS handshake error from 10.244.1.1:54062: EOF level=info timestamp=2018-08-07T19:27:09.822857Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:27:18 http: TLS handshake error from 10.244.1.1:54068: EOF level=info timestamp=2018-08-07T19:27:18.654334Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:27:28 http: TLS handshake error from 10.244.1.1:54074: EOF level=info timestamp=2018-08-07T19:27:34.959225Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:27:35.964088Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:27:36.342582Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T19:21:35.999718Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixf6cd9gjc9wwn5b99mpnj9fhsckj8dfqxcqsmfpstks4d8lb7d25m4cng7r9w5n\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixf6cd9gjc9wwn5b99mpnj9fhsckj8dfqxcqsmfpstks4d8lb7d25m4cng7r9w5n" level=info timestamp=2018-08-07T19:21:36.530117Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmims5lc4k7frt4wstkt2rxzbf8jc8qbnh79bt8rd6x768zp2x7klgr257s9s5dbpl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmims5lc4k7frt4wstkt2rxzbf8jc8qbnh79bt8rd6x768zp2x7klgr257s9s5dbpl" level=info timestamp=2018-08-07T19:21:36.937271Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi6gpdbqjhsprr6bjqd9hq9sdpsmplksk8bkccgpxmxfblbw6xnvfmrpvwkbhnqhr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi6gpdbqjhsprr6bjqd9hq9sdpsmplksk8bkccgpxmxfblbw6xnvfmrpvwkbhnqhr" level=info timestamp=2018-08-07T19:24:37.552815Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvminwp9w68mr9mngl8fxs7t8ftxrfzsxxfrnslrfx79fzh89rqhrd8lp4hwtsxp2zv kind= uid=86095429-9a77-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:24:37.553013Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvminwp9w68mr9mngl8fxs7t8ftxrfzsxxfrnslrfx79fzh89rqhrd8lp4hwtsxp2zv kind= uid=86095429-9a77-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:24:37.827431Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmipg55jkmcnzbs4m65zsc26bpbhc9jlm2xspfqnlx7qj6cf6s5p7qvjtmrwtcsvnf kind= uid=860cf525-9a77-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:24:37.827588Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmipg55jkmcnzbs4m65zsc26bpbhc9jlm2xspfqnlx7qj6cf6s5p7qvjtmrwtcsvnf kind= uid=860cf525-9a77-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:24:37.879744Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifpjf5f2qvrsmzp9bg4zrqxdrps6jx6vvh6ggwlw9qgf85lwdbvqk99bzb86sjbj kind= uid=8637491e-9a77-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:24:37.879882Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifpjf5f2qvrsmzp9bg4zrqxdrps6jx6vvh6ggwlw9qgf85lwdbvqk99bzb86sjbj kind= uid=8637491e-9a77-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:24:38.591840Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvminjwqnfd8ddzkrbhwhb8tw4mxpqqfkq7nn66f9h8czt6tk5qch9lp86bxhcd56tr kind= uid=863c9c17-9a77-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:24:38.592599Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvminjwqnfd8ddzkrbhwhb8tw4mxpqqfkq7nn66f9h8czt6tk5qch9lp86bxhcd56tr kind= uid=863c9c17-9a77-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:24:38.808630Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmipg55jkmcnzbs4m65zsc26bpbhc9jlm2xspfqnlx7qj6cf6s5p7qvjtmrwtcsvnf\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmipg55jkmcnzbs4m65zsc26bpbhc9jlm2xspfqnlx7qj6cf6s5p7qvjtmrwtcsvnf" level=info timestamp=2018-08-07T19:24:38.834345Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmifpjf5f2qvrsmzp9bg4zrqxdrps6jx6vvh6ggwlw9qgf85lwdbvqk99bzb86sjbj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmifpjf5f2qvrsmzp9bg4zrqxdrps6jx6vvh6ggwlw9qgf85lwdbvqk99bzb86sjbj" level=info timestamp=2018-08-07T19:24:39.009871Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmifpjf5f2qvrsmzp9bg4zrqxdrps6jx6vvh6ggwlw9qgf85lwdbvqk99bzb86sjbj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmifpjf5f2qvrsmzp9bg4zrqxdrps6jx6vvh6ggwlw9qgf85lwdbvqk99bzb86sjbj" level=info timestamp=2018-08-07T19:24:39.401581Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvminjwqnfd8ddzkrbhwhb8tw4mxpqqfkq7nn66f9h8czt6tk5qch9lp86bxhcd56tr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvminjwqnfd8ddzkrbhwhb8tw4mxpqqfkq7nn66f9h8czt6tk5qch9lp86bxhcd56tr" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:54:00.452465Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:54:00.452560Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.452587Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.452620Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.452692Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.452888Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:00.453673Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.453708Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.453737Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.453823Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.454286Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:06.122246Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: false\n" level=info timestamp=2018-08-07T18:54:06.122317Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:06.122393Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:06.122464Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmifpjf5f2qvrsmzp9bg4zrqxdrps6jx6vvh6ggwm67vb Pod phase: Pending level=info timestamp=2018-08-07T19:24:43.841090Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:24:43.841421Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:24:43.843358Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:24:53.859770Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:24:53.960104Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmifpjf5f2qvrsmzp9bg4zrqxdrps6jx6vvh6ggwlw9qgf85lwdbvqk99bzb86sjbj" level=info timestamp=2018-08-07T19:24:53.967179Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:24:53.967465Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvminjwqnfd8ddzkrbhwhb8tw4mxpqqfkq7nn66f9fqh5d Pod phase: Pending level=info timestamp=2018-08-07T19:24:50.972752Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:24:50.973058Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:24:50.978503Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:25:00.985667Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:25:01.057217Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvminjwqnfd8ddzkrbhwhb8tw4mxpqqfkq7nn66f9h8czt6tk5qch9lp86bxhcd56tr" level=info timestamp=2018-08-07T19:25:01.060146Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:25:01.060483Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvminwp9w68mr9mngl8fxs7t8ftxrfzsxxfrnslrf4lzh5 Pod phase: Pending level=info timestamp=2018-08-07T19:24:42.840812Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:24:42.841131Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:24:42.843294Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:24:52.855174Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:24:52.933712Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvminwp9w68mr9mngl8fxs7t8ftxrfzsxxfrnslrfx79fzh89rqhrd8lp4hwtsxp2zv" level=info timestamp=2018-08-07T19:24:52.935483Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:24:52.935686Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmipg55jkmcnzbs4m65zsc26bpbhc9jlm2xspfqnd7xb9 Pod phase: Pending level=info timestamp=2018-08-07T19:24:48.624657Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:24:48.624946Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:24:48.628085Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:24:58.637592Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:24:58.724484Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmipg55jkmcnzbs4m65zsc26bpbhc9jlm2xspfqnlx7qj6cf6s5p7qvjtmrwtcsvnf" level=info timestamp=2018-08-07T19:24:58.729759Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:24:58.729984Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [182.545 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be able to reach [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 the internet /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.005s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:24:38.959511Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvminwp9w68mr9mngl8fxs7t8ftxrfzsxxfrnslrfx79fzh89rqhrd8lp4hwtsxp2zv kind=VirtualMachineInstance uid=86095429-9a77-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvminwp9w68mr9mngl8fxs7t8ftxrfzsxxfrnslrf4lzh5" Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running 2018/08/07 19:29:58 http: TLS handshake error from 10.244.1.1:54164: EOF level=info timestamp=2018-08-07T19:30:04.983748Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:30:06.226890Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:30:06.607102Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:30:08 http: TLS handshake error from 10.244.1.1:54170: EOF level=info timestamp=2018-08-07T19:30:09.987211Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:30:10.058584Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:30:10.059792Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:30:18 http: TLS handshake error from 10.244.1.1:54176: EOF level=info timestamp=2018-08-07T19:30:18.979319Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:30:28 http: TLS handshake error from 10.244.1.1:54182: EOF level=info timestamp=2018-08-07T19:30:34.955571Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:30:36.279021Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:30:36.661561Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:30:38 http: TLS handshake error from 10.244.1.1:54188: EOF Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T19:24:38.592599Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvminjwqnfd8ddzkrbhwhb8tw4mxpqqfkq7nn66f9h8czt6tk5qch9lp86bxhcd56tr kind= uid=863c9c17-9a77-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:24:38.808630Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmipg55jkmcnzbs4m65zsc26bpbhc9jlm2xspfqnlx7qj6cf6s5p7qvjtmrwtcsvnf\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmipg55jkmcnzbs4m65zsc26bpbhc9jlm2xspfqnlx7qj6cf6s5p7qvjtmrwtcsvnf" level=info timestamp=2018-08-07T19:24:38.834345Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmifpjf5f2qvrsmzp9bg4zrqxdrps6jx6vvh6ggwlw9qgf85lwdbvqk99bzb86sjbj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmifpjf5f2qvrsmzp9bg4zrqxdrps6jx6vvh6ggwlw9qgf85lwdbvqk99bzb86sjbj" level=info timestamp=2018-08-07T19:24:39.009871Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmifpjf5f2qvrsmzp9bg4zrqxdrps6jx6vvh6ggwlw9qgf85lwdbvqk99bzb86sjbj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmifpjf5f2qvrsmzp9bg4zrqxdrps6jx6vvh6ggwlw9qgf85lwdbvqk99bzb86sjbj" level=info timestamp=2018-08-07T19:24:39.401581Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvminjwqnfd8ddzkrbhwhb8tw4mxpqqfkq7nn66f9h8czt6tk5qch9lp86bxhcd56tr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvminjwqnfd8ddzkrbhwhb8tw4mxpqqfkq7nn66f9h8czt6tk5qch9lp86bxhcd56tr" level=info timestamp=2018-08-07T19:27:40.100328Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifsdfghk95z6rx4xmgtlpvfdnxnznsk7tcchp6jrgq47c7sjmjsdgv9dgznzzx5n kind= uid=f2d712b2-9a77-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:27:40.103148Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifsdfghk95z6rx4xmgtlpvfdnxnznsk7tcchp6jrgq47c7sjmjsdgv9dgznzzx5n kind= uid=f2d712b2-9a77-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:27:40.115869Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigpdjrm6rzfdp9tgmzk6rg9hdhqv2826mwzptgjk5fkttrw269hhwn6jzqrzvkk2 kind= uid=f2daf7dd-9a77-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:27:40.116815Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigpdjrm6rzfdp9tgmzk6rg9hdhqv2826mwzptgjk5fkttrw269hhwn6jzqrzvkk2 kind= uid=f2daf7dd-9a77-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:27:40.128335Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis6b8824wfjlrvg7xvjgk2tcxdx6ndj84pt8pn8flnkvjsrmbmlv8xpmjq8p4phg kind= uid=f2dd865f-9a77-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:27:40.128458Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis6b8824wfjlrvg7xvjgk2tcxdx6ndj84pt8pn8flnkvjsrmbmlv8xpmjq8p4phg kind= uid=f2dd865f-9a77-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:27:40.140720Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimxssdsp77hklb9mmrhv62zh9vlrl28xg56pp7cxxbzbqq8zqcxr2qt78zjqqq2d kind= uid=f2df4b2e-9a77-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:27:40.140820Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimxssdsp77hklb9mmrhv62zh9vlrl28xg56pp7cxxbzbqq8zqcxr2qt78zjqqq2d kind= uid=f2df4b2e-9a77-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:27:40.311449Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimxssdsp77hklb9mmrhv62zh9vlrl28xg56pp7cxxbzbqq8zqcxr2qt78zjqqq2d\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimxssdsp77hklb9mmrhv62zh9vlrl28xg56pp7cxxbzbqq8zqcxr2qt78zjqqq2d" level=info timestamp=2018-08-07T19:27:40.508135Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmifsdfghk95z6rx4xmgtlpvfdnxnznsk7tcchp6jrgq47c7sjmjsdgv9dgznzzx5n\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmifsdfghk95z6rx4xmgtlpvfdnxnznsk7tcchp6jrgq47c7sjmjsdgv9dgznzzx5n" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:54:00.452465Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:54:00.452560Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.452587Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.452620Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.452692Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.452888Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:00.453673Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.453708Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.453737Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.453823Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.454286Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:06.122246Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: false\n" level=info timestamp=2018-08-07T18:54:06.122317Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:06.122393Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:06.122464Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmifsdfghk95z6rx4xmgtlpvfdnxnznsk7tcchp6v24pb Pod phase: Pending level=info timestamp=2018-08-07T19:27:44.662594Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:27:44.663633Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:27:44.665892Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:27:54.676563Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:27:54.742328Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmifsdfghk95z6rx4xmgtlpvfdnxnznsk7tcchp6jrgq47c7sjmjsdgv9dgznzzx5n" level=info timestamp=2018-08-07T19:27:54.743995Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:27:54.744222Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmigpdjrm6rzfdp9tgmzk6rg9hdhqv2826mwzptgxphlq Pod phase: Pending level=info timestamp=2018-08-07T19:27:45.118070Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:27:45.118448Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:27:45.121093Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:27:55.131197Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:27:55.177836Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmigpdjrm6rzfdp9tgmzk6rg9hdhqv2826mwzptgjk5fkttrw269hhwn6jzqrzvkk2" level=info timestamp=2018-08-07T19:27:55.180644Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:27:55.181179Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmimxssdsp77hklb9mmrhv62zh9vlrl28xg56pp7tbgr6 Pod phase: Pending level=info timestamp=2018-08-07T19:27:45.148968Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:27:45.149305Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:27:45.156711Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:27:55.168483Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:27:55.197869Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmimxssdsp77hklb9mmrhv62zh9vlrl28xg56pp7cxxbzbqq8zqcxr2qt78zjqqq2d" level=info timestamp=2018-08-07T19:27:55.199866Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:27:55.200229Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmis6b8824wfjlrvg7xvjgk2tcxdx6ndj84pt8pn4hm26 Pod phase: Pending level=info timestamp=2018-08-07T19:27:44.850600Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:27:44.856596Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:27:44.858284Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:27:54.867013Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:27:54.911877Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmis6b8824wfjlrvg7xvjgk2tcxdx6ndj84pt8pn8flnkvjsrmbmlv8xpmjq8p4phg" level=info timestamp=2018-08-07T19:27:54.913983Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:27:54.914177Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [181.549 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be reachable via the propagated IP from a Pod [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 on the same node from Pod /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.007s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:27:40.332443Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmifsdfghk95z6rx4xmgtlpvfdnxnznsk7tcchp6jrgq47c7sjmjsdgv9dgznzzx5n kind=VirtualMachineInstance uid=f2d712b2-9a77-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmifsdfghk95z6rx4xmgtlpvfdnxnznsk7tcchp6v24pb" Pod name: disks-images-provider-76k5d Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-fcxmf Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79975b94-lqc2d Pod phase: Running level=info timestamp=2018-08-07T19:33:04.961645Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:33:06.622045Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:33:06.923561Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:33:08 http: TLS handshake error from 10.244.1.1:54278: EOF level=info timestamp=2018-08-07T19:33:10.065540Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:33:10.066827Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:33:10.141268Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:33:18 http: TLS handshake error from 10.244.1.1:54284: EOF level=info timestamp=2018-08-07T19:33:19.372674Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:33:28 http: TLS handshake error from 10.244.1.1:54290: EOF level=info timestamp=2018-08-07T19:33:34.952027Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:33:36.650928Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:33:36.974848Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:33:38 http: TLS handshake error from 10.244.1.1:54296: EOF level=info timestamp=2018-08-07T19:33:40.162338Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-67dcdd8464-9bb4x Pod phase: Running level=info timestamp=2018-08-07T18:03:22.512384Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 E0807 18:03:22.664426 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again Pod name: virt-controller-67dcdd8464-j4f48 Pod phase: Running level=info timestamp=2018-08-07T19:27:40.140820Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimxssdsp77hklb9mmrhv62zh9vlrl28xg56pp7cxxbzbqq8zqcxr2qt78zjqqq2d kind= uid=f2df4b2e-9a77-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:27:40.311449Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimxssdsp77hklb9mmrhv62zh9vlrl28xg56pp7cxxbzbqq8zqcxr2qt78zjqqq2d\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimxssdsp77hklb9mmrhv62zh9vlrl28xg56pp7cxxbzbqq8zqcxr2qt78zjqqq2d" level=info timestamp=2018-08-07T19:27:40.508135Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmifsdfghk95z6rx4xmgtlpvfdnxnznsk7tcchp6jrgq47c7sjmjsdgv9dgznzzx5n\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmifsdfghk95z6rx4xmgtlpvfdnxnznsk7tcchp6jrgq47c7sjmjsdgv9dgznzzx5n" level=info timestamp=2018-08-07T19:30:41.626640Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6dg2vprr96qtsnnnxvnr57cwwb8fgfx7djqthmj4rkd8wwtgsds2kplllsrkp5v kind= uid=5f0bfbce-9a78-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:30:41.627399Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6dg2vprr96qtsnnnxvnr57cwwb8fgfx7djqthmj4rkd8wwtgsds2kplllsrkp5v kind= uid=5f0bfbce-9a78-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:30:41.645046Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim7pvppxxgxq2zptcrlx6xcv46c6qprmnf96q9q4s5427kmqfcmgh4mbphck78mx kind= uid=5f0e143e-9a78-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:30:41.645193Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim7pvppxxgxq2zptcrlx6xcv46c6qprmnf96q9q4s5427kmqfcmgh4mbphck78mx kind= uid=5f0e143e-9a78-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:30:41.661215Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirbv5plzpltthmwhnr4kk7c4fx7rxdm68qdl5h8lr5vsj2t4k2nl7flx9k5vdzsv kind= uid=5f100c5c-9a78-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:30:41.661369Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirbv5plzpltthmwhnr4kk7c4fx7rxdm68qdl5h8lr5vsj2t4k2nl7flx9k5vdzsv kind= uid=5f100c5c-9a78-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:30:41.685652Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmil8jzk7hktjzzjq9szk7nv4bv8skxkvkgc7n5cdhxqvs2lzdgdd5vhgp5hj7qt7c kind= uid=5f126b76-9a78-11e8-8d82-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:30:41.685786Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmil8jzk7hktjzzjq9szk7nv4bv8skxkvkgc7n5cdhxqvs2lzdgdd5vhgp5hj7qt7c kind= uid=5f126b76-9a78-11e8-8d82-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:30:41.714216Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmim7pvppxxgxq2zptcrlx6xcv46c6qprmnf96q9q4s5427kmqfcmgh4mbphck78mx\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmim7pvppxxgxq2zptcrlx6xcv46c6qprmnf96q9q4s5427kmqfcmgh4mbphck78mx" level=info timestamp=2018-08-07T19:30:41.715192Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi6dg2vprr96qtsnnnxvnr57cwwb8fgfx7djqthmj4rkd8wwtgsds2kplllsrkp5v\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi6dg2vprr96qtsnnnxvnr57cwwb8fgfx7djqthmj4rkd8wwtgsds2kplllsrkp5v" level=info timestamp=2018-08-07T19:30:42.041476Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirbv5plzpltthmwhnr4kk7c4fx7rxdm68qdl5h8lr5vsj2t4k2nl7flx9k5vdzsv\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirbv5plzpltthmwhnr4kk7c4fx7rxdm68qdl5h8lr5vsj2t4k2nl7flx9k5vdzsv" level=info timestamp=2018-08-07T19:30:42.855821Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirbv5plzpltthmwhnr4kk7c4fx7rxdm68qdl5h8lr5vsj2t4k2nl7flx9k5vdzsv\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirbv5plzpltthmwhnr4kk7c4fx7rxdm68qdl5h8lr5vsj2t4k2nl7flx9k5vdzsv" Pod name: virt-handler-6h725 Pod phase: Running level=info timestamp=2018-08-07T18:03:27.773029Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:03:27.780733Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:03:27.782008Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:03:27.894131Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:03:27.912123Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:03:27.915676Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-9ppmp Pod phase: Running level=info timestamp=2018-08-07T18:54:00.452465Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:54:00.452560Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.452587Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.452620Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.452692Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.452888Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:00.453673Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: true\n" level=info timestamp=2018-08-07T18:54:00.453708Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:54:00.453737Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:00.453823Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:00.454286Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind= uid=2b44dc2d-9a73-11e8-8d82-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:54:06.122246Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t, existing: false\n" level=info timestamp=2018-08-07T18:54:06.122317Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:54:06.122393Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:54:06.122464Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmi655tsbzt4wql55pf5rn6257sgxt9mnhdptmq6x5zgrmd67mxlb8hbbg84x9866t kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi6dg2vprr96qtsnnnxvnr57cwwb8fgfx7djqth774h9 Pod phase: Pending level=info timestamp=2018-08-07T19:30:46.546888Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:30:46.547181Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:30:46.548736Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:30:56.556490Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:30:56.596224Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi6dg2vprr96qtsnnnxvnr57cwwb8fgfx7djqthmj4rkd8wwtgsds2kplllsrkp5v" level=info timestamp=2018-08-07T19:30:56.598831Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:30:56.599167Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmil8jzk7hktjzzjq9szk7nv4bv8skxkvkgc7n5cz7g4v Pod phase: Pending level=info timestamp=2018-08-07T19:30:46.081980Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:30:46.082660Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:30:46.085143Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:30:56.852177Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:30:56.877311Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmil8jzk7hktjzzjq9szk7nv4bv8skxkvkgc7n5cdhxqvs2lzdgdd5vhgp5hj7qt7c" level=info timestamp=2018-08-07T19:30:56.880003Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:30:56.880222Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmim7pvppxxgxq2zptcrlx6xcv46c6qprmnf96q9j7j5l Pod phase: Pending level=info timestamp=2018-08-07T19:30:45.961121Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:30:45.961395Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:30:45.964556Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:30:56.529287Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:30:56.758755Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmim7pvppxxgxq2zptcrlx6xcv46c6qprmnf96q9q4s5427kmqfcmgh4mbphck78mx" level=info timestamp=2018-08-07T19:30:56.765268Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:30:56.765556Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmirbv5plzpltthmwhnr4kk7c4fx7rxdm68qdl5hgkb8d Pod phase: Pending level=info timestamp=2018-08-07T19:30:45.895259Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:30:45.895535Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:30:45.899306Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:30:55.912272Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:30:56.186169Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmirbv5plzpltthmwhnr4kk7c4fx7rxdm68qdl5h8lr5vsj2t4k2nl7flx9k5vdzsv" level=info timestamp=2018-08-07T19:30:56.190690Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:30:56.190915Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [181.590 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be reachable via the propagated IP from a Pod [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 on a different node from Pod /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.019s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:30:41.865678Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi6dg2vprr96qtsnnnxvnr57cwwb8fgfx7djqthmj4rkd8wwtgsds2kplllsrkp5v kind=VirtualMachineInstance uid=5f0bfbce-9a78-11e8-8d82-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi6dg2vprr96qtsnnnxvnr57cwwb8fgfx7djqth774h9" panic: test timed out after 1h30m0s goroutine 14452 [running]: testing.(*M).startAlarm.func1() /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:1240 +0xfc created by time.goFunc /gimme/.gimme/versions/go1.10.linux.amd64/src/time/sleep.go:172 +0x44 goroutine 1 [chan receive, 90 minutes]: testing.(*T).Run(0xc420493d10, 0x139fc95, 0x9, 0x1432278, 0x4801e6) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:825 +0x301 testing.runTests.func1(0xc420493c20) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:1063 +0x64 testing.tRunner(0xc420493c20, 0xc4207a3df8) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:777 +0xd0 testing.runTests(0xc4204fd9e0, 0x1d34a50, 0x1, 0x1, 0x412009) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:1061 +0x2c4 testing.(*M).Run(0xc42054b680, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:978 +0x171 main.main() _testmain.go:44 +0x151 goroutine 5 [chan receive]: kubevirt.io/kubevirt/vendor/github.com/golang/glog.(*loggingT).flushDaemon(0x1d60280) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/golang/glog/glog.go:879 +0x8b created by kubevirt.io/kubevirt/vendor/github.com/golang/glog.init.0 /root/go/src/kubevirt.io/kubevirt/vendor/github.com/golang/glog/glog.go:410 +0x203 goroutine 7 [syscall, 90 minutes]: os/signal.signal_recv(0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/sigqueue.go:139 +0xa6 os/signal.loop() /gimme/.gimme/versions/go1.10.linux.amd64/src/os/signal/signal_unix.go:22 +0x22 created by os/signal.init.0 /gimme/.gimme/versions/go1.10.linux.amd64/src/os/signal/signal_unix.go:28 +0x41 goroutine 35 [sleep]: time.Sleep(0xb183201) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/time.go:102 +0x166 kubevirt.io/kubevirt/vendor/k8s.io/client-go/util/flowcontrol.realClock.Sleep(0xb183201) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/client-go/util/flowcontrol/throttle.go:66 +0x2b kubevirt.io/kubevirt/vendor/k8s.io/client-go/util/flowcontrol.(*tokenBucketRateLimiter).Accept(0xc42070e4a0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/client-go/util/flowcontrol/throttle.go:91 +0xbd kubevirt.io/kubevirt/vendor/k8s.io/client-go/rest.(*Request).tryThrottle(0xc420d1b080) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/client-go/rest/request.go:478 +0x1fd kubevirt.io/kubevirt/vendor/k8s.io/client-go/rest.(*Request).Do(0xc420d1b080, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/client-go/rest/request.go:733 +0x62 kubevirt.io/kubevirt/pkg/kubecli.(*vmis).Get(0xc42064c8a0, 0xc4206e98b0, 0x46, 0xc420c84680, 0xc42064c8a0, 0xc420476000, 0x8) /root/go/src/kubevirt.io/kubevirt/pkg/kubecli/vmi.go:369 +0x125 kubevirt.io/kubevirt/tests.waitForVMIStart.func1(0x0) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1068 +0xc2 reflect.Value.call(0x118c620, 0xc42071b290, 0x13, 0x1399d50, 0x4, 0xc420d22cb8, 0x0, 0x0, 0x118c620, 0x118c620, ...) /gimme/.gimme/versions/go1.10.linux.amd64/src/reflect/value.go:447 +0x969 reflect.Value.Call(0x118c620, 0xc42071b290, 0x13, 0xc420d22cb8, 0x0, 0x0, 0x44b21b, 0xc42044b818, 0xc420d22cf0) /gimme/.gimme/versions/go1.10.linux.amd64/src/reflect/value.go:308 +0xa4 kubevirt.io/kubevirt/vendor/github.com/onsi/gomega/internal/asyncassertion.(*AsyncAssertion).pollActual(0xc4208d6d80, 0x0, 0x0, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/gomega/internal/asyncassertion/async_assertion.go:71 +0x9f kubevirt.io/kubevirt/vendor/github.com/onsi/gomega/internal/asyncassertion.(*AsyncAssertion).match(0xc4208d6d80, 0x14c6040, 0xc4209ccc60, 0x412801, 0xc4209ccc70, 0x1, 0x1, 0xc4209ccc70) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/gomega/internal/asyncassertion/async_assertion.go:141 +0x305 kubevirt.io/kubevirt/vendor/github.com/onsi/gomega/internal/asyncassertion.(*AsyncAssertion).Should(0xc4208d6d80, 0x14c6040, 0xc4209ccc60, 0xc4209ccc70, 0x1, 0x1, 0x14bcfe0) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/gomega/internal/asyncassertion/async_assertion.go:48 +0x62 kubevirt.io/kubevirt/tests.waitForVMIStart(0x14bbd60, 0xc420bd0500, 0x5a, 0x0, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1078 +0x703 kubevirt.io/kubevirt/tests.WaitForSuccessfulVMIStart(0x14bbd60, 0xc420bd0500, 0xc420d23120, 0xa5a99e) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 +0x43 kubevirt.io/kubevirt/tests.WaitUntilVMIReady(0xc420bd0500, 0x1432250, 0x1d7e938) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1106 +0x3b kubevirt.io/kubevirt/tests_test.glob..func18.4() /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:135 +0x72b kubevirt.io/kubevirt/tests.BeforeAll.func1() /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1388 +0x3f kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).runSync(0xc4201e5e60, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113 +0x9c kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).run(0xc4201e5e60, 0xc42081a460, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:64 +0x13e kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*SetupNode).Run(0xc42049a590, 0x14b8200, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes/setup_nodes.go:15 +0x7f kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec.(*Spec).runSample(0xc4203d3590, 0x0, 0x14b8200, 0xc420055500) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec/spec.go:181 +0x1f1 kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec.(*Spec).Run(0xc4203d3590, 0x14b8200, 0xc420055500) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec/spec.go:138 +0xff kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).runSpec(0xc420609b80, 0xc4203d3590, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:200 +0x10d kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).runSpecs(0xc420609b80, 0x1) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:170 +0x329 kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).Run(0xc420609b80, 0xb) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:66 +0x11b kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/suite.(*Suite).Run(0xc4200ccb40, 0x7f55c2114378, 0xc420493d10, 0x13a2278, 0xb, 0xc4204fda40, 0x2, 0x2, 0x14d4b00, 0xc420055500, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/suite/suite.go:62 +0x27c kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo.RunSpecsWithCustomReporters(0x14b9260, 0xc420493d10, 0x13a2278, 0xb, 0xc4204fda00, 0x2, 0x2, 0x2) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/ginkgo_dsl.go:221 +0x258 kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo.RunSpecsWithDefaultAndCustomReporters(0x14b9260, 0xc420493d10, 0x13a2278, 0xb, 0xc4204e86f0, 0x1, 0x1, 0x1) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/ginkgo_dsl.go:209 +0xab kubevirt.io/kubevirt/tests_test.TestTests(0xc420493d10) /root/go/src/kubevirt.io/kubevirt/tests/tests_suite_test.go:43 +0xaa testing.tRunner(0xc420493d10, 0x1432278) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:777 +0xd0 created by testing.(*T).Run /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:824 +0x2e0 goroutine 36 [chan receive, 90 minutes]: kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).registerForInterrupts(0xc420609b80, 0xc42081d920) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:223 +0xd1 created by kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).Run /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:60 +0x88 goroutine 37 [select, 90 minutes, locked to thread]: runtime.gopark(0x1434450, 0x0, 0x139c7b7, 0x6, 0x18, 0x1) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/proc.go:291 +0x11a runtime.selectgo(0xc420792750, 0xc42081d9e0) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/select.go:392 +0xe50 runtime.ensureSigM.func1() /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/signal_unix.go:549 +0x1f4 runtime.goexit() /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/asm_amd64.s:2361 +0x1 goroutine 533 [chan send, 84 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc42061cf60) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 41 [IO wait]: internal/poll.runtime_pollWait(0x7f55c21b2f00, 0x72, 0xc4206f5850) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/netpoll.go:173 +0x57 internal/poll.(*pollDesc).wait(0xc420383718, 0x72, 0xffffffffffffff00, 0x14ba420, 0x1c4b7d0) /gimme/.gimme/versions/go1.10.linux.amd64/src/internal/poll/fd_poll_runtime.go:85 +0x9b internal/poll.(*pollDesc).waitRead(0xc420383718, 0xc420c76000, 0x8000, 0x8000) /gimme/.gimme/versions/go1.10.linux.amd64/src/internal/poll/fd_poll_runtime.go:90 +0x3d internal/poll.(*FD).Read(0xc420383700, 0xc420c76000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/internal/poll/fd_unix.go:157 +0x17d net.(*netFD).Read(0xc420383700, 0xc420c76000, 0x8000, 0x8000, 0x0, 0x8, 0x7ffb) /gimme/.gimme/versions/go1.10.linux.amd64/src/net/fd_unix.go:202 +0x4f net.(*conn).Read(0xc42049a010, 0xc420c76000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/net/net.go:176 +0x6a crypto/tls.(*block).readFromUntil(0xc420796090, 0x7f55c2167e08, 0xc42049a010, 0x5, 0xc42049a010, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/crypto/tls/conn.go:493 +0x96 crypto/tls.(*Conn).readRecord(0xc420798000, 0x1434517, 0xc420798120, 0x20) /gimme/.gimme/versions/go1.10.linux.amd64/src/crypto/tls/conn.go:595 +0xe0 crypto/tls.(*Conn).Read(0xc420798000, 0xc42082d000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/crypto/tls/conn.go:1156 +0x100 bufio.(*Reader).Read(0xc4205a81e0, 0xc42001eb98, 0x9, 0x9, 0xc420503738, 0xc420482620, 0xc4206f5d10) /gimme/.gimme/versions/go1.10.linux.amd64/src/bufio/bufio.go:216 +0x238 io.ReadAtLeast(0x14b7000, 0xc4205a81e0, 0xc42001eb98, 0x9, 0x9, 0x9, 0xc4206f5ce0, 0xc4206f5ce0, 0x406614) /gimme/.gimme/versions/go1.10.linux.amd64/src/io/io.go:309 +0x86 io.ReadFull(0x14b7000, 0xc4205a81e0, 0xc42001eb98, 0x9, 0x9, 0xc4205036e0, 0xc4206f5d10, 0xc400006b01) /gimme/.gimme/versions/go1.10.linux.amd64/src/io/io.go:327 +0x58 kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.readFrameHeader(0xc42001eb98, 0x9, 0x9, 0x14b7000, 0xc4205a81e0, 0x0, 0xc400000000, 0x7efa6d, 0xc4206f5fb0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/frame.go:237 +0x7b kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc42001eb60, 0xc4203d5200, 0x0, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/frame.go:492 +0xa4 kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*clientConnReadLoop).run(0xc4206f5fb0, 0x14331d0, 0xc4207937b0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/transport.go:1428 +0x8e kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*ClientConn).readLoop(0xc4202151e0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/transport.go:1354 +0x76 created by kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*Transport).newClientConn /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/transport.go:579 +0x651 goroutine 228 [chan send, 87 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc42053e540) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 598 [chan send, 83 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc42099a120) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 2451 [chan send, 72 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc4208794a0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 2595 [chan send, 71 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc420606810) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 make: *** [functest] Error 2 + make cluster-down ./cluster/down.sh