+ export WORKSPACE=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release + WORKSPACE=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release + [[ k8s-1.11.0-release =~ openshift-.* ]] + [[ k8s-1.11.0-release =~ .*-1.10.4-.* ]] + export KUBEVIRT_PROVIDER=k8s-1.11.0 + KUBEVIRT_PROVIDER=k8s-1.11.0 + export KUBEVIRT_NUM_NODES=2 + KUBEVIRT_NUM_NODES=2 + export NFS_WINDOWS_DIR=/home/nfs/images/windows2016 + NFS_WINDOWS_DIR=/home/nfs/images/windows2016 + export NAMESPACE=kube-system + NAMESPACE=kube-system + trap '{ make cluster-down; }' EXIT SIGINT SIGTERM SIGSTOP + make cluster-down ./cluster/down.sh + make cluster-up ./cluster/up.sh Downloading ....... Downloading ....... 2018/08/07 17:54:03 Waiting for host: 192.168.66.101:22 2018/08/07 17:54:06 Problem with dial: dial tcp 192.168.66.101:22: getsockopt: no route to host. Sleeping 5s 2018/08/07 17:54:14 Problem with dial: dial tcp 192.168.66.101:22: getsockopt: no route to host. Sleeping 5s 2018/08/07 17:54:19 Connected to tcp://192.168.66.101:22 ++ systemctl status docker ++ wc -l ++ grep active + [[ 1 -eq 0 ]] + kubeadm init --config /etc/kubernetes/kubeadm.conf [init] using Kubernetes version: v1.11.0 [preflight] running pre-flight checks I0807 17:54:20.365239 1290 feature_gate.go:230] feature gates: &{map[]} I0807 17:54:20.472898 1290 kernel_validator.go:81] Validating kernel version I0807 17:54:20.473728 1290 kernel_validator.go:96] Validating kernel config [preflight/images] Pulling images required for setting up a Kubernetes cluster [preflight/images] This might take a minute or two, depending on the speed of your internet connection [preflight/images] You can also perform this action in beforehand using 'kubeadm config images pull' [kubelet] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env" [kubelet] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml" [preflight] Activating the kubelet service [certificates] Generated ca certificate and key. [certificates] Generated apiserver certificate and key. [certificates] apiserver serving cert is signed for DNS names [node01 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 192.168.66.101] [certificates] Generated apiserver-kubelet-client certificate and key. [certificates] Generated sa key and public key. [certificates] Generated front-proxy-ca certificate and key. [certificates] Generated front-proxy-client certificate and key. [certificates] Generated etcd/ca certificate and key. [certificates] Generated etcd/server certificate and key. [certificates] etcd/server serving cert is signed for DNS names [node01 localhost] and IPs [127.0.0.1 ::1] [certificates] Generated etcd/peer certificate and key. [certificates] etcd/peer serving cert is signed for DNS names [node01 localhost] and IPs [192.168.66.101 127.0.0.1 ::1] [certificates] Generated etcd/healthcheck-client certificate and key. [certificates] Generated apiserver-etcd-client certificate and key. [certificates] valid certificates and keys now exist in "/etc/kubernetes/pki" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/admin.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/kubelet.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/controller-manager.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/scheduler.conf" [controlplane] wrote Static Pod manifest for component kube-apiserver to "/etc/kubernetes/manifests/kube-apiserver.yaml" [controlplane] wrote Static Pod manifest for component kube-controller-manager to "/etc/kubernetes/manifests/kube-controller-manager.yaml" [controlplane] wrote Static Pod manifest for component kube-scheduler to "/etc/kubernetes/manifests/kube-scheduler.yaml" [etcd] Wrote Static Pod manifest for a local etcd instance to "/etc/kubernetes/manifests/etcd.yaml" [init] waiting for the kubelet to boot up the control plane as Static Pods from directory "/etc/kubernetes/manifests" [init] this might take a minute or longer if the control plane images have to be pulled [apiclient] All control plane components are healthy after 38.013356 seconds [uploadconfig] storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace [kubelet] Creating a ConfigMap "kubelet-config-1.11" in namespace kube-system with the configuration for the kubelets in the cluster [markmaster] Marking the node node01 as master by adding the label "node-role.kubernetes.io/master=''" [markmaster] Marking the node node01 as master by adding the taints [node-role.kubernetes.io/master:NoSchedule] [patchnode] Uploading the CRI Socket information "/var/run/dockershim.sock" to the Node API object "node01" as an annotation [bootstraptoken] using token: abcdef.1234567890123456 [bootstraptoken] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials [bootstraptoken] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token [bootstraptoken] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster [bootstraptoken] creating the "cluster-info" ConfigMap in the "kube-public" namespace [addons] Applied essential addon: CoreDNS [addons] Applied essential addon: kube-proxy Your Kubernetes master has initialized successfully! To start using your cluster, you need to run the following as a regular user: mkdir -p $HOME/.kube sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config sudo chown $(id -u):$(id -g) $HOME/.kube/config You should now deploy a pod network to the cluster. Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at: https://kubernetes.io/docs/concepts/cluster-administration/addons/ You can now join any number of machines by running the following on each node as root: kubeadm join 192.168.66.101:6443 --token abcdef.1234567890123456 --discovery-token-ca-cert-hash sha256:18a9bff899e22ffdcddd738009041cf915f4ab5aa589bd813a3a8283c55201c9 + kubectl --kubeconfig=/etc/kubernetes/admin.conf apply -f https://raw.githubusercontent.com/coreos/flannel/v0.9.1/Documentation/kube-flannel.yml clusterrole.rbac.authorization.k8s.io/flannel created clusterrolebinding.rbac.authorization.k8s.io/flannel created serviceaccount/flannel created configmap/kube-flannel-cfg created daemonset.extensions/kube-flannel-ds created + kubectl --kubeconfig=/etc/kubernetes/admin.conf taint nodes node01 node-role.kubernetes.io/master:NoSchedule- node/node01 untainted + kubectl --kubeconfig=/etc/kubernetes/admin.conf create -f /tmp/local-volume.yaml storageclass.storage.k8s.io/local created configmap/local-storage-config created clusterrolebinding.rbac.authorization.k8s.io/local-storage-provisioner-pv-binding created clusterrole.rbac.authorization.k8s.io/local-storage-provisioner-node-clusterrole created clusterrolebinding.rbac.authorization.k8s.io/local-storage-provisioner-node-binding created role.rbac.authorization.k8s.io/local-storage-provisioner-jobs-role created rolebinding.rbac.authorization.k8s.io/local-storage-provisioner-jobs-rolebinding created serviceaccount/local-storage-admin created daemonset.extensions/local-volume-provisioner created 2018/08/07 17:55:20 Waiting for host: 192.168.66.102:22 2018/08/07 17:55:23 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: no route to host. Sleeping 5s 2018/08/07 17:55:31 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: no route to host. Sleeping 5s 2018/08/07 17:55:36 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: connection refused. Sleeping 5s 2018/08/07 17:55:41 Connected to tcp://192.168.66.102:22 ++ systemctl status docker ++ grep active ++ wc -l + [[ 1 -eq 0 ]] + kubeadm join --token abcdef.1234567890123456 192.168.66.101:6443 --ignore-preflight-errors=all --discovery-token-unsafe-skip-ca-verification=true [preflight] running pre-flight checks [WARNING RequiredIPVSKernelModulesAvailable]: the IPVS proxier will not be used, because the following required kernel modules are not loaded: [ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh] or no builtin kernel ipvs support: map[ip_vs:{} ip_vs_rr:{} ip_vs_wrr:{} ip_vs_sh:{} nf_conntrack_ipv4:{}] you can solve this problem with following methods: 1. Run 'modprobe -- ' to load missing kernel modules; 2. Provide the missing builtin kernel ipvs support I0807 17:55:42.708143 1287 kernel_validator.go:81] Validating kernel version I0807 17:55:42.709139 1287 kernel_validator.go:96] Validating kernel config [discovery] Trying to connect to API Server "192.168.66.101:6443" [discovery] Created cluster-info discovery client, requesting info from "https://192.168.66.101:6443" [discovery] Cluster info signature and contents are valid and no TLS pinning was specified, will use API Server "192.168.66.101:6443" [discovery] Successfully established connection with API Server "192.168.66.101:6443" [kubelet] Downloading configuration for the kubelet from the "kubelet-config-1.11" ConfigMap in the kube-system namespace [kubelet] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml" [kubelet] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env" [preflight] Activating the kubelet service [tlsbootstrap] Waiting for the kubelet to perform the TLS Bootstrap... [patchnode] Uploading the CRI Socket information "/var/run/dockershim.sock" to the Node API object "node02" as an annotation This node has joined the cluster: * Certificate signing request was sent to master and a response was received. * The Kubelet was informed of the new secure connection details. Run 'kubectl get nodes' on the master to see this node join the cluster. Sending file modes: C0755 38739968 kubectl Sending file modes: C0600 5454 admin.conf Cluster "kubernetes" set. Cluster "kubernetes" set. + set +e + kubectl get nodes --no-headers + cluster/kubectl.sh get nodes --no-headers node01 Ready master 58s v1.11.0 node02 Ready 22s v1.11.0 + kubectl_rc=0 + '[' 0 -ne 0 ']' ++ kubectl get nodes --no-headers ++ grep NotReady ++ cluster/kubectl.sh get nodes --no-headers + '[' -n '' ']' + set -e + echo 'Nodes are ready:' Nodes are ready: + kubectl get nodes + cluster/kubectl.sh get nodes NAME STATUS ROLES AGE VERSION node01 Ready master 59s v1.11.0 node02 Ready 23s v1.11.0 + make cluster-sync ./cluster/build.sh Building ... Untagged: localhost:33421/kubevirt/virt-controller:devel Untagged: localhost:33421/kubevirt/virt-controller@sha256:0a774b623cffe92413e17263fcc78bfeb9928eac5d939d0fcea7f7d07df29ece Deleted: sha256:6fb6d94c9c57a1c4f79e1ab9b9577b35120161ffb728a3b254014e97bc10555a Untagged: localhost:33421/kubevirt/virt-launcher:devel Untagged: localhost:33421/kubevirt/virt-launcher@sha256:92f62675dfa0fb0cda6d94026181551f825818bf6afcc7dd7c3a89ee22c12078 Deleted: sha256:c0225094f10d3668ca9f5cdfce9c7c04a3d8e5e2cd9f1a20b576fbc18ea98e20 Untagged: localhost:33421/kubevirt/virt-handler:devel Untagged: localhost:33421/kubevirt/virt-handler@sha256:bd31f314accb957278daabc453a229a1eb18acedaa61f3cbd1e8997790d628ae Deleted: sha256:a229b5bef356e9a8bae985dc594c65444ce7c40e14beb7b5e17a54c3f1d18b44 Untagged: localhost:33421/kubevirt/virt-api:devel Untagged: localhost:33421/kubevirt/virt-api@sha256:ce5d51e2f6fa26f14edcc7a6075ae043970c946ca9b22ce7111d953110421e81 Deleted: sha256:5c451f72e772f1b3e4709c7b4eb3eda72d57c80da7fdbf0119e05929e30835d5 Untagged: localhost:33421/kubevirt/subresource-access-test:devel Untagged: localhost:33421/kubevirt/subresource-access-test@sha256:4d95d5eeec8bb95335d86a34839a6287f26064e51093ba89bc493f6b95a76982 Deleted: sha256:551176ab7e244cb8d18c6e5cdc97ea901357bb964414a4b835c15c5b2749359d Untagged: localhost:33421/kubevirt/example-hook-sidecar:devel Untagged: localhost:33421/kubevirt/example-hook-sidecar@sha256:108c90e4f17bbcc45511b3fb2c1cdbe8e732e5f70a92a9489e5a4bf36f643f74 Deleted: sha256:e6bc5a1026dda51dffb33dd1ebdcfa865433a9f49824b526ac4f1b78ec62ee10 Deleted: sha256:9bedbe78e4a1b335a1261bad6c507ba779da5587ec6d4b637da7a07828f0599a Deleted: sha256:b11584661aefe370afea041af82fdbdbb769222074ca56b580ef683ddd60f232 Deleted: sha256:aa17122b49ba33ffe6692cac6965645260a7b19cdc092ee1c5992a11e4e0c73e Sending build context to Docker daemon 5.632 kB Step 1/12 : FROM fedora:28 ---> cc510acfcd70 Step 2/12 : ENV LIBVIRT_VERSION 4.2.0 ---> Using cache ---> b1088795aeb6 Step 3/12 : RUN curl --output /etc/yum.repos.d/fedora-virt-preview.repo https://fedorapeople.org/groups/virt/virt-preview/fedora-virt-preview.repo ---> Using cache ---> 88f43b954f9f Step 4/12 : RUN dnf -y install libvirt-devel-${LIBVIRT_VERSION} make git mercurial sudo gcc findutils gradle rsync-daemon rsync qemu-img protobuf-compiler && dnf -y clean all ---> Using cache ---> 06c70b43758a Step 5/12 : ENV GIMME_GO_VERSION 1.10 ---> Using cache ---> e5b3ae738662 Step 6/12 : RUN mkdir -p /gimme && curl -sL https://raw.githubusercontent.com/travis-ci/gimme/master/gimme | HOME=/gimme bash >> /etc/profile.d/gimme.sh ---> Using cache ---> 3e3d43f49e45 Step 7/12 : ENV GOPATH "/go" GOBIN "/usr/bin" ---> Using cache ---> 73e8a3aa263a Step 8/12 : ADD rsyncd.conf /etc/rsyncd.conf ---> Using cache ---> bc244b1c712b Step 9/12 : RUN mkdir -p /go && source /etc/profile.d/gimme.sh && go get github.com/mattn/goveralls && go get -u github.com/Masterminds/glide && go get golang.org/x/tools/cmd/goimports && git clone https://github.com/mvdan/sh.git $GOPATH/src/mvdan.cc/sh && cd /go/src/mvdan.cc/sh/cmd/shfmt && git checkout v2.5.0 && go get mvdan.cc/sh/cmd/shfmt && go install && go get -u github.com/golang/mock/gomock && go get -u github.com/rmohr/mock/mockgen && go get -u github.com/rmohr/go-swagger-utils/swagger-doc && go get -u github.com/onsi/ginkgo/ginkgo && go get -u -d k8s.io/code-generator/cmd/deepcopy-gen && go get -u -d k8s.io/code-generator/cmd/defaulter-gen && go get -u -d k8s.io/code-generator/cmd/openapi-gen && cd /go/src/k8s.io/code-generator/cmd/deepcopy-gen && git checkout release-1.9 && go install && cd /go/src/k8s.io/code-generator/cmd/defaulter-gen && git checkout release-1.9 && go install && cd /go/src/k8s.io/code-generator/cmd/openapi-gen && git checkout release-1.9 && go install && go get -u -d github.com/golang/protobuf/protoc-gen-go && cd /go/src/github.com/golang/protobuf/protoc-gen-go && git checkout 1643683e1b54a9e88ad26d98f81400c8c9d9f4f9 && go install ---> Using cache ---> 4cd1786b2bc8 Step 10/12 : RUN pip install j2cli ---> Using cache ---> b51a532fa53a Step 11/12 : ADD entrypoint.sh /entrypoint.sh ---> Using cache ---> 3bc0185264f6 Step 12/12 : ENTRYPOINT /entrypoint.sh ---> Using cache ---> dcf2b21fa2ed Successfully built dcf2b21fa2ed go version go1.10 linux/amd64 go version go1.10 linux/amd64 make[1]: Entering directory `/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt' hack/dockerized "./hack/check.sh && KUBEVIRT_VERSION= ./hack/build-go.sh install " && ./hack/build-copy-artifacts.sh Sending build context to Docker daemon 5.632 kB Step 1/12 : FROM fedora:28 ---> cc510acfcd70 Step 2/12 : ENV LIBVIRT_VERSION 4.2.0 ---> Using cache ---> b1088795aeb6 Step 3/12 : RUN curl --output /etc/yum.repos.d/fedora-virt-preview.repo https://fedorapeople.org/groups/virt/virt-preview/fedora-virt-preview.repo ---> Using cache ---> 88f43b954f9f Step 4/12 : RUN dnf -y install libvirt-devel-${LIBVIRT_VERSION} make git mercurial sudo gcc findutils gradle rsync-daemon rsync qemu-img protobuf-compiler && dnf -y clean all ---> Using cache ---> 06c70b43758a Step 5/12 : ENV GIMME_GO_VERSION 1.10 ---> Using cache ---> e5b3ae738662 Step 6/12 : RUN mkdir -p /gimme && curl -sL https://raw.githubusercontent.com/travis-ci/gimme/master/gimme | HOME=/gimme bash >> /etc/profile.d/gimme.sh ---> Using cache ---> 3e3d43f49e45 Step 7/12 : ENV GOPATH "/go" GOBIN "/usr/bin" ---> Using cache ---> 73e8a3aa263a Step 8/12 : ADD rsyncd.conf /etc/rsyncd.conf ---> Using cache ---> bc244b1c712b Step 9/12 : RUN mkdir -p /go && source /etc/profile.d/gimme.sh && go get github.com/mattn/goveralls && go get -u github.com/Masterminds/glide && go get golang.org/x/tools/cmd/goimports && git clone https://github.com/mvdan/sh.git $GOPATH/src/mvdan.cc/sh && cd /go/src/mvdan.cc/sh/cmd/shfmt && git checkout v2.5.0 && go get mvdan.cc/sh/cmd/shfmt && go install && go get -u github.com/golang/mock/gomock && go get -u github.com/rmohr/mock/mockgen && go get -u github.com/rmohr/go-swagger-utils/swagger-doc && go get -u github.com/onsi/ginkgo/ginkgo && go get -u -d k8s.io/code-generator/cmd/deepcopy-gen && go get -u -d k8s.io/code-generator/cmd/defaulter-gen && go get -u -d k8s.io/code-generator/cmd/openapi-gen && cd /go/src/k8s.io/code-generator/cmd/deepcopy-gen && git checkout release-1.9 && go install && cd /go/src/k8s.io/code-generator/cmd/defaulter-gen && git checkout release-1.9 && go install && cd /go/src/k8s.io/code-generator/cmd/openapi-gen && git checkout release-1.9 && go install && go get -u -d github.com/golang/protobuf/protoc-gen-go && cd /go/src/github.com/golang/protobuf/protoc-gen-go && git checkout 1643683e1b54a9e88ad26d98f81400c8c9d9f4f9 && go install ---> Using cache ---> 4cd1786b2bc8 Step 10/12 : RUN pip install j2cli ---> Using cache ---> b51a532fa53a Step 11/12 : ADD entrypoint.sh /entrypoint.sh ---> Using cache ---> 3bc0185264f6 Step 12/12 : ENTRYPOINT /entrypoint.sh ---> Using cache ---> dcf2b21fa2ed Successfully built dcf2b21fa2ed go version go1.10 linux/amd64 go version go1.10 linux/amd64 find: '/root/go/src/kubevirt.io/kubevirt/_out/cmd': No such file or directory Compiling tests... compiled tests.test hack/build-docker.sh build Sending build context to Docker daemon 40.4 MB Step 1/8 : FROM fedora:28 ---> cc510acfcd70 Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virt-controller ---> Using cache ---> b00c84523b53 Step 4/8 : WORKDIR /home/virt-controller ---> Using cache ---> b76b8bd8cd39 Step 5/8 : USER 1001 ---> Using cache ---> b6d9ad9ed232 Step 6/8 : COPY virt-controller /usr/bin/virt-controller ---> Using cache ---> 0bf9563134f5 Step 7/8 : ENTRYPOINT /usr/bin/virt-controller ---> Using cache ---> 8f484abc807f Step 8/8 : LABEL "kubevirt-functional-tests-k8s-1.11.0-release0" '' "virt-controller" '' ---> Running in 9fc9a06d6613 ---> 3590ee93abf8 Removing intermediate container 9fc9a06d6613 Successfully built 3590ee93abf8 Sending build context to Docker daemon 43.32 MB Step 1/10 : FROM kubevirt/libvirt:4.2.0 ---> 5f0bfe81a3e0 Step 2/10 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 945996802736 Step 3/10 : RUN dnf -y install socat genisoimage util-linux libcgroup-tools ethtool net-tools sudo && dnf -y clean all && test $(id -u qemu) = 107 # make sure that the qemu user really is 107 ---> Using cache ---> 672f9ab56316 Step 4/10 : COPY virt-launcher /usr/bin/virt-launcher ---> 2dda6072016f Removing intermediate container 79cf0cba36ec Step 5/10 : COPY kubevirt-sudo /etc/sudoers.d/kubevirt ---> 78ded6a6f87d Removing intermediate container 43f98a5c532b Step 6/10 : RUN setcap CAP_NET_BIND_SERVICE=+eip /usr/bin/qemu-system-x86_64 ---> Running in 3f7f012f4e46  ---> 750119981d77 Removing intermediate container 3f7f012f4e46 Step 7/10 : RUN mkdir -p /usr/share/kubevirt/virt-launcher ---> Running in fce33ed6fa3a  ---> e963c3799f73 Removing intermediate container fce33ed6fa3a Step 8/10 : COPY entrypoint.sh libvirtd.sh sock-connector /usr/share/kubevirt/virt-launcher/ ---> 31c0a6a1d28e Removing intermediate container dd144448d045 Step 9/10 : ENTRYPOINT /usr/share/kubevirt/virt-launcher/entrypoint.sh ---> Running in 59c5a2f18e3c ---> 84d89809aeab Removing intermediate container 59c5a2f18e3c Step 10/10 : LABEL "kubevirt-functional-tests-k8s-1.11.0-release0" '' "virt-launcher" '' ---> Running in 9cf3319bd484 ---> 5c2926c22e98 Removing intermediate container 9cf3319bd484 Successfully built 5c2926c22e98 Sending build context to Docker daemon 41.7 MB Step 1/5 : FROM fedora:28 ---> cc510acfcd70 Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/5 : COPY virt-handler /usr/bin/virt-handler ---> 1576a0d85438 Removing intermediate container b1c1615e6e6a Step 4/5 : ENTRYPOINT /usr/bin/virt-handler ---> Running in a0c4f3d84049 ---> 581c52468115 Removing intermediate container a0c4f3d84049 Step 5/5 : LABEL "kubevirt-functional-tests-k8s-1.11.0-release0" '' "virt-handler" '' ---> Running in 5836ebc3b552 ---> 90d94c1ba5e9 Removing intermediate container 5836ebc3b552 Successfully built 90d94c1ba5e9 Sending build context to Docker daemon 38.81 MB Step 1/8 : FROM fedora:28 ---> cc510acfcd70 Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virt-api ---> Using cache ---> ed1ebf600ee1 Step 4/8 : WORKDIR /home/virt-api ---> Using cache ---> 0769dad023e5 Step 5/8 : USER 1001 ---> Using cache ---> 0cb65afb0c2b Step 6/8 : COPY virt-api /usr/bin/virt-api ---> 7bc9c63349a4 Removing intermediate container 848084292ec6 Step 7/8 : ENTRYPOINT /usr/bin/virt-api ---> Running in f9d3dd6dde7d ---> c52c0070432f Removing intermediate container f9d3dd6dde7d Step 8/8 : LABEL "kubevirt-functional-tests-k8s-1.11.0-release0" '' "virt-api" '' ---> Running in 389226639e49 ---> e9fea20ba4bf Removing intermediate container 389226639e49 Successfully built e9fea20ba4bf Sending build context to Docker daemon 4.096 kB Step 1/7 : FROM fedora:28 ---> cc510acfcd70 Step 2/7 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/7 : ENV container docker ---> Using cache ---> 62847a2a1fa8 Step 4/7 : RUN mkdir -p /images/custom /images/alpine && truncate -s 64M /images/custom/disk.img && curl http://dl-cdn.alpinelinux.org/alpine/v3.7/releases/x86_64/alpine-virt-3.7.0-x86_64.iso > /images/alpine/disk.img ---> Using cache ---> 02134835a6aa Step 5/7 : ADD entrypoint.sh / ---> Using cache ---> ec0843818da7 Step 6/7 : CMD /entrypoint.sh ---> Using cache ---> 754029bb4bd2 Step 7/7 : LABEL "disks-images-provider" '' "kubevirt-functional-tests-k8s-1.11.0-release0" '' ---> Using cache ---> 2ce1eec77729 Successfully built 2ce1eec77729 Sending build context to Docker daemon 2.56 kB Step 1/5 : FROM fedora:28 ---> cc510acfcd70 Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/5 : ENV container docker ---> Using cache ---> 62847a2a1fa8 Step 4/5 : RUN dnf -y install procps-ng nmap-ncat && dnf -y clean all ---> Using cache ---> 207487abe7b2 Step 5/5 : LABEL "kubevirt-functional-tests-k8s-1.11.0-release0" '' "vm-killer" '' ---> Using cache ---> 51b62a0ecd10 Successfully built 51b62a0ecd10 Sending build context to Docker daemon 5.12 kB Step 1/7 : FROM debian:sid ---> 68f33cf86aab Step 2/7 : MAINTAINER "David Vossel" \ ---> Using cache ---> 5734d749eb5c Step 3/7 : ENV container docker ---> Using cache ---> f8775a77966f Step 4/7 : RUN apt-get update && apt-get install -y bash curl bzip2 qemu-utils && mkdir -p /disk && rm -rf /var/lib/apt/lists/* ---> Using cache ---> 1a40cf222a61 Step 5/7 : ADD entry-point.sh / ---> Using cache ---> 77b545d92fe7 Step 6/7 : CMD /entry-point.sh ---> Using cache ---> dfe20d463305 Step 7/7 : LABEL "kubevirt-functional-tests-k8s-1.11.0-release0" '' "registry-disk-v1alpha" '' ---> Using cache ---> d47274c50623 Successfully built d47274c50623 Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33771/kubevirt/registry-disk-v1alpha:devel ---> d47274c50623 Step 2/4 : MAINTAINER "David Vossel" \ ---> Using cache ---> 94c21c65872a Step 3/4 : RUN curl https://download.cirros-cloud.net/0.4.0/cirros-0.4.0-x86_64-disk.img > /disk/cirros.img ---> Using cache ---> 48605500da55 Step 4/4 : LABEL "cirros-registry-disk-demo" '' "kubevirt-functional-tests-k8s-1.11.0-release0" '' ---> Using cache ---> 4b8200fc9235 Successfully built 4b8200fc9235 Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33771/kubevirt/registry-disk-v1alpha:devel ---> d47274c50623 Step 2/4 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 8e698fc18d9d Step 3/4 : RUN curl -g -L https://download.fedoraproject.org/pub/fedora/linux/releases/27/CloudImages/x86_64/images/Fedora-Cloud-Base-27-1.6.x86_64.qcow2 > /disk/fedora.qcow2 ---> Using cache ---> e9c68c4dc91c Step 4/4 : LABEL "fedora-cloud-registry-disk-demo" '' "kubevirt-functional-tests-k8s-1.11.0-release0" '' ---> Using cache ---> 98232324771d Successfully built 98232324771d Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33771/kubevirt/registry-disk-v1alpha:devel ---> d47274c50623 Step 2/4 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 8e698fc18d9d Step 3/4 : RUN curl http://dl-cdn.alpinelinux.org/alpine/v3.7/releases/x86_64/alpine-virt-3.7.0-x86_64.iso > /disk/alpine.iso ---> Using cache ---> 38176d1a3214 Step 4/4 : LABEL "alpine-registry-disk-demo" '' "kubevirt-functional-tests-k8s-1.11.0-release0" '' ---> Using cache ---> 8c0a79fc816d Successfully built 8c0a79fc816d Sending build context to Docker daemon 35.59 MB Step 1/8 : FROM fedora:28 ---> cc510acfcd70 Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virtctl ---> Using cache ---> 985fe391c056 Step 4/8 : WORKDIR /home/virtctl ---> Using cache ---> 3b2cae8ac543 Step 5/8 : USER 1001 ---> Using cache ---> 0c06e5b4a900 Step 6/8 : COPY subresource-access-test /subresource-access-test ---> df1280571ee0 Removing intermediate container 655acbebffcb Step 7/8 : ENTRYPOINT /subresource-access-test ---> Running in dc05184b30be ---> 5e63bb8cdd94 Removing intermediate container dc05184b30be Step 8/8 : LABEL "kubevirt-functional-tests-k8s-1.11.0-release0" '' "subresource-access-test" '' ---> Running in f6b53ddb6cdf ---> 9d47ca05b24c Removing intermediate container f6b53ddb6cdf Successfully built 9d47ca05b24c Sending build context to Docker daemon 3.072 kB Step 1/9 : FROM fedora:28 ---> cc510acfcd70 Step 2/9 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/9 : ENV container docker ---> Using cache ---> 62847a2a1fa8 Step 4/9 : RUN dnf -y install make git gcc && dnf -y clean all ---> Using cache ---> d3456b1644b1 Step 5/9 : ENV GIMME_GO_VERSION 1.9.2 ---> Using cache ---> 0ba81fddbba1 Step 6/9 : RUN mkdir -p /gimme && curl -sL https://raw.githubusercontent.com/travis-ci/gimme/master/gimme | HOME=/gimme bash >> /etc/profile.d/gimme.sh ---> Using cache ---> 5d33abe3f819 Step 7/9 : ENV GOPATH "/go" GOBIN "/usr/bin" ---> Using cache ---> 783826523be1 Step 8/9 : RUN mkdir -p /go && source /etc/profile.d/gimme.sh && go get github.com/masterzen/winrm-cli ---> Using cache ---> 711bc8d15952 Step 9/9 : LABEL "kubevirt-functional-tests-k8s-1.11.0-release0" '' "winrmcli" '' ---> Using cache ---> 671374ffcc63 Successfully built 671374ffcc63 Sending build context to Docker daemon 36.8 MB Step 1/5 : FROM fedora:27 ---> 9110ae7f579f Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> e3238544ad97 Step 3/5 : COPY example-hook-sidecar /example-hook-sidecar ---> 1bdc82fa6ea8 Removing intermediate container 194ecbe03931 Step 4/5 : ENTRYPOINT /example-hook-sidecar ---> Running in 13fbc291b3c6 ---> 519ebb52fe40 Removing intermediate container 13fbc291b3c6 Step 5/5 : LABEL "example-hook-sidecar" '' "kubevirt-functional-tests-k8s-1.11.0-release0" '' ---> Running in 2def17b3413d ---> 14bd78cc99a4 Removing intermediate container 2def17b3413d Successfully built 14bd78cc99a4 hack/build-docker.sh push The push refers to a repository [localhost:33771/kubevirt/virt-controller] bc4a0c364265: Preparing aa89340cf7a8: Preparing 891e1e4ef82a: Preparing aa89340cf7a8: Pushed bc4a0c364265: Pushed 891e1e4ef82a: Pushed devel: digest: sha256:68add576f98f01c5eda4b554ecde2d749b39889c587bb14108adbbcda0a8f949 size: 949 The push refers to a repository [localhost:33771/kubevirt/virt-launcher] 3da3839dbd1f: Preparing 95c7934ce1e6: Preparing 0c2bc01e9ba4: Preparing 0a56c4bb1f31: Preparing 74adc1efaba4: Preparing 633427c64a24: Preparing da38cf808aa5: Preparing b83399358a92: Preparing 186d8b3e4fd8: Preparing fa6154170bf5: Preparing 95c7934ce1e6: Waiting 5eefb9960a36: Preparing 633427c64a24: Waiting 891e1e4ef82a: Preparing 186d8b3e4fd8: Waiting 0c2bc01e9ba4: Waiting 0a56c4bb1f31: Waiting fa6154170bf5: Waiting da38cf808aa5: Waiting 74adc1efaba4: Waiting 5eefb9960a36: Waiting 891e1e4ef82a: Waiting b83399358a92: Waiting 3da3839dbd1f: Pushed 95c7934ce1e6: Pushed 0a56c4bb1f31: Pushed 0c2bc01e9ba4: Pushed da38cf808aa5: Pushed b83399358a92: Pushed 186d8b3e4fd8: Pushed fa6154170bf5: Pushed 891e1e4ef82a: Mounted from kubevirt/virt-controller 633427c64a24: Pushed 74adc1efaba4: Pushed 5eefb9960a36: Pushed devel: digest: sha256:b1db53c712a694aa2e2c3af89a3bca52458cfad3631fae4c94d78a94b2bfdf03 size: 2828 The push refers to a repository [localhost:33771/kubevirt/virt-handler] 8f8080a870ba: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/virt-launcher 8f8080a870ba: Pushed devel: digest: sha256:fe8669128a8ef105e30451be826fa4c2ff0314886611c50346bbdce4a43c4203 size: 741 The push refers to a repository [localhost:33771/kubevirt/virt-api] c9930870042e: Preparing 82fc744c99b4: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/virt-handler 82fc744c99b4: Pushed c9930870042e: Pushed devel: digest: sha256:bec0573e3d1984bc6f344330cd2e52cfe5af402d37cc9f795d45ed27c6a7e378 size: 948 The push refers to a repository [localhost:33771/kubevirt/disks-images-provider] 71ad31feb2c5: Preparing 21d4b721776e: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/virt-api 71ad31feb2c5: Pushed 21d4b721776e: Pushed devel: digest: sha256:cd187e542554d6c701bfb0cb08f65a76d23fa75be34176dc4188c76ec468c9f4 size: 948 The push refers to a repository [localhost:33771/kubevirt/vm-killer] c4cfadeeaf5f: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/disks-images-provider c4cfadeeaf5f: Pushed devel: digest: sha256:72afae217b15b5f36f1509e4a78d76f16b21e607b318d2e701cfe8567738c9dc size: 740 The push refers to a repository [localhost:33771/kubevirt/registry-disk-v1alpha] 661cce8d8e52: Preparing 41e0baba3077: Preparing 25edbec0eaea: Preparing 661cce8d8e52: Pushed 41e0baba3077: Pushed 25edbec0eaea: Pushed devel: digest: sha256:4beab74b750c384fed6e9272292cd4f3885cf63160b4cc8be85dcb7eb12fd910 size: 948 The push refers to a repository [localhost:33771/kubevirt/cirros-registry-disk-demo] 796d82cd42db: Preparing 661cce8d8e52: Preparing 41e0baba3077: Preparing 25edbec0eaea: Preparing 25edbec0eaea: Mounted from kubevirt/registry-disk-v1alpha 661cce8d8e52: Mounted from kubevirt/registry-disk-v1alpha 41e0baba3077: Mounted from kubevirt/registry-disk-v1alpha 796d82cd42db: Pushed devel: digest: sha256:caa473d35dda5da1c955c07c18584bca173fc3ac1655c04509b42465d78e6565 size: 1160 The push refers to a repository [localhost:33771/kubevirt/fedora-cloud-registry-disk-demo] 3cf3799e71d4: Preparing 661cce8d8e52: Preparing 41e0baba3077: Preparing 25edbec0eaea: Preparing 661cce8d8e52: Mounted from kubevirt/cirros-registry-disk-demo 25edbec0eaea: Mounted from kubevirt/cirros-registry-disk-demo 41e0baba3077: Mounted from kubevirt/cirros-registry-disk-demo 3cf3799e71d4: Pushed devel: digest: sha256:949d4de4d95938a99ac539d20780234a3f06cc98e3d0113d383d45e98b360c10 size: 1161 The push refers to a repository [localhost:33771/kubevirt/alpine-registry-disk-demo] c59c11514491: Preparing 661cce8d8e52: Preparing 41e0baba3077: Preparing 25edbec0eaea: Preparing 661cce8d8e52: Mounted from kubevirt/fedora-cloud-registry-disk-demo 25edbec0eaea: Mounted from kubevirt/fedora-cloud-registry-disk-demo 41e0baba3077: Mounted from kubevirt/fedora-cloud-registry-disk-demo c59c11514491: Pushed devel: digest: sha256:f95f7a6825d39ae4570cd8b9e1fb8d77f390e328d9d8a0e516f222809071b61c size: 1160 The push refers to a repository [localhost:33771/kubevirt/subresource-access-test] 481c9fa8a9bf: Preparing 25cb73590a9d: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/vm-killer 25cb73590a9d: Pushed 481c9fa8a9bf: Pushed devel: digest: sha256:79405d09b0cd5f36f32fbaa6195caaf5d687fc0d60ce08f9df44f79d09c1f72c size: 948 The push refers to a repository [localhost:33771/kubevirt/winrmcli] f8083e002d0b: Preparing 53c709abc882: Preparing 9ca98a0f492b: Preparing 891e1e4ef82a: Preparing f8083e002d0b: Pushed 891e1e4ef82a: Mounted from kubevirt/subresource-access-test 9ca98a0f492b: Pushed 53c709abc882: Pushed devel: digest: sha256:a1fae1967d100edf5b23924a81a158c98d867422874226220754a604b2c256af size: 1165 The push refers to a repository [localhost:33771/kubevirt/example-hook-sidecar] 975169ded35e: Preparing 39bae602f753: Preparing 975169ded35e: Pushed 39bae602f753: Pushed devel: digest: sha256:a2f97e14fdc9b953525fc72f258167d72246acef44b17f7c1d030ce08527de10 size: 740 make[1]: Leaving directory `/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt' Done ./cluster/clean.sh + source hack/common.sh ++++ dirname 'hack/common.sh[0]' +++ cd hack/../ +++ pwd ++ KUBEVIRT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt ++ OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out ++ VENDOR_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/vendor ++ CMD_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out/cmd ++ TESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out/tests ++ APIDOCS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out/apidocs ++ MANIFESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out/manifests ++ MANIFEST_TEMPLATES_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out/templates/manifests ++ PYTHON_CLIENT_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out/client-python ++ KUBEVIRT_PROVIDER=k8s-1.11.0 ++ KUBEVIRT_NUM_NODES=2 ++ '[' -z kubevirt-functional-tests-k8s-1.11.0-release ']' ++ provider_prefix=kubevirt-functional-tests-k8s-1.11.0-release0 ++ job_prefix=kubevirt-functional-tests-k8s-1.11.0-release0 +++ kubevirt_version +++ '[' -n '' ']' +++ '[' -d /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/.git ']' ++++ git describe --always --tags +++ echo v0.7.0-200-g25fa194 ++ KUBEVIRT_VERSION=v0.7.0-200-g25fa194 + source cluster/k8s-1.11.0/provider.sh ++ set -e ++ image=k8s-1.11.0@sha256:6c1caf5559eb02a144bf606de37eb0194c06ace4d77ad4561459f3bde876151c ++ source cluster/ephemeral-provider-common.sh +++ set -e +++ _cli='docker run --privileged --net=host --rm -v /var/run/docker.sock:/var/run/docker.sock kubevirtci/gocli@sha256:aa7f295a7908fa333ab5e98ef3af0bfafbabfd3cee2b83f9af47f722e3000f6a' + source hack/config.sh ++ unset binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig manifest_docker_prefix namespace image_pull_policy ++ KUBEVIRT_PROVIDER=k8s-1.11.0 ++ source hack/config-default.sh source hack/config-k8s-1.11.0.sh +++ binaries='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virtctl cmd/fake-qemu-process cmd/virt-api cmd/subresource-access-test cmd/example-hook-sidecar' +++ docker_images='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virt-api images/disks-images-provider images/vm-killer cmd/registry-disk-v1alpha images/cirros-registry-disk-demo images/fedora-cloud-registry-disk-demo images/alpine-registry-disk-demo cmd/subresource-access-test images/winrmcli cmd/example-hook-sidecar' +++ docker_prefix=kubevirt +++ docker_tag=latest +++ master_ip=192.168.200.2 +++ network_provider=flannel +++ namespace=kube-system +++ image_pull_policy=IfNotPresent ++ test -f hack/config-provider-k8s-1.11.0.sh ++ source hack/config-provider-k8s-1.11.0.sh +++ master_ip=127.0.0.1 +++ docker_tag=devel +++ kubeconfig=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/cluster/k8s-1.11.0/.kubeconfig +++ kubectl=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/cluster/k8s-1.11.0/.kubectl +++ docker_prefix=localhost:33771/kubevirt +++ manifest_docker_prefix=registry:5000/kubevirt ++ test -f hack/config-local.sh ++ export binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig namespace image_pull_policy + echo 'Cleaning up ...' Cleaning up ... + cluster/kubectl.sh get vmis --all-namespaces -o=custom-columns=NAME:.metadata.name,NAMESPACE:.metadata.namespace,FINALIZERS:.metadata.finalizers --no-headers + grep foregroundDeleteVirtualMachine + read p error: the server doesn't have a resource type "vmis" + _kubectl delete ds -l kubevirt.io -n kube-system --cascade=false --grace-period 0 No resources found + _kubectl delete pods -n kube-system -l=kubevirt.io=libvirt --force --grace-period 0 No resources found + _kubectl delete pods -n kube-system -l=kubevirt.io=virt-handler --force --grace-period 0 No resources found + namespaces=(default ${namespace}) + for i in '${namespaces[@]}' + _kubectl -n default delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete apiservices -l kubevirt.io No resources found + _kubectl -n default delete deployment -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete deployment -l kubevirt.io No resources found + _kubectl -n default delete rs -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete rs -l kubevirt.io No resources found + _kubectl -n default delete services -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete services -l kubevirt.io No resources found + _kubectl -n default delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete apiservices -l kubevirt.io No resources found + _kubectl -n default delete validatingwebhookconfiguration -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete validatingwebhookconfiguration -l kubevirt.io No resources found + _kubectl -n default delete secrets -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete secrets -l kubevirt.io No resources found + _kubectl -n default delete pv -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete pv -l kubevirt.io No resources found + _kubectl -n default delete pvc -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete pvc -l kubevirt.io No resources found + _kubectl -n default delete ds -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete ds -l kubevirt.io No resources found + _kubectl -n default delete customresourcedefinitions -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete customresourcedefinitions -l kubevirt.io No resources found + _kubectl -n default delete pods -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete pods -l kubevirt.io No resources found + _kubectl -n default delete clusterrolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete clusterrolebinding -l kubevirt.io No resources found + _kubectl -n default delete rolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete rolebinding -l kubevirt.io No resources found + _kubectl -n default delete roles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete roles -l kubevirt.io No resources found + _kubectl -n default delete clusterroles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete clusterroles -l kubevirt.io No resources found + _kubectl -n default delete serviceaccounts -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n default delete serviceaccounts -l kubevirt.io No resources found ++ _kubectl -n default get crd offlinevirtualmachines.kubevirt.io ++ wc -l ++ export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig ++ KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig ++ cluster/k8s-1.11.0/.kubectl -n default get crd offlinevirtualmachines.kubevirt.io No resources found. Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "offlinevirtualmachines.kubevirt.io" not found + '[' 0 -gt 0 ']' + for i in '${namespaces[@]}' + _kubectl -n kube-system delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete apiservices -l kubevirt.io No resources found + _kubectl -n kube-system delete deployment -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete deployment -l kubevirt.io No resources found + _kubectl -n kube-system delete rs -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete rs -l kubevirt.io No resources found + _kubectl -n kube-system delete services -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete services -l kubevirt.io No resources found + _kubectl -n kube-system delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete apiservices -l kubevirt.io No resources found + _kubectl -n kube-system delete validatingwebhookconfiguration -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete validatingwebhookconfiguration -l kubevirt.io No resources found + _kubectl -n kube-system delete secrets -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete secrets -l kubevirt.io No resources found + _kubectl -n kube-system delete pv -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete pv -l kubevirt.io No resources found + _kubectl -n kube-system delete pvc -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete pvc -l kubevirt.io No resources found + _kubectl -n kube-system delete ds -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete ds -l kubevirt.io No resources found + _kubectl -n kube-system delete customresourcedefinitions -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete customresourcedefinitions -l kubevirt.io No resources found + _kubectl -n kube-system delete pods -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete pods -l kubevirt.io No resources found + _kubectl -n kube-system delete clusterrolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete clusterrolebinding -l kubevirt.io No resources found + _kubectl -n kube-system delete rolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete rolebinding -l kubevirt.io No resources found + _kubectl -n kube-system delete roles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete roles -l kubevirt.io No resources found + _kubectl -n kube-system delete clusterroles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete clusterroles -l kubevirt.io No resources found + _kubectl -n kube-system delete serviceaccounts -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl -n kube-system delete serviceaccounts -l kubevirt.io No resources found ++ _kubectl -n kube-system get crd offlinevirtualmachines.kubevirt.io ++ wc -l ++ export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig ++ KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig ++ cluster/k8s-1.11.0/.kubectl -n kube-system get crd offlinevirtualmachines.kubevirt.io No resources found. Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "offlinevirtualmachines.kubevirt.io" not found + '[' 0 -gt 0 ']' + sleep 2 + echo Done Done ./cluster/deploy.sh + source hack/common.sh ++++ dirname 'hack/common.sh[0]' +++ cd hack/../ +++ pwd ++ KUBEVIRT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt ++ OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out ++ VENDOR_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/vendor ++ CMD_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out/cmd ++ TESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out/tests ++ APIDOCS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out/apidocs ++ MANIFESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out/manifests ++ MANIFEST_TEMPLATES_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out/templates/manifests ++ PYTHON_CLIENT_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out/client-python ++ KUBEVIRT_PROVIDER=k8s-1.11.0 ++ KUBEVIRT_NUM_NODES=2 ++ '[' -z kubevirt-functional-tests-k8s-1.11.0-release ']' ++ provider_prefix=kubevirt-functional-tests-k8s-1.11.0-release0 ++ job_prefix=kubevirt-functional-tests-k8s-1.11.0-release0 +++ kubevirt_version +++ '[' -n '' ']' +++ '[' -d /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/.git ']' ++++ git describe --always --tags +++ echo v0.7.0-200-g25fa194 ++ KUBEVIRT_VERSION=v0.7.0-200-g25fa194 + source cluster/k8s-1.11.0/provider.sh ++ set -e ++ image=k8s-1.11.0@sha256:6c1caf5559eb02a144bf606de37eb0194c06ace4d77ad4561459f3bde876151c ++ source cluster/ephemeral-provider-common.sh +++ set -e +++ _cli='docker run --privileged --net=host --rm -v /var/run/docker.sock:/var/run/docker.sock kubevirtci/gocli@sha256:aa7f295a7908fa333ab5e98ef3af0bfafbabfd3cee2b83f9af47f722e3000f6a' + source hack/config.sh ++ unset binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig manifest_docker_prefix namespace image_pull_policy ++ KUBEVIRT_PROVIDER=k8s-1.11.0 ++ source hack/config-default.sh source hack/config-k8s-1.11.0.sh +++ binaries='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virtctl cmd/fake-qemu-process cmd/virt-api cmd/subresource-access-test cmd/example-hook-sidecar' +++ docker_images='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virt-api images/disks-images-provider images/vm-killer cmd/registry-disk-v1alpha images/cirros-registry-disk-demo images/fedora-cloud-registry-disk-demo images/alpine-registry-disk-demo cmd/subresource-access-test images/winrmcli cmd/example-hook-sidecar' +++ docker_prefix=kubevirt +++ docker_tag=latest +++ master_ip=192.168.200.2 +++ network_provider=flannel +++ namespace=kube-system +++ image_pull_policy=IfNotPresent ++ test -f hack/config-provider-k8s-1.11.0.sh ++ source hack/config-provider-k8s-1.11.0.sh +++ master_ip=127.0.0.1 +++ docker_tag=devel +++ kubeconfig=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/cluster/k8s-1.11.0/.kubeconfig +++ kubectl=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/cluster/k8s-1.11.0/.kubectl +++ docker_prefix=localhost:33771/kubevirt +++ manifest_docker_prefix=registry:5000/kubevirt ++ test -f hack/config-local.sh ++ export binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig namespace image_pull_policy + echo 'Deploying ...' Deploying ... + [[ -z k8s-1.11.0-release ]] + [[ k8s-1.11.0-release =~ .*-dev ]] + [[ k8s-1.11.0-release =~ .*-release ]] + for manifest in '${MANIFESTS_OUT_DIR}/release/*' + [[ /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out/manifests/release/demo-content.yaml =~ .*demo.* ]] + continue + for manifest in '${MANIFESTS_OUT_DIR}/release/*' + [[ /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out/manifests/release/kubevirt.yaml =~ .*demo.* ]] + _kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out/manifests/release/kubevirt.yaml + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out/manifests/release/kubevirt.yaml clusterrole.rbac.authorization.k8s.io/kubevirt.io:admin created clusterrole.rbac.authorization.k8s.io/kubevirt.io:edit created clusterrole.rbac.authorization.k8s.io/kubevirt.io:view created serviceaccount/kubevirt-apiserver created clusterrolebinding.rbac.authorization.k8s.io/kubevirt-apiserver created clusterrolebinding.rbac.authorization.k8s.io/kubevirt-apiserver-auth-delegator created rolebinding.rbac.authorization.k8s.io/kubevirt-apiserver created role.rbac.authorization.k8s.io/kubevirt-apiserver created clusterrole.rbac.authorization.k8s.io/kubevirt-apiserver created clusterrole.rbac.authorization.k8s.io/kubevirt-controller created serviceaccount/kubevirt-controller created serviceaccount/kubevirt-privileged created clusterrolebinding.rbac.authorization.k8s.io/kubevirt-controller created clusterrolebinding.rbac.authorization.k8s.io/kubevirt-controller-cluster-admin created clusterrolebinding.rbac.authorization.k8s.io/kubevirt-privileged-cluster-admin created clusterrole.rbac.authorization.k8s.io/kubevirt.io:default created clusterrolebinding.rbac.authorization.k8s.io/kubevirt.io:default created service/virt-api created deployment.extensions/virt-api created deployment.extensions/virt-controller created daemonset.extensions/virt-handler created customresourcedefinition.apiextensions.k8s.io/virtualmachineinstances.kubevirt.io created customresourcedefinition.apiextensions.k8s.io/virtualmachineinstancereplicasets.kubevirt.io created customresourcedefinition.apiextensions.k8s.io/virtualmachineinstancepresets.kubevirt.io created customresourcedefinition.apiextensions.k8s.io/virtualmachines.kubevirt.io created + _kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out/manifests/testing -R + export KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + KUBECONFIG=cluster/k8s-1.11.0/.kubeconfig + cluster/k8s-1.11.0/.kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/go/src/kubevirt.io/kubevirt/_out/manifests/testing -R persistentvolumeclaim/disk-alpine created persistentvolume/host-path-disk-alpine created persistentvolumeclaim/disk-custom created persistentvolume/host-path-disk-custom created daemonset.extensions/disks-images-provider created serviceaccount/kubevirt-testing created clusterrolebinding.rbac.authorization.k8s.io/kubevirt-testing-cluster-admin created + [[ k8s-1.11.0 =~ os-* ]] + echo Done Done + namespaces=(kube-system default) + [[ kube-system != \k\u\b\e\-\s\y\s\t\e\m ]] + timeout=300 + sample=30 + for i in '${namespaces[@]}' + current_time=0 ++ kubectl get pods -n kube-system --no-headers ++ cluster/kubectl.sh get pods -n kube-system --no-headers ++ grep -v Running + '[' -n 'virt-api-bcc6b587d-c2f48 0/1 ContainerCreating 0 2s virt-api-bcc6b587d-rbw2d 0/1 ContainerCreating 0 2s virt-controller-67dcdd8464-lh2vk 0/1 ContainerCreating 0 2s virt-controller-67dcdd8464-wc5w7 0/1 ContainerCreating 0 2s virt-handler-thh67 0/1 ContainerCreating 0 2s virt-handler-vj5c7 0/1 ContainerCreating 0 2s' ']' + echo 'Waiting for kubevirt pods to enter the Running state ...' Waiting for kubevirt pods to enter the Running state ... + kubectl get pods -n kube-system --no-headers + cluster/kubectl.sh get pods -n kube-system --no-headers + grep -v Running virt-api-bcc6b587d-c2f48 0/1 ContainerCreating 0 2s virt-api-bcc6b587d-rbw2d 0/1 ContainerCreating 0 2s virt-controller-67dcdd8464-lh2vk 0/1 ContainerCreating 0 2s virt-controller-67dcdd8464-wc5w7 0/1 ContainerCreating 0 2s virt-handler-thh67 0/1 ContainerCreating 0 2s virt-handler-vj5c7 0/1 ContainerCreating 0 2s + sleep 30 + current_time=30 + '[' 30 -gt 300 ']' ++ kubectl get pods -n kube-system --no-headers ++ cluster/kubectl.sh get pods -n kube-system --no-headers ++ grep -v Running + '[' -n '' ']' + current_time=0 ++ kubectl get pods -n kube-system '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers ++ grep false ++ cluster/kubectl.sh get pods -n kube-system '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers + '[' -n false ']' + echo 'Waiting for KubeVirt containers to become ready ...' Waiting for KubeVirt containers to become ready ... + kubectl get pods -n kube-system '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers + cluster/kubectl.sh get pods -n kube-system '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers + grep false false + sleep 30 + current_time=30 + '[' 30 -gt 300 ']' ++ grep false ++ kubectl get pods -n kube-system '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers ++ cluster/kubectl.sh get pods -n kube-system '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers + '[' -n '' ']' + kubectl get pods -n kube-system + cluster/kubectl.sh get pods -n kube-system NAME READY STATUS RESTARTS AGE coredns-78fcdf6894-4vzqn 1/1 Running 0 15m coredns-78fcdf6894-55kks 1/1 Running 0 15m disks-images-provider-ckdff 1/1 Running 0 1m disks-images-provider-dknsv 1/1 Running 0 1m etcd-node01 1/1 Running 0 14m kube-apiserver-node01 1/1 Running 0 14m kube-controller-manager-node01 1/1 Running 0 14m kube-flannel-ds-fjnt7 1/1 Running 0 15m kube-flannel-ds-kf8rl 1/1 Running 0 15m kube-proxy-d7bfc 1/1 Running 0 15m kube-proxy-ggcg6 1/1 Running 0 15m kube-scheduler-node01 1/1 Running 0 14m virt-api-bcc6b587d-c2f48 1/1 Running 0 1m virt-api-bcc6b587d-rbw2d 1/1 Running 0 1m virt-controller-67dcdd8464-lh2vk 1/1 Running 0 1m virt-controller-67dcdd8464-wc5w7 1/1 Running 0 1m virt-handler-thh67 1/1 Running 0 1m virt-handler-vj5c7 1/1 Running 0 1m + for i in '${namespaces[@]}' + current_time=0 ++ kubectl get pods -n default --no-headers ++ cluster/kubectl.sh get pods -n default --no-headers ++ grep -v Running + '[' -n '' ']' + current_time=0 ++ kubectl get pods -n default '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers ++ cluster/kubectl.sh get pods -n default '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers ++ grep false + '[' -n '' ']' + kubectl get pods -n default + cluster/kubectl.sh get pods -n default NAME READY STATUS RESTARTS AGE local-volume-provisioner-s8bjd 1/1 Running 0 15m local-volume-provisioner-t7fcm 1/1 Running 0 15m + kubectl version + cluster/kubectl.sh version Client Version: version.Info{Major:"1", Minor:"11", GitVersion:"v1.11.0", GitCommit:"91e7b4fd31fcd3d5f436da26c980becec37ceefe", GitTreeState:"clean", BuildDate:"2018-06-27T20:17:28Z", GoVersion:"go1.10.2", Compiler:"gc", Platform:"linux/amd64"} Server Version: version.Info{Major:"1", Minor:"11", GitVersion:"v1.11.0", GitCommit:"91e7b4fd31fcd3d5f436da26c980becec37ceefe", GitTreeState:"clean", BuildDate:"2018-06-27T20:08:34Z", GoVersion:"go1.10.2", Compiler:"gc", Platform:"linux/amd64"} + ginko_params='--ginkgo.noColor --junit-output=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/junit.xml' + [[ k8s-1.11.0-release =~ windows.* ]] + FUNC_TEST_ARGS='--ginkgo.noColor --junit-output=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-release/junit.xml' + make functest hack/dockerized "hack/build-func-tests.sh" Sending build context to Docker daemon 5.632 kB Step 1/12 : FROM fedora:28 ---> cc510acfcd70 Step 2/12 : ENV LIBVIRT_VERSION 4.2.0 ---> Using cache ---> b1088795aeb6 Step 3/12 : RUN curl --output /etc/yum.repos.d/fedora-virt-preview.repo https://fedorapeople.org/groups/virt/virt-preview/fedora-virt-preview.repo ---> Using cache ---> 88f43b954f9f Step 4/12 : RUN dnf -y install libvirt-devel-${LIBVIRT_VERSION} make git mercurial sudo gcc findutils gradle rsync-daemon rsync qemu-img protobuf-compiler && dnf -y clean all ---> Using cache ---> 06c70b43758a Step 5/12 : ENV GIMME_GO_VERSION 1.10 ---> Using cache ---> e5b3ae738662 Step 6/12 : RUN mkdir -p /gimme && curl -sL https://raw.githubusercontent.com/travis-ci/gimme/master/gimme | HOME=/gimme bash >> /etc/profile.d/gimme.sh ---> Using cache ---> 3e3d43f49e45 Step 7/12 : ENV GOPATH "/go" GOBIN "/usr/bin" ---> Using cache ---> 73e8a3aa263a Step 8/12 : ADD rsyncd.conf /etc/rsyncd.conf ---> Using cache ---> bc244b1c712b Step 9/12 : RUN mkdir -p /go && source /etc/profile.d/gimme.sh && go get github.com/mattn/goveralls && go get -u github.com/Masterminds/glide && go get golang.org/x/tools/cmd/goimports && git clone https://github.com/mvdan/sh.git $GOPATH/src/mvdan.cc/sh && cd /go/src/mvdan.cc/sh/cmd/shfmt && git checkout v2.5.0 && go get mvdan.cc/sh/cmd/shfmt && go install && go get -u github.com/golang/mock/gomock && go get -u github.com/rmohr/mock/mockgen && go get -u github.com/rmohr/go-swagger-utils/swagger-doc && go get -u github.com/onsi/ginkgo/ginkgo && go get -u -d k8s.io/code-generator/cmd/deepcopy-gen && go get -u -d k8s.io/code-generator/cmd/defaulter-gen && go get -u -d k8s.io/code-generator/cmd/openapi-gen && cd /go/src/k8s.io/code-generator/cmd/deepcopy-gen && git checkout release-1.9 && go install && cd /go/src/k8s.io/code-generator/cmd/defaulter-gen && git checkout release-1.9 && go install && cd /go/src/k8s.io/code-generator/cmd/openapi-gen && git checkout release-1.9 && go install && go get -u -d github.com/golang/protobuf/protoc-gen-go && cd /go/src/github.com/golang/protobuf/protoc-gen-go && git checkout 1643683e1b54a9e88ad26d98f81400c8c9d9f4f9 && go install ---> Using cache ---> 4cd1786b2bc8 Step 10/12 : RUN pip install j2cli ---> Using cache ---> b51a532fa53a Step 11/12 : ADD entrypoint.sh /entrypoint.sh ---> Using cache ---> 3bc0185264f6 Step 12/12 : ENTRYPOINT /entrypoint.sh ---> Using cache ---> dcf2b21fa2ed Successfully built dcf2b21fa2ed go version go1.10 linux/amd64 go version go1.10 linux/amd64 Compiling tests... compiled tests.test hack/functests.sh Running Suite: Tests Suite ========================== Random Seed: 1533665746 Will run 151 of 151 specs • Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running level=info timestamp=2018-08-07T18:18:02.709835Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:18:02.875843Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:18:11.350825Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:18:11 http: TLS handshake error from 10.244.1.1:43186: EOF level=info timestamp=2018-08-07T18:18:16.089918Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:18:18.494496Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:18:18.499220Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:18:21.113626Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:18:21 http: TLS handshake error from 10.244.1.1:43192: EOF 2018/08/07 18:18:31 http: TLS handshake error from 10.244.1.1:43198: EOF level=info timestamp=2018-08-07T18:18:32.777732Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:18:32.935761Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:18:41.373476Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:18:41 http: TLS handshake error from 10.244.1.1:43204: EOF level=info timestamp=2018-08-07T18:18:46.203725Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 18:16:23 http: TLS handshake error from 10.244.0.1:41120: EOF 2018/08/07 18:16:33 http: TLS handshake error from 10.244.0.1:41180: EOF 2018/08/07 18:16:43 http: TLS handshake error from 10.244.0.1:41240: EOF 2018/08/07 18:16:53 http: TLS handshake error from 10.244.0.1:41300: EOF 2018/08/07 18:17:03 http: TLS handshake error from 10.244.0.1:41360: EOF 2018/08/07 18:17:13 http: TLS handshake error from 10.244.0.1:41420: EOF 2018/08/07 18:17:23 http: TLS handshake error from 10.244.0.1:41480: EOF 2018/08/07 18:17:33 http: TLS handshake error from 10.244.0.1:41540: EOF 2018/08/07 18:17:43 http: TLS handshake error from 10.244.0.1:41600: EOF 2018/08/07 18:17:53 http: TLS handshake error from 10.244.0.1:41660: EOF 2018/08/07 18:18:03 http: TLS handshake error from 10.244.0.1:41720: EOF 2018/08/07 18:18:13 http: TLS handshake error from 10.244.0.1:41780: EOF 2018/08/07 18:18:23 http: TLS handshake error from 10.244.0.1:41840: EOF 2018/08/07 18:18:33 http: TLS handshake error from 10.244.0.1:41900: EOF 2018/08/07 18:18:43 http: TLS handshake error from 10.244.0.1:41960: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T18:10:06.242155Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmiInformer" level=info timestamp=2018-08-07T18:10:06.242172Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer kubeVirtPodInformer" level=info timestamp=2018-08-07T18:10:06.242199Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer kubeVirtNodeInformer" level=info timestamp=2018-08-07T18:10:06.242217Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmiPresetInformer" level=info timestamp=2018-08-07T18:10:06.242265Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-08-07T18:10:06.242893Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-08-07T18:10:06.242932Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-08-07T18:10:06.243944Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-08-07T18:10:06.244359Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-08-07T18:15:48.292771Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmif24p4knsr54flnmtvk9dcrqwppn64mvf95ncpt7p29rb5qhkkmzq5r64swxrsr9 kind= uid=e89ce22b-9a6d-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:15:48.306181Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmif24p4knsr54flnmtvk9dcrqwppn64mvf95ncpt7p29rb5qhkkmzq5r64swxrsr9 kind= uid=e89ce22b-9a6d-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:15:48.491540Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmif24p4knsr54flnmtvk9dcrqwppn64mvf95ncpt7p29rb5qhkkmzq5r64swxrsr9\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmif24p4knsr54flnmtvk9dcrqwppn64mvf95ncpt7p29rb5qhkkmzq5r64swxrsr9" level=info timestamp=2018-08-07T18:15:48.543308Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmif24p4knsr54flnmtvk9dcrqwppn64mvf95ncpt7p29rb5qhkkmzq5r64swxrsr9\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmif24p4knsr54flnmtvk9dcrqwppn64mvf95ncpt7p29rb5qhkkmzq5r64swxrsr9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e89ce22b-9a6d-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmif24p4knsr54flnmtvk9dcrqwppn64mvf95ncpt7p29rb5qhkkmzq5r64swxrsr9" level=info timestamp=2018-08-07T18:15:48.661517Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi48m2dr8p8st8xltqgk7qmxzzdqg4bhmz2nxpjh78wd52b25vjtqnlg9vmdc8hwb kind= uid=e8ea51c4-9a6d-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:15:48.661894Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi48m2dr8p8st8xltqgk7qmxzzdqg4bhmz2nxpjh78wd52b25vjtqnlg9vmdc8hwb kind= uid=e8ea51c4-9a6d-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:10:09.262078Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-07T18:10:09.272028Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:09.276900Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:09.376847Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:09.420718Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:09.428791Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmi48m2dr8p8st8xltqgk7qmxzzdqg4bhmz2nxpjmwk45 Pod phase: Pending level=info timestamp=2018-08-07T18:15:53.779730Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:15:53.782035Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:15:53.786346Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:16:04.629439Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:16:04.693251Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi48m2dr8p8st8xltqgk7qmxzzdqg4bhmz2nxpjh78wd52b25vjtqnlg9vmdc8hwb" level=info timestamp=2018-08-07T18:16:04.695693Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:16:04.696198Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure [180.969 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 should start it [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:80 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T18:15:48.854267Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi48m2dr8p8st8xltqgk7qmxzzdqg4bhmz2nxpjh78wd52b25vjtqnlg9vmdc8hwb kind=VirtualMachineInstance uid=e8ea51c4-9a6d-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi48m2dr8p8st8xltqgk7qmxzzdqg4bhmz2nxpjmwk45" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running level=info timestamp=2018-08-07T18:21:03.067351Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:21:03.233979Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:21:11.378085Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:21:11 http: TLS handshake error from 10.244.1.1:43294: EOF level=info timestamp=2018-08-07T18:21:16.743638Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:21:19.375927Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:21:19.380198Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:21:21 http: TLS handshake error from 10.244.1.1:43300: EOF level=info timestamp=2018-08-07T18:21:22.006879Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:21:31 http: TLS handshake error from 10.244.1.1:43306: EOF level=info timestamp=2018-08-07T18:21:33.162067Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:21:33.295662Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:21:41.464116Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:21:41 http: TLS handshake error from 10.244.1.1:43312: EOF level=info timestamp=2018-08-07T18:21:46.844329Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 18:19:23 http: TLS handshake error from 10.244.0.1:42204: EOF 2018/08/07 18:19:33 http: TLS handshake error from 10.244.0.1:42264: EOF 2018/08/07 18:19:43 http: TLS handshake error from 10.244.0.1:42324: EOF 2018/08/07 18:19:53 http: TLS handshake error from 10.244.0.1:42384: EOF 2018/08/07 18:20:03 http: TLS handshake error from 10.244.0.1:42444: EOF 2018/08/07 18:20:13 http: TLS handshake error from 10.244.0.1:42504: EOF 2018/08/07 18:20:23 http: TLS handshake error from 10.244.0.1:42564: EOF 2018/08/07 18:20:33 http: TLS handshake error from 10.244.0.1:42624: EOF 2018/08/07 18:20:43 http: TLS handshake error from 10.244.0.1:42684: EOF 2018/08/07 18:20:53 http: TLS handshake error from 10.244.0.1:42744: EOF 2018/08/07 18:21:03 http: TLS handshake error from 10.244.0.1:42804: EOF 2018/08/07 18:21:13 http: TLS handshake error from 10.244.0.1:42864: EOF 2018/08/07 18:21:23 http: TLS handshake error from 10.244.0.1:42924: EOF 2018/08/07 18:21:33 http: TLS handshake error from 10.244.0.1:42984: EOF 2018/08/07 18:21:43 http: TLS handshake error from 10.244.0.1:43044: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T18:10:06.242265Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-08-07T18:10:06.242893Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-08-07T18:10:06.242932Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-08-07T18:10:06.243944Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-08-07T18:10:06.244359Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-08-07T18:15:48.292771Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmif24p4knsr54flnmtvk9dcrqwppn64mvf95ncpt7p29rb5qhkkmzq5r64swxrsr9 kind= uid=e89ce22b-9a6d-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:15:48.306181Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmif24p4knsr54flnmtvk9dcrqwppn64mvf95ncpt7p29rb5qhkkmzq5r64swxrsr9 kind= uid=e89ce22b-9a6d-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:15:48.491540Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmif24p4knsr54flnmtvk9dcrqwppn64mvf95ncpt7p29rb5qhkkmzq5r64swxrsr9\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmif24p4knsr54flnmtvk9dcrqwppn64mvf95ncpt7p29rb5qhkkmzq5r64swxrsr9" level=info timestamp=2018-08-07T18:15:48.543308Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmif24p4knsr54flnmtvk9dcrqwppn64mvf95ncpt7p29rb5qhkkmzq5r64swxrsr9\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmif24p4knsr54flnmtvk9dcrqwppn64mvf95ncpt7p29rb5qhkkmzq5r64swxrsr9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e89ce22b-9a6d-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmif24p4knsr54flnmtvk9dcrqwppn64mvf95ncpt7p29rb5qhkkmzq5r64swxrsr9" level=info timestamp=2018-08-07T18:15:48.661517Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi48m2dr8p8st8xltqgk7qmxzzdqg4bhmz2nxpjh78wd52b25vjtqnlg9vmdc8hwb kind= uid=e8ea51c4-9a6d-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:15:48.661894Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi48m2dr8p8st8xltqgk7qmxzzdqg4bhmz2nxpjh78wd52b25vjtqnlg9vmdc8hwb kind= uid=e8ea51c4-9a6d-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:18:49.463851Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi48m2dr8p8st8xltqgk7qmxzzdqg4bhmz2nxpjh78wd52b25vjtqnlg9vmdc8hwb\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi48m2dr8p8st8xltqgk7qmxzzdqg4bhmz2nxpjh78wd52b25vjtqnlg9vmdc8hwb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e8ea51c4-9a6d-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi48m2dr8p8st8xltqgk7qmxzzdqg4bhmz2nxpjh78wd52b25vjtqnlg9vmdc8hwb" level=info timestamp=2018-08-07T18:18:49.634055Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidzcmpjf62tbqbkl5d2m4ngwhvhsqscdhkhphr4lbsrpqqsgffkzcwj2k88mnf7h kind= uid=54c61459-9a6e-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:18:49.634969Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidzcmpjf62tbqbkl5d2m4ngwhvhsqscdhkhphr4lbsrpqqsgffkzcwj2k88mnf7h kind= uid=54c61459-9a6e-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:18:49.744352Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidzcmpjf62tbqbkl5d2m4ngwhvhsqscdhkhphr4lbsrpqqsgffkzcwj2k88mnf7h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidzcmpjf62tbqbkl5d2m4ngwhvhsqscdhkhphr4lbsrpqqsgffkzcwj2k88mnf7h" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:10:09.262078Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-07T18:10:09.272028Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:09.276900Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:09.376847Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:09.420718Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:09.428791Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmidzcmpjf62tbqbkl5d2m4ngwhvhsqscdhkhphr824lt Pod phase: Pending level=info timestamp=2018-08-07T18:18:54.165911Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:18:54.166670Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:18:54.171333Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:19:04.702252Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:19:04.747211Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmidzcmpjf62tbqbkl5d2m4ngwhvhsqscdhkhphr4lbsrpqqsgffkzcwj2k88mnf7h" level=info timestamp=2018-08-07T18:19:04.749189Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:19:04.749434Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.812 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 should attach virt-launcher to it [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:86 Timed out after 90.015s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T18:18:49.831055Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmidzcmpjf62tbqbkl5d2m4ngwhvhsqscdhkhphr4lbsrpqqsgffkzcwj2k88mnf7h kind=VirtualMachineInstance uid=54c61459-9a6e-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmidzcmpjf62tbqbkl5d2m4ngwhvhsqscdhkhphr824lt" •••• Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running 2018/08/07 18:24:01 http: TLS handshake error from 10.244.1.1:43396: EOF level=info timestamp=2018-08-07T18:24:03.486542Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:24:03.584928Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:24:11.381236Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:24:11 http: TLS handshake error from 10.244.1.1:43402: EOF level=info timestamp=2018-08-07T18:24:17.344648Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:24:21 http: TLS handshake error from 10.244.1.1:43408: EOF level=info timestamp=2018-08-07T18:24:22.935949Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:24:31 http: TLS handshake error from 10.244.1.1:43414: EOF level=info timestamp=2018-08-07T18:24:33.542099Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:24:33.634447Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:24:41.365260Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:24:41 http: TLS handshake error from 10.244.1.1:43420: EOF level=info timestamp=2018-08-07T18:24:47.434284Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:24:51 http: TLS handshake error from 10.244.1.1:43426: EOF Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 18:22:23 http: TLS handshake error from 10.244.0.1:43284: EOF 2018/08/07 18:22:33 http: TLS handshake error from 10.244.0.1:43344: EOF 2018/08/07 18:22:43 http: TLS handshake error from 10.244.0.1:43404: EOF 2018/08/07 18:22:53 http: TLS handshake error from 10.244.0.1:43464: EOF 2018/08/07 18:23:03 http: TLS handshake error from 10.244.0.1:43524: EOF 2018/08/07 18:23:13 http: TLS handshake error from 10.244.0.1:43584: EOF 2018/08/07 18:23:23 http: TLS handshake error from 10.244.0.1:43644: EOF 2018/08/07 18:23:33 http: TLS handshake error from 10.244.0.1:43704: EOF 2018/08/07 18:23:43 http: TLS handshake error from 10.244.0.1:43764: EOF 2018/08/07 18:23:53 http: TLS handshake error from 10.244.0.1:43824: EOF 2018/08/07 18:24:03 http: TLS handshake error from 10.244.0.1:43884: EOF 2018/08/07 18:24:13 http: TLS handshake error from 10.244.0.1:43944: EOF 2018/08/07 18:24:23 http: TLS handshake error from 10.244.0.1:44004: EOF 2018/08/07 18:24:33 http: TLS handshake error from 10.244.0.1:44064: EOF 2018/08/07 18:24:43 http: TLS handshake error from 10.244.0.1:44124: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T18:15:48.661517Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi48m2dr8p8st8xltqgk7qmxzzdqg4bhmz2nxpjh78wd52b25vjtqnlg9vmdc8hwb kind= uid=e8ea51c4-9a6d-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:15:48.661894Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi48m2dr8p8st8xltqgk7qmxzzdqg4bhmz2nxpjh78wd52b25vjtqnlg9vmdc8hwb kind= uid=e8ea51c4-9a6d-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:18:49.463851Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi48m2dr8p8st8xltqgk7qmxzzdqg4bhmz2nxpjh78wd52b25vjtqnlg9vmdc8hwb\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi48m2dr8p8st8xltqgk7qmxzzdqg4bhmz2nxpjh78wd52b25vjtqnlg9vmdc8hwb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e8ea51c4-9a6d-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi48m2dr8p8st8xltqgk7qmxzzdqg4bhmz2nxpjh78wd52b25vjtqnlg9vmdc8hwb" level=info timestamp=2018-08-07T18:18:49.634055Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidzcmpjf62tbqbkl5d2m4ngwhvhsqscdhkhphr4lbsrpqqsgffkzcwj2k88mnf7h kind= uid=54c61459-9a6e-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:18:49.634969Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidzcmpjf62tbqbkl5d2m4ngwhvhsqscdhkhphr4lbsrpqqsgffkzcwj2k88mnf7h kind= uid=54c61459-9a6e-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:18:49.744352Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidzcmpjf62tbqbkl5d2m4ngwhvhsqscdhkhphr4lbsrpqqsgffkzcwj2k88mnf7h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidzcmpjf62tbqbkl5d2m4ngwhvhsqscdhkhphr4lbsrpqqsgffkzcwj2k88mnf7h" level=info timestamp=2018-08-07T18:21:51.255715Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimm2dcvwfjs5smvg75xlvz6jgbp54vncdx4mq2ggs9mgkhw77gxn872cjfpj6xr6 kind= uid=c107edd1-9a6e-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:21:51.259620Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimm2dcvwfjs5smvg75xlvz6jgbp54vncdx4mq2ggs9mgkhw77gxn872cjfpj6xr6 kind= uid=c107edd1-9a6e-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:21:51.459961Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimm2dcvwfjs5smvg75xlvz6jgbp54vncdx4mq2ggs9mgkhw77gxn872cjfpj6xr6\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmimm2dcvwfjs5smvg75xlvz6jgbp54vncdx4mq2ggs9mgkhw77gxn872cjfpj6xr6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c107edd1-9a6e-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimm2dcvwfjs5smvg75xlvz6jgbp54vncdx4mq2ggs9mgkhw77gxn872cjfpj6xr6" level=info timestamp=2018-08-07T18:21:51.630080Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicfvjdj9wcr45sj54cccq4x5vdws6dmqblmnr2sw2pdfdkxn97dwgg85hhm8mkns kind= uid=c1431bc5-9a6e-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:21:51.630454Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicfvjdj9wcr45sj54cccq4x5vdws6dmqblmnr2sw2pdfdkxn97dwgg85hhm8mkns kind= uid=c1431bc5-9a6e-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:21:51.848801Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicfvjdj9wcr45sj54cccq4x5vdws6dmqblmnr2sw2pdfdkxn97dwgg85hhm8mkns\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmicfvjdj9wcr45sj54cccq4x5vdws6dmqblmnr2sw2pdfdkxn97dwgg85hhm8mkns, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c1431bc5-9a6e-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicfvjdj9wcr45sj54cccq4x5vdws6dmqblmnr2sw2pdfdkxn97dwgg85hhm8mkns" level=info timestamp=2018-08-07T18:21:52.007133Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmip9nj5vzpjb99gdx5m9fvv8hwtm9nwwxdclrmm5h4hhn4grv9g6rqcck6m87jjvb kind= uid=c17bd6bb-9a6e-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:21:52.007449Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmip9nj5vzpjb99gdx5m9fvv8hwtm9nwwxdclrmm5h4hhn4grv9g6rqcck6m87jjvb kind= uid=c17bd6bb-9a6e-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:21:52.110544Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmip9nj5vzpjb99gdx5m9fvv8hwtm9nwwxdclrmm5h4hhn4grv9g6rqcck6m87jjvb\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmip9nj5vzpjb99gdx5m9fvv8hwtm9nwwxdclrmm5h4hhn4grv9g6rqcck6m87jjvb" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:10:09.262078Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-07T18:10:09.272028Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:09.276900Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:09.376847Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:09.420718Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:09.428791Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmip9nj5vzpjb99gdx5m9fvv8hwtm9nwwxdclrmmdvs77 Pod phase: Pending level=info timestamp=2018-08-07T18:21:56.425473Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:21:56.426081Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:21:56.430767Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:22:07.359650Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:22:07.460323Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmip9nj5vzpjb99gdx5m9fvv8hwtm9nwwxdclrmm5h4hhn4grv9g6rqcck6m87jjvb" level=info timestamp=2018-08-07T18:22:07.463167Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:22:07.463622Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure [180.771 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with boot order /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:174 should be able to boot from selected disk /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 Alpine as first boot [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.013s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: defining a VirtualMachineInstance with an Alpine disk STEP: adding a Cirros Disk STEP: setting boot order STEP: starting VirtualMachineInstance STEP: Waiting the VirtualMachineInstance start level=info timestamp=2018-08-07T18:21:52.172757Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmip9nj5vzpjb99gdx5m9fvv8hwtm9nwwxdclrmm5h4hhn4grv9g6rqcck6m87jjvb kind=VirtualMachineInstance uid=c17bd6bb-9a6e-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmip9nj5vzpjb99gdx5m9fvv8hwtm9nwwxdclrmmdvs77" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running 2018/08/07 18:27:01 http: TLS handshake error from 10.244.1.1:43504: EOF level=info timestamp=2018-08-07T18:27:03.824654Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:27:03.923182Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:27:11.394487Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:27:11 http: TLS handshake error from 10.244.1.1:43510: EOF level=info timestamp=2018-08-07T18:27:17.917271Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:27:21 http: TLS handshake error from 10.244.1.1:43516: EOF level=info timestamp=2018-08-07T18:27:23.888977Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:27:31 http: TLS handshake error from 10.244.1.1:43522: EOF level=info timestamp=2018-08-07T18:27:33.890325Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:27:33.983354Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:27:41.430282Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:27:41 http: TLS handshake error from 10.244.1.1:43528: EOF level=info timestamp=2018-08-07T18:27:48.009970Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:27:51 http: TLS handshake error from 10.244.1.1:43534: EOF Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 18:25:23 http: TLS handshake error from 10.244.0.1:44364: EOF 2018/08/07 18:25:33 http: TLS handshake error from 10.244.0.1:44424: EOF 2018/08/07 18:25:43 http: TLS handshake error from 10.244.0.1:44484: EOF 2018/08/07 18:25:53 http: TLS handshake error from 10.244.0.1:44544: EOF 2018/08/07 18:26:03 http: TLS handshake error from 10.244.0.1:44604: EOF 2018/08/07 18:26:13 http: TLS handshake error from 10.244.0.1:44664: EOF 2018/08/07 18:26:23 http: TLS handshake error from 10.244.0.1:44724: EOF 2018/08/07 18:26:33 http: TLS handshake error from 10.244.0.1:44784: EOF 2018/08/07 18:26:43 http: TLS handshake error from 10.244.0.1:44844: EOF 2018/08/07 18:26:53 http: TLS handshake error from 10.244.0.1:44904: EOF 2018/08/07 18:27:03 http: TLS handshake error from 10.244.0.1:44964: EOF 2018/08/07 18:27:13 http: TLS handshake error from 10.244.0.1:45024: EOF 2018/08/07 18:27:23 http: TLS handshake error from 10.244.0.1:45084: EOF 2018/08/07 18:27:33 http: TLS handshake error from 10.244.0.1:45144: EOF 2018/08/07 18:27:43 http: TLS handshake error from 10.244.0.1:45204: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T18:18:49.634969Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidzcmpjf62tbqbkl5d2m4ngwhvhsqscdhkhphr4lbsrpqqsgffkzcwj2k88mnf7h kind= uid=54c61459-9a6e-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:18:49.744352Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidzcmpjf62tbqbkl5d2m4ngwhvhsqscdhkhphr4lbsrpqqsgffkzcwj2k88mnf7h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidzcmpjf62tbqbkl5d2m4ngwhvhsqscdhkhphr4lbsrpqqsgffkzcwj2k88mnf7h" level=info timestamp=2018-08-07T18:21:51.255715Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimm2dcvwfjs5smvg75xlvz6jgbp54vncdx4mq2ggs9mgkhw77gxn872cjfpj6xr6 kind= uid=c107edd1-9a6e-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:21:51.259620Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimm2dcvwfjs5smvg75xlvz6jgbp54vncdx4mq2ggs9mgkhw77gxn872cjfpj6xr6 kind= uid=c107edd1-9a6e-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:21:51.459961Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimm2dcvwfjs5smvg75xlvz6jgbp54vncdx4mq2ggs9mgkhw77gxn872cjfpj6xr6\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmimm2dcvwfjs5smvg75xlvz6jgbp54vncdx4mq2ggs9mgkhw77gxn872cjfpj6xr6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c107edd1-9a6e-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimm2dcvwfjs5smvg75xlvz6jgbp54vncdx4mq2ggs9mgkhw77gxn872cjfpj6xr6" level=info timestamp=2018-08-07T18:21:51.630080Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicfvjdj9wcr45sj54cccq4x5vdws6dmqblmnr2sw2pdfdkxn97dwgg85hhm8mkns kind= uid=c1431bc5-9a6e-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:21:51.630454Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicfvjdj9wcr45sj54cccq4x5vdws6dmqblmnr2sw2pdfdkxn97dwgg85hhm8mkns kind= uid=c1431bc5-9a6e-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:21:51.848801Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicfvjdj9wcr45sj54cccq4x5vdws6dmqblmnr2sw2pdfdkxn97dwgg85hhm8mkns\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmicfvjdj9wcr45sj54cccq4x5vdws6dmqblmnr2sw2pdfdkxn97dwgg85hhm8mkns, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c1431bc5-9a6e-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicfvjdj9wcr45sj54cccq4x5vdws6dmqblmnr2sw2pdfdkxn97dwgg85hhm8mkns" level=info timestamp=2018-08-07T18:21:52.007133Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmip9nj5vzpjb99gdx5m9fvv8hwtm9nwwxdclrmm5h4hhn4grv9g6rqcck6m87jjvb kind= uid=c17bd6bb-9a6e-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:21:52.007449Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmip9nj5vzpjb99gdx5m9fvv8hwtm9nwwxdclrmm5h4hhn4grv9g6rqcck6m87jjvb kind= uid=c17bd6bb-9a6e-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:21:52.110544Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmip9nj5vzpjb99gdx5m9fvv8hwtm9nwwxdclrmm5h4hhn4grv9g6rqcck6m87jjvb\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmip9nj5vzpjb99gdx5m9fvv8hwtm9nwwxdclrmm5h4hhn4grv9g6rqcck6m87jjvb" level=info timestamp=2018-08-07T18:24:52.834649Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c kind= uid=2d414223-9a6f-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:24:52.840869Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c kind= uid=2d414223-9a6f-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:24:52.965916Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c" level=info timestamp=2018-08-07T18:24:53.008452Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:10:09.262078Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-07T18:10:09.272028Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:09.276900Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:09.376847Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:09.420718Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:09.428791Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshlsj9b5n Pod phase: Pending level=info timestamp=2018-08-07T18:24:56.608170Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:24:56.608426Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:24:56.610143Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:25:07.510355Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:25:07.600934Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c" level=info timestamp=2018-08-07T18:25:07.603217Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:25:07.604629Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.746 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with boot order /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:174 should be able to boot from selected disk /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 Cirros as first boot [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.009s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: defining a VirtualMachineInstance with an Alpine disk STEP: adding a Cirros Disk STEP: setting boot order STEP: starting VirtualMachineInstance STEP: Waiting the VirtualMachineInstance start level=info timestamp=2018-08-07T18:24:52.981332Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c kind=VirtualMachineInstance uid=2d414223-9a6f-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshlsj9b5n" • [SLOW TEST:60.404 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with user-data /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:205 without k8s secret /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:206 should retry starting the VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:207 ------------------------------ •! Panic [60.412 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with user-data /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:205 without k8s secret /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:206 should log warning and proceed once the secret is there [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:237 Test Panicked runtime error: invalid memory address or nil pointer dereference /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/panic.go:505 Full Stack Trace /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/panic.go:505 +0x229 kubevirt.io/kubevirt/tests_test.glob..func16.3.9.1.2() /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:258 +0x431 kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).runSync(0xc42015ce40, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/tests/tests_suite_test.go:43 +0xaa testing.tRunner(0xc4201710e0, 0x1432278) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:777 +0xd0 created by testing.(*T).Run /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:824 +0x2e0 ------------------------------ STEP: Starting a VirtualMachineInstance STEP: Checking that VirtualMachineInstance start failed level=info timestamp=2018-08-07T18:28:54.126307Z pos=utils.go:257 component=tests namespace=kubevirt-test-default name=testvmijkzxhpc9fb5sklgr9n7fphwxppg6fn9xf7dm75n9pjmg6wbljg87jk9bsjv4nr9 kind=VirtualMachineInstance uid=bd02abfa-9a6f-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmijkzxhpc9fb5sklgr9n7fphwxppg6fn9xf7dm7xpld5" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running 2018/08/07 18:32:01 http: TLS handshake error from 10.244.1.1:43684: EOF level=info timestamp=2018-08-07T18:32:04.494024Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:32:04.532357Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:32:11.464261Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:32:11 http: TLS handshake error from 10.244.1.1:43690: EOF level=info timestamp=2018-08-07T18:32:18.949535Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:32:21 http: TLS handshake error from 10.244.1.1:43696: EOF level=info timestamp=2018-08-07T18:32:25.524776Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:32:31 http: TLS handshake error from 10.244.1.1:43702: EOF level=info timestamp=2018-08-07T18:32:34.545877Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:32:34.593965Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:32:41.445010Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:32:41 http: TLS handshake error from 10.244.1.1:43708: EOF level=info timestamp=2018-08-07T18:32:49.055617Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:32:51 http: TLS handshake error from 10.244.1.1:43714: EOF Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 18:30:33 http: TLS handshake error from 10.244.0.1:46224: EOF 2018/08/07 18:30:43 http: TLS handshake error from 10.244.0.1:46284: EOF 2018/08/07 18:30:53 http: TLS handshake error from 10.244.0.1:46344: EOF 2018/08/07 18:31:03 http: TLS handshake error from 10.244.0.1:46404: EOF 2018/08/07 18:31:13 http: TLS handshake error from 10.244.0.1:46464: EOF 2018/08/07 18:31:23 http: TLS handshake error from 10.244.0.1:46524: EOF 2018/08/07 18:31:33 http: TLS handshake error from 10.244.0.1:46584: EOF 2018/08/07 18:31:43 http: TLS handshake error from 10.244.0.1:46644: EOF 2018/08/07 18:31:53 http: TLS handshake error from 10.244.0.1:46704: EOF 2018/08/07 18:32:03 http: TLS handshake error from 10.244.0.1:46764: EOF 2018/08/07 18:32:13 http: TLS handshake error from 10.244.0.1:46824: EOF 2018/08/07 18:32:23 http: TLS handshake error from 10.244.0.1:46884: EOF 2018/08/07 18:32:33 http: TLS handshake error from 10.244.0.1:46944: EOF 2018/08/07 18:32:43 http: TLS handshake error from 10.244.0.1:47004: EOF 2018/08/07 18:32:53 http: TLS handshake error from 10.244.0.1:47064: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T18:21:52.110544Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmip9nj5vzpjb99gdx5m9fvv8hwtm9nwwxdclrmm5h4hhn4grv9g6rqcck6m87jjvb\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmip9nj5vzpjb99gdx5m9fvv8hwtm9nwwxdclrmm5h4hhn4grv9g6rqcck6m87jjvb" level=info timestamp=2018-08-07T18:24:52.834649Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c kind= uid=2d414223-9a6f-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:24:52.840869Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c kind= uid=2d414223-9a6f-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:24:52.965916Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c" level=info timestamp=2018-08-07T18:24:53.008452Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c" level=info timestamp=2018-08-07T18:27:53.421311Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2d414223-9a6f-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c" level=info timestamp=2018-08-07T18:27:53.614513Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimnpwwf9l4rjnt5rn22gtw59kb6tl47k84wr9x26mpcczkwlsd29m29g6gvf67ww kind= uid=9900b9e4-9a6f-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:27:53.615104Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimnpwwf9l4rjnt5rn22gtw59kb6tl47k84wr9x26mpcczkwlsd29m29g6gvf67ww kind= uid=9900b9e4-9a6f-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:27:53.734576Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimnpwwf9l4rjnt5rn22gtw59kb6tl47k84wr9x26mpcczkwlsd29m29g6gvf67ww\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimnpwwf9l4rjnt5rn22gtw59kb6tl47k84wr9x26mpcczkwlsd29m29g6gvf67ww" level=info timestamp=2018-08-07T18:28:53.826685Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimnpwwf9l4rjnt5rn22gtw59kb6tl47k84wr9x26mpcczkwlsd29m29g6gvf67ww\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmimnpwwf9l4rjnt5rn22gtw59kb6tl47k84wr9x26mpcczkwlsd29m29g6gvf67ww, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9900b9e4-9a6f-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimnpwwf9l4rjnt5rn22gtw59kb6tl47k84wr9x26mpcczkwlsd29m29g6gvf67ww" level=info timestamp=2018-08-07T18:28:54.013943Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijkzxhpc9fb5sklgr9n7fphwxppg6fn9xf7dm75n9pjmg6wbljg87jk9bsjv4nr9 kind= uid=bd02abfa-9a6f-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:28:54.014626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijkzxhpc9fb5sklgr9n7fphwxppg6fn9xf7dm75n9pjmg6wbljg87jk9bsjv4nr9 kind= uid=bd02abfa-9a6f-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:28:54.122084Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijkzxhpc9fb5sklgr9n7fphwxppg6fn9xf7dm75n9pjmg6wbljg87jk9bsjv4nr9\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijkzxhpc9fb5sklgr9n7fphwxppg6fn9xf7dm75n9pjmg6wbljg87jk9bsjv4nr9" level=info timestamp=2018-08-07T18:29:54.414670Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4pp4vlmh5fjzs596nhgsg2wghg7 kind= uid=e1032a1c-9a6f-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:29:54.418547Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4pp4vlmh5fjzs596nhgsg2wghg7 kind= uid=e1032a1c-9a6f-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:10:09.262078Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-07T18:10:09.272028Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:09.276900Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:09.376847Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:09.420718Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:09.428791Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4sr9xv Pod phase: Pending level=info timestamp=2018-08-07T18:29:58.504230Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:29:58.504473Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:29:58.506490Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:30:09.175450Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:30:09.229861Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4pp4vlmh5fjzs596nhgsg2wghg7" level=info timestamp=2018-08-07T18:30:09.231155Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:30:09.231497Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.794 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 when virt-launcher crashes /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:285 should be stopped and have Failed phase [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:286 Timed out after 90.013s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T18:29:54.650068Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4pp4vlmh5fjzs596nhgsg2wghg7 kind=VirtualMachineInstance uid=e1032a1c-9a6f-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4sr9xv" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running level=info timestamp=2018-08-07T18:35:11.334776Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:35:11.380906Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:35:11 http: TLS handshake error from 10.244.1.1:43798: EOF level=info timestamp=2018-08-07T18:35:19.560043Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:35:20.900696Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:35:20.904733Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:35:21 http: TLS handshake error from 10.244.1.1:43804: EOF level=info timestamp=2018-08-07T18:35:26.427554Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:35:31 http: TLS handshake error from 10.244.1.1:43810: EOF level=info timestamp=2018-08-07T18:35:34.904687Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:35:34.948681Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:35:41.478846Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:35:41 http: TLS handshake error from 10.244.1.1:43816: EOF level=info timestamp=2018-08-07T18:35:49.663548Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:35:51 http: TLS handshake error from 10.244.1.1:43822: EOF Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 18:33:33 http: TLS handshake error from 10.244.0.1:47304: EOF 2018/08/07 18:33:43 http: TLS handshake error from 10.244.0.1:47364: EOF 2018/08/07 18:33:53 http: TLS handshake error from 10.244.0.1:47424: EOF 2018/08/07 18:34:03 http: TLS handshake error from 10.244.0.1:47484: EOF 2018/08/07 18:34:13 http: TLS handshake error from 10.244.0.1:47544: EOF 2018/08/07 18:34:23 http: TLS handshake error from 10.244.0.1:47604: EOF 2018/08/07 18:34:33 http: TLS handshake error from 10.244.0.1:47664: EOF 2018/08/07 18:34:43 http: TLS handshake error from 10.244.0.1:47724: EOF 2018/08/07 18:34:53 http: TLS handshake error from 10.244.0.1:47784: EOF 2018/08/07 18:35:03 http: TLS handshake error from 10.244.0.1:47844: EOF 2018/08/07 18:35:13 http: TLS handshake error from 10.244.0.1:47904: EOF 2018/08/07 18:35:23 http: TLS handshake error from 10.244.0.1:47964: EOF 2018/08/07 18:35:33 http: TLS handshake error from 10.244.0.1:48024: EOF 2018/08/07 18:35:43 http: TLS handshake error from 10.244.0.1:48084: EOF 2018/08/07 18:35:53 http: TLS handshake error from 10.244.0.1:48144: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T18:24:53.008452Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c" level=info timestamp=2018-08-07T18:27:53.421311Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2d414223-9a6f-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidx4j9rrkhvwklzh56dkq5xhk6zff8pjxvshls5rdpwmnftczhbl5khgqhmr7l6c" level=info timestamp=2018-08-07T18:27:53.614513Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimnpwwf9l4rjnt5rn22gtw59kb6tl47k84wr9x26mpcczkwlsd29m29g6gvf67ww kind= uid=9900b9e4-9a6f-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:27:53.615104Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimnpwwf9l4rjnt5rn22gtw59kb6tl47k84wr9x26mpcczkwlsd29m29g6gvf67ww kind= uid=9900b9e4-9a6f-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:27:53.734576Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimnpwwf9l4rjnt5rn22gtw59kb6tl47k84wr9x26mpcczkwlsd29m29g6gvf67ww\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimnpwwf9l4rjnt5rn22gtw59kb6tl47k84wr9x26mpcczkwlsd29m29g6gvf67ww" level=info timestamp=2018-08-07T18:28:53.826685Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimnpwwf9l4rjnt5rn22gtw59kb6tl47k84wr9x26mpcczkwlsd29m29g6gvf67ww\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmimnpwwf9l4rjnt5rn22gtw59kb6tl47k84wr9x26mpcczkwlsd29m29g6gvf67ww, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9900b9e4-9a6f-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimnpwwf9l4rjnt5rn22gtw59kb6tl47k84wr9x26mpcczkwlsd29m29g6gvf67ww" level=info timestamp=2018-08-07T18:28:54.013943Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijkzxhpc9fb5sklgr9n7fphwxppg6fn9xf7dm75n9pjmg6wbljg87jk9bsjv4nr9 kind= uid=bd02abfa-9a6f-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:28:54.014626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijkzxhpc9fb5sklgr9n7fphwxppg6fn9xf7dm75n9pjmg6wbljg87jk9bsjv4nr9 kind= uid=bd02abfa-9a6f-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:28:54.122084Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijkzxhpc9fb5sklgr9n7fphwxppg6fn9xf7dm75n9pjmg6wbljg87jk9bsjv4nr9\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijkzxhpc9fb5sklgr9n7fphwxppg6fn9xf7dm75n9pjmg6wbljg87jk9bsjv4nr9" level=info timestamp=2018-08-07T18:29:54.414670Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4pp4vlmh5fjzs596nhgsg2wghg7 kind= uid=e1032a1c-9a6f-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:29:54.418547Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4pp4vlmh5fjzs596nhgsg2wghg7 kind= uid=e1032a1c-9a6f-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:32:55.013913Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4pp4vlmh5fjzs596nhgsg2wghg7\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4pp4vlmh5fjzs596nhgsg2wghg7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e1032a1c-9a6f-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4pp4vlmh5fjzs596nhgsg2wghg7" level=info timestamp=2018-08-07T18:32:55.270809Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk kind= uid=4cceb08f-9a70-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:32:55.271571Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk kind= uid=4cceb08f-9a70-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:32:55.402825Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:10:09.262078Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-07T18:10:09.272028Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:09.276900Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:09.376847Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:09.420718Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:09.428791Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222q5x7 Pod phase: Pending level=info timestamp=2018-08-07T18:32:58.873277Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:32:58.873527Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:32:58.875976Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:33:09.597329Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:33:09.651688Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk" level=info timestamp=2018-08-07T18:33:09.654536Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:33:09.655029Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.828 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 when virt-handler crashes /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:309 should recover and continue management [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:310 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T18:32:55.379304Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk kind=VirtualMachineInstance uid=4cceb08f-9a70-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222q5x7" • [SLOW TEST:72.895 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 when virt-handler is responsive /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:340 should indicate that a node is ready for vmis /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:341 ------------------------------ Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running 2018/08/07 18:39:11 http: TLS handshake error from 10.244.1.1:43942: EOF level=info timestamp=2018-08-07T18:39:20.405453Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:39:21 http: TLS handshake error from 10.244.1.1:43948: EOF level=info timestamp=2018-08-07T18:39:27.689796Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:39:31 http: TLS handshake error from 10.244.1.1:43954: EOF level=info timestamp=2018-08-07T18:39:35.415627Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:39:35.457036Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:39:41.411676Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:39:41 http: TLS handshake error from 10.244.1.1:43960: EOF level=info timestamp=2018-08-07T18:39:50.498156Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:39:51 http: TLS handshake error from 10.244.1.1:43966: EOF level=info timestamp=2018-08-07T18:39:57.844056Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:40:01 http: TLS handshake error from 10.244.1.1:43972: EOF level=info timestamp=2018-08-07T18:40:05.461994Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:40:05.514320Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 18:37:43 http: TLS handshake error from 10.244.0.1:48804: EOF 2018/08/07 18:37:53 http: TLS handshake error from 10.244.0.1:48864: EOF 2018/08/07 18:38:03 http: TLS handshake error from 10.244.0.1:48924: EOF 2018/08/07 18:38:13 http: TLS handshake error from 10.244.0.1:48984: EOF 2018/08/07 18:38:23 http: TLS handshake error from 10.244.0.1:49044: EOF 2018/08/07 18:38:33 http: TLS handshake error from 10.244.0.1:49104: EOF 2018/08/07 18:38:43 http: TLS handshake error from 10.244.0.1:49164: EOF 2018/08/07 18:38:53 http: TLS handshake error from 10.244.0.1:49224: EOF 2018/08/07 18:39:03 http: TLS handshake error from 10.244.0.1:49284: EOF 2018/08/07 18:39:13 http: TLS handshake error from 10.244.0.1:49344: EOF 2018/08/07 18:39:23 http: TLS handshake error from 10.244.0.1:49404: EOF 2018/08/07 18:39:33 http: TLS handshake error from 10.244.0.1:49464: EOF 2018/08/07 18:39:43 http: TLS handshake error from 10.244.0.1:49524: EOF 2018/08/07 18:39:53 http: TLS handshake error from 10.244.0.1:49584: EOF 2018/08/07 18:40:03 http: TLS handshake error from 10.244.0.1:49644: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T18:27:53.734576Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimnpwwf9l4rjnt5rn22gtw59kb6tl47k84wr9x26mpcczkwlsd29m29g6gvf67ww\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimnpwwf9l4rjnt5rn22gtw59kb6tl47k84wr9x26mpcczkwlsd29m29g6gvf67ww" level=info timestamp=2018-08-07T18:28:53.826685Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimnpwwf9l4rjnt5rn22gtw59kb6tl47k84wr9x26mpcczkwlsd29m29g6gvf67ww\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmimnpwwf9l4rjnt5rn22gtw59kb6tl47k84wr9x26mpcczkwlsd29m29g6gvf67ww, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9900b9e4-9a6f-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimnpwwf9l4rjnt5rn22gtw59kb6tl47k84wr9x26mpcczkwlsd29m29g6gvf67ww" level=info timestamp=2018-08-07T18:28:54.013943Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijkzxhpc9fb5sklgr9n7fphwxppg6fn9xf7dm75n9pjmg6wbljg87jk9bsjv4nr9 kind= uid=bd02abfa-9a6f-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:28:54.014626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijkzxhpc9fb5sklgr9n7fphwxppg6fn9xf7dm75n9pjmg6wbljg87jk9bsjv4nr9 kind= uid=bd02abfa-9a6f-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:28:54.122084Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijkzxhpc9fb5sklgr9n7fphwxppg6fn9xf7dm75n9pjmg6wbljg87jk9bsjv4nr9\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijkzxhpc9fb5sklgr9n7fphwxppg6fn9xf7dm75n9pjmg6wbljg87jk9bsjv4nr9" level=info timestamp=2018-08-07T18:29:54.414670Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4pp4vlmh5fjzs596nhgsg2wghg7 kind= uid=e1032a1c-9a6f-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:29:54.418547Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4pp4vlmh5fjzs596nhgsg2wghg7 kind= uid=e1032a1c-9a6f-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:32:55.013913Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4pp4vlmh5fjzs596nhgsg2wghg7\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4pp4vlmh5fjzs596nhgsg2wghg7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e1032a1c-9a6f-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4pp4vlmh5fjzs596nhgsg2wghg7" level=info timestamp=2018-08-07T18:32:55.270809Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk kind= uid=4cceb08f-9a70-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:32:55.271571Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk kind= uid=4cceb08f-9a70-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:32:55.402825Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk" level=info timestamp=2018-08-07T18:35:55.861861Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4cceb08f-9a70-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk" level=info timestamp=2018-08-07T18:37:08.847218Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7lj8gxztbblcmrlfn9x6lj5frfkn6mh9dfdj2k2cvgfldbcv6d56q52vjfl2v7f kind= uid=e3f3ee37-9a70-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:37:08.848134Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7lj8gxztbblcmrlfn9x6lj5frfkn6mh9dfdj2k2cvgfldbcv6d56q52vjfl2v7f kind= uid=e3f3ee37-9a70-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:37:08.977283Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7lj8gxztbblcmrlfn9x6lj5frfkn6mh9dfdj2k2cvgfldbcv6d56q52vjfl2v7f\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7lj8gxztbblcmrlfn9x6lj5frfkn6mh9dfdj2k2cvgfldbcv6d56q52vjfl2v7f" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:10:09.262078Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-07T18:10:09.272028Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:09.276900Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:09.376847Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:09.420718Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:09.428791Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmi7lj8gxztbblcmrlfn9x6lj5frfkn6mh9dfdj2k2qnn Pod phase: Pending level=info timestamp=2018-08-07T18:37:12.901520Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:37:12.901764Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:37:12.903291Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:37:24.017948Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:37:24.082726Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi7lj8gxztbblcmrlfn9x6lj5frfkn6mh9dfdj2k2cvgfldbcv6d56q52vjfl2v7f" level=info timestamp=2018-08-07T18:37:24.084574Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:37:24.084972Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [180.647 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 when virt-handler is not responsive /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:371 the node controller should react [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:410 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T18:37:08.959732Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi7lj8gxztbblcmrlfn9x6lj5frfkn6mh9dfdj2k2cvgfldbcv6d56q52vjfl2v7f kind=VirtualMachineInstance uid=e3f3ee37-9a70-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi7lj8gxztbblcmrlfn9x6lj5frfkn6mh9dfdj2k2qnn" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running 2018/08/07 18:42:11 http: TLS handshake error from 10.244.1.1:44050: EOF level=info timestamp=2018-08-07T18:42:21.051547Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:42:21 http: TLS handshake error from 10.244.1.1:44056: EOF level=info timestamp=2018-08-07T18:42:28.589587Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:42:31 http: TLS handshake error from 10.244.1.1:44062: EOF level=info timestamp=2018-08-07T18:42:35.757875Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:42:35.813675Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:42:41.448923Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:42:41 http: TLS handshake error from 10.244.1.1:44068: EOF level=info timestamp=2018-08-07T18:42:51.148191Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:42:51 http: TLS handshake error from 10.244.1.1:44074: EOF level=info timestamp=2018-08-07T18:42:58.759613Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:43:01 http: TLS handshake error from 10.244.1.1:44080: EOF level=info timestamp=2018-08-07T18:43:05.814756Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:43:05.866319Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 18:40:43 http: TLS handshake error from 10.244.0.1:49884: EOF 2018/08/07 18:40:53 http: TLS handshake error from 10.244.0.1:49944: EOF 2018/08/07 18:41:03 http: TLS handshake error from 10.244.0.1:50004: EOF 2018/08/07 18:41:13 http: TLS handshake error from 10.244.0.1:50064: EOF 2018/08/07 18:41:23 http: TLS handshake error from 10.244.0.1:50124: EOF 2018/08/07 18:41:33 http: TLS handshake error from 10.244.0.1:50184: EOF 2018/08/07 18:41:43 http: TLS handshake error from 10.244.0.1:50244: EOF 2018/08/07 18:41:53 http: TLS handshake error from 10.244.0.1:50304: EOF 2018/08/07 18:42:03 http: TLS handshake error from 10.244.0.1:50364: EOF 2018/08/07 18:42:13 http: TLS handshake error from 10.244.0.1:50424: EOF 2018/08/07 18:42:23 http: TLS handshake error from 10.244.0.1:50484: EOF 2018/08/07 18:42:33 http: TLS handshake error from 10.244.0.1:50544: EOF 2018/08/07 18:42:43 http: TLS handshake error from 10.244.0.1:50604: EOF 2018/08/07 18:42:53 http: TLS handshake error from 10.244.0.1:50664: EOF 2018/08/07 18:43:03 http: TLS handshake error from 10.244.0.1:50724: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T18:28:54.014626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijkzxhpc9fb5sklgr9n7fphwxppg6fn9xf7dm75n9pjmg6wbljg87jk9bsjv4nr9 kind= uid=bd02abfa-9a6f-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:28:54.122084Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijkzxhpc9fb5sklgr9n7fphwxppg6fn9xf7dm75n9pjmg6wbljg87jk9bsjv4nr9\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijkzxhpc9fb5sklgr9n7fphwxppg6fn9xf7dm75n9pjmg6wbljg87jk9bsjv4nr9" level=info timestamp=2018-08-07T18:29:54.414670Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4pp4vlmh5fjzs596nhgsg2wghg7 kind= uid=e1032a1c-9a6f-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:29:54.418547Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4pp4vlmh5fjzs596nhgsg2wghg7 kind= uid=e1032a1c-9a6f-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:32:55.013913Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4pp4vlmh5fjzs596nhgsg2wghg7\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4pp4vlmh5fjzs596nhgsg2wghg7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e1032a1c-9a6f-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibkb26bvj92dk8r9c8rkr98dftqxqnrcftngx4pp4vlmh5fjzs596nhgsg2wghg7" level=info timestamp=2018-08-07T18:32:55.270809Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk kind= uid=4cceb08f-9a70-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:32:55.271571Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk kind= uid=4cceb08f-9a70-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:32:55.402825Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk" level=info timestamp=2018-08-07T18:35:55.861861Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4cceb08f-9a70-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitj5s5n5ljx96x9b7rschd7tg8v2c42sjt2g222qwxm2tcp7p4h9fhbj9ts8rnnk" level=info timestamp=2018-08-07T18:37:08.847218Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7lj8gxztbblcmrlfn9x6lj5frfkn6mh9dfdj2k2cvgfldbcv6d56q52vjfl2v7f kind= uid=e3f3ee37-9a70-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:37:08.848134Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7lj8gxztbblcmrlfn9x6lj5frfkn6mh9dfdj2k2cvgfldbcv6d56q52vjfl2v7f kind= uid=e3f3ee37-9a70-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:37:08.977283Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7lj8gxztbblcmrlfn9x6lj5frfkn6mh9dfdj2k2cvgfldbcv6d56q52vjfl2v7f\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7lj8gxztbblcmrlfn9x6lj5frfkn6mh9dfdj2k2cvgfldbcv6d56q52vjfl2v7f" level=info timestamp=2018-08-07T18:40:09.406607Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7lj8gxztbblcmrlfn9x6lj5frfkn6mh9dfdj2k2cvgfldbcv6d56q52vjfl2v7f\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi7lj8gxztbblcmrlfn9x6lj5frfkn6mh9dfdj2k2cvgfldbcv6d56q52vjfl2v7f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e3f3ee37-9a70-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7lj8gxztbblcmrlfn9x6lj5frfkn6mh9dfdj2k2cvgfldbcv6d56q52vjfl2v7f" level=info timestamp=2018-08-07T18:40:09.606877Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvminbcwpxtt4fgbz6rc7s6fvqvwqdtkwqzzzqfrgntfdzrzndk69lzlvj9b4zwg2vl kind= uid=4faf5097-9a71-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:40:09.607732Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvminbcwpxtt4fgbz6rc7s6fvqvwqdtkwqzzzqfrgntfdzrzndk69lzlvj9b4zwg2vl kind= uid=4faf5097-9a71-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:10:09.262078Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-07T18:10:09.272028Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:09.276900Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:09.376847Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:09.420718Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:09.428791Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvminbcwpxtt4fgbz6rc7s6fvqvwqdtkwqzzzqfrgnd8fp Pod phase: Pending level=info timestamp=2018-08-07T18:40:13.847965Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:40:13.851636Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:40:13.856917Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:40:26.269370Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:40:26.389093Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvminbcwpxtt4fgbz6rc7s6fvqvwqdtkwqzzzqfrgntfdzrzndk69lzlvj9b4zwg2vl" level=info timestamp=2018-08-07T18:40:26.392100Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:40:26.392830Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.885 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with node tainted /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:463 the vmi with tolerations should be scheduled [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:485 Timed out after 90.010s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T18:40:09.681084Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvminbcwpxtt4fgbz6rc7s6fvqvwqdtkwqzzzqfrgntfdzrzndk69lzlvj9b4zwg2vl kind=VirtualMachineInstance uid=4faf5097-9a71-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvminbcwpxtt4fgbz6rc7s6fvqvwqdtkwqzzzqfrgnd8fp" • ------------------------------ • [SLOW TEST:23.707 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with non default namespace /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:535 should log libvirt start and stop lifecycle events of the domain /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 kubevirt-test-default /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:25.777 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with non default namespace /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:535 should log libvirt start and stop lifecycle events of the domain /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 kubevirt-test-alternative /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.232 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 VirtualMachineInstance Emulation Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:592 should enable emulation in virt-launcher [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:604 Software emulation is not enabled on this cluster /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:600 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.245 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 VirtualMachineInstance Emulation Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:592 should be reflected in domain XML [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:641 Software emulation is not enabled on this cluster /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:600 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.216 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 VirtualMachineInstance Emulation Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:592 should request a TUN device but not KVM [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:685 Software emulation is not enabled on this cluster /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:600 ------------------------------ •••• Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running 2018/08/07 18:46:11 http: TLS handshake error from 10.244.1.1:44194: EOF level=info timestamp=2018-08-07T18:46:20.186192Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:46:20.190579Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:46:21 http: TLS handshake error from 10.244.1.1:44200: EOF level=info timestamp=2018-08-07T18:46:21.888610Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:46:29.840430Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:46:31 http: TLS handshake error from 10.244.1.1:44206: EOF level=info timestamp=2018-08-07T18:46:36.273986Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:46:36.322914Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:46:41.478444Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:46:41 http: TLS handshake error from 10.244.1.1:44212: EOF 2018/08/07 18:46:51 http: TLS handshake error from 10.244.1.1:44218: EOF level=info timestamp=2018-08-07T18:46:51.990909Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:46:59.986853Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:47:01 http: TLS handshake error from 10.244.1.1:44224: EOF Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 18:44:43 http: TLS handshake error from 10.244.0.1:51324: EOF 2018/08/07 18:44:53 http: TLS handshake error from 10.244.0.1:51384: EOF 2018/08/07 18:45:03 http: TLS handshake error from 10.244.0.1:51444: EOF 2018/08/07 18:45:13 http: TLS handshake error from 10.244.0.1:51504: EOF 2018/08/07 18:45:23 http: TLS handshake error from 10.244.0.1:51564: EOF 2018/08/07 18:45:33 http: TLS handshake error from 10.244.0.1:51624: EOF 2018/08/07 18:45:43 http: TLS handshake error from 10.244.0.1:51684: EOF 2018/08/07 18:45:53 http: TLS handshake error from 10.244.0.1:51744: EOF 2018/08/07 18:46:03 http: TLS handshake error from 10.244.0.1:51804: EOF 2018/08/07 18:46:13 http: TLS handshake error from 10.244.0.1:51864: EOF 2018/08/07 18:46:23 http: TLS handshake error from 10.244.0.1:51924: EOF 2018/08/07 18:46:33 http: TLS handshake error from 10.244.0.1:51984: EOF 2018/08/07 18:46:43 http: TLS handshake error from 10.244.0.1:52044: EOF 2018/08/07 18:46:53 http: TLS handshake error from 10.244.0.1:52104: EOF 2018/08/07 18:47:03 http: TLS handshake error from 10.244.0.1:52164: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T18:43:11.947630Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi5m6p2bjhdmfrkzl72lrjng2lt7wxhpfhtm7h2tn2m4fct5pk979hhm5dd4tkdhs\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi5m6p2bjhdmfrkzl72lrjng2lt7wxhpfhtm7h2tn2m4fct5pk979hhm5dd4tkdhs, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bb8c811c-9a71-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi5m6p2bjhdmfrkzl72lrjng2lt7wxhpfhtm7h2tn2m4fct5pk979hhm5dd4tkdhs" level=info timestamp=2018-08-07T18:43:12.180149Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimwwklhhs5pnjm8njwqvmnrfcmqc6jzf4jjz6hskfqp5s2wqtkv4s6q8hbp5c668 kind= uid=bc87279d-9a71-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:43:12.180700Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimwwklhhs5pnjm8njwqvmnrfcmqc6jzf4jjz6hskfqp5s2wqtkv4s6q8hbp5c668 kind= uid=bc87279d-9a71-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:43:35.691677Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:43:35.692183Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:44:02.188498Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihz87qcllp2wkchj28w44q9sdxxgfqm4fcspmjblw7sj92vw9vxnnwtg2x6mbg4v kind= uid=da52e8ea-9a71-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:02.188861Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihz87qcllp2wkchj28w44q9sdxxgfqm4fcspmjblw7sj92vw9vxnnwtg2x6mbg4v kind= uid=da52e8ea-9a71-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:44:02.886081Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmihz87qcllp2wkchj28w44q9sdxxgfqm4fcspmjblw7sj92vw9vxnnwtg2x6mbg4v\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmihz87qcllp2wkchj28w44q9sdxxgfqm4fcspmjblw7sj92vw9vxnnwtg2x6mbg4v, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: da52e8ea-9a71-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmihz87qcllp2wkchj28w44q9sdxxgfqm4fcspmjblw7sj92vw9vxnnwtg2x6mbg4v" level=info timestamp=2018-08-07T18:44:03.034508Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494 kind= uid=dad71548-9a71-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:03.034746Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494 kind= uid=dad71548-9a71-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:44:03.144308Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494" level=info timestamp=2018-08-07T18:44:03.181234Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494" level=info timestamp=2018-08-07T18:44:03.266015Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: dad71548-9a71-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494" level=info timestamp=2018-08-07T18:44:03.855283Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx kind= uid=db542c23-9a71-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:03.855582Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx kind= uid=db542c23-9a71-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs4796dhgf Pod phase: Pending level=info timestamp=2018-08-07T18:44:07.943651Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:44:07.945200Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:44:07.949085Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:44:20.271112Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:44:20.349651Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx" level=info timestamp=2018-08-07T18:44:20.351870Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:44:20.352312Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure [180.684 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance's Pod /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:837 should result in the VirtualMachineInstance moving to a finalized state [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:838 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-07T18:44:04.021902Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx kind=VirtualMachineInstance uid=db542c23-9a71-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs4796dhgf" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running level=info timestamp=2018-08-07T18:49:06.656270Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:49:11.413712Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:49:11 http: TLS handshake error from 10.244.1.1:44302: EOF 2018/08/07 18:49:21 http: TLS handshake error from 10.244.1.1:44308: EOF level=info timestamp=2018-08-07T18:49:22.517441Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:49:30.749573Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:49:31 http: TLS handshake error from 10.244.1.1:44314: EOF level=info timestamp=2018-08-07T18:49:36.673463Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:49:36.727770Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:49:41.477004Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:49:41 http: TLS handshake error from 10.244.1.1:44320: EOF 2018/08/07 18:49:51 http: TLS handshake error from 10.244.1.1:44326: EOF level=info timestamp=2018-08-07T18:49:52.619663Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:50:00.899690Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:50:01 http: TLS handshake error from 10.244.1.1:44332: EOF Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 18:47:43 http: TLS handshake error from 10.244.0.1:52404: EOF 2018/08/07 18:47:53 http: TLS handshake error from 10.244.0.1:52464: EOF 2018/08/07 18:48:03 http: TLS handshake error from 10.244.0.1:52524: EOF 2018/08/07 18:48:13 http: TLS handshake error from 10.244.0.1:52584: EOF 2018/08/07 18:48:23 http: TLS handshake error from 10.244.0.1:52644: EOF 2018/08/07 18:48:33 http: TLS handshake error from 10.244.0.1:52704: EOF 2018/08/07 18:48:43 http: TLS handshake error from 10.244.0.1:52764: EOF 2018/08/07 18:48:53 http: TLS handshake error from 10.244.0.1:52824: EOF 2018/08/07 18:49:03 http: TLS handshake error from 10.244.0.1:52884: EOF 2018/08/07 18:49:13 http: TLS handshake error from 10.244.0.1:52944: EOF 2018/08/07 18:49:23 http: TLS handshake error from 10.244.0.1:53004: EOF 2018/08/07 18:49:33 http: TLS handshake error from 10.244.0.1:53064: EOF 2018/08/07 18:49:43 http: TLS handshake error from 10.244.0.1:53124: EOF 2018/08/07 18:49:53 http: TLS handshake error from 10.244.0.1:53184: EOF 2018/08/07 18:50:03 http: TLS handshake error from 10.244.0.1:53244: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T18:43:35.691677Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:43:35.692183Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:44:02.188498Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihz87qcllp2wkchj28w44q9sdxxgfqm4fcspmjblw7sj92vw9vxnnwtg2x6mbg4v kind= uid=da52e8ea-9a71-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:02.188861Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihz87qcllp2wkchj28w44q9sdxxgfqm4fcspmjblw7sj92vw9vxnnwtg2x6mbg4v kind= uid=da52e8ea-9a71-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:44:02.886081Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmihz87qcllp2wkchj28w44q9sdxxgfqm4fcspmjblw7sj92vw9vxnnwtg2x6mbg4v\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmihz87qcllp2wkchj28w44q9sdxxgfqm4fcspmjblw7sj92vw9vxnnwtg2x6mbg4v, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: da52e8ea-9a71-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmihz87qcllp2wkchj28w44q9sdxxgfqm4fcspmjblw7sj92vw9vxnnwtg2x6mbg4v" level=info timestamp=2018-08-07T18:44:03.034508Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494 kind= uid=dad71548-9a71-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:03.034746Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494 kind= uid=dad71548-9a71-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:44:03.144308Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494" level=info timestamp=2018-08-07T18:44:03.181234Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494" level=info timestamp=2018-08-07T18:44:03.266015Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: dad71548-9a71-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494" level=info timestamp=2018-08-07T18:44:03.855283Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx kind= uid=db542c23-9a71-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:03.855582Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx kind= uid=db542c23-9a71-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:47:04.508119Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: db542c23-9a71-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx" level=info timestamp=2018-08-07T18:47:04.672563Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc59rp6n5g5lwpxnx574k9lqwmzd5 kind= uid=471811b2-9a72-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:47:04.673249Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc59rp6n5g5lwpxnx574k9lqwmzd5 kind= uid=471811b2-9a72-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc5clrhl Pod phase: Pending level=info timestamp=2018-08-07T18:47:09.319084Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:47:09.319722Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:47:09.323990Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:47:20.481608Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:47:20.567112Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc59rp6n5g5lwpxnx574k9lqwmzd5" level=info timestamp=2018-08-07T18:47:20.569189Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:47:20.569693Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.734 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:869 with an active pod. /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:870 should result in pod being terminated [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:871 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-07T18:47:04.837640Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc59rp6n5g5lwpxnx574k9lqwmzd5 kind=VirtualMachineInstance uid=471811b2-9a72-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc5clrhl" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running level=info timestamp=2018-08-07T18:52:07.035935Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:52:11.503339Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:52:11 http: TLS handshake error from 10.244.1.1:44410: EOF 2018/08/07 18:52:21 http: TLS handshake error from 10.244.1.1:44416: EOF level=info timestamp=2018-08-07T18:52:23.118897Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:52:31.661216Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:52:31 http: TLS handshake error from 10.244.1.1:44422: EOF level=info timestamp=2018-08-07T18:52:37.029001Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:52:37.084964Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:52:41.539587Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:52:41 http: TLS handshake error from 10.244.1.1:44428: EOF 2018/08/07 18:52:51 http: TLS handshake error from 10.244.1.1:44434: EOF level=info timestamp=2018-08-07T18:52:53.232025Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:53:01 http: TLS handshake error from 10.244.1.1:44440: EOF level=info timestamp=2018-08-07T18:53:01.810855Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 18:50:43 http: TLS handshake error from 10.244.0.1:53484: EOF 2018/08/07 18:50:53 http: TLS handshake error from 10.244.0.1:53544: EOF 2018/08/07 18:51:03 http: TLS handshake error from 10.244.0.1:53604: EOF 2018/08/07 18:51:13 http: TLS handshake error from 10.244.0.1:53664: EOF 2018/08/07 18:51:23 http: TLS handshake error from 10.244.0.1:53724: EOF 2018/08/07 18:51:33 http: TLS handshake error from 10.244.0.1:53784: EOF 2018/08/07 18:51:43 http: TLS handshake error from 10.244.0.1:53844: EOF 2018/08/07 18:51:53 http: TLS handshake error from 10.244.0.1:53904: EOF 2018/08/07 18:52:03 http: TLS handshake error from 10.244.0.1:53964: EOF 2018/08/07 18:52:13 http: TLS handshake error from 10.244.0.1:54024: EOF 2018/08/07 18:52:23 http: TLS handshake error from 10.244.0.1:54084: EOF 2018/08/07 18:52:33 http: TLS handshake error from 10.244.0.1:54144: EOF 2018/08/07 18:52:43 http: TLS handshake error from 10.244.0.1:54204: EOF 2018/08/07 18:52:53 http: TLS handshake error from 10.244.0.1:54264: EOF 2018/08/07 18:53:03 http: TLS handshake error from 10.244.0.1:54324: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T18:44:02.886081Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmihz87qcllp2wkchj28w44q9sdxxgfqm4fcspmjblw7sj92vw9vxnnwtg2x6mbg4v\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmihz87qcllp2wkchj28w44q9sdxxgfqm4fcspmjblw7sj92vw9vxnnwtg2x6mbg4v, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: da52e8ea-9a71-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmihz87qcllp2wkchj28w44q9sdxxgfqm4fcspmjblw7sj92vw9vxnnwtg2x6mbg4v" level=info timestamp=2018-08-07T18:44:03.034508Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494 kind= uid=dad71548-9a71-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:03.034746Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494 kind= uid=dad71548-9a71-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:44:03.144308Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494" level=info timestamp=2018-08-07T18:44:03.181234Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494" level=info timestamp=2018-08-07T18:44:03.266015Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: dad71548-9a71-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494" level=info timestamp=2018-08-07T18:44:03.855283Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx kind= uid=db542c23-9a71-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:03.855582Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx kind= uid=db542c23-9a71-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:47:04.508119Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: db542c23-9a71-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx" level=info timestamp=2018-08-07T18:47:04.672563Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc59rp6n5g5lwpxnx574k9lqwmzd5 kind= uid=471811b2-9a72-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:47:04.673249Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc59rp6n5g5lwpxnx574k9lqwmzd5 kind= uid=471811b2-9a72-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:50:05.277886Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc59rp6n5g5lwpxnx574k9lqwmzd5\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc59rp6n5g5lwpxnx574k9lqwmzd5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 471811b2-9a72-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc59rp6n5g5lwpxnx574k9lqwmzd5" level=info timestamp=2018-08-07T18:50:05.444345Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x kind= uid=b2d78346-9a72-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:50:05.444999Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x kind= uid=b2d78346-9a72-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:50:05.567287Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnpmscc Pod phase: Pending level=info timestamp=2018-08-07T18:50:10.145818Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:50:10.146496Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:50:10.150691Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:50:21.365779Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:50:21.415936Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x" level=info timestamp=2018-08-07T18:50:21.421095Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:50:21.421489Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.774 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:869 with ACPI and 0 grace period seconds /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:895 should result in vmi status failed [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:896 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-07T18:50:05.554826Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x kind=VirtualMachineInstance uid=b2d78346-9a72-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnpmscc" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running 2018/08/07 18:55:11 http: TLS handshake error from 10.244.1.1:44518: EOF level=info timestamp=2018-08-07T18:55:20.137338Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:55:20.140993Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:55:21 http: TLS handshake error from 10.244.1.1:44524: EOF level=info timestamp=2018-08-07T18:55:23.730959Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:55:31 http: TLS handshake error from 10.244.1.1:44530: EOF level=info timestamp=2018-08-07T18:55:32.590315Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:55:37.419753Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:55:37.465311Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:55:41.500654Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:55:41 http: TLS handshake error from 10.244.1.1:44536: EOF 2018/08/07 18:55:51 http: TLS handshake error from 10.244.1.1:44542: EOF level=info timestamp=2018-08-07T18:55:53.826674Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:56:01 http: TLS handshake error from 10.244.1.1:44548: EOF level=info timestamp=2018-08-07T18:56:02.753815Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 18:53:43 http: TLS handshake error from 10.244.0.1:54564: EOF 2018/08/07 18:53:53 http: TLS handshake error from 10.244.0.1:54624: EOF 2018/08/07 18:54:03 http: TLS handshake error from 10.244.0.1:54684: EOF 2018/08/07 18:54:13 http: TLS handshake error from 10.244.0.1:54744: EOF 2018/08/07 18:54:23 http: TLS handshake error from 10.244.0.1:54804: EOF 2018/08/07 18:54:33 http: TLS handshake error from 10.244.0.1:54864: EOF 2018/08/07 18:54:43 http: TLS handshake error from 10.244.0.1:54924: EOF 2018/08/07 18:54:53 http: TLS handshake error from 10.244.0.1:54984: EOF 2018/08/07 18:55:03 http: TLS handshake error from 10.244.0.1:55044: EOF 2018/08/07 18:55:13 http: TLS handshake error from 10.244.0.1:55104: EOF 2018/08/07 18:55:23 http: TLS handshake error from 10.244.0.1:55164: EOF 2018/08/07 18:55:33 http: TLS handshake error from 10.244.0.1:55224: EOF 2018/08/07 18:55:43 http: TLS handshake error from 10.244.0.1:55284: EOF 2018/08/07 18:55:53 http: TLS handshake error from 10.244.0.1:55344: EOF 2018/08/07 18:56:03 http: TLS handshake error from 10.244.0.1:55404: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T18:44:03.181234Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494" level=info timestamp=2018-08-07T18:44:03.266015Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: dad71548-9a71-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib9b2bx58c6gzdv2xfkhwcnktwv5mq46dbf664m4bl4x6kcpvfbznzx52t7vh494" level=info timestamp=2018-08-07T18:44:03.855283Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx kind= uid=db542c23-9a71-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:03.855582Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx kind= uid=db542c23-9a71-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:47:04.508119Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: db542c23-9a71-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx" level=info timestamp=2018-08-07T18:47:04.672563Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc59rp6n5g5lwpxnx574k9lqwmzd5 kind= uid=471811b2-9a72-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:47:04.673249Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc59rp6n5g5lwpxnx574k9lqwmzd5 kind= uid=471811b2-9a72-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:50:05.277886Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc59rp6n5g5lwpxnx574k9lqwmzd5\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc59rp6n5g5lwpxnx574k9lqwmzd5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 471811b2-9a72-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc59rp6n5g5lwpxnx574k9lqwmzd5" level=info timestamp=2018-08-07T18:50:05.444345Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x kind= uid=b2d78346-9a72-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:50:05.444999Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x kind= uid=b2d78346-9a72-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:50:05.567287Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x" level=info timestamp=2018-08-07T18:53:06.052923Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b2d78346-9a72-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x" level=info timestamp=2018-08-07T18:53:06.220318Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpjd4qqb6x85nt9cqgmrgmxfd55x kind= uid=1e976225-9a73-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:53:06.221092Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpjd4qqb6x85nt9cqgmrgmxfd55x kind= uid=1e976225-9a73-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:53:06.351149Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpjd4qqb6x85nt9cqgmrgmxfd55x\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpjd4qqb6x85nt9cqgmrgmxfd55x" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpbrtcg Pod phase: Pending level=info timestamp=2018-08-07T18:53:10.234675Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:53:10.235536Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:53:10.237332Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:53:21.877982Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:53:21.949291Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpjd4qqb6x85nt9cqgmrgmxfd55x" level=info timestamp=2018-08-07T18:53:21.951924Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:53:21.952483Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.769 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:869 with ACPI and some grace period seconds /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:920 should result in vmi status succeeded [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:921 Timed out after 90.014s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-07T18:53:06.340369Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpjd4qqb6x85nt9cqgmrgmxfd55x kind=VirtualMachineInstance uid=1e976225-9a73-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpbrtcg" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running 2018/08/07 18:58:11 http: TLS handshake error from 10.244.1.1:44626: EOF level=info timestamp=2018-08-07T18:58:20.158214Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:58:20.162713Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:58:21 http: TLS handshake error from 10.244.1.1:44632: EOF level=info timestamp=2018-08-07T18:58:24.375768Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:58:31 http: TLS handshake error from 10.244.1.1:44638: EOF level=info timestamp=2018-08-07T18:58:33.572752Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:58:37.798429Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:58:37.835347Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:58:41.471657Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:58:41 http: TLS handshake error from 10.244.1.1:44644: EOF 2018/08/07 18:58:51 http: TLS handshake error from 10.244.1.1:44650: EOF level=info timestamp=2018-08-07T18:58:54.483289Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:59:01 http: TLS handshake error from 10.244.1.1:44656: EOF level=info timestamp=2018-08-07T18:59:03.719794Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 18:56:43 http: TLS handshake error from 10.244.0.1:55644: EOF 2018/08/07 18:56:53 http: TLS handshake error from 10.244.0.1:55704: EOF 2018/08/07 18:57:03 http: TLS handshake error from 10.244.0.1:55764: EOF 2018/08/07 18:57:13 http: TLS handshake error from 10.244.0.1:55824: EOF 2018/08/07 18:57:23 http: TLS handshake error from 10.244.0.1:55884: EOF 2018/08/07 18:57:33 http: TLS handshake error from 10.244.0.1:55944: EOF 2018/08/07 18:57:43 http: TLS handshake error from 10.244.0.1:56004: EOF 2018/08/07 18:57:53 http: TLS handshake error from 10.244.0.1:56064: EOF 2018/08/07 18:58:03 http: TLS handshake error from 10.244.0.1:56124: EOF 2018/08/07 18:58:13 http: TLS handshake error from 10.244.0.1:56184: EOF 2018/08/07 18:58:23 http: TLS handshake error from 10.244.0.1:56244: EOF 2018/08/07 18:58:33 http: TLS handshake error from 10.244.0.1:56304: EOF 2018/08/07 18:58:43 http: TLS handshake error from 10.244.0.1:56364: EOF 2018/08/07 18:58:53 http: TLS handshake error from 10.244.0.1:56424: EOF 2018/08/07 18:59:03 http: TLS handshake error from 10.244.0.1:56484: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T18:47:04.508119Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: db542c23-9a71-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijp27gh6r28qlsjs455m2wth4rm6fc782gs479ks7wrmnb8bz7mbq5k58nf4pnbx" level=info timestamp=2018-08-07T18:47:04.672563Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc59rp6n5g5lwpxnx574k9lqwmzd5 kind= uid=471811b2-9a72-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:47:04.673249Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc59rp6n5g5lwpxnx574k9lqwmzd5 kind= uid=471811b2-9a72-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:50:05.277886Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc59rp6n5g5lwpxnx574k9lqwmzd5\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc59rp6n5g5lwpxnx574k9lqwmzd5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 471811b2-9a72-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij6s6q5r9ch7b8frbnrjnzwqr2ghsg9dmbjxc59rp6n5g5lwpxnx574k9lqwmzd5" level=info timestamp=2018-08-07T18:50:05.444345Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x kind= uid=b2d78346-9a72-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:50:05.444999Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x kind= uid=b2d78346-9a72-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:50:05.567287Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x" level=info timestamp=2018-08-07T18:53:06.052923Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b2d78346-9a72-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x" level=info timestamp=2018-08-07T18:53:06.220318Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpjd4qqb6x85nt9cqgmrgmxfd55x kind= uid=1e976225-9a73-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:53:06.221092Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpjd4qqb6x85nt9cqgmrgmxfd55x kind= uid=1e976225-9a73-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:53:06.351149Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpjd4qqb6x85nt9cqgmrgmxfd55x\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpjd4qqb6x85nt9cqgmrgmxfd55x" level=info timestamp=2018-08-07T18:56:07.000523Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr kind= uid=8a58fd62-9a73-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:56:07.004661Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr kind= uid=8a58fd62-9a73-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:56:07.111728Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr" level=info timestamp=2018-08-07T18:56:07.175455Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbm8vvk Pod phase: Pending level=info timestamp=2018-08-07T18:56:10.941550Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:56:10.942060Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:56:10.946235Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:56:22.838039Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:56:22.892625Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr" level=info timestamp=2018-08-07T18:56:22.895468Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:56:22.895926Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.779 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:869 with grace period greater than 0 /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:945 should run graceful shutdown [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:946 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Setting a VirtualMachineInstance termination grace period to 5 STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-07T18:56:07.143553Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr kind=VirtualMachineInstance uid=8a58fd62-9a73-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbm8vvk" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running 2018/08/07 19:01:11 http: TLS handshake error from 10.244.1.1:44734: EOF level=info timestamp=2018-08-07T19:01:20.851832Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:01:20.854899Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:01:21 http: TLS handshake error from 10.244.1.1:44740: EOF level=info timestamp=2018-08-07T19:01:25.057274Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:01:31 http: TLS handshake error from 10.244.1.1:44746: EOF level=info timestamp=2018-08-07T19:01:34.463829Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:01:38.194717Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:01:38.251122Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:01:41.514724Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:01:41 http: TLS handshake error from 10.244.1.1:44752: EOF 2018/08/07 19:01:51 http: TLS handshake error from 10.244.1.1:44758: EOF level=info timestamp=2018-08-07T19:01:55.179690Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:02:01 http: TLS handshake error from 10.244.1.1:44764: EOF level=info timestamp=2018-08-07T19:02:04.608146Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 18:59:43 http: TLS handshake error from 10.244.0.1:56724: EOF 2018/08/07 18:59:53 http: TLS handshake error from 10.244.0.1:56784: EOF 2018/08/07 19:00:03 http: TLS handshake error from 10.244.0.1:56844: EOF 2018/08/07 19:00:13 http: TLS handshake error from 10.244.0.1:56904: EOF 2018/08/07 19:00:23 http: TLS handshake error from 10.244.0.1:56964: EOF 2018/08/07 19:00:33 http: TLS handshake error from 10.244.0.1:57024: EOF 2018/08/07 19:00:43 http: TLS handshake error from 10.244.0.1:57084: EOF 2018/08/07 19:00:53 http: TLS handshake error from 10.244.0.1:57144: EOF 2018/08/07 19:01:03 http: TLS handshake error from 10.244.0.1:57204: EOF 2018/08/07 19:01:13 http: TLS handshake error from 10.244.0.1:57264: EOF 2018/08/07 19:01:23 http: TLS handshake error from 10.244.0.1:57324: EOF 2018/08/07 19:01:33 http: TLS handshake error from 10.244.0.1:57384: EOF 2018/08/07 19:01:43 http: TLS handshake error from 10.244.0.1:57444: EOF 2018/08/07 19:01:53 http: TLS handshake error from 10.244.0.1:57504: EOF 2018/08/07 19:02:03 http: TLS handshake error from 10.244.0.1:57564: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T18:50:05.444999Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x kind= uid=b2d78346-9a72-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:50:05.567287Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x" level=info timestamp=2018-08-07T18:53:06.052923Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b2d78346-9a72-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmil2tbj6vjqjwsq5hk5wgpg2rrbhbhtwqlsxbxnx4khkhnfx2s7dt9pwsw2g7tn6x" level=info timestamp=2018-08-07T18:53:06.220318Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpjd4qqb6x85nt9cqgmrgmxfd55x kind= uid=1e976225-9a73-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:53:06.221092Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpjd4qqb6x85nt9cqgmrgmxfd55x kind= uid=1e976225-9a73-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:53:06.351149Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpjd4qqb6x85nt9cqgmrgmxfd55x\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpjd4qqb6x85nt9cqgmrgmxfd55x" level=info timestamp=2018-08-07T18:56:07.000523Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr kind= uid=8a58fd62-9a73-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:56:07.004661Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr kind= uid=8a58fd62-9a73-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:56:07.111728Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr" level=info timestamp=2018-08-07T18:56:07.175455Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr" level=info timestamp=2018-08-07T18:59:07.598885Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8a58fd62-9a73-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr" level=info timestamp=2018-08-07T18:59:07.771931Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h kind= uid=f618dee0-9a73-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:59:07.772665Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h kind= uid=f618dee0-9a73-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:59:07.906710Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h" level=info timestamp=2018-08-07T18:59:07.969889Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jf52x4 Pod phase: Pending level=info timestamp=2018-08-07T18:59:12.027234Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:59:12.027599Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:59:12.029657Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:59:23.178202Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:59:23.271801Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h" level=info timestamp=2018-08-07T18:59:23.274098Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:59:23.274587Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.719 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Killed VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:997 should be in Failed phase [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:998 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Starting a VirtualMachineInstance level=info timestamp=2018-08-07T18:59:07.870368Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h kind=VirtualMachineInstance uid=f618dee0-9a73-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jf52x4" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running 2018/08/07 19:04:11 http: TLS handshake error from 10.244.1.1:44842: EOF 2018/08/07 19:04:21 http: TLS handshake error from 10.244.1.1:44848: EOF level=info timestamp=2018-08-07T19:04:25.749529Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:04:31 http: TLS handshake error from 10.244.1.1:44854: EOF level=info timestamp=2018-08-07T19:04:35.375908Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:04:38.602172Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:04:38.673971Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:04:41.499546Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:04:41 http: TLS handshake error from 10.244.1.1:44860: EOF 2018/08/07 19:04:51 http: TLS handshake error from 10.244.1.1:44866: EOF level=info timestamp=2018-08-07T19:04:55.857838Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:05:01 http: TLS handshake error from 10.244.1.1:44872: EOF level=info timestamp=2018-08-07T19:05:05.526883Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:05:08.643955Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:05:08.721925Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 19:02:43 http: TLS handshake error from 10.244.0.1:57804: EOF 2018/08/07 19:02:53 http: TLS handshake error from 10.244.0.1:57864: EOF 2018/08/07 19:03:03 http: TLS handshake error from 10.244.0.1:57924: EOF 2018/08/07 19:03:13 http: TLS handshake error from 10.244.0.1:57984: EOF 2018/08/07 19:03:23 http: TLS handshake error from 10.244.0.1:58044: EOF 2018/08/07 19:03:33 http: TLS handshake error from 10.244.0.1:58104: EOF 2018/08/07 19:03:43 http: TLS handshake error from 10.244.0.1:58164: EOF 2018/08/07 19:03:53 http: TLS handshake error from 10.244.0.1:58224: EOF 2018/08/07 19:04:03 http: TLS handshake error from 10.244.0.1:58284: EOF 2018/08/07 19:04:13 http: TLS handshake error from 10.244.0.1:58344: EOF 2018/08/07 19:04:23 http: TLS handshake error from 10.244.0.1:58404: EOF 2018/08/07 19:04:33 http: TLS handshake error from 10.244.0.1:58464: EOF 2018/08/07 19:04:43 http: TLS handshake error from 10.244.0.1:58524: EOF 2018/08/07 19:04:53 http: TLS handshake error from 10.244.0.1:58584: EOF 2018/08/07 19:05:03 http: TLS handshake error from 10.244.0.1:58644: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T18:53:06.220318Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpjd4qqb6x85nt9cqgmrgmxfd55x kind= uid=1e976225-9a73-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:53:06.221092Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpjd4qqb6x85nt9cqgmrgmxfd55x kind= uid=1e976225-9a73-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:53:06.351149Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpjd4qqb6x85nt9cqgmrgmxfd55x\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiv7pq6ffwt6szg2w6bdc252ftpbv76hz77txcpjd4qqb6x85nt9cqgmrgmxfd55x" level=info timestamp=2018-08-07T18:56:07.000523Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr kind= uid=8a58fd62-9a73-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:56:07.004661Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr kind= uid=8a58fd62-9a73-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:56:07.111728Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr" level=info timestamp=2018-08-07T18:56:07.175455Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr" level=info timestamp=2018-08-07T18:59:07.598885Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8a58fd62-9a73-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr" level=info timestamp=2018-08-07T18:59:07.771931Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h kind= uid=f618dee0-9a73-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:59:07.772665Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h kind= uid=f618dee0-9a73-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:59:07.906710Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h" level=info timestamp=2018-08-07T18:59:07.969889Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h" level=info timestamp=2018-08-07T19:02:08.401924Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f618dee0-9a73-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h" level=info timestamp=2018-08-07T19:02:08.585961Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi29dng8h8mvs9kvq9d7fzfzzlf7v7phn2d2h9rz8rk6h2jbjcsk2bt8gxbbgsz84 kind= uid=61dc36be-9a74-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:02:08.586717Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi29dng8h8mvs9kvq9d7fzfzzlf7v7phn2d2h9rz8rk6h2jbjcsk2bt8gxbbgsz84 kind= uid=61dc36be-9a74-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmi29dng8h8mvs9kvq9d7fzfzzlf7v7phn2d2h9rlph2k Pod phase: Pending level=info timestamp=2018-08-07T19:02:13.166173Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:02:13.166876Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:02:13.174036Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:02:23.481047Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:02:23.531870Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi29dng8h8mvs9kvq9d7fzfzzlf7v7phn2d2h9rz8rk6h2jbjcsk2bt8gxbbgsz84" level=info timestamp=2018-08-07T19:02:23.533802Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:02:23.534293Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.873 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Killed VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:997 should be left alone by virt-handler [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:1025 Timed out after 90.010s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Starting a VirtualMachineInstance level=info timestamp=2018-08-07T19:02:08.761655Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi29dng8h8mvs9kvq9d7fzfzzlf7v7phn2d2h9rz8rk6h2jbjcsk2bt8gxbbgsz84 kind=VirtualMachineInstance uid=61dc36be-9a74-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi29dng8h8mvs9kvq9d7fzfzzlf7v7phn2d2h9rlph2k" • [SLOW TEST:16.612 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given a vmi /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:12.791 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given an vm /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:12.925 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given a vmi preset /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:13.024 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given a vmi replica set /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.002 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 should succeed to generate a VM JSON file using oc-process command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:150 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1435 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.002 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 with given VM JSON from the Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:152 should succeed to create a VM using oc-create command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:156 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1435 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.002 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 with given VM JSON from the Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:152 with given VM from the VM JSON /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:158 should succeed to launch a VMI using oc-patch command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:161 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1435 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.002 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 with given VM JSON from the Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:152 with given VM from the VM JSON /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:158 with given VMI from the VM /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:163 should succeed to terminate the VMI using oc-patch command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:166 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1435 ------------------------------ Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running level=info timestamp=2018-08-07T19:08:11.509597Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:08:11 http: TLS handshake error from 10.244.1.1:44986: EOF level=info timestamp=2018-08-07T19:08:21.014109Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:08:21.018319Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:08:21 http: TLS handshake error from 10.244.1.1:44992: EOF level=info timestamp=2018-08-07T19:08:26.530610Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:08:31 http: TLS handshake error from 10.244.1.1:44998: EOF level=info timestamp=2018-08-07T19:08:36.751541Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:08:39.097705Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:08:39.188601Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:08:41.454181Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:08:41 http: TLS handshake error from 10.244.1.1:45004: EOF 2018/08/07 19:08:51 http: TLS handshake error from 10.244.1.1:45010: EOF level=info timestamp=2018-08-07T19:08:56.634124Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:09:01 http: TLS handshake error from 10.244.1.1:45016: EOF Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 19:06:43 http: TLS handshake error from 10.244.0.1:59244: EOF 2018/08/07 19:06:53 http: TLS handshake error from 10.244.0.1:59304: EOF 2018/08/07 19:07:03 http: TLS handshake error from 10.244.0.1:59364: EOF 2018/08/07 19:07:13 http: TLS handshake error from 10.244.0.1:59424: EOF 2018/08/07 19:07:23 http: TLS handshake error from 10.244.0.1:59484: EOF 2018/08/07 19:07:33 http: TLS handshake error from 10.244.0.1:59544: EOF 2018/08/07 19:07:43 http: TLS handshake error from 10.244.0.1:59604: EOF 2018/08/07 19:07:53 http: TLS handshake error from 10.244.0.1:59664: EOF 2018/08/07 19:08:03 http: TLS handshake error from 10.244.0.1:59724: EOF 2018/08/07 19:08:13 http: TLS handshake error from 10.244.0.1:59784: EOF 2018/08/07 19:08:23 http: TLS handshake error from 10.244.0.1:59844: EOF 2018/08/07 19:08:33 http: TLS handshake error from 10.244.0.1:59904: EOF 2018/08/07 19:08:43 http: TLS handshake error from 10.244.0.1:59964: EOF 2018/08/07 19:08:53 http: TLS handshake error from 10.244.0.1:60024: EOF 2018/08/07 19:09:03 http: TLS handshake error from 10.244.0.1:60084: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T18:56:07.000523Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr kind= uid=8a58fd62-9a73-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:56:07.004661Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr kind= uid=8a58fd62-9a73-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:56:07.111728Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr" level=info timestamp=2018-08-07T18:56:07.175455Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr" level=info timestamp=2018-08-07T18:59:07.598885Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8a58fd62-9a73-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi52vnv6rn8t8hhzhp68c85j6bc7k6r22lczzmbgww4lvwf257q5wkjbdpfn7cmqr" level=info timestamp=2018-08-07T18:59:07.771931Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h kind= uid=f618dee0-9a73-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:59:07.772665Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h kind= uid=f618dee0-9a73-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:59:07.906710Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h" level=info timestamp=2018-08-07T18:59:07.969889Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h" level=info timestamp=2018-08-07T19:02:08.401924Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f618dee0-9a73-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h" level=info timestamp=2018-08-07T19:02:08.585961Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi29dng8h8mvs9kvq9d7fzfzzlf7v7phn2d2h9rz8rk6h2jbjcsk2bt8gxbbgsz84 kind= uid=61dc36be-9a74-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:02:08.586717Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi29dng8h8mvs9kvq9d7fzfzzlf7v7phn2d2h9rz8rk6h2jbjcsk2bt8gxbbgsz84 kind= uid=61dc36be-9a74-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:05:09.193839Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi29dng8h8mvs9kvq9d7fzfzzlf7v7phn2d2h9rz8rk6h2jbjcsk2bt8gxbbgsz84\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi29dng8h8mvs9kvq9d7fzfzzlf7v7phn2d2h9rz8rk6h2jbjcsk2bt8gxbbgsz84, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 61dc36be-9a74-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi29dng8h8mvs9kvq9d7fzfzzlf7v7phn2d2h9rz8rk6h2jbjcsk2bt8gxbbgsz84" level=info timestamp=2018-08-07T19:06:04.667880Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijnddcbvgk55b4rkzzwn7h2vfgvvqfnqzt5rzhzh7d8czh8vrf6np29pr9ck75x8 kind= uid=ee949e08-9a74-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:06:04.668789Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijnddcbvgk55b4rkzzwn7h2vfgvvqfnqzt5rzhzh7d8czh8vrf6np29pr9ck75x8 kind= uid=ee949e08-9a74-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmijnddcbvgk55b4rkzzwn7h2vfgvvqfnqzt5rzhccjnn Pod phase: Pending level=info timestamp=2018-08-07T19:06:09.326303Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:06:09.326569Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:06:09.328186Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:06:21.302184Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:06:21.379297Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmijnddcbvgk55b4rkzzwn7h2vfgvvqfnqzt5rzhzh7d8czh8vrf6np29pr9ck75x8" level=info timestamp=2018-08-07T19:06:21.381976Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:06:21.382616Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.638 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 VirtualMachineInstance definition /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:55 with 3 CPU cores /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:56 should report 3 cpu cores under guest OS [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:62 Timed out after 90.013s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Starting a VirtualMachineInstance level=info timestamp=2018-08-07T19:06:04.755306Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmijnddcbvgk55b4rkzzwn7h2vfgvvqfnqzt5rzhzh7d8czh8vrf6np29pr9ck75x8 kind=VirtualMachineInstance uid=ee949e08-9a74-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmijnddcbvgk55b4rkzzwn7h2vfgvvqfnqzt5rzhccjnn" • Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running level=info timestamp=2018-08-07T19:11:11.502230Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:11:11 http: TLS handshake error from 10.244.1.1:45094: EOF level=info timestamp=2018-08-07T19:11:21.346918Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:11:21.350655Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:11:21 http: TLS handshake error from 10.244.1.1:45100: EOF level=info timestamp=2018-08-07T19:11:27.137962Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:11:31 http: TLS handshake error from 10.244.1.1:45106: EOF level=info timestamp=2018-08-07T19:11:37.686523Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:11:39.464641Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:11:39.528799Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:11:41.459964Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:11:41 http: TLS handshake error from 10.244.1.1:45112: EOF 2018/08/07 19:11:51 http: TLS handshake error from 10.244.1.1:45118: EOF level=info timestamp=2018-08-07T19:11:57.244834Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:12:01 http: TLS handshake error from 10.244.1.1:45124: EOF Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 19:09:43 http: TLS handshake error from 10.244.0.1:60324: EOF 2018/08/07 19:09:53 http: TLS handshake error from 10.244.0.1:60384: EOF 2018/08/07 19:10:03 http: TLS handshake error from 10.244.0.1:60444: EOF 2018/08/07 19:10:13 http: TLS handshake error from 10.244.0.1:60504: EOF 2018/08/07 19:10:23 http: TLS handshake error from 10.244.0.1:60564: EOF 2018/08/07 19:10:33 http: TLS handshake error from 10.244.0.1:60624: EOF 2018/08/07 19:10:43 http: TLS handshake error from 10.244.0.1:60684: EOF 2018/08/07 19:10:53 http: TLS handshake error from 10.244.0.1:60744: EOF 2018/08/07 19:11:03 http: TLS handshake error from 10.244.0.1:60804: EOF 2018/08/07 19:11:13 http: TLS handshake error from 10.244.0.1:60864: EOF 2018/08/07 19:11:23 http: TLS handshake error from 10.244.0.1:60924: EOF 2018/08/07 19:11:33 http: TLS handshake error from 10.244.0.1:60984: EOF 2018/08/07 19:11:43 http: TLS handshake error from 10.244.0.1:32812: EOF 2018/08/07 19:11:53 http: TLS handshake error from 10.244.0.1:32872: EOF 2018/08/07 19:12:03 http: TLS handshake error from 10.244.0.1:32932: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T18:59:07.771931Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h kind= uid=f618dee0-9a73-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:59:07.772665Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h kind= uid=f618dee0-9a73-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:59:07.906710Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h" level=info timestamp=2018-08-07T18:59:07.969889Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h" level=info timestamp=2018-08-07T19:02:08.401924Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f618dee0-9a73-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiprmg7hxwv9ghhc69nn9kn8gp49gvhjs55l62jhgv5vn52cst9k6q8pjzx94h76h" level=info timestamp=2018-08-07T19:02:08.585961Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi29dng8h8mvs9kvq9d7fzfzzlf7v7phn2d2h9rz8rk6h2jbjcsk2bt8gxbbgsz84 kind= uid=61dc36be-9a74-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:02:08.586717Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi29dng8h8mvs9kvq9d7fzfzzlf7v7phn2d2h9rz8rk6h2jbjcsk2bt8gxbbgsz84 kind= uid=61dc36be-9a74-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:05:09.193839Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi29dng8h8mvs9kvq9d7fzfzzlf7v7phn2d2h9rz8rk6h2jbjcsk2bt8gxbbgsz84\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi29dng8h8mvs9kvq9d7fzfzzlf7v7phn2d2h9rz8rk6h2jbjcsk2bt8gxbbgsz84, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 61dc36be-9a74-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi29dng8h8mvs9kvq9d7fzfzzlf7v7phn2d2h9rz8rk6h2jbjcsk2bt8gxbbgsz84" level=info timestamp=2018-08-07T19:06:04.667880Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijnddcbvgk55b4rkzzwn7h2vfgvvqfnqzt5rzhzh7d8czh8vrf6np29pr9ck75x8 kind= uid=ee949e08-9a74-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:06:04.668789Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijnddcbvgk55b4rkzzwn7h2vfgvvqfnqzt5rzhzh7d8czh8vrf6np29pr9ck75x8 kind= uid=ee949e08-9a74-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:09:05.220283Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijnddcbvgk55b4rkzzwn7h2vfgvvqfnqzt5rzhzh7d8czh8vrf6np29pr9ck75x8\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmijnddcbvgk55b4rkzzwn7h2vfgvvqfnqzt5rzhzh7d8czh8vrf6np29pr9ck75x8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ee949e08-9a74-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijnddcbvgk55b4rkzzwn7h2vfgvvqfnqzt5rzhzh7d8czh8vrf6np29pr9ck75x8" level=info timestamp=2018-08-07T19:09:05.452643Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicgkcbrnqvwnccttv5pcbqxf8fzkws5g6lmtghdgpqsmvrbg26824l4rd2k7gf49 kind= uid=5a575965-9a75-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:09:05.453465Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicgkcbrnqvwnccttv5pcbqxf8fzkws5g6lmtghdgpqsmvrbg26824l4rd2k7gf49 kind= uid=5a575965-9a75-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:09:06.859751Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5bjzk4wkfn5hlfb25zbhlmdqz9tln6dspw8ll78p4dsjrwrvq8grqrdwf28ql5h kind= uid=5b2a6f2d-9a75-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:09:06.860096Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5bjzk4wkfn5hlfb25zbhlmdqz9tln6dspw8ll78p4dsjrwrvq8grqrdwf28ql5h kind= uid=5b2a6f2d-9a75-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmi5bjzk4wkfn5hlfb25zbhlmdqz9tln6dspw8llz5ftz Pod phase: Pending level=info timestamp=2018-08-07T19:09:11.807888Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:09:11.808383Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:09:11.810143Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:09:23.852829Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:09:23.937602Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi5bjzk4wkfn5hlfb25zbhlmdqz9tln6dspw8ll78p4dsjrwrvq8grqrdwf28ql5h" level=info timestamp=2018-08-07T19:09:23.940047Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:09:23.940574Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure [180.746 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 VirtualMachineInstance definition /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:55 with hugepages /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:164 should consume hugepages /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 hugepages-2Mi [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Starting a VM level=info timestamp=2018-08-07T19:09:06.994266Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi5bjzk4wkfn5hlfb25zbhlmdqz9tln6dspw8ll78p4dsjrwrvq8grqrdwf28ql5h kind=VirtualMachineInstance uid=5b2a6f2d-9a75-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi5bjzk4wkfn5hlfb25zbhlmdqz9tln6dspw8llz5ftz" S [SKIPPING] [0.595 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 VirtualMachineInstance definition /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:55 with hugepages /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:164 should consume hugepages /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 hugepages-1Gi [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 No node with hugepages hugepages-1Gi capacity /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:216 ------------------------------ • Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running level=info timestamp=2018-08-07T19:14:09.817712Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:14:11.552313Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:14:11 http: TLS handshake error from 10.244.1.1:45202: EOF 2018/08/07 19:14:21 http: TLS handshake error from 10.244.1.1:45208: EOF level=info timestamp=2018-08-07T19:14:27.830480Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:14:31 http: TLS handshake error from 10.244.1.1:45214: EOF level=info timestamp=2018-08-07T19:14:38.652283Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:14:39.844748Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:14:39.882967Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:14:41.513063Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:14:41 http: TLS handshake error from 10.244.1.1:45220: EOF 2018/08/07 19:14:51 http: TLS handshake error from 10.244.1.1:45226: EOF level=info timestamp=2018-08-07T19:14:57.933001Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:15:01 http: TLS handshake error from 10.244.1.1:45232: EOF level=info timestamp=2018-08-07T19:15:08.815026Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 19:12:43 http: TLS handshake error from 10.244.0.1:33172: EOF 2018/08/07 19:12:53 http: TLS handshake error from 10.244.0.1:33232: EOF 2018/08/07 19:13:03 http: TLS handshake error from 10.244.0.1:33292: EOF 2018/08/07 19:13:13 http: TLS handshake error from 10.244.0.1:33352: EOF 2018/08/07 19:13:23 http: TLS handshake error from 10.244.0.1:33412: EOF 2018/08/07 19:13:33 http: TLS handshake error from 10.244.0.1:33472: EOF 2018/08/07 19:13:43 http: TLS handshake error from 10.244.0.1:33532: EOF 2018/08/07 19:13:53 http: TLS handshake error from 10.244.0.1:33592: EOF 2018/08/07 19:14:03 http: TLS handshake error from 10.244.0.1:33652: EOF 2018/08/07 19:14:13 http: TLS handshake error from 10.244.0.1:33712: EOF 2018/08/07 19:14:23 http: TLS handshake error from 10.244.0.1:33772: EOF 2018/08/07 19:14:33 http: TLS handshake error from 10.244.0.1:33832: EOF 2018/08/07 19:14:43 http: TLS handshake error from 10.244.0.1:33892: EOF 2018/08/07 19:14:53 http: TLS handshake error from 10.244.0.1:33952: EOF 2018/08/07 19:15:03 http: TLS handshake error from 10.244.0.1:34012: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T19:06:04.668789Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijnddcbvgk55b4rkzzwn7h2vfgvvqfnqzt5rzhzh7d8czh8vrf6np29pr9ck75x8 kind= uid=ee949e08-9a74-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:09:05.220283Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijnddcbvgk55b4rkzzwn7h2vfgvvqfnqzt5rzhzh7d8czh8vrf6np29pr9ck75x8\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmijnddcbvgk55b4rkzzwn7h2vfgvvqfnqzt5rzhzh7d8czh8vrf6np29pr9ck75x8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ee949e08-9a74-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijnddcbvgk55b4rkzzwn7h2vfgvvqfnqzt5rzhzh7d8czh8vrf6np29pr9ck75x8" level=info timestamp=2018-08-07T19:09:05.452643Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicgkcbrnqvwnccttv5pcbqxf8fzkws5g6lmtghdgpqsmvrbg26824l4rd2k7gf49 kind= uid=5a575965-9a75-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:09:05.453465Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicgkcbrnqvwnccttv5pcbqxf8fzkws5g6lmtghdgpqsmvrbg26824l4rd2k7gf49 kind= uid=5a575965-9a75-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:09:06.859751Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5bjzk4wkfn5hlfb25zbhlmdqz9tln6dspw8ll78p4dsjrwrvq8grqrdwf28ql5h kind= uid=5b2a6f2d-9a75-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:09:06.860096Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5bjzk4wkfn5hlfb25zbhlmdqz9tln6dspw8ll78p4dsjrwrvq8grqrdwf28ql5h kind= uid=5b2a6f2d-9a75-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:12:07.690021Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi5bjzk4wkfn5hlfb25zbhlmdqz9tln6dspw8ll78p4dsjrwrvq8grqrdwf28ql5h\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi5bjzk4wkfn5hlfb25zbhlmdqz9tln6dspw8ll78p4dsjrwrvq8grqrdwf28ql5h, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5b2a6f2d-9a75-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi5bjzk4wkfn5hlfb25zbhlmdqz9tln6dspw8ll78p4dsjrwrvq8grqrdwf28ql5h" level=info timestamp=2018-08-07T19:12:08.020230Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr kind= uid=c7297d7b-9a75-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:12:08.020813Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr kind= uid=c7297d7b-9a75-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:12:08.119800Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr" level=info timestamp=2018-08-07T19:12:09.162796Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c7297d7b-9a75-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr" level=info timestamp=2018-08-07T19:12:09.314760Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25 kind= uid=c7f0a572-9a75-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:12:09.315181Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25 kind= uid=c7f0a572-9a75-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:12:09.418279Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25" level=info timestamp=2018-08-07T19:12:09.464265Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rzshww Pod phase: Pending level=info timestamp=2018-08-07T19:12:12.843040Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:12:12.843597Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:12:12.847387Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:12:24.297057Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:12:24.417215Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25" level=info timestamp=2018-08-07T19:12:24.419587Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:12:24.420012Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure in Spec Setup (BeforeEach) [180.705 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 with CPU spec /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:294 when CPU model defined [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:340 should report defined CPU model /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:341 Timed out after 90.013s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:12:09.397200Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25 kind=VirtualMachineInstance uid=c7f0a572-9a75-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rzshww" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running 2018/08/07 19:17:11 http: TLS handshake error from 10.244.1.1:45310: EOF 2018/08/07 19:17:21 http: TLS handshake error from 10.244.1.1:45316: EOF level=info timestamp=2018-08-07T19:17:28.456904Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:17:31 http: TLS handshake error from 10.244.1.1:45322: EOF level=info timestamp=2018-08-07T19:17:39.604215Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:17:40.239503Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:17:40.287876Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:17:41.530236Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:17:41 http: TLS handshake error from 10.244.1.1:45328: EOF 2018/08/07 19:17:51 http: TLS handshake error from 10.244.1.1:45334: EOF level=info timestamp=2018-08-07T19:17:58.562277Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:18:01 http: TLS handshake error from 10.244.1.1:45340: EOF level=info timestamp=2018-08-07T19:18:09.760193Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:18:10.327167Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:18:10.363190Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 19:15:43 http: TLS handshake error from 10.244.0.1:34252: EOF 2018/08/07 19:15:53 http: TLS handshake error from 10.244.0.1:34312: EOF 2018/08/07 19:16:03 http: TLS handshake error from 10.244.0.1:34372: EOF 2018/08/07 19:16:13 http: TLS handshake error from 10.244.0.1:34432: EOF 2018/08/07 19:16:23 http: TLS handshake error from 10.244.0.1:34492: EOF 2018/08/07 19:16:33 http: TLS handshake error from 10.244.0.1:34552: EOF 2018/08/07 19:16:43 http: TLS handshake error from 10.244.0.1:34612: EOF 2018/08/07 19:16:53 http: TLS handshake error from 10.244.0.1:34672: EOF 2018/08/07 19:17:03 http: TLS handshake error from 10.244.0.1:34732: EOF 2018/08/07 19:17:13 http: TLS handshake error from 10.244.0.1:34792: EOF 2018/08/07 19:17:23 http: TLS handshake error from 10.244.0.1:34852: EOF 2018/08/07 19:17:33 http: TLS handshake error from 10.244.0.1:34912: EOF 2018/08/07 19:17:43 http: TLS handshake error from 10.244.0.1:34972: EOF 2018/08/07 19:17:53 http: TLS handshake error from 10.244.0.1:35032: EOF 2018/08/07 19:18:03 http: TLS handshake error from 10.244.0.1:35092: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T19:09:06.859751Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5bjzk4wkfn5hlfb25zbhlmdqz9tln6dspw8ll78p4dsjrwrvq8grqrdwf28ql5h kind= uid=5b2a6f2d-9a75-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:09:06.860096Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5bjzk4wkfn5hlfb25zbhlmdqz9tln6dspw8ll78p4dsjrwrvq8grqrdwf28ql5h kind= uid=5b2a6f2d-9a75-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:12:07.690021Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi5bjzk4wkfn5hlfb25zbhlmdqz9tln6dspw8ll78p4dsjrwrvq8grqrdwf28ql5h\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi5bjzk4wkfn5hlfb25zbhlmdqz9tln6dspw8ll78p4dsjrwrvq8grqrdwf28ql5h, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5b2a6f2d-9a75-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi5bjzk4wkfn5hlfb25zbhlmdqz9tln6dspw8ll78p4dsjrwrvq8grqrdwf28ql5h" level=info timestamp=2018-08-07T19:12:08.020230Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr kind= uid=c7297d7b-9a75-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:12:08.020813Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr kind= uid=c7297d7b-9a75-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:12:08.119800Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr" level=info timestamp=2018-08-07T19:12:09.162796Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c7297d7b-9a75-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr" level=info timestamp=2018-08-07T19:12:09.314760Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25 kind= uid=c7f0a572-9a75-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:12:09.315181Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25 kind= uid=c7f0a572-9a75-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:12:09.418279Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25" level=info timestamp=2018-08-07T19:12:09.464265Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25" level=info timestamp=2018-08-07T19:15:09.871929Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c7f0a572-9a75-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25" level=info timestamp=2018-08-07T19:15:10.142230Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j kind= uid=33b4177a-9a76-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:15:10.142719Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j kind= uid=33b4177a-9a76-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:15:10.259205Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw97gwnb Pod phase: Pending level=info timestamp=2018-08-07T19:15:14.428436Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:15:14.428642Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:15:14.431269Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:15:26.118790Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:15:26.206129Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j" level=info timestamp=2018-08-07T19:15:26.208444Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:15:26.208893Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [180.831 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 with CPU spec /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:294 when CPU model equals to passthrough [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:368 should report exactly the same model as node CPU /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:369 Timed out after 90.014s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:15:10.169999Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j kind=VirtualMachineInstance uid=33b4177a-9a76-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw97gwnb" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running level=info timestamp=2018-08-07T19:20:21.558919Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:20:21 http: TLS handshake error from 10.244.1.1:45424: EOF level=info timestamp=2018-08-07T19:20:29.081749Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:20:31 http: TLS handshake error from 10.244.1.1:45430: EOF level=info timestamp=2018-08-07T19:20:40.559430Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:20:40.614326Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:20:40.653487Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:20:41.503067Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:20:41 http: TLS handshake error from 10.244.1.1:45436: EOF 2018/08/07 19:20:51 http: TLS handshake error from 10.244.1.1:45442: EOF level=info timestamp=2018-08-07T19:20:59.198974Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:21:01 http: TLS handshake error from 10.244.1.1:45448: EOF level=info timestamp=2018-08-07T19:21:10.674856Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:21:10.727690Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:21:10.741493Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 19:18:43 http: TLS handshake error from 10.244.0.1:35332: EOF 2018/08/07 19:18:53 http: TLS handshake error from 10.244.0.1:35392: EOF 2018/08/07 19:19:03 http: TLS handshake error from 10.244.0.1:35452: EOF 2018/08/07 19:19:13 http: TLS handshake error from 10.244.0.1:35512: EOF 2018/08/07 19:19:23 http: TLS handshake error from 10.244.0.1:35572: EOF 2018/08/07 19:19:33 http: TLS handshake error from 10.244.0.1:35632: EOF 2018/08/07 19:19:43 http: TLS handshake error from 10.244.0.1:35692: EOF 2018/08/07 19:19:53 http: TLS handshake error from 10.244.0.1:35752: EOF 2018/08/07 19:20:03 http: TLS handshake error from 10.244.0.1:35812: EOF 2018/08/07 19:20:13 http: TLS handshake error from 10.244.0.1:35872: EOF 2018/08/07 19:20:23 http: TLS handshake error from 10.244.0.1:35932: EOF 2018/08/07 19:20:33 http: TLS handshake error from 10.244.0.1:35992: EOF 2018/08/07 19:20:43 http: TLS handshake error from 10.244.0.1:36052: EOF 2018/08/07 19:20:53 http: TLS handshake error from 10.244.0.1:36112: EOF 2018/08/07 19:21:03 http: TLS handshake error from 10.244.0.1:36172: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T19:12:08.020813Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr kind= uid=c7297d7b-9a75-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:12:08.119800Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr" level=info timestamp=2018-08-07T19:12:09.162796Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c7297d7b-9a75-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmif66t85wbvc7c2hqzk7scxn6jrd2d4tgdjsnszqg46zsxzf6kcg4rgjcbhqj45kr" level=info timestamp=2018-08-07T19:12:09.314760Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25 kind= uid=c7f0a572-9a75-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:12:09.315181Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25 kind= uid=c7f0a572-9a75-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:12:09.418279Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25" level=info timestamp=2018-08-07T19:12:09.464265Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25" level=info timestamp=2018-08-07T19:15:09.871929Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c7f0a572-9a75-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25" level=info timestamp=2018-08-07T19:15:10.142230Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j kind= uid=33b4177a-9a76-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:15:10.142719Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j kind= uid=33b4177a-9a76-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:15:10.259205Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j" level=info timestamp=2018-08-07T19:18:10.725859Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 33b4177a-9a76-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j" level=info timestamp=2018-08-07T19:18:10.947059Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid4jsth4ltl458h56jg7xgr5ndn89pm5jzt7p6f9jdq8g87r4bp2m9wsjkwsczjf kind= uid=9f78f0c9-9a76-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:18:10.947770Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid4jsth4ltl458h56jg7xgr5ndn89pm5jzt7p6f9jdq8g87r4bp2m9wsjkwsczjf kind= uid=9f78f0c9-9a76-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:18:11.068124Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid4jsth4ltl458h56jg7xgr5ndn89pm5jzt7p6f9jdq8g87r4bp2m9wsjkwsczjf\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid4jsth4ltl458h56jg7xgr5ndn89pm5jzt7p6f9jdq8g87r4bp2m9wsjkwsczjf" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmid4jsth4ltl458h56jg7xgr5ndn89pm5jzt7p6s45l7 Pod phase: Pending level=info timestamp=2018-08-07T19:18:15.210822Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:18:15.211070Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:18:15.213032Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:18:27.793558Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:18:27.844907Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmid4jsth4ltl458h56jg7xgr5ndn89pm5jzt7p6f9jdq8g87r4bp2m9wsjkwsczjf" level=info timestamp=2018-08-07T19:18:27.847689Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:18:27.848146Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [180.750 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 with CPU spec /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:294 when CPU model not defined [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:392 should report CPU model from libvirt capabilities /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:393 Timed out after 90.013s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:18:11.043626Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmid4jsth4ltl458h56jg7xgr5ndn89pm5jzt7p6f9jdq8g87r4bp2m9wsjkwsczjf kind=VirtualMachineInstance uid=9f78f0c9-9a76-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmid4jsth4ltl458h56jg7xgr5ndn89pm5jzt7p6s45l7" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running level=info timestamp=2018-08-07T19:23:29.732754Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:23:31 http: TLS handshake error from 10.244.1.1:45538: EOF level=info timestamp=2018-08-07T19:23:41.049268Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:23:41.084182Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:23:41.549074Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:23:41.551501Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:23:41 http: TLS handshake error from 10.244.1.1:45544: EOF 2018/08/07 19:23:51 http: TLS handshake error from 10.244.1.1:45550: EOF level=info timestamp=2018-08-07T19:23:59.855903Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:24:01 http: TLS handshake error from 10.244.1.1:45556: EOF level=info timestamp=2018-08-07T19:24:11.099069Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:24:11.145885Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:24:11.534460Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:24:11.723119Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:24:11 http: TLS handshake error from 10.244.1.1:45562: EOF Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 19:21:43 http: TLS handshake error from 10.244.0.1:36412: EOF 2018/08/07 19:21:53 http: TLS handshake error from 10.244.0.1:36472: EOF 2018/08/07 19:22:03 http: TLS handshake error from 10.244.0.1:36532: EOF 2018/08/07 19:22:13 http: TLS handshake error from 10.244.0.1:36592: EOF 2018/08/07 19:22:23 http: TLS handshake error from 10.244.0.1:36652: EOF 2018/08/07 19:22:33 http: TLS handshake error from 10.244.0.1:36712: EOF 2018/08/07 19:22:43 http: TLS handshake error from 10.244.0.1:36772: EOF 2018/08/07 19:22:53 http: TLS handshake error from 10.244.0.1:36832: EOF 2018/08/07 19:23:03 http: TLS handshake error from 10.244.0.1:36892: EOF 2018/08/07 19:23:13 http: TLS handshake error from 10.244.0.1:36952: EOF 2018/08/07 19:23:23 http: TLS handshake error from 10.244.0.1:37012: EOF 2018/08/07 19:23:33 http: TLS handshake error from 10.244.0.1:37072: EOF 2018/08/07 19:23:43 http: TLS handshake error from 10.244.0.1:37132: EOF 2018/08/07 19:23:53 http: TLS handshake error from 10.244.0.1:37192: EOF 2018/08/07 19:24:03 http: TLS handshake error from 10.244.0.1:37252: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T19:12:09.315181Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25 kind= uid=c7f0a572-9a75-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:12:09.418279Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25" level=info timestamp=2018-08-07T19:12:09.464265Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25" level=info timestamp=2018-08-07T19:15:09.871929Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c7f0a572-9a75-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmix66h62mnjnslkbvlnrhbbz78mvwn2sgnzvj7rfx78bc447l5lk4kvkvzp8cvr25" level=info timestamp=2018-08-07T19:15:10.142230Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j kind= uid=33b4177a-9a76-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:15:10.142719Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j kind= uid=33b4177a-9a76-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:15:10.259205Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j" level=info timestamp=2018-08-07T19:18:10.725859Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 33b4177a-9a76-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib9nf9fr8wt8kq2dwn5qjnl26f9x46g9s29xw986bkrj7ppzrzk8wvs2k6gqvc8j" level=info timestamp=2018-08-07T19:18:10.947059Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid4jsth4ltl458h56jg7xgr5ndn89pm5jzt7p6f9jdq8g87r4bp2m9wsjkwsczjf kind= uid=9f78f0c9-9a76-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:18:10.947770Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid4jsth4ltl458h56jg7xgr5ndn89pm5jzt7p6f9jdq8g87r4bp2m9wsjkwsczjf kind= uid=9f78f0c9-9a76-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:18:11.068124Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid4jsth4ltl458h56jg7xgr5ndn89pm5jzt7p6f9jdq8g87r4bp2m9wsjkwsczjf\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid4jsth4ltl458h56jg7xgr5ndn89pm5jzt7p6f9jdq8g87r4bp2m9wsjkwsczjf" level=info timestamp=2018-08-07T19:21:11.523208Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid4jsth4ltl458h56jg7xgr5ndn89pm5jzt7p6f9jdq8g87r4bp2m9wsjkwsczjf\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmid4jsth4ltl458h56jg7xgr5ndn89pm5jzt7p6f9jdq8g87r4bp2m9wsjkwsczjf, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9f78f0c9-9a76-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid4jsth4ltl458h56jg7xgr5ndn89pm5jzt7p6f9jdq8g87r4bp2m9wsjkwsczjf" level=info timestamp=2018-08-07T19:21:11.774505Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6bkg6924rqvx4gpmhdq9pw9nkkcx6r8kh8s8ls4ppc6lvwpkhbl4qdmqwg4brjn kind= uid=0b40bb60-9a77-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:21:11.775044Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6bkg6924rqvx4gpmhdq9pw9nkkcx6r8kh8s8ls4ppc6lvwpkhbl4qdmqwg4brjn kind= uid=0b40bb60-9a77-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:21:11.918913Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi6bkg6924rqvx4gpmhdq9pw9nkkcx6r8kh8s8ls4ppc6lvwpkhbl4qdmqwg4brjn\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi6bkg6924rqvx4gpmhdq9pw9nkkcx6r8kh8s8ls4ppc6lvwpkhbl4qdmqwg4brjn" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmi6bkg6924rqvx4gpmhdq9pw9nkkcx6r8kh8s8lc5g6v Pod phase: Pending level=info timestamp=2018-08-07T19:21:15.948607Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:21:15.948863Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:21:15.950971Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:21:27.228812Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:21:27.312154Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi6bkg6924rqvx4gpmhdq9pw9nkkcx6r8kh8s8ls4ppc6lvwpkhbl4qdmqwg4brjn" level=info timestamp=2018-08-07T19:21:27.314198Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:21:27.314732Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.844 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 New VirtualMachineInstance with all supported drives /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:413 should have all the device nodes [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:436 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:21:11.821441Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi6bkg6924rqvx4gpmhdq9pw9nkkcx6r8kh8s8ls4ppc6lvwpkhbl4qdmqwg4brjn kind=VirtualMachineInstance uid=0b40bb60-9a77-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi6bkg6924rqvx4gpmhdq9pw9nkkcx6r8kh8s8lc5g6v" • Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running level=info timestamp=2018-08-07T19:26:30.433431Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:26:31 http: TLS handshake error from 10.244.1.1:45646: EOF level=info timestamp=2018-08-07T19:26:41.460464Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:26:41.515275Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:26:41.523747Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:26:41 http: TLS handshake error from 10.244.1.1:45652: EOF level=info timestamp=2018-08-07T19:26:42.582120Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:26:51 http: TLS handshake error from 10.244.1.1:45658: EOF level=info timestamp=2018-08-07T19:27:00.555080Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:27:01 http: TLS handshake error from 10.244.1.1:45664: EOF level=info timestamp=2018-08-07T19:27:11.495844Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:27:11.534170Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:27:11.605915Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:27:11 http: TLS handshake error from 10.244.1.1:45670: EOF level=info timestamp=2018-08-07T19:27:12.744820Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 19:24:43 http: TLS handshake error from 10.244.0.1:37492: EOF 2018/08/07 19:24:53 http: TLS handshake error from 10.244.0.1:37552: EOF 2018/08/07 19:25:03 http: TLS handshake error from 10.244.0.1:37612: EOF 2018/08/07 19:25:13 http: TLS handshake error from 10.244.0.1:37672: EOF 2018/08/07 19:25:23 http: TLS handshake error from 10.244.0.1:37732: EOF 2018/08/07 19:25:33 http: TLS handshake error from 10.244.0.1:37792: EOF 2018/08/07 19:25:43 http: TLS handshake error from 10.244.0.1:37852: EOF 2018/08/07 19:25:53 http: TLS handshake error from 10.244.0.1:37912: EOF 2018/08/07 19:26:03 http: TLS handshake error from 10.244.0.1:37972: EOF 2018/08/07 19:26:13 http: TLS handshake error from 10.244.0.1:38032: EOF 2018/08/07 19:26:23 http: TLS handshake error from 10.244.0.1:38092: EOF 2018/08/07 19:26:33 http: TLS handshake error from 10.244.0.1:38152: EOF 2018/08/07 19:26:43 http: TLS handshake error from 10.244.0.1:38212: EOF 2018/08/07 19:26:53 http: TLS handshake error from 10.244.0.1:38272: EOF 2018/08/07 19:27:03 http: TLS handshake error from 10.244.0.1:38332: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T19:21:11.774505Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6bkg6924rqvx4gpmhdq9pw9nkkcx6r8kh8s8ls4ppc6lvwpkhbl4qdmqwg4brjn kind= uid=0b40bb60-9a77-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:21:11.775044Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6bkg6924rqvx4gpmhdq9pw9nkkcx6r8kh8s8ls4ppc6lvwpkhbl4qdmqwg4brjn kind= uid=0b40bb60-9a77-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:21:11.918913Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi6bkg6924rqvx4gpmhdq9pw9nkkcx6r8kh8s8ls4ppc6lvwpkhbl4qdmqwg4brjn\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi6bkg6924rqvx4gpmhdq9pw9nkkcx6r8kh8s8ls4ppc6lvwpkhbl4qdmqwg4brjn" level=info timestamp=2018-08-07T19:24:12.345427Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi6bkg6924rqvx4gpmhdq9pw9nkkcx6r8kh8s8ls4ppc6lvwpkhbl4qdmqwg4brjn\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi6bkg6924rqvx4gpmhdq9pw9nkkcx6r8kh8s8ls4ppc6lvwpkhbl4qdmqwg4brjn, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0b40bb60-9a77-11e8-bcdf-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi6bkg6924rqvx4gpmhdq9pw9nkkcx6r8kh8s8ls4ppc6lvwpkhbl4qdmqwg4brjn" level=info timestamp=2018-08-07T19:24:12.712677Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifd2brpndbd8zqs77smkw4tb59tvnvvf5phzkxhl2xrv5h6tfn7tpgrfg59b8v2j kind= uid=771a30ca-9a77-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:24:12.713501Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifd2brpndbd8zqs77smkw4tb59tvnvvf5phzkxhl2xrv5h6tfn7tpgrfg59b8v2j kind= uid=771a30ca-9a77-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:24:12.735286Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilwkl6sx6cdnnvr5gtvxjjhg5jthlwqd4lhzd2k6sqzfzrgwqrvn86vt8jjbwbt8 kind= uid=7721c554-9a77-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:24:12.735826Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilwkl6sx6cdnnvr5gtvxjjhg5jthlwqd4lhzd2k6sqzfzrgwqrvn86vt8jjbwbt8 kind= uid=7721c554-9a77-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:24:12.767861Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid49lv2dxgjhhfh4xcdjmc77kvbz8ml7xvbdtfvq9pw5g5h6fkpwfw78lpxg2cb7 kind= uid=7725bb18-9a77-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:24:12.768276Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid49lv2dxgjhhfh4xcdjmc77kvbz8ml7xvbdtfvq9pw5g5h6fkpwfw78lpxg2cb7 kind= uid=7725bb18-9a77-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:24:12.848266Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz8wrrvhx2jrkx8sqmkt89n6v7w4tsn5lbz8jpz89nq7fkxgmclj6n8x4ghn79nx kind= uid=772acebe-9a77-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:24:12.848555Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz8wrrvhx2jrkx8sqmkt89n6v7w4tsn5lbz8jpz89nq7fkxgmclj6n8x4ghn79nx kind= uid=772acebe-9a77-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:24:12.893635Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilwkl6sx6cdnnvr5gtvxjjhg5jthlwqd4lhzd2k6sqzfzrgwqrvn86vt8jjbwbt8\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmilwkl6sx6cdnnvr5gtvxjjhg5jthlwqd4lhzd2k6sqzfzrgwqrvn86vt8jjbwbt8" level=info timestamp=2018-08-07T19:24:13.328604Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilwkl6sx6cdnnvr5gtvxjjhg5jthlwqd4lhzd2k6sqzfzrgwqrvn86vt8jjbwbt8\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmilwkl6sx6cdnnvr5gtvxjjhg5jthlwqd4lhzd2k6sqzfzrgwqrvn86vt8jjbwbt8" level=info timestamp=2018-08-07T19:24:13.526498Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz8wrrvhx2jrkx8sqmkt89n6v7w4tsn5lbz8jpz89nq7fkxgmclj6n8x4ghn79nx\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiz8wrrvhx2jrkx8sqmkt89n6v7w4tsn5lbz8jpz89nq7fkxgmclj6n8x4ghn79nx" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmid49lv2dxgjhhfh4xcdjmc77kvbz8ml7xvbdtf444vm Pod phase: Pending level=info timestamp=2018-08-07T19:24:17.746881Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:24:17.747002Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:24:17.749122Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:24:27.757019Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:24:27.828511Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmid49lv2dxgjhhfh4xcdjmc77kvbz8ml7xvbdtfvq9pw5g5h6fkpwfw78lpxg2cb7" level=info timestamp=2018-08-07T19:24:27.830210Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:24:27.830933Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmifd2brpndbd8zqs77smkw4tb59tvnvvf5phzkxkbvsj Pod phase: Pending level=info timestamp=2018-08-07T19:24:17.336192Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:24:17.336328Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:24:17.338276Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:24:27.345608Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:24:27.426923Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmifd2brpndbd8zqs77smkw4tb59tvnvvf5phzkxhl2xrv5h6tfn7tpgrfg59b8v2j" level=info timestamp=2018-08-07T19:24:27.428802Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:24:27.430012Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmilwkl6sx6cdnnvr5gtvxjjhg5jthlwqd4lhzd2hsv6d Pod phase: Pending level=info timestamp=2018-08-07T19:24:16.678107Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:24:16.684304Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:24:16.686615Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:24:26.693897Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:24:26.787087Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmilwkl6sx6cdnnvr5gtvxjjhg5jthlwqd4lhzd2k6sqzfzrgwqrvn86vt8jjbwbt8" level=info timestamp=2018-08-07T19:24:26.789655Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:24:26.790137Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmiz8wrrvhx2jrkx8sqmkt89n6v7w4tsn5lbz8jpkzwl7 Pod phase: Pending level=info timestamp=2018-08-07T19:24:16.671412Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:24:16.672832Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:24:16.675326Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:24:26.685456Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:24:26.792440Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiz8wrrvhx2jrkx8sqmkt89n6v7w4tsn5lbz8jpz89nq7fkxgmclj6n8x4ghn79nx" level=info timestamp=2018-08-07T19:24:26.794060Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:24:26.794585Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure in Spec Setup (BeforeEach) [181.285 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be able to reach [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 the Inbound VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:24:12.903246Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmifd2brpndbd8zqs77smkw4tb59tvnvvf5phzkxhl2xrv5h6tfn7tpgrfg59b8v2j kind=VirtualMachineInstance uid=771a30ca-9a77-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmifd2brpndbd8zqs77smkw4tb59tvnvvf5phzkxkbvsj" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running level=info timestamp=2018-08-07T19:29:31.099796Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:29:31 http: TLS handshake error from 10.244.1.1:45754: EOF level=info timestamp=2018-08-07T19:29:41.571144Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:29:41 http: TLS handshake error from 10.244.1.1:45760: EOF level=info timestamp=2018-08-07T19:29:41.880477Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:29:41.925241Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:29:43.562549Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:29:51 http: TLS handshake error from 10.244.1.1:45766: EOF level=info timestamp=2018-08-07T19:30:01.211986Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:30:01 http: TLS handshake error from 10.244.1.1:45772: EOF level=info timestamp=2018-08-07T19:30:11.598757Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:30:11 http: TLS handshake error from 10.244.1.1:45778: EOF level=info timestamp=2018-08-07T19:30:11.944311Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:30:11.989662Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:30:13.722036Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 19:27:53 http: TLS handshake error from 10.244.0.1:38632: EOF 2018/08/07 19:28:03 http: TLS handshake error from 10.244.0.1:38692: EOF 2018/08/07 19:28:13 http: TLS handshake error from 10.244.0.1:38752: EOF 2018/08/07 19:28:23 http: TLS handshake error from 10.244.0.1:38812: EOF 2018/08/07 19:28:33 http: TLS handshake error from 10.244.0.1:38872: EOF 2018/08/07 19:28:43 http: TLS handshake error from 10.244.0.1:38932: EOF 2018/08/07 19:28:53 http: TLS handshake error from 10.244.0.1:38992: EOF 2018/08/07 19:29:03 http: TLS handshake error from 10.244.0.1:39052: EOF 2018/08/07 19:29:13 http: TLS handshake error from 10.244.0.1:39112: EOF 2018/08/07 19:29:23 http: TLS handshake error from 10.244.0.1:39172: EOF 2018/08/07 19:29:33 http: TLS handshake error from 10.244.0.1:39232: EOF 2018/08/07 19:29:43 http: TLS handshake error from 10.244.0.1:39292: EOF 2018/08/07 19:29:53 http: TLS handshake error from 10.244.0.1:39352: EOF 2018/08/07 19:30:03 http: TLS handshake error from 10.244.0.1:39412: EOF 2018/08/07 19:30:13 http: TLS handshake error from 10.244.0.1:39472: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T19:24:12.848555Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz8wrrvhx2jrkx8sqmkt89n6v7w4tsn5lbz8jpz89nq7fkxgmclj6n8x4ghn79nx kind= uid=772acebe-9a77-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:24:12.893635Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilwkl6sx6cdnnvr5gtvxjjhg5jthlwqd4lhzd2k6sqzfzrgwqrvn86vt8jjbwbt8\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmilwkl6sx6cdnnvr5gtvxjjhg5jthlwqd4lhzd2k6sqzfzrgwqrvn86vt8jjbwbt8" level=info timestamp=2018-08-07T19:24:13.328604Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilwkl6sx6cdnnvr5gtvxjjhg5jthlwqd4lhzd2k6sqzfzrgwqrvn86vt8jjbwbt8\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmilwkl6sx6cdnnvr5gtvxjjhg5jthlwqd4lhzd2k6sqzfzrgwqrvn86vt8jjbwbt8" level=info timestamp=2018-08-07T19:24:13.526498Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz8wrrvhx2jrkx8sqmkt89n6v7w4tsn5lbz8jpz89nq7fkxgmclj6n8x4ghn79nx\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiz8wrrvhx2jrkx8sqmkt89n6v7w4tsn5lbz8jpz89nq7fkxgmclj6n8x4ghn79nx" level=info timestamp=2018-08-07T19:27:14.655538Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiff7rmd7dsr4nj5xf75p6qhz9d4wl8gdnd22d48xjcptkxlbzcr4xstwzfzf8wmw kind= uid=e38dd1f2-9a77-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:27:14.658662Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiff7rmd7dsr4nj5xf75p6qhz9d4wl8gdnd22d48xjcptkxlbzcr4xstwzfzf8wmw kind= uid=e38dd1f2-9a77-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:27:14.691603Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmic2sc8nbf89r6zdgzw8ftrgfhjm9smghgwrd5qk68bqnxghmbjqw62g72bbh6r26 kind= uid=e3950acc-9a77-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:27:14.691965Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmic2sc8nbf89r6zdgzw8ftrgfhjm9smghgwrd5qk68bqnxghmbjqw62g72bbh6r26 kind= uid=e3950acc-9a77-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:27:14.723741Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicbxjtpzqdd8l4xbj9xcx4ktgt7wtbqkkhv4w46znb5vdlrppzqx7l2k4kbvjpfg kind= uid=e399deca-9a77-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:27:14.724096Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicbxjtpzqdd8l4xbj9xcx4ktgt7wtbqkkhv4w46znb5vdlrppzqx7l2k4kbvjpfg kind= uid=e399deca-9a77-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:27:14.787872Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi96p89h4p644rzgffxfqhdz472hg9cqssdcg47nhcqvv4h9klffqt9gq494d56wf kind= uid=e39e2132-9a77-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:27:14.788138Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi96p89h4p644rzgffxfqhdz472hg9cqssdcg47nhcqvv4h9klffqt9gq494d56wf kind= uid=e39e2132-9a77-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:27:14.876503Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmic2sc8nbf89r6zdgzw8ftrgfhjm9smghgwrd5qk68bqnxghmbjqw62g72bbh6r26\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmic2sc8nbf89r6zdgzw8ftrgfhjm9smghgwrd5qk68bqnxghmbjqw62g72bbh6r26" level=info timestamp=2018-08-07T19:27:15.101019Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmic2sc8nbf89r6zdgzw8ftrgfhjm9smghgwrd5qk68bqnxghmbjqw62g72bbh6r26\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmic2sc8nbf89r6zdgzw8ftrgfhjm9smghgwrd5qk68bqnxghmbjqw62g72bbh6r26" level=info timestamp=2018-08-07T19:27:15.703351Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi96p89h4p644rzgffxfqhdz472hg9cqssdcg47nhcqvv4h9klffqt9gq494d56wf\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi96p89h4p644rzgffxfqhdz472hg9cqssdcg47nhcqvv4h9klffqt9gq494d56wf" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmi96p89h4p644rzgffxfqhdz472hg9cqssdcg47tnp56 Pod phase: Pending level=info timestamp=2018-08-07T19:27:18.608911Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:27:18.609174Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:27:18.611118Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:27:30.611037Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:27:30.697922Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi96p89h4p644rzgffxfqhdz472hg9cqssdcg47nhcqvv4h9klffqt9gq494d56wf" level=info timestamp=2018-08-07T19:27:30.700552Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:27:30.701011Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmic2sc8nbf89r6zdgzw8ftrgfhjm9smghgwrd5ql9m56 Pod phase: Pending level=info timestamp=2018-08-07T19:27:19.529585Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:27:19.529881Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:27:19.535205Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:27:29.544105Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:27:29.637944Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmic2sc8nbf89r6zdgzw8ftrgfhjm9smghgwrd5qk68bqnxghmbjqw62g72bbh6r26" level=info timestamp=2018-08-07T19:27:29.639511Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:27:29.639973Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmicbxjtpzqdd8l4xbj9xcx4ktgt7wtbqkkhv4w4bht77 Pod phase: Pending level=info timestamp=2018-08-07T19:27:18.765169Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:27:18.766161Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:27:18.768266Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:27:28.775973Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:27:28.840546Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmicbxjtpzqdd8l4xbj9xcx4ktgt7wtbqkkhv4w46znb5vdlrppzqx7l2k4kbvjpfg" level=info timestamp=2018-08-07T19:27:28.842502Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:27:28.842998Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmiff7rmd7dsr4nj5xf75p6qhz9d4wl8gdnd22d4rqz4n Pod phase: Pending level=info timestamp=2018-08-07T19:27:18.452411Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:27:18.452990Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:27:18.455479Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:27:28.464187Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:27:28.537207Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiff7rmd7dsr4nj5xf75p6qhz9d4wl8gdnd22d48xjcptkxlbzcr4xstwzfzf8wmw" level=info timestamp=2018-08-07T19:27:28.539452Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:27:28.539900Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [181.904 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be able to reach [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 the Inbound VirtualMachineInstance with pod network connectivity explicitly set /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:27:14.807917Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmiff7rmd7dsr4nj5xf75p6qhz9d4wl8gdnd22d48xjcptkxlbzcr4xstwzfzf8wmw kind=VirtualMachineInstance uid=e38dd1f2-9a77-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmiff7rmd7dsr4nj5xf75p6qhz9d4wl8gdnd22d4rqz4n" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running 2018/08/07 19:32:31 http: TLS handshake error from 10.244.1.1:45862: EOF level=info timestamp=2018-08-07T19:32:31.778079Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:32:41.577896Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:32:41 http: TLS handshake error from 10.244.1.1:45868: EOF level=info timestamp=2018-08-07T19:32:42.283419Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:32:42.326906Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:32:44.506317Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:32:51 http: TLS handshake error from 10.244.1.1:45874: EOF 2018/08/07 19:33:01 http: TLS handshake error from 10.244.1.1:45880: EOF level=info timestamp=2018-08-07T19:33:01.881580Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:33:11.572494Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:33:11 http: TLS handshake error from 10.244.1.1:45886: EOF level=info timestamp=2018-08-07T19:33:12.339902Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:33:12.419551Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:33:14.673503Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 19:30:53 http: TLS handshake error from 10.244.0.1:39712: EOF 2018/08/07 19:31:03 http: TLS handshake error from 10.244.0.1:39772: EOF 2018/08/07 19:31:13 http: TLS handshake error from 10.244.0.1:39832: EOF 2018/08/07 19:31:23 http: TLS handshake error from 10.244.0.1:39892: EOF 2018/08/07 19:31:33 http: TLS handshake error from 10.244.0.1:39952: EOF 2018/08/07 19:31:43 http: TLS handshake error from 10.244.0.1:40012: EOF 2018/08/07 19:31:53 http: TLS handshake error from 10.244.0.1:40072: EOF 2018/08/07 19:32:03 http: TLS handshake error from 10.244.0.1:40132: EOF 2018/08/07 19:32:13 http: TLS handshake error from 10.244.0.1:40192: EOF 2018/08/07 19:32:23 http: TLS handshake error from 10.244.0.1:40252: EOF 2018/08/07 19:32:33 http: TLS handshake error from 10.244.0.1:40312: EOF 2018/08/07 19:32:43 http: TLS handshake error from 10.244.0.1:40372: EOF 2018/08/07 19:32:53 http: TLS handshake error from 10.244.0.1:40432: EOF 2018/08/07 19:33:03 http: TLS handshake error from 10.244.0.1:40492: EOF 2018/08/07 19:33:13 http: TLS handshake error from 10.244.0.1:40552: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T19:27:14.724096Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicbxjtpzqdd8l4xbj9xcx4ktgt7wtbqkkhv4w46znb5vdlrppzqx7l2k4kbvjpfg kind= uid=e399deca-9a77-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:27:14.787872Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi96p89h4p644rzgffxfqhdz472hg9cqssdcg47nhcqvv4h9klffqt9gq494d56wf kind= uid=e39e2132-9a77-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:27:14.788138Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi96p89h4p644rzgffxfqhdz472hg9cqssdcg47nhcqvv4h9klffqt9gq494d56wf kind= uid=e39e2132-9a77-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:27:14.876503Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmic2sc8nbf89r6zdgzw8ftrgfhjm9smghgwrd5qk68bqnxghmbjqw62g72bbh6r26\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmic2sc8nbf89r6zdgzw8ftrgfhjm9smghgwrd5qk68bqnxghmbjqw62g72bbh6r26" level=info timestamp=2018-08-07T19:27:15.101019Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmic2sc8nbf89r6zdgzw8ftrgfhjm9smghgwrd5qk68bqnxghmbjqw62g72bbh6r26\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmic2sc8nbf89r6zdgzw8ftrgfhjm9smghgwrd5qk68bqnxghmbjqw62g72bbh6r26" level=info timestamp=2018-08-07T19:27:15.703351Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi96p89h4p644rzgffxfqhdz472hg9cqssdcg47nhcqvv4h9klffqt9gq494d56wf\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi96p89h4p644rzgffxfqhdz472hg9cqssdcg47nhcqvv4h9klffqt9gq494d56wf" level=info timestamp=2018-08-07T19:30:16.590522Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih47drcxtpchckrvkdnfxhlqrxn89pht2kdh6dv77txtjdk2rc27pmx5lcpl25hz kind= uid=4ffe8774-9a78-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:30:16.595255Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih47drcxtpchckrvkdnfxhlqrxn89pht2kdh6dv77txtjdk2rc27pmx5lcpl25hz kind= uid=4ffe8774-9a78-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:30:16.621184Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiscrgpq27wlqcc6dqrr7qp9xzcln8p4dhfzf88bbkhgdqz4566vsj8gf6bglkwkp kind= uid=50052747-9a78-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:30:16.621621Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiscrgpq27wlqcc6dqrr7qp9xzcln8p4dhfzf88bbkhgdqz4566vsj8gf6bglkwkp kind= uid=50052747-9a78-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:30:16.662581Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9sc9xj25hbrr2sn5z795b2wqzcvdtrmjzkbqbrzgq22h7ksxz99g2mnsgfs9k7b kind= uid=500b811a-9a78-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:30:16.663009Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9sc9xj25hbrr2sn5z795b2wqzcvdtrmjzkbqbrzgq22h7ksxz99g2mnsgfs9k7b kind= uid=500b811a-9a78-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:30:16.738156Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimfltzpxnbg9v5xz46qqhq88q49rwsmzkjcrswrl4kchp52jb2nd5wg9f5dk2zs8 kind= uid=5010d698-9a78-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:30:16.738516Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimfltzpxnbg9v5xz46qqhq88q49rwsmzkjcrswrl4kchp52jb2nd5wg9f5dk2zs8 kind= uid=5010d698-9a78-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:30:17.026625Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimfltzpxnbg9v5xz46qqhq88q49rwsmzkjcrswrl4kchp52jb2nd5wg9f5dk2zs8\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimfltzpxnbg9v5xz46qqhq88q49rwsmzkjcrswrl4kchp52jb2nd5wg9f5dk2zs8" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmi9sc9xj25hbrr2sn5z795b2wqzcvdtrmjzkbqb5mqfq Pod phase: Pending level=info timestamp=2018-08-07T19:30:21.005886Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:30:21.006581Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:30:21.009218Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:30:31.016646Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:30:31.066725Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi9sc9xj25hbrr2sn5z795b2wqzcvdtrmjzkbqbrzgq22h7ksxz99g2mnsgfs9k7b" level=info timestamp=2018-08-07T19:30:31.069003Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:30:31.069577Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmih47drcxtpchckrvkdnfxhlqrxn89pht2kdh6dsbjqz Pod phase: Pending level=info timestamp=2018-08-07T19:30:20.250982Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:30:20.253106Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:30:20.254700Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:30:30.262549Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:30:30.313850Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmih47drcxtpchckrvkdnfxhlqrxn89pht2kdh6dv77txtjdk2rc27pmx5lcpl25hz" level=info timestamp=2018-08-07T19:30:30.315837Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:30:30.316328Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmimfltzpxnbg9v5xz46qqhq88q49rwsmzkjcrswzjb9c Pod phase: Pending level=info timestamp=2018-08-07T19:30:21.443886Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:30:21.444064Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:30:21.446464Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:30:31.454191Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:30:31.545518Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmimfltzpxnbg9v5xz46qqhq88q49rwsmzkjcrswrl4kchp52jb2nd5wg9f5dk2zs8" level=info timestamp=2018-08-07T19:30:31.547772Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:30:31.548976Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmiscrgpq27wlqcc6dqrr7qp9xzcln8p4dhfzf88vlqq7 Pod phase: Pending level=info timestamp=2018-08-07T19:30:20.760359Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:30:20.762716Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:30:20.769543Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:30:30.777227Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:30:30.859059Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiscrgpq27wlqcc6dqrr7qp9xzcln8p4dhfzf88bbkhgdqz4566vsj8gf6bglkwkp" level=info timestamp=2018-08-07T19:30:30.860796Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:30:30.861231Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [182.010 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be able to reach [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 the Inbound VirtualMachineInstance with custom MAC address /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:30:16.777905Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmih47drcxtpchckrvkdnfxhlqrxn89pht2kdh6dv77txtjdk2rc27pmx5lcpl25hz kind=VirtualMachineInstance uid=4ffe8774-9a78-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmih47drcxtpchckrvkdnfxhlqrxn89pht2kdh6dsbjqz" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running 2018/08/07 19:35:31 http: TLS handshake error from 10.244.1.1:45970: EOF level=info timestamp=2018-08-07T19:35:32.405665Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:35:41.596745Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:35:41 http: TLS handshake error from 10.244.1.1:45976: EOF level=info timestamp=2018-08-07T19:35:42.708083Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:35:42.754908Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:35:45.462429Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:35:51 http: TLS handshake error from 10.244.1.1:45982: EOF 2018/08/07 19:36:01 http: TLS handshake error from 10.244.1.1:45988: EOF level=info timestamp=2018-08-07T19:36:02.510813Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:36:11.540483Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:36:11 http: TLS handshake error from 10.244.1.1:45994: EOF level=info timestamp=2018-08-07T19:36:12.777605Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:36:12.825880Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:36:15.604831Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 19:33:53 http: TLS handshake error from 10.244.0.1:40792: EOF 2018/08/07 19:34:03 http: TLS handshake error from 10.244.0.1:40852: EOF 2018/08/07 19:34:13 http: TLS handshake error from 10.244.0.1:40912: EOF 2018/08/07 19:34:23 http: TLS handshake error from 10.244.0.1:40972: EOF 2018/08/07 19:34:33 http: TLS handshake error from 10.244.0.1:41032: EOF 2018/08/07 19:34:43 http: TLS handshake error from 10.244.0.1:41092: EOF 2018/08/07 19:34:53 http: TLS handshake error from 10.244.0.1:41152: EOF 2018/08/07 19:35:03 http: TLS handshake error from 10.244.0.1:41212: EOF 2018/08/07 19:35:13 http: TLS handshake error from 10.244.0.1:41272: EOF 2018/08/07 19:35:23 http: TLS handshake error from 10.244.0.1:41332: EOF 2018/08/07 19:35:33 http: TLS handshake error from 10.244.0.1:41392: EOF 2018/08/07 19:35:43 http: TLS handshake error from 10.244.0.1:41452: EOF 2018/08/07 19:35:53 http: TLS handshake error from 10.244.0.1:41512: EOF 2018/08/07 19:36:03 http: TLS handshake error from 10.244.0.1:41572: EOF 2018/08/07 19:36:13 http: TLS handshake error from 10.244.0.1:41632: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T19:30:16.663009Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9sc9xj25hbrr2sn5z795b2wqzcvdtrmjzkbqbrzgq22h7ksxz99g2mnsgfs9k7b kind= uid=500b811a-9a78-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:30:16.738156Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimfltzpxnbg9v5xz46qqhq88q49rwsmzkjcrswrl4kchp52jb2nd5wg9f5dk2zs8 kind= uid=5010d698-9a78-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:30:16.738516Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimfltzpxnbg9v5xz46qqhq88q49rwsmzkjcrswrl4kchp52jb2nd5wg9f5dk2zs8 kind= uid=5010d698-9a78-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:30:17.026625Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimfltzpxnbg9v5xz46qqhq88q49rwsmzkjcrswrl4kchp52jb2nd5wg9f5dk2zs8\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimfltzpxnbg9v5xz46qqhq88q49rwsmzkjcrswrl4kchp52jb2nd5wg9f5dk2zs8" level=info timestamp=2018-08-07T19:33:18.600822Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim8slh5khwqhjksfbqlt7m2fmk5f6bxgz4mc789qm5f6zvbqxkdsm4g798kbdl7w kind= uid=bc7ad71f-9a78-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:33:18.604589Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim8slh5khwqhjksfbqlt7m2fmk5f6bxgz4mc789qm5f6zvbqxkdsm4g798kbdl7w kind= uid=bc7ad71f-9a78-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:33:18.620866Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivqvn8cxtk5h6bdtgdmfbzjw2t2zrskxxvn4g5hwwddv4l9cb6rwrq7lm4nqqgq2 kind= uid=bc816daf-9a78-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:33:18.621431Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivqvn8cxtk5h6bdtgdmfbzjw2t2zrskxxvn4g5hwwddv4l9cb6rwrq7lm4nqqgq2 kind= uid=bc816daf-9a78-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:33:18.665129Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilrc668kxxnfl87wgncxwjt4mkjcchknr82fbzqnj4gzp7phkb85sbk4qt945j46 kind= uid=bc856ed2-9a78-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:33:18.665518Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilrc668kxxnfl87wgncxwjt4mkjcchknr82fbzqnj4gzp7phkb85sbk4qt945j46 kind= uid=bc856ed2-9a78-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:33:18.719642Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikzjbfnq5fpdzf9plwhmrk8mspx2fd8j5ckh6szwvddv7wf87pjgbwwjtccsgmcz kind= uid=bc8ba286-9a78-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:33:18.720028Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikzjbfnq5fpdzf9plwhmrk8mspx2fd8j5ckh6szwvddv7wf87pjgbwwjtccsgmcz kind= uid=bc8ba286-9a78-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:33:18.792549Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmim8slh5khwqhjksfbqlt7m2fmk5f6bxgz4mc789qm5f6zvbqxkdsm4g798kbdl7w\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmim8slh5khwqhjksfbqlt7m2fmk5f6bxgz4mc789qm5f6zvbqxkdsm4g798kbdl7w" level=info timestamp=2018-08-07T19:33:18.796693Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivqvn8cxtk5h6bdtgdmfbzjw2t2zrskxxvn4g5hwwddv4l9cb6rwrq7lm4nqqgq2\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivqvn8cxtk5h6bdtgdmfbzjw2t2zrskxxvn4g5hwwddv4l9cb6rwrq7lm4nqqgq2" level=info timestamp=2018-08-07T19:33:19.488479Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivqvn8cxtk5h6bdtgdmfbzjw2t2zrskxxvn4g5hwwddv4l9cb6rwrq7lm4nqqgq2\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivqvn8cxtk5h6bdtgdmfbzjw2t2zrskxxvn4g5hwwddv4l9cb6rwrq7lm4nqqgq2" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmikzjbfnq5fpdzf9plwhmrk8mspx2fd8j5ckh6svt7bq Pod phase: Pending level=info timestamp=2018-08-07T19:33:23.525227Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:33:23.525857Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:33:23.529889Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:33:36.181392Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:33:36.290782Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmikzjbfnq5fpdzf9plwhmrk8mspx2fd8j5ckh6szwvddv7wf87pjgbwwjtccsgmcz" level=info timestamp=2018-08-07T19:33:36.293998Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:33:36.294533Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmilrc668kxxnfl87wgncxwjt4mkjcchknr82fbz4df4n Pod phase: Pending level=info timestamp=2018-08-07T19:33:23.046039Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:33:23.046159Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:33:23.048604Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:33:33.055912Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:33:33.137289Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmilrc668kxxnfl87wgncxwjt4mkjcchknr82fbzqnj4gzp7phkb85sbk4qt945j46" level=info timestamp=2018-08-07T19:33:33.139202Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:33:33.139686Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmim8slh5khwqhjksfbqlt7m2fmk5f6bxgz4mc78kzfcf Pod phase: Pending level=info timestamp=2018-08-07T19:33:23.165929Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:33:23.166123Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:33:23.169172Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:33:33.177896Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:33:33.255156Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmim8slh5khwqhjksfbqlt7m2fmk5f6bxgz4mc789qm5f6zvbqxkdsm4g798kbdl7w" level=info timestamp=2018-08-07T19:33:33.256950Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:33:33.257461Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmivqvn8cxtk5h6bdtgdmfbzjw2t2zrskxxvn4g5cf9jl Pod phase: Pending level=info timestamp=2018-08-07T19:33:22.925114Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:33:22.925317Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:33:22.927897Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:33:32.937259Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:33:33.027126Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmivqvn8cxtk5h6bdtgdmfbzjw2t2zrskxxvn4g5hwwddv4l9cb6rwrq7lm4nqqgq2" level=info timestamp=2018-08-07T19:33:33.030545Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:33:33.031039Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [181.908 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be able to reach [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 the internet /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:33:18.831108Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmim8slh5khwqhjksfbqlt7m2fmk5f6bxgz4mc789qm5f6zvbqxkdsm4g798kbdl7w kind=VirtualMachineInstance uid=bc7ad71f-9a78-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmim8slh5khwqhjksfbqlt7m2fmk5f6bxgz4mc78kzfcf" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running 2018/08/07 19:38:31 http: TLS handshake error from 10.244.1.1:46078: EOF level=info timestamp=2018-08-07T19:38:33.069621Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:38:41.562064Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:38:41 http: TLS handshake error from 10.244.1.1:46084: EOF level=info timestamp=2018-08-07T19:38:43.063993Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:38:43.093208Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:38:46.348225Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:38:51 http: TLS handshake error from 10.244.1.1:46090: EOF 2018/08/07 19:39:01 http: TLS handshake error from 10.244.1.1:46096: EOF level=info timestamp=2018-08-07T19:39:03.167627Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:39:11.583001Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:39:11 http: TLS handshake error from 10.244.1.1:46102: EOF level=info timestamp=2018-08-07T19:39:13.134150Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:39:13.191996Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:39:16.523241Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 19:36:53 http: TLS handshake error from 10.244.0.1:41872: EOF 2018/08/07 19:37:03 http: TLS handshake error from 10.244.0.1:41932: EOF 2018/08/07 19:37:13 http: TLS handshake error from 10.244.0.1:41992: EOF 2018/08/07 19:37:23 http: TLS handshake error from 10.244.0.1:42052: EOF 2018/08/07 19:37:33 http: TLS handshake error from 10.244.0.1:42112: EOF 2018/08/07 19:37:43 http: TLS handshake error from 10.244.0.1:42172: EOF 2018/08/07 19:37:53 http: TLS handshake error from 10.244.0.1:42232: EOF 2018/08/07 19:38:03 http: TLS handshake error from 10.244.0.1:42292: EOF 2018/08/07 19:38:13 http: TLS handshake error from 10.244.0.1:42352: EOF 2018/08/07 19:38:23 http: TLS handshake error from 10.244.0.1:42412: EOF 2018/08/07 19:38:33 http: TLS handshake error from 10.244.0.1:42472: EOF 2018/08/07 19:38:43 http: TLS handshake error from 10.244.0.1:42532: EOF 2018/08/07 19:38:53 http: TLS handshake error from 10.244.0.1:42592: EOF 2018/08/07 19:39:03 http: TLS handshake error from 10.244.0.1:42652: EOF 2018/08/07 19:39:13 http: TLS handshake error from 10.244.0.1:42712: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T19:33:18.665518Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilrc668kxxnfl87wgncxwjt4mkjcchknr82fbzqnj4gzp7phkb85sbk4qt945j46 kind= uid=bc856ed2-9a78-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:33:18.719642Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikzjbfnq5fpdzf9plwhmrk8mspx2fd8j5ckh6szwvddv7wf87pjgbwwjtccsgmcz kind= uid=bc8ba286-9a78-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:33:18.720028Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikzjbfnq5fpdzf9plwhmrk8mspx2fd8j5ckh6szwvddv7wf87pjgbwwjtccsgmcz kind= uid=bc8ba286-9a78-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:33:18.792549Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmim8slh5khwqhjksfbqlt7m2fmk5f6bxgz4mc789qm5f6zvbqxkdsm4g798kbdl7w\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmim8slh5khwqhjksfbqlt7m2fmk5f6bxgz4mc789qm5f6zvbqxkdsm4g798kbdl7w" level=info timestamp=2018-08-07T19:33:18.796693Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivqvn8cxtk5h6bdtgdmfbzjw2t2zrskxxvn4g5hwwddv4l9cb6rwrq7lm4nqqgq2\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivqvn8cxtk5h6bdtgdmfbzjw2t2zrskxxvn4g5hwwddv4l9cb6rwrq7lm4nqqgq2" level=info timestamp=2018-08-07T19:33:19.488479Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivqvn8cxtk5h6bdtgdmfbzjw2t2zrskxxvn4g5hwwddv4l9cb6rwrq7lm4nqqgq2\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivqvn8cxtk5h6bdtgdmfbzjw2t2zrskxxvn4g5hwwddv4l9cb6rwrq7lm4nqqgq2" level=info timestamp=2018-08-07T19:36:20.493730Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmic498dpn6n556xkjft4zxktvcb88txjvhhdz2qc298jc7zznt2265gc229qrrkds kind= uid=28e6fd75-9a79-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:36:20.497064Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmic498dpn6n556xkjft4zxktvcb88txjvhhdz2qc298jc7zznt2265gc229qrrkds kind= uid=28e6fd75-9a79-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:36:20.521593Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifvs8rvgfkqqrrgxg6xs9bmkvgtdl97pcfjz4rsxkqlv6dx7fhk7s2mrkvh6j4kt kind= uid=28ec9b47-9a79-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:36:20.521947Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifvs8rvgfkqqrrgxg6xs9bmkvgtdl97pcfjz4rsxkqlv6dx7fhk7s2mrkvh6j4kt kind= uid=28ec9b47-9a79-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:36:20.568216Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwx6ktfdzxpd5pb6qdhxvjxjvlf58czngkfdzfmfktxl2qhbdw22ms4r9k568rnw kind= uid=28f0902e-9a79-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:36:20.568604Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwx6ktfdzxpd5pb6qdhxvjxjvlf58czngkfdzfmfktxl2qhbdw22ms4r9k568rnw kind= uid=28f0902e-9a79-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:36:20.606998Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixcpbcdfr578zr57d25nqcp72tskmwxvcx4pdhkglkmnsjrdrkzwlhgwzqlz5ftb kind= uid=28f8c5a2-9a79-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:36:20.607239Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixcpbcdfr578zr57d25nqcp72tskmwxvcx4pdhkglkmnsjrdrkzwlhgwzqlz5ftb kind= uid=28f8c5a2-9a79-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:36:20.926208Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixcpbcdfr578zr57d25nqcp72tskmwxvcx4pdhkglkmnsjrdrkzwlhgwzqlz5ftb\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixcpbcdfr578zr57d25nqcp72tskmwxvcx4pdhkglkmnsjrdrkzwlhgwzqlz5ftb" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmic498dpn6n556xkjft4zxktvcb88txjvhhdz2qjnd57 Pod phase: Pending level=info timestamp=2018-08-07T19:36:24.834147Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:36:24.834674Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:36:24.836659Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:36:34.844136Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:36:34.924187Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmic498dpn6n556xkjft4zxktvcb88txjvhhdz2qc298jc7zznt2265gc229qrrkds" level=info timestamp=2018-08-07T19:36:34.926029Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:36:34.926559Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmifvs8rvgfkqqrrgxg6xs9bmkvgtdl97pcfjz4rbgvj2 Pod phase: Pending level=info timestamp=2018-08-07T19:36:25.106328Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:36:25.106841Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:36:25.108900Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:36:35.117205Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:36:35.174834Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmifvs8rvgfkqqrrgxg6xs9bmkvgtdl97pcfjz4rsxkqlv6dx7fhk7s2mrkvh6j4kt" level=info timestamp=2018-08-07T19:36:35.176811Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:36:35.177208Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmiwx6ktfdzxpd5pb6qdhxvjxjvlf58czngkfdzfwfdt5 Pod phase: Pending level=info timestamp=2018-08-07T19:36:25.421058Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:36:25.421208Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:36:25.423151Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:36:35.431154Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:36:35.484273Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiwx6ktfdzxpd5pb6qdhxvjxjvlf58czngkfdzfmfktxl2qhbdw22ms4r9k568rnw" level=info timestamp=2018-08-07T19:36:35.485969Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:36:35.486449Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmixcpbcdfr578zr57d25nqcp72tskmwxvcx4pdhzm6q4 Pod phase: Pending level=info timestamp=2018-08-07T19:36:24.606556Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:36:24.606782Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:36:24.609004Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:36:34.619312Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:36:34.710941Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmixcpbcdfr578zr57d25nqcp72tskmwxvcx4pdhkglkmnsjrdrkzwlhgwzqlz5ftb" level=info timestamp=2018-08-07T19:36:34.713529Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:36:34.713952Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [181.892 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be reachable via the propagated IP from a Pod [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 on the same node from Pod /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:36:20.689774Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmic498dpn6n556xkjft4zxktvcb88txjvhhdz2qc298jc7zznt2265gc229qrrkds kind=VirtualMachineInstance uid=28e6fd75-9a79-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmic498dpn6n556xkjft4zxktvcb88txjvhhdz2qjnd57" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running level=info timestamp=2018-08-07T19:41:33.722829Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:41:41.627323Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:41:41 http: TLS handshake error from 10.244.1.1:46192: EOF level=info timestamp=2018-08-07T19:41:43.497011Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:41:43.572174Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:41:47.215078Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:41:51 http: TLS handshake error from 10.244.1.1:46198: EOF 2018/08/07 19:42:01 http: TLS handshake error from 10.244.1.1:46204: EOF level=info timestamp=2018-08-07T19:42:03.832841Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:42:11.594278Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:42:11 http: TLS handshake error from 10.244.1.1:46210: EOF level=info timestamp=2018-08-07T19:42:13.567259Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:42:13.632303Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:42:17.366166Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:42:21 http: TLS handshake error from 10.244.1.1:46216: EOF Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 19:39:53 http: TLS handshake error from 10.244.0.1:42952: EOF 2018/08/07 19:40:03 http: TLS handshake error from 10.244.0.1:43012: EOF 2018/08/07 19:40:13 http: TLS handshake error from 10.244.0.1:43072: EOF 2018/08/07 19:40:23 http: TLS handshake error from 10.244.0.1:43132: EOF 2018/08/07 19:40:33 http: TLS handshake error from 10.244.0.1:43192: EOF 2018/08/07 19:40:43 http: TLS handshake error from 10.244.0.1:43252: EOF 2018/08/07 19:40:53 http: TLS handshake error from 10.244.0.1:43312: EOF 2018/08/07 19:41:03 http: TLS handshake error from 10.244.0.1:43372: EOF 2018/08/07 19:41:13 http: TLS handshake error from 10.244.0.1:43432: EOF 2018/08/07 19:41:23 http: TLS handshake error from 10.244.0.1:43492: EOF 2018/08/07 19:41:33 http: TLS handshake error from 10.244.0.1:43552: EOF 2018/08/07 19:41:43 http: TLS handshake error from 10.244.0.1:43612: EOF 2018/08/07 19:41:53 http: TLS handshake error from 10.244.0.1:43672: EOF 2018/08/07 19:42:03 http: TLS handshake error from 10.244.0.1:43732: EOF 2018/08/07 19:42:13 http: TLS handshake error from 10.244.0.1:43792: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T19:36:20.568216Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwx6ktfdzxpd5pb6qdhxvjxjvlf58czngkfdzfmfktxl2qhbdw22ms4r9k568rnw kind= uid=28f0902e-9a79-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:36:20.568604Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwx6ktfdzxpd5pb6qdhxvjxjvlf58czngkfdzfmfktxl2qhbdw22ms4r9k568rnw kind= uid=28f0902e-9a79-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:36:20.606998Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixcpbcdfr578zr57d25nqcp72tskmwxvcx4pdhkglkmnsjrdrkzwlhgwzqlz5ftb kind= uid=28f8c5a2-9a79-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:36:20.607239Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixcpbcdfr578zr57d25nqcp72tskmwxvcx4pdhkglkmnsjrdrkzwlhgwzqlz5ftb kind= uid=28f8c5a2-9a79-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:36:20.926208Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixcpbcdfr578zr57d25nqcp72tskmwxvcx4pdhkglkmnsjrdrkzwlhgwzqlz5ftb\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixcpbcdfr578zr57d25nqcp72tskmwxvcx4pdhkglkmnsjrdrkzwlhgwzqlz5ftb" level=info timestamp=2018-08-07T19:39:22.394436Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibtfrdjpkzrrmcx4vczgj28s7qrkph87bfwkqdvh8t9d4z9w8r9r5pgkfkdkx2h4 kind= uid=95526b5d-9a79-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:39:22.398734Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibtfrdjpkzrrmcx4vczgj28s7qrkph87bfwkqdvh8t9d4z9w8r9r5pgkfkdkx2h4 kind= uid=95526b5d-9a79-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:39:22.415587Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivn7rkxvzknvrwzpp5b6wtkjk9xjgzxmnxhp6sfjlz7mvhxnmz4n5nj5bcgb8xwb kind= uid=95581d7c-9a79-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:39:22.416016Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivn7rkxvzknvrwzpp5b6wtkjk9xjgzxmnxhp6sfjlz7mvhxnmz4n5nj5bcgb8xwb kind= uid=95581d7c-9a79-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:39:22.445294Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibxfq9dckkvg7llrhtwkbbbt6z2ff269flps6vlwwwkr25qddcdtgjgd46629htk kind= uid=955bfcee-9a79-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:39:22.445685Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibxfq9dckkvg7llrhtwkbbbt6z2ff269flps6vlwwwkr25qddcdtgjgd46629htk kind= uid=955bfcee-9a79-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:39:22.501261Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvminvp4c45f5bgn24jc2lw4dbrpwvj4qxtj6swqcvz6x2ct7dlckvmqb89kr459fth kind= uid=9560f843-9a79-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:39:22.501869Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvminvp4c45f5bgn24jc2lw4dbrpwvj4qxtj6swqcvz6x2ct7dlckvmqb89kr459fth kind= uid=9560f843-9a79-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:39:22.611052Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibtfrdjpkzrrmcx4vczgj28s7qrkph87bfwkqdvh8t9d4z9w8r9r5pgkfkdkx2h4\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibtfrdjpkzrrmcx4vczgj28s7qrkph87bfwkqdvh8t9d4z9w8r9r5pgkfkdkx2h4" level=info timestamp=2018-08-07T19:39:23.058293Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvminvp4c45f5bgn24jc2lw4dbrpwvj4qxtj6swqcvz6x2ct7dlckvmqb89kr459fth\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvminvp4c45f5bgn24jc2lw4dbrpwvj4qxtj6swqcvz6x2ct7dlckvmqb89kr459fth" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmibtfrdjpkzrrmcx4vczgj28s7qrkph87bfwkqdkwd92 Pod phase: Pending level=info timestamp=2018-08-07T19:39:26.236836Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:39:26.237805Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:39:26.239944Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:39:36.248946Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:39:36.345348Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmibtfrdjpkzrrmcx4vczgj28s7qrkph87bfwkqdvh8t9d4z9w8r9r5pgkfkdkx2h4" level=info timestamp=2018-08-07T19:39:36.347310Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:39:36.347796Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmibxfq9dckkvg7llrhtwkbbbt6z2ff269flps6vmpp2m Pod phase: Pending level=info timestamp=2018-08-07T19:39:26.636514Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:39:26.637020Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:39:26.638491Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:39:36.648350Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:39:36.701557Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmibxfq9dckkvg7llrhtwkbbbt6z2ff269flps6vlwwwkr25qddcdtgjgd46629htk" level=info timestamp=2018-08-07T19:39:36.703764Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:39:36.704206Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvminvp4c45f5bgn24jc2lw4dbrpwvj4qxtj6swqcxdkx9 Pod phase: Pending level=info timestamp=2018-08-07T19:39:27.328121Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:39:27.328385Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:39:27.330486Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:39:40.417959Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:39:40.530906Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvminvp4c45f5bgn24jc2lw4dbrpwvj4qxtj6swqcvz6x2ct7dlckvmqb89kr459fth" level=info timestamp=2018-08-07T19:39:40.534463Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:39:40.534986Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmivn7rkxvzknvrwzpp5b6wtkjk9xjgzxmnxhp6s67cwc Pod phase: Pending level=info timestamp=2018-08-07T19:39:26.675879Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:39:26.676356Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:39:26.679585Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:39:36.687738Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:39:36.761176Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmivn7rkxvzknvrwzpp5b6wtkjk9xjgzxmnxhp6sfjlz7mvhxnmz4n5nj5bcgb8xwb" level=info timestamp=2018-08-07T19:39:36.763505Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:39:36.763919Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [181.899 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be reachable via the propagated IP from a Pod [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 on a different node from Pod /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:39:22.642529Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmibtfrdjpkzrrmcx4vczgj28s7qrkph87bfwkqdvh8t9d4z9w8r9r5pgkfkdkx2h4 kind=VirtualMachineInstance uid=95526b5d-9a79-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmibtfrdjpkzrrmcx4vczgj28s7qrkph87bfwkqdkwd92" Pod name: disks-images-provider-ckdff Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-dknsv Pod phase: Running copy all images to host mount directory Pod name: virt-api-bcc6b587d-c2f48 Pod phase: Running level=info timestamp=2018-08-07T19:44:43.985132Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:44:48.107446Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:44:51 http: TLS handshake error from 10.244.1.1:46306: EOF 2018/08/07 19:45:01 http: TLS handshake error from 10.244.1.1:46312: EOF level=info timestamp=2018-08-07T19:45:04.586457Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:45:11.298468Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:45:11.354080Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:45:11.593843Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:45:11 http: TLS handshake error from 10.244.1.1:46318: EOF level=info timestamp=2018-08-07T19:45:13.930804Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:45:14.041506Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:45:18.355886Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url="/apis/subresources.kubevirt.io/v1alpha2?timeout=32s" proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:45:20.605872Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:45:20.609829Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:45:21 http: TLS handshake error from 10.244.1.1:46324: EOF Pod name: virt-api-bcc6b587d-rbw2d Pod phase: Running 2018/08/07 19:43:03 http: TLS handshake error from 10.244.0.1:44092: EOF 2018/08/07 19:43:13 http: TLS handshake error from 10.244.0.1:44152: EOF 2018/08/07 19:43:23 http: TLS handshake error from 10.244.0.1:44212: EOF 2018/08/07 19:43:33 http: TLS handshake error from 10.244.0.1:44272: EOF 2018/08/07 19:43:43 http: TLS handshake error from 10.244.0.1:44332: EOF 2018/08/07 19:43:53 http: TLS handshake error from 10.244.0.1:44392: EOF 2018/08/07 19:44:03 http: TLS handshake error from 10.244.0.1:44452: EOF 2018/08/07 19:44:13 http: TLS handshake error from 10.244.0.1:44512: EOF 2018/08/07 19:44:23 http: TLS handshake error from 10.244.0.1:44572: EOF 2018/08/07 19:44:33 http: TLS handshake error from 10.244.0.1:44632: EOF 2018/08/07 19:44:43 http: TLS handshake error from 10.244.0.1:44692: EOF 2018/08/07 19:44:53 http: TLS handshake error from 10.244.0.1:44752: EOF 2018/08/07 19:45:03 http: TLS handshake error from 10.244.0.1:44812: EOF 2018/08/07 19:45:13 http: TLS handshake error from 10.244.0.1:44872: EOF 2018/08/07 19:45:23 http: TLS handshake error from 10.244.0.1:44932: EOF Pod name: virt-controller-67dcdd8464-lh2vk Pod phase: Running level=info timestamp=2018-08-07T19:39:22.501869Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvminvp4c45f5bgn24jc2lw4dbrpwvj4qxtj6swqcvz6x2ct7dlckvmqb89kr459fth kind= uid=9560f843-9a79-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:39:22.611052Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibtfrdjpkzrrmcx4vczgj28s7qrkph87bfwkqdvh8t9d4z9w8r9r5pgkfkdkx2h4\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibtfrdjpkzrrmcx4vczgj28s7qrkph87bfwkqdvh8t9d4z9w8r9r5pgkfkdkx2h4" level=info timestamp=2018-08-07T19:39:23.058293Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvminvp4c45f5bgn24jc2lw4dbrpwvj4qxtj6swqcvz6x2ct7dlckvmqb89kr459fth\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvminvp4c45f5bgn24jc2lw4dbrpwvj4qxtj6swqcvz6x2ct7dlckvmqb89kr459fth" level=info timestamp=2018-08-07T19:42:24.317796Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimhxmjrsd2p79vf4cvxzz4bg7xxt2md6g2q5f89wv8hgplvr8c2x5cqlrplq8dnt kind= uid=01bff459-9a7a-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:42:24.321773Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimhxmjrsd2p79vf4cvxzz4bg7xxt2md6g2q5f89wv8hgplvr8c2x5cqlrplq8dnt kind= uid=01bff459-9a7a-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:42:24.330642Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiq8rt2vnb2xhctmbf9s6rjhpltzwqqmkj527f8x4xmt5gqpkdvshsxhnjm6gjd4w kind= uid=01c5f7a9-9a7a-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:42:24.331134Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiq8rt2vnb2xhctmbf9s6rjhpltzwqqmkj527f8x4xmt5gqpkdvshsxhnjm6gjd4w kind= uid=01c5f7a9-9a7a-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:42:24.364904Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihcz6cdt7xhdt4k6ff6gmcbrgs9gm4swsp27vb8zng7psdmkw2p2wchbkvmlnz8n kind= uid=01c8f7c7-9a7a-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:42:24.365277Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihcz6cdt7xhdt4k6ff6gmcbrgs9gm4swsp27vb8zng7psdmkw2p2wchbkvmlnz8n kind= uid=01c8f7c7-9a7a-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:42:24.395297Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis5dp2rbwdpjg6n6ffjlsk2tt9qm8ddbqbgvm2wrjdv2qxlstkmw6cnvb5lz9z4b kind= uid=01cef505-9a7a-11e8-bcdf-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:42:24.395655Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis5dp2rbwdpjg6n6ffjlsk2tt9qm8ddbqbgvm2wrjdv2qxlstkmw6cnvb5lz9z4b kind= uid=01cef505-9a7a-11e8-bcdf-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:42:24.484461Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiq8rt2vnb2xhctmbf9s6rjhpltzwqqmkj527f8x4xmt5gqpkdvshsxhnjm6gjd4w\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiq8rt2vnb2xhctmbf9s6rjhpltzwqqmkj527f8x4xmt5gqpkdvshsxhnjm6gjd4w" level=info timestamp=2018-08-07T19:42:24.507478Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmihcz6cdt7xhdt4k6ff6gmcbrgs9gm4swsp27vb8zng7psdmkw2p2wchbkvmlnz8n\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmihcz6cdt7xhdt4k6ff6gmcbrgs9gm4swsp27vb8zng7psdmkw2p2wchbkvmlnz8n" level=info timestamp=2018-08-07T19:42:24.508980Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimhxmjrsd2p79vf4cvxzz4bg7xxt2md6g2q5f89wv8hgplvr8c2x5cqlrplq8dnt\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimhxmjrsd2p79vf4cvxzz4bg7xxt2md6g2q5f89wv8hgplvr8c2x5cqlrplq8dnt" level=info timestamp=2018-08-07T19:42:25.363892Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmis5dp2rbwdpjg6n6ffjlsk2tt9qm8ddbqbgvm2wrjdv2qxlstkmw6cnvb5lz9z4b\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmis5dp2rbwdpjg6n6ffjlsk2tt9qm8ddbqbgvm2wrjdv2qxlstkmw6cnvb5lz9z4b" Pod name: virt-controller-67dcdd8464-wc5w7 Pod phase: Running level=info timestamp=2018-08-07T18:10:06.025426Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-thh67 Pod phase: Running level=info timestamp=2018-08-07T18:43:57.539416Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:43:57.539540Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.539594Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.539656Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.539789Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.543509Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:43:57.544107Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: true\n" level=info timestamp=2018-08-07T18:43:57.544209Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:43:57.544479Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:43:57.544661Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:43:57.544919Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind= uid=ca885efa-9a71-11e8-bcdf-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:00.879346Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555, existing: false\n" level=info timestamp=2018-08-07T18:44:00.879590Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:00.879977Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:00.880236Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvmih27x4z2gf6fpjx2vdg4jl942dkl2hbxgqfq26gkv4gkpwdtrfw7k8dj8kvn4555 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-vj5c7 Pod phase: Running level=info timestamp=2018-08-07T18:10:05.995138Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:06.000837Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:06.001962Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:06.117625Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:06.152971Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:06.158004Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=error timestamp=2018-08-07T18:10:06.299346Z pos=vm.go:796 component=virt-handler reason="open /proc/4451/cmdline: no such file or directory" msg="failed to set a cpu manager label on host node02" Pod name: virt-launcher-testvmihcz6cdt7xhdt4k6ff6gmcbrgs9gm4swsp27vbbfnhn Pod phase: Pending level=info timestamp=2018-08-07T19:42:28.749504Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:42:28.749742Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:42:28.751456Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:42:38.761994Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:42:38.883185Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmihcz6cdt7xhdt4k6ff6gmcbrgs9gm4swsp27vb8zng7psdmkw2p2wchbkvmlnz8n" level=info timestamp=2018-08-07T19:42:38.885929Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:42:38.886704Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmimhxmjrsd2p79vf4cvxzz4bg7xxt2md6g2q5f8zq4ls Pod phase: Pending level=info timestamp=2018-08-07T19:42:28.769678Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:42:28.770231Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:42:28.771854Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:42:38.780342Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:42:38.867019Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmimhxmjrsd2p79vf4cvxzz4bg7xxt2md6g2q5f89wv8hgplvr8c2x5cqlrplq8dnt" level=info timestamp=2018-08-07T19:42:38.870254Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:42:38.870878Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmiq8rt2vnb2xhctmbf9s6rjhpltzwqqmkj527f89bcpp Pod phase: Pending level=info timestamp=2018-08-07T19:42:28.975542Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:42:28.976890Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:42:28.978910Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:42:38.988030Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:42:39.077570Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiq8rt2vnb2xhctmbf9s6rjhpltzwqqmkj527f8x4xmt5gqpkdvshsxhnjm6gjd4w" level=info timestamp=2018-08-07T19:42:39.079167Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:42:39.079829Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmis5dp2rbwdpjg6n6ffjlsk2tt9qm8ddbqbgvm27w9p9 Pod phase: Pending level=info timestamp=2018-08-07T19:42:29.413918Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:42:29.414201Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:42:29.418148Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:42:39.426345Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:42:39.502675Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmis5dp2rbwdpjg6n6ffjlsk2tt9qm8ddbqbgvm2wrjdv2qxlstkmw6cnvb5lz9z4b" level=info timestamp=2018-08-07T19:42:39.504536Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:42:39.505071Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [181.902 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be reachable via the propagated IP from a Pod [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 on the same node from Node /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:42:24.527311Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmimhxmjrsd2p79vf4cvxzz4bg7xxt2md6g2q5f89wv8hgplvr8c2x5cqlrplq8dnt kind=VirtualMachineInstance uid=01bff459-9a7a-11e8-bcdf-525500d15501 msg="Created virtual machine pod virt-launcher-testvmimhxmjrsd2p79vf4cvxzz4bg7xxt2md6g2q5f8zq4ls" panic: test timed out after 1h30m0s goroutine 15403 [running]: testing.(*M).startAlarm.func1() /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:1240 +0xfc created by time.goFunc /gimme/.gimme/versions/go1.10.linux.amd64/src/time/sleep.go:172 +0x44 goroutine 1 [chan receive, 90 minutes]: testing.(*T).Run(0xc4201710e0, 0x139fc95, 0x9, 0x1432278, 0x4801e6) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:825 +0x301 testing.runTests.func1(0xc420170ff0) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:1063 +0x64 testing.tRunner(0xc420170ff0, 0xc420679df8) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:777 +0xd0 testing.runTests(0xc420304260, 0x1d34a50, 0x1, 0x1, 0x412009) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:1061 +0x2c4 testing.(*M).Run(0xc420590c00, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:978 +0x171 main.main() _testmain.go:44 +0x151 goroutine 20 [chan receive]: kubevirt.io/kubevirt/vendor/github.com/golang/glog.(*loggingT).flushDaemon(0x1d60280) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/golang/glog/glog.go:879 +0x8b created by kubevirt.io/kubevirt/vendor/github.com/golang/glog.init.0 /root/go/src/kubevirt.io/kubevirt/vendor/github.com/golang/glog/glog.go:410 +0x203 goroutine 21 [syscall, 90 minutes]: os/signal.signal_recv(0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/sigqueue.go:139 +0xa6 os/signal.loop() /gimme/.gimme/versions/go1.10.linux.amd64/src/os/signal/signal_unix.go:22 +0x22 created by os/signal.init.0 /gimme/.gimme/versions/go1.10.linux.amd64/src/os/signal/signal_unix.go:28 +0x41 goroutine 16 [select]: kubevirt.io/kubevirt/tests.(*ObjectEventWatcher).Watch(0xc420e95030, 0xc420a08780) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:286 +0x579 kubevirt.io/kubevirt/tests.(*ObjectEventWatcher).WaitFor(0xc420e95030, 0x139ba31, 0x6, 0x11e4920, 0x14b2710, 0x0) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:296 +0xba kubevirt.io/kubevirt/tests.waitForVMIStart(0x14bbd60, 0xc420d02c80, 0x5a, 0x0, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1064 +0x50e kubevirt.io/kubevirt/tests.WaitForSuccessfulVMIStart(0x14bbd60, 0xc420d02c80, 0xc420e95120, 0xa5a99e) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 +0x43 kubevirt.io/kubevirt/tests.WaitUntilVMIReady(0xc420d02c80, 0x1432250, 0x1d7e938) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1106 +0x3b kubevirt.io/kubevirt/tests_test.glob..func18.4() /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:135 +0x72b kubevirt.io/kubevirt/tests.BeforeAll.func1() /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1388 +0x3f kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).runSync(0xc420863aa0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113 +0x9c kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).run(0xc420863aa0, 0xc4208b9790, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:64 +0x13e kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*SetupNode).Run(0xc42000e268, 0x14b8200, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes/setup_nodes.go:15 +0x7f kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec.(*Spec).runSample(0xc42040b4a0, 0x0, 0x14b8200, 0xc4200fb4c0) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec/spec.go:181 +0x1f1 kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec.(*Spec).Run(0xc42040b4a0, 0x14b8200, 0xc4200fb4c0) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec/spec.go:138 +0xff kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).runSpec(0xc4207cf040, 0xc42040b4a0, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:200 +0x10d kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).runSpecs(0xc4207cf040, 0x1) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:170 +0x329 kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).Run(0xc4207cf040, 0xb) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:66 +0x11b kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/suite.(*Suite).Run(0xc4200f8af0, 0x7fac81dfce08, 0xc4201710e0, 0x13a2278, 0xb, 0xc420304360, 0x2, 0x2, 0x14d4b00, 0xc4200fb4c0, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/suite/suite.go:62 +0x27c kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo.RunSpecsWithCustomReporters(0x14b9260, 0xc4201710e0, 0x13a2278, 0xb, 0xc4203042e0, 0x2, 0x2, 0x2) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/ginkgo_dsl.go:221 +0x258 kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo.RunSpecsWithDefaultAndCustomReporters(0x14b9260, 0xc4201710e0, 0x13a2278, 0xb, 0xc420508ae0, 0x1, 0x1, 0x1) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/ginkgo_dsl.go:209 +0xab kubevirt.io/kubevirt/tests_test.TestTests(0xc4201710e0) /root/go/src/kubevirt.io/kubevirt/tests/tests_suite_test.go:43 +0xaa testing.tRunner(0xc4201710e0, 0x1432278) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:777 +0xd0 created by testing.(*T).Run /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:824 +0x2e0 goroutine 66 [chan receive, 90 minutes]: kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).registerForInterrupts(0xc4207cf040, 0xc4207f8fc0) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:223 +0xd1 created by kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).Run /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:60 +0x88 goroutine 67 [select, 90 minutes, locked to thread]: runtime.gopark(0x1434450, 0x0, 0x139c7b7, 0x6, 0x18, 0x1) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/proc.go:291 +0x11a runtime.selectgo(0xc42046df50, 0xc4207f9080) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/select.go:392 +0xe50 runtime.ensureSigM.func1() /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/signal_unix.go:549 +0x1f4 runtime.goexit() /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/asm_amd64.s:2361 +0x1 goroutine 87 [IO wait]: internal/poll.runtime_pollWait(0x7fac81e86f00, 0x72, 0xc420cd1850) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/netpoll.go:173 +0x57 internal/poll.(*pollDesc).wait(0xc420a0c298, 0x72, 0xffffffffffffff00, 0x14ba420, 0x1c4b7d0) /gimme/.gimme/versions/go1.10.linux.amd64/src/internal/poll/fd_poll_runtime.go:85 +0x9b internal/poll.(*pollDesc).waitRead(0xc420a0c298, 0xc420d3a000, 0x8000, 0x8000) /gimme/.gimme/versions/go1.10.linux.amd64/src/internal/poll/fd_poll_runtime.go:90 +0x3d internal/poll.(*FD).Read(0xc420a0c280, 0xc420d3a000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/internal/poll/fd_unix.go:157 +0x17d net.(*netFD).Read(0xc420a0c280, 0xc420d3a000, 0x8000, 0x8000, 0x0, 0x8, 0x7ffb) /gimme/.gimme/versions/go1.10.linux.amd64/src/net/fd_unix.go:202 +0x4f net.(*conn).Read(0xc4204c23c0, 0xc420d3a000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/net/net.go:176 +0x6a crypto/tls.(*block).readFromUntil(0xc42049bda0, 0x7fac7c2af0b0, 0xc4204c23c0, 0x5, 0xc4204c23c0, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/crypto/tls/conn.go:493 +0x96 crypto/tls.(*Conn).readRecord(0xc4206d2000, 0x1434517, 0xc4206d2120, 0x20) /gimme/.gimme/versions/go1.10.linux.amd64/src/crypto/tls/conn.go:595 +0xe0 crypto/tls.(*Conn).Read(0xc4206d2000, 0xc4203e9000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/crypto/tls/conn.go:1156 +0x100 bufio.(*Reader).Read(0xc4207996e0, 0xc42057e2d8, 0x9, 0x9, 0xc42109a428, 0x1, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/bufio/bufio.go:216 +0x238 io.ReadAtLeast(0x14b7000, 0xc4207996e0, 0xc42057e2d8, 0x9, 0x9, 0x9, 0xc420bc6060, 0x43f2c1, 0xc420e3e300) /gimme/.gimme/versions/go1.10.linux.amd64/src/io/io.go:309 +0x86 io.ReadFull(0x14b7000, 0xc4207996e0, 0xc42057e2d8, 0x9, 0x9, 0x1434598, 0xc420cd1d10, 0x462d33) /gimme/.gimme/versions/go1.10.linux.amd64/src/io/io.go:327 +0x58 kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.readFrameHeader(0xc42057e2d8, 0x9, 0x9, 0x14b7000, 0xc4207996e0, 0x0, 0xc400000000, 0x7efc20, 0xc420efba68) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/frame.go:237 +0x7b kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc42057e2a0, 0xc4208abcb0, 0x0, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/frame.go:492 +0xa4 kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*clientConnReadLoop).run(0xc420cd1fb0, 0x14331d0, 0xc4204837b0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/transport.go:1428 +0x8e kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*ClientConn).readLoop(0xc42072c820) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/transport.go:1354 +0x76 created by kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*Transport).newClientConn /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/transport.go:579 +0x651 goroutine 15401 [semacquire]: sync.runtime_notifyListWait(0xc420efba80, 0xc400000001) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/sema.go:510 +0x10b sync.(*Cond).Wait(0xc420efba70) /gimme/.gimme/versions/go1.10.linux.amd64/src/sync/cond.go:56 +0x80 kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*pipe).Read(0xc420efba68, 0xc420b06c01, 0x5ff, 0x5ff, 0x0, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/pipe.go:64 +0x8f kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.transportResponseBody.Read(0xc420efba40, 0xc420b06c01, 0x5ff, 0x5ff, 0x0, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/transport.go:1674 +0xa1 encoding/json.(*Decoder).refill(0xc42080c960, 0x835c0a, 0x9) /gimme/.gimme/versions/go1.10.linux.amd64/src/encoding/json/stream.go:159 +0x132 encoding/json.(*Decoder).readValue(0xc42080c960, 0x0, 0x0, 0x11f6880) /gimme/.gimme/versions/go1.10.linux.amd64/src/encoding/json/stream.go:134 +0x23d encoding/json.(*Decoder).Decode(0xc42080c960, 0x12127c0, 0xc420945fc0, 0x14bf020, 0xc4203c0c80) /gimme/.gimme/versions/go1.10.linux.amd64/src/encoding/json/stream.go:63 +0x78 kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc4208abc50, 0xc42023aa80, 0x800, 0xa80, 0xc42089dfc0, 0x40, 0x38) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:150 +0x295 kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc420b969b0, 0x0, 0x14c0ce0, 0xc42089dfc0, 0x480, 0x14bf020, 0xc4209f20b8, 0x456ae0, 0xc4209f2060) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0x95 kubevirt.io/kubevirt/vendor/k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc420945d40, 0xc420cd3fa8, 0x5, 0x14bf020, 0xc4203c0c80, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0x7c kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc4208abc80) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:93 +0x12e created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 15402 [chan receive]: kubevirt.io/kubevirt/tests.(*ObjectEventWatcher).Watch.func3(0x14c1260, 0xc4208abc80, 0xc4202abe10, 0xc4209f20c0) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:277 +0x93 created by kubevirt.io/kubevirt/tests.(*ObjectEventWatcher).Watch /root/go/src/kubevirt.io/kubevirt/tests/utils.go:275 +0x4ae make: *** [functest] Error 2 + make cluster-down ./cluster/down.sh