+ export WORKSPACE=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release + WORKSPACE=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release + [[ k8s-1.10.4-release =~ openshift-.* ]] + [[ k8s-1.10.4-release =~ .*-1.10.4-.* ]] + export KUBEVIRT_PROVIDER=k8s-1.10.4 + KUBEVIRT_PROVIDER=k8s-1.10.4 + export KUBEVIRT_NUM_NODES=2 + KUBEVIRT_NUM_NODES=2 + export NFS_WINDOWS_DIR=/home/nfs/images/windows2016 + NFS_WINDOWS_DIR=/home/nfs/images/windows2016 + export NAMESPACE=kube-system + NAMESPACE=kube-system + trap '{ make cluster-down; }' EXIT SIGINT SIGTERM SIGSTOP + make cluster-down ./cluster/down.sh + make cluster-up ./cluster/up.sh Downloading ....... Downloading ....... 2018/08/07 17:53:59 Waiting for host: 192.168.66.101:22 2018/08/07 17:54:02 Problem with dial: dial tcp 192.168.66.101:22: getsockopt: no route to host. Sleeping 5s 2018/08/07 17:54:10 Problem with dial: dial tcp 192.168.66.101:22: getsockopt: no route to host. Sleeping 5s 2018/08/07 17:54:15 Connected to tcp://192.168.66.101:22 + kubeadm init --config /etc/kubernetes/kubeadm.conf [init] Using Kubernetes version: v1.10.4 [init] Using Authorization modes: [Node RBAC] [preflight] Running pre-flight checks. [WARNING FileExisting-crictl]: crictl not found in system path Suggestion: go get github.com/kubernetes-incubator/cri-tools/cmd/crictl Flag --admission-control has been deprecated, Use --enable-admission-plugins or --disable-admission-plugins instead. Will be removed in a future version. [certificates] Generated ca certificate and key. [certificates] Generated apiserver certificate and key. [certificates] apiserver serving cert is signed for DNS names [node01 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 192.168.66.101] [certificates] Generated apiserver-kubelet-client certificate and key. [certificates] Generated sa key and public key. [certificates] Generated front-proxy-ca certificate and key. [certificates] Generated front-proxy-client certificate and key. [certificates] Generated etcd/ca certificate and key. [certificates] Generated etcd/server certificate and key. [certificates] etcd/server serving cert is signed for DNS names [localhost] and IPs [127.0.0.1] [certificates] Generated etcd/peer certificate and key. [certificates] etcd/peer serving cert is signed for DNS names [node01] and IPs [192.168.66.101] [certificates] Generated etcd/healthcheck-client certificate and key. [certificates] Generated apiserver-etcd-client certificate and key. [certificates] Valid certificates and keys now exist in "/etc/kubernetes/pki" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/admin.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/kubelet.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/controller-manager.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/scheduler.conf" [controlplane] Wrote Static Pod manifest for component kube-apiserver to "/etc/kubernetes/manifests/kube-apiserver.yaml" [controlplane] Wrote Static Pod manifest for component kube-controller-manager to "/etc/kubernetes/manifests/kube-controller-manager.yaml" [controlplane] Wrote Static Pod manifest for component kube-scheduler to "/etc/kubernetes/manifests/kube-scheduler.yaml" [etcd] Wrote Static Pod manifest for a local etcd instance to "/etc/kubernetes/manifests/etcd.yaml" [init] Waiting for the kubelet to boot up the control plane as Static Pods from directory "/etc/kubernetes/manifests". [init] This might take a minute or longer if the control plane images have to be pulled. [apiclient] All control plane components are healthy after 38.020213 seconds [uploadconfig] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace [markmaster] Will mark node node01 as master by adding a label and a taint [markmaster] Master node01 tainted and labelled with key/value: node-role.kubernetes.io/master="" [bootstraptoken] Using token: abcdef.1234567890123456 [bootstraptoken] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials [bootstraptoken] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token [bootstraptoken] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster [bootstraptoken] Creating the "cluster-info" ConfigMap in the "kube-public" namespace [addons] Applied essential addon: kube-dns [addons] Applied essential addon: kube-proxy Your Kubernetes master has initialized successfully! To start using your cluster, you need to run the following as a regular user: mkdir -p $HOME/.kube sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config sudo chown $(id -u):$(id -g) $HOME/.kube/config You should now deploy a pod network to the cluster. Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at: https://kubernetes.io/docs/concepts/cluster-administration/addons/ You can now join any number of machines by running the following on each node as root: kubeadm join 192.168.66.101:6443 --token abcdef.1234567890123456 --discovery-token-ca-cert-hash sha256:e818f573dc98680612610c66c90224c074eb8c1fe71a05e3bc617ac02eee595f + kubectl --kubeconfig=/etc/kubernetes/admin.conf apply -f https://raw.githubusercontent.com/coreos/flannel/v0.9.1/Documentation/kube-flannel.yml clusterrole.rbac.authorization.k8s.io "flannel" created clusterrolebinding.rbac.authorization.k8s.io "flannel" created serviceaccount "flannel" created configmap "kube-flannel-cfg" created daemonset.extensions "kube-flannel-ds" created + kubectl --kubeconfig=/etc/kubernetes/admin.conf taint nodes node01 node-role.kubernetes.io/master:NoSchedule- node "node01" untainted 2018/08/07 17:55:11 Waiting for host: 192.168.66.102:22 2018/08/07 17:55:14 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: no route to host. Sleeping 5s 2018/08/07 17:55:22 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: no route to host. Sleeping 5s 2018/08/07 17:55:28 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: connection refused. Sleeping 5s 2018/08/07 17:55:33 Connected to tcp://192.168.66.102:22 + kubeadm join --token abcdef.1234567890123456 192.168.66.101:6443 --ignore-preflight-errors=all --discovery-token-unsafe-skip-ca-verification=true [preflight] Running pre-flight checks. [discovery] Trying to connect to API Server "192.168.66.101:6443" [WARNING FileExisting-crictl]: crictl not found in system path Suggestion: go get github.com/kubernetes-incubator/cri-tools/cmd/crictl [discovery] Created cluster-info discovery client, requesting info from "https://192.168.66.101:6443" [discovery] Cluster info signature and contents are valid and no TLS pinning was specified, will use API Server "192.168.66.101:6443" [discovery] Successfully established connection with API Server "192.168.66.101:6443" This node has joined the cluster: * Certificate signing request was sent to master and a response was received. * The Kubelet was informed of the new secure connection details. Run 'kubectl get nodes' on the master to see this node join the cluster. Sending file modes: C0755 39611920 kubectl Sending file modes: C0600 5454 admin.conf Cluster "kubernetes" set. Cluster "kubernetes" set. + set +e + kubectl get nodes --no-headers + cluster/kubectl.sh get nodes --no-headers node01 Ready master 56s v1.10.4 node02 Ready 22s v1.10.4 + kubectl_rc=0 + '[' 0 -ne 0 ']' ++ kubectl get nodes --no-headers ++ cluster/kubectl.sh get nodes --no-headers ++ grep NotReady + '[' -n '' ']' + set -e + echo 'Nodes are ready:' Nodes are ready: + kubectl get nodes + cluster/kubectl.sh get nodes NAME STATUS ROLES AGE VERSION node01 Ready master 57s v1.10.4 node02 Ready 23s v1.10.4 + make cluster-sync ./cluster/build.sh Building ... Sending build context to Docker daemon 5.632 kB Step 1/12 : FROM fedora:28 ---> cc510acfcd70 Step 2/12 : ENV LIBVIRT_VERSION 4.2.0 ---> Using cache ---> b1088795aeb6 Step 3/12 : RUN curl --output /etc/yum.repos.d/fedora-virt-preview.repo https://fedorapeople.org/groups/virt/virt-preview/fedora-virt-preview.repo ---> Using cache ---> 88f43b954f9f Step 4/12 : RUN dnf -y install libvirt-devel-${LIBVIRT_VERSION} make git mercurial sudo gcc findutils gradle rsync-daemon rsync qemu-img protobuf-compiler && dnf -y clean all ---> Using cache ---> 06c70b43758a Step 5/12 : ENV GIMME_GO_VERSION 1.10 ---> Using cache ---> e5b3ae738662 Step 6/12 : RUN mkdir -p /gimme && curl -sL https://raw.githubusercontent.com/travis-ci/gimme/master/gimme | HOME=/gimme bash >> /etc/profile.d/gimme.sh ---> Using cache ---> 3e3d43f49e45 Step 7/12 : ENV GOPATH "/go" GOBIN "/usr/bin" ---> Using cache ---> 73e8a3aa263a Step 8/12 : ADD rsyncd.conf /etc/rsyncd.conf ---> Using cache ---> bc244b1c712b Step 9/12 : RUN mkdir -p /go && source /etc/profile.d/gimme.sh && go get github.com/mattn/goveralls && go get -u github.com/Masterminds/glide && go get golang.org/x/tools/cmd/goimports && git clone https://github.com/mvdan/sh.git $GOPATH/src/mvdan.cc/sh && cd /go/src/mvdan.cc/sh/cmd/shfmt && git checkout v2.5.0 && go get mvdan.cc/sh/cmd/shfmt && go install && go get -u github.com/golang/mock/gomock && go get -u github.com/rmohr/mock/mockgen && go get -u github.com/rmohr/go-swagger-utils/swagger-doc && go get -u github.com/onsi/ginkgo/ginkgo && go get -u -d k8s.io/code-generator/cmd/deepcopy-gen && go get -u -d k8s.io/code-generator/cmd/defaulter-gen && go get -u -d k8s.io/code-generator/cmd/openapi-gen && cd /go/src/k8s.io/code-generator/cmd/deepcopy-gen && git checkout release-1.9 && go install && cd /go/src/k8s.io/code-generator/cmd/defaulter-gen && git checkout release-1.9 && go install && cd /go/src/k8s.io/code-generator/cmd/openapi-gen && git checkout release-1.9 && go install && go get -u -d github.com/golang/protobuf/protoc-gen-go && cd /go/src/github.com/golang/protobuf/protoc-gen-go && git checkout 1643683e1b54a9e88ad26d98f81400c8c9d9f4f9 && go install ---> Using cache ---> 4cd1786b2bc8 Step 10/12 : RUN pip install j2cli ---> Using cache ---> b51a532fa53a Step 11/12 : ADD entrypoint.sh /entrypoint.sh ---> Using cache ---> 3bc0185264f6 Step 12/12 : ENTRYPOINT /entrypoint.sh ---> Using cache ---> dcf2b21fa2ed Successfully built dcf2b21fa2ed go version go1.10 linux/amd64 go version go1.10 linux/amd64 make[1]: Entering directory `/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt' hack/dockerized "./hack/check.sh && KUBEVIRT_VERSION= ./hack/build-go.sh install " && ./hack/build-copy-artifacts.sh Sending build context to Docker daemon 5.632 kB Step 1/12 : FROM fedora:28 ---> cc510acfcd70 Step 2/12 : ENV LIBVIRT_VERSION 4.2.0 ---> Using cache ---> b1088795aeb6 Step 3/12 : RUN curl --output /etc/yum.repos.d/fedora-virt-preview.repo https://fedorapeople.org/groups/virt/virt-preview/fedora-virt-preview.repo ---> Using cache ---> 88f43b954f9f Step 4/12 : RUN dnf -y install libvirt-devel-${LIBVIRT_VERSION} make git mercurial sudo gcc findutils gradle rsync-daemon rsync qemu-img protobuf-compiler && dnf -y clean all ---> Using cache ---> 06c70b43758a Step 5/12 : ENV GIMME_GO_VERSION 1.10 ---> Using cache ---> e5b3ae738662 Step 6/12 : RUN mkdir -p /gimme && curl -sL https://raw.githubusercontent.com/travis-ci/gimme/master/gimme | HOME=/gimme bash >> /etc/profile.d/gimme.sh ---> Using cache ---> 3e3d43f49e45 Step 7/12 : ENV GOPATH "/go" GOBIN "/usr/bin" ---> Using cache ---> 73e8a3aa263a Step 8/12 : ADD rsyncd.conf /etc/rsyncd.conf ---> Using cache ---> bc244b1c712b Step 9/12 : RUN mkdir -p /go && source /etc/profile.d/gimme.sh && go get github.com/mattn/goveralls && go get -u github.com/Masterminds/glide && go get golang.org/x/tools/cmd/goimports && git clone https://github.com/mvdan/sh.git $GOPATH/src/mvdan.cc/sh && cd /go/src/mvdan.cc/sh/cmd/shfmt && git checkout v2.5.0 && go get mvdan.cc/sh/cmd/shfmt && go install && go get -u github.com/golang/mock/gomock && go get -u github.com/rmohr/mock/mockgen && go get -u github.com/rmohr/go-swagger-utils/swagger-doc && go get -u github.com/onsi/ginkgo/ginkgo && go get -u -d k8s.io/code-generator/cmd/deepcopy-gen && go get -u -d k8s.io/code-generator/cmd/defaulter-gen && go get -u -d k8s.io/code-generator/cmd/openapi-gen && cd /go/src/k8s.io/code-generator/cmd/deepcopy-gen && git checkout release-1.9 && go install && cd /go/src/k8s.io/code-generator/cmd/defaulter-gen && git checkout release-1.9 && go install && cd /go/src/k8s.io/code-generator/cmd/openapi-gen && git checkout release-1.9 && go install && go get -u -d github.com/golang/protobuf/protoc-gen-go && cd /go/src/github.com/golang/protobuf/protoc-gen-go && git checkout 1643683e1b54a9e88ad26d98f81400c8c9d9f4f9 && go install ---> Using cache ---> 4cd1786b2bc8 Step 10/12 : RUN pip install j2cli ---> Using cache ---> b51a532fa53a Step 11/12 : ADD entrypoint.sh /entrypoint.sh ---> Using cache ---> 3bc0185264f6 Step 12/12 : ENTRYPOINT /entrypoint.sh ---> Using cache ---> dcf2b21fa2ed Successfully built dcf2b21fa2ed go version go1.10 linux/amd64 go version go1.10 linux/amd64 find: '/root/go/src/kubevirt.io/kubevirt/_out/cmd': No such file or directory Compiling tests... compiled tests.test hack/build-docker.sh build Sending build context to Docker daemon 40.4 MB Step 1/8 : FROM fedora:28 ---> cc510acfcd70 Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virt-controller ---> Using cache ---> b00c84523b53 Step 4/8 : WORKDIR /home/virt-controller ---> Using cache ---> b76b8bd8cd39 Step 5/8 : USER 1001 ---> Using cache ---> b6d9ad9ed232 Step 6/8 : COPY virt-controller /usr/bin/virt-controller ---> 0bf9563134f5 Removing intermediate container 7e4e3bde32e6 Step 7/8 : ENTRYPOINT /usr/bin/virt-controller ---> Running in eade20ae836a ---> 8f484abc807f Removing intermediate container eade20ae836a Step 8/8 : LABEL "kubevirt-functional-tests-k8s-1.10.4-release1" '' "virt-controller" '' ---> Running in b56e07f8cb9d ---> 7e4c17789133 Removing intermediate container b56e07f8cb9d Successfully built 7e4c17789133 Sending build context to Docker daemon 43.32 MB Step 1/10 : FROM kubevirt/libvirt:4.2.0 ---> 5f0bfe81a3e0 Step 2/10 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 945996802736 Step 3/10 : RUN dnf -y install socat genisoimage util-linux libcgroup-tools ethtool net-tools sudo && dnf -y clean all && test $(id -u qemu) = 107 # make sure that the qemu user really is 107 ---> Using cache ---> 672f9ab56316 Step 4/10 : COPY virt-launcher /usr/bin/virt-launcher ---> a07ac83c6c50 Removing intermediate container ffdb739f3122 Step 5/10 : COPY kubevirt-sudo /etc/sudoers.d/kubevirt ---> 3d5836c56f0c Removing intermediate container 205686af2ae6 Step 6/10 : RUN setcap CAP_NET_BIND_SERVICE=+eip /usr/bin/qemu-system-x86_64 ---> Running in a3157bec51dd  ---> 321cd0625d49 Removing intermediate container a3157bec51dd Step 7/10 : RUN mkdir -p /usr/share/kubevirt/virt-launcher ---> Running in 7b90657d4f6f  ---> 20d6dc51e8ed Removing intermediate container 7b90657d4f6f Step 8/10 : COPY entrypoint.sh libvirtd.sh sock-connector /usr/share/kubevirt/virt-launcher/ ---> 71b543ffd484 Removing intermediate container 37da00c65786 Step 9/10 : ENTRYPOINT /usr/share/kubevirt/virt-launcher/entrypoint.sh ---> Running in bb6e439e64e1 ---> e0aa41ccb749 Removing intermediate container bb6e439e64e1 Step 10/10 : LABEL "kubevirt-functional-tests-k8s-1.10.4-release1" '' "virt-launcher" '' ---> Running in a3a82c8b57f7 ---> a34ae519af72 Removing intermediate container a3a82c8b57f7 Successfully built a34ae519af72 Sending build context to Docker daemon 41.7 MB Step 1/5 : FROM fedora:28 ---> cc510acfcd70 Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/5 : COPY virt-handler /usr/bin/virt-handler ---> c650b727c5df Removing intermediate container b2ba41a2c8cf Step 4/5 : ENTRYPOINT /usr/bin/virt-handler ---> Running in 5d098a017302 ---> 4cf18c9bc10d Removing intermediate container 5d098a017302 Step 5/5 : LABEL "kubevirt-functional-tests-k8s-1.10.4-release1" '' "virt-handler" '' ---> Running in fcfede4ed698 ---> 15437fdaac31 Removing intermediate container fcfede4ed698 Successfully built 15437fdaac31 Sending build context to Docker daemon 38.81 MB Step 1/8 : FROM fedora:28 ---> cc510acfcd70 Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virt-api ---> Using cache ---> ed1ebf600ee1 Step 4/8 : WORKDIR /home/virt-api ---> Using cache ---> 0769dad023e5 Step 5/8 : USER 1001 ---> Using cache ---> 0cb65afb0c2b Step 6/8 : COPY virt-api /usr/bin/virt-api ---> 720c4e1761d9 Removing intermediate container cba95cb28db2 Step 7/8 : ENTRYPOINT /usr/bin/virt-api ---> Running in a5c03aeb3163 ---> 205967948175 Removing intermediate container a5c03aeb3163 Step 8/8 : LABEL "kubevirt-functional-tests-k8s-1.10.4-release1" '' "virt-api" '' ---> Running in 8f4f48a8d005 ---> 184f487f604c Removing intermediate container 8f4f48a8d005 Successfully built 184f487f604c Sending build context to Docker daemon 4.096 kB Step 1/7 : FROM fedora:28 ---> cc510acfcd70 Step 2/7 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/7 : ENV container docker ---> Using cache ---> 62847a2a1fa8 Step 4/7 : RUN mkdir -p /images/custom /images/alpine && truncate -s 64M /images/custom/disk.img && curl http://dl-cdn.alpinelinux.org/alpine/v3.7/releases/x86_64/alpine-virt-3.7.0-x86_64.iso > /images/alpine/disk.img ---> Using cache ---> 02134835a6aa Step 5/7 : ADD entrypoint.sh / ---> Using cache ---> ec0843818da7 Step 6/7 : CMD /entrypoint.sh ---> Using cache ---> 754029bb4bd2 Step 7/7 : LABEL "disks-images-provider" '' "kubevirt-functional-tests-k8s-1.10.4-release1" '' ---> Using cache ---> 627ff0913f8a Successfully built 627ff0913f8a Sending build context to Docker daemon 2.56 kB Step 1/5 : FROM fedora:28 ---> cc510acfcd70 Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/5 : ENV container docker ---> Using cache ---> 62847a2a1fa8 Step 4/5 : RUN dnf -y install procps-ng nmap-ncat && dnf -y clean all ---> Using cache ---> 207487abe7b2 Step 5/5 : LABEL "kubevirt-functional-tests-k8s-1.10.4-release1" '' "vm-killer" '' ---> Using cache ---> d971f9663974 Successfully built d971f9663974 Sending build context to Docker daemon 5.12 kB Step 1/7 : FROM debian:sid ---> 68f33cf86aab Step 2/7 : MAINTAINER "David Vossel" \ ---> Using cache ---> 5734d749eb5c Step 3/7 : ENV container docker ---> Using cache ---> f8775a77966f Step 4/7 : RUN apt-get update && apt-get install -y bash curl bzip2 qemu-utils && mkdir -p /disk && rm -rf /var/lib/apt/lists/* ---> Using cache ---> 1a40cf222a61 Step 5/7 : ADD entry-point.sh / ---> Using cache ---> 77b545d92fe7 Step 6/7 : CMD /entry-point.sh ---> Using cache ---> dfe20d463305 Step 7/7 : LABEL "kubevirt-functional-tests-k8s-1.10.4-release1" '' "registry-disk-v1alpha" '' ---> Using cache ---> 85e79af02f0d Successfully built 85e79af02f0d Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33766/kubevirt/registry-disk-v1alpha:devel ---> 85e79af02f0d Step 2/4 : MAINTAINER "David Vossel" \ ---> Using cache ---> 26a11cc9948b Step 3/4 : RUN curl https://download.cirros-cloud.net/0.4.0/cirros-0.4.0-x86_64-disk.img > /disk/cirros.img ---> Using cache ---> 15845dbfc616 Step 4/4 : LABEL "cirros-registry-disk-demo" '' "kubevirt-functional-tests-k8s-1.10.4-release1" '' ---> Using cache ---> a060b56e1095 Successfully built a060b56e1095 Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33766/kubevirt/registry-disk-v1alpha:devel ---> 85e79af02f0d Step 2/4 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 0d3e3061f693 Step 3/4 : RUN curl -g -L https://download.fedoraproject.org/pub/fedora/linux/releases/27/CloudImages/x86_64/images/Fedora-Cloud-Base-27-1.6.x86_64.qcow2 > /disk/fedora.qcow2 ---> Using cache ---> faaecf74e262 Step 4/4 : LABEL "fedora-cloud-registry-disk-demo" '' "kubevirt-functional-tests-k8s-1.10.4-release1" '' ---> Using cache ---> d4ba77eb0b4f Successfully built d4ba77eb0b4f Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33766/kubevirt/registry-disk-v1alpha:devel ---> 85e79af02f0d Step 2/4 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 0d3e3061f693 Step 3/4 : RUN curl http://dl-cdn.alpinelinux.org/alpine/v3.7/releases/x86_64/alpine-virt-3.7.0-x86_64.iso > /disk/alpine.iso ---> Using cache ---> 299fe25a74ad Step 4/4 : LABEL "alpine-registry-disk-demo" '' "kubevirt-functional-tests-k8s-1.10.4-release1" '' ---> Using cache ---> effc69d81975 Successfully built effc69d81975 Sending build context to Docker daemon 35.59 MB Step 1/8 : FROM fedora:28 ---> cc510acfcd70 Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virtctl ---> Using cache ---> 985fe391c056 Step 4/8 : WORKDIR /home/virtctl ---> Using cache ---> 3b2cae8ac543 Step 5/8 : USER 1001 ---> Using cache ---> 0c06e5b4a900 Step 6/8 : COPY subresource-access-test /subresource-access-test ---> bbd82722cee7 Removing intermediate container a1c6a07732fe Step 7/8 : ENTRYPOINT /subresource-access-test ---> Running in d91e50ab7e06 ---> 71fcfdaec836 Removing intermediate container d91e50ab7e06 Step 8/8 : LABEL "kubevirt-functional-tests-k8s-1.10.4-release1" '' "subresource-access-test" '' ---> Running in 6f444d8c0cb2 ---> 5c58fa1b07c0 Removing intermediate container 6f444d8c0cb2 Successfully built 5c58fa1b07c0 Sending build context to Docker daemon 3.072 kB Step 1/9 : FROM fedora:28 ---> cc510acfcd70 Step 2/9 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/9 : ENV container docker ---> Using cache ---> 62847a2a1fa8 Step 4/9 : RUN dnf -y install make git gcc && dnf -y clean all ---> Using cache ---> d3456b1644b1 Step 5/9 : ENV GIMME_GO_VERSION 1.9.2 ---> Using cache ---> 0ba81fddbba1 Step 6/9 : RUN mkdir -p /gimme && curl -sL https://raw.githubusercontent.com/travis-ci/gimme/master/gimme | HOME=/gimme bash >> /etc/profile.d/gimme.sh ---> Using cache ---> 5d33abe3f819 Step 7/9 : ENV GOPATH "/go" GOBIN "/usr/bin" ---> Using cache ---> 783826523be1 Step 8/9 : RUN mkdir -p /go && source /etc/profile.d/gimme.sh && go get github.com/masterzen/winrm-cli ---> Using cache ---> 711bc8d15952 Step 9/9 : LABEL "kubevirt-functional-tests-k8s-1.10.4-release1" '' "winrmcli" '' ---> Using cache ---> d9c1e709dad2 Successfully built d9c1e709dad2 Sending build context to Docker daemon 36.8 MB Step 1/5 : FROM fedora:27 ---> 9110ae7f579f Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> e3238544ad97 Step 3/5 : COPY example-hook-sidecar /example-hook-sidecar ---> cfc9deee8193 Removing intermediate container 3c050d10b3bd Step 4/5 : ENTRYPOINT /example-hook-sidecar ---> Running in 433f4c317e93 ---> 0280894c164e Removing intermediate container 433f4c317e93 Step 5/5 : LABEL "example-hook-sidecar" '' "kubevirt-functional-tests-k8s-1.10.4-release1" '' ---> Running in 125af4a35e28 ---> e87711863b60 Removing intermediate container 125af4a35e28 Successfully built e87711863b60 hack/build-docker.sh push The push refers to a repository [localhost:33766/kubevirt/virt-controller] bc4a0c364265: Preparing aa89340cf7a8: Preparing 891e1e4ef82a: Preparing aa89340cf7a8: Pushed bc4a0c364265: Pushed 891e1e4ef82a: Pushed devel: digest: sha256:caf9a4953644d789b88529f17c4b3f207eebfb14886a5da7b53e5d3df9287d3c size: 949 The push refers to a repository [localhost:33766/kubevirt/virt-launcher] 39447a383871: Preparing b2f58085979e: Preparing 0c2bc01e9ba4: Preparing 0296f0988d0e: Preparing 57934fc1b8f5: Preparing 633427c64a24: Preparing da38cf808aa5: Preparing b83399358a92: Preparing 186d8b3e4fd8: Preparing fa6154170bf5: Preparing 5eefb9960a36: Preparing 891e1e4ef82a: Preparing 186d8b3e4fd8: Waiting 57934fc1b8f5: Waiting b83399358a92: Waiting 5eefb9960a36: Waiting 891e1e4ef82a: Waiting 633427c64a24: Waiting fa6154170bf5: Waiting da38cf808aa5: Waiting b2f58085979e: Pushed 0296f0988d0e: Pushed 39447a383871: Pushed da38cf808aa5: Pushed b83399358a92: Pushed 186d8b3e4fd8: Pushed fa6154170bf5: Pushed 891e1e4ef82a: Mounted from kubevirt/virt-controller 0c2bc01e9ba4: Pushed 633427c64a24: Pushed 57934fc1b8f5: Pushed 5eefb9960a36: Pushed devel: digest: sha256:1870b1067d5f4f8959b4183fcb2a4fe87c8dbdbf26c04a89acfaaeffabc077cb size: 2828 The push refers to a repository [localhost:33766/kubevirt/virt-handler] 9d86f47781a0: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/virt-launcher 9d86f47781a0: Pushed devel: digest: sha256:f7fe39196d571a7f95b26de3c166f906f2d46423aab8f466f3feea524d59ae28 size: 741 The push refers to a repository [localhost:33766/kubevirt/virt-api] 047012f3eae8: Preparing 82fc744c99b4: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/virt-handler 82fc744c99b4: Pushed 047012f3eae8: Pushed devel: digest: sha256:dec8644ace0350f81d2932d14ac4f69ad18d3157b22ccae382a495a023bd80a3 size: 948 The push refers to a repository [localhost:33766/kubevirt/disks-images-provider] 71ad31feb2c5: Preparing 21d4b721776e: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/virt-api 71ad31feb2c5: Pushed 21d4b721776e: Pushed devel: digest: sha256:9c38b17eefb514ec17a7ec8076106f4795575f714f9f74d79989eccf277403a7 size: 948 The push refers to a repository [localhost:33766/kubevirt/vm-killer] c4cfadeeaf5f: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/disks-images-provider c4cfadeeaf5f: Pushed devel: digest: sha256:fafdb480fdb46c6d3e9a21c85179371daaa3ed03387664d0b54e1c8ae7de073b size: 740 The push refers to a repository [localhost:33766/kubevirt/registry-disk-v1alpha] 661cce8d8e52: Preparing 41e0baba3077: Preparing 25edbec0eaea: Preparing 661cce8d8e52: Pushed 41e0baba3077: Pushed 25edbec0eaea: Pushed devel: digest: sha256:c5058ac023abdcba834fa283970de554e01415e93cb1e5e051ca68250b3a2933 size: 948 The push refers to a repository [localhost:33766/kubevirt/cirros-registry-disk-demo] 5c0c6e5f806f: Preparing 661cce8d8e52: Preparing 41e0baba3077: Preparing 25edbec0eaea: Preparing 41e0baba3077: Mounted from kubevirt/registry-disk-v1alpha 661cce8d8e52: Mounted from kubevirt/registry-disk-v1alpha 25edbec0eaea: Mounted from kubevirt/registry-disk-v1alpha 5c0c6e5f806f: Pushed devel: digest: sha256:53f93b4b2717773a7bd7ff2a17c99a21d5a566fa919f6fb658c889965f5eff51 size: 1160 The push refers to a repository [localhost:33766/kubevirt/fedora-cloud-registry-disk-demo] 4238c97ab88b: Preparing 661cce8d8e52: Preparing 41e0baba3077: Preparing 25edbec0eaea: Preparing 661cce8d8e52: Mounted from kubevirt/cirros-registry-disk-demo 25edbec0eaea: Mounted from kubevirt/cirros-registry-disk-demo 41e0baba3077: Mounted from kubevirt/cirros-registry-disk-demo 4238c97ab88b: Pushed devel: digest: sha256:5764f27cfc3c8514ae806da5be4f6301fb6b3619f452b8fd8d828862e3cb1cb7 size: 1161 The push refers to a repository [localhost:33766/kubevirt/alpine-registry-disk-demo] 73bd0eb85640: Preparing 661cce8d8e52: Preparing 41e0baba3077: Preparing 25edbec0eaea: Preparing 41e0baba3077: Mounted from kubevirt/fedora-cloud-registry-disk-demo 25edbec0eaea: Mounted from kubevirt/fedora-cloud-registry-disk-demo 661cce8d8e52: Mounted from kubevirt/fedora-cloud-registry-disk-demo 73bd0eb85640: Pushed devel: digest: sha256:4d57e4bdf32e9ed31b37c56ca0b4ff4bb7768601f68e9c156ee4a1fe49e7512a size: 1160 The push refers to a repository [localhost:33766/kubevirt/subresource-access-test] 79ac8e150051: Preparing 25cb73590a9d: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/vm-killer 25cb73590a9d: Pushed 79ac8e150051: Pushed devel: digest: sha256:1c0960efd741f74a5bbfec4c3afdd973d6ea20ebb906867278d8344011b6011a size: 948 The push refers to a repository [localhost:33766/kubevirt/winrmcli] f8083e002d0b: Preparing 53c709abc882: Preparing 9ca98a0f492b: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/subresource-access-test f8083e002d0b: Pushed 9ca98a0f492b: Pushed 53c709abc882: Pushed devel: digest: sha256:933ba893225d50903cc2706df2af7aa600f3dd7911ef35f88cfebb08cd5bd8ac size: 1165 The push refers to a repository [localhost:33766/kubevirt/example-hook-sidecar] 5d648f282316: Preparing 39bae602f753: Preparing 5d648f282316: Pushed 39bae602f753: Pushed devel: digest: sha256:53b78a1896fe318d8e1b14c4d9ae7945f5094ad548fa626347fa8f5634be973c size: 740 make[1]: Leaving directory `/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt' Done ./cluster/clean.sh + source hack/common.sh ++++ dirname 'hack/common.sh[0]' +++ cd hack/../ +++ pwd ++ KUBEVIRT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt ++ OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out ++ VENDOR_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/vendor ++ CMD_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/cmd ++ TESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/tests ++ APIDOCS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/apidocs ++ MANIFESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/manifests ++ MANIFEST_TEMPLATES_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/templates/manifests ++ PYTHON_CLIENT_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/client-python ++ KUBEVIRT_PROVIDER=k8s-1.10.4 ++ KUBEVIRT_NUM_NODES=2 ++ '[' -z kubevirt-functional-tests-k8s-1.10.4-release ']' ++ provider_prefix=kubevirt-functional-tests-k8s-1.10.4-release1 ++ job_prefix=kubevirt-functional-tests-k8s-1.10.4-release1 +++ kubevirt_version +++ '[' -n '' ']' +++ '[' -d /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/.git ']' ++++ git describe --always --tags +++ echo v0.7.0-200-g25fa194 ++ KUBEVIRT_VERSION=v0.7.0-200-g25fa194 + source cluster/k8s-1.10.4/provider.sh ++ set -e ++ image=k8s-1.10.4@sha256:09ac918cc16f13a5d0af51d4c98e3e25cbf4f97b7b32fe18ec61b32f04ca1009 ++ source cluster/ephemeral-provider-common.sh +++ set -e +++ _cli='docker run --privileged --net=host --rm -v /var/run/docker.sock:/var/run/docker.sock kubevirtci/gocli@sha256:aa7f295a7908fa333ab5e98ef3af0bfafbabfd3cee2b83f9af47f722e3000f6a' + source hack/config.sh ++ unset binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig manifest_docker_prefix namespace image_pull_policy ++ KUBEVIRT_PROVIDER=k8s-1.10.4 ++ source hack/config-default.sh source hack/config-k8s-1.10.4.sh +++ binaries='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virtctl cmd/fake-qemu-process cmd/virt-api cmd/subresource-access-test cmd/example-hook-sidecar' +++ docker_images='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virt-api images/disks-images-provider images/vm-killer cmd/registry-disk-v1alpha images/cirros-registry-disk-demo images/fedora-cloud-registry-disk-demo images/alpine-registry-disk-demo cmd/subresource-access-test images/winrmcli cmd/example-hook-sidecar' +++ docker_prefix=kubevirt +++ docker_tag=latest +++ master_ip=192.168.200.2 +++ network_provider=flannel +++ namespace=kube-system +++ image_pull_policy=IfNotPresent ++ test -f hack/config-provider-k8s-1.10.4.sh ++ source hack/config-provider-k8s-1.10.4.sh +++ master_ip=127.0.0.1 +++ docker_tag=devel +++ kubeconfig=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/cluster/k8s-1.10.4/.kubeconfig +++ kubectl=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/cluster/k8s-1.10.4/.kubectl +++ docker_prefix=localhost:33766/kubevirt +++ manifest_docker_prefix=registry:5000/kubevirt ++ test -f hack/config-local.sh ++ export binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig namespace image_pull_policy + echo 'Cleaning up ...' Cleaning up ... + cluster/kubectl.sh get vmis --all-namespaces -o=custom-columns=NAME:.metadata.name,NAMESPACE:.metadata.namespace,FINALIZERS:.metadata.finalizers --no-headers + grep foregroundDeleteVirtualMachine + read p error: the server doesn't have a resource type "vmis" + _kubectl delete ds -l kubevirt.io -n kube-system --cascade=false --grace-period 0 No resources found + _kubectl delete pods -n kube-system -l=kubevirt.io=libvirt --force --grace-period 0 No resources found + _kubectl delete pods -n kube-system -l=kubevirt.io=virt-handler --force --grace-period 0 No resources found + namespaces=(default ${namespace}) + for i in '${namespaces[@]}' + _kubectl -n default delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete apiservices -l kubevirt.io No resources found + _kubectl -n default delete deployment -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete deployment -l kubevirt.io No resources found + _kubectl -n default delete rs -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete rs -l kubevirt.io No resources found + _kubectl -n default delete services -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete services -l kubevirt.io No resources found + _kubectl -n default delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete apiservices -l kubevirt.io No resources found + _kubectl -n default delete validatingwebhookconfiguration -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete validatingwebhookconfiguration -l kubevirt.io No resources found + _kubectl -n default delete secrets -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete secrets -l kubevirt.io No resources found + _kubectl -n default delete pv -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete pv -l kubevirt.io No resources found + _kubectl -n default delete pvc -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete pvc -l kubevirt.io No resources found + _kubectl -n default delete ds -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete ds -l kubevirt.io No resources found + _kubectl -n default delete customresourcedefinitions -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete customresourcedefinitions -l kubevirt.io No resources found + _kubectl -n default delete pods -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete pods -l kubevirt.io No resources found + _kubectl -n default delete clusterrolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete clusterrolebinding -l kubevirt.io No resources found + _kubectl -n default delete rolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete rolebinding -l kubevirt.io No resources found + _kubectl -n default delete roles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete roles -l kubevirt.io No resources found + _kubectl -n default delete clusterroles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete clusterroles -l kubevirt.io No resources found + _kubectl -n default delete serviceaccounts -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete serviceaccounts -l kubevirt.io No resources found ++ _kubectl -n default get crd offlinevirtualmachines.kubevirt.io ++ wc -l ++ export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig ++ KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig ++ cluster/k8s-1.10.4/.kubectl -n default get crd offlinevirtualmachines.kubevirt.io Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "offlinevirtualmachines.kubevirt.io" not found + '[' 0 -gt 0 ']' + for i in '${namespaces[@]}' + _kubectl -n kube-system delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete apiservices -l kubevirt.io No resources found + _kubectl -n kube-system delete deployment -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete deployment -l kubevirt.io No resources found + _kubectl -n kube-system delete rs -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete rs -l kubevirt.io No resources found + _kubectl -n kube-system delete services -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete services -l kubevirt.io No resources found + _kubectl -n kube-system delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete apiservices -l kubevirt.io No resources found + _kubectl -n kube-system delete validatingwebhookconfiguration -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete validatingwebhookconfiguration -l kubevirt.io No resources found + _kubectl -n kube-system delete secrets -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete secrets -l kubevirt.io No resources found + _kubectl -n kube-system delete pv -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete pv -l kubevirt.io No resources found + _kubectl -n kube-system delete pvc -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete pvc -l kubevirt.io No resources found + _kubectl -n kube-system delete ds -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete ds -l kubevirt.io No resources found + _kubectl -n kube-system delete customresourcedefinitions -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete customresourcedefinitions -l kubevirt.io No resources found + _kubectl -n kube-system delete pods -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete pods -l kubevirt.io No resources found + _kubectl -n kube-system delete clusterrolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete clusterrolebinding -l kubevirt.io No resources found + _kubectl -n kube-system delete rolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete rolebinding -l kubevirt.io No resources found + _kubectl -n kube-system delete roles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete roles -l kubevirt.io No resources found + _kubectl -n kube-system delete clusterroles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete clusterroles -l kubevirt.io No resources found + _kubectl -n kube-system delete serviceaccounts -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete serviceaccounts -l kubevirt.io No resources found ++ _kubectl -n kube-system get crd offlinevirtualmachines.kubevirt.io ++ export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig ++ KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig ++ cluster/k8s-1.10.4/.kubectl -n kube-system get crd offlinevirtualmachines.kubevirt.io ++ wc -l Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "offlinevirtualmachines.kubevirt.io" not found + '[' 0 -gt 0 ']' + sleep 2 + echo Done Done ./cluster/deploy.sh + source hack/common.sh ++++ dirname 'hack/common.sh[0]' +++ cd hack/../ +++ pwd ++ KUBEVIRT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt ++ OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out ++ VENDOR_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/vendor ++ CMD_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/cmd ++ TESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/tests ++ APIDOCS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/apidocs ++ MANIFESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/manifests ++ MANIFEST_TEMPLATES_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/templates/manifests ++ PYTHON_CLIENT_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/client-python ++ KUBEVIRT_PROVIDER=k8s-1.10.4 ++ KUBEVIRT_NUM_NODES=2 ++ '[' -z kubevirt-functional-tests-k8s-1.10.4-release ']' ++ provider_prefix=kubevirt-functional-tests-k8s-1.10.4-release1 ++ job_prefix=kubevirt-functional-tests-k8s-1.10.4-release1 +++ kubevirt_version +++ '[' -n '' ']' +++ '[' -d /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/.git ']' ++++ git describe --always --tags +++ echo v0.7.0-200-g25fa194 ++ KUBEVIRT_VERSION=v0.7.0-200-g25fa194 + source cluster/k8s-1.10.4/provider.sh ++ set -e ++ image=k8s-1.10.4@sha256:09ac918cc16f13a5d0af51d4c98e3e25cbf4f97b7b32fe18ec61b32f04ca1009 ++ source cluster/ephemeral-provider-common.sh +++ set -e +++ _cli='docker run --privileged --net=host --rm -v /var/run/docker.sock:/var/run/docker.sock kubevirtci/gocli@sha256:aa7f295a7908fa333ab5e98ef3af0bfafbabfd3cee2b83f9af47f722e3000f6a' + source hack/config.sh ++ unset binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig manifest_docker_prefix namespace image_pull_policy ++ KUBEVIRT_PROVIDER=k8s-1.10.4 ++ source hack/config-default.sh source hack/config-k8s-1.10.4.sh +++ binaries='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virtctl cmd/fake-qemu-process cmd/virt-api cmd/subresource-access-test cmd/example-hook-sidecar' +++ docker_images='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virt-api images/disks-images-provider images/vm-killer cmd/registry-disk-v1alpha images/cirros-registry-disk-demo images/fedora-cloud-registry-disk-demo images/alpine-registry-disk-demo cmd/subresource-access-test images/winrmcli cmd/example-hook-sidecar' +++ docker_prefix=kubevirt +++ docker_tag=latest +++ master_ip=192.168.200.2 +++ network_provider=flannel +++ namespace=kube-system +++ image_pull_policy=IfNotPresent ++ test -f hack/config-provider-k8s-1.10.4.sh ++ source hack/config-provider-k8s-1.10.4.sh +++ master_ip=127.0.0.1 +++ docker_tag=devel +++ kubeconfig=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/cluster/k8s-1.10.4/.kubeconfig +++ kubectl=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/cluster/k8s-1.10.4/.kubectl +++ docker_prefix=localhost:33766/kubevirt +++ manifest_docker_prefix=registry:5000/kubevirt ++ test -f hack/config-local.sh ++ export binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig namespace image_pull_policy + echo 'Deploying ...' Deploying ... + [[ -z k8s-1.10.4-release ]] + [[ k8s-1.10.4-release =~ .*-dev ]] + [[ k8s-1.10.4-release =~ .*-release ]] + for manifest in '${MANIFESTS_OUT_DIR}/release/*' + [[ /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/manifests/release/demo-content.yaml =~ .*demo.* ]] + continue + for manifest in '${MANIFESTS_OUT_DIR}/release/*' + [[ /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/manifests/release/kubevirt.yaml =~ .*demo.* ]] + _kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/manifests/release/kubevirt.yaml + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/manifests/release/kubevirt.yaml clusterrole.rbac.authorization.k8s.io "kubevirt.io:admin" created clusterrole.rbac.authorization.k8s.io "kubevirt.io:edit" created clusterrole.rbac.authorization.k8s.io "kubevirt.io:view" created serviceaccount "kubevirt-apiserver" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-apiserver" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-apiserver-auth-delegator" created rolebinding.rbac.authorization.k8s.io "kubevirt-apiserver" created role.rbac.authorization.k8s.io "kubevirt-apiserver" created clusterrole.rbac.authorization.k8s.io "kubevirt-apiserver" created clusterrole.rbac.authorization.k8s.io "kubevirt-controller" created serviceaccount "kubevirt-controller" created serviceaccount "kubevirt-privileged" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-controller" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-controller-cluster-admin" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-privileged-cluster-admin" created clusterrole.rbac.authorization.k8s.io "kubevirt.io:default" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt.io:default" created service "virt-api" created deployment.extensions "virt-api" created deployment.extensions "virt-controller" created daemonset.extensions "virt-handler" created customresourcedefinition.apiextensions.k8s.io "virtualmachineinstances.kubevirt.io" created customresourcedefinition.apiextensions.k8s.io "virtualmachineinstancereplicasets.kubevirt.io" created customresourcedefinition.apiextensions.k8s.io "virtualmachineinstancepresets.kubevirt.io" created customresourcedefinition.apiextensions.k8s.io "virtualmachines.kubevirt.io" created + _kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/manifests/testing -R + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/manifests/testing -R persistentvolumeclaim "disk-alpine" created persistentvolume "host-path-disk-alpine" created persistentvolumeclaim "disk-custom" created persistentvolume "host-path-disk-custom" created daemonset.extensions "disks-images-provider" created serviceaccount "kubevirt-testing" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-testing-cluster-admin" created + [[ k8s-1.10.4 =~ os-* ]] + echo Done Done + namespaces=(kube-system default) + [[ kube-system != \k\u\b\e\-\s\y\s\t\e\m ]] + timeout=300 + sample=30 + for i in '${namespaces[@]}' + current_time=0 ++ kubectl get pods -n kube-system --no-headers ++ grep -v Running ++ cluster/kubectl.sh get pods -n kube-system --no-headers + '[' -n 'virt-api-7d79764579-cv9g2 0/1 ContainerCreating 0 4s virt-api-7d79764579-wr2sl 0/1 ContainerCreating 0 4s virt-controller-7d57d96b65-2hbsp 0/1 ContainerCreating 0 4s virt-controller-7d57d96b65-fp8vk 0/1 ContainerCreating 0 4s virt-handler-g2ghf 0/1 ContainerCreating 0 4s virt-handler-n7bx6 0/1 ContainerCreating 0 4s' ']' + echo 'Waiting for kubevirt pods to enter the Running state ...' Waiting for kubevirt pods to enter the Running state ... + kubectl get pods -n kube-system --no-headers + cluster/kubectl.sh get pods -n kube-system --no-headers + grep -v Running disks-images-provider-9tm22 0/1 ContainerCreating 0 3s disks-images-provider-crp69 0/1 ContainerCreating 0 3s virt-api-7d79764579-cv9g2 0/1 ContainerCreating 0 5s virt-api-7d79764579-wr2sl 0/1 ContainerCreating 0 5s virt-controller-7d57d96b65-2hbsp 0/1 ContainerCreating 0 5s virt-controller-7d57d96b65-fp8vk 0/1 ContainerCreating 0 5s virt-handler-g2ghf 0/1 ContainerCreating 0 5s virt-handler-n7bx6 0/1 ContainerCreating 0 5s + sleep 30 + current_time=30 + '[' 30 -gt 300 ']' ++ kubectl get pods -n kube-system --no-headers ++ cluster/kubectl.sh get pods -n kube-system --no-headers ++ grep -v Running + '[' -n '' ']' + current_time=0 ++ kubectl get pods -n kube-system '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers ++ cluster/kubectl.sh get pods -n kube-system '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers ++ grep false + '[' -n '' ']' + kubectl get pods -n kube-system + cluster/kubectl.sh get pods -n kube-system NAME READY STATUS RESTARTS AGE disks-images-provider-9tm22 1/1 Running 0 54s disks-images-provider-crp69 1/1 Running 0 54s etcd-node01 1/1 Running 0 14m kube-apiserver-node01 1/1 Running 0 14m kube-controller-manager-node01 1/1 Running 0 15m kube-dns-86f4d74b45-9cvx4 3/3 Running 0 15m kube-flannel-ds-bmnnf 1/1 Running 0 15m kube-flannel-ds-zq7v2 1/1 Running 0 15m kube-proxy-dvnl2 1/1 Running 0 15m kube-proxy-v98p2 1/1 Running 0 15m kube-scheduler-node01 1/1 Running 0 14m virt-api-7d79764579-cv9g2 1/1 Running 0 56s virt-api-7d79764579-wr2sl 1/1 Running 1 56s virt-controller-7d57d96b65-2hbsp 1/1 Running 0 56s virt-controller-7d57d96b65-fp8vk 1/1 Running 0 56s virt-handler-g2ghf 1/1 Running 0 56s virt-handler-n7bx6 1/1 Running 0 56s + for i in '${namespaces[@]}' + current_time=0 ++ kubectl get pods -n default --no-headers ++ cluster/kubectl.sh get pods -n default --no-headers ++ grep -v Running No resources found. + '[' -n '' ']' + current_time=0 ++ kubectl get pods -n default '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers ++ grep false ++ cluster/kubectl.sh get pods -n default '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers + '[' -n '' ']' + kubectl get pods -n default + cluster/kubectl.sh get pods -n default No resources found. + kubectl version + cluster/kubectl.sh version Client Version: version.Info{Major:"1", Minor:"10", GitVersion:"v1.10.4", GitCommit:"5ca598b4ba5abb89bb773071ce452e33fb66339d", GitTreeState:"clean", BuildDate:"2018-06-06T08:13:03Z", GoVersion:"go1.9.3", Compiler:"gc", Platform:"linux/amd64"} Server Version: version.Info{Major:"1", Minor:"10", GitVersion:"v1.10.4", GitCommit:"5ca598b4ba5abb89bb773071ce452e33fb66339d", GitTreeState:"clean", BuildDate:"2018-06-06T08:00:59Z", GoVersion:"go1.9.3", Compiler:"gc", Platform:"linux/amd64"} + ginko_params='--ginkgo.noColor --junit-output=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/junit.xml' + [[ k8s-1.10.4-release =~ windows.* ]] + FUNC_TEST_ARGS='--ginkgo.noColor --junit-output=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/junit.xml' + make functest hack/dockerized "hack/build-func-tests.sh" Sending build context to Docker daemon 5.632 kB Step 1/12 : FROM fedora:28 ---> cc510acfcd70 Step 2/12 : ENV LIBVIRT_VERSION 4.2.0 ---> Using cache ---> b1088795aeb6 Step 3/12 : RUN curl --output /etc/yum.repos.d/fedora-virt-preview.repo https://fedorapeople.org/groups/virt/virt-preview/fedora-virt-preview.repo ---> Using cache ---> 88f43b954f9f Step 4/12 : RUN dnf -y install libvirt-devel-${LIBVIRT_VERSION} make git mercurial sudo gcc findutils gradle rsync-daemon rsync qemu-img protobuf-compiler && dnf -y clean all ---> Using cache ---> 06c70b43758a Step 5/12 : ENV GIMME_GO_VERSION 1.10 ---> Using cache ---> e5b3ae738662 Step 6/12 : RUN mkdir -p /gimme && curl -sL https://raw.githubusercontent.com/travis-ci/gimme/master/gimme | HOME=/gimme bash >> /etc/profile.d/gimme.sh ---> Using cache ---> 3e3d43f49e45 Step 7/12 : ENV GOPATH "/go" GOBIN "/usr/bin" ---> Using cache ---> 73e8a3aa263a Step 8/12 : ADD rsyncd.conf /etc/rsyncd.conf ---> Using cache ---> bc244b1c712b Step 9/12 : RUN mkdir -p /go && source /etc/profile.d/gimme.sh && go get github.com/mattn/goveralls && go get -u github.com/Masterminds/glide && go get golang.org/x/tools/cmd/goimports && git clone https://github.com/mvdan/sh.git $GOPATH/src/mvdan.cc/sh && cd /go/src/mvdan.cc/sh/cmd/shfmt && git checkout v2.5.0 && go get mvdan.cc/sh/cmd/shfmt && go install && go get -u github.com/golang/mock/gomock && go get -u github.com/rmohr/mock/mockgen && go get -u github.com/rmohr/go-swagger-utils/swagger-doc && go get -u github.com/onsi/ginkgo/ginkgo && go get -u -d k8s.io/code-generator/cmd/deepcopy-gen && go get -u -d k8s.io/code-generator/cmd/defaulter-gen && go get -u -d k8s.io/code-generator/cmd/openapi-gen && cd /go/src/k8s.io/code-generator/cmd/deepcopy-gen && git checkout release-1.9 && go install && cd /go/src/k8s.io/code-generator/cmd/defaulter-gen && git checkout release-1.9 && go install && cd /go/src/k8s.io/code-generator/cmd/openapi-gen && git checkout release-1.9 && go install && go get -u -d github.com/golang/protobuf/protoc-gen-go && cd /go/src/github.com/golang/protobuf/protoc-gen-go && git checkout 1643683e1b54a9e88ad26d98f81400c8c9d9f4f9 && go install ---> Using cache ---> 4cd1786b2bc8 Step 10/12 : RUN pip install j2cli ---> Using cache ---> b51a532fa53a Step 11/12 : ADD entrypoint.sh /entrypoint.sh ---> Using cache ---> 3bc0185264f6 Step 12/12 : ENTRYPOINT /entrypoint.sh ---> Using cache ---> dcf2b21fa2ed Successfully built dcf2b21fa2ed go version go1.10 linux/amd64 go version go1.10 linux/amd64 Compiling tests... compiled tests.test hack/functests.sh Running Suite: Tests Suite ========================== Random Seed: 1533665746 Will run 151 of 151 specs • Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running level=info timestamp=2018-08-07T18:17:02.515500Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:17:04 http: TLS handshake error from 10.244.0.1:33938: EOF 2018/08/07 18:17:14 http: TLS handshake error from 10.244.0.1:33962: EOF 2018/08/07 18:17:24 http: TLS handshake error from 10.244.0.1:33986: EOF level=info timestamp=2018-08-07T18:17:32.451342Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:17:34 http: TLS handshake error from 10.244.0.1:34010: EOF 2018/08/07 18:17:44 http: TLS handshake error from 10.244.0.1:34034: EOF 2018/08/07 18:17:54 http: TLS handshake error from 10.244.0.1:34058: EOF level=info timestamp=2018-08-07T18:18:02.491067Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:18:04 http: TLS handshake error from 10.244.0.1:34082: EOF 2018/08/07 18:18:14 http: TLS handshake error from 10.244.0.1:34106: EOF 2018/08/07 18:18:24 http: TLS handshake error from 10.244.0.1:34130: EOF level=info timestamp=2018-08-07T18:18:32.533954Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:18:34 http: TLS handshake error from 10.244.0.1:34154: EOF 2018/08/07 18:18:44 http: TLS handshake error from 10.244.0.1:34178: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T18:17:28.638568Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:17:35 http: TLS handshake error from 10.244.1.1:38832: EOF 2018/08/07 18:17:45 http: TLS handshake error from 10.244.1.1:38838: EOF 2018/08/07 18:17:55 http: TLS handshake error from 10.244.1.1:38844: EOF level=info timestamp=2018-08-07T18:17:58.187304Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:17:58.750674Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:18:05 http: TLS handshake error from 10.244.1.1:38850: EOF level=info timestamp=2018-08-07T18:18:09.136225Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:18:09.140788Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:18:15 http: TLS handshake error from 10.244.1.1:38856: EOF 2018/08/07 18:18:25 http: TLS handshake error from 10.244.1.1:38862: EOF level=info timestamp=2018-08-07T18:18:28.327542Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:18:28.894020Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:18:35 http: TLS handshake error from 10.244.1.1:38868: EOF 2018/08/07 18:18:45 http: TLS handshake error from 10.244.1.1:38874: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T18:10:04.683896Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer kubeVirtNodeInformer" level=info timestamp=2018-08-07T18:10:04.683940Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmiPresetInformer" level=info timestamp=2018-08-07T18:10:04.683973Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmirsInformer" level=info timestamp=2018-08-07T18:10:04.684004Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer configMapInformer" level=info timestamp=2018-08-07T18:10:04.684267Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-08-07T18:10:04.687268Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-08-07T18:10:04.687448Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-08-07T18:10:04.687529Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-08-07T18:10:04.687892Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-08-07T18:15:47.533619Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicqqrgl2dfwqbsg94wccqbwzhrbhvbcbrdshsvqgqjghbzphfwd5m98sdrbtjlqv kind= uid=e85ed098-9a6d-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:15:47.542508Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicqqrgl2dfwqbsg94wccqbwzhrbhvbcbrdshsvqgqjghbzphfwd5m98sdrbtjlqv kind= uid=e85ed098-9a6d-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:15:47.719383Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicqqrgl2dfwqbsg94wccqbwzhrbhvbcbrdshsvqgqjghbzphfwd5m98sdrbtjlqv\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicqqrgl2dfwqbsg94wccqbwzhrbhvbcbrdshsvqgqjghbzphfwd5m98sdrbtjlqv" level=info timestamp=2018-08-07T18:15:47.773363Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicqqrgl2dfwqbsg94wccqbwzhrbhvbcbrdshsvqgqjghbzphfwd5m98sdrbtjlqv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmicqqrgl2dfwqbsg94wccqbwzhrbhvbcbrdshsvqgqjghbzphfwd5m98sdrbtjlqv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e85ed098-9a6d-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicqqrgl2dfwqbsg94wccqbwzhrbhvbcbrdshsvqgqjghbzphfwd5m98sdrbtjlqv" level=info timestamp=2018-08-07T18:15:47.941536Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmir975qt4plwv2jnltqtlsr5mfdlfkgwb8xfhqd6rzf6db6lm6l8rqqg8w2x6hpl5 kind= uid=e8b32715-9a6d-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:15:47.944662Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmir975qt4plwv2jnltqtlsr5mfdlfkgwb8xfhqd6rzf6db6lm6l8rqqg8w2x6hpl5 kind= uid=e8b32715-9a6d-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:10:01.514309Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-07T18:10:01.529963Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:01.530868Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:01.630434Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:01.690304Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:01.694395Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-launcher-testvmir975qt4plwv2jnltqtlsr5mfdlfkgwb8xfhqdmr6fc Pod phase: Pending level=info timestamp=2018-08-07T18:15:52.755754Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:15:52.756041Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:15:52.758732Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:16:04.830647Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:16:04.909563Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmir975qt4plwv2jnltqtlsr5mfdlfkgwb8xfhqd6rzf6db6lm6l8rqqg8w2x6hpl5" level=info timestamp=2018-08-07T18:16:04.911532Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:16:04.912002Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure [181.017 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 should start it [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:80 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T18:15:48.589179Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmir975qt4plwv2jnltqtlsr5mfdlfkgwb8xfhqd6rzf6db6lm6l8rqqg8w2x6hpl5 kind=VirtualMachineInstance uid=e8b32715-9a6d-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmir975qt4plwv2jnltqtlsr5mfdlfkgwb8xfhqdmr6fc" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running level=info timestamp=2018-08-07T18:20:02.524512Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:20:04 http: TLS handshake error from 10.244.0.1:34374: EOF 2018/08/07 18:20:14 http: TLS handshake error from 10.244.0.1:34398: EOF 2018/08/07 18:20:24 http: TLS handshake error from 10.244.0.1:34422: EOF level=info timestamp=2018-08-07T18:20:32.459366Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:20:34 http: TLS handshake error from 10.244.0.1:34446: EOF 2018/08/07 18:20:44 http: TLS handshake error from 10.244.0.1:34470: EOF 2018/08/07 18:20:54 http: TLS handshake error from 10.244.0.1:34494: EOF level=info timestamp=2018-08-07T18:21:02.529887Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:21:04 http: TLS handshake error from 10.244.0.1:34518: EOF 2018/08/07 18:21:14 http: TLS handshake error from 10.244.0.1:34542: EOF 2018/08/07 18:21:24 http: TLS handshake error from 10.244.0.1:34566: EOF level=info timestamp=2018-08-07T18:21:32.478289Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:21:34 http: TLS handshake error from 10.244.0.1:34590: EOF 2018/08/07 18:21:44 http: TLS handshake error from 10.244.0.1:34614: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T18:20:29.514867Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:20:35 http: TLS handshake error from 10.244.1.1:38940: EOF 2018/08/07 18:20:45 http: TLS handshake error from 10.244.1.1:38946: EOF 2018/08/07 18:20:55 http: TLS handshake error from 10.244.1.1:38952: EOF level=info timestamp=2018-08-07T18:20:59.011699Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:20:59.632396Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:21:05 http: TLS handshake error from 10.244.1.1:38958: EOF level=info timestamp=2018-08-07T18:21:09.448537Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:21:09.452536Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:21:15 http: TLS handshake error from 10.244.1.1:38964: EOF 2018/08/07 18:21:25 http: TLS handshake error from 10.244.1.1:38970: EOF level=info timestamp=2018-08-07T18:21:29.149034Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:21:29.749752Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:21:35 http: TLS handshake error from 10.244.1.1:38976: EOF 2018/08/07 18:21:45 http: TLS handshake error from 10.244.1.1:38982: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T18:10:04.684004Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer configMapInformer" level=info timestamp=2018-08-07T18:10:04.684267Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-08-07T18:10:04.687268Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-08-07T18:10:04.687448Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-08-07T18:10:04.687529Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-08-07T18:10:04.687892Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-08-07T18:15:47.533619Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicqqrgl2dfwqbsg94wccqbwzhrbhvbcbrdshsvqgqjghbzphfwd5m98sdrbtjlqv kind= uid=e85ed098-9a6d-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:15:47.542508Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicqqrgl2dfwqbsg94wccqbwzhrbhvbcbrdshsvqgqjghbzphfwd5m98sdrbtjlqv kind= uid=e85ed098-9a6d-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:15:47.719383Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicqqrgl2dfwqbsg94wccqbwzhrbhvbcbrdshsvqgqjghbzphfwd5m98sdrbtjlqv\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicqqrgl2dfwqbsg94wccqbwzhrbhvbcbrdshsvqgqjghbzphfwd5m98sdrbtjlqv" level=info timestamp=2018-08-07T18:15:47.773363Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicqqrgl2dfwqbsg94wccqbwzhrbhvbcbrdshsvqgqjghbzphfwd5m98sdrbtjlqv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmicqqrgl2dfwqbsg94wccqbwzhrbhvbcbrdshsvqgqjghbzphfwd5m98sdrbtjlqv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e85ed098-9a6d-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicqqrgl2dfwqbsg94wccqbwzhrbhvbcbrdshsvqgqjghbzphfwd5m98sdrbtjlqv" level=info timestamp=2018-08-07T18:15:47.941536Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmir975qt4plwv2jnltqtlsr5mfdlfkgwb8xfhqd6rzf6db6lm6l8rqqg8w2x6hpl5 kind= uid=e8b32715-9a6d-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:15:47.944662Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmir975qt4plwv2jnltqtlsr5mfdlfkgwb8xfhqd6rzf6db6lm6l8rqqg8w2x6hpl5 kind= uid=e8b32715-9a6d-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:18:48.899960Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9cr4qm26h6sqxkrht5tmc9cc77gb6 kind= uid=548dd828-9a6e-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:18:48.900947Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9cr4qm26h6sqxkrht5tmc9cc77gb6 kind= uid=548dd828-9a6e-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:18:49.021461Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9cr4qm26h6sqxkrht5tmc9cc77gb6\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9cr4qm26h6sqxkrht5tmc9cc77gb6" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:10:01.514309Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-07T18:10:01.529963Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:01.530868Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:01.630434Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:01.690304Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:01.694395Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-launcher-testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9crkk5lm Pod phase: Pending level=info timestamp=2018-08-07T18:18:52.996440Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:18:52.996754Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:18:52.998789Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:19:05.103081Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:19:05.175317Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9cr4qm26h6sqxkrht5tmc9cc77gb6" level=info timestamp=2018-08-07T18:19:05.177432Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:19:05.177903Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.755 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 should attach virt-launcher to it [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:86 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T18:18:49.552108Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9cr4qm26h6sqxkrht5tmc9cc77gb6 kind=VirtualMachineInstance uid=548dd828-9a6e-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9crkk5lm" •••• Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running level=info timestamp=2018-08-07T18:23:02.509975Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:23:04 http: TLS handshake error from 10.244.0.1:34806: EOF 2018/08/07 18:23:14 http: TLS handshake error from 10.244.0.1:34830: EOF 2018/08/07 18:23:24 http: TLS handshake error from 10.244.0.1:34854: EOF level=info timestamp=2018-08-07T18:23:32.520968Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:23:34 http: TLS handshake error from 10.244.0.1:34878: EOF 2018/08/07 18:23:44 http: TLS handshake error from 10.244.0.1:34902: EOF 2018/08/07 18:23:54 http: TLS handshake error from 10.244.0.1:34926: EOF level=info timestamp=2018-08-07T18:24:02.520168Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:24:04 http: TLS handshake error from 10.244.0.1:34950: EOF 2018/08/07 18:24:14 http: TLS handshake error from 10.244.0.1:34974: EOF 2018/08/07 18:24:24 http: TLS handshake error from 10.244.0.1:34998: EOF level=info timestamp=2018-08-07T18:24:32.544331Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:24:34 http: TLS handshake error from 10.244.0.1:35022: EOF 2018/08/07 18:24:44 http: TLS handshake error from 10.244.0.1:35046: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running 2018/08/07 18:23:25 http: TLS handshake error from 10.244.1.1:39042: EOF level=info timestamp=2018-08-07T18:23:29.661035Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:23:30.196293Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:23:35 http: TLS handshake error from 10.244.1.1:39048: EOF 2018/08/07 18:23:45 http: TLS handshake error from 10.244.1.1:39054: EOF 2018/08/07 18:23:55 http: TLS handshake error from 10.244.1.1:39060: EOF level=info timestamp=2018-08-07T18:23:59.790704Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:24:00.316674Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:24:05 http: TLS handshake error from 10.244.1.1:39066: EOF 2018/08/07 18:24:15 http: TLS handshake error from 10.244.1.1:39072: EOF 2018/08/07 18:24:25 http: TLS handshake error from 10.244.1.1:39078: EOF level=info timestamp=2018-08-07T18:24:29.916481Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:24:30.427243Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:24:35 http: TLS handshake error from 10.244.1.1:39084: EOF 2018/08/07 18:24:45 http: TLS handshake error from 10.244.1.1:39090: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T18:15:47.941536Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmir975qt4plwv2jnltqtlsr5mfdlfkgwb8xfhqd6rzf6db6lm6l8rqqg8w2x6hpl5 kind= uid=e8b32715-9a6d-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:15:47.944662Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmir975qt4plwv2jnltqtlsr5mfdlfkgwb8xfhqd6rzf6db6lm6l8rqqg8w2x6hpl5 kind= uid=e8b32715-9a6d-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:18:48.899960Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9cr4qm26h6sqxkrht5tmc9cc77gb6 kind= uid=548dd828-9a6e-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:18:48.900947Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9cr4qm26h6sqxkrht5tmc9cc77gb6 kind= uid=548dd828-9a6e-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:18:49.021461Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9cr4qm26h6sqxkrht5tmc9cc77gb6\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9cr4qm26h6sqxkrht5tmc9cc77gb6" level=info timestamp=2018-08-07T18:21:49.475656Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9cr4qm26h6sqxkrht5tmc9cc77gb6\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9cr4qm26h6sqxkrht5tmc9cc77gb6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 548dd828-9a6e-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9cr4qm26h6sqxkrht5tmc9cc77gb6" level=info timestamp=2018-08-07T18:21:50.150319Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmib7k45zpqzkhqgm49g57lp5l9v6vmw52wpq9njbg4v9pxljtjvpz6sv4v2vjkd6s kind= uid=c0974096-9a6e-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:21:50.151104Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmib7k45zpqzkhqgm49g57lp5l9v6vmw52wpq9njbg4v9pxljtjvpz6sv4v2vjkd6s kind= uid=c0974096-9a6e-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:21:50.272971Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib7k45zpqzkhqgm49g57lp5l9v6vmw52wpq9njbg4v9pxljtjvpz6sv4v2vjkd6s\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib7k45zpqzkhqgm49g57lp5l9v6vmw52wpq9njbg4v9pxljtjvpz6sv4v2vjkd6s" level=info timestamp=2018-08-07T18:21:50.351271Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib7k45zpqzkhqgm49g57lp5l9v6vmw52wpq9njbg4v9pxljtjvpz6sv4v2vjkd6s\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmib7k45zpqzkhqgm49g57lp5l9v6vmw52wpq9njbg4v9pxljtjvpz6sv4v2vjkd6s, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c0974096-9a6e-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib7k45zpqzkhqgm49g57lp5l9v6vmw52wpq9njbg4v9pxljtjvpz6sv4v2vjkd6s" level=info timestamp=2018-08-07T18:21:50.518922Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimwxpvbnfpmths9vfj9msrk4wsbk2n4cjm28mjp9znm65w5xzc2sfdxgbbp7mptq kind= uid=c0d129ce-9a6e-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:21:50.519251Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimwxpvbnfpmths9vfj9msrk4wsbk2n4cjm28mjp9znm65w5xzc2sfdxgbbp7mptq kind= uid=c0d129ce-9a6e-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:21:50.967785Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dzpxw5zttgd2q8nzhnk7wdxzkwm kind= uid=c113b42e-9a6e-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:21:50.970196Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dzpxw5zttgd2q8nzhnk7wdxzkwm kind= uid=c113b42e-9a6e-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:21:51.064477Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dzpxw5zttgd2q8nzhnk7wdxzkwm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dzpxw5zttgd2q8nzhnk7wdxzkwm" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:10:01.514309Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-07T18:10:01.529963Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:01.530868Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:01.630434Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:01.690304Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:01.694395Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-launcher-testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dgcrxl Pod phase: Pending level=info timestamp=2018-08-07T18:21:55.564685Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:21:55.565479Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:21:55.567650Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:22:07.885865Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:22:07.968526Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dzpxw5zttgd2q8nzhnk7wdxzkwm" level=info timestamp=2018-08-07T18:22:07.971355Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:22:07.971818Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure [180.741 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with boot order /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:174 should be able to boot from selected disk /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 Alpine as first boot [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: defining a VirtualMachineInstance with an Alpine disk STEP: adding a Cirros Disk STEP: setting boot order STEP: starting VirtualMachineInstance STEP: Waiting the VirtualMachineInstance start level=info timestamp=2018-08-07T18:21:51.620034Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dzpxw5zttgd2q8nzhnk7wdxzkwm kind=VirtualMachineInstance uid=c113b42e-9a6e-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dgcrxl" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running level=info timestamp=2018-08-07T18:26:02.509468Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:26:04 http: TLS handshake error from 10.244.0.1:35238: EOF 2018/08/07 18:26:14 http: TLS handshake error from 10.244.0.1:35262: EOF 2018/08/07 18:26:24 http: TLS handshake error from 10.244.0.1:35286: EOF level=info timestamp=2018-08-07T18:26:32.511541Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:26:34 http: TLS handshake error from 10.244.0.1:35310: EOF 2018/08/07 18:26:44 http: TLS handshake error from 10.244.0.1:35334: EOF 2018/08/07 18:26:54 http: TLS handshake error from 10.244.0.1:35358: EOF level=info timestamp=2018-08-07T18:27:02.485373Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:27:04 http: TLS handshake error from 10.244.0.1:35382: EOF 2018/08/07 18:27:14 http: TLS handshake error from 10.244.0.1:35406: EOF 2018/08/07 18:27:24 http: TLS handshake error from 10.244.0.1:35430: EOF level=info timestamp=2018-08-07T18:27:32.529284Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:27:34 http: TLS handshake error from 10.244.0.1:35454: EOF 2018/08/07 18:27:44 http: TLS handshake error from 10.244.0.1:35478: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running 2018/08/07 18:26:25 http: TLS handshake error from 10.244.1.1:39150: EOF level=info timestamp=2018-08-07T18:26:30.434742Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:26:30.891680Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:26:35 http: TLS handshake error from 10.244.1.1:39156: EOF 2018/08/07 18:26:45 http: TLS handshake error from 10.244.1.1:39162: EOF 2018/08/07 18:26:55 http: TLS handshake error from 10.244.1.1:39168: EOF level=info timestamp=2018-08-07T18:27:00.556367Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:27:01.020837Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:27:05 http: TLS handshake error from 10.244.1.1:39174: EOF 2018/08/07 18:27:15 http: TLS handshake error from 10.244.1.1:39180: EOF 2018/08/07 18:27:25 http: TLS handshake error from 10.244.1.1:39186: EOF level=info timestamp=2018-08-07T18:27:30.718274Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:27:31.128090Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:27:35 http: TLS handshake error from 10.244.1.1:39192: EOF 2018/08/07 18:27:45 http: TLS handshake error from 10.244.1.1:39198: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T18:18:48.900947Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9cr4qm26h6sqxkrht5tmc9cc77gb6 kind= uid=548dd828-9a6e-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:18:49.021461Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9cr4qm26h6sqxkrht5tmc9cc77gb6\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9cr4qm26h6sqxkrht5tmc9cc77gb6" level=info timestamp=2018-08-07T18:21:49.475656Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9cr4qm26h6sqxkrht5tmc9cc77gb6\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9cr4qm26h6sqxkrht5tmc9cc77gb6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 548dd828-9a6e-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmih9ljb7nmdq5l9n486j2wb2khtdn7blp2qb9cr4qm26h6sqxkrht5tmc9cc77gb6" level=info timestamp=2018-08-07T18:21:50.150319Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmib7k45zpqzkhqgm49g57lp5l9v6vmw52wpq9njbg4v9pxljtjvpz6sv4v2vjkd6s kind= uid=c0974096-9a6e-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:21:50.151104Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmib7k45zpqzkhqgm49g57lp5l9v6vmw52wpq9njbg4v9pxljtjvpz6sv4v2vjkd6s kind= uid=c0974096-9a6e-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:21:50.272971Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib7k45zpqzkhqgm49g57lp5l9v6vmw52wpq9njbg4v9pxljtjvpz6sv4v2vjkd6s\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib7k45zpqzkhqgm49g57lp5l9v6vmw52wpq9njbg4v9pxljtjvpz6sv4v2vjkd6s" level=info timestamp=2018-08-07T18:21:50.351271Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmib7k45zpqzkhqgm49g57lp5l9v6vmw52wpq9njbg4v9pxljtjvpz6sv4v2vjkd6s\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmib7k45zpqzkhqgm49g57lp5l9v6vmw52wpq9njbg4v9pxljtjvpz6sv4v2vjkd6s, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c0974096-9a6e-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmib7k45zpqzkhqgm49g57lp5l9v6vmw52wpq9njbg4v9pxljtjvpz6sv4v2vjkd6s" level=info timestamp=2018-08-07T18:21:50.518922Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimwxpvbnfpmths9vfj9msrk4wsbk2n4cjm28mjp9znm65w5xzc2sfdxgbbp7mptq kind= uid=c0d129ce-9a6e-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:21:50.519251Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimwxpvbnfpmths9vfj9msrk4wsbk2n4cjm28mjp9znm65w5xzc2sfdxgbbp7mptq kind= uid=c0d129ce-9a6e-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:21:50.967785Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dzpxw5zttgd2q8nzhnk7wdxzkwm kind= uid=c113b42e-9a6e-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:21:50.970196Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dzpxw5zttgd2q8nzhnk7wdxzkwm kind= uid=c113b42e-9a6e-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:21:51.064477Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dzpxw5zttgd2q8nzhnk7wdxzkwm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dzpxw5zttgd2q8nzhnk7wdxzkwm" level=info timestamp=2018-08-07T18:24:51.529714Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dzpxw5zttgd2q8nzhnk7wdxzkwm\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dzpxw5zttgd2q8nzhnk7wdxzkwm, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c113b42e-9a6e-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dzpxw5zttgd2q8nzhnk7wdxzkwm" level=info timestamp=2018-08-07T18:24:51.704388Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwzgzrbcq54jtv29hd7m4bllph6lbxnhmm75w8ln5628w2dm8kxbqcnvqznf2fc5 kind= uid=2cccf2b0-9a6f-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:24:51.705392Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwzgzrbcq54jtv29hd7m4bllph6lbxnhmm75w8ln5628w2dm8kxbqcnvqznf2fc5 kind= uid=2cccf2b0-9a6f-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:10:01.514309Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-07T18:10:01.529963Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:01.530868Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:01.630434Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:01.690304Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:01.694395Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-launcher-testvmiwzgzrbcq54jtv29hd7m4bllph6lbxnhmm75w8nchwl Pod phase: Pending level=info timestamp=2018-08-07T18:24:55.864509Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:24:55.865415Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:24:55.870049Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:25:06.810012Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:25:06.864456Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiwzgzrbcq54jtv29hd7m4bllph6lbxnhmm75w8ln5628w2dm8kxbqcnvqznf2fc5" level=info timestamp=2018-08-07T18:25:06.867042Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:25:06.867707Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.765 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with boot order /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:174 should be able to boot from selected disk /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 Cirros as first boot [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.013s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: defining a VirtualMachineInstance with an Alpine disk STEP: adding a Cirros Disk STEP: setting boot order STEP: starting VirtualMachineInstance STEP: Waiting the VirtualMachineInstance start level=info timestamp=2018-08-07T18:24:52.325821Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmiwzgzrbcq54jtv29hd7m4bllph6lbxnhmm75w8ln5628w2dm8kxbqcnvqznf2fc5 kind=VirtualMachineInstance uid=2cccf2b0-9a6f-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmiwzgzrbcq54jtv29hd7m4bllph6lbxnhmm75w8nchwl" • [SLOW TEST:60.339 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with user-data /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:205 without k8s secret /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:206 should retry starting the VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:207 ------------------------------ •! Panic [60.396 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with user-data /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:205 without k8s secret /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:206 should log warning and proceed once the secret is there [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:237 Test Panicked runtime error: invalid memory address or nil pointer dereference /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/panic.go:505 Full Stack Trace /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/panic.go:505 +0x229 kubevirt.io/kubevirt/tests_test.glob..func16.3.9.1.2() /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:258 +0x431 kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).runSync(0xc42076f620, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/tests/tests_suite_test.go:43 +0xaa testing.tRunner(0xc4205c9e00, 0x1432278) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:777 +0xd0 created by testing.(*T).Run /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:824 +0x2e0 ------------------------------ STEP: Starting a VirtualMachineInstance STEP: Checking that VirtualMachineInstance start failed level=info timestamp=2018-08-07T18:28:53.483342Z pos=utils.go:257 component=tests namespace=kubevirt-test-default name=testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm kind=VirtualMachineInstance uid=bc83d8bc-9a6f-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlhbfbnh" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running level=info timestamp=2018-08-07T18:31:02.562128Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:31:04 http: TLS handshake error from 10.244.0.1:35958: EOF 2018/08/07 18:31:14 http: TLS handshake error from 10.244.0.1:35982: EOF 2018/08/07 18:31:24 http: TLS handshake error from 10.244.0.1:36006: EOF level=info timestamp=2018-08-07T18:31:32.548925Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:31:34 http: TLS handshake error from 10.244.0.1:36030: EOF 2018/08/07 18:31:44 http: TLS handshake error from 10.244.0.1:36054: EOF 2018/08/07 18:31:54 http: TLS handshake error from 10.244.0.1:36078: EOF level=info timestamp=2018-08-07T18:32:02.480224Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:32:04 http: TLS handshake error from 10.244.0.1:36102: EOF 2018/08/07 18:32:14 http: TLS handshake error from 10.244.0.1:36126: EOF 2018/08/07 18:32:24 http: TLS handshake error from 10.244.0.1:36150: EOF level=info timestamp=2018-08-07T18:32:32.535959Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:32:34 http: TLS handshake error from 10.244.0.1:36174: EOF 2018/08/07 18:32:44 http: TLS handshake error from 10.244.0.1:36198: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running 2018/08/07 18:31:25 http: TLS handshake error from 10.244.1.1:39330: EOF level=info timestamp=2018-08-07T18:31:31.758512Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:31:32.033270Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:31:35 http: TLS handshake error from 10.244.1.1:39336: EOF 2018/08/07 18:31:45 http: TLS handshake error from 10.244.1.1:39342: EOF 2018/08/07 18:31:55 http: TLS handshake error from 10.244.1.1:39348: EOF level=info timestamp=2018-08-07T18:32:01.888713Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:32:02.145076Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:32:05 http: TLS handshake error from 10.244.1.1:39354: EOF 2018/08/07 18:32:15 http: TLS handshake error from 10.244.1.1:39360: EOF 2018/08/07 18:32:25 http: TLS handshake error from 10.244.1.1:39366: EOF level=info timestamp=2018-08-07T18:32:32.013225Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:32:32.258465Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:32:35 http: TLS handshake error from 10.244.1.1:39372: EOF 2018/08/07 18:32:45 http: TLS handshake error from 10.244.1.1:39378: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T18:21:50.970196Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dzpxw5zttgd2q8nzhnk7wdxzkwm kind= uid=c113b42e-9a6e-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:21:51.064477Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dzpxw5zttgd2q8nzhnk7wdxzkwm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dzpxw5zttgd2q8nzhnk7wdxzkwm" level=info timestamp=2018-08-07T18:24:51.529714Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dzpxw5zttgd2q8nzhnk7wdxzkwm\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dzpxw5zttgd2q8nzhnk7wdxzkwm, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c113b42e-9a6e-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9mgdpfbktsfmb9jmvjrs8bczzsmbsp7njpv5dzpxw5zttgd2q8nzhnk7wdxzkwm" level=info timestamp=2018-08-07T18:24:51.704388Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwzgzrbcq54jtv29hd7m4bllph6lbxnhmm75w8ln5628w2dm8kxbqcnvqznf2fc5 kind= uid=2cccf2b0-9a6f-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:24:51.705392Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwzgzrbcq54jtv29hd7m4bllph6lbxnhmm75w8ln5628w2dm8kxbqcnvqznf2fc5 kind= uid=2cccf2b0-9a6f-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:27:52.282278Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwzgzrbcq54jtv29hd7m4bllph6lbxnhmm75w8ln5628w2dm8kxbqcnvqznf2fc5\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiwzgzrbcq54jtv29hd7m4bllph6lbxnhmm75w8ln5628w2dm8kxbqcnvqznf2fc5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2cccf2b0-9a6f-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwzgzrbcq54jtv29hd7m4bllph6lbxnhmm75w8ln5628w2dm8kxbqcnvqznf2fc5" level=info timestamp=2018-08-07T18:27:52.445679Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiznr5d9gp5j98s52flkc9ltqvzxtgfsd6sn8ndfm4pl64b6f5m5hm9jcztr4hjgn kind= uid=988873b4-9a6f-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:27:52.446563Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiznr5d9gp5j98s52flkc9ltqvzxtgfsd6sn8ndfm4pl64b6f5m5hm9jcztr4hjgn kind= uid=988873b4-9a6f-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:28:52.654411Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiznr5d9gp5j98s52flkc9ltqvzxtgfsd6sn8ndfm4pl64b6f5m5hm9jcztr4hjgn\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiznr5d9gp5j98s52flkc9ltqvzxtgfsd6sn8ndfm4pl64b6f5m5hm9jcztr4hjgn, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 988873b4-9a6f-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiznr5d9gp5j98s52flkc9ltqvzxtgfsd6sn8ndfm4pl64b6f5m5hm9jcztr4hjgn" level=info timestamp=2018-08-07T18:28:52.822271Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm kind= uid=bc83d8bc-9a6f-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:28:52.822894Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm kind= uid=bc83d8bc-9a6f-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:28:52.948226Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm" level=info timestamp=2018-08-07T18:29:53.034645Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bc83d8bc-9a6f-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm" level=info timestamp=2018-08-07T18:29:53.184953Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdcqg8c7tmrbcqhmbr55dxxpnzwz kind= uid=e07fc037-9a6f-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:29:53.185553Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdcqg8c7tmrbcqhmbr55dxxpnzwz kind= uid=e07fc037-9a6f-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:10:01.514309Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-07T18:10:01.529963Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:01.530868Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:01.630434Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:01.690304Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:01.694395Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-launcher-testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdllncz Pod phase: Pending level=info timestamp=2018-08-07T18:29:57.245647Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:29:57.246243Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:29:57.249103Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:30:10.066311Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:30:10.135229Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdcqg8c7tmrbcqhmbr55dxxpnzwz" level=info timestamp=2018-08-07T18:30:10.137313Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:30:10.137808Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.720 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 when virt-launcher crashes /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:285 should be stopped and have Failed phase [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:286 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T18:29:53.839686Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdcqg8c7tmrbcqhmbr55dxxpnzwz kind=VirtualMachineInstance uid=e07fc037-9a6f-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdllncz" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running 2018/08/07 18:34:14 http: TLS handshake error from 10.244.0.1:36414: EOF 2018/08/07 18:34:24 http: TLS handshake error from 10.244.0.1:36438: EOF level=info timestamp=2018-08-07T18:34:32.516620Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:34:34 http: TLS handshake error from 10.244.0.1:36462: EOF 2018/08/07 18:34:44 http: TLS handshake error from 10.244.0.1:36486: EOF 2018/08/07 18:34:54 http: TLS handshake error from 10.244.0.1:36510: EOF level=info timestamp=2018-08-07T18:35:02.364056Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:35:02.400271Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:35:02.554394Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:35:04 http: TLS handshake error from 10.244.0.1:36534: EOF 2018/08/07 18:35:14 http: TLS handshake error from 10.244.0.1:36558: EOF 2018/08/07 18:35:24 http: TLS handshake error from 10.244.0.1:36582: EOF level=info timestamp=2018-08-07T18:35:32.558292Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:35:34 http: TLS handshake error from 10.244.0.1:36606: EOF 2018/08/07 18:35:44 http: TLS handshake error from 10.244.0.1:36630: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T18:34:32.738110Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:34:35 http: TLS handshake error from 10.244.1.1:39444: EOF 2018/08/07 18:34:45 http: TLS handshake error from 10.244.1.1:39450: EOF 2018/08/07 18:34:55 http: TLS handshake error from 10.244.1.1:39456: EOF level=info timestamp=2018-08-07T18:35:02.694331Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:35:02.854593Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:35:05 http: TLS handshake error from 10.244.1.1:39462: EOF level=info timestamp=2018-08-07T18:35:09.753910Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:35:09.758506Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:35:15 http: TLS handshake error from 10.244.1.1:39468: EOF 2018/08/07 18:35:25 http: TLS handshake error from 10.244.1.1:39474: EOF level=info timestamp=2018-08-07T18:35:32.819637Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:35:32.987849Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:35:35 http: TLS handshake error from 10.244.1.1:39480: EOF 2018/08/07 18:35:45 http: TLS handshake error from 10.244.1.1:39486: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T18:24:51.704388Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwzgzrbcq54jtv29hd7m4bllph6lbxnhmm75w8ln5628w2dm8kxbqcnvqznf2fc5 kind= uid=2cccf2b0-9a6f-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:24:51.705392Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwzgzrbcq54jtv29hd7m4bllph6lbxnhmm75w8ln5628w2dm8kxbqcnvqznf2fc5 kind= uid=2cccf2b0-9a6f-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:27:52.282278Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwzgzrbcq54jtv29hd7m4bllph6lbxnhmm75w8ln5628w2dm8kxbqcnvqznf2fc5\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiwzgzrbcq54jtv29hd7m4bllph6lbxnhmm75w8ln5628w2dm8kxbqcnvqznf2fc5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2cccf2b0-9a6f-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwzgzrbcq54jtv29hd7m4bllph6lbxnhmm75w8ln5628w2dm8kxbqcnvqznf2fc5" level=info timestamp=2018-08-07T18:27:52.445679Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiznr5d9gp5j98s52flkc9ltqvzxtgfsd6sn8ndfm4pl64b6f5m5hm9jcztr4hjgn kind= uid=988873b4-9a6f-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:27:52.446563Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiznr5d9gp5j98s52flkc9ltqvzxtgfsd6sn8ndfm4pl64b6f5m5hm9jcztr4hjgn kind= uid=988873b4-9a6f-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:28:52.654411Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiznr5d9gp5j98s52flkc9ltqvzxtgfsd6sn8ndfm4pl64b6f5m5hm9jcztr4hjgn\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiznr5d9gp5j98s52flkc9ltqvzxtgfsd6sn8ndfm4pl64b6f5m5hm9jcztr4hjgn, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 988873b4-9a6f-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiznr5d9gp5j98s52flkc9ltqvzxtgfsd6sn8ndfm4pl64b6f5m5hm9jcztr4hjgn" level=info timestamp=2018-08-07T18:28:52.822271Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm kind= uid=bc83d8bc-9a6f-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:28:52.822894Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm kind= uid=bc83d8bc-9a6f-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:28:52.948226Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm" level=info timestamp=2018-08-07T18:29:53.034645Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bc83d8bc-9a6f-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm" level=info timestamp=2018-08-07T18:29:53.184953Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdcqg8c7tmrbcqhmbr55dxxpnzwz kind= uid=e07fc037-9a6f-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:29:53.185553Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdcqg8c7tmrbcqhmbr55dxxpnzwz kind= uid=e07fc037-9a6f-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:32:53.739516Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdcqg8c7tmrbcqhmbr55dxxpnzwz\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdcqg8c7tmrbcqhmbr55dxxpnzwz, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e07fc037-9a6f-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdcqg8c7tmrbcqhmbr55dxxpnzwz" level=info timestamp=2018-08-07T18:32:53.913472Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizc669jt7xlxxnlgtxr8tqqjz5rz9gp7x4dl6brqgn9zw4p9rc6zpq6wbnzbvmlp kind= uid=4c391afc-9a70-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:32:53.914194Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizc669jt7xlxxnlgtxr8tqqjz5rz9gp7x4dl6brqgn9zw4p9rc6zpq6wbnzbvmlp kind= uid=4c391afc-9a70-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:10:01.514309Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-07T18:10:01.529963Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:01.530868Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:01.630434Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:01.690304Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:01.694395Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-launcher-testvmizc669jt7xlxxnlgtxr8tqqjz5rz9gp7x4dl6bmgpmh Pod phase: Pending level=info timestamp=2018-08-07T18:32:58.124652Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:32:58.124877Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:32:58.126807Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:33:09.905837Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:33:09.983779Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmizc669jt7xlxxnlgtxr8tqqjz5rz9gp7x4dl6brqgn9zw4p9rc6zpq6wbnzbvmlp" level=info timestamp=2018-08-07T18:33:09.986349Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:33:09.986854Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.723 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 when virt-handler crashes /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:309 should recover and continue management [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:310 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T18:32:54.553585Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmizc669jt7xlxxnlgtxr8tqqjz5rz9gp7x4dl6brqgn9zw4p9rc6zpq6wbnzbvmlp kind=VirtualMachineInstance uid=4c391afc-9a70-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmizc669jt7xlxxnlgtxr8tqqjz5rz9gp7x4dl6bmgpmh" • [SLOW TEST:66.843 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 when virt-handler is responsive /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:340 should indicate that a node is ready for vmis /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:341 ------------------------------ Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running 2018/08/07 18:38:04 http: TLS handshake error from 10.244.0.1:36966: EOF 2018/08/07 18:38:14 http: TLS handshake error from 10.244.0.1:36990: EOF 2018/08/07 18:38:24 http: TLS handshake error from 10.244.0.1:37014: EOF level=info timestamp=2018-08-07T18:38:32.582847Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:38:34 http: TLS handshake error from 10.244.0.1:37038: EOF 2018/08/07 18:38:44 http: TLS handshake error from 10.244.0.1:37062: EOF 2018/08/07 18:38:54 http: TLS handshake error from 10.244.0.1:37086: EOF level=info timestamp=2018-08-07T18:39:02.545544Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:39:04 http: TLS handshake error from 10.244.0.1:37110: EOF 2018/08/07 18:39:14 http: TLS handshake error from 10.244.0.1:37134: EOF 2018/08/07 18:39:24 http: TLS handshake error from 10.244.0.1:37158: EOF level=info timestamp=2018-08-07T18:39:32.540005Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:39:34 http: TLS handshake error from 10.244.0.1:37182: EOF 2018/08/07 18:39:44 http: TLS handshake error from 10.244.0.1:37206: EOF 2018/08/07 18:39:54 http: TLS handshake error from 10.244.0.1:37230: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T18:38:33.622715Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:38:33.689790Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:38:35 http: TLS handshake error from 10.244.1.1:39588: EOF 2018/08/07 18:38:45 http: TLS handshake error from 10.244.1.1:39594: EOF 2018/08/07 18:38:55 http: TLS handshake error from 10.244.1.1:39600: EOF level=info timestamp=2018-08-07T18:39:03.746250Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:39:03.820911Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:39:05 http: TLS handshake error from 10.244.1.1:39606: EOF 2018/08/07 18:39:15 http: TLS handshake error from 10.244.1.1:39612: EOF 2018/08/07 18:39:25 http: TLS handshake error from 10.244.1.1:39618: EOF level=info timestamp=2018-08-07T18:39:33.883225Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:39:33.944214Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:39:35 http: TLS handshake error from 10.244.1.1:39624: EOF 2018/08/07 18:39:45 http: TLS handshake error from 10.244.1.1:39630: EOF 2018/08/07 18:39:55 http: TLS handshake error from 10.244.1.1:39636: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T18:27:52.446563Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiznr5d9gp5j98s52flkc9ltqvzxtgfsd6sn8ndfm4pl64b6f5m5hm9jcztr4hjgn kind= uid=988873b4-9a6f-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:28:52.654411Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiznr5d9gp5j98s52flkc9ltqvzxtgfsd6sn8ndfm4pl64b6f5m5hm9jcztr4hjgn\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiznr5d9gp5j98s52flkc9ltqvzxtgfsd6sn8ndfm4pl64b6f5m5hm9jcztr4hjgn, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 988873b4-9a6f-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiznr5d9gp5j98s52flkc9ltqvzxtgfsd6sn8ndfm4pl64b6f5m5hm9jcztr4hjgn" level=info timestamp=2018-08-07T18:28:52.822271Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm kind= uid=bc83d8bc-9a6f-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:28:52.822894Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm kind= uid=bc83d8bc-9a6f-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:28:52.948226Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm" level=info timestamp=2018-08-07T18:29:53.034645Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bc83d8bc-9a6f-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm" level=info timestamp=2018-08-07T18:29:53.184953Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdcqg8c7tmrbcqhmbr55dxxpnzwz kind= uid=e07fc037-9a6f-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:29:53.185553Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdcqg8c7tmrbcqhmbr55dxxpnzwz kind= uid=e07fc037-9a6f-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:32:53.739516Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdcqg8c7tmrbcqhmbr55dxxpnzwz\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdcqg8c7tmrbcqhmbr55dxxpnzwz, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e07fc037-9a6f-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdcqg8c7tmrbcqhmbr55dxxpnzwz" level=info timestamp=2018-08-07T18:32:53.913472Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizc669jt7xlxxnlgtxr8tqqjz5rz9gp7x4dl6brqgn9zw4p9rc6zpq6wbnzbvmlp kind= uid=4c391afc-9a70-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:32:53.914194Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizc669jt7xlxxnlgtxr8tqqjz5rz9gp7x4dl6brqgn9zw4p9rc6zpq6wbnzbvmlp kind= uid=4c391afc-9a70-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:35:54.477764Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizc669jt7xlxxnlgtxr8tqqjz5rz9gp7x4dl6brqgn9zw4p9rc6zpq6wbnzbvmlp\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmizc669jt7xlxxnlgtxr8tqqjz5rz9gp7x4dl6brqgn9zw4p9rc6zpq6wbnzbvmlp, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4c391afc-9a70-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizc669jt7xlxxnlgtxr8tqqjz5rz9gp7x4dl6brqgn9zw4p9rc6zpq6wbnzbvmlp" level=info timestamp=2018-08-07T18:37:01.425592Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizhbnrkvwwdh7cqt2krhdklw9hdrq6lh8hnnt2rws27ffh26gn2jmm9m7s7b5264 kind= uid=dfbf2b30-9a70-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:37:01.435323Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizhbnrkvwwdh7cqt2krhdklw9hdrq6lh8hnnt2rws27ffh26gn2jmm9m7s7b5264 kind= uid=dfbf2b30-9a70-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:37:01.543531Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizhbnrkvwwdh7cqt2krhdklw9hdrq6lh8hnnt2rws27ffh26gn2jmm9m7s7b5264\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizhbnrkvwwdh7cqt2krhdklw9hdrq6lh8hnnt2rws27ffh26gn2jmm9m7s7b5264" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:10:01.514309Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-07T18:10:01.529963Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:01.530868Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:01.630434Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:01.690304Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:01.694395Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-launcher-testvmizhbnrkvwwdh7cqt2krhdklw9hdrq6lh8hnnt2574v4 Pod phase: Pending level=info timestamp=2018-08-07T18:37:06.245045Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:37:06.245701Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:37:06.251515Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:37:17.693339Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:37:17.744507Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmizhbnrkvwwdh7cqt2krhdklw9hdrq6lh8hnnt2rws27ffh26gn2jmm9m7s7b5264" level=info timestamp=2018-08-07T18:37:17.746832Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:37:17.747423Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [180.692 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 when virt-handler is not responsive /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:371 the node controller should react [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:410 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T18:37:02.099965Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmizhbnrkvwwdh7cqt2krhdklw9hdrq6lh8hnnt2rws27ffh26gn2jmm9m7s7b5264 kind=VirtualMachineInstance uid=dfbf2b30-9a70-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmizhbnrkvwwdh7cqt2krhdklw9hdrq6lh8hnnt2574v4" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running 2018/08/07 18:41:14 http: TLS handshake error from 10.244.0.1:37422: EOF 2018/08/07 18:41:24 http: TLS handshake error from 10.244.0.1:37446: EOF level=info timestamp=2018-08-07T18:41:32.583875Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:41:34 http: TLS handshake error from 10.244.0.1:37470: EOF 2018/08/07 18:41:44 http: TLS handshake error from 10.244.0.1:37494: EOF 2018/08/07 18:41:54 http: TLS handshake error from 10.244.0.1:37518: EOF level=info timestamp=2018-08-07T18:42:02.564719Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:42:04 http: TLS handshake error from 10.244.0.1:37542: EOF 2018/08/07 18:42:14 http: TLS handshake error from 10.244.0.1:37566: EOF 2018/08/07 18:42:24 http: TLS handshake error from 10.244.0.1:37590: EOF level=info timestamp=2018-08-07T18:42:32.604778Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:42:34 http: TLS handshake error from 10.244.0.1:37614: EOF 2018/08/07 18:42:44 http: TLS handshake error from 10.244.0.1:37638: EOF 2018/08/07 18:42:54 http: TLS handshake error from 10.244.0.1:37662: EOF level=info timestamp=2018-08-07T18:43:02.562592Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T18:41:34.547445Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:41:34.559610Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:41:35 http: TLS handshake error from 10.244.1.1:39696: EOF 2018/08/07 18:41:45 http: TLS handshake error from 10.244.1.1:39702: EOF 2018/08/07 18:41:55 http: TLS handshake error from 10.244.1.1:39708: EOF level=info timestamp=2018-08-07T18:42:04.682751Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:42:04.692211Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:42:05 http: TLS handshake error from 10.244.1.1:39714: EOF 2018/08/07 18:42:15 http: TLS handshake error from 10.244.1.1:39720: EOF 2018/08/07 18:42:25 http: TLS handshake error from 10.244.1.1:39726: EOF level=info timestamp=2018-08-07T18:42:34.828077Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:42:34.832388Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:42:35 http: TLS handshake error from 10.244.1.1:39732: EOF 2018/08/07 18:42:45 http: TLS handshake error from 10.244.1.1:39738: EOF 2018/08/07 18:42:55 http: TLS handshake error from 10.244.1.1:39744: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T18:28:52.822894Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm kind= uid=bc83d8bc-9a6f-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:28:52.948226Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm" level=info timestamp=2018-08-07T18:29:53.034645Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bc83d8bc-9a6f-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij8j9g4gjlg6ddgk64csw5mvhtgrpqb8chsjlh29m4k5hlrwww5xfpw9l7j6hrhm" level=info timestamp=2018-08-07T18:29:53.184953Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdcqg8c7tmrbcqhmbr55dxxpnzwz kind= uid=e07fc037-9a6f-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:29:53.185553Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdcqg8c7tmrbcqhmbr55dxxpnzwz kind= uid=e07fc037-9a6f-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:32:53.739516Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdcqg8c7tmrbcqhmbr55dxxpnzwz\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdcqg8c7tmrbcqhmbr55dxxpnzwz, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e07fc037-9a6f-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiv2t5rpnns4hp2xdl26jqbj8shvg9rtln8qpkdcqg8c7tmrbcqhmbr55dxxpnzwz" level=info timestamp=2018-08-07T18:32:53.913472Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizc669jt7xlxxnlgtxr8tqqjz5rz9gp7x4dl6brqgn9zw4p9rc6zpq6wbnzbvmlp kind= uid=4c391afc-9a70-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:32:53.914194Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizc669jt7xlxxnlgtxr8tqqjz5rz9gp7x4dl6brqgn9zw4p9rc6zpq6wbnzbvmlp kind= uid=4c391afc-9a70-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:35:54.477764Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizc669jt7xlxxnlgtxr8tqqjz5rz9gp7x4dl6brqgn9zw4p9rc6zpq6wbnzbvmlp\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmizc669jt7xlxxnlgtxr8tqqjz5rz9gp7x4dl6brqgn9zw4p9rc6zpq6wbnzbvmlp, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4c391afc-9a70-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizc669jt7xlxxnlgtxr8tqqjz5rz9gp7x4dl6brqgn9zw4p9rc6zpq6wbnzbvmlp" level=info timestamp=2018-08-07T18:37:01.425592Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizhbnrkvwwdh7cqt2krhdklw9hdrq6lh8hnnt2rws27ffh26gn2jmm9m7s7b5264 kind= uid=dfbf2b30-9a70-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:37:01.435323Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizhbnrkvwwdh7cqt2krhdklw9hdrq6lh8hnnt2rws27ffh26gn2jmm9m7s7b5264 kind= uid=dfbf2b30-9a70-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:37:01.543531Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizhbnrkvwwdh7cqt2krhdklw9hdrq6lh8hnnt2rws27ffh26gn2jmm9m7s7b5264\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizhbnrkvwwdh7cqt2krhdklw9hdrq6lh8hnnt2rws27ffh26gn2jmm9m7s7b5264" level=info timestamp=2018-08-07T18:40:02.243618Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4lsxnjhlsg64h2srr749bsk8r6646jlbc7qp464t7xxzjlpr4rbk5t5k4v78r4c kind= uid=4b8456ad-9a71-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:40:02.244065Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4lsxnjhlsg64h2srr749bsk8r6646jlbc7qp464t7xxzjlpr4rbk5t5k4v78r4c kind= uid=4b8456ad-9a71-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:40:02.500624Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4lsxnjhlsg64h2srr749bsk8r6646jlbc7qp464t7xxzjlpr4rbk5t5k4v78r4c\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4lsxnjhlsg64h2srr749bsk8r6646jlbc7qp464t7xxzjlpr4rbk5t5k4v78r4c" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:10:01.514309Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-07T18:10:01.529963Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:01.530868Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:01.630434Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:01.690304Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-08-07T18:10:01.694395Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-launcher-testvmi4lsxnjhlsg64h2srr749bsk8r6646jlbc7qp4bbmkx Pod phase: Pending level=info timestamp=2018-08-07T18:40:06.574270Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:40:06.574889Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:40:06.576541Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:40:18.138069Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:40:18.216796Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi4lsxnjhlsg64h2srr749bsk8r6646jlbc7qp464t7xxzjlpr4rbk5t5k4v78r4c" level=info timestamp=2018-08-07T18:40:18.219394Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:40:18.219844Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.856 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with node tainted /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:463 the vmi with tolerations should be scheduled [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:485 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T18:40:02.963180Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi4lsxnjhlsg64h2srr749bsk8r6646jlbc7qp464t7xxzjlpr4rbk5t5k4v78r4c kind=VirtualMachineInstance uid=4b8456ad-9a71-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi4lsxnjhlsg64h2srr749bsk8r6646jlbc7qp4bbmkx" • ------------------------------ • [SLOW TEST:51.423 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with non default namespace /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:535 should log libvirt start and stop lifecycle events of the domain /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 kubevirt-test-default /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:21.707 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with non default namespace /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:535 should log libvirt start and stop lifecycle events of the domain /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 kubevirt-test-alternative /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.217 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 VirtualMachineInstance Emulation Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:592 should enable emulation in virt-launcher [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:604 Software emulation is not enabled on this cluster /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:600 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.209 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 VirtualMachineInstance Emulation Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:592 should be reflected in domain XML [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:641 Software emulation is not enabled on this cluster /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:600 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.232 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 VirtualMachineInstance Emulation Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:592 should request a TUN device but not KVM [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:685 Software emulation is not enabled on this cluster /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:600 ------------------------------ •••• Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running level=info timestamp=2018-08-07T18:45:32.542384Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:45:34 http: TLS handshake error from 10.244.0.1:38046: EOF 2018/08/07 18:45:44 http: TLS handshake error from 10.244.0.1:38070: EOF 2018/08/07 18:45:54 http: TLS handshake error from 10.244.0.1:38094: EOF level=info timestamp=2018-08-07T18:46:02.563731Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:46:04 http: TLS handshake error from 10.244.0.1:38118: EOF 2018/08/07 18:46:14 http: TLS handshake error from 10.244.0.1:38142: EOF 2018/08/07 18:46:24 http: TLS handshake error from 10.244.0.1:38166: EOF level=info timestamp=2018-08-07T18:46:32.579941Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:46:34 http: TLS handshake error from 10.244.0.1:38190: EOF 2018/08/07 18:46:44 http: TLS handshake error from 10.244.0.1:38214: EOF 2018/08/07 18:46:54 http: TLS handshake error from 10.244.0.1:38238: EOF level=info timestamp=2018-08-07T18:47:02.582685Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:47:04 http: TLS handshake error from 10.244.0.1:38262: EOF 2018/08/07 18:47:14 http: TLS handshake error from 10.244.0.1:38286: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T18:46:05.871729Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:46:05.876697Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:46:09.564497Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:46:09.569753Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:46:15 http: TLS handshake error from 10.244.1.1:39864: EOF 2018/08/07 18:46:25 http: TLS handshake error from 10.244.1.1:39870: EOF 2018/08/07 18:46:35 http: TLS handshake error from 10.244.1.1:39876: EOF level=info timestamp=2018-08-07T18:46:36.016606Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:46:36.023922Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:46:45 http: TLS handshake error from 10.244.1.1:39882: EOF 2018/08/07 18:46:55 http: TLS handshake error from 10.244.1.1:39888: EOF 2018/08/07 18:47:05 http: TLS handshake error from 10.244.1.1:39894: EOF level=info timestamp=2018-08-07T18:47:06.155943Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:47:06.174672Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:47:15 http: TLS handshake error from 10.244.1.1:39900: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T18:43:04.694004Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7lbqzv9sj4sxs4wx628wz9hdmg9htxrdkmd4vt5t65nb629cgs48lwldj25fc5c kind= uid=b84934fb-9a71-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:43:04.694499Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7lbqzv9sj4sxs4wx628wz9hdmg9htxrdkmd4vt5t65nb629cgs48lwldj25fc5c kind= uid=b84934fb-9a71-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:43:55.899911Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:43:55.900602Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:44:18.224917Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8 kind= uid=e41b4e08-9a71-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:18.225276Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8 kind= uid=e41b4e08-9a71-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:44:18.302250Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8" level=info timestamp=2018-08-07T18:44:18.329496Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8" level=info timestamp=2018-08-07T18:44:18.911426Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e41b4e08-9a71-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8" level=info timestamp=2018-08-07T18:44:19.086438Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk kind= uid=e49ff7fe-9a71-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:19.086696Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk kind= uid=e49ff7fe-9a71-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:44:19.157369Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk" level=info timestamp=2018-08-07T18:44:19.206248Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk" level=info timestamp=2018-08-07T18:44:19.921861Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v kind= uid=e51f9430-9a71-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:19.923427Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v kind= uid=e51f9430-9a71-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf5866jx4r6 Pod phase: Pending level=info timestamp=2018-08-07T18:44:24.352613Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:44:24.353901Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:44:24.355999Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:44:35.881808Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:44:35.955035Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v" level=info timestamp=2018-08-07T18:44:35.957315Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:44:35.957757Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure [180.651 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance's Pod /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:837 should result in the VirtualMachineInstance moving to a finalized state [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:838 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-07T18:44:20.580431Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v kind=VirtualMachineInstance uid=e51f9430-9a71-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf5866jx4r6" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running level=info timestamp=2018-08-07T18:48:32.568468Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:48:34 http: TLS handshake error from 10.244.0.1:38478: EOF 2018/08/07 18:48:44 http: TLS handshake error from 10.244.0.1:38502: EOF 2018/08/07 18:48:54 http: TLS handshake error from 10.244.0.1:38526: EOF level=info timestamp=2018-08-07T18:49:02.579386Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:49:04 http: TLS handshake error from 10.244.0.1:38550: EOF 2018/08/07 18:49:14 http: TLS handshake error from 10.244.0.1:38574: EOF 2018/08/07 18:49:24 http: TLS handshake error from 10.244.0.1:38598: EOF level=info timestamp=2018-08-07T18:49:32.514817Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:49:34 http: TLS handshake error from 10.244.0.1:38622: EOF 2018/08/07 18:49:44 http: TLS handshake error from 10.244.0.1:38646: EOF 2018/08/07 18:49:54 http: TLS handshake error from 10.244.0.1:38670: EOF level=info timestamp=2018-08-07T18:50:02.597842Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:50:04 http: TLS handshake error from 10.244.0.1:38694: EOF 2018/08/07 18:50:14 http: TLS handshake error from 10.244.0.1:38718: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T18:49:06.763892Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:49:06.773763Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:49:15 http: TLS handshake error from 10.244.1.1:39972: EOF 2018/08/07 18:49:25 http: TLS handshake error from 10.244.1.1:39978: EOF 2018/08/07 18:49:35 http: TLS handshake error from 10.244.1.1:39984: EOF level=info timestamp=2018-08-07T18:49:36.894205Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:49:36.909861Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:49:45 http: TLS handshake error from 10.244.1.1:39990: EOF 2018/08/07 18:49:55 http: TLS handshake error from 10.244.1.1:39996: EOF 2018/08/07 18:50:05 http: TLS handshake error from 10.244.1.1:40002: EOF level=info timestamp=2018-08-07T18:50:07.035364Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:50:07.050648Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:50:10.089412Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:50:10.093888Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:50:15 http: TLS handshake error from 10.244.1.1:40008: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T18:43:55.900602Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:44:18.224917Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8 kind= uid=e41b4e08-9a71-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:18.225276Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8 kind= uid=e41b4e08-9a71-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:44:18.302250Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8" level=info timestamp=2018-08-07T18:44:18.329496Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8" level=info timestamp=2018-08-07T18:44:18.911426Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e41b4e08-9a71-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8" level=info timestamp=2018-08-07T18:44:19.086438Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk kind= uid=e49ff7fe-9a71-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:19.086696Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk kind= uid=e49ff7fe-9a71-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:44:19.157369Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk" level=info timestamp=2018-08-07T18:44:19.206248Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk" level=info timestamp=2018-08-07T18:44:19.921861Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v kind= uid=e51f9430-9a71-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:19.923427Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v kind= uid=e51f9430-9a71-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:47:20.495052Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e51f9430-9a71-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v" level=info timestamp=2018-08-07T18:47:20.674393Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirqbwrxthjq5lzj8c8lp7td7bbrcdmt222mrxxgnscbk2cswjsjbngklgjj6bhz7 kind= uid=50da3dd3-9a72-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:47:20.675640Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirqbwrxthjq5lzj8c8lp7td7bbrcdmt222mrxxgnscbk2cswjsjbngklgjj6bhz7 kind= uid=50da3dd3-9a72-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmirqbwrxthjq5lzj8c8lp7td7bbrcdmt222mrxxv9cws Pod phase: Pending level=info timestamp=2018-08-07T18:47:25.654448Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:47:25.655004Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:47:25.658722Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:47:37.547914Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:47:37.618030Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmirqbwrxthjq5lzj8c8lp7td7bbrcdmt222mrxxgnscbk2cswjsjbngklgjj6bhz7" level=info timestamp=2018-08-07T18:47:37.620577Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:47:37.621030Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.707 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:869 with an active pod. /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:870 should result in pod being terminated [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:871 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-07T18:47:21.293040Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmirqbwrxthjq5lzj8c8lp7td7bbrcdmt222mrxxgnscbk2cswjsjbngklgjj6bhz7 kind=VirtualMachineInstance uid=50da3dd3-9a72-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmirqbwrxthjq5lzj8c8lp7td7bbrcdmt222mrxxv9cws" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running level=info timestamp=2018-08-07T18:51:32.555916Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:51:34 http: TLS handshake error from 10.244.0.1:38910: EOF 2018/08/07 18:51:44 http: TLS handshake error from 10.244.0.1:38934: EOF 2018/08/07 18:51:54 http: TLS handshake error from 10.244.0.1:38958: EOF level=info timestamp=2018-08-07T18:52:02.578228Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:52:04 http: TLS handshake error from 10.244.0.1:38982: EOF 2018/08/07 18:52:14 http: TLS handshake error from 10.244.0.1:39006: EOF 2018/08/07 18:52:24 http: TLS handshake error from 10.244.0.1:39030: EOF level=info timestamp=2018-08-07T18:52:32.521330Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:52:34 http: TLS handshake error from 10.244.0.1:39054: EOF 2018/08/07 18:52:44 http: TLS handshake error from 10.244.0.1:39078: EOF 2018/08/07 18:52:54 http: TLS handshake error from 10.244.0.1:39102: EOF level=info timestamp=2018-08-07T18:53:02.565610Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:53:04 http: TLS handshake error from 10.244.0.1:39126: EOF 2018/08/07 18:53:14 http: TLS handshake error from 10.244.0.1:39150: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T18:52:07.587735Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:52:07.588508Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:52:15 http: TLS handshake error from 10.244.1.1:40080: EOF 2018/08/07 18:52:25 http: TLS handshake error from 10.244.1.1:40086: EOF 2018/08/07 18:52:35 http: TLS handshake error from 10.244.1.1:40092: EOF level=info timestamp=2018-08-07T18:52:37.725744Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:52:37.725482Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:52:45 http: TLS handshake error from 10.244.1.1:40098: EOF 2018/08/07 18:52:55 http: TLS handshake error from 10.244.1.1:40104: EOF 2018/08/07 18:53:05 http: TLS handshake error from 10.244.1.1:40110: EOF level=info timestamp=2018-08-07T18:53:07.866516Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:53:07.866552Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:53:10.116315Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:53:10.124445Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:53:15 http: TLS handshake error from 10.244.1.1:40116: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T18:44:18.225276Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8 kind= uid=e41b4e08-9a71-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:44:18.302250Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8" level=info timestamp=2018-08-07T18:44:18.329496Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8" level=info timestamp=2018-08-07T18:44:18.911426Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e41b4e08-9a71-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8" level=info timestamp=2018-08-07T18:44:19.086438Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk kind= uid=e49ff7fe-9a71-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:19.086696Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk kind= uid=e49ff7fe-9a71-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:44:19.157369Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk" level=info timestamp=2018-08-07T18:44:19.206248Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk" level=info timestamp=2018-08-07T18:44:19.921861Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v kind= uid=e51f9430-9a71-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:19.923427Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v kind= uid=e51f9430-9a71-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:47:20.495052Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e51f9430-9a71-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v" level=info timestamp=2018-08-07T18:47:20.674393Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirqbwrxthjq5lzj8c8lp7td7bbrcdmt222mrxxgnscbk2cswjsjbngklgjj6bhz7 kind= uid=50da3dd3-9a72-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:47:20.675640Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirqbwrxthjq5lzj8c8lp7td7bbrcdmt222mrxxgnscbk2cswjsjbngklgjj6bhz7 kind= uid=50da3dd3-9a72-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:50:21.363416Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin2dpbj2z9xcpg9b68tr7n4bg9qq6grczs225b59zdvpv9w5z46d5rw9d92kpcjd kind= uid=bc8d71a8-9a72-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:50:21.369425Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin2dpbj2z9xcpg9b68tr7n4bg9qq6grczs225b59zdvpv9w5z46d5rw9d92kpcjd kind= uid=bc8d71a8-9a72-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmin2dpbj2z9xcpg9b68tr7n4bg9qq6grczs225bqrmqr Pod phase: Pending level=info timestamp=2018-08-07T18:50:25.677611Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:50:25.677865Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:50:25.679774Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:50:37.481075Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:50:37.565230Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmin2dpbj2z9xcpg9b68tr7n4bg9qq6grczs225b59zdvpv9w5z46d5rw9d92kpcjd" level=info timestamp=2018-08-07T18:50:37.568084Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:50:37.568548Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.720 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:869 with ACPI and 0 grace period seconds /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:895 should result in vmi status failed [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:896 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-07T18:50:21.984308Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmin2dpbj2z9xcpg9b68tr7n4bg9qq6grczs225b59zdvpv9w5z46d5rw9d92kpcjd kind=VirtualMachineInstance uid=bc8d71a8-9a72-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmin2dpbj2z9xcpg9b68tr7n4bg9qq6grczs225bqrmqr" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running 2018/08/07 18:54:44 http: TLS handshake error from 10.244.0.1:39366: EOF 2018/08/07 18:54:54 http: TLS handshake error from 10.244.0.1:39390: EOF level=info timestamp=2018-08-07T18:55:02.373845Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:55:02.401704Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:55:02.520712Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:55:04 http: TLS handshake error from 10.244.0.1:39414: EOF 2018/08/07 18:55:14 http: TLS handshake error from 10.244.0.1:39438: EOF 2018/08/07 18:55:24 http: TLS handshake error from 10.244.0.1:39462: EOF level=info timestamp=2018-08-07T18:55:32.578306Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:55:34 http: TLS handshake error from 10.244.0.1:39486: EOF 2018/08/07 18:55:44 http: TLS handshake error from 10.244.0.1:39510: EOF 2018/08/07 18:55:54 http: TLS handshake error from 10.244.0.1:39534: EOF level=info timestamp=2018-08-07T18:56:02.584317Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:56:04 http: TLS handshake error from 10.244.0.1:39558: EOF 2018/08/07 18:56:14 http: TLS handshake error from 10.244.0.1:39582: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T18:55:09.681710Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:55:09.685622Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:55:15 http: TLS handshake error from 10.244.1.1:40188: EOF 2018/08/07 18:55:25 http: TLS handshake error from 10.244.1.1:40194: EOF 2018/08/07 18:55:35 http: TLS handshake error from 10.244.1.1:40200: EOF level=info timestamp=2018-08-07T18:55:38.599205Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:55:38.599327Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:55:45 http: TLS handshake error from 10.244.1.1:40206: EOF 2018/08/07 18:55:55 http: TLS handshake error from 10.244.1.1:40212: EOF 2018/08/07 18:56:05 http: TLS handshake error from 10.244.1.1:40218: EOF level=info timestamp=2018-08-07T18:56:08.738717Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:56:08.738739Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:56:09.691349Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:56:09.695628Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:56:15 http: TLS handshake error from 10.244.1.1:40224: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T18:44:18.329496Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8" level=info timestamp=2018-08-07T18:44:18.911426Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e41b4e08-9a71-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmifg4bz76n9vvjsvq2fjkvjw5527vllg4l6jcjzckpk4zn5xrmqwpmpqbhrpp2sb8" level=info timestamp=2018-08-07T18:44:19.086438Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk kind= uid=e49ff7fe-9a71-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:19.086696Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk kind= uid=e49ff7fe-9a71-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:44:19.157369Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk" level=info timestamp=2018-08-07T18:44:19.206248Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk" level=info timestamp=2018-08-07T18:44:19.921861Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v kind= uid=e51f9430-9a71-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:19.923427Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v kind= uid=e51f9430-9a71-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:47:20.495052Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e51f9430-9a71-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v" level=info timestamp=2018-08-07T18:47:20.674393Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirqbwrxthjq5lzj8c8lp7td7bbrcdmt222mrxxgnscbk2cswjsjbngklgjj6bhz7 kind= uid=50da3dd3-9a72-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:47:20.675640Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirqbwrxthjq5lzj8c8lp7td7bbrcdmt222mrxxgnscbk2cswjsjbngklgjj6bhz7 kind= uid=50da3dd3-9a72-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:50:21.363416Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin2dpbj2z9xcpg9b68tr7n4bg9qq6grczs225b59zdvpv9w5z46d5rw9d92kpcjd kind= uid=bc8d71a8-9a72-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:50:21.369425Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin2dpbj2z9xcpg9b68tr7n4bg9qq6grczs225b59zdvpv9w5z46d5rw9d92kpcjd kind= uid=bc8d71a8-9a72-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:53:22.117970Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc kind= uid=284a5d71-9a73-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:53:22.122874Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc kind= uid=284a5d71-9a73-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwd4rfw2 Pod phase: Pending level=info timestamp=2018-08-07T18:53:26.927628Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:53:26.927959Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:53:26.929903Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:53:38.726463Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:53:38.800379Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc" level=info timestamp=2018-08-07T18:53:38.802281Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:53:38.802700Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.752 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:869 with ACPI and some grace period seconds /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:920 should result in vmi status succeeded [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:921 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-07T18:53:22.710159Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc kind=VirtualMachineInstance uid=284a5d71-9a73-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwd4rfw2" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running level=info timestamp=2018-08-07T18:57:32.597523Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:57:34 http: TLS handshake error from 10.244.0.1:39774: EOF 2018/08/07 18:57:44 http: TLS handshake error from 10.244.0.1:39798: EOF 2018/08/07 18:57:54 http: TLS handshake error from 10.244.0.1:39822: EOF level=info timestamp=2018-08-07T18:58:02.562294Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:58:04 http: TLS handshake error from 10.244.0.1:39846: EOF 2018/08/07 18:58:14 http: TLS handshake error from 10.244.0.1:39870: EOF 2018/08/07 18:58:24 http: TLS handshake error from 10.244.0.1:39894: EOF level=info timestamp=2018-08-07T18:58:32.578558Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:58:34 http: TLS handshake error from 10.244.0.1:39918: EOF 2018/08/07 18:58:44 http: TLS handshake error from 10.244.0.1:39942: EOF 2018/08/07 18:58:54 http: TLS handshake error from 10.244.0.1:39966: EOF level=info timestamp=2018-08-07T18:59:02.592574Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:59:04 http: TLS handshake error from 10.244.0.1:39990: EOF 2018/08/07 18:59:14 http: TLS handshake error from 10.244.0.1:40014: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T18:58:09.273415Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:58:09.288457Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:58:09.706910Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T18:58:09.710859Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 18:58:15 http: TLS handshake error from 10.244.1.1:40296: EOF 2018/08/07 18:58:25 http: TLS handshake error from 10.244.1.1:40302: EOF 2018/08/07 18:58:35 http: TLS handshake error from 10.244.1.1:40308: EOF level=info timestamp=2018-08-07T18:58:39.427884Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:58:39.448597Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:58:45 http: TLS handshake error from 10.244.1.1:40314: EOF 2018/08/07 18:58:55 http: TLS handshake error from 10.244.1.1:40320: EOF 2018/08/07 18:59:05 http: TLS handshake error from 10.244.1.1:40326: EOF level=info timestamp=2018-08-07T18:59:09.564053Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T18:59:09.572502Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 18:59:15 http: TLS handshake error from 10.244.1.1:40332: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T18:44:19.157369Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk" level=info timestamp=2018-08-07T18:44:19.206248Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij9lchx6mpp66kz5grh8qs9kmblvfkp4tlvd44v6vtvnbfsd7dd97t72pr4frcpk" level=info timestamp=2018-08-07T18:44:19.921861Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v kind= uid=e51f9430-9a71-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:44:19.923427Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v kind= uid=e51f9430-9a71-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:47:20.495052Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e51f9430-9a71-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v" level=info timestamp=2018-08-07T18:47:20.674393Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirqbwrxthjq5lzj8c8lp7td7bbrcdmt222mrxxgnscbk2cswjsjbngklgjj6bhz7 kind= uid=50da3dd3-9a72-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:47:20.675640Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirqbwrxthjq5lzj8c8lp7td7bbrcdmt222mrxxgnscbk2cswjsjbngklgjj6bhz7 kind= uid=50da3dd3-9a72-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:50:21.363416Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin2dpbj2z9xcpg9b68tr7n4bg9qq6grczs225b59zdvpv9w5z46d5rw9d92kpcjd kind= uid=bc8d71a8-9a72-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:50:21.369425Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin2dpbj2z9xcpg9b68tr7n4bg9qq6grczs225b59zdvpv9w5z46d5rw9d92kpcjd kind= uid=bc8d71a8-9a72-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:53:22.117970Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc kind= uid=284a5d71-9a73-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:53:22.122874Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc kind= uid=284a5d71-9a73-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:56:22.690436Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 284a5d71-9a73-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc" level=info timestamp=2018-08-07T18:56:22.890326Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr kind= uid=94097f39-9a73-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:56:22.890875Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr kind= uid=94097f39-9a73-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:56:22.997417Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979vqdtm Pod phase: Pending level=info timestamp=2018-08-07T18:56:27.557357Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:56:27.557605Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:56:27.559406Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:56:38.016789Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:56:38.099718Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr" level=info timestamp=2018-08-07T18:56:38.100720Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:56:38.100911Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.777 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:869 with grace period greater than 0 /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:945 should run graceful shutdown [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:946 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Setting a VirtualMachineInstance termination grace period to 5 STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-07T18:56:23.515159Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr kind=VirtualMachineInstance uid=94097f39-9a73-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979vqdtm" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running level=info timestamp=2018-08-07T19:00:32.613770Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:00:34 http: TLS handshake error from 10.244.0.1:40206: EOF 2018/08/07 19:00:44 http: TLS handshake error from 10.244.0.1:40230: EOF 2018/08/07 19:00:54 http: TLS handshake error from 10.244.0.1:40254: EOF level=info timestamp=2018-08-07T19:01:02.613718Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:01:04 http: TLS handshake error from 10.244.0.1:40278: EOF 2018/08/07 19:01:14 http: TLS handshake error from 10.244.0.1:40302: EOF 2018/08/07 19:01:24 http: TLS handshake error from 10.244.0.1:40326: EOF level=info timestamp=2018-08-07T19:01:32.607223Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:01:34 http: TLS handshake error from 10.244.0.1:40350: EOF 2018/08/07 19:01:44 http: TLS handshake error from 10.244.0.1:40374: EOF 2018/08/07 19:01:54 http: TLS handshake error from 10.244.0.1:40398: EOF level=info timestamp=2018-08-07T19:02:02.598332Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:02:04 http: TLS handshake error from 10.244.0.1:40422: EOF 2018/08/07 19:02:14 http: TLS handshake error from 10.244.0.1:40446: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T19:01:10.048973Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:01:10.053956Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:01:10.530572Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:01:10.535505Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:01:15 http: TLS handshake error from 10.244.1.1:40404: EOF 2018/08/07 19:01:25 http: TLS handshake error from 10.244.1.1:40410: EOF 2018/08/07 19:01:35 http: TLS handshake error from 10.244.1.1:40416: EOF level=info timestamp=2018-08-07T19:01:40.166596Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:01:40.173682Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:01:45 http: TLS handshake error from 10.244.1.1:40422: EOF 2018/08/07 19:01:55 http: TLS handshake error from 10.244.1.1:40428: EOF 2018/08/07 19:02:05 http: TLS handshake error from 10.244.1.1:40434: EOF level=info timestamp=2018-08-07T19:02:10.321385Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:02:10.326555Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:02:15 http: TLS handshake error from 10.244.1.1:40440: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T18:47:20.495052Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e51f9430-9a71-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixg6m8n2v65frcl9v9sv574dhdfkq5dhbf58664wgx4hp6rjxb4mqtv9mcmzts6v" level=info timestamp=2018-08-07T18:47:20.674393Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirqbwrxthjq5lzj8c8lp7td7bbrcdmt222mrxxgnscbk2cswjsjbngklgjj6bhz7 kind= uid=50da3dd3-9a72-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:47:20.675640Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirqbwrxthjq5lzj8c8lp7td7bbrcdmt222mrxxgnscbk2cswjsjbngklgjj6bhz7 kind= uid=50da3dd3-9a72-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:50:21.363416Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin2dpbj2z9xcpg9b68tr7n4bg9qq6grczs225b59zdvpv9w5z46d5rw9d92kpcjd kind= uid=bc8d71a8-9a72-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:50:21.369425Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin2dpbj2z9xcpg9b68tr7n4bg9qq6grczs225b59zdvpv9w5z46d5rw9d92kpcjd kind= uid=bc8d71a8-9a72-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:53:22.117970Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc kind= uid=284a5d71-9a73-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:53:22.122874Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc kind= uid=284a5d71-9a73-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:56:22.690436Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 284a5d71-9a73-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc" level=info timestamp=2018-08-07T18:56:22.890326Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr kind= uid=94097f39-9a73-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:56:22.890875Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr kind= uid=94097f39-9a73-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:56:22.997417Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr" level=info timestamp=2018-08-07T18:59:23.519456Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 94097f39-9a73-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr" level=info timestamp=2018-08-07T18:59:23.710090Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb kind= uid=ffd1721f-9a73-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:59:23.710794Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb kind= uid=ffd1721f-9a73-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:59:23.802610Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjj6qf8l Pod phase: Pending level=info timestamp=2018-08-07T18:59:27.864010Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T18:59:27.864804Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T18:59:27.869517Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T18:59:39.583536Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T18:59:39.662002Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb" level=info timestamp=2018-08-07T18:59:39.663969Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T18:59:39.664512Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.770 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Killed VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:997 should be in Failed phase [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:998 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Starting a VirtualMachineInstance level=info timestamp=2018-08-07T18:59:24.300181Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb kind=VirtualMachineInstance uid=ffd1721f-9a73-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjj6qf8l" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running 2018/08/07 19:03:54 http: TLS handshake error from 10.244.0.1:40686: EOF level=info timestamp=2018-08-07T19:04:02.618376Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:04:04 http: TLS handshake error from 10.244.0.1:40710: EOF 2018/08/07 19:04:14 http: TLS handshake error from 10.244.0.1:40734: EOF 2018/08/07 19:04:24 http: TLS handshake error from 10.244.0.1:40758: EOF level=info timestamp=2018-08-07T19:04:32.646252Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:04:34 http: TLS handshake error from 10.244.0.1:40782: EOF 2018/08/07 19:04:44 http: TLS handshake error from 10.244.0.1:40806: EOF 2018/08/07 19:04:54 http: TLS handshake error from 10.244.0.1:40830: EOF level=info timestamp=2018-08-07T19:05:02.375377Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:05:02.402274Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:05:02.656999Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:05:04 http: TLS handshake error from 10.244.0.1:40854: EOF 2018/08/07 19:05:14 http: TLS handshake error from 10.244.0.1:40878: EOF 2018/08/07 19:05:24 http: TLS handshake error from 10.244.0.1:40902: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T19:04:10.912644Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:04:10.920624Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:04:15 http: TLS handshake error from 10.244.1.1:40512: EOF 2018/08/07 19:04:25 http: TLS handshake error from 10.244.1.1:40518: EOF 2018/08/07 19:04:35 http: TLS handshake error from 10.244.1.1:40524: EOF level=info timestamp=2018-08-07T19:04:41.057468Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:04:41.062505Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:04:45 http: TLS handshake error from 10.244.1.1:40530: EOF 2018/08/07 19:04:55 http: TLS handshake error from 10.244.1.1:40536: EOF 2018/08/07 19:05:05 http: TLS handshake error from 10.244.1.1:40542: EOF level=info timestamp=2018-08-07T19:05:09.663639Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:05:09.669710Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:05:11.200531Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:05:11.200590Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:05:15 http: TLS handshake error from 10.244.1.1:40548: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T18:50:21.363416Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin2dpbj2z9xcpg9b68tr7n4bg9qq6grczs225b59zdvpv9w5z46d5rw9d92kpcjd kind= uid=bc8d71a8-9a72-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:50:21.369425Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin2dpbj2z9xcpg9b68tr7n4bg9qq6grczs225b59zdvpv9w5z46d5rw9d92kpcjd kind= uid=bc8d71a8-9a72-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:53:22.117970Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc kind= uid=284a5d71-9a73-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:53:22.122874Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc kind= uid=284a5d71-9a73-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:56:22.690436Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 284a5d71-9a73-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc" level=info timestamp=2018-08-07T18:56:22.890326Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr kind= uid=94097f39-9a73-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:56:22.890875Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr kind= uid=94097f39-9a73-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:56:22.997417Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr" level=info timestamp=2018-08-07T18:59:23.519456Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 94097f39-9a73-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr" level=info timestamp=2018-08-07T18:59:23.710090Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb kind= uid=ffd1721f-9a73-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:59:23.710794Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb kind= uid=ffd1721f-9a73-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:59:23.802610Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb" level=info timestamp=2018-08-07T19:02:24.262263Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ffd1721f-9a73-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb" level=info timestamp=2018-08-07T19:02:24.416048Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr kind= uid=6b86129f-9a74-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:02:24.417083Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr kind= uid=6b86129f-9a74-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfskzrhn Pod phase: Pending level=info timestamp=2018-08-07T19:02:28.366528Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:02:28.367050Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:02:28.371583Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:02:40.463739Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:02:40.484834Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr" level=info timestamp=2018-08-07T19:02:40.485662Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:02:40.485871Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.773 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Killed VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:997 should be left alone by virt-handler [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:1025 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Starting a VirtualMachineInstance level=info timestamp=2018-08-07T19:02:25.073617Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr kind=VirtualMachineInstance uid=6b86129f-9a74-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfskzrhn" • [SLOW TEST:15.329 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given a vmi /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:14.739 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given an vm /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:14.512 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given a vmi preset /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:14.064 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given a vmi replica set /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.002 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 should succeed to generate a VM JSON file using oc-process command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:150 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1435 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.002 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 with given VM JSON from the Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:152 should succeed to create a VM using oc-create command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:156 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1435 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.002 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 with given VM JSON from the Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:152 with given VM from the VM JSON /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:158 should succeed to launch a VMI using oc-patch command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:161 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1435 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.002 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 with given VM JSON from the Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:152 with given VM from the VM JSON /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:158 with given VMI from the VM /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:163 should succeed to terminate the VMI using oc-patch command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:166 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1435 ------------------------------ Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running level=info timestamp=2018-08-07T19:07:32.599940Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:07:34 http: TLS handshake error from 10.244.0.1:41214: EOF 2018/08/07 19:07:44 http: TLS handshake error from 10.244.0.1:41238: EOF 2018/08/07 19:07:54 http: TLS handshake error from 10.244.0.1:41262: EOF level=info timestamp=2018-08-07T19:08:02.624339Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:08:04 http: TLS handshake error from 10.244.0.1:41286: EOF 2018/08/07 19:08:14 http: TLS handshake error from 10.244.0.1:41310: EOF 2018/08/07 19:08:24 http: TLS handshake error from 10.244.0.1:41334: EOF level=info timestamp=2018-08-07T19:08:32.570370Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:08:34 http: TLS handshake error from 10.244.0.1:41358: EOF 2018/08/07 19:08:44 http: TLS handshake error from 10.244.0.1:41382: EOF 2018/08/07 19:08:54 http: TLS handshake error from 10.244.0.1:41406: EOF level=info timestamp=2018-08-07T19:09:02.625833Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:09:04 http: TLS handshake error from 10.244.0.1:41430: EOF 2018/08/07 19:09:14 http: TLS handshake error from 10.244.0.1:41454: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T19:08:09.686598Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:08:09.701541Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:08:12.100660Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:08:12.102873Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:08:15 http: TLS handshake error from 10.244.1.1:40656: EOF 2018/08/07 19:08:25 http: TLS handshake error from 10.244.1.1:40662: EOF 2018/08/07 19:08:35 http: TLS handshake error from 10.244.1.1:40668: EOF level=info timestamp=2018-08-07T19:08:42.247338Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:08:42.250326Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:08:45 http: TLS handshake error from 10.244.1.1:40674: EOF 2018/08/07 19:08:55 http: TLS handshake error from 10.244.1.1:40680: EOF 2018/08/07 19:09:05 http: TLS handshake error from 10.244.1.1:40686: EOF level=info timestamp=2018-08-07T19:09:12.381360Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:09:12.381757Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:09:15 http: TLS handshake error from 10.244.1.1:40692: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T18:53:22.122874Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc kind= uid=284a5d71-9a73-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:56:22.690436Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 284a5d71-9a73-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmin2djgvqfc25svf9dkk7sgsgdfmp7xfr2cfvwdznv4x6lrd87g226kt64thjk9tc" level=info timestamp=2018-08-07T18:56:22.890326Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr kind= uid=94097f39-9a73-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:56:22.890875Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr kind= uid=94097f39-9a73-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:56:22.997417Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr" level=info timestamp=2018-08-07T18:59:23.519456Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 94097f39-9a73-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr" level=info timestamp=2018-08-07T18:59:23.710090Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb kind= uid=ffd1721f-9a73-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:59:23.710794Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb kind= uid=ffd1721f-9a73-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:59:23.802610Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb" level=info timestamp=2018-08-07T19:02:24.262263Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ffd1721f-9a73-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb" level=info timestamp=2018-08-07T19:02:24.416048Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr kind= uid=6b86129f-9a74-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:02:24.417083Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr kind= uid=6b86129f-9a74-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:05:25.043383Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6b86129f-9a74-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr" level=info timestamp=2018-08-07T19:06:23.775002Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc kind= uid=fa3126eb-9a74-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:06:23.775949Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc kind= uid=fa3126eb-9a74-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qmjrpzz Pod phase: Pending level=info timestamp=2018-08-07T19:06:27.499075Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:06:27.499690Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:06:27.503588Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:06:39.004199Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:06:39.054390Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc" level=info timestamp=2018-08-07T19:06:39.056341Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:06:39.056802Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.581 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 VirtualMachineInstance definition /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:55 with 3 CPU cores /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:56 should report 3 cpu cores under guest OS [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:62 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Starting a VirtualMachineInstance level=info timestamp=2018-08-07T19:06:24.440613Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc kind=VirtualMachineInstance uid=fa3126eb-9a74-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qmjrpzz" • Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running 2018/08/07 19:10:34 http: TLS handshake error from 10.244.0.1:41646: EOF 2018/08/07 19:10:44 http: TLS handshake error from 10.244.0.1:41670: EOF 2018/08/07 19:10:54 http: TLS handshake error from 10.244.0.1:41694: EOF level=info timestamp=2018-08-07T19:11:02.607317Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:11:04 http: TLS handshake error from 10.244.0.1:41718: EOF 2018/08/07 19:11:14 http: TLS handshake error from 10.244.0.1:41742: EOF 2018/08/07 19:11:24 http: TLS handshake error from 10.244.0.1:41766: EOF level=info timestamp=2018-08-07T19:11:32.557061Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:11:34 http: TLS handshake error from 10.244.0.1:41790: EOF 2018/08/07 19:11:44 http: TLS handshake error from 10.244.0.1:41814: EOF 2018/08/07 19:11:54 http: TLS handshake error from 10.244.0.1:41838: EOF level=info timestamp=2018-08-07T19:12:02.605529Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:12:04 http: TLS handshake error from 10.244.0.1:41862: EOF 2018/08/07 19:12:14 http: TLS handshake error from 10.244.0.1:41886: EOF 2018/08/07 19:12:24 http: TLS handshake error from 10.244.0.1:41910: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T19:11:10.122356Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:11:12.937553Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:11:12.946291Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:11:15 http: TLS handshake error from 10.244.1.1:40764: EOF 2018/08/07 19:11:25 http: TLS handshake error from 10.244.1.1:40770: EOF 2018/08/07 19:11:35 http: TLS handshake error from 10.244.1.1:40776: EOF level=info timestamp=2018-08-07T19:11:43.078342Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:11:43.082280Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:11:45 http: TLS handshake error from 10.244.1.1:40782: EOF 2018/08/07 19:11:55 http: TLS handshake error from 10.244.1.1:40788: EOF 2018/08/07 19:12:05 http: TLS handshake error from 10.244.1.1:40794: EOF level=info timestamp=2018-08-07T19:12:13.226055Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:12:13.225919Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:12:15 http: TLS handshake error from 10.244.1.1:40800: EOF 2018/08/07 19:12:25 http: TLS handshake error from 10.244.1.1:40806: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T18:59:23.519456Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 94097f39-9a73-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi75mw7mc969hz4v52d8hvcmfwszrz2tlcfd979h7jkmc2qkln5w8jwgwsswk27fr" level=info timestamp=2018-08-07T18:59:23.710090Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb kind= uid=ffd1721f-9a73-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T18:59:23.710794Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb kind= uid=ffd1721f-9a73-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T18:59:23.802610Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb" level=info timestamp=2018-08-07T19:02:24.262263Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ffd1721f-9a73-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb" level=info timestamp=2018-08-07T19:02:24.416048Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr kind= uid=6b86129f-9a74-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:02:24.417083Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr kind= uid=6b86129f-9a74-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:05:25.043383Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6b86129f-9a74-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr" level=info timestamp=2018-08-07T19:06:23.775002Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc kind= uid=fa3126eb-9a74-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:06:23.775949Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc kind= uid=fa3126eb-9a74-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:09:24.256712Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: fa3126eb-9a74-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc" level=info timestamp=2018-08-07T19:09:24.484019Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivj88xbqkwg4jwhsnnlpb4zhxdg9wnvhc6gmw5lg9q9j9w98rnzrbhmtw8j5kmg8 kind= uid=65e78f24-9a75-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:09:24.484792Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivj88xbqkwg4jwhsnnlpb4zhxdg9wnvhc6gmw5lg9q9j9w98rnzrbhmtw8j5kmg8 kind= uid=65e78f24-9a75-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:09:25.816327Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis4xzzlmm4wk8ffn29n6b6wxm84wcx5b88z2gnl8mq7qddqbvc6fr7sn76dkdxs5 kind= uid=66b4b4b1-9a75-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:09:25.816631Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis4xzzlmm4wk8ffn29n6b6wxm84wcx5b88z2gnl8mq7qddqbvc6fr7sn76dkdxs5 kind= uid=66b4b4b1-9a75-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmis4xzzlmm4wk8ffn29n6b6wxm84wcx5b88z2gnlhb7h Pod phase: Pending level=info timestamp=2018-08-07T19:09:30.454579Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:09:30.454844Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:09:30.456693Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:09:42.038715Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:09:42.119114Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmis4xzzlmm4wk8ffn29n6b6wxm84wcx5b88z2gnl8mq7qddqbvc6fr7sn76dkdxs5" level=info timestamp=2018-08-07T19:09:42.121286Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:09:42.121731Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure [180.690 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 VirtualMachineInstance definition /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:55 with hugepages /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:164 should consume hugepages /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 hugepages-2Mi [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ STEP: Starting a VM level=info timestamp=2018-08-07T19:09:26.433322Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmis4xzzlmm4wk8ffn29n6b6wxm84wcx5b88z2gnl8mq7qddqbvc6fr7sn76dkdxs5 kind=VirtualMachineInstance uid=66b4b4b1-9a75-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmis4xzzlmm4wk8ffn29n6b6wxm84wcx5b88z2gnlhb7h" S [SKIPPING] [0.286 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 VirtualMachineInstance definition /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:55 with hugepages /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:164 should consume hugepages /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 hugepages-1Gi [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 No node with hugepages hugepages-1Gi capacity /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:216 ------------------------------ • Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running 2018/08/07 19:13:54 http: TLS handshake error from 10.244.0.1:42126: EOF level=info timestamp=2018-08-07T19:14:02.567716Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:14:04 http: TLS handshake error from 10.244.0.1:42150: EOF 2018/08/07 19:14:14 http: TLS handshake error from 10.244.0.1:42174: EOF 2018/08/07 19:14:24 http: TLS handshake error from 10.244.0.1:42198: EOF level=info timestamp=2018-08-07T19:14:32.646706Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:14:34 http: TLS handshake error from 10.244.0.1:42222: EOF 2018/08/07 19:14:44 http: TLS handshake error from 10.244.0.1:42246: EOF 2018/08/07 19:14:54 http: TLS handshake error from 10.244.0.1:42270: EOF level=info timestamp=2018-08-07T19:15:02.378396Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:15:02.401767Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:15:02.566762Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:15:04 http: TLS handshake error from 10.244.0.1:42294: EOF 2018/08/07 19:15:14 http: TLS handshake error from 10.244.0.1:42318: EOF 2018/08/07 19:15:24 http: TLS handshake error from 10.244.0.1:42342: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T19:14:13.767558Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:14:15 http: TLS handshake error from 10.244.1.1:40872: EOF 2018/08/07 19:14:25 http: TLS handshake error from 10.244.1.1:40878: EOF 2018/08/07 19:14:35 http: TLS handshake error from 10.244.1.1:40884: EOF level=info timestamp=2018-08-07T19:14:43.890094Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:14:43.911575Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:14:45 http: TLS handshake error from 10.244.1.1:40890: EOF 2018/08/07 19:14:55 http: TLS handshake error from 10.244.1.1:40896: EOF 2018/08/07 19:15:05 http: TLS handshake error from 10.244.1.1:40902: EOF level=info timestamp=2018-08-07T19:15:10.546429Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:15:10.550819Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:15:14.014237Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:15:14.041375Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:15:15 http: TLS handshake error from 10.244.1.1:40908: EOF 2018/08/07 19:15:25 http: TLS handshake error from 10.244.1.1:40914: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T19:02:24.262263Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ffd1721f-9a73-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi5nr9hc4wc4vjqk6r64dtm9qvjmpbf9lgz8rjjtzscjhw542hjhzpvbd4ckklpkb" level=info timestamp=2018-08-07T19:02:24.416048Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr kind= uid=6b86129f-9a74-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:02:24.417083Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr kind= uid=6b86129f-9a74-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:05:25.043383Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6b86129f-9a74-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr" level=info timestamp=2018-08-07T19:06:23.775002Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc kind= uid=fa3126eb-9a74-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:06:23.775949Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc kind= uid=fa3126eb-9a74-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:09:24.256712Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: fa3126eb-9a74-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc" level=info timestamp=2018-08-07T19:09:24.484019Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivj88xbqkwg4jwhsnnlpb4zhxdg9wnvhc6gmw5lg9q9j9w98rnzrbhmtw8j5kmg8 kind= uid=65e78f24-9a75-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:09:24.484792Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivj88xbqkwg4jwhsnnlpb4zhxdg9wnvhc6gmw5lg9q9j9w98rnzrbhmtw8j5kmg8 kind= uid=65e78f24-9a75-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:09:25.816327Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis4xzzlmm4wk8ffn29n6b6wxm84wcx5b88z2gnl8mq7qddqbvc6fr7sn76dkdxs5 kind= uid=66b4b4b1-9a75-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:09:25.816631Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis4xzzlmm4wk8ffn29n6b6wxm84wcx5b88z2gnl8mq7qddqbvc6fr7sn76dkdxs5 kind= uid=66b4b4b1-9a75-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:12:26.823726Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij62jhf66bdxq8kkcfffvkwfrlr67k28s9w6gr5gg5q2tw6fgd5f4kmk7lntrvwb kind= uid=d295d744-9a75-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:12:26.824711Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij62jhf66bdxq8kkcfffvkwfrlr67k28s9w6gr5gg5q2tw6fgd5f4kmk7lntrvwb kind= uid=d295d744-9a75-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:12:28.111802Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckx4sqh6gngqmwbx94s6vrrgggmrw kind= uid=d35c9f11-9a75-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:12:28.112272Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckx4sqh6gngqmwbx94s6vrrgggmrw kind= uid=d35c9f11-9a75-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckxvgj4s Pod phase: Pending level=info timestamp=2018-08-07T19:12:32.214098Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:12:32.214318Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:12:32.215730Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:12:43.023632Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:12:43.112780Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckx4sqh6gngqmwbx94s6vrrgggmrw" level=info timestamp=2018-08-07T19:12:43.114897Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:12:43.115447Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure in Spec Setup (BeforeEach) [180.688 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 with CPU spec /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:294 when CPU model defined [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:340 should report defined CPU model /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:341 Timed out after 90.013s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:12:28.679052Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckx4sqh6gngqmwbx94s6vrrgggmrw kind=VirtualMachineInstance uid=d35c9f11-9a75-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckxvgj4s" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running 2018/08/07 19:16:34 http: TLS handshake error from 10.244.0.1:42510: EOF 2018/08/07 19:16:44 http: TLS handshake error from 10.244.0.1:42534: EOF 2018/08/07 19:16:54 http: TLS handshake error from 10.244.0.1:42558: EOF level=info timestamp=2018-08-07T19:17:02.628834Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:17:04 http: TLS handshake error from 10.244.0.1:42582: EOF 2018/08/07 19:17:14 http: TLS handshake error from 10.244.0.1:42606: EOF 2018/08/07 19:17:24 http: TLS handshake error from 10.244.0.1:42630: EOF level=info timestamp=2018-08-07T19:17:32.634904Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:17:34 http: TLS handshake error from 10.244.0.1:42654: EOF 2018/08/07 19:17:44 http: TLS handshake error from 10.244.0.1:42678: EOF 2018/08/07 19:17:54 http: TLS handshake error from 10.244.0.1:42702: EOF level=info timestamp=2018-08-07T19:18:02.609502Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:18:04 http: TLS handshake error from 10.244.0.1:42726: EOF 2018/08/07 19:18:14 http: TLS handshake error from 10.244.0.1:42750: EOF 2018/08/07 19:18:24 http: TLS handshake error from 10.244.0.1:42774: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T19:17:14.583361Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:17:15 http: TLS handshake error from 10.244.1.1:40980: EOF 2018/08/07 19:17:25 http: TLS handshake error from 10.244.1.1:40986: EOF 2018/08/07 19:17:35 http: TLS handshake error from 10.244.1.1:40992: EOF level=info timestamp=2018-08-07T19:17:44.686598Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:17:44.701245Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:17:45 http: TLS handshake error from 10.244.1.1:40998: EOF 2018/08/07 19:17:55 http: TLS handshake error from 10.244.1.1:41004: EOF 2018/08/07 19:18:05 http: TLS handshake error from 10.244.1.1:41010: EOF level=info timestamp=2018-08-07T19:18:10.574310Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:18:10.579621Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:18:14.829510Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:18:14.833088Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:18:15 http: TLS handshake error from 10.244.1.1:41016: EOF 2018/08/07 19:18:25 http: TLS handshake error from 10.244.1.1:41022: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T19:05:25.043383Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6b86129f-9a74-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibb8wchngdpgbgfd9ntx228x8nr7tc65tvbvfszrwkfgjgvgtn7vbbgkh7lqjqxr" level=info timestamp=2018-08-07T19:06:23.775002Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc kind= uid=fa3126eb-9a74-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:06:23.775949Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc kind= uid=fa3126eb-9a74-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:09:24.256712Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: fa3126eb-9a74-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc" level=info timestamp=2018-08-07T19:09:24.484019Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivj88xbqkwg4jwhsnnlpb4zhxdg9wnvhc6gmw5lg9q9j9w98rnzrbhmtw8j5kmg8 kind= uid=65e78f24-9a75-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:09:24.484792Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivj88xbqkwg4jwhsnnlpb4zhxdg9wnvhc6gmw5lg9q9j9w98rnzrbhmtw8j5kmg8 kind= uid=65e78f24-9a75-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:09:25.816327Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis4xzzlmm4wk8ffn29n6b6wxm84wcx5b88z2gnl8mq7qddqbvc6fr7sn76dkdxs5 kind= uid=66b4b4b1-9a75-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:09:25.816631Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis4xzzlmm4wk8ffn29n6b6wxm84wcx5b88z2gnl8mq7qddqbvc6fr7sn76dkdxs5 kind= uid=66b4b4b1-9a75-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:12:26.823726Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij62jhf66bdxq8kkcfffvkwfrlr67k28s9w6gr5gg5q2tw6fgd5f4kmk7lntrvwb kind= uid=d295d744-9a75-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:12:26.824711Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij62jhf66bdxq8kkcfffvkwfrlr67k28s9w6gr5gg5q2tw6fgd5f4kmk7lntrvwb kind= uid=d295d744-9a75-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:12:28.111802Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckx4sqh6gngqmwbx94s6vrrgggmrw kind= uid=d35c9f11-9a75-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:12:28.112272Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckx4sqh6gngqmwbx94s6vrrgggmrw kind= uid=d35c9f11-9a75-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:15:28.638376Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckx4sqh6gngqmwbx94s6vrrgggmrw\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckx4sqh6gngqmwbx94s6vrrgggmrw, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d35c9f11-9a75-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckx4sqh6gngqmwbx94s6vrrgggmrw" level=info timestamp=2018-08-07T19:15:28.827457Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi54th9xkmlnw6ptzdww7qsff968w4xzpfbh9rbz8629c5tj6zz94dt248nqjq446 kind= uid=3f11d899-9a76-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:15:28.828204Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi54th9xkmlnw6ptzdww7qsff968w4xzpfbh9rbz8629c5tj6zz94dt248nqjq446 kind= uid=3f11d899-9a76-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi54th9xkmlnw6ptzdww7qsff968w4xzpfbh9rbg46gz Pod phase: Pending level=info timestamp=2018-08-07T19:15:33.241639Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:15:33.241878Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:15:33.243543Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:15:44.268150Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:15:44.310126Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi54th9xkmlnw6ptzdww7qsff968w4xzpfbh9rbz8629c5tj6zz94dt248nqjq446" level=info timestamp=2018-08-07T19:15:44.311725Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:15:44.312171Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [180.735 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 with CPU spec /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:294 when CPU model equals to passthrough [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:368 should report exactly the same model as node CPU /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:369 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:15:29.478292Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi54th9xkmlnw6ptzdww7qsff968w4xzpfbh9rbz8629c5tj6zz94dt248nqjq446 kind=VirtualMachineInstance uid=3f11d899-9a76-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi54th9xkmlnw6ptzdww7qsff968w4xzpfbh9rbg46gz" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running 2018/08/07 19:19:34 http: TLS handshake error from 10.244.0.1:42942: EOF 2018/08/07 19:19:44 http: TLS handshake error from 10.244.0.1:42966: EOF 2018/08/07 19:19:54 http: TLS handshake error from 10.244.0.1:42990: EOF level=info timestamp=2018-08-07T19:20:02.572144Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:20:04 http: TLS handshake error from 10.244.0.1:43014: EOF 2018/08/07 19:20:14 http: TLS handshake error from 10.244.0.1:43038: EOF 2018/08/07 19:20:24 http: TLS handshake error from 10.244.0.1:43062: EOF level=info timestamp=2018-08-07T19:20:32.580896Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:20:34 http: TLS handshake error from 10.244.0.1:43086: EOF 2018/08/07 19:20:44 http: TLS handshake error from 10.244.0.1:43110: EOF 2018/08/07 19:20:54 http: TLS handshake error from 10.244.0.1:43134: EOF level=info timestamp=2018-08-07T19:21:02.594404Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:21:04 http: TLS handshake error from 10.244.0.1:43158: EOF 2018/08/07 19:21:14 http: TLS handshake error from 10.244.0.1:43182: EOF 2018/08/07 19:21:24 http: TLS handshake error from 10.244.0.1:43206: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T19:20:15.408184Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:20:15.416849Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:20:25 http: TLS handshake error from 10.244.1.1:41094: EOF 2018/08/07 19:20:35 http: TLS handshake error from 10.244.1.1:41100: EOF 2018/08/07 19:20:45 http: TLS handshake error from 10.244.1.1:41106: EOF level=info timestamp=2018-08-07T19:20:45.566834Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:20:45.566871Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:20:55 http: TLS handshake error from 10.244.1.1:41112: EOF 2018/08/07 19:21:05 http: TLS handshake error from 10.244.1.1:41118: EOF level=info timestamp=2018-08-07T19:21:09.617988Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:21:09.623619Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:21:15 http: TLS handshake error from 10.244.1.1:41124: EOF level=info timestamp=2018-08-07T19:21:15.712574Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:21:15.712568Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:21:25 http: TLS handshake error from 10.244.1.1:41130: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T19:09:24.256712Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: fa3126eb-9a74-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicv7qjrrpkfpnxnq5dnggk9hdjcvvb9hbhr5qms9hplgfwd9jssd2xc9gxk4kmtc" level=info timestamp=2018-08-07T19:09:24.484019Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivj88xbqkwg4jwhsnnlpb4zhxdg9wnvhc6gmw5lg9q9j9w98rnzrbhmtw8j5kmg8 kind= uid=65e78f24-9a75-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:09:24.484792Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivj88xbqkwg4jwhsnnlpb4zhxdg9wnvhc6gmw5lg9q9j9w98rnzrbhmtw8j5kmg8 kind= uid=65e78f24-9a75-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:09:25.816327Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis4xzzlmm4wk8ffn29n6b6wxm84wcx5b88z2gnl8mq7qddqbvc6fr7sn76dkdxs5 kind= uid=66b4b4b1-9a75-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:09:25.816631Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis4xzzlmm4wk8ffn29n6b6wxm84wcx5b88z2gnl8mq7qddqbvc6fr7sn76dkdxs5 kind= uid=66b4b4b1-9a75-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:12:26.823726Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij62jhf66bdxq8kkcfffvkwfrlr67k28s9w6gr5gg5q2tw6fgd5f4kmk7lntrvwb kind= uid=d295d744-9a75-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:12:26.824711Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij62jhf66bdxq8kkcfffvkwfrlr67k28s9w6gr5gg5q2tw6fgd5f4kmk7lntrvwb kind= uid=d295d744-9a75-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:12:28.111802Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckx4sqh6gngqmwbx94s6vrrgggmrw kind= uid=d35c9f11-9a75-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:12:28.112272Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckx4sqh6gngqmwbx94s6vrrgggmrw kind= uid=d35c9f11-9a75-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:15:28.638376Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckx4sqh6gngqmwbx94s6vrrgggmrw\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckx4sqh6gngqmwbx94s6vrrgggmrw, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d35c9f11-9a75-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckx4sqh6gngqmwbx94s6vrrgggmrw" level=info timestamp=2018-08-07T19:15:28.827457Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi54th9xkmlnw6ptzdww7qsff968w4xzpfbh9rbz8629c5tj6zz94dt248nqjq446 kind= uid=3f11d899-9a76-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:15:28.828204Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi54th9xkmlnw6ptzdww7qsff968w4xzpfbh9rbz8629c5tj6zz94dt248nqjq446 kind= uid=3f11d899-9a76-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:18:29.390055Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi54th9xkmlnw6ptzdww7qsff968w4xzpfbh9rbz8629c5tj6zz94dt248nqjq446\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi54th9xkmlnw6ptzdww7qsff968w4xzpfbh9rbz8629c5tj6zz94dt248nqjq446, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3f11d899-9a76-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi54th9xkmlnw6ptzdww7qsff968w4xzpfbh9rbz8629c5tj6zz94dt248nqjq446" level=info timestamp=2018-08-07T19:18:29.593322Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6lgplr46zmsgtxwbp4xlgqfz6hsnx5dr4pgjr6g984d6rc6gcx4bdfflsr9dn5v kind= uid=aacee2b6-9a76-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:18:29.594110Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6lgplr46zmsgtxwbp4xlgqfz6hsnx5dr4pgjr6g984d6rc6gcx4bdfflsr9dn5v kind= uid=aacee2b6-9a76-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi6lgplr46zmsgtxwbp4xlgqfz6hsnx5dr4pgjrzspw7 Pod phase: Pending level=info timestamp=2018-08-07T19:18:33.903360Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:18:33.903760Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:18:33.906649Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:18:46.193203Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:18:46.284929Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi6lgplr46zmsgtxwbp4xlgqfz6hsnx5dr4pgjr6g984d6rc6gcx4bdfflsr9dn5v" level=info timestamp=2018-08-07T19:18:46.287141Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:18:46.287560Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [180.709 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 with CPU spec /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:294 when CPU model not defined [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:392 should report CPU model from libvirt capabilities /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:393 Timed out after 90.010s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:18:30.178343Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi6lgplr46zmsgtxwbp4xlgqfz6hsnx5dr4pgjr6g984d6rc6gcx4bdfflsr9dn5v kind=VirtualMachineInstance uid=aacee2b6-9a76-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi6lgplr46zmsgtxwbp4xlgqfz6hsnx5dr4pgjrzspw7" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running 2018/08/07 19:22:34 http: TLS handshake error from 10.244.0.1:43374: EOF 2018/08/07 19:22:44 http: TLS handshake error from 10.244.0.1:43398: EOF 2018/08/07 19:22:54 http: TLS handshake error from 10.244.0.1:43422: EOF level=info timestamp=2018-08-07T19:23:02.655402Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:23:04 http: TLS handshake error from 10.244.0.1:43446: EOF 2018/08/07 19:23:14 http: TLS handshake error from 10.244.0.1:43470: EOF 2018/08/07 19:23:24 http: TLS handshake error from 10.244.0.1:43494: EOF level=info timestamp=2018-08-07T19:23:32.649734Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:23:34 http: TLS handshake error from 10.244.0.1:43518: EOF 2018/08/07 19:23:44 http: TLS handshake error from 10.244.0.1:43542: EOF 2018/08/07 19:23:54 http: TLS handshake error from 10.244.0.1:43566: EOF level=info timestamp=2018-08-07T19:24:02.662611Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:24:04 http: TLS handshake error from 10.244.0.1:43590: EOF 2018/08/07 19:24:14 http: TLS handshake error from 10.244.0.1:43614: EOF 2018/08/07 19:24:24 http: TLS handshake error from 10.244.0.1:43638: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T19:23:09.635465Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:23:15 http: TLS handshake error from 10.244.1.1:41196: EOF level=info timestamp=2018-08-07T19:23:16.287865Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:23:16.288103Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:23:25 http: TLS handshake error from 10.244.1.1:41202: EOF 2018/08/07 19:23:35 http: TLS handshake error from 10.244.1.1:41208: EOF 2018/08/07 19:23:45 http: TLS handshake error from 10.244.1.1:41214: EOF level=info timestamp=2018-08-07T19:23:46.444708Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:23:46.444706Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:23:55 http: TLS handshake error from 10.244.1.1:41220: EOF 2018/08/07 19:24:05 http: TLS handshake error from 10.244.1.1:41226: EOF 2018/08/07 19:24:15 http: TLS handshake error from 10.244.1.1:41232: EOF level=info timestamp=2018-08-07T19:24:16.632350Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:24:16.635650Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:24:25 http: TLS handshake error from 10.244.1.1:41238: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T19:09:25.816327Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis4xzzlmm4wk8ffn29n6b6wxm84wcx5b88z2gnl8mq7qddqbvc6fr7sn76dkdxs5 kind= uid=66b4b4b1-9a75-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:09:25.816631Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis4xzzlmm4wk8ffn29n6b6wxm84wcx5b88z2gnl8mq7qddqbvc6fr7sn76dkdxs5 kind= uid=66b4b4b1-9a75-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:12:26.823726Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij62jhf66bdxq8kkcfffvkwfrlr67k28s9w6gr5gg5q2tw6fgd5f4kmk7lntrvwb kind= uid=d295d744-9a75-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:12:26.824711Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij62jhf66bdxq8kkcfffvkwfrlr67k28s9w6gr5gg5q2tw6fgd5f4kmk7lntrvwb kind= uid=d295d744-9a75-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:12:28.111802Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckx4sqh6gngqmwbx94s6vrrgggmrw kind= uid=d35c9f11-9a75-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:12:28.112272Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckx4sqh6gngqmwbx94s6vrrgggmrw kind= uid=d35c9f11-9a75-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:15:28.638376Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckx4sqh6gngqmwbx94s6vrrgggmrw\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckx4sqh6gngqmwbx94s6vrrgggmrw, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d35c9f11-9a75-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi96fb54js6sxlk27z9mkzxmz4qvjkthdjx5ckx4sqh6gngqmwbx94s6vrrgggmrw" level=info timestamp=2018-08-07T19:15:28.827457Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi54th9xkmlnw6ptzdww7qsff968w4xzpfbh9rbz8629c5tj6zz94dt248nqjq446 kind= uid=3f11d899-9a76-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:15:28.828204Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi54th9xkmlnw6ptzdww7qsff968w4xzpfbh9rbz8629c5tj6zz94dt248nqjq446 kind= uid=3f11d899-9a76-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:18:29.390055Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi54th9xkmlnw6ptzdww7qsff968w4xzpfbh9rbz8629c5tj6zz94dt248nqjq446\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi54th9xkmlnw6ptzdww7qsff968w4xzpfbh9rbz8629c5tj6zz94dt248nqjq446, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3f11d899-9a76-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi54th9xkmlnw6ptzdww7qsff968w4xzpfbh9rbz8629c5tj6zz94dt248nqjq446" level=info timestamp=2018-08-07T19:18:29.593322Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6lgplr46zmsgtxwbp4xlgqfz6hsnx5dr4pgjr6g984d6rc6gcx4bdfflsr9dn5v kind= uid=aacee2b6-9a76-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:18:29.594110Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6lgplr46zmsgtxwbp4xlgqfz6hsnx5dr4pgjr6g984d6rc6gcx4bdfflsr9dn5v kind= uid=aacee2b6-9a76-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:21:30.091900Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi6lgplr46zmsgtxwbp4xlgqfz6hsnx5dr4pgjr6g984d6rc6gcx4bdfflsr9dn5v\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi6lgplr46zmsgtxwbp4xlgqfz6hsnx5dr4pgjr6g984d6rc6gcx4bdfflsr9dn5v, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: aacee2b6-9a76-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi6lgplr46zmsgtxwbp4xlgqfz6hsnx5dr4pgjr6g984d6rc6gcx4bdfflsr9dn5v" level=info timestamp=2018-08-07T19:21:30.256950Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2hj4szf8r8kqjnx6vwqs4fhdj58b45hrqpnh7vn5mwxx7rps28h6s5sgkw6s98p kind= uid=167f6c6c-9a77-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:21:30.257628Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2hj4szf8r8kqjnx6vwqs4fhdj58b45hrqpnh7vn5mwxx7rps28h6s5sgkw6s98p kind= uid=167f6c6c-9a77-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi2hj4szf8r8kqjnx6vwqs4fhdj58b45hrqpnh7rrslk Pod phase: Pending level=info timestamp=2018-08-07T19:21:35.213635Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:21:35.214238Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:21:35.218191Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:21:46.874711Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:21:46.956257Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi2hj4szf8r8kqjnx6vwqs4fhdj58b45hrqpnh7vn5mwxx7rps28h6s5sgkw6s98p" level=info timestamp=2018-08-07T19:21:46.958699Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:21:46.959228Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.671 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 New VirtualMachineInstance with all supported drives /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:413 should have all the device nodes [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:436 Timed out after 90.015s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:21:30.886733Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi2hj4szf8r8kqjnx6vwqs4fhdj58b45hrqpnh7vn5mwxx7rps28h6s5sgkw6s98p kind=VirtualMachineInstance uid=167f6c6c-9a77-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi2hj4szf8r8kqjnx6vwqs4fhdj58b45hrqpnh7rrslk" • Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running 2018/08/07 19:25:34 http: TLS handshake error from 10.244.0.1:43806: EOF 2018/08/07 19:25:44 http: TLS handshake error from 10.244.0.1:43830: EOF 2018/08/07 19:25:54 http: TLS handshake error from 10.244.0.1:43854: EOF level=info timestamp=2018-08-07T19:26:02.586564Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:26:04 http: TLS handshake error from 10.244.0.1:43878: EOF 2018/08/07 19:26:14 http: TLS handshake error from 10.244.0.1:43902: EOF 2018/08/07 19:26:24 http: TLS handshake error from 10.244.0.1:43926: EOF level=info timestamp=2018-08-07T19:26:32.652642Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:26:34 http: TLS handshake error from 10.244.0.1:43950: EOF 2018/08/07 19:26:44 http: TLS handshake error from 10.244.0.1:43974: EOF 2018/08/07 19:26:54 http: TLS handshake error from 10.244.0.1:43998: EOF level=info timestamp=2018-08-07T19:27:02.666620Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:27:04 http: TLS handshake error from 10.244.0.1:44022: EOF 2018/08/07 19:27:14 http: TLS handshake error from 10.244.0.1:44046: EOF 2018/08/07 19:27:24 http: TLS handshake error from 10.244.0.1:44070: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T19:26:10.210644Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:26:15 http: TLS handshake error from 10.244.1.1:41304: EOF level=info timestamp=2018-08-07T19:26:17.191077Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:26:17.193916Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:26:25 http: TLS handshake error from 10.244.1.1:41310: EOF 2018/08/07 19:26:35 http: TLS handshake error from 10.244.1.1:41316: EOF 2018/08/07 19:26:45 http: TLS handshake error from 10.244.1.1:41322: EOF level=info timestamp=2018-08-07T19:26:47.337744Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:26:47.340789Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:26:55 http: TLS handshake error from 10.244.1.1:41328: EOF 2018/08/07 19:27:05 http: TLS handshake error from 10.244.1.1:41334: EOF 2018/08/07 19:27:15 http: TLS handshake error from 10.244.1.1:41340: EOF level=info timestamp=2018-08-07T19:27:17.472585Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:27:17.472587Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:27:25 http: TLS handshake error from 10.244.1.1:41346: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T19:21:30.091900Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi6lgplr46zmsgtxwbp4xlgqfz6hsnx5dr4pgjr6g984d6rc6gcx4bdfflsr9dn5v\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi6lgplr46zmsgtxwbp4xlgqfz6hsnx5dr4pgjr6g984d6rc6gcx4bdfflsr9dn5v, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: aacee2b6-9a76-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi6lgplr46zmsgtxwbp4xlgqfz6hsnx5dr4pgjr6g984d6rc6gcx4bdfflsr9dn5v" level=info timestamp=2018-08-07T19:21:30.256950Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2hj4szf8r8kqjnx6vwqs4fhdj58b45hrqpnh7vn5mwxx7rps28h6s5sgkw6s98p kind= uid=167f6c6c-9a77-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:21:30.257628Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2hj4szf8r8kqjnx6vwqs4fhdj58b45hrqpnh7vn5mwxx7rps28h6s5sgkw6s98p kind= uid=167f6c6c-9a77-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:24:30.798672Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi2hj4szf8r8kqjnx6vwqs4fhdj58b45hrqpnh7vn5mwxx7rps28h6s5sgkw6s98p\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi2hj4szf8r8kqjnx6vwqs4fhdj58b45hrqpnh7vn5mwxx7rps28h6s5sgkw6s98p, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 167f6c6c-9a77-11e8-ae40-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi2hj4szf8r8kqjnx6vwqs4fhdj58b45hrqpnh7vn5mwxx7rps28h6s5sgkw6s98p" level=info timestamp=2018-08-07T19:24:31.157231Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7tl7l6ff9z562l2mrxltppv87rfnrjc2ndxvvwwz9nx79sfqz4vdlmwvjvdkmvh kind= uid=825224ef-9a77-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:24:31.158672Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7tl7l6ff9z562l2mrxltppv87rfnrjc2ndxvvwwz9nx79sfqz4vdlmwvjvdkmvh kind= uid=825224ef-9a77-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:24:31.181666Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2nszwj2vfxpnjgq964qpx9p9v56ldpcrq2r92l296hgsqkthmrgqrhbbl8xt8q7 kind= uid=8257a0ef-9a77-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:24:31.182065Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2nszwj2vfxpnjgq964qpx9p9v56ldpcrq2r92l296hgsqkthmrgqrhbbl8xt8q7 kind= uid=8257a0ef-9a77-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:24:31.199719Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigx2w6q8nf9hm6q4th7cdf9ch4m7mlkc89j855rrlzc7vrtwmw64pk7pz5tqmh66 kind= uid=825af1d1-9a77-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:24:31.199950Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigx2w6q8nf9hm6q4th7cdf9ch4m7mlkc89j855rrlzc7vrtwmw64pk7pz5tqmh66 kind= uid=825af1d1-9a77-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:24:31.224542Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi54df7p8x7wtzclxmvqmrszj7gnn28zf4p2968kj6qh99j65tjbh7m4kwc8cz2bk kind= uid=825e8623-9a77-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:24:31.224715Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi54df7p8x7wtzclxmvqmrszj7gnn28zf4p2968kj6qh99j65tjbh7m4kwc8cz2bk kind= uid=825e8623-9a77-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:24:31.390814Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmigx2w6q8nf9hm6q4th7cdf9ch4m7mlkc89j855rrlzc7vrtwmw64pk7pz5tqmh66\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmigx2w6q8nf9hm6q4th7cdf9ch4m7mlkc89j855rrlzc7vrtwmw64pk7pz5tqmh66" level=info timestamp=2018-08-07T19:24:31.773262Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi54df7p8x7wtzclxmvqmrszj7gnn28zf4p2968kj6qh99j65tjbh7m4kwc8cz2bk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi54df7p8x7wtzclxmvqmrszj7gnn28zf4p2968kj6qh99j65tjbh7m4kwc8cz2bk" level=info timestamp=2018-08-07T19:24:32.172355Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi54df7p8x7wtzclxmvqmrszj7gnn28zf4p2968kj6qh99j65tjbh7m4kwc8cz2bk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi54df7p8x7wtzclxmvqmrszj7gnn28zf4p2968kj6qh99j65tjbh7m4kwc8cz2bk" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi2nszwj2vfxpnjgq964qpx9p9v56ldpcrq2r926z6cn Pod phase: Pending level=info timestamp=2018-08-07T19:24:35.813765Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:24:35.814016Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:24:35.816994Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:24:45.825804Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:24:45.881243Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi2nszwj2vfxpnjgq964qpx9p9v56ldpcrq2r92l296hgsqkthmrgqrhbbl8xt8q7" level=info timestamp=2018-08-07T19:24:45.883004Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:24:45.883565Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmi54df7p8x7wtzclxmvqmrszj7gnn28zf4p2968b9hs2 Pod phase: Pending level=info timestamp=2018-08-07T19:24:35.956990Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:24:35.957520Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:24:35.959592Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:24:45.968218Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:24:46.066998Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi54df7p8x7wtzclxmvqmrszj7gnn28zf4p2968kj6qh99j65tjbh7m4kwc8cz2bk" level=info timestamp=2018-08-07T19:24:46.069063Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:24:46.069638Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmi7tl7l6ff9z562l2mrxltppv87rfnrjc2ndxvvr9zlg Pod phase: Pending level=info timestamp=2018-08-07T19:24:35.538064Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:24:35.538337Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:24:35.540402Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:24:45.548776Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:24:45.601379Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi7tl7l6ff9z562l2mrxltppv87rfnrjc2ndxvvwwz9nx79sfqz4vdlmwvjvdkmvh" level=info timestamp=2018-08-07T19:24:45.604192Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:24:45.604760Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmigx2w6q8nf9hm6q4th7cdf9ch4m7mlkc89j855m2rxb Pod phase: Pending level=info timestamp=2018-08-07T19:24:35.986235Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:24:35.986371Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:24:35.988699Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:24:45.997075Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:24:46.105940Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmigx2w6q8nf9hm6q4th7cdf9ch4m7mlkc89j855rrlzc7vrtwmw64pk7pz5tqmh66" level=info timestamp=2018-08-07T19:24:46.107840Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:24:46.108342Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure in Spec Setup (BeforeEach) [181.176 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be able to reach [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 the Inbound VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:24:31.851384Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi7tl7l6ff9z562l2mrxltppv87rfnrjc2ndxvvwwz9nx79sfqz4vdlmwvjvdkmvh kind=VirtualMachineInstance uid=825224ef-9a77-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi7tl7l6ff9z562l2mrxltppv87rfnrjc2ndxvvr9zlg" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running 2018/08/07 19:28:44 http: TLS handshake error from 10.244.0.1:44262: EOF 2018/08/07 19:28:54 http: TLS handshake error from 10.244.0.1:44286: EOF level=info timestamp=2018-08-07T19:29:02.679903Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:29:04 http: TLS handshake error from 10.244.0.1:44310: EOF 2018/08/07 19:29:14 http: TLS handshake error from 10.244.0.1:44334: EOF 2018/08/07 19:29:24 http: TLS handshake error from 10.244.0.1:44358: EOF level=info timestamp=2018-08-07T19:29:32.682757Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:29:34 http: TLS handshake error from 10.244.0.1:44382: EOF 2018/08/07 19:29:44 http: TLS handshake error from 10.244.0.1:44406: EOF 2018/08/07 19:29:54 http: TLS handshake error from 10.244.0.1:44430: EOF level=info timestamp=2018-08-07T19:30:02.667909Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:30:04 http: TLS handshake error from 10.244.0.1:44454: EOF 2018/08/07 19:30:14 http: TLS handshake error from 10.244.0.1:44478: EOF 2018/08/07 19:30:24 http: TLS handshake error from 10.244.0.1:44502: EOF level=info timestamp=2018-08-07T19:30:32.701626Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T19:29:18.034832Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:29:18.034845Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:29:25 http: TLS handshake error from 10.244.1.1:41418: EOF 2018/08/07 19:29:35 http: TLS handshake error from 10.244.1.1:41424: EOF 2018/08/07 19:29:45 http: TLS handshake error from 10.244.1.1:41430: EOF level=info timestamp=2018-08-07T19:29:48.194623Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:29:48.194599Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:29:55 http: TLS handshake error from 10.244.1.1:41436: EOF 2018/08/07 19:30:05 http: TLS handshake error from 10.244.1.1:41442: EOF level=info timestamp=2018-08-07T19:30:10.105099Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:30:10.110752Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:30:15 http: TLS handshake error from 10.244.1.1:41448: EOF level=info timestamp=2018-08-07T19:30:18.297925Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:30:18.304814Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:30:25 http: TLS handshake error from 10.244.1.1:41454: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T19:24:31.773262Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi54df7p8x7wtzclxmvqmrszj7gnn28zf4p2968kj6qh99j65tjbh7m4kwc8cz2bk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi54df7p8x7wtzclxmvqmrszj7gnn28zf4p2968kj6qh99j65tjbh7m4kwc8cz2bk" level=info timestamp=2018-08-07T19:24:32.172355Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi54df7p8x7wtzclxmvqmrszj7gnn28zf4p2968kj6qh99j65tjbh7m4kwc8cz2bk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi54df7p8x7wtzclxmvqmrszj7gnn28zf4p2968kj6qh99j65tjbh7m4kwc8cz2bk" level=info timestamp=2018-08-07T19:27:32.994280Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5hrn5r9mzqtb854rdzwnzht4d5tjnrqwrthx274t8hp996rfxvlzd2ndkz9nwj kind= uid=eeb5041c-9a77-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:27:32.997882Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5hrn5r9mzqtb854rdzwnzht4d5tjnrqwrthx274t8hp996rfxvlzd2ndkz9nwj kind= uid=eeb5041c-9a77-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:27:33.014846Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit4gw5j9j9jpb97j2ffg9vf885k42t6mzk9f9mnh4c8xtd5h75ngdkqc24x9vd7l kind= uid=eeba58db-9a77-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:27:33.015507Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit4gw5j9j9jpb97j2ffg9vf885k42t6mzk9f9mnh4c8xtd5h75ngdkqc24x9vd7l kind= uid=eeba58db-9a77-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:27:33.042503Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6442dz2vcnjbgx6mt8z75lxwqct65t4nnc9vx6fsv9x7f7rz47b4r8jjtmd7kdh kind= uid=eebe23c1-9a77-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:27:33.042847Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6442dz2vcnjbgx6mt8z75lxwqct65t4nnc9vx6fsv9x7f7rz47b4r8jjtmd7kdh kind= uid=eebe23c1-9a77-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:27:33.089631Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7hwlp9x2kkvhjxnrlvk72tbj77ffblxjl4kbz5zxt9crvnz4qjzv8fgs6ntghz2 kind= uid=eec1d204-9a77-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:27:33.089856Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7hwlp9x2kkvhjxnrlvk72tbj77ffblxjl4kbz5zxt9crvnz4qjzv8fgs6ntghz2 kind= uid=eec1d204-9a77-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:27:33.157701Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmit4gw5j9j9jpb97j2ffg9vf885k42t6mzk9f9mnh4c8xtd5h75ngdkqc24x9vd7l\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmit4gw5j9j9jpb97j2ffg9vf885k42t6mzk9f9mnh4c8xtd5h75ngdkqc24x9vd7l" level=info timestamp=2018-08-07T19:27:33.157740Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz5hrn5r9mzqtb854rdzwnzht4d5tjnrqwrthx274t8hp996rfxvlzd2ndkz9nwj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiz5hrn5r9mzqtb854rdzwnzht4d5tjnrqwrthx274t8hp996rfxvlzd2ndkz9nwj" level=info timestamp=2018-08-07T19:27:33.197443Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi6442dz2vcnjbgx6mt8z75lxwqct65t4nnc9vx6fsv9x7f7rz47b4r8jjtmd7kdh\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi6442dz2vcnjbgx6mt8z75lxwqct65t4nnc9vx6fsv9x7f7rz47b4r8jjtmd7kdh" level=info timestamp=2018-08-07T19:27:34.033721Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz5hrn5r9mzqtb854rdzwnzht4d5tjnrqwrthx274t8hp996rfxvlzd2ndkz9nwj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiz5hrn5r9mzqtb854rdzwnzht4d5tjnrqwrthx274t8hp996rfxvlzd2ndkz9nwj" level=info timestamp=2018-08-07T19:27:34.432416Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi6442dz2vcnjbgx6mt8z75lxwqct65t4nnc9vx6fsv9x7f7rz47b4r8jjtmd7kdh\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi6442dz2vcnjbgx6mt8z75lxwqct65t4nnc9vx6fsv9x7f7rz47b4r8jjtmd7kdh" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi6442dz2vcnjbgx6mt8z75lxwqct65t4nnc9vx7m6wv Pod phase: Pending level=info timestamp=2018-08-07T19:27:38.138695Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:27:38.138826Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:27:38.140709Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:27:48.176215Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:27:48.251048Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi6442dz2vcnjbgx6mt8z75lxwqct65t4nnc9vx6fsv9x7f7rz47b4r8jjtmd7kdh" level=info timestamp=2018-08-07T19:27:48.252783Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:27:48.253305Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmi7hwlp9x2kkvhjxnrlvk72tbj77ffblxjl4kbzr5mdg Pod phase: Pending level=info timestamp=2018-08-07T19:27:37.720473Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:27:37.721856Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:27:37.725656Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:27:47.737112Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:27:47.768953Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi7hwlp9x2kkvhjxnrlvk72tbj77ffblxjl4kbz5zxt9crvnz4qjzv8fgs6ntghz2" level=info timestamp=2018-08-07T19:27:47.769791Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:27:47.770001Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmit4gw5j9j9jpb97j2ffg9vf885k42t6mzk9f9mvtfzv Pod phase: Pending level=info timestamp=2018-08-07T19:27:37.624008Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:27:37.626461Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:27:37.636589Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:27:47.647884Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:27:47.720021Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmit4gw5j9j9jpb97j2ffg9vf885k42t6mzk9f9mnh4c8xtd5h75ngdkqc24x9vd7l" level=info timestamp=2018-08-07T19:27:47.721203Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:27:47.721441Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmiz5hrn5r9mzqtb854rdzwnzht4d5tjnrqwrthxrpmb8 Pod phase: Pending level=info timestamp=2018-08-07T19:27:37.264565Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:27:37.265314Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:27:37.269244Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:27:47.984646Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:27:48.050449Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiz5hrn5r9mzqtb854rdzwnzht4d5tjnrqwrthx274t8hp996rfxvlzd2ndkz9nwj" level=info timestamp=2018-08-07T19:27:48.052620Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:27:48.053076Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [181.892 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be able to reach [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 the Inbound VirtualMachineInstance with pod network connectivity explicitly set /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.013s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:27:33.783080Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmiz5hrn5r9mzqtb854rdzwnzht4d5tjnrqwrthx274t8hp996rfxvlzd2ndkz9nwj kind=VirtualMachineInstance uid=eeb5041c-9a77-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmiz5hrn5r9mzqtb854rdzwnzht4d5tjnrqwrthxrpmb8" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running 2018/08/07 19:31:54 http: TLS handshake error from 10.244.0.1:44718: EOF level=info timestamp=2018-08-07T19:32:02.690386Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:32:04 http: TLS handshake error from 10.244.0.1:44742: EOF 2018/08/07 19:32:14 http: TLS handshake error from 10.244.0.1:44766: EOF 2018/08/07 19:32:24 http: TLS handshake error from 10.244.0.1:44790: EOF level=info timestamp=2018-08-07T19:32:32.707818Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:32:34 http: TLS handshake error from 10.244.0.1:44814: EOF 2018/08/07 19:32:44 http: TLS handshake error from 10.244.0.1:44838: EOF 2018/08/07 19:32:54 http: TLS handshake error from 10.244.0.1:44862: EOF level=info timestamp=2018-08-07T19:33:02.605540Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:33:04 http: TLS handshake error from 10.244.0.1:44886: EOF 2018/08/07 19:33:14 http: TLS handshake error from 10.244.0.1:44910: EOF 2018/08/07 19:33:24 http: TLS handshake error from 10.244.0.1:44934: EOF level=info timestamp=2018-08-07T19:33:32.620970Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:33:34 http: TLS handshake error from 10.244.0.1:44958: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T19:32:18.887989Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:32:25 http: TLS handshake error from 10.244.1.1:41526: EOF 2018/08/07 19:32:35 http: TLS handshake error from 10.244.1.1:41532: EOF 2018/08/07 19:32:45 http: TLS handshake error from 10.244.1.1:41538: EOF level=info timestamp=2018-08-07T19:32:49.086626Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:32:49.087393Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:32:55 http: TLS handshake error from 10.244.1.1:41544: EOF 2018/08/07 19:33:05 http: TLS handshake error from 10.244.1.1:41550: EOF level=info timestamp=2018-08-07T19:33:10.132790Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:33:10.148619Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:33:15 http: TLS handshake error from 10.244.1.1:41556: EOF level=info timestamp=2018-08-07T19:33:19.223962Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:33:19.223966Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:33:25 http: TLS handshake error from 10.244.1.1:41562: EOF 2018/08/07 19:33:35 http: TLS handshake error from 10.244.1.1:41568: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T19:27:33.089631Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7hwlp9x2kkvhjxnrlvk72tbj77ffblxjl4kbz5zxt9crvnz4qjzv8fgs6ntghz2 kind= uid=eec1d204-9a77-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:27:33.089856Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7hwlp9x2kkvhjxnrlvk72tbj77ffblxjl4kbz5zxt9crvnz4qjzv8fgs6ntghz2 kind= uid=eec1d204-9a77-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:27:33.157701Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmit4gw5j9j9jpb97j2ffg9vf885k42t6mzk9f9mnh4c8xtd5h75ngdkqc24x9vd7l\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmit4gw5j9j9jpb97j2ffg9vf885k42t6mzk9f9mnh4c8xtd5h75ngdkqc24x9vd7l" level=info timestamp=2018-08-07T19:27:33.157740Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz5hrn5r9mzqtb854rdzwnzht4d5tjnrqwrthx274t8hp996rfxvlzd2ndkz9nwj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiz5hrn5r9mzqtb854rdzwnzht4d5tjnrqwrthx274t8hp996rfxvlzd2ndkz9nwj" level=info timestamp=2018-08-07T19:27:33.197443Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi6442dz2vcnjbgx6mt8z75lxwqct65t4nnc9vx6fsv9x7f7rz47b4r8jjtmd7kdh\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi6442dz2vcnjbgx6mt8z75lxwqct65t4nnc9vx6fsv9x7f7rz47b4r8jjtmd7kdh" level=info timestamp=2018-08-07T19:27:34.033721Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz5hrn5r9mzqtb854rdzwnzht4d5tjnrqwrthx274t8hp996rfxvlzd2ndkz9nwj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiz5hrn5r9mzqtb854rdzwnzht4d5tjnrqwrthx274t8hp996rfxvlzd2ndkz9nwj" level=info timestamp=2018-08-07T19:27:34.432416Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi6442dz2vcnjbgx6mt8z75lxwqct65t4nnc9vx6fsv9x7f7rz47b4r8jjtmd7kdh\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi6442dz2vcnjbgx6mt8z75lxwqct65t4nnc9vx6fsv9x7f7rz47b4r8jjtmd7kdh" level=info timestamp=2018-08-07T19:30:34.890060Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9rhnjxv7p26b5fjqw99zqthn5qxrzbrs6vdfggbszgljt5xlvqhczz5mtk96658 kind= uid=5b203a13-9a78-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:30:34.893880Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9rhnjxv7p26b5fjqw99zqthn5qxrzbrs6vdfggbszgljt5xlvqhczz5mtk96658 kind= uid=5b203a13-9a78-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:30:34.917324Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifsh9swslcbch7xg9fjjz62c8m99nbt2dflcnmqbc2r7mvqhmw8nrln5rjh47j9l kind= uid=5b25367b-9a78-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:30:34.917775Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifsh9swslcbch7xg9fjjz62c8m99nbt2dflcnmqbc2r7mvqhmw8nrln5rjh47j9l kind= uid=5b25367b-9a78-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:30:34.949955Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwd6fvgzpkbgrzrwzv9jsz5dqx59p2mjts7h28hjvwmz7zw85fwxgx69s4whqvqn kind= uid=5b2aa220-9a78-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:30:34.950553Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwd6fvgzpkbgrzrwzv9jsz5dqx59p2mjts7h28hjvwmz7zw85fwxgx69s4whqvqn kind= uid=5b2aa220-9a78-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:30:34.989742Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih6f4wslnj2vmhk5m554c2q5bmlgh2hx5fqbszrvvjftzdtgzn6gmswwb8bgg5n7 kind= uid=5b2e7985-9a78-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:30:34.990026Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih6f4wslnj2vmhk5m554c2q5bmlgh2hx5fqbszrvvjftzdtgzn6gmswwb8bgg5n7 kind= uid=5b2e7985-9a78-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi9rhnjxv7p26b5fjqw99zqthn5qxrzbrs6vdfgpkjm4 Pod phase: Pending level=info timestamp=2018-08-07T19:30:39.974392Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:30:39.975760Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:30:39.977902Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:30:49.990399Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:30:50.047359Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi9rhnjxv7p26b5fjqw99zqthn5qxrzbrs6vdfggbszgljt5xlvqhczz5mtk96658" level=info timestamp=2018-08-07T19:30:50.048898Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:30:50.049431Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmifsh9swslcbch7xg9fjjz62c8m99nbt2dflcnmv78xw Pod phase: Pending level=info timestamp=2018-08-07T19:30:40.134191Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:30:40.135737Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:30:40.140892Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:30:50.151371Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:30:50.203798Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmifsh9swslcbch7xg9fjjz62c8m99nbt2dflcnmqbc2r7mvqhmw8nrln5rjh47j9l" level=info timestamp=2018-08-07T19:30:50.205478Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:30:50.205890Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmih6f4wslnj2vmhk5m554c2q5bmlgh2hx5fqbsz97krg Pod phase: Pending level=info timestamp=2018-08-07T19:30:40.111552Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:30:40.112245Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:30:40.113896Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:30:50.123285Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:30:50.210882Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmih6f4wslnj2vmhk5m554c2q5bmlgh2hx5fqbszrvvjftzdtgzn6gmswwb8bgg5n7" level=info timestamp=2018-08-07T19:30:50.213065Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:30:50.213630Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmiwd6fvgzpkbgrzrwzv9jsz5dqx59p2mjts7h285kn97 Pod phase: Pending level=info timestamp=2018-08-07T19:30:39.437007Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:30:39.438103Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:30:39.441097Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:30:49.451739Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:30:49.540717Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiwd6fvgzpkbgrzrwzv9jsz5dqx59p2mjts7h28hjvwmz7zw85fwxgx69s4whqvqn" level=info timestamp=2018-08-07T19:30:49.544102Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:30:49.544646Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [181.889 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be able to reach [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 the Inbound VirtualMachineInstance with custom MAC address /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:30:35.608711Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi9rhnjxv7p26b5fjqw99zqthn5qxrzbrs6vdfggbszgljt5xlvqhczz5mtk96658 kind=VirtualMachineInstance uid=5b203a13-9a78-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi9rhnjxv7p26b5fjqw99zqthn5qxrzbrs6vdfgpkjm4" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running level=info timestamp=2018-08-07T19:35:02.403902Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:35:02.677745Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:35:04 http: TLS handshake error from 10.244.0.1:45174: EOF 2018/08/07 19:35:14 http: TLS handshake error from 10.244.0.1:45198: EOF 2018/08/07 19:35:24 http: TLS handshake error from 10.244.0.1:45222: EOF level=info timestamp=2018-08-07T19:35:32.713840Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:35:34 http: TLS handshake error from 10.244.0.1:45246: EOF 2018/08/07 19:35:44 http: TLS handshake error from 10.244.0.1:45270: EOF 2018/08/07 19:35:54 http: TLS handshake error from 10.244.0.1:45294: EOF level=info timestamp=2018-08-07T19:36:02.637597Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:36:04 http: TLS handshake error from 10.244.0.1:45318: EOF 2018/08/07 19:36:14 http: TLS handshake error from 10.244.0.1:45342: EOF 2018/08/07 19:36:24 http: TLS handshake error from 10.244.0.1:45366: EOF level=info timestamp=2018-08-07T19:36:32.606683Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:36:34 http: TLS handshake error from 10.244.0.1:45390: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T19:35:19.875511Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:35:25 http: TLS handshake error from 10.244.1.1:41634: EOF 2018/08/07 19:35:35 http: TLS handshake error from 10.244.1.1:41640: EOF 2018/08/07 19:35:45 http: TLS handshake error from 10.244.1.1:41646: EOF level=info timestamp=2018-08-07T19:35:50.030206Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:35:50.069300Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:35:55 http: TLS handshake error from 10.244.1.1:41652: EOF 2018/08/07 19:36:05 http: TLS handshake error from 10.244.1.1:41658: EOF level=info timestamp=2018-08-07T19:36:10.038759Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:36:10.045188Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:36:15 http: TLS handshake error from 10.244.1.1:41664: EOF level=info timestamp=2018-08-07T19:36:20.173596Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:36:20.202236Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:36:25 http: TLS handshake error from 10.244.1.1:41670: EOF 2018/08/07 19:36:35 http: TLS handshake error from 10.244.1.1:41676: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T19:30:34.917775Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifsh9swslcbch7xg9fjjz62c8m99nbt2dflcnmqbc2r7mvqhmw8nrln5rjh47j9l kind= uid=5b25367b-9a78-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:30:34.949955Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwd6fvgzpkbgrzrwzv9jsz5dqx59p2mjts7h28hjvwmz7zw85fwxgx69s4whqvqn kind= uid=5b2aa220-9a78-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:30:34.950553Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwd6fvgzpkbgrzrwzv9jsz5dqx59p2mjts7h28hjvwmz7zw85fwxgx69s4whqvqn kind= uid=5b2aa220-9a78-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:30:34.989742Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih6f4wslnj2vmhk5m554c2q5bmlgh2hx5fqbszrvvjftzdtgzn6gmswwb8bgg5n7 kind= uid=5b2e7985-9a78-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:30:34.990026Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih6f4wslnj2vmhk5m554c2q5bmlgh2hx5fqbszrvvjftzdtgzn6gmswwb8bgg5n7 kind= uid=5b2e7985-9a78-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:33:36.784410Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9rpb4l4r6qw2qhjrbxfhvp5tppwh4tz56l7b84q9vvrmzflntbscsc7hd8n9pf2 kind= uid=c78ac7dd-9a78-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:33:36.789112Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9rpb4l4r6qw2qhjrbxfhvp5tppwh4tz56l7b84q9vvrmzflntbscsc7hd8n9pf2 kind= uid=c78ac7dd-9a78-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:33:36.808940Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi84f728f5tf7d8lhkm6hjsvfbgfmphf9bsn9rtdsr76tnzbjngszbxd84kfzh6js kind= uid=c7903224-9a78-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:33:36.809435Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi84f728f5tf7d8lhkm6hjsvfbgfmphf9bsn9rtdsr76tnzbjngszbxd84kfzh6js kind= uid=c7903224-9a78-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:33:36.840960Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis7cdzsvxwth7ls2jzl58w45kq6xsrlsjg9pjrzkp4dtk2hqfqlmtndrrp8z4q7r kind= uid=c79477dc-9a78-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:33:36.841463Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis7cdzsvxwth7ls2jzl58w45kq6xsrlsjg9pjrzkp4dtk2hqfqlmtndrrp8z4q7r kind= uid=c79477dc-9a78-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:33:36.889470Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivnffvcnhq7r54t7czt5m75wwr9xb2ggslppjrr7ggdcwvvzx6vkxdcfm8gxlllb kind= uid=c7995150-9a78-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:33:36.889709Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivnffvcnhq7r54t7czt5m75wwr9xb2ggslppjrr7ggdcwvvzx6vkxdcfm8gxlllb kind= uid=c7995150-9a78-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:33:37.072913Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmis7cdzsvxwth7ls2jzl58w45kq6xsrlsjg9pjrzkp4dtk2hqfqlmtndrrp8z4q7r\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmis7cdzsvxwth7ls2jzl58w45kq6xsrlsjg9pjrzkp4dtk2hqfqlmtndrrp8z4q7r" level=info timestamp=2018-08-07T19:33:37.237048Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivnffvcnhq7r54t7czt5m75wwr9xb2ggslppjrr7ggdcwvvzx6vkxdcfm8gxlllb\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivnffvcnhq7r54t7czt5m75wwr9xb2ggslppjrr7ggdcwvvzx6vkxdcfm8gxlllb" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi84f728f5tf7d8lhkm6hjsvfbgfmphf9bsn9rtg8cv6 Pod phase: Pending level=info timestamp=2018-08-07T19:33:40.694753Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:33:40.694895Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:33:40.696880Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:33:50.912353Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:33:50.981043Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi84f728f5tf7d8lhkm6hjsvfbgfmphf9bsn9rtdsr76tnzbjngszbxd84kfzh6js" level=info timestamp=2018-08-07T19:33:50.983254Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:33:50.983809Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmi9rpb4l4r6qw2qhjrbxfhvp5tppwh4tz56l7b8rdsnn Pod phase: Pending level=info timestamp=2018-08-07T19:33:41.584997Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:33:41.585266Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:33:41.586866Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:33:52.538435Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:33:52.616844Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi9rpb4l4r6qw2qhjrbxfhvp5tppwh4tz56l7b84q9vvrmzflntbscsc7hd8n9pf2" level=info timestamp=2018-08-07T19:33:52.619258Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:33:52.619704Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmis7cdzsvxwth7ls2jzl58w45kq6xsrlsjg9pjrlfkgq Pod phase: Pending level=info timestamp=2018-08-07T19:33:39.663179Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:33:39.663836Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:33:39.665965Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:33:49.679556Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:33:49.788822Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmis7cdzsvxwth7ls2jzl58w45kq6xsrlsjg9pjrzkp4dtk2hqfqlmtndrrp8z4q7r" level=info timestamp=2018-08-07T19:33:49.789798Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:33:49.790007Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmivnffvcnhq7r54t7czt5m75wwr9xb2ggslppjr8tqxm Pod phase: Pending level=info timestamp=2018-08-07T19:33:40.465594Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:33:40.465803Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:33:40.467988Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:33:50.475246Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:33:50.553909Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmivnffvcnhq7r54t7czt5m75wwr9xb2ggslppjrr7ggdcwvvzx6vkxdcfm8gxlllb" level=info timestamp=2018-08-07T19:33:50.556044Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:33:50.556735Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [181.879 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be able to reach [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 the internet /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:33:37.564931Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmi9rpb4l4r6qw2qhjrbxfhvp5tppwh4tz56l7b84q9vvrmzflntbscsc7hd8n9pf2 kind=VirtualMachineInstance uid=c78ac7dd-9a78-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi9rpb4l4r6qw2qhjrbxfhvp5tppwh4tz56l7b8rdsnn" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running 2018/08/07 19:37:54 http: TLS handshake error from 10.244.0.1:45582: EOF level=info timestamp=2018-08-07T19:38:02.615924Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:38:04 http: TLS handshake error from 10.244.0.1:45606: EOF 2018/08/07 19:38:14 http: TLS handshake error from 10.244.0.1:45630: EOF 2018/08/07 19:38:24 http: TLS handshake error from 10.244.0.1:45654: EOF level=info timestamp=2018-08-07T19:38:32.670825Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:38:34 http: TLS handshake error from 10.244.0.1:45678: EOF 2018/08/07 19:38:44 http: TLS handshake error from 10.244.0.1:45702: EOF 2018/08/07 19:38:54 http: TLS handshake error from 10.244.0.1:45726: EOF level=info timestamp=2018-08-07T19:39:02.705650Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:39:04 http: TLS handshake error from 10.244.0.1:45750: EOF 2018/08/07 19:39:14 http: TLS handshake error from 10.244.0.1:45774: EOF 2018/08/07 19:39:24 http: TLS handshake error from 10.244.0.1:45798: EOF level=info timestamp=2018-08-07T19:39:32.638995Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:39:34 http: TLS handshake error from 10.244.0.1:45822: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running 2018/08/07 19:38:15 http: TLS handshake error from 10.244.1.1:41736: EOF level=info timestamp=2018-08-07T19:38:20.828818Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:38:20.830179Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:38:25 http: TLS handshake error from 10.244.1.1:41742: EOF 2018/08/07 19:38:35 http: TLS handshake error from 10.244.1.1:41748: EOF 2018/08/07 19:38:45 http: TLS handshake error from 10.244.1.1:41754: EOF level=info timestamp=2018-08-07T19:38:50.988155Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:38:50.988097Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:38:55 http: TLS handshake error from 10.244.1.1:41760: EOF 2018/08/07 19:39:05 http: TLS handshake error from 10.244.1.1:41766: EOF 2018/08/07 19:39:15 http: TLS handshake error from 10.244.1.1:41772: EOF level=info timestamp=2018-08-07T19:39:21.136228Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:39:21.136191Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:39:25 http: TLS handshake error from 10.244.1.1:41778: EOF 2018/08/07 19:39:35 http: TLS handshake error from 10.244.1.1:41784: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T19:33:36.889470Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivnffvcnhq7r54t7czt5m75wwr9xb2ggslppjrr7ggdcwvvzx6vkxdcfm8gxlllb kind= uid=c7995150-9a78-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:33:36.889709Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivnffvcnhq7r54t7czt5m75wwr9xb2ggslppjrr7ggdcwvvzx6vkxdcfm8gxlllb kind= uid=c7995150-9a78-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:33:37.072913Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmis7cdzsvxwth7ls2jzl58w45kq6xsrlsjg9pjrzkp4dtk2hqfqlmtndrrp8z4q7r\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmis7cdzsvxwth7ls2jzl58w45kq6xsrlsjg9pjrzkp4dtk2hqfqlmtndrrp8z4q7r" level=info timestamp=2018-08-07T19:33:37.237048Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivnffvcnhq7r54t7czt5m75wwr9xb2ggslppjrr7ggdcwvvzx6vkxdcfm8gxlllb\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivnffvcnhq7r54t7czt5m75wwr9xb2ggslppjrr7ggdcwvvzx6vkxdcfm8gxlllb" level=info timestamp=2018-08-07T19:36:38.671478Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmip5nfv87spjhdd5wvtv75bw2nq8q9clq8pcxsv4p5l7w52872wls8t78zl5wmr9b kind= uid=33f4b028-9a79-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:36:38.675733Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmip5nfv87spjhdd5wvtv75bw2nq8q9clq8pcxsv4p5l7w52872wls8t78zl5wmr9b kind= uid=33f4b028-9a79-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:36:38.703225Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8zwvrdwrd749lq74hztvzp4bc2x6d9qg5slhz4b7j97mdxrxqhpn7rwblqs8dmc kind= uid=33fa8f1e-9a79-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:36:38.703625Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8zwvrdwrd749lq74hztvzp4bc2x6d9qg5slhz4b7j97mdxrxqhpn7rwblqs8dmc kind= uid=33fa8f1e-9a79-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:36:38.729034Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmic2rmzcvnbrhzp6ll8j8rqzf4b4z9brdh5gfv2tfwsvtt67q4gv92b85k498kzzz kind= uid=33feb60c-9a79-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:36:38.729421Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmic2rmzcvnbrhzp6ll8j8rqzf4b4z9brdh5gfv2tfwsvtt67q4gv92b85k498kzzz kind= uid=33feb60c-9a79-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:36:38.793382Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigc7j8wlkbpbd9qgm97vt6zwvtl24bclbhp589zjc7ndzb2gncrxzgkdmkpq9ckd kind= uid=34043ecc-9a79-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:36:38.793626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigc7j8wlkbpbd9qgm97vt6zwvtl24bclbhp589zjc7ndzb2gncrxzgkdmkpq9ckd kind= uid=34043ecc-9a79-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:36:38.854687Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmip5nfv87spjhdd5wvtv75bw2nq8q9clq8pcxsv4p5l7w52872wls8t78zl5wmr9b\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmip5nfv87spjhdd5wvtv75bw2nq8q9clq8pcxsv4p5l7w52872wls8t78zl5wmr9b" level=info timestamp=2018-08-07T19:36:39.338246Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmip5nfv87spjhdd5wvtv75bw2nq8q9clq8pcxsv4p5l7w52872wls8t78zl5wmr9b\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmip5nfv87spjhdd5wvtv75bw2nq8q9clq8pcxsv4p5l7w52872wls8t78zl5wmr9b" level=info timestamp=2018-08-07T19:36:39.740766Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmigc7j8wlkbpbd9qgm97vt6zwvtl24bclbhp589zjc7ndzb2gncrxzgkdmkpq9ckd\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmigc7j8wlkbpbd9qgm97vt6zwvtl24bclbhp589zjc7ndzb2gncrxzgkdmkpq9ckd" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi8zwvrdwrd749lq74hztvzp4bc2x6d9qg5slhzk5g4r Pod phase: Pending level=info timestamp=2018-08-07T19:36:43.305954Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:36:43.306615Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:36:43.308863Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:36:53.317644Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:36:53.396272Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi8zwvrdwrd749lq74hztvzp4bc2x6d9qg5slhz4b7j97mdxrxqhpn7rwblqs8dmc" level=info timestamp=2018-08-07T19:36:53.398282Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:36:53.398726Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmic2rmzcvnbrhzp6ll8j8rqzf4b4z9brdh5gfv25q8vb Pod phase: Pending level=info timestamp=2018-08-07T19:36:43.184164Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:36:43.184330Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:36:43.186664Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:36:53.194320Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:36:53.270086Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmic2rmzcvnbrhzp6ll8j8rqzf4b4z9brdh5gfv2tfwsvtt67q4gv92b85k498kzzz" level=info timestamp=2018-08-07T19:36:53.272050Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:36:53.272572Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmigc7j8wlkbpbd9qgm97vt6zwvtl24bclbhp589g64ws Pod phase: Pending level=info timestamp=2018-08-07T19:36:43.837831Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:36:43.837979Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:36:43.840813Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:36:53.851299Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:36:53.923778Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmigc7j8wlkbpbd9qgm97vt6zwvtl24bclbhp589zjc7ndzb2gncrxzgkdmkpq9ckd" level=info timestamp=2018-08-07T19:36:53.925743Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:36:53.926334Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmip5nfv87spjhdd5wvtv75bw2nq8q9clq8pcxsv9v5fv Pod phase: Pending level=info timestamp=2018-08-07T19:36:42.774839Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:36:42.776153Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:36:42.779342Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:36:52.790239Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:36:52.846556Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmip5nfv87spjhdd5wvtv75bw2nq8q9clq8pcxsv4p5l7w52872wls8t78zl5wmr9b" level=info timestamp=2018-08-07T19:36:52.848846Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:36:52.849405Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [181.921 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be reachable via the propagated IP from a Pod [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 on the same node from Pod /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:36:39.415392Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmip5nfv87spjhdd5wvtv75bw2nq8q9clq8pcxsv4p5l7w52872wls8t78zl5wmr9b kind=VirtualMachineInstance uid=33f4b028-9a79-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmip5nfv87spjhdd5wvtv75bw2nq8q9clq8pcxsv9v5fv" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running 2018/08/07 19:40:54 http: TLS handshake error from 10.244.0.1:46014: EOF level=info timestamp=2018-08-07T19:41:02.627994Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:41:04 http: TLS handshake error from 10.244.0.1:46038: EOF 2018/08/07 19:41:14 http: TLS handshake error from 10.244.0.1:46062: EOF 2018/08/07 19:41:24 http: TLS handshake error from 10.244.0.1:46086: EOF level=info timestamp=2018-08-07T19:41:32.693961Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:41:34 http: TLS handshake error from 10.244.0.1:46110: EOF 2018/08/07 19:41:44 http: TLS handshake error from 10.244.0.1:46134: EOF 2018/08/07 19:41:54 http: TLS handshake error from 10.244.0.1:46158: EOF level=info timestamp=2018-08-07T19:42:02.616859Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:42:04 http: TLS handshake error from 10.244.0.1:46182: EOF 2018/08/07 19:42:14 http: TLS handshake error from 10.244.0.1:46206: EOF 2018/08/07 19:42:24 http: TLS handshake error from 10.244.0.1:46230: EOF level=info timestamp=2018-08-07T19:42:32.643676Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:42:34 http: TLS handshake error from 10.244.0.1:46254: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running 2018/08/07 19:41:15 http: TLS handshake error from 10.244.1.1:41844: EOF level=info timestamp=2018-08-07T19:41:21.725628Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:41:21.747411Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:41:25 http: TLS handshake error from 10.244.1.1:41850: EOF 2018/08/07 19:41:35 http: TLS handshake error from 10.244.1.1:41856: EOF 2018/08/07 19:41:45 http: TLS handshake error from 10.244.1.1:41862: EOF level=info timestamp=2018-08-07T19:41:51.859702Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:41:51.874073Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:41:55 http: TLS handshake error from 10.244.1.1:41868: EOF 2018/08/07 19:42:05 http: TLS handshake error from 10.244.1.1:41874: EOF 2018/08/07 19:42:15 http: TLS handshake error from 10.244.1.1:41880: EOF level=info timestamp=2018-08-07T19:42:22.009784Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:42:22.009787Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:42:25 http: TLS handshake error from 10.244.1.1:41886: EOF 2018/08/07 19:42:35 http: TLS handshake error from 10.244.1.1:41892: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T19:36:38.793626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigc7j8wlkbpbd9qgm97vt6zwvtl24bclbhp589zjc7ndzb2gncrxzgkdmkpq9ckd kind= uid=34043ecc-9a79-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:36:38.854687Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmip5nfv87spjhdd5wvtv75bw2nq8q9clq8pcxsv4p5l7w52872wls8t78zl5wmr9b\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmip5nfv87spjhdd5wvtv75bw2nq8q9clq8pcxsv4p5l7w52872wls8t78zl5wmr9b" level=info timestamp=2018-08-07T19:36:39.338246Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmip5nfv87spjhdd5wvtv75bw2nq8q9clq8pcxsv4p5l7w52872wls8t78zl5wmr9b\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmip5nfv87spjhdd5wvtv75bw2nq8q9clq8pcxsv4p5l7w52872wls8t78zl5wmr9b" level=info timestamp=2018-08-07T19:36:39.740766Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmigc7j8wlkbpbd9qgm97vt6zwvtl24bclbhp589zjc7ndzb2gncrxzgkdmkpq9ckd\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmigc7j8wlkbpbd9qgm97vt6zwvtl24bclbhp589zjc7ndzb2gncrxzgkdmkpq9ckd" level=info timestamp=2018-08-07T19:39:40.601944Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimfcmfzw4mk72tlhlmtnkb22k8xgq5rsphlgntjnvb54jc4ftzzwzsl62rx9njnm kind= uid=a06478af-9a79-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:39:40.605341Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimfcmfzw4mk72tlhlmtnkb22k8xgq5rsphlgntjnvb54jc4ftzzwzsl62rx9njnm kind= uid=a06478af-9a79-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:39:40.622629Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicpjxhjdhqj4hnblc8rhwv79bzp665qt4gj6p9qv66zpc8vmcpdg8mrqr99hqhb6 kind= uid=a06a4442-9a79-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:39:40.623015Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicpjxhjdhqj4hnblc8rhwv79bzp665qt4gj6p9qv66zpc8vmcpdg8mrqr99hqhb6 kind= uid=a06a4442-9a79-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:39:40.659459Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim69tgb6mltq8qzfc6qtm77bw7vc2fn6gqdlt5kkbfvk7l4qnqncvwwbjmstjszx kind= uid=a06e00c9-9a79-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:39:40.659840Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim69tgb6mltq8qzfc6qtm77bw7vc2fn6gqdlt5kkbfvk7l4qnqncvwwbjmstjszx kind= uid=a06e00c9-9a79-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:39:40.700346Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimj67wv8hvrhfgqwc28jrvjdg9hx9l5mcfdxfmtlpj9s6ncjp2zbgw4f8sthzvvn kind= uid=a074ab60-9a79-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:39:40.700570Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimj67wv8hvrhfgqwc28jrvjdg9hx9l5mcfdxfmtlpj9s6ncjp2zbgw4f8sthzvvn kind= uid=a074ab60-9a79-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:39:40.741760Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicpjxhjdhqj4hnblc8rhwv79bzp665qt4gj6p9qv66zpc8vmcpdg8mrqr99hqhb6\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicpjxhjdhqj4hnblc8rhwv79bzp665qt4gj6p9qv66zpc8vmcpdg8mrqr99hqhb6" level=info timestamp=2018-08-07T19:39:40.754850Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimfcmfzw4mk72tlhlmtnkb22k8xgq5rsphlgntjnvb54jc4ftzzwzsl62rx9njnm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimfcmfzw4mk72tlhlmtnkb22k8xgq5rsphlgntjnvb54jc4ftzzwzsl62rx9njnm" level=info timestamp=2018-08-07T19:39:41.453552Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmim69tgb6mltq8qzfc6qtm77bw7vc2fn6gqdlt5kkbfvk7l4qnqncvwwbjmstjszx\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmim69tgb6mltq8qzfc6qtm77bw7vc2fn6gqdlt5kkbfvk7l4qnqncvwwbjmstjszx" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmicpjxhjdhqj4hnblc8rhwv79bzp665qt4gj6p9wqntv Pod phase: Pending level=info timestamp=2018-08-07T19:39:44.664343Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:39:44.664579Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:39:44.666162Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:39:55.361002Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:39:55.441417Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmicpjxhjdhqj4hnblc8rhwv79bzp665qt4gj6p9qv66zpc8vmcpdg8mrqr99hqhb6" level=info timestamp=2018-08-07T19:39:55.444417Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:39:55.444844Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmim69tgb6mltq8qzfc6qtm77bw7vc2fn6gqdlt5f26jr Pod phase: Pending level=info timestamp=2018-08-07T19:39:44.716714Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:39:44.716909Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:39:44.719351Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:39:54.730699Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:39:54.821228Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmim69tgb6mltq8qzfc6qtm77bw7vc2fn6gqdlt5kkbfvk7l4qnqncvwwbjmstjszx" level=info timestamp=2018-08-07T19:39:54.823195Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:39:54.823751Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmimfcmfzw4mk72tlhlmtnkb22k8xgq5rsphlgntcrwpd Pod phase: Pending level=info timestamp=2018-08-07T19:39:44.932478Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:39:44.932644Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:39:44.934736Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:39:54.942806Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:39:54.990963Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmimfcmfzw4mk72tlhlmtnkb22k8xgq5rsphlgntjnvb54jc4ftzzwzsl62rx9njnm" level=info timestamp=2018-08-07T19:39:54.992758Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:39:54.993278Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmimj67wv8hvrhfgqwc28jrvjdg9hx9l5mcfdxfm6nh6t Pod phase: Pending level=info timestamp=2018-08-07T19:39:44.678780Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:39:44.679038Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:39:44.681198Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:39:54.693157Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:39:54.752324Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmimj67wv8hvrhfgqwc28jrvjdg9hx9l5mcfdxfmtlpj9s6ncjp2zbgw4f8sthzvvn" level=info timestamp=2018-08-07T19:39:54.761321Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:39:54.761814Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [181.908 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be reachable via the propagated IP from a Pod [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 on a different node from Pod /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.015s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:39:41.308427Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmimfcmfzw4mk72tlhlmtnkb22k8xgq5rsphlgntjnvb54jc4ftzzwzsl62rx9njnm kind=VirtualMachineInstance uid=a06478af-9a79-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmimfcmfzw4mk72tlhlmtnkb22k8xgq5rsphlgntcrwpd" Pod name: disks-images-provider-9tm22 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-crp69 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-cv9g2 Pod phase: Running 2018/08/07 19:44:04 http: TLS handshake error from 10.244.0.1:46470: EOF 2018/08/07 19:44:14 http: TLS handshake error from 10.244.0.1:46494: EOF 2018/08/07 19:44:24 http: TLS handshake error from 10.244.0.1:46518: EOF level=info timestamp=2018-08-07T19:44:32.620149Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:44:34 http: TLS handshake error from 10.244.0.1:46542: EOF 2018/08/07 19:44:44 http: TLS handshake error from 10.244.0.1:46566: EOF 2018/08/07 19:44:54 http: TLS handshake error from 10.244.0.1:46590: EOF level=info timestamp=2018-08-07T19:45:02.378282Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:45:02.404559Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:45:02.679835Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:45:04 http: TLS handshake error from 10.244.0.1:46614: EOF 2018/08/07 19:45:14 http: TLS handshake error from 10.244.0.1:46638: EOF 2018/08/07 19:45:24 http: TLS handshake error from 10.244.0.1:46662: EOF level=info timestamp=2018-08-07T19:45:32.645952Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:45:34 http: TLS handshake error from 10.244.0.1:46686: EOF Pod name: virt-api-7d79764579-wr2sl Pod phase: Running level=info timestamp=2018-08-07T19:44:22.629554Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:44:25 http: TLS handshake error from 10.244.1.1:41958: EOF 2018/08/07 19:44:35 http: TLS handshake error from 10.244.1.1:41964: EOF 2018/08/07 19:44:45 http: TLS handshake error from 10.244.1.1:41970: EOF level=info timestamp=2018-08-07T19:44:52.752924Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:44:52.768534Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:44:55 http: TLS handshake error from 10.244.1.1:41976: EOF 2018/08/07 19:45:05 http: TLS handshake error from 10.244.1.1:41982: EOF level=info timestamp=2018-08-07T19:45:09.785627Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-07T19:45:09.789951Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/07 19:45:15 http: TLS handshake error from 10.244.1.1:41988: EOF level=info timestamp=2018-08-07T19:45:22.890475Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-07T19:45:22.898358Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/07 19:45:25 http: TLS handshake error from 10.244.1.1:41994: EOF 2018/08/07 19:45:35 http: TLS handshake error from 10.244.1.1:42000: EOF Pod name: virt-controller-7d57d96b65-2hbsp Pod phase: Running level=info timestamp=2018-08-07T19:39:40.700570Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimj67wv8hvrhfgqwc28jrvjdg9hx9l5mcfdxfmtlpj9s6ncjp2zbgw4f8sthzvvn kind= uid=a074ab60-9a79-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:39:40.741760Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicpjxhjdhqj4hnblc8rhwv79bzp665qt4gj6p9qv66zpc8vmcpdg8mrqr99hqhb6\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicpjxhjdhqj4hnblc8rhwv79bzp665qt4gj6p9qv66zpc8vmcpdg8mrqr99hqhb6" level=info timestamp=2018-08-07T19:39:40.754850Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimfcmfzw4mk72tlhlmtnkb22k8xgq5rsphlgntjnvb54jc4ftzzwzsl62rx9njnm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimfcmfzw4mk72tlhlmtnkb22k8xgq5rsphlgntjnvb54jc4ftzzwzsl62rx9njnm" level=info timestamp=2018-08-07T19:39:41.453552Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmim69tgb6mltq8qzfc6qtm77bw7vc2fn6gqdlt5kkbfvk7l4qnqncvwwbjmstjszx\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmim69tgb6mltq8qzfc6qtm77bw7vc2fn6gqdlt5kkbfvk7l4qnqncvwwbjmstjszx" level=info timestamp=2018-08-07T19:42:42.504781Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirj8g4jt7qmkmcjh6nrxwffzpx6lbzm6mxblkr7zcktzfpqqmxcjz4dxg79l958w kind= uid=0cd1ab5f-9a7a-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:42:42.511102Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirj8g4jt7qmkmcjh6nrxwffzpx6lbzm6mxblkr7zcktzfpqqmxcjz4dxg79l958w kind= uid=0cd1ab5f-9a7a-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:42:42.527536Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7frft45v8ntz9xbkjx9k4tlwwr6bmrcpnhnvjcbwklkrdcnzw4strz76jnh9npn kind= uid=0cd696b7-9a7a-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:42:42.527950Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7frft45v8ntz9xbkjx9k4tlwwr6bmrcpnhnvjcbwklkrdcnzw4strz76jnh9npn kind= uid=0cd696b7-9a7a-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:42:42.575496Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibcjwghb7d6zhcgvvs5j29c979pxnz249p8x98wsn9l9d4vrtwq8mgft2rw9cl25 kind= uid=0cdaf8b6-9a7a-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:42:42.575873Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibcjwghb7d6zhcgvvs5j29c979pxnz249p8x98wsn9l9d4vrtwq8mgft2rw9cl25 kind= uid=0cdaf8b6-9a7a-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:42:42.649600Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicxxvcwt2z4pqc2tbhr5q6btwqrjdnxglkzx46xcfdnfzzmsm7r8dxzrdjnshvbn kind= uid=0ce1cfd4-9a7a-11e8-ae40-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-07T19:42:42.649860Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicxxvcwt2z4pqc2tbhr5q6btwqrjdnxglkzx46xcfdnfzzmsm7r8dxzrdjnshvbn kind= uid=0ce1cfd4-9a7a-11e8-ae40-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-07T19:42:42.735476Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibcjwghb7d6zhcgvvs5j29c979pxnz249p8x98wsn9l9d4vrtwq8mgft2rw9cl25\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibcjwghb7d6zhcgvvs5j29c979pxnz249p8x98wsn9l9d4vrtwq8mgft2rw9cl25" level=info timestamp=2018-08-07T19:42:42.780349Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirj8g4jt7qmkmcjh6nrxwffzpx6lbzm6mxblkr7zcktzfpqqmxcjz4dxg79l958w\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirj8g4jt7qmkmcjh6nrxwffzpx6lbzm6mxblkr7zcktzfpqqmxcjz4dxg79l958w" level=info timestamp=2018-08-07T19:42:43.548351Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicxxvcwt2z4pqc2tbhr5q6btwqrjdnxglkzx46xcfdnfzzmsm7r8dxzrdjnshvbn\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicxxvcwt2z4pqc2tbhr5q6btwqrjdnxglkzx46xcfdnfzzmsm7r8dxzrdjnshvbn" Pod name: virt-controller-7d57d96b65-fp8vk Pod phase: Running level=info timestamp=2018-08-07T18:10:05.144479Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-g2ghf Pod phase: Running level=info timestamp=2018-08-07T18:10:00.845576Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-08-07T18:10:00.866572Z pos=vm.go:213 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-07T18:10:00.884437Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-07T18:10:00.981198Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-07T18:10:00.992603Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-07T18:10:01.004543Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-handler-n7bx6 Pod phase: Running level=info timestamp=2018-08-07T18:44:15.156787Z pos=vm.go:749 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-08-07T18:44:15.156999Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.157313Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.157417Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.157987Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.158805Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:15.161335Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: true\n" level=info timestamp=2018-08-07T18:44:15.161491Z pos=vm.go:322 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-07T18:44:15.161562Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:15.161747Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:15.162288Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind= uid=d6cc98c4-9a71-11e8-ae40-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-07T18:44:17.240289Z pos=vm.go:320 component=virt-handler msg="Processing vmi testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc, existing: false\n" level=info timestamp=2018-08-07T18:44:17.240446Z pos=vm.go:336 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-07T18:44:17.240664Z pos=vm.go:420 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-07T18:44:17.240909Z pos=vm.go:447 component=virt-handler namespace=kubevirt-test-alternative name=testvminltdn9h5xlnxhh7h7msfldd2wz7bbx6t65vm9f8j462s25qv4phsdc5b27427kc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi7frft45v8ntz9xbkjx9k4tlwwr6bmrcpnhnvjnd2ms Pod phase: Pending level=info timestamp=2018-08-07T19:42:47.704488Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:42:47.704665Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:42:47.707445Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:42:57.717008Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:42:57.766656Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi7frft45v8ntz9xbkjx9k4tlwwr6bmrcpnhnvjcbwklkrdcnzw4strz76jnh9npn" level=info timestamp=2018-08-07T19:42:57.768803Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:42:57.769336Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmibcjwghb7d6zhcgvvs5j29c979pxnz249p8x98jgszb Pod phase: Pending level=info timestamp=2018-08-07T19:42:47.487313Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:42:47.487458Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:42:47.489664Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:42:57.497679Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:42:57.557592Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmibcjwghb7d6zhcgvvs5j29c979pxnz249p8x98wsn9l9d4vrtwq8mgft2rw9cl25" level=info timestamp=2018-08-07T19:42:57.559301Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:42:57.559820Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmicxxvcwt2z4pqc2tbhr5q6btwqrjdnxglkzx46929fz Pod phase: Pending level=info timestamp=2018-08-07T19:42:47.004522Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:42:47.004699Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:42:47.006850Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:42:57.014942Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:42:57.117491Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmicxxvcwt2z4pqc2tbhr5q6btwqrjdnxglkzx46xcfdnfzzmsm7r8dxzrdjnshvbn" level=info timestamp=2018-08-07T19:42:57.119382Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:42:57.119905Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmirj8g4jt7qmkmcjh6nrxwffzpx6lbzm6mxblkrgjdtn Pod phase: Pending level=info timestamp=2018-08-07T19:42:46.851337Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-07T19:42:46.851728Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-07T19:42:46.854225Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-07T19:42:56.864795Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-07T19:42:56.919870Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmirj8g4jt7qmkmcjh6nrxwffzpx6lbzm6mxblkr7zcktzfpqqmxcjz4dxg79l958w" level=info timestamp=2018-08-07T19:42:56.922368Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-07T19:42:56.922871Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [181.941 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be reachable via the propagated IP from a Pod [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 on the same node from Node /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 ------------------------------ level=info timestamp=2018-08-07T19:42:43.226895Z pos=utils.go:246 component=tests namespace=kubevirt-test-default name=testvmirj8g4jt7qmkmcjh6nrxwffzpx6lbzm6mxblkr7zcktzfpqqmxcjz4dxg79l958w kind=VirtualMachineInstance uid=0cd1ab5f-9a7a-11e8-ae40-525500d15501 msg="Created virtual machine pod virt-launcher-testvmirj8g4jt7qmkmcjh6nrxwffzpx6lbzm6mxblkrgjdtn" panic: test timed out after 1h30m0s goroutine 15097 [running]: testing.(*M).startAlarm.func1() /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:1240 +0xfc created by time.goFunc /gimme/.gimme/versions/go1.10.linux.amd64/src/time/sleep.go:172 +0x44 goroutine 1 [chan receive, 90 minutes]: testing.(*T).Run(0xc4205c9e00, 0x139fc95, 0x9, 0x1432278, 0x4801e6) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:825 +0x301 testing.runTests.func1(0xc4205c9d10) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:1063 +0x64 testing.tRunner(0xc4205c9d10, 0xc4207bfdf8) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:777 +0xd0 testing.runTests(0xc42084f080, 0x1d34a50, 0x1, 0x1, 0x412009) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:1061 +0x2c4 testing.(*M).Run(0xc420731500, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:978 +0x171 main.main() _testmain.go:44 +0x151 goroutine 20 [chan receive]: kubevirt.io/kubevirt/vendor/github.com/golang/glog.(*loggingT).flushDaemon(0x1d60280) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/golang/glog/glog.go:879 +0x8b created by kubevirt.io/kubevirt/vendor/github.com/golang/glog.init.0 /root/go/src/kubevirt.io/kubevirt/vendor/github.com/golang/glog/glog.go:410 +0x203 goroutine 21 [syscall, 90 minutes]: os/signal.signal_recv(0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/sigqueue.go:139 +0xa6 os/signal.loop() /gimme/.gimme/versions/go1.10.linux.amd64/src/os/signal/signal_unix.go:22 +0x22 created by os/signal.init.0 /gimme/.gimme/versions/go1.10.linux.amd64/src/os/signal/signal_unix.go:28 +0x41 goroutine 8 [select]: kubevirt.io/kubevirt/tests.(*ObjectEventWatcher).Watch(0xc420dd3030, 0xc4203ef290) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:286 +0x579 kubevirt.io/kubevirt/tests.(*ObjectEventWatcher).WaitFor(0xc420dd3030, 0x139ba31, 0x6, 0x11e4920, 0x14b2710, 0x0) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:296 +0xba kubevirt.io/kubevirt/tests.waitForVMIStart(0x14bbd60, 0xc420a5ca00, 0x5a, 0x0, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1064 +0x50e kubevirt.io/kubevirt/tests.WaitForSuccessfulVMIStart(0x14bbd60, 0xc420a5ca00, 0xc420dd3120, 0xa5a99e) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1101 +0x43 kubevirt.io/kubevirt/tests.WaitUntilVMIReady(0xc420a5ca00, 0x1432250, 0x1d7e938) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1106 +0x3b kubevirt.io/kubevirt/tests_test.glob..func18.4() /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:135 +0x72b kubevirt.io/kubevirt/tests.BeforeAll.func1() /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1388 +0x3f kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).runSync(0xc420651b00, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113 +0x9c kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).run(0xc420651b00, 0xc4205d7cf0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:64 +0x13e kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*SetupNode).Run(0xc42000e4d8, 0x14b8200, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes/setup_nodes.go:15 +0x7f kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec.(*Spec).runSample(0xc420825b30, 0x0, 0x14b8200, 0xc4200fb4c0) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec/spec.go:181 +0x1f1 kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec.(*Spec).Run(0xc420825b30, 0x14b8200, 0xc4200fb4c0) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec/spec.go:138 +0xff kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).runSpec(0xc4208a4500, 0xc420825b30, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:200 +0x10d kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).runSpecs(0xc4208a4500, 0x1) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:170 +0x329 kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).Run(0xc4208a4500, 0xb) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:66 +0x11b kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/suite.(*Suite).Run(0xc4200f8af0, 0x7fb5e15199f8, 0xc4205c9e00, 0x13a2278, 0xb, 0xc42084f0c0, 0x2, 0x2, 0x14d4b00, 0xc4200fb4c0, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/suite/suite.go:62 +0x27c kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo.RunSpecsWithCustomReporters(0x14b9260, 0xc4205c9e00, 0x13a2278, 0xb, 0xc42084f0a0, 0x2, 0x2, 0x2) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/ginkgo_dsl.go:221 +0x258 kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo.RunSpecsWithDefaultAndCustomReporters(0x14b9260, 0xc4205c9e00, 0x13a2278, 0xb, 0xc4205184f0, 0x1, 0x1, 0x1) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/ginkgo_dsl.go:209 +0xab kubevirt.io/kubevirt/tests_test.TestTests(0xc4205c9e00) /root/go/src/kubevirt.io/kubevirt/tests/tests_suite_test.go:43 +0xaa testing.tRunner(0xc4205c9e00, 0x1432278) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:777 +0xd0 created by testing.(*T).Run /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:824 +0x2e0 goroutine 9 [chan receive, 90 minutes]: kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).registerForInterrupts(0xc4208a4500, 0xc4200deea0) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:223 +0xd1 created by kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).Run /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:60 +0x88 goroutine 10 [select, 90 minutes, locked to thread]: runtime.gopark(0x1434450, 0x0, 0x139c7b7, 0x6, 0x18, 0x1) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/proc.go:291 +0x11a runtime.selectgo(0xc42047c750, 0xc4200def60) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/select.go:392 +0xe50 runtime.ensureSigM.func1() /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/signal_unix.go:549 +0x1f4 runtime.goexit() /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/asm_amd64.s:2361 +0x1 goroutine 12 [IO wait]: internal/poll.runtime_pollWait(0x7fb5e15b6f00, 0x72, 0xc420f3b850) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/netpoll.go:173 +0x57 internal/poll.(*pollDesc).wait(0xc42090ed18, 0x72, 0xffffffffffffff00, 0x14ba420, 0x1c4b7d0) /gimme/.gimme/versions/go1.10.linux.amd64/src/internal/poll/fd_poll_runtime.go:85 +0x9b internal/poll.(*pollDesc).waitRead(0xc42090ed18, 0xc420cc0000, 0x8000, 0x8000) /gimme/.gimme/versions/go1.10.linux.amd64/src/internal/poll/fd_poll_runtime.go:90 +0x3d internal/poll.(*FD).Read(0xc42090ed00, 0xc420cc0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/internal/poll/fd_unix.go:157 +0x17d net.(*netFD).Read(0xc42090ed00, 0xc420cc0000, 0x8000, 0x8000, 0x0, 0x8, 0x7ffb) /gimme/.gimme/versions/go1.10.linux.amd64/src/net/fd_unix.go:202 +0x4f net.(*conn).Read(0xc42061a690, 0xc420cc0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/net/net.go:176 +0x6a crypto/tls.(*block).readFromUntil(0xc420911140, 0x7fb5dc2603f8, 0xc42061a690, 0x5, 0xc42061a690, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/crypto/tls/conn.go:493 +0x96 crypto/tls.(*Conn).readRecord(0xc420784000, 0x1434517, 0xc420784120, 0x20) /gimme/.gimme/versions/go1.10.linux.amd64/src/crypto/tls/conn.go:595 +0xe0 crypto/tls.(*Conn).Read(0xc420784000, 0xc42094c000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/crypto/tls/conn.go:1156 +0x100 bufio.(*Reader).Read(0xc42094e960, 0xc4207fe038, 0x9, 0x9, 0xc420724d28, 0x1, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/bufio/bufio.go:216 +0x238 io.ReadAtLeast(0x14b7000, 0xc42094e960, 0xc4207fe038, 0x9, 0x9, 0x9, 0xc4208c6ca0, 0x43f2c1, 0xc420db1200) /gimme/.gimme/versions/go1.10.linux.amd64/src/io/io.go:309 +0x86 io.ReadFull(0x14b7000, 0xc42094e960, 0xc4207fe038, 0x9, 0x9, 0x1434598, 0xc420f3bd10, 0x462d33) /gimme/.gimme/versions/go1.10.linux.amd64/src/io/io.go:327 +0x58 kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.readFrameHeader(0xc4207fe038, 0x9, 0x9, 0x14b7000, 0xc42094e960, 0x0, 0xc400000000, 0x7efc20, 0xc420ebade8) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/frame.go:237 +0x7b kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc4207fe000, 0xc420742030, 0x0, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/frame.go:492 +0xa4 kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*clientConnReadLoop).run(0xc420f3bfb0, 0x14331d0, 0xc420478fb0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/transport.go:1428 +0x8e kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*ClientConn).readLoop(0xc4202761a0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/transport.go:1354 +0x76 created by kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*Transport).newClientConn /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/transport.go:579 +0x651 goroutine 15441 [chan receive]: kubevirt.io/kubevirt/tests.(*ObjectEventWatcher).Watch.func3(0x14c1260, 0xc42039c300, 0xc4205f2540, 0xc420c517a0) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:277 +0x93 created by kubevirt.io/kubevirt/tests.(*ObjectEventWatcher).Watch /root/go/src/kubevirt.io/kubevirt/tests/utils.go:275 +0x4ae goroutine 15440 [semacquire]: sync.runtime_notifyListWait(0xc420ebae00, 0xc400000001) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/sema.go:510 +0x10b sync.(*Cond).Wait(0xc420ebadf0) /gimme/.gimme/versions/go1.10.linux.amd64/src/sync/cond.go:56 +0x80 kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*pipe).Read(0xc420ebade8, 0xc42036e001, 0x5ff, 0x5ff, 0x0, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/pipe.go:64 +0x8f kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.transportResponseBody.Read(0xc420ebadc0, 0xc42036e001, 0x5ff, 0x5ff, 0x0, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/transport.go:1674 +0xa1 encoding/json.(*Decoder).refill(0xc4201ee1e0, 0x835c0a, 0x9) /gimme/.gimme/versions/go1.10.linux.amd64/src/encoding/json/stream.go:159 +0x132 encoding/json.(*Decoder).readValue(0xc4201ee1e0, 0x0, 0x0, 0x11f6880) /gimme/.gimme/versions/go1.10.linux.amd64/src/encoding/json/stream.go:134 +0x23d encoding/json.(*Decoder).Decode(0xc4201ee1e0, 0x12127c0, 0xc4207981c0, 0x14bf020, 0xc42095c000) /gimme/.gimme/versions/go1.10.linux.amd64/src/encoding/json/stream.go:63 +0x78 kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc42039c2d0, 0xc42023aa80, 0x800, 0xa80, 0xc420754080, 0x40, 0x38) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:150 +0x295 kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc4203fe050, 0x0, 0x14c0ce0, 0xc420754080, 0x480, 0x14bf020, 0xc420c51798, 0x456ae0, 0xc420c51740) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0x95 kubevirt.io/kubevirt/vendor/k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc4202c5ea0, 0xc420f3dfa8, 0x5, 0x14bf020, 0xc42095c000, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0x7c kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc42039c300) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:93 +0x12e created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 make: *** [functest] Error 2 + make cluster-down ./cluster/down.sh