+ export WORKSPACE=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev + WORKSPACE=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev + [[ k8s-1.11.0-dev =~ openshift-.* ]] + [[ k8s-1.11.0-dev =~ .*-1.9.3-.* ]] + export KUBEVIRT_PROVIDER=k8s-1.10.3 + KUBEVIRT_PROVIDER=k8s-1.10.3 + export KUBEVIRT_NUM_NODES=2 + KUBEVIRT_NUM_NODES=2 + export NFS_WINDOWS_DIR=/home/nfs/images/windows2016 + NFS_WINDOWS_DIR=/home/nfs/images/windows2016 + export NAMESPACE=kube-system + NAMESPACE=kube-system + trap '{ make cluster-down; }' EXIT SIGINT SIGTERM SIGSTOP + make cluster-down ./cluster/down.sh + make cluster-up ./cluster/up.sh Downloading ....... Downloading ....... 2018/07/30 08:55:16 Waiting for host: 192.168.66.101:22 2018/07/30 08:55:19 Problem with dial: dial tcp 192.168.66.101:22: getsockopt: no route to host. Sleeping 5s 2018/07/30 08:55:27 Problem with dial: dial tcp 192.168.66.101:22: getsockopt: no route to host. Sleeping 5s 2018/07/30 08:55:32 Connected to tcp://192.168.66.101:22 + kubeadm init --config /etc/kubernetes/kubeadm.conf [init] Using Kubernetes version: v1.10.3 [init] Using Authorization modes: [Node RBAC] [preflight] Running pre-flight checks. [WARNING FileExisting-crictl]: crictl not found in system path Suggestion: go get github.com/kubernetes-incubator/cri-tools/cmd/crictl Flag --admission-control has been deprecated, Use --enable-admission-plugins or --disable-admission-plugins instead. Will be removed in a future version. [certificates] Generated ca certificate and key. [certificates] Generated apiserver certificate and key. [certificates] apiserver serving cert is signed for DNS names [node01 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 192.168.66.101] [certificates] Generated apiserver-kubelet-client certificate and key. [certificates] Generated etcd/ca certificate and key. [certificates] Generated etcd/server certificate and key. [certificates] etcd/server serving cert is signed for DNS names [localhost] and IPs [127.0.0.1] [certificates] Generated etcd/peer certificate and key. [certificates] etcd/peer serving cert is signed for DNS names [node01] and IPs [192.168.66.101] [certificates] Generated etcd/healthcheck-client certificate and key. [certificates] Generated apiserver-etcd-client certificate and key. [certificates] Generated sa key and public key. [certificates] Generated front-proxy-ca certificate and key. [certificates] Generated front-proxy-client certificate and key. [certificates] Valid certificates and keys now exist in "/etc/kubernetes/pki" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/admin.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/kubelet.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/controller-manager.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/scheduler.conf" [controlplane] Wrote Static Pod manifest for component kube-apiserver to "/etc/kubernetes/manifests/kube-apiserver.yaml" [controlplane] Wrote Static Pod manifest for component kube-controller-manager to "/etc/kubernetes/manifests/kube-controller-manager.yaml" [controlplane] Wrote Static Pod manifest for component kube-scheduler to "/etc/kubernetes/manifests/kube-scheduler.yaml" [etcd] Wrote Static Pod manifest for a local etcd instance to "/etc/kubernetes/manifests/etcd.yaml" [init] Waiting for the kubelet to boot up the control plane as Static Pods from directory "/etc/kubernetes/manifests". [init] This might take a minute or longer if the control plane images have to be pulled. [apiclient] All control plane components are healthy after 28.007732 seconds [uploadconfig] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace [markmaster] Will mark node node01 as master by adding a label and a taint [markmaster] Master node01 tainted and labelled with key/value: node-role.kubernetes.io/master="" [bootstraptoken] Using token: abcdef.1234567890123456 [bootstraptoken] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials [bootstraptoken] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token [bootstraptoken] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster [bootstraptoken] Creating the "cluster-info" ConfigMap in the "kube-public" namespace [addons] Applied essential addon: kube-dns [addons] Applied essential addon: kube-proxy Your Kubernetes master has initialized successfully! To start using your cluster, you need to run the following as a regular user: mkdir -p $HOME/.kube sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config sudo chown $(id -u):$(id -g) $HOME/.kube/config You should now deploy a pod network to the cluster. Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at: https://kubernetes.io/docs/concepts/cluster-administration/addons/ You can now join any number of machines by running the following on each node as root: kubeadm join 192.168.66.101:6443 --token abcdef.1234567890123456 --discovery-token-ca-cert-hash sha256:802f99c0c23ee13c8c91080dffe56571ff30bed557b1e714e7295891b90897cd + kubectl --kubeconfig=/etc/kubernetes/admin.conf apply -f https://raw.githubusercontent.com/coreos/flannel/v0.9.1/Documentation/kube-flannel.yml clusterrole.rbac.authorization.k8s.io "flannel" created clusterrolebinding.rbac.authorization.k8s.io "flannel" created serviceaccount "flannel" created configmap "kube-flannel-cfg" created daemonset.extensions "kube-flannel-ds" created + kubectl --kubeconfig=/etc/kubernetes/admin.conf taint nodes node01 node-role.kubernetes.io/master:NoSchedule- node "node01" untainted 2018/07/30 08:56:17 Waiting for host: 192.168.66.102:22 2018/07/30 08:56:20 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: no route to host. Sleeping 5s 2018/07/30 08:56:28 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: no route to host. Sleeping 5s 2018/07/30 08:56:33 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: connection refused. Sleeping 5s 2018/07/30 08:56:38 Connected to tcp://192.168.66.102:22 + kubeadm join --token abcdef.1234567890123456 192.168.66.101:6443 --ignore-preflight-errors=all --discovery-token-unsafe-skip-ca-verification=true [preflight] Running pre-flight checks. [discovery] Trying to connect to API Server "192.168.66.101:6443" [WARNING FileExisting-crictl]: crictl not found in system path Suggestion: go get github.com/kubernetes-incubator/cri-tools/cmd/crictl [discovery] Created cluster-info discovery client, requesting info from "https://192.168.66.101:6443" [discovery] Cluster info signature and contents are valid and no TLS pinning was specified, will use API Server "192.168.66.101:6443" [discovery] Successfully established connection with API Server "192.168.66.101:6443" This node has joined the cluster: * Certificate signing request was sent to master and a response was received. * The Kubelet was informed of the new secure connection details. Run 'kubectl get nodes' on the master to see this node join the cluster. Sending file modes: C0755 39588992 kubectl Sending file modes: C0600 5450 admin.conf Cluster "kubernetes" set. Cluster "kubernetes" set. + set +e + kubectl get nodes --no-headers + cluster/kubectl.sh get nodes --no-headers node01 Ready master 54s v1.10.3 node02 Ready 24s v1.10.3 + kubectl_rc=0 + '[' 0 -ne 0 ']' ++ kubectl get nodes --no-headers ++ cluster/kubectl.sh get nodes --no-headers ++ grep NotReady + '[' -n '' ']' + set -e + echo 'Nodes are ready:' Nodes are ready: + kubectl get nodes + cluster/kubectl.sh get nodes NAME STATUS ROLES AGE VERSION node01 Ready master 55s v1.10.3 node02 Ready 25s v1.10.3 + make cluster-sync ./cluster/build.sh Building ... sha256:dcf2b21fa2ed11dcf9dbba21b1cca0ee3fad521a0e9aee61c06d0b0b66a4b200 go version go1.10 linux/amd64 go version go1.10 linux/amd64 make[1]: Entering directory `/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt' hack/dockerized "./hack/check.sh && KUBEVIRT_VERSION= ./hack/build-go.sh install " && ./hack/build-copy-artifacts.sh sha256:dcf2b21fa2ed11dcf9dbba21b1cca0ee3fad521a0e9aee61c06d0b0b66a4b200 go version go1.10 linux/amd64 go version go1.10 linux/amd64 find: '/root/go/src/kubevirt.io/kubevirt/_out/cmd': No such file or directory Compiling tests... compiled tests.test hack/build-docker.sh build Sending build context to Docker daemon 40.39 MB Step 1/8 : FROM fedora:28 ---> cc510acfcd70 Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virt-controller ---> Using cache ---> b00c84523b53 Step 4/8 : WORKDIR /home/virt-controller ---> Using cache ---> b76b8bd8cd39 Step 5/8 : USER 1001 ---> Using cache ---> b6d9ad9ed232 Step 6/8 : COPY virt-controller /usr/bin/virt-controller ---> 2e13773a0cd7 Removing intermediate container 841d2bd2bd6b Step 7/8 : ENTRYPOINT /usr/bin/virt-controller ---> Running in 6d6df43fc57d ---> 9895842547f9 Removing intermediate container 6d6df43fc57d Step 8/8 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev0" '' "virt-controller" '' ---> Running in 81b13a6138c6 ---> b9e6a696b39d Removing intermediate container 81b13a6138c6 Successfully built b9e6a696b39d Sending build context to Docker daemon 43.31 MB Step 1/9 : FROM kubevirt/libvirt:4.2.0 ---> 5f0bfe81a3e0 Step 2/9 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 945996802736 Step 3/9 : RUN dnf -y install socat genisoimage util-linux libcgroup-tools ethtool net-tools sudo && dnf -y clean all && test $(id -u qemu) = 107 # make sure that the qemu user really is 107 ---> Using cache ---> 672f9ab56316 Step 4/9 : COPY virt-launcher /usr/bin/virt-launcher ---> aea1b3ffeae0 Removing intermediate container 42a1fa4b37ae Step 5/9 : RUN setcap CAP_NET_BIND_SERVICE=+eip /usr/bin/qemu-system-x86_64 ---> Running in afbeab405364  ---> c749bf4ef1d0 Removing intermediate container afbeab405364 Step 6/9 : RUN mkdir -p /usr/share/kubevirt/virt-launcher ---> Running in 3e8d0dd0bb78  ---> 7dc5a428196a Removing intermediate container 3e8d0dd0bb78 Step 7/9 : COPY sock-connector /usr/share/kubevirt/virt-launcher/ ---> 8a182b35b2e8 Removing intermediate container 7a257d677cd7 Step 8/9 : ENTRYPOINT /usr/bin/virt-launcher ---> Running in 6dc6bdac86ce ---> 9d20c7fbf846 Removing intermediate container 6dc6bdac86ce Step 9/9 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev0" '' "virt-launcher" '' ---> Running in 5a0d1a9a8cf7 ---> 6f458d4350a2 Removing intermediate container 5a0d1a9a8cf7 Successfully built 6f458d4350a2 Sending build context to Docker daemon 41.68 MB Step 1/5 : FROM fedora:28 ---> cc510acfcd70 Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/5 : COPY virt-handler /usr/bin/virt-handler ---> 8704f5221ac6 Removing intermediate container 108427e6cc43 Step 4/5 : ENTRYPOINT /usr/bin/virt-handler ---> Running in b51f8873b2cd ---> 71dcbce8b450 Removing intermediate container b51f8873b2cd Step 5/5 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev0" '' "virt-handler" '' ---> Running in ac75ef14321a ---> d1c95588f966 Removing intermediate container ac75ef14321a Successfully built d1c95588f966 Sending build context to Docker daemon 38.81 MB Step 1/8 : FROM fedora:28 ---> cc510acfcd70 Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virt-api ---> Using cache ---> ed1ebf600ee1 Step 4/8 : WORKDIR /home/virt-api ---> Using cache ---> 0769dad023e5 Step 5/8 : USER 1001 ---> Using cache ---> 0cb65afb0c2b Step 6/8 : COPY virt-api /usr/bin/virt-api ---> e1d4fe3c88f0 Removing intermediate container 37c6e5a5a58d Step 7/8 : ENTRYPOINT /usr/bin/virt-api ---> Running in 5cfaf0eb3f1c ---> 0154f4eabe6d Removing intermediate container 5cfaf0eb3f1c Step 8/8 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev0" '' "virt-api" '' ---> Running in 2f3ecc01a596 ---> 05cefa9af4f7 Removing intermediate container 2f3ecc01a596 Successfully built 05cefa9af4f7 Sending build context to Docker daemon 4.096 kB Step 1/7 : FROM fedora:28 ---> cc510acfcd70 Step 2/7 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/7 : ENV container docker ---> Using cache ---> 62847a2a1fa8 Step 4/7 : RUN mkdir -p /images/custom /images/alpine && truncate -s 64M /images/custom/disk.img && curl http://dl-cdn.alpinelinux.org/alpine/v3.7/releases/x86_64/alpine-virt-3.7.0-x86_64.iso > /images/alpine/disk.img ---> Using cache ---> 02134835a6aa Step 5/7 : ADD entrypoint.sh / ---> Using cache ---> ec0843818da7 Step 6/7 : CMD /entrypoint.sh ---> Using cache ---> 754029bb4bd2 Step 7/7 : LABEL "disks-images-provider" '' "kubevirt-functional-tests-k8s-1.11.0-dev0" '' ---> Using cache ---> ce29f424cc93 Successfully built ce29f424cc93 Sending build context to Docker daemon 2.56 kB Step 1/5 : FROM fedora:28 ---> cc510acfcd70 Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/5 : ENV container docker ---> Using cache ---> 62847a2a1fa8 Step 4/5 : RUN dnf -y install procps-ng nmap-ncat && dnf -y clean all ---> Using cache ---> 207487abe7b2 Step 5/5 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev0" '' "vm-killer" '' ---> Using cache ---> 08e9fdc44c13 Successfully built 08e9fdc44c13 Sending build context to Docker daemon 5.12 kB Step 1/7 : FROM debian:sid ---> 68f33cf86aab Step 2/7 : MAINTAINER "David Vossel" \ ---> Using cache ---> 5734d749eb5c Step 3/7 : ENV container docker ---> Using cache ---> f8775a77966f Step 4/7 : RUN apt-get update && apt-get install -y bash curl bzip2 qemu-utils && mkdir -p /disk && rm -rf /var/lib/apt/lists/* ---> Using cache ---> 1a40cf222a61 Step 5/7 : ADD entry-point.sh / ---> Using cache ---> 77b545d92fe7 Step 6/7 : CMD /entry-point.sh ---> Using cache ---> dfe20d463305 Step 7/7 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev0" '' "registry-disk-v1alpha" '' ---> Using cache ---> 8de7f4959dd4 Successfully built 8de7f4959dd4 Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33134/kubevirt/registry-disk-v1alpha:devel ---> 8de7f4959dd4 Step 2/4 : MAINTAINER "David Vossel" \ ---> Using cache ---> 49a3f493dc16 Step 3/4 : RUN curl https://download.cirros-cloud.net/0.4.0/cirros-0.4.0-x86_64-disk.img > /disk/cirros.img ---> Using cache ---> 8e5011e93ffa Step 4/4 : LABEL "cirros-registry-disk-demo" '' "kubevirt-functional-tests-k8s-1.11.0-dev0" '' ---> Using cache ---> a1b0ec251983 Successfully built a1b0ec251983 Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33134/kubevirt/registry-disk-v1alpha:devel ---> 8de7f4959dd4 Step 2/4 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> d22f57947ffb Step 3/4 : RUN curl -g -L https://download.fedoraproject.org/pub/fedora/linux/releases/27/CloudImages/x86_64/images/Fedora-Cloud-Base-27-1.6.x86_64.qcow2 > /disk/fedora.qcow2 ---> Using cache ---> 5c1be4f0e759 Step 4/4 : LABEL "fedora-cloud-registry-disk-demo" '' "kubevirt-functional-tests-k8s-1.11.0-dev0" '' ---> Using cache ---> 0d3284ce9dbb Successfully built 0d3284ce9dbb Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33134/kubevirt/registry-disk-v1alpha:devel ---> 8de7f4959dd4 Step 2/4 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> d22f57947ffb Step 3/4 : RUN curl http://dl-cdn.alpinelinux.org/alpine/v3.7/releases/x86_64/alpine-virt-3.7.0-x86_64.iso > /disk/alpine.iso ---> Using cache ---> b3fefa2de4bc Step 4/4 : LABEL "alpine-registry-disk-demo" '' "kubevirt-functional-tests-k8s-1.11.0-dev0" '' ---> Using cache ---> 0c1cb3296027 Successfully built 0c1cb3296027 Sending build context to Docker daemon 35.59 MB Step 1/8 : FROM fedora:28 ---> cc510acfcd70 Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virtctl ---> Using cache ---> 985fe391c056 Step 4/8 : WORKDIR /home/virtctl ---> Using cache ---> 3b2cae8ac543 Step 5/8 : USER 1001 ---> Using cache ---> 0c06e5b4a900 Step 6/8 : COPY subresource-access-test /subresource-access-test ---> d1d20086adc2 Removing intermediate container 87f4644e75a1 Step 7/8 : ENTRYPOINT /subresource-access-test ---> Running in 5e693cd02953 ---> a0087cb33204 Removing intermediate container 5e693cd02953 Step 8/8 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev0" '' "subresource-access-test" '' ---> Running in bb54256e9adc ---> 09ed228093ff Removing intermediate container bb54256e9adc Successfully built 09ed228093ff Sending build context to Docker daemon 3.072 kB Step 1/9 : FROM fedora:28 ---> cc510acfcd70 Step 2/9 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/9 : ENV container docker ---> Using cache ---> 62847a2a1fa8 Step 4/9 : RUN dnf -y install make git gcc && dnf -y clean all ---> Using cache ---> d3456b1644b1 Step 5/9 : ENV GIMME_GO_VERSION 1.9.2 ---> Using cache ---> 0ba81fddbba1 Step 6/9 : RUN mkdir -p /gimme && curl -sL https://raw.githubusercontent.com/travis-ci/gimme/master/gimme | HOME=/gimme bash >> /etc/profile.d/gimme.sh ---> Using cache ---> 5d33abe3f819 Step 7/9 : ENV GOPATH "/go" GOBIN "/usr/bin" ---> Using cache ---> 783826523be1 Step 8/9 : RUN mkdir -p /go && source /etc/profile.d/gimme.sh && go get github.com/masterzen/winrm-cli ---> Using cache ---> 711bc8d15952 Step 9/9 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev0" '' "winrmcli" '' ---> Using cache ---> 7693f5193568 Successfully built 7693f5193568 Sending build context to Docker daemon 36.8 MB Step 1/5 : FROM fedora:27 ---> 9110ae7f579f Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> e3238544ad97 Step 3/5 : COPY example-hook-sidecar /example-hook-sidecar ---> 00a29bdedf74 Removing intermediate container e9dbf50dd95a Step 4/5 : ENTRYPOINT /example-hook-sidecar ---> Running in 9af1f513145f ---> 0fe33257c4df Removing intermediate container 9af1f513145f Step 5/5 : LABEL "example-hook-sidecar" '' "kubevirt-functional-tests-k8s-1.11.0-dev0" '' ---> Running in 8baaa3e183a0 ---> de554bb5ff8e Removing intermediate container 8baaa3e183a0 Successfully built de554bb5ff8e hack/build-docker.sh push The push refers to a repository [localhost:33134/kubevirt/virt-controller] 1dd2243f20c7: Preparing aa89340cf7a8: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Waiting aa89340cf7a8: Pushed 1dd2243f20c7: Pushed 891e1e4ef82a: Pushed devel: digest: sha256:bbe064e8bd57227f2ccc26666bf593c87fb3f466dc324218b754475612181cef size: 949 The push refers to a repository [localhost:33134/kubevirt/virt-launcher] 83b34c9602df: Preparing 32cd7de8f811: Preparing 746d0ab94251: Preparing ff60b29a54a3: Preparing 633427c64a24: Preparing da38cf808aa5: Preparing b83399358a92: Preparing 186d8b3e4fd8: Preparing fa6154170bf5: Preparing 5eefb9960a36: Preparing 891e1e4ef82a: Preparing 186d8b3e4fd8: Waiting fa6154170bf5: Waiting da38cf808aa5: Waiting 5eefb9960a36: Waiting b83399358a92: Waiting 32cd7de8f811: Pushed 83b34c9602df: Pushed da38cf808aa5: Pushed b83399358a92: Pushed 186d8b3e4fd8: Pushed fa6154170bf5: Pushed 891e1e4ef82a: Mounted from kubevirt/virt-controller 746d0ab94251: Pushed 633427c64a24: Pushed ff60b29a54a3: Pushed 5eefb9960a36: Pushed devel: digest: sha256:ccfde6470ca8a72e6206233012df1bf8cd47451c15019f07d54452d0adaf4abd size: 2620 The push refers to a repository [localhost:33134/kubevirt/virt-handler] 6f9e1ce7ff46: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/virt-launcher 6f9e1ce7ff46: Pushed devel: digest: sha256:456fa7604dbc06a3f6858a1cf076019b0609807c73bd0398807d028ee351e68a size: 741 The push refers to a repository [localhost:33134/kubevirt/virt-api] 69a6eb49533e: Preparing 82fc744c99b4: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/virt-handler 82fc744c99b4: Pushed 69a6eb49533e: Pushed devel: digest: sha256:eb3836f895a29e7fd0d0dabc893090fc1f3f5a67ad918dfeb81b65e29161a407 size: 948 The push refers to a repository [localhost:33134/kubevirt/disks-images-provider] 71ad31feb2c5: Preparing 21d4b721776e: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Waiting 891e1e4ef82a: Mounted from kubevirt/virt-api 71ad31feb2c5: Pushed 21d4b721776e: Pushed devel: digest: sha256:93a2d8fbd58f732bcc0ddfa782eb0ec8b66841da3432d4d076031b0cf0374893 size: 948 The push refers to a repository [localhost:33134/kubevirt/vm-killer] c4cfadeeaf5f: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/disks-images-provider c4cfadeeaf5f: Pushed devel: digest: sha256:1c6e16fdf1220d75998f09c67409a225579ff3e3d90208aa38d8f824316c1437 size: 740 The push refers to a repository [localhost:33134/kubevirt/registry-disk-v1alpha] 661cce8d8e52: Preparing 41e0baba3077: Preparing 25edbec0eaea: Preparing 25edbec0eaea: Waiting 661cce8d8e52: Pushed 41e0baba3077: Pushed 25edbec0eaea: Pushed devel: digest: sha256:03a06bd0321a8a1693e5ef2e7fac4e99c8a868c8d67c89d00d29393fc49834cf size: 948 The push refers to a repository [localhost:33134/kubevirt/cirros-registry-disk-demo] ce69c857cc6c: Preparing 661cce8d8e52: Preparing 41e0baba3077: Preparing 25edbec0eaea: Preparing 661cce8d8e52: Mounted from kubevirt/registry-disk-v1alpha 25edbec0eaea: Mounted from kubevirt/registry-disk-v1alpha 41e0baba3077: Mounted from kubevirt/registry-disk-v1alpha ce69c857cc6c: Pushed devel: digest: sha256:eaac17e61b627a9d84311f369185deb054f9e728f308695d91d7bedc9e1dcb86 size: 1160 The push refers to a repository [localhost:33134/kubevirt/fedora-cloud-registry-disk-demo] ac5988afc68a: Preparing 661cce8d8e52: Preparing 41e0baba3077: Preparing 25edbec0eaea: Preparing 661cce8d8e52: Waiting 41e0baba3077: Waiting 25edbec0eaea: Waiting 661cce8d8e52: Mounted from kubevirt/cirros-registry-disk-demo 41e0baba3077: Mounted from kubevirt/cirros-registry-disk-demo 25edbec0eaea: Mounted from kubevirt/cirros-registry-disk-demo ac5988afc68a: Pushed devel: digest: sha256:bcd44fd2ce40c282482794eee80e6b10c3ff2a8be2b4c36c26d12a732df91434 size: 1161 The push refers to a repository [localhost:33134/kubevirt/alpine-registry-disk-demo] 2670ecb7d9d9: Preparing 661cce8d8e52: Preparing 41e0baba3077: Preparing 25edbec0eaea: Preparing 661cce8d8e52: Mounted from kubevirt/fedora-cloud-registry-disk-demo 25edbec0eaea: Mounted from kubevirt/fedora-cloud-registry-disk-demo 41e0baba3077: Mounted from kubevirt/fedora-cloud-registry-disk-demo 2670ecb7d9d9: Pushed devel: digest: sha256:82f5ee9b5fd9f1095618f692bae697f204012415acada61cadd3465f2075818d size: 1160 The push refers to a repository [localhost:33134/kubevirt/subresource-access-test] f3e74dc48cc6: Preparing 25cb73590a9d: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/vm-killer 25cb73590a9d: Pushed f3e74dc48cc6: Pushed devel: digest: sha256:771f55c8003563dc7ebe26f9403779e7f3e29a6a171f5f6608bc7e1186db1d48 size: 948 The push refers to a repository [localhost:33134/kubevirt/winrmcli] f8083e002d0b: Preparing 53c709abc882: Preparing 9ca98a0f492b: Preparing 891e1e4ef82a: Preparing 9ca98a0f492b: Waiting 891e1e4ef82a: Waiting f8083e002d0b: Pushed 891e1e4ef82a: Mounted from kubevirt/subresource-access-test 9ca98a0f492b: Pushed 53c709abc882: Pushed devel: digest: sha256:b90cb25cae51d5b205fd12ac5d635365f53da75eed215e41c0e50e01d75c9bf1 size: 1165 The push refers to a repository [localhost:33134/kubevirt/example-hook-sidecar] 28469772f256: Preparing 39bae602f753: Preparing 28469772f256: Pushed 39bae602f753: Pushed devel: digest: sha256:04ab6d3004cb363a68fae29a1898b822b22638526177ec708d382f0e8f3836b7 size: 740 make[1]: Leaving directory `/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt' Done ./cluster/clean.sh + source hack/common.sh ++++ dirname 'hack/common.sh[0]' +++ cd hack/../ +++ pwd ++ KUBEVIRT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt ++ OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out ++ VENDOR_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/vendor ++ CMD_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/cmd ++ TESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/tests ++ APIDOCS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/apidocs ++ MANIFESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/manifests ++ MANIFEST_TEMPLATES_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/templates/manifests ++ PYTHON_CLIENT_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/client-python ++ KUBEVIRT_PROVIDER=k8s-1.10.3 ++ KUBEVIRT_NUM_NODES=2 ++ '[' -z kubevirt-functional-tests-k8s-1.11.0-dev ']' ++ provider_prefix=kubevirt-functional-tests-k8s-1.11.0-dev0 ++ job_prefix=kubevirt-functional-tests-k8s-1.11.0-dev0 +++ kubevirt_version +++ '[' -n '' ']' +++ '[' -d /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/.git ']' ++++ git describe --always --tags +++ echo v0.7.0-151-gdc3f4c7 ++ KUBEVIRT_VERSION=v0.7.0-151-gdc3f4c7 + source cluster/k8s-1.10.3/provider.sh ++ set -e ++ image=k8s-1.10.3@sha256:d6290260e7e6b84419984f12719cf592ccbe327373b8df76aa0481f8ec01d357 ++ source cluster/ephemeral-provider-common.sh +++ set -e +++ _cli='docker run --privileged --net=host --rm -v /var/run/docker.sock:/var/run/docker.sock kubevirtci/gocli@sha256:aa7f295a7908fa333ab5e98ef3af0bfafbabfd3cee2b83f9af47f722e3000f6a' + source hack/config.sh ++ unset binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig manifest_docker_prefix namespace ++ KUBEVIRT_PROVIDER=k8s-1.10.3 ++ KUBEVIRT_PROVIDER=k8s-1.10.3 ++ source hack/config-default.sh source hack/config-k8s-1.10.3.sh +++ binaries='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virtctl cmd/fake-qemu-process cmd/virt-api cmd/subresource-access-test cmd/example-hook-sidecar' +++ docker_images='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virt-api images/disks-images-provider images/vm-killer cmd/registry-disk-v1alpha images/cirros-registry-disk-demo images/fedora-cloud-registry-disk-demo images/alpine-registry-disk-demo cmd/subresource-access-test images/winrmcli cmd/example-hook-sidecar' +++ docker_prefix=kubevirt +++ docker_tag=latest +++ master_ip=192.168.200.2 +++ network_provider=flannel +++ namespace=kube-system ++ test -f hack/config-provider-k8s-1.10.3.sh ++ source hack/config-provider-k8s-1.10.3.sh +++ master_ip=127.0.0.1 +++ docker_tag=devel +++ kubeconfig=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/cluster/k8s-1.10.3/.kubeconfig +++ kubectl=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/cluster/k8s-1.10.3/.kubectl +++ docker_prefix=localhost:33134/kubevirt +++ manifest_docker_prefix=registry:5000/kubevirt ++ test -f hack/config-local.sh ++ export binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig namespace + echo 'Cleaning up ...' Cleaning up ... + cluster/kubectl.sh get vmis --all-namespaces -o=custom-columns=NAME:.metadata.name,NAMESPACE:.metadata.namespace,FINALIZERS:.metadata.finalizers --no-headers + grep foregroundDeleteVirtualMachine + read p error: the server doesn't have a resource type "vmis" + _kubectl delete ds -l kubevirt.io -n kube-system --cascade=false --grace-period 0 No resources found + _kubectl delete pods -n kube-system -l=kubevirt.io=libvirt --force --grace-period 0 No resources found + _kubectl delete pods -n kube-system -l=kubevirt.io=virt-handler --force --grace-period 0 No resources found + namespaces=(default ${namespace}) + for i in '${namespaces[@]}' + _kubectl -n default delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete apiservices -l kubevirt.io No resources found + _kubectl -n default delete deployment -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete deployment -l kubevirt.io No resources found + _kubectl -n default delete rs -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete rs -l kubevirt.io No resources found + _kubectl -n default delete services -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete services -l kubevirt.io No resources found + _kubectl -n default delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete apiservices -l kubevirt.io No resources found + _kubectl -n default delete validatingwebhookconfiguration -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete validatingwebhookconfiguration -l kubevirt.io No resources found + _kubectl -n default delete secrets -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete secrets -l kubevirt.io No resources found + _kubectl -n default delete pv -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete pv -l kubevirt.io No resources found + _kubectl -n default delete pvc -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete pvc -l kubevirt.io No resources found + _kubectl -n default delete ds -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete ds -l kubevirt.io No resources found + _kubectl -n default delete customresourcedefinitions -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete customresourcedefinitions -l kubevirt.io No resources found + _kubectl -n default delete pods -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete pods -l kubevirt.io No resources found + _kubectl -n default delete clusterrolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete clusterrolebinding -l kubevirt.io No resources found + _kubectl -n default delete rolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete rolebinding -l kubevirt.io No resources found + _kubectl -n default delete roles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete roles -l kubevirt.io No resources found + _kubectl -n default delete clusterroles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete clusterroles -l kubevirt.io No resources found + _kubectl -n default delete serviceaccounts -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete serviceaccounts -l kubevirt.io No resources found ++ _kubectl -n default get crd offlinevirtualmachines.kubevirt.io ++ wc -l ++ export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig ++ KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig ++ cluster/k8s-1.10.3/.kubectl -n default get crd offlinevirtualmachines.kubevirt.io Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "offlinevirtualmachines.kubevirt.io" not found + '[' 0 -gt 0 ']' + for i in '${namespaces[@]}' + _kubectl -n kube-system delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete apiservices -l kubevirt.io No resources found + _kubectl -n kube-system delete deployment -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete deployment -l kubevirt.io No resources found + _kubectl -n kube-system delete rs -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete rs -l kubevirt.io No resources found + _kubectl -n kube-system delete services -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete services -l kubevirt.io No resources found + _kubectl -n kube-system delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete apiservices -l kubevirt.io No resources found + _kubectl -n kube-system delete validatingwebhookconfiguration -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete validatingwebhookconfiguration -l kubevirt.io No resources found + _kubectl -n kube-system delete secrets -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete secrets -l kubevirt.io No resources found + _kubectl -n kube-system delete pv -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete pv -l kubevirt.io No resources found + _kubectl -n kube-system delete pvc -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete pvc -l kubevirt.io No resources found + _kubectl -n kube-system delete ds -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete ds -l kubevirt.io No resources found + _kubectl -n kube-system delete customresourcedefinitions -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete customresourcedefinitions -l kubevirt.io No resources found + _kubectl -n kube-system delete pods -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete pods -l kubevirt.io No resources found + _kubectl -n kube-system delete clusterrolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete clusterrolebinding -l kubevirt.io No resources found + _kubectl -n kube-system delete rolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete rolebinding -l kubevirt.io No resources found + _kubectl -n kube-system delete roles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete roles -l kubevirt.io No resources found + _kubectl -n kube-system delete clusterroles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete clusterroles -l kubevirt.io No resources found + _kubectl -n kube-system delete serviceaccounts -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete serviceaccounts -l kubevirt.io No resources found ++ _kubectl -n kube-system get crd offlinevirtualmachines.kubevirt.io ++ wc -l ++ export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig ++ KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig ++ cluster/k8s-1.10.3/.kubectl -n kube-system get crd offlinevirtualmachines.kubevirt.io Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "offlinevirtualmachines.kubevirt.io" not found + '[' 0 -gt 0 ']' + sleep 2 + echo Done Done ./cluster/deploy.sh + source hack/common.sh ++++ dirname 'hack/common.sh[0]' +++ cd hack/../ +++ pwd ++ KUBEVIRT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt ++ OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out ++ VENDOR_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/vendor ++ CMD_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/cmd ++ TESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/tests ++ APIDOCS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/apidocs ++ MANIFESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/manifests ++ MANIFEST_TEMPLATES_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/templates/manifests ++ PYTHON_CLIENT_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/client-python ++ KUBEVIRT_PROVIDER=k8s-1.10.3 ++ KUBEVIRT_NUM_NODES=2 ++ '[' -z kubevirt-functional-tests-k8s-1.11.0-dev ']' ++ provider_prefix=kubevirt-functional-tests-k8s-1.11.0-dev0 ++ job_prefix=kubevirt-functional-tests-k8s-1.11.0-dev0 +++ kubevirt_version +++ '[' -n '' ']' +++ '[' -d /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/.git ']' ++++ git describe --always --tags +++ echo v0.7.0-151-gdc3f4c7 ++ KUBEVIRT_VERSION=v0.7.0-151-gdc3f4c7 + source cluster/k8s-1.10.3/provider.sh ++ set -e ++ image=k8s-1.10.3@sha256:d6290260e7e6b84419984f12719cf592ccbe327373b8df76aa0481f8ec01d357 ++ source cluster/ephemeral-provider-common.sh +++ set -e +++ _cli='docker run --privileged --net=host --rm -v /var/run/docker.sock:/var/run/docker.sock kubevirtci/gocli@sha256:aa7f295a7908fa333ab5e98ef3af0bfafbabfd3cee2b83f9af47f722e3000f6a' + source hack/config.sh ++ unset binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig manifest_docker_prefix namespace ++ KUBEVIRT_PROVIDER=k8s-1.10.3 ++ KUBEVIRT_PROVIDER=k8s-1.10.3 ++ source hack/config-default.sh source hack/config-k8s-1.10.3.sh +++ binaries='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virtctl cmd/fake-qemu-process cmd/virt-api cmd/subresource-access-test cmd/example-hook-sidecar' +++ docker_images='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virt-api images/disks-images-provider images/vm-killer cmd/registry-disk-v1alpha images/cirros-registry-disk-demo images/fedora-cloud-registry-disk-demo images/alpine-registry-disk-demo cmd/subresource-access-test images/winrmcli cmd/example-hook-sidecar' +++ docker_prefix=kubevirt +++ docker_tag=latest +++ master_ip=192.168.200.2 +++ network_provider=flannel +++ namespace=kube-system ++ test -f hack/config-provider-k8s-1.10.3.sh ++ source hack/config-provider-k8s-1.10.3.sh +++ master_ip=127.0.0.1 +++ docker_tag=devel +++ kubeconfig=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/cluster/k8s-1.10.3/.kubeconfig +++ kubectl=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/cluster/k8s-1.10.3/.kubectl +++ docker_prefix=localhost:33134/kubevirt +++ manifest_docker_prefix=registry:5000/kubevirt ++ test -f hack/config-local.sh ++ export binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig namespace + echo 'Deploying ...' Deploying ... + [[ -z k8s-1.11.0-dev ]] + [[ k8s-1.11.0-dev =~ .*-dev ]] + _kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/manifests/dev -R + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/manifests/dev -R serviceaccount "kubevirt-apiserver" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-apiserver" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-apiserver-auth-delegator" created rolebinding.rbac.authorization.k8s.io "kubevirt-apiserver" created role.rbac.authorization.k8s.io "kubevirt-apiserver" created clusterrole.rbac.authorization.k8s.io "kubevirt-apiserver" created clusterrole.rbac.authorization.k8s.io "kubevirt-controller" created serviceaccount "kubevirt-controller" created serviceaccount "kubevirt-privileged" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-controller" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-controller-cluster-admin" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-privileged-cluster-admin" created clusterrole.rbac.authorization.k8s.io "kubevirt.io:admin" created clusterrole.rbac.authorization.k8s.io "kubevirt.io:edit" created clusterrole.rbac.authorization.k8s.io "kubevirt.io:view" created clusterrole.rbac.authorization.k8s.io "kubevirt.io:default" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt.io:default" created customresourcedefinition.apiextensions.k8s.io "virtualmachineinstancereplicasets.kubevirt.io" created service "virt-api" created deployment.extensions "virt-api" created service "virt-controller" created deployment.extensions "virt-controller" created daemonset.extensions "virt-handler" created customresourcedefinition.apiextensions.k8s.io "virtualmachines.kubevirt.io" created customresourcedefinition.apiextensions.k8s.io "virtualmachineinstances.kubevirt.io" created customresourcedefinition.apiextensions.k8s.io "virtualmachineinstancepresets.kubevirt.io" created + _kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/manifests/testing -R + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/manifests/testing -R persistentvolumeclaim "disk-alpine" created persistentvolume "host-path-disk-alpine" created persistentvolumeclaim "disk-custom" created persistentvolume "host-path-disk-custom" created daemonset.extensions "disks-images-provider" created serviceaccount "kubevirt-testing" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-testing-cluster-admin" created + [[ k8s-1.10.3 =~ os-* ]] + echo Done Done + namespaces=(kube-system default) + [[ kube-system != \k\u\b\e\-\s\y\s\t\e\m ]] + timeout=300 + sample=30 + for i in '${namespaces[@]}' + current_time=0 ++ kubectl get pods -n kube-system --no-headers ++ grep -v Running ++ cluster/kubectl.sh get pods -n kube-system --no-headers + '[' -n 'virt-api-7586947775-tjq8k 0/1 ContainerCreating 0 5s virt-controller-7d57d96b65-d4wkj 0/1 ContainerCreating 0 5s virt-controller-7d57d96b65-nvqww 0/1 ContainerCreating 0 5s virt-handler-9pz9z 0/1 ContainerCreating 0 5s virt-handler-w4jj7 0/1 ContainerCreating 0 5s' ']' + echo 'Waiting for kubevirt pods to enter the Running state ...' Waiting for kubevirt pods to enter the Running state ... + kubectl get pods -n kube-system --no-headers + cluster/kubectl.sh get pods -n kube-system --no-headers + grep -v Running disks-images-provider-cmxpm 0/1 ContainerCreating 0 2s disks-images-provider-d7lwz 0/1 ContainerCreating 0 2s virt-api-7586947775-tjq8k 0/1 ContainerCreating 0 6s virt-controller-7d57d96b65-d4wkj 0/1 ContainerCreating 0 6s virt-controller-7d57d96b65-nvqww 0/1 ContainerCreating 0 6s virt-handler-9pz9z 0/1 ContainerCreating 0 6s virt-handler-w4jj7 0/1 ContainerCreating 0 6s + sleep 30 + current_time=30 + '[' 30 -gt 300 ']' ++ kubectl get pods -n kube-system --no-headers ++ grep -v Running ++ cluster/kubectl.sh get pods -n kube-system --no-headers + '[' -n '' ']' + current_time=0 ++ kubectl get pods -n kube-system '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers ++ grep false ++ cluster/kubectl.sh get pods -n kube-system '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers + '[' -n '' ']' + kubectl get pods -n kube-system + cluster/kubectl.sh get pods -n kube-system NAME READY STATUS RESTARTS AGE disks-images-provider-cmxpm 1/1 Running 0 43s disks-images-provider-d7lwz 1/1 Running 0 43s etcd-node01 1/1 Running 0 14m kube-apiserver-node01 1/1 Running 0 14m kube-controller-manager-node01 1/1 Running 0 13m kube-dns-86f4d74b45-2zn8h 3/3 Running 0 14m kube-flannel-ds-vf7kj 1/1 Running 0 14m kube-flannel-ds-x4zrt 1/1 Running 0 14m kube-proxy-jk5zc 1/1 Running 0 14m kube-proxy-mr92p 1/1 Running 0 14m kube-scheduler-node01 1/1 Running 0 14m virt-api-7586947775-tjq8k 1/1 Running 0 47s virt-controller-7d57d96b65-d4wkj 1/1 Running 0 47s virt-controller-7d57d96b65-nvqww 1/1 Running 0 47s virt-handler-9pz9z 1/1 Running 0 47s virt-handler-w4jj7 1/1 Running 0 47s + for i in '${namespaces[@]}' + current_time=0 ++ kubectl get pods -n default --no-headers ++ cluster/kubectl.sh get pods -n default --no-headers ++ grep -v Running No resources found. + '[' -n '' ']' + current_time=0 ++ kubectl get pods -n default '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers ++ grep false ++ cluster/kubectl.sh get pods -n default '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers + '[' -n '' ']' + kubectl get pods -n default + cluster/kubectl.sh get pods -n default No resources found. + kubectl version + cluster/kubectl.sh version Client Version: version.Info{Major:"1", Minor:"10", GitVersion:"v1.10.3", GitCommit:"2bba0127d85d5a46ab4b778548be28623b32d0b0", GitTreeState:"clean", BuildDate:"2018-05-21T09:17:39Z", GoVersion:"go1.9.3", Compiler:"gc", Platform:"linux/amd64"} Server Version: version.Info{Major:"1", Minor:"10", GitVersion:"v1.10.3", GitCommit:"2bba0127d85d5a46ab4b778548be28623b32d0b0", GitTreeState:"clean", BuildDate:"2018-05-21T09:05:37Z", GoVersion:"go1.9.3", Compiler:"gc", Platform:"linux/amd64"} + ginko_params='--ginkgo.noColor --junit-output=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/junit.xml' + [[ k8s-1.11.0-dev =~ windows.* ]] + FUNC_TEST_ARGS='--ginkgo.noColor --junit-output=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/junit.xml' + make functest hack/dockerized "hack/build-func-tests.sh" sha256:dcf2b21fa2ed11dcf9dbba21b1cca0ee3fad521a0e9aee61c06d0b0b66a4b200 go version go1.10 linux/amd64 go version go1.10 linux/amd64 Compiling tests... compiled tests.test hack/functests.sh Running Suite: Tests Suite ========================== Random Seed: 1532942087 Will run 149 of 149 specs Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:15:36 http: response.WriteHeader on hijacked connection level=error timestamp=2018-07-30T09:15:36.063292Z pos=subresource.go:97 component=virt-api reason="read tcp 10.244.1.3:8443->10.244.0.0:60798: use of closed network connection" msg="error ecountered reading from websocket stream" level=info timestamp=2018-07-30T09:15:36.063788Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvminmwrb/console proto=HTTP/1.1 statusCode=200 contentLength=0 level=info timestamp=2018-07-30T09:15:36.605681Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-30T09:15:37.365266Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/30 09:15:37 http: TLS handshake error from 10.244.1.1:48812: EOF level=info timestamp=2018-07-30T09:15:40.270268Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/30 09:15:47 http: TLS handshake error from 10.244.1.1:48818: EOF 2018/07/30 09:15:57 http: TLS handshake error from 10.244.1.1:48824: EOF level=info timestamp=2018-07-30T09:16:06.747029Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-30T09:16:07.482245Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/30 09:16:07 http: TLS handshake error from 10.244.1.1:48830: EOF level=info timestamp=2018-07-30T09:16:10.083496Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-30T09:16:10.102900Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-30T09:16:10.268026Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:10:42.383539Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-nvqww Pod phase: Running level=info timestamp=2018-07-30T09:10:38.752732Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer kubeVirtNodeInformer" level=info timestamp=2018-07-30T09:10:38.752799Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmiPresetInformer" level=info timestamp=2018-07-30T09:10:38.752821Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmirsInformer" level=info timestamp=2018-07-30T09:10:38.752847Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer configMapInformer" level=info timestamp=2018-07-30T09:10:38.752865Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmInformer" level=info timestamp=2018-07-30T09:10:38.752883Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer limitrangeInformer" level=info timestamp=2018-07-30T09:10:38.760020Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmiInformer" level=info timestamp=2018-07-30T09:10:38.760090Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer kubeVirtPodInformer" level=info timestamp=2018-07-30T09:10:38.760151Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-07-30T09:10:38.780373Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-07-30T09:10:38.780475Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-07-30T09:10:38.780514Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-07-30T09:10:38.780561Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-07-30T09:14:47.612177Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmwrb kind= uid=0155b083-93d9-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:14:47.624144Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmwrb kind= uid=0155b083-93d9-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T09:10:41.549217Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-07-30T09:10:41.555695Z pos=vm.go:210 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-07-30T09:10:41.556802Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-07-30T09:10:41.657998Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-07-30T09:10:41.701099Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-07-30T09:10:41.704414Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:10:46.654580Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-07-30T09:10:46.757329Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-07-30T09:10:46.782622Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-07-30T09:10:46.784283Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-07-30T09:15:06.543602Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvminmwrb kind= uid=0155b083-93d9-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:15:07.925478Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type ADDED" level=info timestamp=2018-07-30T09:15:07.925952Z pos=vm.go:657 component=virt-handler namespace=kubevirt-test-default name=testvminmwrb kind=Domain uid=0155b083-93d9-11e8-adf7-525500d15501 msg="Domain is in state Paused reason StartingUp" level=info timestamp=2018-07-30T09:15:08.411048Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:15:08.411383Z pos=vm.go:688 component=virt-handler namespace=kubevirt-test-default name=testvminmwrb kind=Domain uid=0155b083-93d9-11e8-adf7-525500d15501 msg="Domain is in state Running reason Unknown" level=info timestamp=2018-07-30T09:15:08.490977Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:15:08.493089Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvminmwrb kind= uid=0155b083-93d9-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:15:08.493380Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvminmwrb kind= uid=0155b083-93d9-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:15:08.543339Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvminmwrb kind= uid=0155b083-93d9-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:15:08.543591Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvminmwrb kind= uid=0155b083-93d9-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:15:08.554018Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvminmwrb kind= uid=0155b083-93d9-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." Pod name: virt-launcher-testvminmwrb-sr5rx Pod phase: Running 2018/07/30 05:16:12 read closing down: EOF • Failure [84.569 seconds] Health Monitoring /root/go/src/kubevirt.io/kubevirt/tests/vmi_monitoring_test.go:37 A VirtualMachineInstance with a watchdog device /root/go/src/kubevirt.io/kubevirt/tests/vmi_monitoring_test.go:56 should be shut down when the watchdog expires [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_monitoring_test.go:57 Timed out after 40.060s. Expected : Running to equal : Failed /root/go/src/kubevirt.io/kubevirt/tests/vmi_monitoring_test.go:85 ------------------------------ STEP: Starting a VirtualMachineInstance level=info timestamp=2018-07-30T09:14:48.730977Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvminmwrb kind=VirtualMachineInstance uid=0155b083-93d9-11e8-adf7-525500d15501 msg="Created virtual machine pod virt-launcher-testvminmwrb-sr5rx" level=info timestamp=2018-07-30T09:15:07.033839Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvminmwrb kind=VirtualMachineInstance uid=0155b083-93d9-11e8-adf7-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvminmwrb-sr5rx" level=info timestamp=2018-07-30T09:15:09.042365Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvminmwrb kind=VirtualMachineInstance uid=0155b083-93d9-11e8-adf7-525500d15501 msg="VirtualMachineInstance defined." level=info timestamp=2018-07-30T09:15:09.068588Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvminmwrb kind=VirtualMachineInstance uid=0155b083-93d9-11e8-adf7-525500d15501 msg="VirtualMachineInstance started." STEP: Expecting the VirtualMachineInstance console STEP: Killing the watchdog device STEP: Checking that the VirtualMachineInstance has Failed status 2018/07/30 05:16:46 read closing down: EOF • [SLOW TEST:34.229 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 with Alpine PVC /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:71 should be successfully started /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 with Disk PVC /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ 2018/07/30 05:17:21 read closing down: EOF • [SLOW TEST:34.394 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 with Alpine PVC /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:71 should be successfully started /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 with CDRom PVC /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:18:37 http: TLS handshake error from 10.244.1.1:48924: EOF level=info timestamp=2018-07-30T09:18:38.020853Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-30T09:18:40.486715Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/30 09:18:47 http: TLS handshake error from 10.244.1.1:48930: EOF 2018/07/30 09:18:57 http: TLS handshake error from 10.244.1.1:48936: EOF level=info timestamp=2018-07-30T09:19:07.705661Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/30 09:19:07 http: TLS handshake error from 10.244.1.1:48942: EOF level=info timestamp=2018-07-30T09:19:08.137215Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-30T09:19:10.473644Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/30 09:19:17 http: TLS handshake error from 10.244.1.1:48948: EOF level=info timestamp=2018-07-30T09:19:18.059478Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-30T09:19:18.063059Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/30 09:19:27 http: TLS handshake error from 10.244.1.1:48954: EOF level=info timestamp=2018-07-30T09:19:37.840458Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/30 09:19:37 http: TLS handshake error from 10.244.1.1:48960: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:10:42.383539Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-nvqww Pod phase: Running level=info timestamp=2018-07-30T09:10:38.780373Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-07-30T09:10:38.780475Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-07-30T09:10:38.780514Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-07-30T09:10:38.780561Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-07-30T09:14:47.612177Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmwrb kind= uid=0155b083-93d9-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:14:47.624144Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmwrb kind= uid=0155b083-93d9-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:16:12.252171Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixnbq8 kind= uid=33e0a74e-93d9-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:16:12.252529Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixnbq8 kind= uid=33e0a74e-93d9-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:16:12.350789Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixnbq8\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixnbq8" level=info timestamp=2018-07-30T09:16:46.466877Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizd7x7 kind= uid=4841494d-93d9-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:16:46.467651Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizd7x7 kind= uid=4841494d-93d9-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:16:46.592756Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizd7x7\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizd7x7" level=info timestamp=2018-07-30T09:16:46.647123Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizd7x7\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizd7x7" level=info timestamp=2018-07-30T09:17:20.895857Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicvnxr kind= uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:17:20.896866Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicvnxr kind= uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T09:10:41.549217Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-07-30T09:10:41.555695Z pos=vm.go:210 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-07-30T09:10:41.556802Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-07-30T09:10:41.657998Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-07-30T09:10:41.701099Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-07-30T09:10:41.704414Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:17:36.055542Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmicvnxr kind= uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:17:36.927961Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type ADDED" level=info timestamp=2018-07-30T09:17:36.928241Z pos=vm.go:657 component=virt-handler namespace=kubevirt-test-default name=testvmicvnxr kind=Domain uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="Domain is in state Paused reason StartingUp" level=info timestamp=2018-07-30T09:17:37.856918Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:17:37.859226Z pos=vm.go:688 component=virt-handler namespace=kubevirt-test-default name=testvmicvnxr kind=Domain uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="Domain is in state Running reason Unknown" level=info timestamp=2018-07-30T09:17:37.871442Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicvnxr kind= uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:17:37.871790Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmicvnxr kind= uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:17:37.919016Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:17:37.920682Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicvnxr kind= uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:17:37.924389Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmicvnxr kind= uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:17:37.941367Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicvnxr kind= uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:17:38.031853Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmicvnxr kind= uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:17:38.031973Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicvnxr kind= uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:17:38.032713Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmicvnxr kind= uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmicvnxr" level=info timestamp=2018-07-30T09:17:38.066730Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicvnxr kind= uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." • Failure [137.482 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 with Alpine PVC /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:71 should be successfully started and stopped multiple times /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 with Disk PVC [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 120.000s. Expected : false to be true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1065 ------------------------------ STEP: Starting and stopping the VirtualMachineInstance number of times STEP: Starting a VirtualMachineInstance STEP: Waiting until the VirtualMachineInstance will start level=info timestamp=2018-07-30T09:17:21.921191Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmicvnxr kind=VirtualMachineInstance uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="Created virtual machine pod virt-launcher-testvmicvnxr-nm4kp" level=info timestamp=2018-07-30T09:17:36.560154Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmicvnxr kind=VirtualMachineInstance uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmicvnxr-nm4kp" level=info timestamp=2018-07-30T09:17:38.404962Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmicvnxr kind=VirtualMachineInstance uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="VirtualMachineInstance defined." level=info timestamp=2018-07-30T09:17:38.443438Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmicvnxr kind=VirtualMachineInstance uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="VirtualMachineInstance started." Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:20:47 http: TLS handshake error from 10.244.1.1:49002: EOF 2018/07/30 09:20:57 http: TLS handshake error from 10.244.1.1:49008: EOF 2018/07/30 09:21:07 http: TLS handshake error from 10.244.1.1:49014: EOF level=info timestamp=2018-07-30T09:21:08.217923Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-30T09:21:08.605824Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-30T09:21:10.432407Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-30T09:21:17.658708Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-30T09:21:17.662771Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/30 09:21:17 http: TLS handshake error from 10.244.1.1:49020: EOF 2018/07/30 09:21:27 http: TLS handshake error from 10.244.1.1:49026: EOF 2018/07/30 09:21:37 http: TLS handshake error from 10.244.1.1:49032: EOF level=info timestamp=2018-07-30T09:21:38.562007Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-30T09:21:38.651391Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-30T09:21:40.296493Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/30 09:21:47 http: TLS handshake error from 10.244.1.1:49038: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:10:42.383539Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-nvqww Pod phase: Running level=info timestamp=2018-07-30T09:10:38.780561Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-07-30T09:14:47.612177Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmwrb kind= uid=0155b083-93d9-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:14:47.624144Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmwrb kind= uid=0155b083-93d9-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:16:12.252171Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixnbq8 kind= uid=33e0a74e-93d9-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:16:12.252529Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixnbq8 kind= uid=33e0a74e-93d9-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:16:12.350789Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixnbq8\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixnbq8" level=info timestamp=2018-07-30T09:16:46.466877Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizd7x7 kind= uid=4841494d-93d9-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:16:46.467651Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizd7x7 kind= uid=4841494d-93d9-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:16:46.592756Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizd7x7\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizd7x7" level=info timestamp=2018-07-30T09:16:46.647123Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizd7x7\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizd7x7" level=info timestamp=2018-07-30T09:17:20.895857Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicvnxr kind= uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:17:20.896866Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicvnxr kind= uid=5cca0014-93d9-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:19:38.253688Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitnct6 kind= uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:19:38.254694Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitnct6 kind= uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:19:38.365521Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitnct6\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitnct6" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T09:10:41.549217Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-07-30T09:10:41.555695Z pos=vm.go:210 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-07-30T09:10:41.556802Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-07-30T09:10:41.657998Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-07-30T09:10:41.701099Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-07-30T09:10:41.704414Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:19:54.979289Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmitnct6 kind= uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:19:55.908417Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type ADDED" level=info timestamp=2018-07-30T09:19:55.908641Z pos=vm.go:657 component=virt-handler namespace=kubevirt-test-default name=testvmitnct6 kind=Domain uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="Domain is in state Paused reason StartingUp" level=info timestamp=2018-07-30T09:19:56.457354Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:19:56.457936Z pos=vm.go:688 component=virt-handler namespace=kubevirt-test-default name=testvmitnct6 kind=Domain uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="Domain is in state Running reason Unknown" level=info timestamp=2018-07-30T09:19:56.517419Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:19:56.518234Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitnct6 kind= uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:19:56.518435Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmitnct6 kind= uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:19:56.580770Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitnct6 kind= uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:19:56.581191Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmitnct6 kind= uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:19:56.588639Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitnct6 kind= uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:19:56.690848Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmitnct6 kind= uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:19:56.690935Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmitnct6 kind= uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:19:56.691940Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmitnct6 kind= uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmitnct6" level=info timestamp=2018-07-30T09:19:56.804082Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitnct6 kind= uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." • Failure [138.662 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 with Alpine PVC /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:71 should be successfully started and stopped multiple times /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 with CDRom PVC [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 120.000s. Expected : false to be true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1065 ------------------------------ STEP: Starting and stopping the VirtualMachineInstance number of times STEP: Starting a VirtualMachineInstance STEP: Waiting until the VirtualMachineInstance will start level=info timestamp=2018-07-30T09:19:39.281149Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmitnct6 kind=VirtualMachineInstance uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="Created virtual machine pod virt-launcher-testvmitnct6-cd4bk" level=info timestamp=2018-07-30T09:19:55.444389Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmitnct6 kind=VirtualMachineInstance uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmitnct6-cd4bk" level=info timestamp=2018-07-30T09:19:57.092697Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmitnct6 kind=VirtualMachineInstance uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="VirtualMachineInstance defined." level=info timestamp=2018-07-30T09:19:57.111863Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmitnct6 kind=VirtualMachineInstance uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="VirtualMachineInstance started." • [SLOW TEST:47.351 seconds] Storage 2018/07/30 05:22:44 read closing down: EOF /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 With an emptyDisk defined /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:113 should create a writeable emptyDisk with the right capacity /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:115 ------------------------------ • [SLOW TEST:50.387 seconds] Storage 2018/07/30 05:23:35 read closing down: EOF /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 With an emptyDisk defined and a specified serial number /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:163 should create a writeable emptyDisk with the specified serial number /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:165 ------------------------------ 2018/07/30 05:24:10 read closing down: EOF • [SLOW TEST:34.863 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 With ephemeral alpine PVC /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:205 should be successfully started /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:207 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:25:57 http: TLS handshake error from 10.244.1.1:49196: EOF 2018/07/30 09:26:07 http: TLS handshake error from 10.244.1.1:49202: EOF level=info timestamp=2018-07-30T09:26:09.727479Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-30T09:26:09.846567Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-30T09:26:10.083353Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-30T09:26:10.104459Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-30T09:26:10.498879Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/30 09:26:17 http: TLS handshake error from 10.244.1.1:49208: EOF level=info timestamp=2018-07-30T09:26:18.020089Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-30T09:26:18.024462Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/30 09:26:27 http: TLS handshake error from 10.244.1.1:49214: EOF 2018/07/30 09:26:37 http: TLS handshake error from 10.244.1.1:49220: EOF level=info timestamp=2018-07-30T09:26:39.902805Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-30T09:26:39.994217Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-30T09:26:40.564245Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:10:42.383539Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-nvqww Pod phase: Running level=info timestamp=2018-07-30T09:19:38.253688Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitnct6 kind= uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:19:38.254694Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitnct6 kind= uid=aea837cb-93d9-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:19:38.365521Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitnct6\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitnct6" level=info timestamp=2018-07-30T09:21:56.938581Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmippg2z kind= uid=015155f6-93da-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:21:56.939313Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmippg2z kind= uid=015155f6-93da-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:21:57.082190Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmippg2z\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmippg2z" level=info timestamp=2018-07-30T09:21:57.098585Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmippg2z\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmippg2z" level=info timestamp=2018-07-30T09:22:44.345512Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:22:44.346751Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:22:44.551226Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid7mt8\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid7mt8" level=info timestamp=2018-07-30T09:23:35.118869Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitv4wr kind= uid=3bd4e083-93da-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:23:35.120860Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitv4wr kind= uid=3bd4e083-93da-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:23:35.292838Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitv4wr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitv4wr" level=info timestamp=2018-07-30T09:24:09.577290Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5vmhh kind= uid=50607846-93da-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:24:09.577606Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5vmhh kind= uid=50607846-93da-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T09:23:04.682098Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:23:04.683362Z pos=vm.go:688 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind=Domain uid=1d952378-93da-11e8-adf7-525500d15501 msg="Domain is in state Running reason Unknown" level=info timestamp=2018-07-30T09:23:04.727593Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:23:04.728209Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:23:04.750143Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:23:04.789555Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:23:04.789729Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:23:04.799547Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:23:34.433436Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:23:34.435600Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:23:34.443219Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmid7mt8" level=info timestamp=2018-07-30T09:23:34.696512Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:23:34.701507Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:23:34.701758Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:23:34.712401Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:24:27.288683Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5vmhh kind= uid=50607846-93da-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:24:27.288951Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmi5vmhh kind= uid=50607846-93da-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:24:27.305447Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:24:27.326823Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5vmhh kind= uid=50607846-93da-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:24:27.327088Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmi5vmhh kind= uid=50607846-93da-11e8-adf7-525500d15501 msg="No update processing required" level=error timestamp=2018-07-30T09:24:27.351027Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmi5vmhh kind= uid=50607846-93da-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi5vmhh\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:24:27.351285Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi5vmhh\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi5vmhh" level=info timestamp=2018-07-30T09:24:27.351521Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi5vmhh kind= uid=50607846-93da-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:24:27.361189Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5vmhh kind= uid=50607846-93da-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:24:27.361438Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi5vmhh kind= uid=50607846-93da-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:24:27.373714Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5vmhh kind= uid=50607846-93da-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:24:44.690049Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi5vmhh kind= uid=50607846-93da-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:24:44.690453Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi5vmhh kind= uid=50607846-93da-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:24:44.692380Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi5vmhh kind= uid=50607846-93da-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi5vmhh" level=info timestamp=2018-07-30T09:24:44.813205Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5vmhh kind= uid=50607846-93da-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." 2018/07/30 05:26:45 read closing down: EOF • Failure [155.415 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 With ephemeral alpine PVC /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:205 should not persist data [It] /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:218 Timed out after 120.000s. Expected : false to be true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1065 ------------------------------ STEP: Starting the VirtualMachineInstance STEP: Starting a VirtualMachineInstance STEP: Waiting until the VirtualMachineInstance will start level=info timestamp=2018-07-30T09:24:10.619212Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmi5vmhh kind=VirtualMachineInstance uid=50607846-93da-11e8-adf7-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi5vmhh-d9qdz" level=info timestamp=2018-07-30T09:24:26.482048Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmi5vmhh kind=VirtualMachineInstance uid=50607846-93da-11e8-adf7-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmi5vmhh-d9qdz" level=info timestamp=2018-07-30T09:24:27.808222Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmi5vmhh kind=VirtualMachineInstance uid=50607846-93da-11e8-adf7-525500d15501 msg="VirtualMachineInstance defined." level=info timestamp=2018-07-30T09:24:27.827770Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmi5vmhh kind=VirtualMachineInstance uid=50607846-93da-11e8-adf7-525500d15501 msg="VirtualMachineInstance started." STEP: Writing an arbitrary file to it's EFI partition STEP: Killing a VirtualMachineInstance Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running level=info timestamp=2018-07-30T09:27:40.525828Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/30 09:27:47 http: TLS handshake error from 10.244.1.1:49262: EOF 2018/07/30 09:27:57 http: TLS handshake error from 10.244.1.1:49268: EOF 2018/07/30 09:28:07 http: TLS handshake error from 10.244.1.1:49274: EOF level=info timestamp=2018-07-30T09:28:10.319758Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-30T09:28:10.380296Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-30T09:28:10.526243Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/30 09:28:17 http: TLS handshake error from 10.244.1.1:49280: EOF 2018/07/30 09:28:27 http: TLS handshake error from 10.244.1.1:49286: EOF 2018/07/30 09:28:37 http: TLS handshake error from 10.244.1.1:49292: EOF level=info timestamp=2018-07-30T09:28:40.418588Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-30T09:28:40.563940Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-30T09:28:40.660002Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/30 09:28:47 http: TLS handshake error from 10.244.1.1:49298: EOF 2018/07/30 09:28:57 http: TLS handshake error from 10.244.1.1:49304: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:10:42.383539Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-nvqww Pod phase: Running level=info timestamp=2018-07-30T09:19:38.365521Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitnct6\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitnct6" level=info timestamp=2018-07-30T09:21:56.938581Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmippg2z kind= uid=015155f6-93da-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:21:56.939313Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmippg2z kind= uid=015155f6-93da-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:21:57.082190Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmippg2z\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmippg2z" level=info timestamp=2018-07-30T09:21:57.098585Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmippg2z\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmippg2z" level=info timestamp=2018-07-30T09:22:44.345512Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:22:44.346751Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:22:44.551226Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid7mt8\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid7mt8" level=info timestamp=2018-07-30T09:23:35.118869Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitv4wr kind= uid=3bd4e083-93da-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:23:35.120860Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitv4wr kind= uid=3bd4e083-93da-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:23:35.292838Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitv4wr\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitv4wr" level=info timestamp=2018-07-30T09:24:09.577290Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5vmhh kind= uid=50607846-93da-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:24:09.577606Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5vmhh kind= uid=50607846-93da-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:26:45.123633Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmipqjwz kind= uid=ad113960-93da-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:26:45.125264Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmipqjwz kind= uid=ad113960-93da-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T09:23:04.682098Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:23:04.683362Z pos=vm.go:688 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind=Domain uid=1d952378-93da-11e8-adf7-525500d15501 msg="Domain is in state Running reason Unknown" level=info timestamp=2018-07-30T09:23:04.727593Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:23:04.728209Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:23:04.750143Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:23:04.789555Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:23:04.789729Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:23:04.799547Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:23:34.433436Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:23:34.435600Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:23:34.443219Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmid7mt8" level=info timestamp=2018-07-30T09:23:34.696512Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind= uid=1d952378-93da-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:23:34.701507Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:23:34.701758Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:23:34.712401Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmid7mt8 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:27:01.713465Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmipqjwz kind= uid=ad113960-93da-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:27:02.731400Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type ADDED" level=info timestamp=2018-07-30T09:27:02.731976Z pos=vm.go:657 component=virt-handler namespace=kubevirt-test-default name=testvmipqjwz kind=Domain uid=ad113960-93da-11e8-adf7-525500d15501 msg="Domain is in state Paused reason StartingUp" level=info timestamp=2018-07-30T09:27:02.950319Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:27:02.950505Z pos=vm.go:688 component=virt-handler namespace=kubevirt-test-default name=testvmipqjwz kind=Domain uid=ad113960-93da-11e8-adf7-525500d15501 msg="Domain is in state Running reason Unknown" level=info timestamp=2018-07-30T09:27:02.968636Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:27:02.970980Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmipqjwz kind= uid=ad113960-93da-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:27:02.971079Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmipqjwz kind= uid=ad113960-93da-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:27:03.018751Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmipqjwz kind= uid=ad113960-93da-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:27:03.020593Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmipqjwz kind= uid=ad113960-93da-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:27:03.033621Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmipqjwz kind= uid=ad113960-93da-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:27:03.108418Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmipqjwz kind= uid=ad113960-93da-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:27:03.108716Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmipqjwz kind= uid=ad113960-93da-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:27:03.110243Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmipqjwz kind= uid=ad113960-93da-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmipqjwz" level=info timestamp=2018-07-30T09:27:03.172405Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmipqjwz kind= uid=ad113960-93da-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." • Failure [138.427 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 With VirtualMachineInstance with two PVCs /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:266 should start vmi multiple times [It] /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:278 Timed out after 120.000s. Expected : false to be true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1065 ------------------------------ STEP: Starting and stopping the VirtualMachineInstance number of times STEP: Starting a VirtualMachineInstance STEP: Waiting until the VirtualMachineInstance will start level=info timestamp=2018-07-30T09:26:46.123321Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmipqjwz kind=VirtualMachineInstance uid=ad113960-93da-11e8-adf7-525500d15501 msg="Created virtual machine pod virt-launcher-testvmipqjwz-8fv9r" level=info timestamp=2018-07-30T09:27:02.169722Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmipqjwz kind=VirtualMachineInstance uid=ad113960-93da-11e8-adf7-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmipqjwz-8fv9r" level=info timestamp=2018-07-30T09:27:03.498006Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmipqjwz kind=VirtualMachineInstance uid=ad113960-93da-11e8-adf7-525500d15501 msg="VirtualMachineInstance defined." level=info timestamp=2018-07-30T09:27:03.528596Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmipqjwz kind=VirtualMachineInstance uid=ad113960-93da-11e8-adf7-525500d15501 msg="VirtualMachineInstance started." • ------------------------------ • [SLOW TEST:5.431 seconds] Subresource Api /root/go/src/kubevirt.io/kubevirt/tests/subresource_api_test.go:37 Rbac Authorization /root/go/src/kubevirt.io/kubevirt/tests/subresource_api_test.go:48 Without permissions /root/go/src/kubevirt.io/kubevirt/tests/subresource_api_test.go:56 should not be able to access subresource endpoint /root/go/src/kubevirt.io/kubevirt/tests/subresource_api_test.go:57 ------------------------------ •• ------------------------------ • [SLOW TEST:18.335 seconds] HookSidecars /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:40 VMI definition /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:58 with SM BIOS hook sidecar /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:59 should successfully start with hook sidecar annotation /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:60 ------------------------------ • [SLOW TEST:19.881 seconds] HookSidecars /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:40 VMI definition /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:58 with SM BIOS hook sidecar /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:59 should call Collect and OnDefineDomain on the hook sidecar /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:67 ------------------------------ • [SLOW TEST:22.434 seconds] HookSidecars /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:40 VMI definition /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:58 with SM BIOS hook sidecar /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:59 should update domain XML with SM BIOS properties /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:83 ------------------------------ • [SLOW TEST:15.068 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given a vmi /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:14.645 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given an vm /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:14.502 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given a vmi preset /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:14.954 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given a vmi replica set /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ 2018/07/30 05:32:06 read closing down: EOF Service cluster-ip-vmi successfully exposed for virtualmachineinstance testvmiptz52 • [SLOW TEST:48.351 seconds] Expose /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:53 Expose service on a VM /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:61 Expose ClusterIP service /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:68 Should expose a Cluster IP service on a VMI and connect to it /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:71 ------------------------------ Service cluster-ip-target-vmi successfully exposed for virtualmachineinstance testvmiptz52 •Service node-port-vmi successfully exposed for virtualmachineinstance testvmiptz52 ------------------------------ • [SLOW TEST:9.409 seconds] Expose /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:53 Expose service on a VM /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:61 Expose NodePort service /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:124 Should expose a NodePort service on a VMI and connect to it /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:129 ------------------------------ 2018/07/30 05:33:04 read closing down: EOF Service cluster-ip-udp-vmi successfully exposed for virtualmachineinstance testvmid8hsl • [SLOW TEST:47.377 seconds] Expose /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:53 Expose UDP service on a VMI /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:166 Expose ClusterIP UDP service /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:173 Should expose a ClusterIP service on a VMI and connect to it /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:177 ------------------------------ Service node-port-udp-vmi successfully exposed for virtualmachineinstance testvmid8hsl • [SLOW TEST:9.955 seconds] Expose /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:53 Expose UDP service on a VMI /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:166 Expose NodePort UDP service /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:205 Should expose a NodePort service on a VMI and connect to it /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:210 ------------------------------ 2018/07/30 05:34:04 read closing down: EOF 2018/07/30 05:34:15 read closing down: EOF Service cluster-ip-vmirs successfully exposed for vmirs replicasetlfb7z • [SLOW TEST:61.644 seconds] Expose /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:53 Expose service on a VMI replica set /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:253 Expose ClusterIP service /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:286 Should create a ClusterIP service on VMRS and connect to it /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:290 ------------------------------ Service cluster-ip-vm successfully exposed for virtualmachine testvmivz954 VM testvmivz954 was scheduled to start 2018/07/30 05:35:10 read closing down: EOF • [SLOW TEST:55.989 seconds] Expose /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:53 Expose service on an VM /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:318 Expose ClusterIP service /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:362 Connect to ClusterIP services that was set when VM was offline /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:363 ------------------------------ •volumedisk0 compute 2018/07/30 05:35:57 read closing down: EOF ------------------------------ • [SLOW TEST:39.483 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 VirtualMachineInstance definition /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:55 with 3 CPU cores /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:56 should report 3 cpu cores under guest OS /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:62 ------------------------------ • ------------------------------ • [SLOW TEST:18.444 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 VirtualMachineInstance definition /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:55 with hugepages /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:164 should consume hugepages /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 hugepages-2Mi /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ S [SKIPPING] [0.261 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 VirtualMachineInstance definition /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:55 with hugepages /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:164 should consume hugepages /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 hugepages-1Gi [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 No node with hugepages hugepages-1Gi capacity /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:216 ------------------------------ •2018/07/30 05:38:04 read closing down: EOF ------------------------------ • [SLOW TEST:104.686 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 with CPU spec /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:294 when CPU model defined /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:340 should report defined CPU model /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:341 ------------------------------ • [SLOW TEST:111.136 seconds] 2018/07/30 05:39:55 read closing down: EOF Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 with CPU spec /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:294 when CPU model equals to passthrough /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:368 should report exactly the same model as node CPU /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:369 ------------------------------ 2018/07/30 05:41:44 read closing down: EOF • [SLOW TEST:109.372 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 with CPU spec /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:294 when CPU model not defined /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:392 should report CPU model from libvirt capabilities /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:393 ------------------------------ • [SLOW TEST:46.558 seconds] Configurations 2018/07/30 05:42:31 read closing down: EOF /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 New VirtualMachineInstance with all supported drives /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:413 should have all the device nodes /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:436 ------------------------------ • ------------------------------ • [SLOW TEST:18.902 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 should start it /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:76 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running level=error timestamp=2018-07-30T09:42:30.711001Z pos=subresource.go:106 component=virt-api reason="websocket: close 1006 (abnormal closure): unexpected EOF" msg="Error in websocket proxy" 2018/07/30 09:42:30 http: response.WriteHeader on hijacked connection level=info timestamp=2018-07-30T09:42:30.711354Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmibjmgk/console proto=HTTP/1.1 statusCode=500 contentLength=0 level=error timestamp=2018-07-30T09:42:30.904336Z pos=subresource.go:85 component=virt-api msg="connection failed: command terminated with exit code 137" 2018/07/30 09:42:37 http: TLS handshake error from 10.244.1.1:49828: EOF level=info timestamp=2018-07-30T09:42:40.376718Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/30 09:42:47 http: TLS handshake error from 10.244.1.1:49834: EOF level=info timestamp=2018-07-30T09:42:49.401825Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-30T09:42:49.411462Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/30 09:42:57 http: TLS handshake error from 10.244.1.1:49840: EOF 2018/07/30 09:43:07 http: TLS handshake error from 10.244.1.1:49846: EOF level=info timestamp=2018-07-30T09:43:10.489802Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/30 09:43:17 http: TLS handshake error from 10.244.1.1:49852: EOF level=info timestamp=2018-07-30T09:43:19.655104Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-30T09:43:19.681501Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:10:42.383539Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-nvqww Pod phase: Running level=info timestamp=2018-07-30T09:40:36.859532Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmisghss kind= uid=9ccd532f-93dc-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:40:38.508882Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmisghss\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmisghss" level=info timestamp=2018-07-30T09:40:40.182886Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmisghss\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmisghss" level=info timestamp=2018-07-30T09:41:45.344509Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibjmgk kind= uid=c5933021-93dc-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:41:45.425242Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibjmgk kind= uid=c5933021-93dc-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:41:46.115526Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibjmgk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibjmgk" level=info timestamp=2018-07-30T09:42:30.574617Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis8t24 kind= uid=e09f47d9-93dc-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:42:30.592444Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis8t24 kind= uid=e09f47d9-93dc-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:42:30.992217Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirp5ms kind= uid=e0e1bf85-93dc-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:42:30.992491Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirp5ms kind= uid=e0e1bf85-93dc-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:42:31.188714Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirp5ms\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirp5ms" level=info timestamp=2018-07-30T09:42:31.209679Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirp5ms\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirp5ms" level=info timestamp=2018-07-30T09:42:49.934525Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2chx4 kind= uid=ec2b23ef-93dc-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:42:49.935490Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2chx4 kind= uid=ec2b23ef-93dc-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:42:50.123602Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi2chx4\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi2chx4" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T09:42:49.150866Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:42:49.151169Z pos=vm.go:688 component=virt-handler namespace=kubevirt-test-default name=testvmirp5ms kind=Domain uid=e0e1bf85-93dc-11e8-adf7-525500d15501 msg="Domain is in state Running reason Unknown" level=info timestamp=2018-07-30T09:42:49.358496Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmirp5ms kind= uid=e0e1bf85-93dc-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:42:49.358638Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmirp5ms kind= uid=e0e1bf85-93dc-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:42:49.356865Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:42:49.433633Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmirp5ms kind= uid=e0e1bf85-93dc-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:42:49.434378Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmirp5ms kind= uid=e0e1bf85-93dc-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:42:49.444219Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmirp5ms kind= uid=e0e1bf85-93dc-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:42:49.643057Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmirp5ms kind= uid=e0e1bf85-93dc-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:42:49.643293Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmirp5ms kind= uid=e0e1bf85-93dc-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:42:49.646442Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmirp5ms kind= uid=e0e1bf85-93dc-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmirp5ms" level=info timestamp=2018-07-30T09:42:49.691810Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmirp5ms kind= uid=e0e1bf85-93dc-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:42:49.744889Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmirp5ms kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:42:49.745100Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmirp5ms kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:42:49.748111Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmirp5ms kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:42:30.837530Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmibjmgk kind= uid=c5933021-93dc-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:42:30.837891Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmibjmgk kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:42:30.838038Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmibjmgk kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:42:30.838932Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmibjmgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:43:08.101646Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi2chx4 kind= uid=ec2b23ef-93dc-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:43:09.077643Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type ADDED" level=info timestamp=2018-07-30T09:43:09.077874Z pos=vm.go:657 component=virt-handler namespace=kubevirt-test-default name=testvmi2chx4 kind=Domain uid=ec2b23ef-93dc-11e8-adf7-525500d15501 msg="Domain is in state Paused reason StartingUp" level=info timestamp=2018-07-30T09:43:09.929907Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:43:09.930346Z pos=vm.go:688 component=virt-handler namespace=kubevirt-test-default name=testvmi2chx4 kind=Domain uid=ec2b23ef-93dc-11e8-adf7-525500d15501 msg="Domain is in state Running reason Unknown" level=info timestamp=2018-07-30T09:43:09.955799Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi2chx4 kind= uid=ec2b23ef-93dc-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:43:09.956063Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmi2chx4 kind= uid=ec2b23ef-93dc-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:43:10.007836Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:43:10.009837Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi2chx4 kind= uid=ec2b23ef-93dc-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:43:10.010095Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi2chx4 kind= uid=ec2b23ef-93dc-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:43:10.026899Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi2chx4 kind= uid=ec2b23ef-93dc-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi2chx4-kpjsl Pod phase: Running • Failure [31.514 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 should attach virt-launcher to it [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:82 Timed out after 11.000s. Expected : to contain substring : Found PID for /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:92 ------------------------------ level=info timestamp=2018-07-30T09:42:50.950078Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmi2chx4 kind=VirtualMachineInstance uid=ec2b23ef-93dc-11e8-adf7-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi2chx4-kpjsl" level=info timestamp=2018-07-30T09:43:08.565195Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmi2chx4 kind=VirtualMachineInstance uid=ec2b23ef-93dc-11e8-adf7-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmi2chx4-kpjsl" level=info timestamp=2018-07-30T09:43:10.451464Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmi2chx4 kind=VirtualMachineInstance uid=ec2b23ef-93dc-11e8-adf7-525500d15501 msg="VirtualMachineInstance defined." level=info timestamp=2018-07-30T09:43:10.479534Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmi2chx4 kind=VirtualMachineInstance uid=ec2b23ef-93dc-11e8-adf7-525500d15501 msg="VirtualMachineInstance started." STEP: Getting virt-launcher logs ••••2018/07/30 05:44:01 read closing down: EOF ------------------------------ • [SLOW TEST:37.896 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 with boot order /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:170 should be able to boot from selected disk /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 Alpine as first boot /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ 2018/07/30 05:44:31 read closing down: EOF • [SLOW TEST:29.890 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 with boot order /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:170 should be able to boot from selected disk /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 Cirros as first boot /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:16.179 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 with user-data /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:201 without k8s secret /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:202 should retry starting the VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:203 ------------------------------ • [SLOW TEST:18.954 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 with user-data /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:201 without k8s secret /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:202 should log warning and proceed once the secret is there /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:233 ------------------------------ • [SLOW TEST:51.284 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 when virt-launcher crashes /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:281 should be stopped and have Failed phase /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:282 ------------------------------ • [SLOW TEST:71.330 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 when virt-handler crashes /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:305 should recover and continue management /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:306 ------------------------------ • [SLOW TEST:93.332 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 when virt-handler is responsive /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:336 should indicate that a node is ready for vmis /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:337 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:47:09 http: TLS handshake error from 10.244.1.1:48014: EOF 2018/07/30 09:47:19 http: TLS handshake error from 10.244.1.1:48018: EOF 2018/07/30 09:47:29 http: TLS handshake error from 10.244.1.1:48024: EOF 2018/07/30 09:47:39 http: TLS handshake error from 10.244.1.1:48030: EOF 2018/07/30 09:47:49 http: TLS handshake error from 10.244.1.1:48036: EOF 2018/07/30 09:47:59 http: TLS handshake error from 10.244.1.1:48042: EOF 2018/07/30 09:48:09 http: TLS handshake error from 10.244.1.1:48048: EOF 2018/07/30 09:48:19 http: TLS handshake error from 10.244.1.1:48054: EOF 2018/07/30 09:48:29 http: TLS handshake error from 10.244.1.1:48060: EOF 2018/07/30 09:48:39 http: TLS handshake error from 10.244.1.1:48066: EOF 2018/07/30 09:48:49 http: TLS handshake error from 10.244.1.1:48072: EOF 2018/07/30 09:48:59 http: TLS handshake error from 10.244.1.1:48078: EOF 2018/07/30 09:49:09 http: TLS handshake error from 10.244.1.1:48084: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:46:59.933939Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-nvqww Pod phase: Running level=info timestamp=2018-07-30T09:44:30.835829Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9zvhm kind= uid=284c2ab2-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:44:30.836806Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9zvhm kind= uid=284c2ab2-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:44:31.199835Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9zvhm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9zvhm" level=info timestamp=2018-07-30T09:44:31.337255Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9zvhm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9zvhm" level=info timestamp=2018-07-30T09:44:46.750104Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifw58j kind= uid=31cc72ac-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:44:46.751459Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifw58j kind= uid=31cc72ac-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:45:05.865815Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:45:05.866277Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:45:06.191866Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:56.982344Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmilpzgk, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3d2f4431-93dd-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:57.237208Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:45:57.237416Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" E0730 09:46:50.487400 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again level=info timestamp=2018-07-30T09:49:11.681060Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis2z7p kind= uid=bdce452a-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:49:11.686509Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis2z7p kind= uid=bdce452a-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:46:59.838073Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-07-30T09:46:59.845383Z pos=vm.go:210 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-07-30T09:46:59.846082Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-07-30T09:46:59.947850Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-07-30T09:46:59.985775Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-07-30T09:47:00.003950Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-07-30T09:47:00.148203Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.325563Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:00.325900Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.326092Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.046605Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.046998Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.106660Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.106929Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmis2z7p-zjbvn Pod phase: Pending • Failure in Spec Setup (BeforeEach) [30.777 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 when virt-handler is not responsive /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:367 the node controller should react [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:406 Expected error: <*errors.StatusError | 0xc42016b710>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:379 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:47:19 http: TLS handshake error from 10.244.1.1:48018: EOF 2018/07/30 09:47:29 http: TLS handshake error from 10.244.1.1:48024: EOF 2018/07/30 09:47:39 http: TLS handshake error from 10.244.1.1:48030: EOF 2018/07/30 09:47:49 http: TLS handshake error from 10.244.1.1:48036: EOF 2018/07/30 09:47:59 http: TLS handshake error from 10.244.1.1:48042: EOF 2018/07/30 09:48:09 http: TLS handshake error from 10.244.1.1:48048: EOF 2018/07/30 09:48:19 http: TLS handshake error from 10.244.1.1:48054: EOF 2018/07/30 09:48:29 http: TLS handshake error from 10.244.1.1:48060: EOF 2018/07/30 09:48:39 http: TLS handshake error from 10.244.1.1:48066: EOF 2018/07/30 09:48:49 http: TLS handshake error from 10.244.1.1:48072: EOF 2018/07/30 09:48:59 http: TLS handshake error from 10.244.1.1:48078: EOF 2018/07/30 09:49:09 http: TLS handshake error from 10.244.1.1:48084: EOF 2018/07/30 09:49:19 http: TLS handshake error from 10.244.1.1:48090: EOF 2018/07/30 09:49:29 http: TLS handshake error from 10.244.1.1:48096: EOF 2018/07/30 09:49:39 http: TLS handshake error from 10.244.1.1:48102: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:46:59.933939Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-nvqww Pod phase: Running level=info timestamp=2018-07-30T09:44:46.750104Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifw58j kind= uid=31cc72ac-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:44:46.751459Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifw58j kind= uid=31cc72ac-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:45:05.865815Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:45:05.866277Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:45:06.191866Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:56.982344Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmilpzgk, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3d2f4431-93dd-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:57.237208Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:45:57.237416Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" E0730 09:46:50.487400 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again level=info timestamp=2018-07-30T09:49:11.681060Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis2z7p kind= uid=bdce452a-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:49:11.686509Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis2z7p kind= uid=bdce452a-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:49:12.266613Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmis2z7p\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmis2z7p, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bdce452a-93dd-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmis2z7p" level=info timestamp=2018-07-30T09:49:42.505889Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim67lq kind= uid=d02c6774-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:49:42.506879Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim67lq kind= uid=d02c6774-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:49:42.800890Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmim67lq\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmim67lq" Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:46:59.838073Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-07-30T09:46:59.845383Z pos=vm.go:210 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-07-30T09:46:59.846082Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-07-30T09:46:59.947850Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-07-30T09:46:59.985775Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-07-30T09:47:00.003950Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-07-30T09:47:00.148203Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.325563Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:00.325900Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.326092Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.046605Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.046998Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.106660Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.106929Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmim67lq-bnzxq Pod phase: Pending • Failure [31.172 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 with node tainted /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:459 the vmi with tolerations should be scheduled [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:481 Expected error: <*errors.StatusError | 0xc420976bd0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:498 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:47:49 http: TLS handshake error from 10.244.1.1:48036: EOF 2018/07/30 09:47:59 http: TLS handshake error from 10.244.1.1:48042: EOF 2018/07/30 09:48:09 http: TLS handshake error from 10.244.1.1:48048: EOF 2018/07/30 09:48:19 http: TLS handshake error from 10.244.1.1:48054: EOF 2018/07/30 09:48:29 http: TLS handshake error from 10.244.1.1:48060: EOF 2018/07/30 09:48:39 http: TLS handshake error from 10.244.1.1:48066: EOF 2018/07/30 09:48:49 http: TLS handshake error from 10.244.1.1:48072: EOF 2018/07/30 09:48:59 http: TLS handshake error from 10.244.1.1:48078: EOF 2018/07/30 09:49:09 http: TLS handshake error from 10.244.1.1:48084: EOF 2018/07/30 09:49:19 http: TLS handshake error from 10.244.1.1:48090: EOF 2018/07/30 09:49:29 http: TLS handshake error from 10.244.1.1:48096: EOF 2018/07/30 09:49:39 http: TLS handshake error from 10.244.1.1:48102: EOF 2018/07/30 09:49:49 http: TLS handshake error from 10.244.1.1:48108: EOF 2018/07/30 09:49:59 http: TLS handshake error from 10.244.1.1:48114: EOF 2018/07/30 09:50:09 http: TLS handshake error from 10.244.1.1:48120: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:46:59.933939Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-nvqww Pod phase: Running level=info timestamp=2018-07-30T09:45:05.866277Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:45:06.191866Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:56.982344Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmilpzgk, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3d2f4431-93dd-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:57.237208Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:45:57.237416Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" E0730 09:46:50.487400 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again level=info timestamp=2018-07-30T09:49:11.681060Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis2z7p kind= uid=bdce452a-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:49:11.686509Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis2z7p kind= uid=bdce452a-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:49:12.266613Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmis2z7p\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmis2z7p, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bdce452a-93dd-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmis2z7p" level=info timestamp=2018-07-30T09:49:42.505889Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim67lq kind= uid=d02c6774-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:49:42.506879Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim67lq kind= uid=d02c6774-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:49:42.800890Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmim67lq\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmim67lq" level=info timestamp=2018-07-30T09:49:43.573520Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmim67lq\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmim67lq, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d02c6774-93dd-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmim67lq" level=info timestamp=2018-07-30T09:50:13.836200Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv57hf kind= uid=e2d68949-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:50:13.842275Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv57hf kind= uid=e2d68949-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:46:59.838073Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-07-30T09:46:59.845383Z pos=vm.go:210 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-07-30T09:46:59.846082Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-07-30T09:46:59.947850Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-07-30T09:46:59.985775Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-07-30T09:47:00.003950Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-07-30T09:47:00.148203Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.325563Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:00.325900Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.326092Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.046605Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.046998Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.106660Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.106929Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmiv57hf-ghrrr Pod phase: Pending • Failure [30.915 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 with node tainted /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:459 the vmi without tolerations should not be scheduled [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:502 Expected error: <*errors.StatusError | 0xc42016a630>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:518 ------------------------------ S [SKIPPING] [0.270 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 with non default namespace /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:531 should log libvirt start and stop lifecycle events of the domain /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 kubevirt-test-default [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Skip log query tests for JENKINS ci test environment /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:536 ------------------------------ S [SKIPPING] [0.149 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 with non default namespace /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:531 should log libvirt start and stop lifecycle events of the domain /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 kubevirt-test-alternative [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Skip log query tests for JENKINS ci test environment /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:536 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.175 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 VirtualMachineInstance Emulation Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:592 should enable emulation in virt-launcher [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:604 Software emulation is not enabled on this cluster /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:600 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.195 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 VirtualMachineInstance Emulation Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:592 should be reflected in domain XML [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:641 Software emulation is not enabled on this cluster /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:600 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.177 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 VirtualMachineInstance Emulation Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:592 should request a TUN device but not KVM [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:685 Software emulation is not enabled on this cluster /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:600 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:48:19 http: TLS handshake error from 10.244.1.1:48054: EOF 2018/07/30 09:48:29 http: TLS handshake error from 10.244.1.1:48060: EOF 2018/07/30 09:48:39 http: TLS handshake error from 10.244.1.1:48066: EOF 2018/07/30 09:48:49 http: TLS handshake error from 10.244.1.1:48072: EOF 2018/07/30 09:48:59 http: TLS handshake error from 10.244.1.1:48078: EOF 2018/07/30 09:49:09 http: TLS handshake error from 10.244.1.1:48084: EOF 2018/07/30 09:49:19 http: TLS handshake error from 10.244.1.1:48090: EOF 2018/07/30 09:49:29 http: TLS handshake error from 10.244.1.1:48096: EOF 2018/07/30 09:49:39 http: TLS handshake error from 10.244.1.1:48102: EOF 2018/07/30 09:49:49 http: TLS handshake error from 10.244.1.1:48108: EOF 2018/07/30 09:49:59 http: TLS handshake error from 10.244.1.1:48114: EOF 2018/07/30 09:50:09 http: TLS handshake error from 10.244.1.1:48120: EOF 2018/07/30 09:50:19 http: TLS handshake error from 10.244.1.1:48126: EOF 2018/07/30 09:50:29 http: TLS handshake error from 10.244.1.1:48132: EOF 2018/07/30 09:50:39 http: TLS handshake error from 10.244.1.1:48138: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:46:59.933939Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-nvqww Pod phase: Running level=info timestamp=2018-07-30T09:45:56.982344Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmilpzgk, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3d2f4431-93dd-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:57.237208Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:45:57.237416Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" E0730 09:46:50.487400 1 leaderelection.go:258] Failed to update lock: Operation cannot be fulfilled on endpoints "virt-controller": the object has been modified; please apply your changes to the latest version and try again level=info timestamp=2018-07-30T09:49:11.681060Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis2z7p kind= uid=bdce452a-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:49:11.686509Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis2z7p kind= uid=bdce452a-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:49:12.266613Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmis2z7p\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmis2z7p, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bdce452a-93dd-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmis2z7p" level=info timestamp=2018-07-30T09:49:42.505889Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim67lq kind= uid=d02c6774-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:49:42.506879Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim67lq kind= uid=d02c6774-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:49:42.800890Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmim67lq\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmim67lq" level=info timestamp=2018-07-30T09:49:43.573520Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmim67lq\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmim67lq, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d02c6774-93dd-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmim67lq" level=info timestamp=2018-07-30T09:50:13.836200Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv57hf kind= uid=e2d68949-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:50:13.842275Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv57hf kind= uid=e2d68949-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:50:45.387323Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimll6d kind= uid=f5a8e0d8-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:50:45.389276Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimll6d kind= uid=f5a8e0d8-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:46:59.838073Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-07-30T09:46:59.845383Z pos=vm.go:210 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-07-30T09:46:59.846082Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-07-30T09:46:59.947850Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-07-30T09:46:59.985775Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-07-30T09:47:00.003950Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-07-30T09:47:00.148203Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.325563Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:00.325900Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.326092Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.046605Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.046998Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.106660Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.106929Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmimll6d-6dbqp Pod phase: Pending • Failure [30.674 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 VM Accelerated Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:721 should request a KVM and TUN device [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:733 Expected <*errors.StatusError | 0xc420821320>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } to be nil /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:735 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:48:49 http: TLS handshake error from 10.244.1.1:48072: EOF 2018/07/30 09:48:59 http: TLS handshake error from 10.244.1.1:48078: EOF 2018/07/30 09:49:09 http: TLS handshake error from 10.244.1.1:48084: EOF 2018/07/30 09:49:19 http: TLS handshake error from 10.244.1.1:48090: EOF 2018/07/30 09:49:29 http: TLS handshake error from 10.244.1.1:48096: EOF 2018/07/30 09:49:39 http: TLS handshake error from 10.244.1.1:48102: EOF 2018/07/30 09:49:49 http: TLS handshake error from 10.244.1.1:48108: EOF 2018/07/30 09:49:59 http: TLS handshake error from 10.244.1.1:48114: EOF 2018/07/30 09:50:09 http: TLS handshake error from 10.244.1.1:48120: EOF 2018/07/30 09:50:19 http: TLS handshake error from 10.244.1.1:48126: EOF 2018/07/30 09:50:29 http: TLS handshake error from 10.244.1.1:48132: EOF 2018/07/30 09:50:39 http: TLS handshake error from 10.244.1.1:48138: EOF 2018/07/30 09:50:49 http: TLS handshake error from 10.244.1.1:48144: EOF 2018/07/30 09:50:59 http: TLS handshake error from 10.244.1.1:48150: EOF 2018/07/30 09:51:09 http: TLS handshake error from 10.244.1.1:48156: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:46:59.933939Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-nvqww Pod phase: Running level=info timestamp=2018-07-30T09:49:11.681060Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis2z7p kind= uid=bdce452a-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:49:11.686509Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmis2z7p kind= uid=bdce452a-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:49:12.266613Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmis2z7p\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmis2z7p, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bdce452a-93dd-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmis2z7p" level=info timestamp=2018-07-30T09:49:42.505889Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim67lq kind= uid=d02c6774-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:49:42.506879Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim67lq kind= uid=d02c6774-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:49:42.800890Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmim67lq\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmim67lq" level=info timestamp=2018-07-30T09:49:43.573520Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmim67lq\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmim67lq, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d02c6774-93dd-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmim67lq" level=info timestamp=2018-07-30T09:50:13.836200Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv57hf kind= uid=e2d68949-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:50:13.842275Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv57hf kind= uid=e2d68949-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:50:45.387323Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimll6d kind= uid=f5a8e0d8-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:50:45.389276Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimll6d kind= uid=f5a8e0d8-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:50:45.975813Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimll6d\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmimll6d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f5a8e0d8-93dd-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimll6d" level=info timestamp=2018-07-30T09:51:16.201115Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibsczh kind= uid=08056ed8-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:51:16.201812Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibsczh kind= uid=08056ed8-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:51:16.536626Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibsczh\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibsczh" Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:46:59.838073Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-07-30T09:46:59.845383Z pos=vm.go:210 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-07-30T09:46:59.846082Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-07-30T09:46:59.947850Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-07-30T09:46:59.985775Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-07-30T09:47:00.003950Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-07-30T09:47:00.148203Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.325563Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:00.325900Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.326092Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.046605Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.046998Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.106660Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.106929Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmibsczh-hg9wp Pod phase: Pending • Failure [30.803 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 VM Accelerated Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:721 should not enable emulation in virt-launcher [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:768 Expected <*errors.StatusError | 0xc420aa2480>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } to be nil /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:770 ------------------------------ •• Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:49:19 http: TLS handshake error from 10.244.1.1:48090: EOF 2018/07/30 09:49:29 http: TLS handshake error from 10.244.1.1:48096: EOF 2018/07/30 09:49:39 http: TLS handshake error from 10.244.1.1:48102: EOF 2018/07/30 09:49:49 http: TLS handshake error from 10.244.1.1:48108: EOF 2018/07/30 09:49:59 http: TLS handshake error from 10.244.1.1:48114: EOF 2018/07/30 09:50:09 http: TLS handshake error from 10.244.1.1:48120: EOF 2018/07/30 09:50:19 http: TLS handshake error from 10.244.1.1:48126: EOF 2018/07/30 09:50:29 http: TLS handshake error from 10.244.1.1:48132: EOF 2018/07/30 09:50:39 http: TLS handshake error from 10.244.1.1:48138: EOF 2018/07/30 09:50:49 http: TLS handshake error from 10.244.1.1:48144: EOF 2018/07/30 09:50:59 http: TLS handshake error from 10.244.1.1:48150: EOF 2018/07/30 09:51:09 http: TLS handshake error from 10.244.1.1:48156: EOF 2018/07/30 09:51:19 http: TLS handshake error from 10.244.1.1:48162: EOF 2018/07/30 09:51:29 http: TLS handshake error from 10.244.1.1:48168: EOF 2018/07/30 09:51:39 http: TLS handshake error from 10.244.1.1:48174: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:46:59.933939Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-nvqww Pod phase: Running level=info timestamp=2018-07-30T09:49:42.505889Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim67lq kind= uid=d02c6774-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:49:42.506879Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim67lq kind= uid=d02c6774-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:49:42.800890Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmim67lq\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmim67lq" level=info timestamp=2018-07-30T09:49:43.573520Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmim67lq\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmim67lq, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d02c6774-93dd-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmim67lq" level=info timestamp=2018-07-30T09:50:13.836200Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv57hf kind= uid=e2d68949-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:50:13.842275Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv57hf kind= uid=e2d68949-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:50:45.387323Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimll6d kind= uid=f5a8e0d8-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:50:45.389276Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimll6d kind= uid=f5a8e0d8-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:50:45.975813Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimll6d\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmimll6d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f5a8e0d8-93dd-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimll6d" level=info timestamp=2018-07-30T09:51:16.201115Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibsczh kind= uid=08056ed8-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:51:16.201812Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibsczh kind= uid=08056ed8-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:51:16.536626Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibsczh\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibsczh" level=info timestamp=2018-07-30T09:51:17.006111Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibsczh\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibsczh, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 08056ed8-93de-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibsczh" level=info timestamp=2018-07-30T09:51:47.742547Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilgpjq kind= uid=1ad1ff74-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:51:47.744280Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilgpjq kind= uid=1ad1ff74-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:46:59.838073Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-07-30T09:46:59.845383Z pos=vm.go:210 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-07-30T09:46:59.846082Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-07-30T09:46:59.947850Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-07-30T09:46:59.985775Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-07-30T09:47:00.003950Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-07-30T09:47:00.148203Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.325563Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:00.325900Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.326092Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.046605Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.046998Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.106660Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.106929Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmilgpjq-724hz Pod phase: Pending ------------------------------ • Failure [30.725 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Delete a VirtualMachineInstance's Pod /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:837 should result in the VirtualMachineInstance moving to a finalized state [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:838 Expected error: <*errors.StatusError | 0xc420821290>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:841 ------------------------------ STEP: Creating the VirtualMachineInstance Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:49:49 http: TLS handshake error from 10.244.1.1:48108: EOF 2018/07/30 09:49:59 http: TLS handshake error from 10.244.1.1:48114: EOF 2018/07/30 09:50:09 http: TLS handshake error from 10.244.1.1:48120: EOF 2018/07/30 09:50:19 http: TLS handshake error from 10.244.1.1:48126: EOF 2018/07/30 09:50:29 http: TLS handshake error from 10.244.1.1:48132: EOF 2018/07/30 09:50:39 http: TLS handshake error from 10.244.1.1:48138: EOF 2018/07/30 09:50:49 http: TLS handshake error from 10.244.1.1:48144: EOF 2018/07/30 09:50:59 http: TLS handshake error from 10.244.1.1:48150: EOF 2018/07/30 09:51:09 http: TLS handshake error from 10.244.1.1:48156: EOF 2018/07/30 09:51:19 http: TLS handshake error from 10.244.1.1:48162: EOF 2018/07/30 09:51:29 http: TLS handshake error from 10.244.1.1:48168: EOF 2018/07/30 09:51:39 http: TLS handshake error from 10.244.1.1:48174: EOF 2018/07/30 09:51:49 http: TLS handshake error from 10.244.1.1:48180: EOF 2018/07/30 09:51:59 http: TLS handshake error from 10.244.1.1:48186: EOF 2018/07/30 09:52:09 http: TLS handshake error from 10.244.1.1:48192: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:46:59.933939Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-nvqww Pod phase: Running level=info timestamp=2018-07-30T09:50:13.836200Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv57hf kind= uid=e2d68949-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:50:13.842275Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiv57hf kind= uid=e2d68949-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:50:45.387323Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimll6d kind= uid=f5a8e0d8-93dd-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:50:45.389276Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimll6d kind= uid=f5a8e0d8-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:50:45.975813Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimll6d\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmimll6d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f5a8e0d8-93dd-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimll6d" level=info timestamp=2018-07-30T09:51:16.201115Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibsczh kind= uid=08056ed8-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:51:16.201812Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibsczh kind= uid=08056ed8-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:51:16.536626Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibsczh\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibsczh" level=info timestamp=2018-07-30T09:51:17.006111Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibsczh\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibsczh, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 08056ed8-93de-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibsczh" level=info timestamp=2018-07-30T09:51:47.742547Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilgpjq kind= uid=1ad1ff74-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:51:47.744280Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilgpjq kind= uid=1ad1ff74-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:51:48.327748Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilgpjq\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmilgpjq, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1ad1ff74-93de-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmilgpjq" level=info timestamp=2018-07-30T09:52:18.512304Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5pnkg kind= uid=2d2cb8ef-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:52:18.517140Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5pnkg kind= uid=2d2cb8ef-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:52:19.164527Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi5pnkg\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi5pnkg" Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:46:59.838073Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-07-30T09:46:59.845383Z pos=vm.go:210 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-07-30T09:46:59.846082Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-07-30T09:46:59.947850Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-07-30T09:46:59.985775Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-07-30T09:47:00.003950Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-07-30T09:47:00.148203Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.325563Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:00.325900Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.326092Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.046605Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.046998Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.106660Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.106929Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi5pnkg-5hl4x Pod phase: Pending • Failure [31.157 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:869 with an active pod. /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:870 should result in pod being terminated [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:871 Expected error: <*errors.StatusError | 0xc420dbc090>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:875 ------------------------------ STEP: Creating the VirtualMachineInstance Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:50:19 http: TLS handshake error from 10.244.1.1:48126: EOF 2018/07/30 09:50:29 http: TLS handshake error from 10.244.1.1:48132: EOF 2018/07/30 09:50:39 http: TLS handshake error from 10.244.1.1:48138: EOF 2018/07/30 09:50:49 http: TLS handshake error from 10.244.1.1:48144: EOF 2018/07/30 09:50:59 http: TLS handshake error from 10.244.1.1:48150: EOF 2018/07/30 09:51:09 http: TLS handshake error from 10.244.1.1:48156: EOF 2018/07/30 09:51:19 http: TLS handshake error from 10.244.1.1:48162: EOF 2018/07/30 09:51:29 http: TLS handshake error from 10.244.1.1:48168: EOF 2018/07/30 09:51:39 http: TLS handshake error from 10.244.1.1:48174: EOF 2018/07/30 09:51:49 http: TLS handshake error from 10.244.1.1:48180: EOF 2018/07/30 09:51:59 http: TLS handshake error from 10.244.1.1:48186: EOF 2018/07/30 09:52:09 http: TLS handshake error from 10.244.1.1:48192: EOF 2018/07/30 09:52:19 http: TLS handshake error from 10.244.1.1:48198: EOF 2018/07/30 09:52:29 http: TLS handshake error from 10.244.1.1:48204: EOF 2018/07/30 09:52:39 http: TLS handshake error from 10.244.1.1:48210: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:46:59.933939Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-nvqww Pod phase: Running level=info timestamp=2018-07-30T09:50:45.389276Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimll6d kind= uid=f5a8e0d8-93dd-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:50:45.975813Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmimll6d\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmimll6d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f5a8e0d8-93dd-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmimll6d" level=info timestamp=2018-07-30T09:51:16.201115Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibsczh kind= uid=08056ed8-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:51:16.201812Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibsczh kind= uid=08056ed8-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:51:16.536626Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibsczh\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibsczh" level=info timestamp=2018-07-30T09:51:17.006111Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibsczh\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibsczh, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 08056ed8-93de-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibsczh" level=info timestamp=2018-07-30T09:51:47.742547Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilgpjq kind= uid=1ad1ff74-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:51:47.744280Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilgpjq kind= uid=1ad1ff74-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:51:48.327748Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilgpjq\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmilgpjq, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1ad1ff74-93de-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmilgpjq" level=info timestamp=2018-07-30T09:52:18.512304Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5pnkg kind= uid=2d2cb8ef-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:52:18.517140Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5pnkg kind= uid=2d2cb8ef-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:52:19.164527Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi5pnkg\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi5pnkg" level=info timestamp=2018-07-30T09:52:49.682145Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikg779 kind= uid=3fbd932f-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:52:49.686317Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikg779 kind= uid=3fbd932f-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:52:50.031388Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikg779\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikg779" Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:46:59.838073Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-07-30T09:46:59.845383Z pos=vm.go:210 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-07-30T09:46:59.846082Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-07-30T09:46:59.947850Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-07-30T09:46:59.985775Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-07-30T09:47:00.003950Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-07-30T09:47:00.148203Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.325563Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:00.325900Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.326092Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.046605Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.046998Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.106660Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.106929Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmikg779-dkvqf Pod phase: Pending • Failure [30.848 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:869 with grace period greater than 0 /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:894 should run graceful shutdown [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:895 Expected error: <*errors.StatusError | 0xc42016a750>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:919 ------------------------------ STEP: Setting a VirtualMachineInstance termination grace period to 5 STEP: Creating the VirtualMachineInstance Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:50:59 http: TLS handshake error from 10.244.1.1:48150: EOF 2018/07/30 09:51:09 http: TLS handshake error from 10.244.1.1:48156: EOF 2018/07/30 09:51:19 http: TLS handshake error from 10.244.1.1:48162: EOF 2018/07/30 09:51:29 http: TLS handshake error from 10.244.1.1:48168: EOF 2018/07/30 09:51:39 http: TLS handshake error from 10.244.1.1:48174: EOF 2018/07/30 09:51:49 http: TLS handshake error from 10.244.1.1:48180: EOF 2018/07/30 09:51:59 http: TLS handshake error from 10.244.1.1:48186: EOF 2018/07/30 09:52:09 http: TLS handshake error from 10.244.1.1:48192: EOF 2018/07/30 09:52:19 http: TLS handshake error from 10.244.1.1:48198: EOF 2018/07/30 09:52:29 http: TLS handshake error from 10.244.1.1:48204: EOF 2018/07/30 09:52:39 http: TLS handshake error from 10.244.1.1:48210: EOF 2018/07/30 09:52:49 http: TLS handshake error from 10.244.1.1:48216: EOF 2018/07/30 09:52:59 http: TLS handshake error from 10.244.1.1:48222: EOF 2018/07/30 09:53:09 http: TLS handshake error from 10.244.1.1:48228: EOF 2018/07/30 09:53:19 http: TLS handshake error from 10.244.1.1:48234: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:46:59.933939Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-nvqww Pod phase: Running level=info timestamp=2018-07-30T09:51:17.006111Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibsczh\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibsczh, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 08056ed8-93de-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibsczh" level=info timestamp=2018-07-30T09:51:47.742547Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilgpjq kind= uid=1ad1ff74-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:51:47.744280Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilgpjq kind= uid=1ad1ff74-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:51:48.327748Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilgpjq\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmilgpjq, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1ad1ff74-93de-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmilgpjq" level=info timestamp=2018-07-30T09:52:18.512304Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5pnkg kind= uid=2d2cb8ef-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:52:18.517140Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5pnkg kind= uid=2d2cb8ef-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:52:19.164527Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi5pnkg\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi5pnkg" level=info timestamp=2018-07-30T09:52:49.682145Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikg779 kind= uid=3fbd932f-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:52:49.686317Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikg779 kind= uid=3fbd932f-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:52:50.031388Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikg779\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikg779" level=info timestamp=2018-07-30T09:52:50.275050Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikg779\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmikg779, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3fbd932f-93de-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikg779" level=info timestamp=2018-07-30T09:53:20.446807Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi55v6t kind= uid=52181516-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:53:20.448656Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi55v6t kind= uid=52181516-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:53:20.701475Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi55v6t\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi55v6t" level=info timestamp=2018-07-30T09:53:20.762872Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi55v6t\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi55v6t" Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:46:59.838073Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-07-30T09:46:59.845383Z pos=vm.go:210 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-07-30T09:46:59.846082Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-07-30T09:46:59.947850Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-07-30T09:46:59.985775Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-07-30T09:47:00.003950Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-07-30T09:47:00.148203Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.325563Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:00.325900Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.326092Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.046605Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.046998Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.106660Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.106929Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi55v6t-ccbhl Pod phase: Pending • Failure [30.845 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Killed VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:946 should be in Failed phase [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:947 Expected <*errors.StatusError | 0xc420821e60>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } to be nil /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:950 ------------------------------ STEP: Starting a VirtualMachineInstance Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:51:29 http: TLS handshake error from 10.244.1.1:48168: EOF 2018/07/30 09:51:39 http: TLS handshake error from 10.244.1.1:48174: EOF 2018/07/30 09:51:49 http: TLS handshake error from 10.244.1.1:48180: EOF 2018/07/30 09:51:59 http: TLS handshake error from 10.244.1.1:48186: EOF 2018/07/30 09:52:09 http: TLS handshake error from 10.244.1.1:48192: EOF 2018/07/30 09:52:19 http: TLS handshake error from 10.244.1.1:48198: EOF 2018/07/30 09:52:29 http: TLS handshake error from 10.244.1.1:48204: EOF 2018/07/30 09:52:39 http: TLS handshake error from 10.244.1.1:48210: EOF 2018/07/30 09:52:49 http: TLS handshake error from 10.244.1.1:48216: EOF 2018/07/30 09:52:59 http: TLS handshake error from 10.244.1.1:48222: EOF 2018/07/30 09:53:09 http: TLS handshake error from 10.244.1.1:48228: EOF 2018/07/30 09:53:19 http: TLS handshake error from 10.244.1.1:48234: EOF 2018/07/30 09:53:29 http: TLS handshake error from 10.244.1.1:48240: EOF 2018/07/30 09:53:39 http: TLS handshake error from 10.244.1.1:48246: EOF 2018/07/30 09:53:49 http: TLS handshake error from 10.244.1.1:48252: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:46:59.933939Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-nvqww Pod phase: Running level=info timestamp=2018-07-30T09:51:48.327748Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilgpjq\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmilgpjq, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1ad1ff74-93de-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmilgpjq" level=info timestamp=2018-07-30T09:52:18.512304Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5pnkg kind= uid=2d2cb8ef-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:52:18.517140Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5pnkg kind= uid=2d2cb8ef-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:52:19.164527Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi5pnkg\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi5pnkg" level=info timestamp=2018-07-30T09:52:49.682145Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikg779 kind= uid=3fbd932f-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:52:49.686317Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikg779 kind= uid=3fbd932f-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:52:50.031388Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikg779\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikg779" level=info timestamp=2018-07-30T09:52:50.275050Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikg779\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmikg779, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3fbd932f-93de-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikg779" level=info timestamp=2018-07-30T09:53:20.446807Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi55v6t kind= uid=52181516-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:53:20.448656Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi55v6t kind= uid=52181516-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:53:20.701475Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi55v6t\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi55v6t" level=info timestamp=2018-07-30T09:53:20.762872Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi55v6t\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi55v6t" level=info timestamp=2018-07-30T09:53:51.428265Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:53:51.429385Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:53:51.634421Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivwhw7\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivwhw7" Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:46:59.838073Z pos=virt-handler.go:87 component=virt-handler hostname=node02 level=info timestamp=2018-07-30T09:46:59.845383Z pos=vm.go:210 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-07-30T09:46:59.846082Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-07-30T09:46:59.947850Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-07-30T09:46:59.985775Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-07-30T09:47:00.003950Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-07-30T09:47:00.148203Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.325563Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:00.325900Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:47:00.326092Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.046605Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.046998Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind= uid=5bd02de0-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:47:08.106660Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:47:08.106929Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmisnssv kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmivwhw7-mzt4w Pod phase: Pending • Failure [30.812 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Killed VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:946 should be left alone by virt-handler [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:974 Expected <*errors.StatusError | 0xc420aa2480>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } to be nil /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:977 ------------------------------ STEP: Starting a VirtualMachineInstance S [SKIPPING] in Spec Setup (BeforeEach) [0.013 seconds] Windows VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:57 should succeed to start a vmi [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:133 Skip Windows tests that requires PVC disk-windows /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1349 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.031 seconds] Windows VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:57 should succeed to stop a running vmi [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:139 Skip Windows tests that requires PVC disk-windows /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1349 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.025 seconds] Windows VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:57 with winrm connection [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:150 should have correct UUID /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:192 Skip Windows tests that requires PVC disk-windows /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1349 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.012 seconds] Windows VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:57 with winrm connection [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:150 should have pod IP /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:208 Skip Windows tests that requires PVC disk-windows /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1349 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.012 seconds] Windows VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:57 with kubectl command [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:226 should succeed to start a vmi /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:242 Skip Windows tests that requires PVC disk-windows /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1349 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.011 seconds] Windows VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:57 with kubectl command [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:226 should succeed to stop a vmi /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:250 Skip Windows tests that requires PVC disk-windows /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1349 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.002 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 should succeed to generate a VM JSON file using oc-process command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:150 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1387 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.002 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 with given VM JSON from the Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:152 should succeed to create a VM using oc-create command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:156 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1387 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.002 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 with given VM JSON from the Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:152 with given VM from the VM JSON /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:158 should succeed to launch a VMI using oc-patch command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:161 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1387 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.002 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 with given VM JSON from the Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:152 with given VM from the VM JSON /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:158 with given VMI from the VM /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:163 should succeed to terminate the VMI using oc-patch command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:166 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1387 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:51:59 http: TLS handshake error from 10.244.1.1:48186: EOF 2018/07/30 09:52:09 http: TLS handshake error from 10.244.1.1:48192: EOF 2018/07/30 09:52:19 http: TLS handshake error from 10.244.1.1:48198: EOF 2018/07/30 09:52:29 http: TLS handshake error from 10.244.1.1:48204: EOF 2018/07/30 09:52:39 http: TLS handshake error from 10.244.1.1:48210: EOF 2018/07/30 09:52:49 http: TLS handshake error from 10.244.1.1:48216: EOF 2018/07/30 09:52:59 http: TLS handshake error from 10.244.1.1:48222: EOF 2018/07/30 09:53:09 http: TLS handshake error from 10.244.1.1:48228: EOF 2018/07/30 09:53:19 http: TLS handshake error from 10.244.1.1:48234: EOF 2018/07/30 09:53:29 http: TLS handshake error from 10.244.1.1:48240: EOF 2018/07/30 09:53:39 http: TLS handshake error from 10.244.1.1:48246: EOF 2018/07/30 09:53:49 http: TLS handshake error from 10.244.1.1:48252: EOF 2018/07/30 09:53:59 http: TLS handshake error from 10.244.1.1:48258: EOF 2018/07/30 09:54:09 http: TLS handshake error from 10.244.1.1:48264: EOF 2018/07/30 09:54:19 http: TLS handshake error from 10.244.1.1:48270: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:46:59.933939Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-nvqww Pod phase: Running level=info timestamp=2018-07-30T09:52:18.517140Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5pnkg kind= uid=2d2cb8ef-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:52:19.164527Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi5pnkg\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi5pnkg" level=info timestamp=2018-07-30T09:52:49.682145Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikg779 kind= uid=3fbd932f-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:52:49.686317Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikg779 kind= uid=3fbd932f-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:52:50.031388Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikg779\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikg779" level=info timestamp=2018-07-30T09:52:50.275050Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikg779\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmikg779, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3fbd932f-93de-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikg779" level=info timestamp=2018-07-30T09:53:20.446807Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi55v6t kind= uid=52181516-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:53:20.448656Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi55v6t kind= uid=52181516-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:53:20.701475Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi55v6t\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi55v6t" level=info timestamp=2018-07-30T09:53:20.762872Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi55v6t\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi55v6t" level=info timestamp=2018-07-30T09:53:51.428265Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:53:51.429385Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:53:51.634421Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivwhw7\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivwhw7" level=info timestamp=2018-07-30T09:54:22.007853Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:54:22.011831Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:54:08.854734Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type ADDED" level=info timestamp=2018-07-30T09:54:08.856160Z pos=vm.go:657 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=Domain uid=648e257a-93de-11e8-adf7-525500d15501 msg="Domain is in state Paused reason StartingUp" level=info timestamp=2018-07-30T09:54:09.543664Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:54:09.543863Z pos=vm.go:688 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=Domain uid=648e257a-93de-11e8-adf7-525500d15501 msg="Domain is in state Running reason Unknown" level=info timestamp=2018-07-30T09:54:09.586851Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:09.588129Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:54:09.587003Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:54:09.623829Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:09.623974Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="No update processing required" level=error timestamp=2018-07-30T09:54:09.654192Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivwhw7\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:54:09.654319Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivwhw7\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmivwhw7" level=info timestamp=2018-07-30T09:54:09.654458Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:54:09.659576Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:09.665199Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:54:09.671478Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmivwhw7-mzt4w Pod phase: Running Pod name: virt-launcher-testvmizzfp2-c2s9c Pod phase: Pending • Failure in Spec Setup (BeforeEach) [30.491 seconds] Slirp /root/go/src/kubevirt.io/kubevirt/tests/vmi_slirp_interface_test.go:39 should be able to [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 VirtualMachineInstance with slirp interface /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Expected error: <*errors.StatusError | 0xc42016bdd0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmi_slirp_interface_test.go:58 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:52:29 http: TLS handshake error from 10.244.1.1:48204: EOF 2018/07/30 09:52:39 http: TLS handshake error from 10.244.1.1:48210: EOF 2018/07/30 09:52:49 http: TLS handshake error from 10.244.1.1:48216: EOF 2018/07/30 09:52:59 http: TLS handshake error from 10.244.1.1:48222: EOF 2018/07/30 09:53:09 http: TLS handshake error from 10.244.1.1:48228: EOF 2018/07/30 09:53:19 http: TLS handshake error from 10.244.1.1:48234: EOF 2018/07/30 09:53:29 http: TLS handshake error from 10.244.1.1:48240: EOF 2018/07/30 09:53:39 http: TLS handshake error from 10.244.1.1:48246: EOF 2018/07/30 09:53:49 http: TLS handshake error from 10.244.1.1:48252: EOF 2018/07/30 09:53:59 http: TLS handshake error from 10.244.1.1:48258: EOF 2018/07/30 09:54:09 http: TLS handshake error from 10.244.1.1:48264: EOF 2018/07/30 09:54:19 http: TLS handshake error from 10.244.1.1:48270: EOF 2018/07/30 09:54:29 http: TLS handshake error from 10.244.1.1:48276: EOF 2018/07/30 09:54:39 http: TLS handshake error from 10.244.1.1:48282: EOF 2018/07/30 09:54:49 http: TLS handshake error from 10.244.1.1:48288: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:46:59.933939Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-nvqww Pod phase: Running level=info timestamp=2018-07-30T09:52:49.682145Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikg779 kind= uid=3fbd932f-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:52:49.686317Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikg779 kind= uid=3fbd932f-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:52:50.031388Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikg779\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikg779" level=info timestamp=2018-07-30T09:52:50.275050Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikg779\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmikg779, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3fbd932f-93de-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikg779" level=info timestamp=2018-07-30T09:53:20.446807Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi55v6t kind= uid=52181516-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:53:20.448656Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi55v6t kind= uid=52181516-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:53:20.701475Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi55v6t\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi55v6t" level=info timestamp=2018-07-30T09:53:20.762872Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi55v6t\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi55v6t" level=info timestamp=2018-07-30T09:53:51.428265Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:53:51.429385Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:53:51.634421Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivwhw7\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivwhw7" level=info timestamp=2018-07-30T09:54:22.007853Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:54:22.011831Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:54:52.521156Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi545j9 kind= uid=88f37b6e-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:54:52.523505Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi545j9 kind= uid=88f37b6e-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:54:09.665199Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:54:09.671478Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:38.532337Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:54:39.641411Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type ADDED" level=info timestamp=2018-07-30T09:54:39.641708Z pos=vm.go:657 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=Domain uid=76c72517-93de-11e8-adf7-525500d15501 msg="Domain is in state Paused reason StartingUp" level=info timestamp=2018-07-30T09:54:40.185484Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:40.185617Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:54:40.188585Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:54:40.188758Z pos=vm.go:688 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=Domain uid=76c72517-93de-11e8-adf7-525500d15501 msg="Domain is in state Running reason Unknown" level=info timestamp=2018-07-30T09:54:40.205608Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:40.205763Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:54:40.216861Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T09:54:40.217139Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:40.217232Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:54:40.224284Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi545j9-8llz5 Pod phase: Pending Pod name: virt-launcher-testvmivwhw7-mzt4w Pod phase: Running Pod name: virt-launcher-testvmizzfp2-c2s9c Pod phase: Running • Failure in Spec Setup (BeforeEach) [30.878 seconds] Slirp /root/go/src/kubevirt.io/kubevirt/tests/vmi_slirp_interface_test.go:39 should be able to [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 VirtualMachineInstance with slirp interface with custom MAC address /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Expected error: <*errors.StatusError | 0xc420aa39e0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmi_slirp_interface_test.go:58 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:53:19 http: TLS handshake error from 10.244.1.1:48234: EOF 2018/07/30 09:53:29 http: TLS handshake error from 10.244.1.1:48240: EOF 2018/07/30 09:53:39 http: TLS handshake error from 10.244.1.1:48246: EOF 2018/07/30 09:53:49 http: TLS handshake error from 10.244.1.1:48252: EOF 2018/07/30 09:53:59 http: TLS handshake error from 10.244.1.1:48258: EOF 2018/07/30 09:54:09 http: TLS handshake error from 10.244.1.1:48264: EOF 2018/07/30 09:54:19 http: TLS handshake error from 10.244.1.1:48270: EOF 2018/07/30 09:54:29 http: TLS handshake error from 10.244.1.1:48276: EOF 2018/07/30 09:54:39 http: TLS handshake error from 10.244.1.1:48282: EOF 2018/07/30 09:54:49 http: TLS handshake error from 10.244.1.1:48288: EOF 2018/07/30 09:54:59 http: TLS handshake error from 10.244.1.1:48294: EOF 2018/07/30 09:55:09 http: TLS handshake error from 10.244.1.1:48300: EOF 2018/07/30 09:55:19 http: TLS handshake error from 10.244.1.1:48306: EOF 2018/07/30 09:55:29 http: TLS handshake error from 10.244.1.1:48312: EOF 2018/07/30 09:55:39 http: TLS handshake error from 10.244.1.1:48318: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:55:14.203789Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer limitrangeInformer" level=info timestamp=2018-07-30T09:55:14.215202Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmiInformer" level=info timestamp=2018-07-30T09:55:14.215352Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer kubeVirtPodInformer" level=info timestamp=2018-07-30T09:55:14.215438Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer kubeVirtNodeInformer" level=info timestamp=2018-07-30T09:55:14.215489Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmiPresetInformer" level=info timestamp=2018-07-30T09:55:14.215573Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmirsInformer" level=info timestamp=2018-07-30T09:55:14.215641Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer configMapInformer" level=info timestamp=2018-07-30T09:55:14.215723Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmInformer" level=info timestamp=2018-07-30T09:55:14.216133Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-07-30T09:55:14.229909Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-07-30T09:55:14.232628Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-07-30T09:55:14.233006Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-07-30T09:55:14.235099Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-07-30T09:55:49.079543Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikqvhd kind= uid=aabf7cc8-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:55:49.080107Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikqvhd kind= uid=aabf7cc8-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T09:54:56.886239Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:54:40.224284Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.276417Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.276662Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.280746Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmivwhw7" level=info timestamp=2018-07-30T09:54:53.303833Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.304093Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.312377Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmizzfp2" level=info timestamp=2018-07-30T09:54:53.442892Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.473616Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.475693Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.476136Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.476707Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.511432Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.511625Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.517529Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmikqvhd-rxmlw Pod phase: Pending Pod name: virt-launcher-testvmivwhw7-mzt4w Pod phase: Pending Unable to retrieve container logs for docker://137b899dd222644fcc1c559d971fa832ec8cd698e1bfb521fafe1148de9f454f Pod name: virt-launcher-testvmizzfp2-c2s9c Pod phase: Pending Unable to retrieve container logs for docker://1b713aaeff481b6352827abe29725c1504fe873895003a608a1151e2c29eb41a• Failure [56.402 seconds] LeaderElection /root/go/src/kubevirt.io/kubevirt/tests/controller_leader_election_test.go:43 Start a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/controller_leader_election_test.go:53 when the controller pod is not running /root/go/src/kubevirt.io/kubevirt/tests/controller_leader_election_test.go:54 should success [It] /root/go/src/kubevirt.io/kubevirt/tests/controller_leader_election_test.go:55 Expected <*errors.StatusError | 0xc420aa33b0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } to be nil /root/go/src/kubevirt.io/kubevirt/tests/controller_leader_election_test.go:91 ------------------------------ STEP: Destroying the leading controller pod STEP: Starting a new VirtualMachineInstance • Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:53:59 http: TLS handshake error from 10.244.1.1:48258: EOF 2018/07/30 09:54:09 http: TLS handshake error from 10.244.1.1:48264: EOF 2018/07/30 09:54:19 http: TLS handshake error from 10.244.1.1:48270: EOF 2018/07/30 09:54:29 http: TLS handshake error from 10.244.1.1:48276: EOF 2018/07/30 09:54:39 http: TLS handshake error from 10.244.1.1:48282: EOF 2018/07/30 09:54:49 http: TLS handshake error from 10.244.1.1:48288: EOF 2018/07/30 09:54:59 http: TLS handshake error from 10.244.1.1:48294: EOF 2018/07/30 09:55:09 http: TLS handshake error from 10.244.1.1:48300: EOF 2018/07/30 09:55:19 http: TLS handshake error from 10.244.1.1:48306: EOF 2018/07/30 09:55:29 http: TLS handshake error from 10.244.1.1:48312: EOF 2018/07/30 09:55:39 http: TLS handshake error from 10.244.1.1:48318: EOF 2018/07/30 09:55:49 http: TLS handshake error from 10.244.1.1:48324: EOF 2018/07/30 09:55:59 http: TLS handshake error from 10.244.1.1:48330: EOF 2018/07/30 09:56:09 http: TLS handshake error from 10.244.1.1:48336: EOF 2018/07/30 09:56:19 http: TLS handshake error from 10.244.1.1:48342: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:55:14.215438Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer kubeVirtNodeInformer" level=info timestamp=2018-07-30T09:55:14.215489Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmiPresetInformer" level=info timestamp=2018-07-30T09:55:14.215573Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmirsInformer" level=info timestamp=2018-07-30T09:55:14.215641Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer configMapInformer" level=info timestamp=2018-07-30T09:55:14.215723Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmInformer" level=info timestamp=2018-07-30T09:55:14.216133Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-07-30T09:55:14.229909Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-07-30T09:55:14.232628Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-07-30T09:55:14.233006Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-07-30T09:55:14.235099Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-07-30T09:55:49.079543Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikqvhd kind= uid=aabf7cc8-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:55:49.080107Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikqvhd kind= uid=aabf7cc8-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:56:20.177380Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimkqhq kind= uid=bd46db8a-93de-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T09:56:20.179622Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimkqhq kind= uid=bd46db8a-93de-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-30T09:56:20.179759Z pos=vm.go:262 component=virt-controller service=http msg="vmi is nil" Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T09:54:56.886239Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:54:40.224284Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.276417Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.276662Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.280746Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmivwhw7" level=info timestamp=2018-07-30T09:54:53.303833Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.304093Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.312377Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmizzfp2" level=info timestamp=2018-07-30T09:54:53.442892Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.473616Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.475693Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.476136Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.476707Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.511432Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.511625Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.517529Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." ------------------------------ • Failure [30.442 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 An invalid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:58 should reject POST if validation webhoook deems the spec is invalid [It] /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:83 Expected : 504 to equal : 422 /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:103 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:54:29 http: TLS handshake error from 10.244.1.1:48276: EOF 2018/07/30 09:54:39 http: TLS handshake error from 10.244.1.1:48282: EOF 2018/07/30 09:54:49 http: TLS handshake error from 10.244.1.1:48288: EOF 2018/07/30 09:54:59 http: TLS handshake error from 10.244.1.1:48294: EOF 2018/07/30 09:55:09 http: TLS handshake error from 10.244.1.1:48300: EOF 2018/07/30 09:55:19 http: TLS handshake error from 10.244.1.1:48306: EOF 2018/07/30 09:55:29 http: TLS handshake error from 10.244.1.1:48312: EOF 2018/07/30 09:55:39 http: TLS handshake error from 10.244.1.1:48318: EOF 2018/07/30 09:55:49 http: TLS handshake error from 10.244.1.1:48324: EOF 2018/07/30 09:55:59 http: TLS handshake error from 10.244.1.1:48330: EOF 2018/07/30 09:56:09 http: TLS handshake error from 10.244.1.1:48336: EOF 2018/07/30 09:56:19 http: TLS handshake error from 10.244.1.1:48342: EOF 2018/07/30 09:56:29 http: TLS handshake error from 10.244.1.1:48348: EOF 2018/07/30 09:56:39 http: TLS handshake error from 10.244.1.1:48354: EOF 2018/07/30 09:56:49 http: TLS handshake error from 10.244.1.1:48360: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:55:14.215641Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer configMapInformer" level=info timestamp=2018-07-30T09:55:14.215723Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmInformer" level=info timestamp=2018-07-30T09:55:14.216133Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-07-30T09:55:14.229909Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-07-30T09:55:14.232628Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-07-30T09:55:14.233006Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-07-30T09:55:14.235099Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-07-30T09:55:49.079543Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikqvhd kind= uid=aabf7cc8-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:55:49.080107Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikqvhd kind= uid=aabf7cc8-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:56:20.177380Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimkqhq kind= uid=bd46db8a-93de-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T09:56:20.179622Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimkqhq kind= uid=bd46db8a-93de-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-30T09:56:20.179759Z pos=vm.go:262 component=virt-controller service=http msg="vmi is nil" level=info timestamp=2018-07-30T09:56:50.696948Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid6nxq kind= uid=cf7c1ecb-93de-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T09:56:50.697566Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid6nxq kind= uid=cf7c1ecb-93de-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: true" level=info timestamp=2018-07-30T09:56:50.697847Z pos=vm.go:377 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid6nxq kind= uid=cf7c1ecb-93de-11e8-adf7-525500d15501 msg="Setting stabile UUID '75e6e51e-a37d-50f6-8f94-fc74cb6e9417' (was '')" Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T09:54:56.886239Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:54:40.224284Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.276417Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.276662Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.280746Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmivwhw7" level=info timestamp=2018-07-30T09:54:53.303833Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.304093Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.312377Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmizzfp2" level=info timestamp=2018-07-30T09:54:53.442892Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.473616Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.475693Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.476136Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.476707Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.511432Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.511625Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.517529Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." • Failure [30.599 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 should update VirtualMachine once VMIs are up [It] /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:195 Expected error: <*errors.StatusError | 0xc420aa22d0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:54:59 http: TLS handshake error from 10.244.1.1:48294: EOF 2018/07/30 09:55:09 http: TLS handshake error from 10.244.1.1:48300: EOF 2018/07/30 09:55:19 http: TLS handshake error from 10.244.1.1:48306: EOF 2018/07/30 09:55:29 http: TLS handshake error from 10.244.1.1:48312: EOF 2018/07/30 09:55:39 http: TLS handshake error from 10.244.1.1:48318: EOF 2018/07/30 09:55:49 http: TLS handshake error from 10.244.1.1:48324: EOF 2018/07/30 09:55:59 http: TLS handshake error from 10.244.1.1:48330: EOF 2018/07/30 09:56:09 http: TLS handshake error from 10.244.1.1:48336: EOF 2018/07/30 09:56:19 http: TLS handshake error from 10.244.1.1:48342: EOF 2018/07/30 09:56:29 http: TLS handshake error from 10.244.1.1:48348: EOF 2018/07/30 09:56:39 http: TLS handshake error from 10.244.1.1:48354: EOF 2018/07/30 09:56:49 http: TLS handshake error from 10.244.1.1:48360: EOF 2018/07/30 09:56:59 http: TLS handshake error from 10.244.1.1:48366: EOF 2018/07/30 09:57:09 http: TLS handshake error from 10.244.1.1:48372: EOF 2018/07/30 09:57:19 http: TLS handshake error from 10.244.1.1:48378: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:56:50.697847Z pos=vm.go:377 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid6nxq kind= uid=cf7c1ecb-93de-11e8-adf7-525500d15501 msg="Setting stabile UUID '75e6e51e-a37d-50f6-8f94-fc74cb6e9417' (was '')" level=info timestamp=2018-07-30T09:57:20.715123Z pos=vm.go:287 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid6nxq kind= uid=cf7c1ecb-93de-11e8-adf7-525500d15501 msg="Failed to create VirtualMachineInstance: /" level=error timestamp=2018-07-30T09:57:20.715523Z pos=vm.go:197 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid6nxq kind= uid=cf7c1ecb-93de-11e8-adf7-525500d15501 msg="Creating the VirtualMachine failed." level=info timestamp=2018-07-30T09:57:20.715796Z pos=vm.go:681 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid6nxq kind= uid=cf7c1ecb-93de-11e8-adf7-525500d15501 msg="Processing failure status:: shouldRun: true; noErr: true; noVm: false" level=info timestamp=2018-07-30T09:57:20.715873Z pos=vm.go:692 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid6nxq kind= uid=cf7c1ecb-93de-11e8-adf7-525500d15501 msg="Reason to fail: FailedCreate" level=error timestamp=2018-07-30T09:57:20.732495Z pos=vm.go:202 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid6nxq kind= uid=cf7c1ecb-93de-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvmid6nxq\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvmid6nxq, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: cf7c1ecb-93de-11e8-adf7-525500d15501, UID in object meta: " msg="Updating the VirtualMachine status failed." level=info timestamp=2018-07-30T09:57:20.732801Z pos=vm.go:111 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvmid6nxq\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvmid6nxq, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: cf7c1ecb-93de-11e8-adf7-525500d15501, UID in object meta: " msg="re-enqueuing VirtualMachine kubevirt-test-default/testvmid6nxq" level=info timestamp=2018-07-30T09:57:20.747734Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid6nxq kind= uid=e1646987-93de-11e8-adf7-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=error timestamp=2018-07-30T09:57:20.748099Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid6nxq kind= uid=e1646987-93de-11e8-adf7-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvmid6nxq" level=info timestamp=2018-07-30T09:57:20.748326Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid6nxq kind= uid=e1646987-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:57:20.748670Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid6nxq kind= uid=e1646987-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:57:20.909331Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid6nxq\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid6nxq" level=info timestamp=2018-07-30T09:57:21.203446Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit4qxn kind= uid=e1ad6794-93de-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T09:57:21.203655Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit4qxn kind= uid=e1ad6794-93de-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: true" level=info timestamp=2018-07-30T09:57:21.203871Z pos=vm.go:377 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit4qxn kind= uid=e1ad6794-93de-11e8-adf7-525500d15501 msg="Setting stabile UUID '7f309eab-70ef-52b0-b48b-448210db30fc' (was '')" Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T09:54:56.886239Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:54:40.224284Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.276417Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.276662Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.280746Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmivwhw7" level=info timestamp=2018-07-30T09:54:53.303833Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.304093Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.312377Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmizzfp2" level=info timestamp=2018-07-30T09:54:53.442892Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.473616Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.475693Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.476136Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.476707Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.511432Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.511625Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.517529Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmid6nxq-nt9zv Pod phase: Pending • Failure [30.537 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 should remove VirtualMachineInstance once the VMI is marked for deletion [It] /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:204 Expected error: <*errors.StatusError | 0xc420c7ca20>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:55:29 http: TLS handshake error from 10.244.1.1:48312: EOF 2018/07/30 09:55:39 http: TLS handshake error from 10.244.1.1:48318: EOF 2018/07/30 09:55:49 http: TLS handshake error from 10.244.1.1:48324: EOF 2018/07/30 09:55:59 http: TLS handshake error from 10.244.1.1:48330: EOF 2018/07/30 09:56:09 http: TLS handshake error from 10.244.1.1:48336: EOF 2018/07/30 09:56:19 http: TLS handshake error from 10.244.1.1:48342: EOF 2018/07/30 09:56:29 http: TLS handshake error from 10.244.1.1:48348: EOF 2018/07/30 09:56:39 http: TLS handshake error from 10.244.1.1:48354: EOF 2018/07/30 09:56:49 http: TLS handshake error from 10.244.1.1:48360: EOF 2018/07/30 09:56:59 http: TLS handshake error from 10.244.1.1:48366: EOF 2018/07/30 09:57:09 http: TLS handshake error from 10.244.1.1:48372: EOF 2018/07/30 09:57:19 http: TLS handshake error from 10.244.1.1:48378: EOF 2018/07/30 09:57:29 http: TLS handshake error from 10.244.1.1:48384: EOF 2018/07/30 09:57:39 http: TLS handshake error from 10.244.1.1:48390: EOF 2018/07/30 09:57:49 http: TLS handshake error from 10.244.1.1:48396: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:57:21.203655Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit4qxn kind= uid=e1ad6794-93de-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: true" level=info timestamp=2018-07-30T09:57:21.203871Z pos=vm.go:377 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit4qxn kind= uid=e1ad6794-93de-11e8-adf7-525500d15501 msg="Setting stabile UUID '7f309eab-70ef-52b0-b48b-448210db30fc' (was '')" level=info timestamp=2018-07-30T09:57:51.220777Z pos=vm.go:287 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit4qxn kind= uid=e1ad6794-93de-11e8-adf7-525500d15501 msg="Failed to create VirtualMachineInstance: /" level=error timestamp=2018-07-30T09:57:51.221295Z pos=vm.go:197 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit4qxn kind= uid=e1ad6794-93de-11e8-adf7-525500d15501 msg="Creating the VirtualMachine failed." level=info timestamp=2018-07-30T09:57:51.221574Z pos=vm.go:681 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit4qxn kind= uid=e1ad6794-93de-11e8-adf7-525500d15501 msg="Processing failure status:: shouldRun: true; noErr: true; noVm: false" level=info timestamp=2018-07-30T09:57:51.221717Z pos=vm.go:692 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit4qxn kind= uid=e1ad6794-93de-11e8-adf7-525500d15501 msg="Reason to fail: FailedCreate" level=error timestamp=2018-07-30T09:57:51.274425Z pos=vm.go:202 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit4qxn kind= uid=e1ad6794-93de-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvmit4qxn\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvmit4qxn, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e1ad6794-93de-11e8-adf7-525500d15501, UID in object meta: " msg="Updating the VirtualMachine status failed." level=info timestamp=2018-07-30T09:57:51.274696Z pos=vm.go:111 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvmit4qxn\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvmit4qxn, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e1ad6794-93de-11e8-adf7-525500d15501, UID in object meta: " msg="re-enqueuing VirtualMachine kubevirt-test-default/testvmit4qxn" level=info timestamp=2018-07-30T09:57:51.327796Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit4qxn kind= uid=f3924d76-93de-11e8-adf7-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=error timestamp=2018-07-30T09:57:51.328175Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit4qxn kind= uid=f3924d76-93de-11e8-adf7-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvmit4qxn" level=info timestamp=2018-07-30T09:57:51.328377Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit4qxn kind= uid=f3924d76-93de-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:57:51.328582Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmit4qxn kind= uid=f3924d76-93de-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:57:51.866956Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=f3f35a96-93de-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T09:57:51.867233Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=f3f35a96-93de-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: true" level=info timestamp=2018-07-30T09:57:51.867448Z pos=vm.go:377 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=f3f35a96-93de-11e8-adf7-525500d15501 msg="Setting stabile UUID '9dd358a5-7247-5774-8897-6881931299f1' (was '')" Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T09:54:56.886239Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:54:40.224284Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.276417Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.276662Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.280746Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmivwhw7" level=info timestamp=2018-07-30T09:54:53.303833Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.304093Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.312377Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmizzfp2" level=info timestamp=2018-07-30T09:54:53.442892Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.473616Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.475693Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.476136Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.476707Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.511432Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.511625Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.517529Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmit4qxn-vprlm Pod phase: Pending • Failure [30.629 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 should remove owner references on the VirtualMachineInstance if it is orphan deleted [It] /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:217 Expected error: <*errors.StatusError | 0xc42016a870>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:55:59 http: TLS handshake error from 10.244.1.1:48330: EOF 2018/07/30 09:56:09 http: TLS handshake error from 10.244.1.1:48336: EOF 2018/07/30 09:56:19 http: TLS handshake error from 10.244.1.1:48342: EOF 2018/07/30 09:56:29 http: TLS handshake error from 10.244.1.1:48348: EOF 2018/07/30 09:56:39 http: TLS handshake error from 10.244.1.1:48354: EOF 2018/07/30 09:56:49 http: TLS handshake error from 10.244.1.1:48360: EOF 2018/07/30 09:56:59 http: TLS handshake error from 10.244.1.1:48366: EOF 2018/07/30 09:57:09 http: TLS handshake error from 10.244.1.1:48372: EOF 2018/07/30 09:57:19 http: TLS handshake error from 10.244.1.1:48378: EOF 2018/07/30 09:57:29 http: TLS handshake error from 10.244.1.1:48384: EOF 2018/07/30 09:57:39 http: TLS handshake error from 10.244.1.1:48390: EOF 2018/07/30 09:57:49 http: TLS handshake error from 10.244.1.1:48396: EOF 2018/07/30 09:57:59 http: TLS handshake error from 10.244.1.1:48402: EOF 2018/07/30 09:58:09 http: TLS handshake error from 10.244.1.1:48408: EOF 2018/07/30 09:58:19 http: TLS handshake error from 10.244.1.1:48414: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:57:51.867233Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=f3f35a96-93de-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: true" level=info timestamp=2018-07-30T09:57:51.867448Z pos=vm.go:377 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=f3f35a96-93de-11e8-adf7-525500d15501 msg="Setting stabile UUID '9dd358a5-7247-5774-8897-6881931299f1' (was '')" level=info timestamp=2018-07-30T09:58:21.875784Z pos=vm.go:287 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=f3f35a96-93de-11e8-adf7-525500d15501 msg="Failed to create VirtualMachineInstance: /" level=error timestamp=2018-07-30T09:58:21.876398Z pos=vm.go:197 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=f3f35a96-93de-11e8-adf7-525500d15501 msg="Creating the VirtualMachine failed." level=info timestamp=2018-07-30T09:58:21.876759Z pos=vm.go:681 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=f3f35a96-93de-11e8-adf7-525500d15501 msg="Processing failure status:: shouldRun: true; noErr: true; noVm: false" level=info timestamp=2018-07-30T09:58:21.876889Z pos=vm.go:692 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=f3f35a96-93de-11e8-adf7-525500d15501 msg="Reason to fail: FailedCreate" level=error timestamp=2018-07-30T09:58:21.895961Z pos=vm.go:202 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=f3f35a96-93de-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvmiz5rd4\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvmiz5rd4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f3f35a96-93de-11e8-adf7-525500d15501, UID in object meta: " msg="Updating the VirtualMachine status failed." level=info timestamp=2018-07-30T09:58:21.896299Z pos=vm.go:111 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvmiz5rd4\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvmiz5rd4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f3f35a96-93de-11e8-adf7-525500d15501, UID in object meta: " msg="re-enqueuing VirtualMachine kubevirt-test-default/testvmiz5rd4" level=info timestamp=2018-07-30T09:58:21.924989Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=05d91a33-93df-11e8-adf7-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=error timestamp=2018-07-30T09:58:21.925257Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=05d91a33-93df-11e8-adf7-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvmiz5rd4" level=info timestamp=2018-07-30T09:58:21.925451Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=05d91a33-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:58:21.925664Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=05d91a33-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:58:22.461899Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiqww4t kind= uid=0630a144-93df-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T09:58:22.462160Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiqww4t kind= uid=0630a144-93df-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-30T09:58:22.462273Z pos=vm.go:262 component=virt-controller service=http msg="vmi is nil" Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T09:54:56.886239Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:54:40.224284Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.276417Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.276662Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.280746Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmivwhw7" level=info timestamp=2018-07-30T09:54:53.303833Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.304093Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.312377Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmizzfp2" level=info timestamp=2018-07-30T09:54:53.442892Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.473616Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.475693Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.476136Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.476707Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.511432Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.511625Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.517529Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmiz5rd4-h92tg Pod phase: Pending • Failure [30.616 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 should recreate VirtualMachineInstance if it gets deleted [It] /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:245 Expected error: <*errors.StatusError | 0xc4209774d0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:56:29 http: TLS handshake error from 10.244.1.1:48348: EOF 2018/07/30 09:56:39 http: TLS handshake error from 10.244.1.1:48354: EOF 2018/07/30 09:56:49 http: TLS handshake error from 10.244.1.1:48360: EOF 2018/07/30 09:56:59 http: TLS handshake error from 10.244.1.1:48366: EOF 2018/07/30 09:57:09 http: TLS handshake error from 10.244.1.1:48372: EOF 2018/07/30 09:57:19 http: TLS handshake error from 10.244.1.1:48378: EOF 2018/07/30 09:57:29 http: TLS handshake error from 10.244.1.1:48384: EOF 2018/07/30 09:57:39 http: TLS handshake error from 10.244.1.1:48390: EOF 2018/07/30 09:57:49 http: TLS handshake error from 10.244.1.1:48396: EOF 2018/07/30 09:57:59 http: TLS handshake error from 10.244.1.1:48402: EOF 2018/07/30 09:58:09 http: TLS handshake error from 10.244.1.1:48408: EOF 2018/07/30 09:58:19 http: TLS handshake error from 10.244.1.1:48414: EOF 2018/07/30 09:58:29 http: TLS handshake error from 10.244.1.1:48420: EOF 2018/07/30 09:58:39 http: TLS handshake error from 10.244.1.1:48426: EOF 2018/07/30 09:58:49 http: TLS handshake error from 10.244.1.1:48432: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=error timestamp=2018-07-30T09:58:21.876398Z pos=vm.go:197 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=f3f35a96-93de-11e8-adf7-525500d15501 msg="Creating the VirtualMachine failed." level=info timestamp=2018-07-30T09:58:21.876759Z pos=vm.go:681 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=f3f35a96-93de-11e8-adf7-525500d15501 msg="Processing failure status:: shouldRun: true; noErr: true; noVm: false" level=info timestamp=2018-07-30T09:58:21.876889Z pos=vm.go:692 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=f3f35a96-93de-11e8-adf7-525500d15501 msg="Reason to fail: FailedCreate" level=error timestamp=2018-07-30T09:58:21.895961Z pos=vm.go:202 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=f3f35a96-93de-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvmiz5rd4\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvmiz5rd4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f3f35a96-93de-11e8-adf7-525500d15501, UID in object meta: " msg="Updating the VirtualMachine status failed." level=info timestamp=2018-07-30T09:58:21.896299Z pos=vm.go:111 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvmiz5rd4\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvmiz5rd4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f3f35a96-93de-11e8-adf7-525500d15501, UID in object meta: " msg="re-enqueuing VirtualMachine kubevirt-test-default/testvmiz5rd4" level=info timestamp=2018-07-30T09:58:21.924989Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=05d91a33-93df-11e8-adf7-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=error timestamp=2018-07-30T09:58:21.925257Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=05d91a33-93df-11e8-adf7-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvmiz5rd4" level=info timestamp=2018-07-30T09:58:21.925451Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=05d91a33-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:58:21.925664Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz5rd4 kind= uid=05d91a33-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T09:58:22.461899Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiqww4t kind= uid=0630a144-93df-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T09:58:22.462160Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiqww4t kind= uid=0630a144-93df-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-30T09:58:22.462273Z pos=vm.go:262 component=virt-controller service=http msg="vmi is nil" level=info timestamp=2018-07-30T09:58:53.130142Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=18757d28-93df-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T09:58:53.130438Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=18757d28-93df-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: true" level=info timestamp=2018-07-30T09:58:53.130633Z pos=vm.go:377 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=18757d28-93df-11e8-adf7-525500d15501 msg="Setting stabile UUID '4e6a4853-6480-5db2-baff-bb1113bb7ff2' (was '')" Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T09:54:56.886239Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:54:40.224284Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.276417Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.276662Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.280746Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmivwhw7" level=info timestamp=2018-07-30T09:54:53.303833Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.304093Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.312377Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmizzfp2" level=info timestamp=2018-07-30T09:54:53.442892Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.473616Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.475693Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.476136Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.476707Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.511432Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.511625Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.517529Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." • Failure [30.525 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 should recreate VirtualMachineInstance if the VirtualMachineInstance's pod gets deleted [It] /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:265 Expected error: <*errors.StatusError | 0xc420820480>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 ------------------------------ STEP: Creating a new VMI Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:56:59 http: TLS handshake error from 10.244.1.1:48366: EOF 2018/07/30 09:57:09 http: TLS handshake error from 10.244.1.1:48372: EOF 2018/07/30 09:57:19 http: TLS handshake error from 10.244.1.1:48378: EOF 2018/07/30 09:57:29 http: TLS handshake error from 10.244.1.1:48384: EOF 2018/07/30 09:57:39 http: TLS handshake error from 10.244.1.1:48390: EOF 2018/07/30 09:57:49 http: TLS handshake error from 10.244.1.1:48396: EOF 2018/07/30 09:57:59 http: TLS handshake error from 10.244.1.1:48402: EOF 2018/07/30 09:58:09 http: TLS handshake error from 10.244.1.1:48408: EOF 2018/07/30 09:58:19 http: TLS handshake error from 10.244.1.1:48414: EOF 2018/07/30 09:58:29 http: TLS handshake error from 10.244.1.1:48420: EOF 2018/07/30 09:58:39 http: TLS handshake error from 10.244.1.1:48426: EOF 2018/07/30 09:58:49 http: TLS handshake error from 10.244.1.1:48432: EOF 2018/07/30 09:58:59 http: TLS handshake error from 10.244.1.1:48438: EOF 2018/07/30 09:59:09 http: TLS handshake error from 10.244.1.1:48444: EOF 2018/07/30 09:59:19 http: TLS handshake error from 10.244.1.1:48450: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:58:53.130633Z pos=vm.go:377 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=18757d28-93df-11e8-adf7-525500d15501 msg="Setting stabile UUID '4e6a4853-6480-5db2-baff-bb1113bb7ff2' (was '')" level=info timestamp=2018-07-30T09:59:23.148404Z pos=vm.go:287 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=18757d28-93df-11e8-adf7-525500d15501 msg="Failed to create VirtualMachineInstance: /" level=error timestamp=2018-07-30T09:59:23.148908Z pos=vm.go:197 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=18757d28-93df-11e8-adf7-525500d15501 msg="Creating the VirtualMachine failed." level=info timestamp=2018-07-30T09:59:23.149285Z pos=vm.go:681 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=18757d28-93df-11e8-adf7-525500d15501 msg="Processing failure status:: shouldRun: true; noErr: true; noVm: false" level=info timestamp=2018-07-30T09:59:23.149424Z pos=vm.go:692 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=18757d28-93df-11e8-adf7-525500d15501 msg="Reason to fail: FailedCreate" level=error timestamp=2018-07-30T09:59:23.187370Z pos=vm.go:202 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=18757d28-93df-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvmijgvrq\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvmijgvrq, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 18757d28-93df-11e8-adf7-525500d15501, UID in object meta: " msg="Updating the VirtualMachine status failed." level=info timestamp=2018-07-30T09:59:23.187546Z pos=vm.go:111 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvmijgvrq\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvmijgvrq, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 18757d28-93df-11e8-adf7-525500d15501, UID in object meta: " msg="re-enqueuing VirtualMachine kubevirt-test-default/testvmijgvrq" level=info timestamp=2018-07-30T09:59:23.239224Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=2a5d6c20-93df-11e8-adf7-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=info timestamp=2018-07-30T09:59:23.239445Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=2a5d6c20-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:59:23.239830Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=2a5d6c20-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=error timestamp=2018-07-30T09:59:23.239638Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=2a5d6c20-93df-11e8-adf7-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvmijgvrq" level=info timestamp=2018-07-30T09:59:23.392852Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijgvrq\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijgvrq" level=info timestamp=2018-07-30T09:59:23.449425Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiks78g kind= uid=2a8b74cb-93df-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T09:59:23.449622Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiks78g kind= uid=2a8b74cb-93df-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-30T09:59:23.449705Z pos=vm.go:262 component=virt-controller service=http msg="vmi is nil" Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T09:54:56.886239Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:54:40.224284Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.276417Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.276662Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.280746Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmivwhw7" level=info timestamp=2018-07-30T09:54:53.303833Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.304093Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.312377Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmizzfp2" level=info timestamp=2018-07-30T09:54:53.442892Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.473616Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.475693Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.476136Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.476707Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.511432Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.511625Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.517529Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." • Failure [30.445 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 should stop VirtualMachineInstance if running set to false [It] /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:325 Expected error: <*errors.StatusError | 0xc420bf4240>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:57:29 http: TLS handshake error from 10.244.1.1:48384: EOF 2018/07/30 09:57:39 http: TLS handshake error from 10.244.1.1:48390: EOF 2018/07/30 09:57:49 http: TLS handshake error from 10.244.1.1:48396: EOF 2018/07/30 09:57:59 http: TLS handshake error from 10.244.1.1:48402: EOF 2018/07/30 09:58:09 http: TLS handshake error from 10.244.1.1:48408: EOF 2018/07/30 09:58:19 http: TLS handshake error from 10.244.1.1:48414: EOF 2018/07/30 09:58:29 http: TLS handshake error from 10.244.1.1:48420: EOF 2018/07/30 09:58:39 http: TLS handshake error from 10.244.1.1:48426: EOF 2018/07/30 09:58:49 http: TLS handshake error from 10.244.1.1:48432: EOF 2018/07/30 09:58:59 http: TLS handshake error from 10.244.1.1:48438: EOF 2018/07/30 09:59:09 http: TLS handshake error from 10.244.1.1:48444: EOF 2018/07/30 09:59:19 http: TLS handshake error from 10.244.1.1:48450: EOF 2018/07/30 09:59:29 http: TLS handshake error from 10.244.1.1:48456: EOF 2018/07/30 09:59:39 http: TLS handshake error from 10.244.1.1:48462: EOF 2018/07/30 09:59:49 http: TLS handshake error from 10.244.1.1:48468: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:59:23.149285Z pos=vm.go:681 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=18757d28-93df-11e8-adf7-525500d15501 msg="Processing failure status:: shouldRun: true; noErr: true; noVm: false" level=info timestamp=2018-07-30T09:59:23.149424Z pos=vm.go:692 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=18757d28-93df-11e8-adf7-525500d15501 msg="Reason to fail: FailedCreate" level=error timestamp=2018-07-30T09:59:23.187370Z pos=vm.go:202 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=18757d28-93df-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvmijgvrq\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvmijgvrq, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 18757d28-93df-11e8-adf7-525500d15501, UID in object meta: " msg="Updating the VirtualMachine status failed." level=info timestamp=2018-07-30T09:59:23.187546Z pos=vm.go:111 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvmijgvrq\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvmijgvrq, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 18757d28-93df-11e8-adf7-525500d15501, UID in object meta: " msg="re-enqueuing VirtualMachine kubevirt-test-default/testvmijgvrq" level=info timestamp=2018-07-30T09:59:23.239224Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=2a5d6c20-93df-11e8-adf7-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=info timestamp=2018-07-30T09:59:23.239445Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=2a5d6c20-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:59:23.239830Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=2a5d6c20-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=error timestamp=2018-07-30T09:59:23.239638Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=2a5d6c20-93df-11e8-adf7-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvmijgvrq" level=info timestamp=2018-07-30T09:59:23.392852Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijgvrq\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijgvrq" level=info timestamp=2018-07-30T09:59:23.449425Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiks78g kind= uid=2a8b74cb-93df-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T09:59:23.449622Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiks78g kind= uid=2a8b74cb-93df-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-30T09:59:23.449705Z pos=vm.go:262 component=virt-controller service=http msg="vmi is nil" level=info timestamp=2018-07-30T09:59:54.004500Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi75dv5 kind= uid=3cbdde7e-93df-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T09:59:54.005246Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi75dv5 kind= uid=3cbdde7e-93df-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-30T09:59:54.005363Z pos=vm.go:262 component=virt-controller service=http msg="vmi is nil" Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T09:54:56.886239Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:54:40.224284Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.276417Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.276662Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.280746Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmivwhw7" level=info timestamp=2018-07-30T09:54:53.303833Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.304093Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.312377Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmizzfp2" level=info timestamp=2018-07-30T09:54:53.442892Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.473616Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.475693Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.476136Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.476707Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.511432Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.511625Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.517529Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." • Failure [30.498 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 should start and stop VirtualMachineInstance multiple times [It] /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:333 Expected error: <*errors.StatusError | 0xc42016b560>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:57:59 http: TLS handshake error from 10.244.1.1:48402: EOF 2018/07/30 09:58:09 http: TLS handshake error from 10.244.1.1:48408: EOF 2018/07/30 09:58:19 http: TLS handshake error from 10.244.1.1:48414: EOF 2018/07/30 09:58:29 http: TLS handshake error from 10.244.1.1:48420: EOF 2018/07/30 09:58:39 http: TLS handshake error from 10.244.1.1:48426: EOF 2018/07/30 09:58:49 http: TLS handshake error from 10.244.1.1:48432: EOF 2018/07/30 09:58:59 http: TLS handshake error from 10.244.1.1:48438: EOF 2018/07/30 09:59:09 http: TLS handshake error from 10.244.1.1:48444: EOF 2018/07/30 09:59:19 http: TLS handshake error from 10.244.1.1:48450: EOF 2018/07/30 09:59:29 http: TLS handshake error from 10.244.1.1:48456: EOF 2018/07/30 09:59:39 http: TLS handshake error from 10.244.1.1:48462: EOF 2018/07/30 09:59:49 http: TLS handshake error from 10.244.1.1:48468: EOF 2018/07/30 09:59:59 http: TLS handshake error from 10.244.1.1:48474: EOF 2018/07/30 10:00:09 http: TLS handshake error from 10.244.1.1:48480: EOF 2018/07/30 10:00:19 http: TLS handshake error from 10.244.1.1:48486: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T09:59:23.187546Z pos=vm.go:111 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvmijgvrq\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvmijgvrq, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 18757d28-93df-11e8-adf7-525500d15501, UID in object meta: " msg="re-enqueuing VirtualMachine kubevirt-test-default/testvmijgvrq" level=info timestamp=2018-07-30T09:59:23.239224Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=2a5d6c20-93df-11e8-adf7-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=info timestamp=2018-07-30T09:59:23.239445Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=2a5d6c20-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T09:59:23.239830Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=2a5d6c20-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=error timestamp=2018-07-30T09:59:23.239638Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgvrq kind= uid=2a5d6c20-93df-11e8-adf7-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvmijgvrq" level=info timestamp=2018-07-30T09:59:23.392852Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijgvrq\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijgvrq" level=info timestamp=2018-07-30T09:59:23.449425Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiks78g kind= uid=2a8b74cb-93df-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T09:59:23.449622Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiks78g kind= uid=2a8b74cb-93df-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-30T09:59:23.449705Z pos=vm.go:262 component=virt-controller service=http msg="vmi is nil" level=info timestamp=2018-07-30T09:59:54.004500Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi75dv5 kind= uid=3cbdde7e-93df-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T09:59:54.005246Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi75dv5 kind= uid=3cbdde7e-93df-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-30T09:59:54.005363Z pos=vm.go:262 component=virt-controller service=http msg="vmi is nil" level=info timestamp=2018-07-30T10:00:24.641072Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=4efaafd6-93df-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T10:00:24.641355Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=4efaafd6-93df-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: true" level=info timestamp=2018-07-30T10:00:24.641594Z pos=vm.go:377 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=4efaafd6-93df-11e8-adf7-525500d15501 msg="Setting stabile UUID 'c7c94c30-28e5-57dc-b0f4-b10dcb42b9ba' (was '')" Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T09:54:56.886239Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:54:40.224284Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.276417Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.276662Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.280746Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmivwhw7" level=info timestamp=2018-07-30T09:54:53.303833Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.304093Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.312377Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmizzfp2" level=info timestamp=2018-07-30T09:54:53.442892Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.473616Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.475693Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.476136Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.476707Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.511432Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.511625Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.517529Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." • Failure [30.745 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 should not update the VirtualMachineInstance spec if Running [It] /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:346 Expected error: <*errors.StatusError | 0xc4208203f0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:58:29 http: TLS handshake error from 10.244.1.1:48420: EOF 2018/07/30 09:58:39 http: TLS handshake error from 10.244.1.1:48426: EOF 2018/07/30 09:58:49 http: TLS handshake error from 10.244.1.1:48432: EOF 2018/07/30 09:58:59 http: TLS handshake error from 10.244.1.1:48438: EOF 2018/07/30 09:59:09 http: TLS handshake error from 10.244.1.1:48444: EOF 2018/07/30 09:59:19 http: TLS handshake error from 10.244.1.1:48450: EOF 2018/07/30 09:59:29 http: TLS handshake error from 10.244.1.1:48456: EOF 2018/07/30 09:59:39 http: TLS handshake error from 10.244.1.1:48462: EOF 2018/07/30 09:59:49 http: TLS handshake error from 10.244.1.1:48468: EOF 2018/07/30 09:59:59 http: TLS handshake error from 10.244.1.1:48474: EOF 2018/07/30 10:00:09 http: TLS handshake error from 10.244.1.1:48480: EOF 2018/07/30 10:00:19 http: TLS handshake error from 10.244.1.1:48486: EOF 2018/07/30 10:00:29 http: TLS handshake error from 10.244.1.1:48492: EOF 2018/07/30 10:00:39 http: TLS handshake error from 10.244.1.1:48498: EOF 2018/07/30 10:00:49 http: TLS handshake error from 10.244.1.1:48504: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:00:54.652425Z pos=vm.go:287 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=4efaafd6-93df-11e8-adf7-525500d15501 msg="Failed to create VirtualMachineInstance: /" level=error timestamp=2018-07-30T10:00:54.653081Z pos=vm.go:197 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=4efaafd6-93df-11e8-adf7-525500d15501 msg="Creating the VirtualMachine failed." level=info timestamp=2018-07-30T10:00:54.653436Z pos=vm.go:681 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=4efaafd6-93df-11e8-adf7-525500d15501 msg="Processing failure status:: shouldRun: true; noErr: true; noVm: false" level=info timestamp=2018-07-30T10:00:54.653564Z pos=vm.go:692 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=4efaafd6-93df-11e8-adf7-525500d15501 msg="Reason to fail: FailedCreate" level=error timestamp=2018-07-30T10:00:54.667961Z pos=vm.go:202 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=4efaafd6-93df-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvminmqq7\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvminmqq7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4efaafd6-93df-11e8-adf7-525500d15501, UID in object meta: " msg="Updating the VirtualMachine status failed." level=info timestamp=2018-07-30T10:00:54.668314Z pos=vm.go:111 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvminmqq7\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvminmqq7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4efaafd6-93df-11e8-adf7-525500d15501, UID in object meta: " msg="re-enqueuing VirtualMachine kubevirt-test-default/testvminmqq7" level=info timestamp=2018-07-30T10:00:54.713641Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=60e8f004-93df-11e8-adf7-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=error timestamp=2018-07-30T10:00:54.714125Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=60e8f004-93df-11e8-adf7-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvminmqq7" level=info timestamp=2018-07-30T10:00:54.714323Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=60e8f004-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:00:54.714512Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=60e8f004-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:00:54.909769Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvminmqq7\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvminmqq7" level=info timestamp=2018-07-30T10:00:55.022568Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvminmqq7\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvminmqq7" level=info timestamp=2018-07-30T10:00:55.145199Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqtdb kind= uid=6133b554-93df-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T10:00:55.145415Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqtdb kind= uid=6133b554-93df-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-30T10:00:55.145572Z pos=vm.go:262 component=virt-controller service=http msg="vmi is nil" Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T09:54:56.886239Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:54:40.224284Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.276417Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.276662Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.280746Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmivwhw7" level=info timestamp=2018-07-30T09:54:53.303833Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.304093Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.312377Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmizzfp2" level=info timestamp=2018-07-30T09:54:53.442892Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.473616Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.475693Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.476136Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.476707Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.511432Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.511625Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.517529Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvminmqq7-h8m2n Pod phase: Pending • Failure [30.306 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 should survive guest shutdown, multiple times [It] /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:387 Expected error: <*errors.StatusError | 0xc420aa2a20>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 ------------------------------ STEP: Creating new VMI, not running Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:58:59 http: TLS handshake error from 10.244.1.1:48438: EOF 2018/07/30 09:59:09 http: TLS handshake error from 10.244.1.1:48444: EOF 2018/07/30 09:59:19 http: TLS handshake error from 10.244.1.1:48450: EOF 2018/07/30 09:59:29 http: TLS handshake error from 10.244.1.1:48456: EOF 2018/07/30 09:59:39 http: TLS handshake error from 10.244.1.1:48462: EOF 2018/07/30 09:59:49 http: TLS handshake error from 10.244.1.1:48468: EOF 2018/07/30 09:59:59 http: TLS handshake error from 10.244.1.1:48474: EOF 2018/07/30 10:00:09 http: TLS handshake error from 10.244.1.1:48480: EOF 2018/07/30 10:00:19 http: TLS handshake error from 10.244.1.1:48486: EOF 2018/07/30 10:00:29 http: TLS handshake error from 10.244.1.1:48492: EOF 2018/07/30 10:00:39 http: TLS handshake error from 10.244.1.1:48498: EOF 2018/07/30 10:00:49 http: TLS handshake error from 10.244.1.1:48504: EOF 2018/07/30 10:00:59 http: TLS handshake error from 10.244.1.1:48510: EOF 2018/07/30 10:01:09 http: TLS handshake error from 10.244.1.1:48516: EOF 2018/07/30 10:01:19 http: TLS handshake error from 10.244.1.1:48522: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:00:54.653564Z pos=vm.go:692 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=4efaafd6-93df-11e8-adf7-525500d15501 msg="Reason to fail: FailedCreate" level=error timestamp=2018-07-30T10:00:54.667961Z pos=vm.go:202 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=4efaafd6-93df-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvminmqq7\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvminmqq7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4efaafd6-93df-11e8-adf7-525500d15501, UID in object meta: " msg="Updating the VirtualMachine status failed." level=info timestamp=2018-07-30T10:00:54.668314Z pos=vm.go:111 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvminmqq7\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvminmqq7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4efaafd6-93df-11e8-adf7-525500d15501, UID in object meta: " msg="re-enqueuing VirtualMachine kubevirt-test-default/testvminmqq7" level=info timestamp=2018-07-30T10:00:54.713641Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=60e8f004-93df-11e8-adf7-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=error timestamp=2018-07-30T10:00:54.714125Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=60e8f004-93df-11e8-adf7-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvminmqq7" level=info timestamp=2018-07-30T10:00:54.714323Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=60e8f004-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:00:54.714512Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=60e8f004-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:00:54.909769Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvminmqq7\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvminmqq7" level=info timestamp=2018-07-30T10:00:55.022568Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvminmqq7\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvminmqq7" level=info timestamp=2018-07-30T10:00:55.145199Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqtdb kind= uid=6133b554-93df-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T10:00:55.145415Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqtdb kind= uid=6133b554-93df-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-30T10:00:55.145572Z pos=vm.go:262 component=virt-controller service=http msg="vmi is nil" level=info timestamp=2018-07-30T10:01:25.712758Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim7qh7 kind= uid=7368b29d-93df-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T10:01:25.713522Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim7qh7 kind= uid=7368b29d-93df-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-30T10:01:25.713638Z pos=vm.go:262 component=virt-controller service=http msg="vmi is nil" Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T09:54:56.886239Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:54:40.224284Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.276417Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.276662Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.280746Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmivwhw7" level=info timestamp=2018-07-30T09:54:53.303833Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.304093Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.312377Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmizzfp2" level=info timestamp=2018-07-30T09:54:53.442892Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.473616Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.475693Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.476136Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.476707Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.511432Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.511625Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.517529Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." • Failure [30.752 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 Using virtctl interface /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:435 should start a VirtualMachineInstance once [It] /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:436 Expected error: <*errors.StatusError | 0xc420aa2b40>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 ------------------------------ STEP: getting an VMI Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:59:29 http: TLS handshake error from 10.244.1.1:48456: EOF 2018/07/30 09:59:39 http: TLS handshake error from 10.244.1.1:48462: EOF 2018/07/30 09:59:49 http: TLS handshake error from 10.244.1.1:48468: EOF 2018/07/30 09:59:59 http: TLS handshake error from 10.244.1.1:48474: EOF 2018/07/30 10:00:09 http: TLS handshake error from 10.244.1.1:48480: EOF 2018/07/30 10:00:19 http: TLS handshake error from 10.244.1.1:48486: EOF 2018/07/30 10:00:29 http: TLS handshake error from 10.244.1.1:48492: EOF 2018/07/30 10:00:39 http: TLS handshake error from 10.244.1.1:48498: EOF 2018/07/30 10:00:49 http: TLS handshake error from 10.244.1.1:48504: EOF 2018/07/30 10:00:59 http: TLS handshake error from 10.244.1.1:48510: EOF 2018/07/30 10:01:09 http: TLS handshake error from 10.244.1.1:48516: EOF 2018/07/30 10:01:19 http: TLS handshake error from 10.244.1.1:48522: EOF 2018/07/30 10:01:29 http: TLS handshake error from 10.244.1.1:48528: EOF 2018/07/30 10:01:39 http: TLS handshake error from 10.244.1.1:48534: EOF 2018/07/30 10:01:49 http: TLS handshake error from 10.244.1.1:48540: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:00:54.713641Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=60e8f004-93df-11e8-adf7-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=error timestamp=2018-07-30T10:00:54.714125Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=60e8f004-93df-11e8-adf7-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvminmqq7" level=info timestamp=2018-07-30T10:00:54.714323Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=60e8f004-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:00:54.714512Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvminmqq7 kind= uid=60e8f004-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:00:54.909769Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvminmqq7\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvminmqq7" level=info timestamp=2018-07-30T10:00:55.022568Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvminmqq7\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvminmqq7" level=info timestamp=2018-07-30T10:00:55.145199Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqtdb kind= uid=6133b554-93df-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T10:00:55.145415Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqtdb kind= uid=6133b554-93df-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-30T10:00:55.145572Z pos=vm.go:262 component=virt-controller service=http msg="vmi is nil" level=info timestamp=2018-07-30T10:01:25.712758Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim7qh7 kind= uid=7368b29d-93df-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T10:01:25.713522Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim7qh7 kind= uid=7368b29d-93df-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-30T10:01:25.713638Z pos=vm.go:262 component=virt-controller service=http msg="vmi is nil" level=info timestamp=2018-07-30T10:01:56.324720Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=85a7cc7f-93df-11e8-adf7-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-30T10:01:56.325092Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=85a7cc7f-93df-11e8-adf7-525500d15501 msg="Creating or the VirtualMachineInstance: true" level=info timestamp=2018-07-30T10:01:56.325335Z pos=vm.go:377 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=85a7cc7f-93df-11e8-adf7-525500d15501 msg="Setting stabile UUID '9a6ae0cf-1a5b-5d75-8c7e-67eb7937452c' (was '')" Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T09:54:56.886239Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:54:40.224284Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.276417Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.276662Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.280746Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmivwhw7" level=info timestamp=2018-07-30T09:54:53.303833Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.304093Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.312377Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmizzfp2" level=info timestamp=2018-07-30T09:54:53.442892Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.473616Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.475693Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.476136Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.476707Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.511432Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.511625Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.517529Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." • Failure [30.515 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 Using virtctl interface /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:435 should stop a VirtualMachineInstance once [It] /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:467 Expected error: <*errors.StatusError | 0xc420aa3dd0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 ------------------------------ STEP: getting an VMI Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 09:59:59 http: TLS handshake error from 10.244.1.1:48474: EOF 2018/07/30 10:00:09 http: TLS handshake error from 10.244.1.1:48480: EOF 2018/07/30 10:00:19 http: TLS handshake error from 10.244.1.1:48486: EOF 2018/07/30 10:00:29 http: TLS handshake error from 10.244.1.1:48492: EOF 2018/07/30 10:00:39 http: TLS handshake error from 10.244.1.1:48498: EOF 2018/07/30 10:00:49 http: TLS handshake error from 10.244.1.1:48504: EOF 2018/07/30 10:00:59 http: TLS handshake error from 10.244.1.1:48510: EOF 2018/07/30 10:01:09 http: TLS handshake error from 10.244.1.1:48516: EOF 2018/07/30 10:01:19 http: TLS handshake error from 10.244.1.1:48522: EOF 2018/07/30 10:01:29 http: TLS handshake error from 10.244.1.1:48528: EOF 2018/07/30 10:01:39 http: TLS handshake error from 10.244.1.1:48534: EOF 2018/07/30 10:01:49 http: TLS handshake error from 10.244.1.1:48540: EOF 2018/07/30 10:01:59 http: TLS handshake error from 10.244.1.1:48546: EOF 2018/07/30 10:02:09 http: TLS handshake error from 10.244.1.1:48552: EOF 2018/07/30 10:02:19 http: TLS handshake error from 10.244.1.1:48558: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:02:26.335618Z pos=vm.go:287 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=85a7cc7f-93df-11e8-adf7-525500d15501 msg="Failed to create VirtualMachineInstance: /" level=error timestamp=2018-07-30T10:02:26.336130Z pos=vm.go:197 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=85a7cc7f-93df-11e8-adf7-525500d15501 msg="Creating the VirtualMachine failed." level=info timestamp=2018-07-30T10:02:26.336384Z pos=vm.go:681 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=85a7cc7f-93df-11e8-adf7-525500d15501 msg="Processing failure status:: shouldRun: true; noErr: true; noVm: false" level=info timestamp=2018-07-30T10:02:26.336503Z pos=vm.go:692 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=85a7cc7f-93df-11e8-adf7-525500d15501 msg="Reason to fail: FailedCreate" level=error timestamp=2018-07-30T10:02:26.361354Z pos=vm.go:202 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=85a7cc7f-93df-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvmirx2hl\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvmirx2hl, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 85a7cc7f-93df-11e8-adf7-525500d15501, UID in object meta: " msg="Updating the VirtualMachine status failed." level=info timestamp=2018-07-30T10:02:26.361597Z pos=vm.go:111 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvmirx2hl\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvmirx2hl, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 85a7cc7f-93df-11e8-adf7-525500d15501, UID in object meta: " msg="re-enqueuing VirtualMachine kubevirt-test-default/testvmirx2hl" level=info timestamp=2018-07-30T10:02:26.379993Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=978ea1fe-93df-11e8-adf7-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=error timestamp=2018-07-30T10:02:26.380374Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=978ea1fe-93df-11e8-adf7-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvmirx2hl" level=info timestamp=2018-07-30T10:02:26.380541Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=978ea1fe-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:02:26.380775Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=978ea1fe-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:02:26.513326Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirx2hl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirx2hl" level=info timestamp=2018-07-30T10:02:26.673768Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirx2hl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirx2hl" level=info timestamp=2018-07-30T10:02:26.810384Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirdrcm kind= uid=97d69490-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:02:26.810756Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirdrcm kind= uid=97d69490-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:02:26.883660Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirdrcm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirdrcm" Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T09:54:56.886239Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:54:40.224284Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.276417Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.276662Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.280746Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmivwhw7" level=info timestamp=2018-07-30T09:54:53.303833Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.304093Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.312377Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmizzfp2" level=info timestamp=2018-07-30T09:54:53.442892Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.473616Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.475693Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.476136Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.476707Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.511432Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.511625Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.517529Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmirdrcm-grp8m Pod phase: Pending Pod name: virt-launcher-testvmirx2hl-lfk4v Pod phase: Pending • Failure [30.489 seconds] VMIDefaults /root/go/src/kubevirt.io/kubevirt/tests/vmidefaults_test.go:33 Disk defaults /root/go/src/kubevirt.io/kubevirt/tests/vmidefaults_test.go:66 Should be applied to VMIs [It] /root/go/src/kubevirt.io/kubevirt/tests/vmidefaults_test.go:68 Expected error: <*errors.StatusError | 0xc420976e10>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmidefaults_test.go:71 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:00:29 http: TLS handshake error from 10.244.1.1:48492: EOF 2018/07/30 10:00:39 http: TLS handshake error from 10.244.1.1:48498: EOF 2018/07/30 10:00:49 http: TLS handshake error from 10.244.1.1:48504: EOF 2018/07/30 10:00:59 http: TLS handshake error from 10.244.1.1:48510: EOF 2018/07/30 10:01:09 http: TLS handshake error from 10.244.1.1:48516: EOF 2018/07/30 10:01:19 http: TLS handshake error from 10.244.1.1:48522: EOF 2018/07/30 10:01:29 http: TLS handshake error from 10.244.1.1:48528: EOF 2018/07/30 10:01:39 http: TLS handshake error from 10.244.1.1:48534: EOF 2018/07/30 10:01:49 http: TLS handshake error from 10.244.1.1:48540: EOF 2018/07/30 10:01:59 http: TLS handshake error from 10.244.1.1:48546: EOF 2018/07/30 10:02:09 http: TLS handshake error from 10.244.1.1:48552: EOF 2018/07/30 10:02:19 http: TLS handshake error from 10.244.1.1:48558: EOF 2018/07/30 10:02:29 http: TLS handshake error from 10.244.1.1:48568: EOF 2018/07/30 10:02:39 http: TLS handshake error from 10.244.1.1:48576: EOF 2018/07/30 10:02:49 http: TLS handshake error from 10.244.1.1:48582: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:02:26.336503Z pos=vm.go:692 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=85a7cc7f-93df-11e8-adf7-525500d15501 msg="Reason to fail: FailedCreate" level=error timestamp=2018-07-30T10:02:26.361354Z pos=vm.go:202 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=85a7cc7f-93df-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvmirx2hl\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvmirx2hl, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 85a7cc7f-93df-11e8-adf7-525500d15501, UID in object meta: " msg="Updating the VirtualMachine status failed." level=info timestamp=2018-07-30T10:02:26.361597Z pos=vm.go:111 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachines.kubevirt.io \"testvmirx2hl\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachines/kubevirt-test-default/testvmirx2hl, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 85a7cc7f-93df-11e8-adf7-525500d15501, UID in object meta: " msg="re-enqueuing VirtualMachine kubevirt-test-default/testvmirx2hl" level=info timestamp=2018-07-30T10:02:26.379993Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=978ea1fe-93df-11e8-adf7-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=error timestamp=2018-07-30T10:02:26.380374Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=978ea1fe-93df-11e8-adf7-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvmirx2hl" level=info timestamp=2018-07-30T10:02:26.380541Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=978ea1fe-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:02:26.380775Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=978ea1fe-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:02:26.513326Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirx2hl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirx2hl" level=info timestamp=2018-07-30T10:02:26.673768Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirx2hl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirx2hl" level=info timestamp=2018-07-30T10:02:26.810384Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirdrcm kind= uid=97d69490-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:02:26.810756Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirdrcm kind= uid=97d69490-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:02:26.883660Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirdrcm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirdrcm" level=info timestamp=2018-07-30T10:02:57.598207Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8f2br kind= uid=aa26a269-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:02:57.604485Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8f2br kind= uid=aa26a269-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:02:57.793600Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi8f2br\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi8f2br" Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T09:54:56.886239Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:54:40.224284Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.276417Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.276662Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.280746Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmivwhw7" level=info timestamp=2018-07-30T09:54:53.303833Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.304093Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.312377Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmizzfp2" level=info timestamp=2018-07-30T09:54:53.442892Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.473616Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.475693Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.476136Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.476707Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.511432Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.511625Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.517529Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi8f2br-twbc7 Pod phase: Pending • Failure [30.913 seconds] Console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:37 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:65 with a serial console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:66 with a cirros image /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:67 should return that we are running cirros [It] /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:68 Expected success, but got an error: <*errors.StatusError | 0xc420aa2240>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:51 ------------------------------ STEP: Creating a new VirtualMachineInstance Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:01:59 http: TLS handshake error from 10.244.1.1:48546: EOF 2018/07/30 10:02:09 http: TLS handshake error from 10.244.1.1:48552: EOF 2018/07/30 10:02:19 http: TLS handshake error from 10.244.1.1:48558: EOF 2018/07/30 10:02:29 http: TLS handshake error from 10.244.1.1:48568: EOF 2018/07/30 10:02:39 http: TLS handshake error from 10.244.1.1:48576: EOF 2018/07/30 10:02:49 http: TLS handshake error from 10.244.1.1:48582: EOF 2018/07/30 10:02:59 http: TLS handshake error from 10.244.1.1:48588: EOF 2018/07/30 10:03:09 http: TLS handshake error from 10.244.1.1:48594: EOF level=info timestamp=2018-07-30T10:03:10.048720Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-30T10:03:10.085927Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-30T10:03:17.688686Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-30T10:03:17.691866Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/30 10:03:19 http: TLS handshake error from 10.244.1.1:48600: EOF level=info timestamp=2018-07-30T10:03:25.631820Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-30T10:03:25.697762Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:02:26.379993Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=978ea1fe-93df-11e8-adf7-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=error timestamp=2018-07-30T10:02:26.380374Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=978ea1fe-93df-11e8-adf7-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvmirx2hl" level=info timestamp=2018-07-30T10:02:26.380541Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=978ea1fe-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:02:26.380775Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirx2hl kind= uid=978ea1fe-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:02:26.513326Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirx2hl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirx2hl" level=info timestamp=2018-07-30T10:02:26.673768Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirx2hl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirx2hl" level=info timestamp=2018-07-30T10:02:26.810384Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirdrcm kind= uid=97d69490-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:02:26.810756Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirdrcm kind= uid=97d69490-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:02:26.883660Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirdrcm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirdrcm" level=info timestamp=2018-07-30T10:02:57.598207Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8f2br kind= uid=aa26a269-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:02:57.604485Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8f2br kind= uid=aa26a269-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:02:57.793600Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi8f2br\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi8f2br" level=info timestamp=2018-07-30T10:03:28.360592Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi984kj kind= uid=bc7fd6db-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:03:28.362217Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi984kj kind= uid=bc7fd6db-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:03:28.492259Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi984kj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi984kj" Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T09:54:56.886239Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:54:40.224284Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.276417Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.276662Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.280746Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmivwhw7" level=info timestamp=2018-07-30T09:54:53.303833Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.304093Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.312377Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmizzfp2" level=info timestamp=2018-07-30T09:54:53.442892Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.473616Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.475693Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.476136Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.476707Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.511432Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.511625Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.517529Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi984kj-tjn5x Pod phase: Pending • Failure [30.726 seconds] Console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:37 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:65 with a serial console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:66 with a fedora image /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:77 should return that we are running fedora [It] /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:78 Expected success, but got an error: <*errors.StatusError | 0xc420aa2fc0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:51 ------------------------------ STEP: Creating a new VirtualMachineInstance Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:02:59 http: TLS handshake error from 10.244.1.1:48588: EOF 2018/07/30 10:03:09 http: TLS handshake error from 10.244.1.1:48594: EOF level=info timestamp=2018-07-30T10:03:10.048720Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-30T10:03:10.085927Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-30T10:03:17.688686Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-30T10:03:17.691866Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/30 10:03:19 http: TLS handshake error from 10.244.1.1:48600: EOF level=info timestamp=2018-07-30T10:03:25.631820Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-30T10:03:25.697762Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/30 10:03:29 http: TLS handshake error from 10.244.1.1:48606: EOF 2018/07/30 10:03:39 http: TLS handshake error from 10.244.1.1:48612: EOF level=info timestamp=2018-07-30T10:03:39.953315Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/30 10:03:49 http: TLS handshake error from 10.244.1.1:48618: EOF level=info timestamp=2018-07-30T10:03:55.836588Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-30T10:03:55.876891Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:02:26.513326Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirx2hl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirx2hl" level=info timestamp=2018-07-30T10:02:26.673768Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirx2hl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirx2hl" level=info timestamp=2018-07-30T10:02:26.810384Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirdrcm kind= uid=97d69490-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:02:26.810756Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirdrcm kind= uid=97d69490-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:02:26.883660Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirdrcm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirdrcm" level=info timestamp=2018-07-30T10:02:57.598207Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8f2br kind= uid=aa26a269-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:02:57.604485Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8f2br kind= uid=aa26a269-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:02:57.793600Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi8f2br\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi8f2br" level=info timestamp=2018-07-30T10:03:28.360592Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi984kj kind= uid=bc7fd6db-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:03:28.362217Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi984kj kind= uid=bc7fd6db-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:03:28.492259Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi984kj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi984kj" level=info timestamp=2018-07-30T10:03:28.784589Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi984kj\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi984kj, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bc7fd6db-93df-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi984kj" level=info timestamp=2018-07-30T10:03:59.175674Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7s2rk kind= uid=cee081d5-93df-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:03:59.176077Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7s2rk kind= uid=cee081d5-93df-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:03:59.385652Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7s2rk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7s2rk" Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T09:54:56.886239Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-9pz9z Pod phase: Running level=error timestamp=2018-07-30T09:45:23.449252Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T09:45:23.449812Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilpzgk\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilpzgk" level=info timestamp=2018-07-30T09:45:23.452630Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.458346Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:23.490525Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T09:45:23.558289Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.559814Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-30T09:45:56.561686Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.627750Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.628458Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T09:45:56.628685Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.815088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.821841Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind= uid=3d2f4431-93dd-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:45:56.942517Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T09:45:56.945340Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilpzgk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T09:54:40.224284Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.276417Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.276662Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.280746Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmivwhw7" level=info timestamp=2018-07-30T09:54:53.303833Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T09:54:53.304093Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.312377Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmizzfp2" level=info timestamp=2018-07-30T09:54:53.442892Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind= uid=648e257a-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.473616Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind= uid=76c72517-93de-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.475693Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.476136Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.476707Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmivwhw7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T09:54:53.511432Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T09:54:53.511625Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T09:54:53.517529Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmizzfp2 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi7s2rk-6znx6 Pod phase: Pending • Failure [30.839 seconds] Console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:37 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:65 with a serial console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:66 should be able to reconnect to console multiple times [It] /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:87 Expected success, but got an error: <*errors.StatusError | 0xc420bf4240>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:91 ------------------------------ STEP: Creating a new VirtualMachineInstance • [SLOW TEST:35.275 seconds] Console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:37 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:65 with a serial console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:66 should wait until the virtual machine is in running state and return a stream interface /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:103 ------------------------------ • [SLOW TEST:30.375 seconds] Console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:37 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:65 with a serial console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:66 should fail waiting for the virtual machine instance to be running /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:111 ------------------------------ • [SLOW TEST:30.491 seconds] Console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:37 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:65 with a serial console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:66 should fail waiting for the expecter /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:134 ------------------------------ • ------------------------------ • [SLOW TEST:7.342 seconds] VirtualMachineInstanceReplicaSet /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:46 should scale /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 to five, to six and then to zero replicas /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ •• ------------------------------ • [SLOW TEST:18.607 seconds] VirtualMachineInstanceReplicaSet /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:46 should update readyReplicas once VMIs are up /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:157 ------------------------------ •• ------------------------------ • [SLOW TEST:7.632 seconds] VirtualMachineInstanceReplicaSet /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:46 should not scale when paused and scale when resume /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:223 ------------------------------ • [SLOW TEST:5.861 seconds] VirtualMachineInstanceReplicaSet /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:46 should remove the finished VM /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:279 ------------------------------ 2018/07/30 06:07:22 read closing down: EOF 2018/07/30 06:07:32 read closing down: EOF 2018/07/30 06:07:43 read closing down: EOF 2018/07/30 06:07:54 read closing down: EOF 2018/07/30 06:07:55 read closing down: EOF 2018/07/30 06:07:56 read closing down: EOF 2018/07/30 06:07:57 read closing down: EOF • [SLOW TEST:87.761 seconds] Networking 2018/07/30 06:07:57 read closing down: EOF /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be able to reach /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 the Inbound VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ 2018/07/30 06:07:59 read closing down: EOF 2018/07/30 06:08:00 read closing down: EOF 2018/07/30 06:08:00 read closing down: EOF •2018/07/30 06:08:02 read closing down: EOF 2018/07/30 06:08:02 read closing down: EOF •2018/07/30 06:08:02 read closing down: EOF 2018/07/30 06:08:04 read closing down: EOF •2018/07/30 06:08:05 read closing down: EOF 2018/07/30 06:08:05 read closing down: EOF ------------------------------ • [SLOW TEST:5.958 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be reachable via the propagated IP from a Pod /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 on the same node from Pod /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:5.296 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be reachable via the propagated IP from a Pod /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 on a different node from Pod /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ •• ------------------------------ • [SLOW TEST:5.487 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 with a service matching the vmi exposed /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:287 should be able to reach the vmi based on labels specified on the vmi /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:307 ------------------------------ ••2018/07/30 06:09:11 read closing down: EOF 2018/07/30 06:09:11 read closing down: EOF ------------------------------ • [SLOW TEST:35.096 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 VirtualMachineInstance with custom interface model /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:383 should expose the right device type to the guest /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:384 ------------------------------ 2018/07/30 06:09:12 read closing down: EOF •2018/07/30 06:09:12 read closing down: EOF 2018/07/30 06:12:31 read closing down: EOF Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:10:20 http: TLS handshake error from 10.244.1.1:37424: EOF 2018/07/30 10:10:30 http: TLS handshake error from 10.244.1.1:37430: EOF 2018/07/30 10:10:40 http: TLS handshake error from 10.244.1.1:37436: EOF 2018/07/30 10:10:50 http: TLS handshake error from 10.244.1.1:37442: EOF 2018/07/30 10:11:00 http: TLS handshake error from 10.244.1.1:37448: EOF 2018/07/30 10:11:10 http: TLS handshake error from 10.244.1.1:37454: EOF 2018/07/30 10:11:20 http: TLS handshake error from 10.244.1.1:37460: EOF 2018/07/30 10:11:30 http: TLS handshake error from 10.244.1.1:37466: EOF 2018/07/30 10:11:40 http: TLS handshake error from 10.244.1.1:37472: EOF 2018/07/30 10:11:50 http: TLS handshake error from 10.244.1.1:37478: EOF 2018/07/30 10:12:00 http: TLS handshake error from 10.244.1.1:37484: EOF 2018/07/30 10:12:10 http: TLS handshake error from 10.244.1.1:37490: EOF 2018/07/30 10:12:20 http: TLS handshake error from 10.244.1.1:37496: EOF 2018/07/30 10:12:30 http: TLS handshake error from 10.244.1.1:37502: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T09:54:56.886239Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 level=info timestamp=2018-07-30T10:09:52.329886Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer kubeVirtNodeInformer" level=info timestamp=2018-07-30T10:09:52.332567Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmiPresetInformer" level=info timestamp=2018-07-30T10:09:52.332641Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmirsInformer" level=info timestamp=2018-07-30T10:09:52.332688Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer configMapInformer" level=info timestamp=2018-07-30T10:09:52.332732Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmInformer" level=info timestamp=2018-07-30T10:09:52.332762Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer limitrangeInformer" level=info timestamp=2018-07-30T10:09:52.332803Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmiInformer" level=info timestamp=2018-07-30T10:09:52.332845Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer kubeVirtPodInformer" level=info timestamp=2018-07-30T10:09:52.338367Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-07-30T10:09:52.368677Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-07-30T10:09:52.369073Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-07-30T10:09:52.369847Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-07-30T10:09:52.374700Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.335421Z pos=vm.go:688 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=Domain uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Domain is in state Running reason Unknown" level=info timestamp=2018-07-30T10:06:49.335670Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.353334Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:06:49.398542Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T10:06:49.432249Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.456217Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:06:49.505854Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.837209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.837421Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=error timestamp=2018-07-30T10:06:49.962461Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi24vzl\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T10:06:49.962601Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi24vzl\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi24vzl" level=info timestamp=2018-07-30T10:06:49.962735Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:06:49.985224Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.985389Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:10:10.175323Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid=3a6f112b-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T10:10:10.176222Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid=859b229f-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T10:10:10.210924Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid=859b229f-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:10:10.211286Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid=9b2e8d18-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T10:10:10.218825Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid=3a6f112b-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:10:10.218996Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind= uid=859b229f-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T10:10:10.219081Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind= uid=859b229f-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:10:10.219164Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind= uid=3a6f112b-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T10:10:10.219259Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind= uid=3a6f112b-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:10:10.232036Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid=9b2e8d18-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:10:10.232755Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid=3a66fa38-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:10:10.234012Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind= uid=3a66fa38-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T10:10:10.234101Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind= uid=3a66fa38-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:10:10.234170Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind= uid=9b2e8d18-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T10:10:10.234244Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind= uid=9b2e8d18-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." Pod name: netcat2rpz2 Pod phase: Succeeded ++ head -n 1 +++ nc my-subdomain.myvmi.kubevirt-test-default 1500 -i 1 -w 1 Hello World! succeeded + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Pod name: netcatbbrsz Pod phase: Failed ++ head -n 1 +++ nc wrongservice.kubevirt-test-default 1500 -i 1 -w 1 Ncat: Could not resolve hostname "wrongservice.kubevirt-test-default": Name or service not known. QUITTING. failed + x= + echo '' + '[' '' = 'Hello World!' ']' + echo failed + exit 1 Pod name: netcatbxvtg Pod phase: Succeeded ++ head -n 1 +++ nc myservice.kubevirt-test-default 1500 -i 1 -w 1 + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Hello World! succeeded Pod name: netcatflprt Pod phase: Succeeded ++ head -n 1 +++ nc 10.244.0.51 1500 -i 1 -w 1 + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Hello World! succeeded Pod name: netcatr69pw Pod phase: Succeeded ++ head -n 1 +++ nc 10.244.0.51 1500 -i 1 -w 1 Hello World! succeeded + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Pod name: netcatsmmqn Pod phase: Succeeded ++ head -n 1 +++ nc 10.244.0.51 1500 -i 1 -w 1 Hello World! succeeded + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Pod name: netcatvmdfx Pod phase: Succeeded ++ head -n 1 +++ nc 10.244.0.51 1500 -i 1 -w 1 Hello World! succeeded + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Pod name: virt-launcher-testvmi22lf4-fxbmt Pod phase: Running Pod name: virt-launcher-testvmi24vzl-djxvn Pod phase: Running Pod name: virt-launcher-testvmi8bp2k-fhlwp Pod phase: Pending Pod name: virt-launcher-testvmihwk9v-txm9r Pod phase: Failed Pod name: virt-launcher-testvmiqhthf-p9mnh Pod phase: Failed Pod name: virt-launcher-testvmitxj5x-jzqrh Pod phase: Failed ------------------------------ • Failure [200.789 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 VirtualMachineInstance with custom MAC address /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:417 should configure custom MAC address [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:418 Expected error: : 180000000000 expect: timer expired after 180 seconds not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:94 ------------------------------ STEP: checking eth0 MAC address level=info timestamp=2018-07-30T10:09:13.321115Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid=9b2e8d18-93e0-11e8-adf7-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi8bp2k-fhlwp" level=info timestamp=2018-07-30T10:09:29.512403Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid=9b2e8d18-93e0-11e8-adf7-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmi8bp2k-fhlwp" level=info timestamp=2018-07-30T10:09:30.852916Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid=9b2e8d18-93e0-11e8-adf7-525500d15501 msg="VirtualMachineInstance defined." level=info timestamp=2018-07-30T10:09:30.885051Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid=9b2e8d18-93e0-11e8-adf7-525500d15501 msg="VirtualMachineInstance started." level=info timestamp=2018-07-30T10:12:31.124857Z pos=utils.go:1256 component=tests namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid=9b2e8d18-93e0-11e8-adf7-525500d15501 msg="Login: [{2 \r\n\r\n\r\nISOLINUX 6.04 6.04-pre1 Copyright (C) 1994-2015 H. Peter Anvin et al\r\nboot: \u001b[?7h\r\n []}]" Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:10:40 http: TLS handshake error from 10.244.1.1:37436: EOF 2018/07/30 10:10:50 http: TLS handshake error from 10.244.1.1:37442: EOF 2018/07/30 10:11:00 http: TLS handshake error from 10.244.1.1:37448: EOF 2018/07/30 10:11:10 http: TLS handshake error from 10.244.1.1:37454: EOF 2018/07/30 10:11:20 http: TLS handshake error from 10.244.1.1:37460: EOF 2018/07/30 10:11:30 http: TLS handshake error from 10.244.1.1:37466: EOF 2018/07/30 10:11:40 http: TLS handshake error from 10.244.1.1:37472: EOF 2018/07/30 10:11:50 http: TLS handshake error from 10.244.1.1:37478: EOF 2018/07/30 10:12:00 http: TLS handshake error from 10.244.1.1:37484: EOF 2018/07/30 10:12:10 http: TLS handshake error from 10.244.1.1:37490: EOF 2018/07/30 10:12:20 http: TLS handshake error from 10.244.1.1:37496: EOF 2018/07/30 10:12:30 http: TLS handshake error from 10.244.1.1:37502: EOF 2018/07/30 10:12:40 http: TLS handshake error from 10.244.1.1:37508: EOF 2018/07/30 10:12:50 http: TLS handshake error from 10.244.1.1:37514: EOF 2018/07/30 10:13:00 http: TLS handshake error from 10.244.1.1:37520: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:09:52.332567Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmiPresetInformer" level=info timestamp=2018-07-30T10:09:52.332641Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmirsInformer" level=info timestamp=2018-07-30T10:09:52.332688Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer configMapInformer" level=info timestamp=2018-07-30T10:09:52.332732Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmInformer" level=info timestamp=2018-07-30T10:09:52.332762Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer limitrangeInformer" level=info timestamp=2018-07-30T10:09:52.332803Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmiInformer" level=info timestamp=2018-07-30T10:09:52.332845Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer kubeVirtPodInformer" level=info timestamp=2018-07-30T10:09:52.338367Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-07-30T10:09:52.368677Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-07-30T10:09:52.369073Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-07-30T10:09:52.369847Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-07-30T10:09:52.374700Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-07-30T10:13:02.918529Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:02.940778Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:03.173805Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9h86j\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9h86j" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.335421Z pos=vm.go:688 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=Domain uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Domain is in state Running reason Unknown" level=info timestamp=2018-07-30T10:06:49.335670Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.353334Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:06:49.398542Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T10:06:49.432249Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.456217Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:06:49.505854Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.837209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.837421Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=error timestamp=2018-07-30T10:06:49.962461Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi24vzl\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T10:06:49.962601Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi24vzl\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi24vzl" level=info timestamp=2018-07-30T10:06:49.962735Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:06:49.985224Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.985389Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:10:10.175323Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid=3a6f112b-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T10:10:10.176222Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid=859b229f-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T10:10:10.210924Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid=859b229f-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:10:10.211286Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid=9b2e8d18-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T10:10:10.218825Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid=3a6f112b-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:10:10.218996Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind= uid=859b229f-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T10:10:10.219081Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind= uid=859b229f-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:10:10.219164Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind= uid=3a6f112b-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T10:10:10.219259Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind= uid=3a6f112b-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:10:10.232036Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid=9b2e8d18-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:10:10.232755Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid=3a66fa38-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:10:10.234012Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind= uid=3a66fa38-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T10:10:10.234101Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind= uid=3a66fa38-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:10:10.234170Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind= uid=9b2e8d18-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T10:10:10.234244Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind= uid=9b2e8d18-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." Pod name: netcat2rpz2 Pod phase: Succeeded ++ head -n 1 +++ nc my-subdomain.myvmi.kubevirt-test-default 1500 -i 1 -w 1 Hello World! succeeded + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Pod name: netcatbbrsz Pod phase: Failed ++ head -n 1 +++ nc wrongservice.kubevirt-test-default 1500 -i 1 -w 1 Ncat: Could not resolve hostname "wrongservice.kubevirt-test-default": Name or service not known. QUITTING. failed + x= + echo '' + '[' '' = 'Hello World!' ']' + echo failed + exit 1 Pod name: netcatbxvtg Pod phase: Succeeded ++ head -n 1 +++ nc myservice.kubevirt-test-default 1500 -i 1 -w 1 + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Hello World! succeeded Pod name: netcatflprt Pod phase: Succeeded ++ head -n 1 +++ nc 10.244.0.51 1500 -i 1 -w 1 + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Hello World! succeeded Pod name: netcatr69pw Pod phase: Succeeded ++ head -n 1 +++ nc 10.244.0.51 1500 -i 1 -w 1 Hello World! succeeded + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Pod name: netcatsmmqn Pod phase: Succeeded ++ head -n 1 +++ nc 10.244.0.51 1500 -i 1 -w 1 Hello World! succeeded + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Pod name: netcatvmdfx Pod phase: Succeeded ++ head -n 1 +++ nc 10.244.0.51 1500 -i 1 -w 1 Hello World! succeeded + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Pod name: virt-launcher-testvmi22lf4-fxbmt Pod phase: Running Pod name: virt-launcher-testvmi24vzl-djxvn Pod phase: Running Pod name: virt-launcher-testvmi8bp2k-fhlwp Pod phase: Pending Pod name: virt-launcher-testvmi9h86j-sgl6d Pod phase: Pending Pod name: virt-launcher-testvmihwk9v-txm9r Pod phase: Failed Pod name: virt-launcher-testvmiqhthf-p9mnh Pod phase: Failed Pod name: virt-launcher-testvmitxj5x-jzqrh Pod phase: Failed • Failure [32.652 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 VirtualMachineInstance with custom MAC address in non-conventional format /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:429 should configure custom MAC address [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:430 Expected error: <*errors.StatusError | 0xc4208207e0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:435 ------------------------------ STEP: checking eth0 MAC address Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:11:10 http: TLS handshake error from 10.244.1.1:37454: EOF 2018/07/30 10:11:20 http: TLS handshake error from 10.244.1.1:37460: EOF 2018/07/30 10:11:30 http: TLS handshake error from 10.244.1.1:37466: EOF 2018/07/30 10:11:40 http: TLS handshake error from 10.244.1.1:37472: EOF 2018/07/30 10:11:50 http: TLS handshake error from 10.244.1.1:37478: EOF 2018/07/30 10:12:00 http: TLS handshake error from 10.244.1.1:37484: EOF 2018/07/30 10:12:10 http: TLS handshake error from 10.244.1.1:37490: EOF 2018/07/30 10:12:20 http: TLS handshake error from 10.244.1.1:37496: EOF 2018/07/30 10:12:30 http: TLS handshake error from 10.244.1.1:37502: EOF 2018/07/30 10:12:40 http: TLS handshake error from 10.244.1.1:37508: EOF 2018/07/30 10:12:50 http: TLS handshake error from 10.244.1.1:37514: EOF 2018/07/30 10:13:00 http: TLS handshake error from 10.244.1.1:37520: EOF 2018/07/30 10:13:10 http: TLS handshake error from 10.244.1.1:37526: EOF 2018/07/30 10:13:20 http: TLS handshake error from 10.244.1.1:37532: EOF 2018/07/30 10:13:30 http: TLS handshake error from 10.244.1.1:37538: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:09:52.332732Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmInformer" level=info timestamp=2018-07-30T10:09:52.332762Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer limitrangeInformer" level=info timestamp=2018-07-30T10:09:52.332803Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmiInformer" level=info timestamp=2018-07-30T10:09:52.332845Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer kubeVirtPodInformer" level=info timestamp=2018-07-30T10:09:52.338367Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-07-30T10:09:52.368677Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-07-30T10:09:52.369073Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-07-30T10:09:52.369847Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-07-30T10:09:52.374700Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-07-30T10:13:02.918529Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:02.940778Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:03.173805Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9h86j\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9h86j" level=info timestamp=2018-07-30T10:13:35.669652Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:35.674033Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:35.763517Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicdkqc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicdkqc" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.335421Z pos=vm.go:688 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=Domain uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Domain is in state Running reason Unknown" level=info timestamp=2018-07-30T10:06:49.335670Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.353334Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:06:49.398542Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T10:06:49.432249Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.456217Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:06:49.505854Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.837209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.837421Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=error timestamp=2018-07-30T10:06:49.962461Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi24vzl\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T10:06:49.962601Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi24vzl\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi24vzl" level=info timestamp=2018-07-30T10:06:49.962735Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:06:49.985224Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.985389Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:10:10.234012Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind= uid=3a66fa38-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T10:10:10.234101Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind= uid=3a66fa38-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:10:10.234170Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind= uid=9b2e8d18-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T10:10:10.234244Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind= uid=9b2e8d18-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:13:21.447700Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:13:22.165542Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type ADDED" level=info timestamp=2018-07-30T10:13:22.167018Z pos=vm.go:657 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=Domain uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Domain is in state Paused reason StartingUp" level=info timestamp=2018-07-30T10:13:22.439308Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T10:13:22.440070Z pos=vm.go:688 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=Domain uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Domain is in state Running reason Unknown" level=info timestamp=2018-07-30T10:13:22.496964Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:13:22.497122Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T10:13:22.498898Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T10:13:22.558627Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:13:22.558753Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:13:22.567567Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." Pod name: netcat2rpz2 Pod phase: Succeeded ++ head -n 1 +++ nc my-subdomain.myvmi.kubevirt-test-default 1500 -i 1 -w 1 Hello World! succeeded + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Pod name: netcatbbrsz Pod phase: Failed ++ head -n 1 +++ nc wrongservice.kubevirt-test-default 1500 -i 1 -w 1 Ncat: Could not resolve hostname "wrongservice.kubevirt-test-default": Name or service not known. QUITTING. failed + x= + echo '' + '[' '' = 'Hello World!' ']' + echo failed + exit 1 Pod name: netcatbxvtg Pod phase: Succeeded ++ head -n 1 +++ nc myservice.kubevirt-test-default 1500 -i 1 -w 1 + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Hello World! succeeded Pod name: netcatflprt Pod phase: Succeeded ++ head -n 1 +++ nc 10.244.0.51 1500 -i 1 -w 1 + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Hello World! succeeded Pod name: netcatr69pw Pod phase: Succeeded ++ head -n 1 +++ nc 10.244.0.51 1500 -i 1 -w 1 Hello World! succeeded + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Pod name: netcatsmmqn Pod phase: Succeeded ++ head -n 1 +++ nc 10.244.0.51 1500 -i 1 -w 1 Hello World! succeeded + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Pod name: netcatvmdfx Pod phase: Succeeded ++ head -n 1 +++ nc 10.244.0.51 1500 -i 1 -w 1 Hello World! succeeded + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Pod name: virt-launcher-testvmi22lf4-fxbmt Pod phase: Running Pod name: virt-launcher-testvmi24vzl-djxvn Pod phase: Running Pod name: virt-launcher-testvmi8bp2k-fhlwp Pod phase: Pending Pod name: virt-launcher-testvmi9h86j-sgl6d Pod phase: Running Pod name: virt-launcher-testvmicdkqc-xdgqm Pod phase: Pending Pod name: virt-launcher-testvmihwk9v-txm9r Pod phase: Failed Pod name: virt-launcher-testvmiqhthf-p9mnh Pod phase: Failed Pod name: virt-launcher-testvmitxj5x-jzqrh Pod phase: Failed • Failure [32.896 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 VirtualMachineInstance with custom MAC address and slirp interface /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:442 should configure custom MAC address [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:443 Expected error: <*errors.StatusError | 0xc420bf41b0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:448 ------------------------------ STEP: checking eth0 MAC address Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:11:40 http: TLS handshake error from 10.244.1.1:37472: EOF 2018/07/30 10:11:50 http: TLS handshake error from 10.244.1.1:37478: EOF 2018/07/30 10:12:00 http: TLS handshake error from 10.244.1.1:37484: EOF 2018/07/30 10:12:10 http: TLS handshake error from 10.244.1.1:37490: EOF 2018/07/30 10:12:20 http: TLS handshake error from 10.244.1.1:37496: EOF 2018/07/30 10:12:30 http: TLS handshake error from 10.244.1.1:37502: EOF 2018/07/30 10:12:40 http: TLS handshake error from 10.244.1.1:37508: EOF 2018/07/30 10:12:50 http: TLS handshake error from 10.244.1.1:37514: EOF 2018/07/30 10:13:00 http: TLS handshake error from 10.244.1.1:37520: EOF 2018/07/30 10:13:10 http: TLS handshake error from 10.244.1.1:37526: EOF 2018/07/30 10:13:20 http: TLS handshake error from 10.244.1.1:37532: EOF 2018/07/30 10:13:30 http: TLS handshake error from 10.244.1.1:37538: EOF 2018/07/30 10:13:40 http: TLS handshake error from 10.244.1.1:37544: EOF 2018/07/30 10:13:50 http: TLS handshake error from 10.244.1.1:37550: EOF 2018/07/30 10:14:00 http: TLS handshake error from 10.244.1.1:37556: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:09:52.332845Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer kubeVirtPodInformer" level=info timestamp=2018-07-30T10:09:52.338367Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-07-30T10:09:52.368677Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-07-30T10:09:52.369073Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-07-30T10:09:52.369847Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-07-30T10:09:52.374700Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-07-30T10:13:02.918529Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:02.940778Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:03.173805Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9h86j\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9h86j" level=info timestamp=2018-07-30T10:13:35.669652Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:35.674033Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:35.763517Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicdkqc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicdkqc" level=info timestamp=2018-07-30T10:14:08.418701Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:14:08.419399Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:14:08.640539Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4v9jd\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4v9jd" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.335421Z pos=vm.go:688 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=Domain uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Domain is in state Running reason Unknown" level=info timestamp=2018-07-30T10:06:49.335670Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.353334Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:06:49.398542Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T10:06:49.432249Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.456217Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:06:49.505854Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.837209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.837421Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="No update processing required" level=error timestamp=2018-07-30T10:06:49.962461Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi24vzl\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-30T10:06:49.962601Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi24vzl\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi24vzl" level=info timestamp=2018-07-30T10:06:49.962735Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:06:49.985224Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:06:49.985389Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:13:22.498898Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T10:13:22.558627Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:13:22.558753Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:13:22.567567Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:13:51.106278Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:13:52.283360Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type ADDED" level=info timestamp=2018-07-30T10:13:52.283656Z pos=vm.go:657 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=Domain uid=26538483-93e1-11e8-adf7-525500d15501 msg="Domain is in state Paused reason StartingUp" level=info timestamp=2018-07-30T10:13:52.532484Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T10:13:52.532711Z pos=vm.go:688 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=Domain uid=26538483-93e1-11e8-adf7-525500d15501 msg="Domain is in state Running reason Unknown" level=info timestamp=2018-07-30T10:13:52.561477Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-30T10:13:52.566110Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:13:52.566221Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="No update processing required" level=info timestamp=2018-07-30T10:13:52.611766Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:13:52.611908Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-30T10:13:52.631647Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." Pod name: netcat2rpz2 Pod phase: Succeeded ++ head -n 1 +++ nc my-subdomain.myvmi.kubevirt-test-default 1500 -i 1 -w 1 Hello World! succeeded + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Pod name: netcatbbrsz Pod phase: Failed ++ head -n 1 +++ nc wrongservice.kubevirt-test-default 1500 -i 1 -w 1 Ncat: Could not resolve hostname "wrongservice.kubevirt-test-default": Name or service not known. QUITTING. failed + x= + echo '' + '[' '' = 'Hello World!' ']' + echo failed + exit 1 Pod name: netcatbxvtg Pod phase: Succeeded ++ head -n 1 +++ nc myservice.kubevirt-test-default 1500 -i 1 -w 1 + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Hello World! succeeded Pod name: netcatflprt Pod phase: Succeeded ++ head -n 1 +++ nc 10.244.0.51 1500 -i 1 -w 1 + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Hello World! succeeded Pod name: netcatr69pw Pod phase: Succeeded ++ head -n 1 +++ nc 10.244.0.51 1500 -i 1 -w 1 Hello World! succeeded + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Pod name: netcatsmmqn Pod phase: Succeeded ++ head -n 1 +++ nc 10.244.0.51 1500 -i 1 -w 1 Hello World! succeeded + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Pod name: netcatvmdfx Pod phase: Succeeded ++ head -n 1 +++ nc 10.244.0.51 1500 -i 1 -w 1 Hello World! succeeded + x='Hello World!' + echo 'Hello World!' + '[' 'Hello World!' = 'Hello World!' ']' + echo succeeded + exit 0 Pod name: virt-launcher-testvmi22lf4-fxbmt Pod phase: Running Pod name: virt-launcher-testvmi24vzl-djxvn Pod phase: Running Pod name: virt-launcher-testvmi4v9jd-fsxvs Pod phase: Pending Pod name: virt-launcher-testvmi8bp2k-fhlwp Pod phase: Pending Pod name: virt-launcher-testvmi9h86j-sgl6d Pod phase: Running Pod name: virt-launcher-testvmicdkqc-xdgqm Pod phase: Running Pod name: virt-launcher-testvmihwk9v-txm9r Pod phase: Failed Pod name: virt-launcher-testvmiqhthf-p9mnh Pod phase: Failed Pod name: virt-launcher-testvmitxj5x-jzqrh Pod phase: Failed • Failure [33.062 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 VirtualMachineInstance with disabled automatic attachment of interfaces /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:455 should not configure any external interfaces [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:456 Expected error: <*errors.StatusError | 0xc420976990>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:463 ------------------------------ STEP: checking loopback is the only guest interface • Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:12:20 http: TLS handshake error from 10.244.1.1:37496: EOF 2018/07/30 10:12:30 http: TLS handshake error from 10.244.1.1:37502: EOF 2018/07/30 10:12:40 http: TLS handshake error from 10.244.1.1:37508: EOF 2018/07/30 10:12:50 http: TLS handshake error from 10.244.1.1:37514: EOF 2018/07/30 10:13:00 http: TLS handshake error from 10.244.1.1:37520: EOF 2018/07/30 10:13:10 http: TLS handshake error from 10.244.1.1:37526: EOF 2018/07/30 10:13:20 http: TLS handshake error from 10.244.1.1:37532: EOF 2018/07/30 10:13:30 http: TLS handshake error from 10.244.1.1:37538: EOF 2018/07/30 10:13:40 http: TLS handshake error from 10.244.1.1:37544: EOF 2018/07/30 10:13:50 http: TLS handshake error from 10.244.1.1:37550: EOF 2018/07/30 10:14:00 http: TLS handshake error from 10.244.1.1:37556: EOF 2018/07/30 10:14:10 http: TLS handshake error from 10.244.1.1:37562: EOF 2018/07/30 10:14:20 http: TLS handshake error from 10.244.1.1:37568: EOF 2018/07/30 10:14:30 http: TLS handshake error from 10.244.1.1:37574: EOF 2018/07/30 10:14:40 http: TLS handshake error from 10.244.1.1:37580: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:09:52.338367Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-07-30T10:09:52.368677Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-07-30T10:09:52.369073Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-07-30T10:09:52.369847Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-07-30T10:09:52.374700Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-07-30T10:13:02.918529Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:02.940778Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:03.173805Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9h86j\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9h86j" level=info timestamp=2018-07-30T10:13:35.669652Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:35.674033Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:35.763517Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicdkqc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicdkqc" level=info timestamp=2018-07-30T10:14:08.418701Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:14:08.419399Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:14:08.640539Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4v9jd\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4v9jd" level=info timestamp=2018-07-30T10:14:12.617831Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitxj5x\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmitxj5x, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 859b229f-93e0-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitxj5x" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.607465Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.607881Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.612458Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi22lf4" level=info timestamp=2018-07-30T10:14:11.622110Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.622257Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.638396Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi24vzl" level=info timestamp=2018-07-30T10:14:11.682637Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.793370Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.029048Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.029169Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.030737Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.037742Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.037837Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.040322Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:14:12.654113Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.654453Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.718921Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.719209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.720541Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.720649Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.721464Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.740855Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.741104Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.741235Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.741717Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.747788Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.748099Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.758463Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.758575Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." ------------------------------ • Failure [30.472 seconds] VMIPreset /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:42 CRD Validation /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:90 should reject POST if validation webhoook deems the spec is invalid [It] /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:103 Expected : 504 to equal : 422 /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:124 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:12:50 http: TLS handshake error from 10.244.1.1:37514: EOF 2018/07/30 10:13:00 http: TLS handshake error from 10.244.1.1:37520: EOF 2018/07/30 10:13:10 http: TLS handshake error from 10.244.1.1:37526: EOF 2018/07/30 10:13:20 http: TLS handshake error from 10.244.1.1:37532: EOF 2018/07/30 10:13:30 http: TLS handshake error from 10.244.1.1:37538: EOF 2018/07/30 10:13:40 http: TLS handshake error from 10.244.1.1:37544: EOF 2018/07/30 10:13:50 http: TLS handshake error from 10.244.1.1:37550: EOF 2018/07/30 10:14:00 http: TLS handshake error from 10.244.1.1:37556: EOF 2018/07/30 10:14:10 http: TLS handshake error from 10.244.1.1:37562: EOF 2018/07/30 10:14:20 http: TLS handshake error from 10.244.1.1:37568: EOF 2018/07/30 10:14:30 http: TLS handshake error from 10.244.1.1:37574: EOF 2018/07/30 10:14:40 http: TLS handshake error from 10.244.1.1:37580: EOF 2018/07/30 10:14:50 http: TLS handshake error from 10.244.1.1:37586: EOF 2018/07/30 10:15:00 http: TLS handshake error from 10.244.1.1:37592: EOF 2018/07/30 10:15:10 http: TLS handshake error from 10.244.1.1:37598: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:09:52.338367Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-07-30T10:09:52.368677Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-07-30T10:09:52.369073Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-07-30T10:09:52.369847Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-07-30T10:09:52.374700Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-07-30T10:13:02.918529Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:02.940778Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:03.173805Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9h86j\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9h86j" level=info timestamp=2018-07-30T10:13:35.669652Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:35.674033Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:35.763517Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicdkqc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicdkqc" level=info timestamp=2018-07-30T10:14:08.418701Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:14:08.419399Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:14:08.640539Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4v9jd\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4v9jd" level=info timestamp=2018-07-30T10:14:12.617831Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitxj5x\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmitxj5x, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 859b229f-93e0-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitxj5x" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.607465Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.607881Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.612458Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi22lf4" level=info timestamp=2018-07-30T10:14:11.622110Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.622257Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.638396Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi24vzl" level=info timestamp=2018-07-30T10:14:11.682637Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.793370Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.029048Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.029169Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.030737Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.037742Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.037837Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.040322Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:14:12.654113Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.654453Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.718921Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.719209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.720541Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.720649Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.721464Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.740855Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.741104Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.741235Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.741717Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.747788Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.748099Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.758463Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.758575Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." • Failure [30.558 seconds] VMIPreset /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:42 Preset Matching /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:135 Should be accepted on POST [It] /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:137 Expected <*errors.StatusError | 0xc420821170>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } to be nil /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:139 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:13:20 http: TLS handshake error from 10.244.1.1:37532: EOF 2018/07/30 10:13:30 http: TLS handshake error from 10.244.1.1:37538: EOF 2018/07/30 10:13:40 http: TLS handshake error from 10.244.1.1:37544: EOF 2018/07/30 10:13:50 http: TLS handshake error from 10.244.1.1:37550: EOF 2018/07/30 10:14:00 http: TLS handshake error from 10.244.1.1:37556: EOF 2018/07/30 10:14:10 http: TLS handshake error from 10.244.1.1:37562: EOF 2018/07/30 10:14:20 http: TLS handshake error from 10.244.1.1:37568: EOF 2018/07/30 10:14:30 http: TLS handshake error from 10.244.1.1:37574: EOF 2018/07/30 10:14:40 http: TLS handshake error from 10.244.1.1:37580: EOF 2018/07/30 10:14:50 http: TLS handshake error from 10.244.1.1:37586: EOF 2018/07/30 10:15:00 http: TLS handshake error from 10.244.1.1:37592: EOF 2018/07/30 10:15:10 http: TLS handshake error from 10.244.1.1:37598: EOF 2018/07/30 10:15:20 http: TLS handshake error from 10.244.1.1:37604: EOF 2018/07/30 10:15:30 http: TLS handshake error from 10.244.1.1:37610: EOF 2018/07/30 10:15:40 http: TLS handshake error from 10.244.1.1:37616: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:09:52.338367Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-07-30T10:09:52.368677Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-07-30T10:09:52.369073Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-07-30T10:09:52.369847Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-07-30T10:09:52.374700Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-07-30T10:13:02.918529Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:02.940778Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:03.173805Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9h86j\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9h86j" level=info timestamp=2018-07-30T10:13:35.669652Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:35.674033Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:35.763517Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicdkqc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicdkqc" level=info timestamp=2018-07-30T10:14:08.418701Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:14:08.419399Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:14:08.640539Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4v9jd\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4v9jd" level=info timestamp=2018-07-30T10:14:12.617831Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitxj5x\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmitxj5x, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 859b229f-93e0-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitxj5x" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.607465Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.607881Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.612458Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi22lf4" level=info timestamp=2018-07-30T10:14:11.622110Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.622257Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.638396Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi24vzl" level=info timestamp=2018-07-30T10:14:11.682637Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.793370Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.029048Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.029169Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.030737Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.037742Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.037837Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.040322Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:14:12.654113Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.654453Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.718921Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.719209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.720541Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.720649Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.721464Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.740855Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.741104Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.741235Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.741717Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.747788Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.748099Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.758463Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.758575Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." • Failure [30.431 seconds] VMIPreset /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:42 Preset Matching /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:135 Should reject a second submission of a VMIPreset [It] /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:142 Expected error: <*errors.StatusError | 0xc42016a870>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:147 ------------------------------ • Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:13:50 http: TLS handshake error from 10.244.1.1:37550: EOF 2018/07/30 10:14:00 http: TLS handshake error from 10.244.1.1:37556: EOF 2018/07/30 10:14:10 http: TLS handshake error from 10.244.1.1:37562: EOF 2018/07/30 10:14:20 http: TLS handshake error from 10.244.1.1:37568: EOF 2018/07/30 10:14:30 http: TLS handshake error from 10.244.1.1:37574: EOF 2018/07/30 10:14:40 http: TLS handshake error from 10.244.1.1:37580: EOF 2018/07/30 10:14:50 http: TLS handshake error from 10.244.1.1:37586: EOF 2018/07/30 10:15:00 http: TLS handshake error from 10.244.1.1:37592: EOF 2018/07/30 10:15:10 http: TLS handshake error from 10.244.1.1:37598: EOF 2018/07/30 10:15:20 http: TLS handshake error from 10.244.1.1:37604: EOF 2018/07/30 10:15:30 http: TLS handshake error from 10.244.1.1:37610: EOF 2018/07/30 10:15:40 http: TLS handshake error from 10.244.1.1:37616: EOF 2018/07/30 10:15:50 http: TLS handshake error from 10.244.1.1:37622: EOF 2018/07/30 10:16:00 http: TLS handshake error from 10.244.1.1:37628: EOF 2018/07/30 10:16:10 http: TLS handshake error from 10.244.1.1:37634: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:09:52.338367Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-07-30T10:09:52.368677Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-07-30T10:09:52.369073Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-07-30T10:09:52.369847Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-07-30T10:09:52.374700Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-07-30T10:13:02.918529Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:02.940778Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:03.173805Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9h86j\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9h86j" level=info timestamp=2018-07-30T10:13:35.669652Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:35.674033Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:35.763517Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicdkqc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicdkqc" level=info timestamp=2018-07-30T10:14:08.418701Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:14:08.419399Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:14:08.640539Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4v9jd\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4v9jd" level=info timestamp=2018-07-30T10:14:12.617831Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitxj5x\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmitxj5x, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 859b229f-93e0-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitxj5x" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.607465Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.607881Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.612458Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi22lf4" level=info timestamp=2018-07-30T10:14:11.622110Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.622257Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.638396Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi24vzl" level=info timestamp=2018-07-30T10:14:11.682637Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.793370Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.029048Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.029169Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.030737Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.037742Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.037837Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.040322Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:14:12.654113Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.654453Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.718921Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.719209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.720541Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.720649Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.721464Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.740855Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.741104Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.741235Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.741717Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.747788Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.748099Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.758463Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.758575Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." ------------------------------ • Failure [30.402 seconds] VMIPreset /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:42 Preset Matching /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:135 Should reject presets that conflict with VirtualMachineInstance settings [It] /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:167 Expected error: <*errors.StatusError | 0xc420977950>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:169 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:14:20 http: TLS handshake error from 10.244.1.1:37568: EOF 2018/07/30 10:14:30 http: TLS handshake error from 10.244.1.1:37574: EOF 2018/07/30 10:14:40 http: TLS handshake error from 10.244.1.1:37580: EOF 2018/07/30 10:14:50 http: TLS handshake error from 10.244.1.1:37586: EOF 2018/07/30 10:15:00 http: TLS handshake error from 10.244.1.1:37592: EOF 2018/07/30 10:15:10 http: TLS handshake error from 10.244.1.1:37598: EOF 2018/07/30 10:15:20 http: TLS handshake error from 10.244.1.1:37604: EOF 2018/07/30 10:15:30 http: TLS handshake error from 10.244.1.1:37610: EOF 2018/07/30 10:15:40 http: TLS handshake error from 10.244.1.1:37616: EOF 2018/07/30 10:15:50 http: TLS handshake error from 10.244.1.1:37622: EOF 2018/07/30 10:16:00 http: TLS handshake error from 10.244.1.1:37628: EOF 2018/07/30 10:16:10 http: TLS handshake error from 10.244.1.1:37634: EOF 2018/07/30 10:16:20 http: TLS handshake error from 10.244.1.1:37640: EOF 2018/07/30 10:16:30 http: TLS handshake error from 10.244.1.1:37646: EOF 2018/07/30 10:16:40 http: TLS handshake error from 10.244.1.1:37652: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:09:52.338367Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-07-30T10:09:52.368677Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-07-30T10:09:52.369073Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-07-30T10:09:52.369847Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-07-30T10:09:52.374700Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-07-30T10:13:02.918529Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:02.940778Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:03.173805Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9h86j\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9h86j" level=info timestamp=2018-07-30T10:13:35.669652Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:35.674033Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:35.763517Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicdkqc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicdkqc" level=info timestamp=2018-07-30T10:14:08.418701Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:14:08.419399Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:14:08.640539Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4v9jd\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4v9jd" level=info timestamp=2018-07-30T10:14:12.617831Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitxj5x\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmitxj5x, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 859b229f-93e0-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitxj5x" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.607465Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.607881Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.612458Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi22lf4" level=info timestamp=2018-07-30T10:14:11.622110Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.622257Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.638396Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi24vzl" level=info timestamp=2018-07-30T10:14:11.682637Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.793370Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.029048Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.029169Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.030737Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.037742Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.037837Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.040322Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:14:12.654113Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.654453Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.718921Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.719209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.720541Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.720649Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.721464Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.740855Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.741104Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.741235Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.741717Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.747788Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.748099Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.758463Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.758575Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." • Failure [30.480 seconds] VMIPreset /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:42 Preset Matching /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:135 Should accept presets that don't conflict with VirtualMachineInstance settings [It] /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:187 Expected error: <*errors.StatusError | 0xc4209765a0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:189 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:14:50 http: TLS handshake error from 10.244.1.1:37586: EOF 2018/07/30 10:15:00 http: TLS handshake error from 10.244.1.1:37592: EOF 2018/07/30 10:15:10 http: TLS handshake error from 10.244.1.1:37598: EOF 2018/07/30 10:15:20 http: TLS handshake error from 10.244.1.1:37604: EOF 2018/07/30 10:15:30 http: TLS handshake error from 10.244.1.1:37610: EOF 2018/07/30 10:15:40 http: TLS handshake error from 10.244.1.1:37616: EOF 2018/07/30 10:15:50 http: TLS handshake error from 10.244.1.1:37622: EOF 2018/07/30 10:16:00 http: TLS handshake error from 10.244.1.1:37628: EOF 2018/07/30 10:16:10 http: TLS handshake error from 10.244.1.1:37634: EOF 2018/07/30 10:16:20 http: TLS handshake error from 10.244.1.1:37640: EOF 2018/07/30 10:16:30 http: TLS handshake error from 10.244.1.1:37646: EOF 2018/07/30 10:16:40 http: TLS handshake error from 10.244.1.1:37652: EOF 2018/07/30 10:16:50 http: TLS handshake error from 10.244.1.1:37658: EOF 2018/07/30 10:17:00 http: TLS handshake error from 10.244.1.1:37664: EOF 2018/07/30 10:17:10 http: TLS handshake error from 10.244.1.1:37670: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:09:52.338367Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-07-30T10:09:52.368677Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-07-30T10:09:52.369073Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-07-30T10:09:52.369847Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-07-30T10:09:52.374700Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-07-30T10:13:02.918529Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:02.940778Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:03.173805Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9h86j\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9h86j" level=info timestamp=2018-07-30T10:13:35.669652Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:35.674033Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:35.763517Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicdkqc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicdkqc" level=info timestamp=2018-07-30T10:14:08.418701Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:14:08.419399Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:14:08.640539Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4v9jd\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4v9jd" level=info timestamp=2018-07-30T10:14:12.617831Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitxj5x\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmitxj5x, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 859b229f-93e0-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitxj5x" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.607465Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.607881Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.612458Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi22lf4" level=info timestamp=2018-07-30T10:14:11.622110Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.622257Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.638396Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi24vzl" level=info timestamp=2018-07-30T10:14:11.682637Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.793370Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.029048Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.029169Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.030737Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.037742Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.037837Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.040322Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:14:12.654113Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.654453Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.718921Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.719209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.720541Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.720649Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.721464Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.740855Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.741104Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.741235Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.741717Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.747788Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.748099Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.758463Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.758575Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." • Failure [30.426 seconds] VMIPreset /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:42 Preset Matching /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:135 Should ignore VMIs that don't match [It] /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:212 Expected error: <*errors.StatusError | 0xc4209773b0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:214 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:15:20 http: TLS handshake error from 10.244.1.1:37604: EOF 2018/07/30 10:15:30 http: TLS handshake error from 10.244.1.1:37610: EOF 2018/07/30 10:15:40 http: TLS handshake error from 10.244.1.1:37616: EOF 2018/07/30 10:15:50 http: TLS handshake error from 10.244.1.1:37622: EOF 2018/07/30 10:16:00 http: TLS handshake error from 10.244.1.1:37628: EOF 2018/07/30 10:16:10 http: TLS handshake error from 10.244.1.1:37634: EOF 2018/07/30 10:16:20 http: TLS handshake error from 10.244.1.1:37640: EOF 2018/07/30 10:16:30 http: TLS handshake error from 10.244.1.1:37646: EOF 2018/07/30 10:16:40 http: TLS handshake error from 10.244.1.1:37652: EOF 2018/07/30 10:16:50 http: TLS handshake error from 10.244.1.1:37658: EOF 2018/07/30 10:17:00 http: TLS handshake error from 10.244.1.1:37664: EOF 2018/07/30 10:17:10 http: TLS handshake error from 10.244.1.1:37670: EOF 2018/07/30 10:17:20 http: TLS handshake error from 10.244.1.1:37676: EOF 2018/07/30 10:17:30 http: TLS handshake error from 10.244.1.1:37682: EOF 2018/07/30 10:17:40 http: TLS handshake error from 10.244.1.1:37688: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:09:52.369847Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-07-30T10:09:52.374700Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-07-30T10:13:02.918529Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:02.940778Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:03.173805Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9h86j\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9h86j" level=info timestamp=2018-07-30T10:13:35.669652Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:35.674033Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:35.763517Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicdkqc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicdkqc" level=info timestamp=2018-07-30T10:14:08.418701Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:14:08.419399Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:14:08.640539Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4v9jd\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4v9jd" level=info timestamp=2018-07-30T10:14:12.617831Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitxj5x\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmitxj5x, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 859b229f-93e0-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitxj5x" level=info timestamp=2018-07-30T10:17:46.595567Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihcgrl kind= uid=bbf3fb77-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:17:46.596626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihcgrl kind= uid=bbf3fb77-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:17:46.793622Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmihcgrl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmihcgrl" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.607465Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.607881Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.612458Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi22lf4" level=info timestamp=2018-07-30T10:14:11.622110Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.622257Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.638396Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi24vzl" level=info timestamp=2018-07-30T10:14:11.682637Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.793370Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.029048Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.029169Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.030737Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.037742Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.037837Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.040322Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:14:12.654113Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.654453Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.718921Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.719209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.720541Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.720649Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.721464Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.740855Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.741104Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.741235Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.741717Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.747788Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.748099Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.758463Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.758575Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmihcgrl-75g2b Pod phase: Pending • Failure [30.648 seconds] VMIPreset /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:42 Preset Matching /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:135 Should not be applied to existing VMIs [It] /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:233 Expected error: <*errors.StatusError | 0xc420821050>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:236 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:15:50 http: TLS handshake error from 10.244.1.1:37622: EOF 2018/07/30 10:16:00 http: TLS handshake error from 10.244.1.1:37628: EOF 2018/07/30 10:16:10 http: TLS handshake error from 10.244.1.1:37634: EOF 2018/07/30 10:16:20 http: TLS handshake error from 10.244.1.1:37640: EOF 2018/07/30 10:16:30 http: TLS handshake error from 10.244.1.1:37646: EOF 2018/07/30 10:16:40 http: TLS handshake error from 10.244.1.1:37652: EOF 2018/07/30 10:16:50 http: TLS handshake error from 10.244.1.1:37658: EOF 2018/07/30 10:17:00 http: TLS handshake error from 10.244.1.1:37664: EOF 2018/07/30 10:17:10 http: TLS handshake error from 10.244.1.1:37670: EOF 2018/07/30 10:17:20 http: TLS handshake error from 10.244.1.1:37676: EOF 2018/07/30 10:17:30 http: TLS handshake error from 10.244.1.1:37682: EOF 2018/07/30 10:17:40 http: TLS handshake error from 10.244.1.1:37688: EOF 2018/07/30 10:17:50 http: TLS handshake error from 10.244.1.1:37694: EOF 2018/07/30 10:18:00 http: TLS handshake error from 10.244.1.1:37700: EOF 2018/07/30 10:18:10 http: TLS handshake error from 10.244.1.1:37706: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:09:52.369847Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-07-30T10:09:52.374700Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-07-30T10:13:02.918529Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:02.940778Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:03.173805Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9h86j\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9h86j" level=info timestamp=2018-07-30T10:13:35.669652Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:35.674033Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:35.763517Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicdkqc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicdkqc" level=info timestamp=2018-07-30T10:14:08.418701Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:14:08.419399Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:14:08.640539Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4v9jd\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4v9jd" level=info timestamp=2018-07-30T10:14:12.617831Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitxj5x\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmitxj5x, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 859b229f-93e0-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitxj5x" level=info timestamp=2018-07-30T10:17:46.595567Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihcgrl kind= uid=bbf3fb77-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:17:46.596626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihcgrl kind= uid=bbf3fb77-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:17:46.793622Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmihcgrl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmihcgrl" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.607465Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.607881Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.612458Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi22lf4" level=info timestamp=2018-07-30T10:14:11.622110Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.622257Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.638396Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi24vzl" level=info timestamp=2018-07-30T10:14:11.682637Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.793370Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.029048Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.029169Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.030737Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.037742Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.037837Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.040322Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:14:12.654113Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.654453Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.718921Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.719209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.720541Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.720649Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.721464Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.740855Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.741104Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.741235Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.741717Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.747788Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.748099Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.758463Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.758575Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." • Failure [30.582 seconds] VMIPreset /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:42 Exclusions /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:253 Should not apply presets to VirtualMachineInstance's with the exclusion marking [It] /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:254 Expected error: <*errors.StatusError | 0xc420821e60>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:256 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:16:20 http: TLS handshake error from 10.244.1.1:37640: EOF 2018/07/30 10:16:30 http: TLS handshake error from 10.244.1.1:37646: EOF 2018/07/30 10:16:40 http: TLS handshake error from 10.244.1.1:37652: EOF 2018/07/30 10:16:50 http: TLS handshake error from 10.244.1.1:37658: EOF 2018/07/30 10:17:00 http: TLS handshake error from 10.244.1.1:37664: EOF 2018/07/30 10:17:10 http: TLS handshake error from 10.244.1.1:37670: EOF 2018/07/30 10:17:20 http: TLS handshake error from 10.244.1.1:37676: EOF 2018/07/30 10:17:30 http: TLS handshake error from 10.244.1.1:37682: EOF 2018/07/30 10:17:40 http: TLS handshake error from 10.244.1.1:37688: EOF 2018/07/30 10:17:50 http: TLS handshake error from 10.244.1.1:37694: EOF 2018/07/30 10:18:00 http: TLS handshake error from 10.244.1.1:37700: EOF 2018/07/30 10:18:10 http: TLS handshake error from 10.244.1.1:37706: EOF 2018/07/30 10:18:20 http: TLS handshake error from 10.244.1.1:37712: EOF 2018/07/30 10:18:30 http: TLS handshake error from 10.244.1.1:37718: EOF 2018/07/30 10:18:40 http: TLS handshake error from 10.244.1.1:37724: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:09:52.369847Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-07-30T10:09:52.374700Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-07-30T10:13:02.918529Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:02.940778Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:03.173805Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9h86j\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9h86j" level=info timestamp=2018-07-30T10:13:35.669652Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:35.674033Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:35.763517Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicdkqc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicdkqc" level=info timestamp=2018-07-30T10:14:08.418701Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:14:08.419399Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:14:08.640539Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4v9jd\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4v9jd" level=info timestamp=2018-07-30T10:14:12.617831Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitxj5x\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmitxj5x, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 859b229f-93e0-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitxj5x" level=info timestamp=2018-07-30T10:17:46.595567Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihcgrl kind= uid=bbf3fb77-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:17:46.596626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihcgrl kind= uid=bbf3fb77-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:17:46.793622Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmihcgrl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmihcgrl" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.607465Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.607881Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.612458Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi22lf4" level=info timestamp=2018-07-30T10:14:11.622110Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.622257Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.638396Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi24vzl" level=info timestamp=2018-07-30T10:14:11.682637Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.793370Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.029048Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.029169Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.030737Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.037742Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.037837Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.040322Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:14:12.654113Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.654453Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.718921Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.719209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.720541Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.720649Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.721464Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.740855Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.741104Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.741235Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.741717Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.747788Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.748099Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.758463Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.758575Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." • Failure [30.535 seconds] VMIPreset /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:42 Conflict /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:285 should not apply any presets in case of conflict [It] /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:307 Expected error: <*errors.StatusError | 0xc420976510>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:309 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:16:50 http: TLS handshake error from 10.244.1.1:37658: EOF 2018/07/30 10:17:00 http: TLS handshake error from 10.244.1.1:37664: EOF 2018/07/30 10:17:10 http: TLS handshake error from 10.244.1.1:37670: EOF 2018/07/30 10:17:20 http: TLS handshake error from 10.244.1.1:37676: EOF 2018/07/30 10:17:30 http: TLS handshake error from 10.244.1.1:37682: EOF 2018/07/30 10:17:40 http: TLS handshake error from 10.244.1.1:37688: EOF 2018/07/30 10:17:50 http: TLS handshake error from 10.244.1.1:37694: EOF 2018/07/30 10:18:00 http: TLS handshake error from 10.244.1.1:37700: EOF 2018/07/30 10:18:10 http: TLS handshake error from 10.244.1.1:37706: EOF 2018/07/30 10:18:20 http: TLS handshake error from 10.244.1.1:37712: EOF 2018/07/30 10:18:30 http: TLS handshake error from 10.244.1.1:37718: EOF 2018/07/30 10:18:40 http: TLS handshake error from 10.244.1.1:37724: EOF 2018/07/30 10:18:50 http: TLS handshake error from 10.244.1.1:37730: EOF 2018/07/30 10:19:00 http: TLS handshake error from 10.244.1.1:37736: EOF 2018/07/30 10:19:10 http: TLS handshake error from 10.244.1.1:37742: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:13:02.940778Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9h86j kind= uid=12dd4ac2-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:03.173805Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9h86j\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9h86j" level=info timestamp=2018-07-30T10:13:35.669652Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:13:35.674033Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:35.763517Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicdkqc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicdkqc" level=info timestamp=2018-07-30T10:14:08.418701Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:14:08.419399Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:14:08.640539Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4v9jd\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4v9jd" level=info timestamp=2018-07-30T10:14:12.617831Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitxj5x\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmitxj5x, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 859b229f-93e0-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitxj5x" level=info timestamp=2018-07-30T10:17:46.595567Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihcgrl kind= uid=bbf3fb77-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:17:46.596626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihcgrl kind= uid=bbf3fb77-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:17:46.793622Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmihcgrl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmihcgrl" level=info timestamp=2018-07-30T10:19:18.318625Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibmlwf kind= uid=f2a86b3b-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:19:18.322072Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibmlwf kind= uid=f2a86b3b-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:19:18.525106Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibmlwf\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibmlwf" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.607465Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.607881Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.612458Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi22lf4" level=info timestamp=2018-07-30T10:14:11.622110Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.622257Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.638396Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi24vzl" level=info timestamp=2018-07-30T10:14:11.682637Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.793370Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.029048Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.029169Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.030737Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.037742Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.037837Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.040322Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:14:12.654113Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.654453Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.718921Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.719209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.720541Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.720649Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.721464Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.740855Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.741104Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.741235Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.741717Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.747788Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.748099Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.758463Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.758575Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmibmlwf-hdbsh Pod phase: Pending • Failure [30.711 seconds] RegistryDisk /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:41 Starting and stopping the same VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:90 with ephemeral registry disk /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:91 should success multiple times [It] /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:92 Expected <*errors.StatusError | 0xc4208219e0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } to be nil /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:98 ------------------------------ STEP: Starting the VirtualMachineInstance Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:17:20 http: TLS handshake error from 10.244.1.1:37676: EOF 2018/07/30 10:17:30 http: TLS handshake error from 10.244.1.1:37682: EOF 2018/07/30 10:17:40 http: TLS handshake error from 10.244.1.1:37688: EOF 2018/07/30 10:17:50 http: TLS handshake error from 10.244.1.1:37694: EOF 2018/07/30 10:18:00 http: TLS handshake error from 10.244.1.1:37700: EOF 2018/07/30 10:18:10 http: TLS handshake error from 10.244.1.1:37706: EOF 2018/07/30 10:18:20 http: TLS handshake error from 10.244.1.1:37712: EOF 2018/07/30 10:18:30 http: TLS handshake error from 10.244.1.1:37718: EOF 2018/07/30 10:18:40 http: TLS handshake error from 10.244.1.1:37724: EOF 2018/07/30 10:18:50 http: TLS handshake error from 10.244.1.1:37730: EOF 2018/07/30 10:19:00 http: TLS handshake error from 10.244.1.1:37736: EOF 2018/07/30 10:19:10 http: TLS handshake error from 10.244.1.1:37742: EOF 2018/07/30 10:19:20 http: TLS handshake error from 10.244.1.1:37748: EOF 2018/07/30 10:19:30 http: TLS handshake error from 10.244.1.1:37754: EOF 2018/07/30 10:19:40 http: TLS handshake error from 10.244.1.1:37760: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:13:35.674033Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:13:35.763517Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmicdkqc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmicdkqc" level=info timestamp=2018-07-30T10:14:08.418701Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:14:08.419399Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:14:08.640539Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4v9jd\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4v9jd" level=info timestamp=2018-07-30T10:14:12.617831Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitxj5x\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmitxj5x, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 859b229f-93e0-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitxj5x" level=info timestamp=2018-07-30T10:17:46.595567Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihcgrl kind= uid=bbf3fb77-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:17:46.596626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihcgrl kind= uid=bbf3fb77-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:17:46.793622Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmihcgrl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmihcgrl" level=info timestamp=2018-07-30T10:19:18.318625Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibmlwf kind= uid=f2a86b3b-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:19:18.322072Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibmlwf kind= uid=f2a86b3b-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:19:18.525106Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibmlwf\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibmlwf" level=info timestamp=2018-07-30T10:19:18.941492Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibmlwf\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibmlwf, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f2a86b3b-93e1-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibmlwf" level=info timestamp=2018-07-30T10:19:49.067387Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibqfr6 kind= uid=04fc1832-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:19:49.078644Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibqfr6 kind= uid=04fc1832-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.607465Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.607881Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.612458Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi22lf4" level=info timestamp=2018-07-30T10:14:11.622110Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.622257Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.638396Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi24vzl" level=info timestamp=2018-07-30T10:14:11.682637Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.793370Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.029048Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.029169Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.030737Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.037742Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.037837Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.040322Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:14:12.654113Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.654453Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.718921Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.719209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.720541Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.720649Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.721464Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.740855Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.741104Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.741235Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.741717Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.747788Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.748099Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.758463Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.758575Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmibqfr6-5x7jn Pod phase: Pending • Failure [30.727 seconds] RegistryDisk /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:41 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:111 with ephemeral registry disk /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:112 should not modify the spec on status update [It] /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:113 Expected <*errors.StatusError | 0xc420977b90>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } to be nil /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:119 ------------------------------ STEP: Starting the VirtualMachineInstance Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:18:00 http: TLS handshake error from 10.244.1.1:37700: EOF 2018/07/30 10:18:10 http: TLS handshake error from 10.244.1.1:37706: EOF 2018/07/30 10:18:20 http: TLS handshake error from 10.244.1.1:37712: EOF 2018/07/30 10:18:30 http: TLS handshake error from 10.244.1.1:37718: EOF 2018/07/30 10:18:40 http: TLS handshake error from 10.244.1.1:37724: EOF 2018/07/30 10:18:50 http: TLS handshake error from 10.244.1.1:37730: EOF 2018/07/30 10:19:00 http: TLS handshake error from 10.244.1.1:37736: EOF 2018/07/30 10:19:10 http: TLS handshake error from 10.244.1.1:37742: EOF 2018/07/30 10:19:20 http: TLS handshake error from 10.244.1.1:37748: EOF 2018/07/30 10:19:30 http: TLS handshake error from 10.244.1.1:37754: EOF 2018/07/30 10:19:40 http: TLS handshake error from 10.244.1.1:37760: EOF 2018/07/30 10:19:50 http: TLS handshake error from 10.244.1.1:37766: EOF 2018/07/30 10:20:00 http: TLS handshake error from 10.244.1.1:37772: EOF 2018/07/30 10:20:10 http: TLS handshake error from 10.244.1.1:37778: EOF 2018/07/30 10:20:20 http: TLS handshake error from 10.244.1.1:37784: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:14:08.419399Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4v9jd kind= uid=39efb1c6-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:14:08.640539Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4v9jd\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4v9jd" level=info timestamp=2018-07-30T10:14:12.617831Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitxj5x\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmitxj5x, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 859b229f-93e0-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitxj5x" level=info timestamp=2018-07-30T10:17:46.595567Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihcgrl kind= uid=bbf3fb77-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:17:46.596626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihcgrl kind= uid=bbf3fb77-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:17:46.793622Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmihcgrl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmihcgrl" level=info timestamp=2018-07-30T10:19:18.318625Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibmlwf kind= uid=f2a86b3b-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:19:18.322072Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibmlwf kind= uid=f2a86b3b-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:19:18.525106Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibmlwf\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibmlwf" level=info timestamp=2018-07-30T10:19:18.941492Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibmlwf\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibmlwf, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f2a86b3b-93e1-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibmlwf" level=info timestamp=2018-07-30T10:19:49.067387Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibqfr6 kind= uid=04fc1832-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:19:49.078644Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibqfr6 kind= uid=04fc1832-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:19:49.603219Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibqfr6\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibqfr6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 04fc1832-93e2-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibqfr6" level=info timestamp=2018-07-30T10:20:19.791169Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqscg kind= uid=174b6f30-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:20:19.791997Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqscg kind= uid=174b6f30-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.607465Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.607881Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.612458Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi22lf4" level=info timestamp=2018-07-30T10:14:11.622110Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.622257Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.638396Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi24vzl" level=info timestamp=2018-07-30T10:14:11.682637Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.793370Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.029048Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.029169Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.030737Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.037742Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.037837Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.040322Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:14:12.654113Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.654453Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.718921Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.719209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.720541Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.720649Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.721464Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.740855Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.741104Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.741235Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.741717Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.747788Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.748099Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.758463Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.758575Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmitqscg-h975x Pod phase: Pending • Failure [30.732 seconds] RegistryDisk /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:41 Starting multiple VMIs /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:129 with ephemeral registry disk /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:130 should success [It] /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:131 Expected <*errors.StatusError | 0xc4209765a0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } to be nil /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:55 ------------------------------ STEP: Starting a VirtualMachineInstance Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:18:30 http: TLS handshake error from 10.244.1.1:37718: EOF 2018/07/30 10:18:40 http: TLS handshake error from 10.244.1.1:37724: EOF 2018/07/30 10:18:50 http: TLS handshake error from 10.244.1.1:37730: EOF 2018/07/30 10:19:00 http: TLS handshake error from 10.244.1.1:37736: EOF 2018/07/30 10:19:10 http: TLS handshake error from 10.244.1.1:37742: EOF 2018/07/30 10:19:20 http: TLS handshake error from 10.244.1.1:37748: EOF 2018/07/30 10:19:30 http: TLS handshake error from 10.244.1.1:37754: EOF 2018/07/30 10:19:40 http: TLS handshake error from 10.244.1.1:37760: EOF 2018/07/30 10:19:50 http: TLS handshake error from 10.244.1.1:37766: EOF 2018/07/30 10:20:00 http: TLS handshake error from 10.244.1.1:37772: EOF 2018/07/30 10:20:10 http: TLS handshake error from 10.244.1.1:37778: EOF 2018/07/30 10:20:20 http: TLS handshake error from 10.244.1.1:37784: EOF 2018/07/30 10:20:30 http: TLS handshake error from 10.244.1.1:37790: EOF 2018/07/30 10:20:40 http: TLS handshake error from 10.244.1.1:37796: EOF 2018/07/30 10:20:50 http: TLS handshake error from 10.244.1.1:37802: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:14:12.617831Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitxj5x\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmitxj5x, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 859b229f-93e0-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitxj5x" level=info timestamp=2018-07-30T10:17:46.595567Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihcgrl kind= uid=bbf3fb77-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:17:46.596626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihcgrl kind= uid=bbf3fb77-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:17:46.793622Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmihcgrl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmihcgrl" level=info timestamp=2018-07-30T10:19:18.318625Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibmlwf kind= uid=f2a86b3b-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:19:18.322072Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibmlwf kind= uid=f2a86b3b-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:19:18.525106Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibmlwf\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibmlwf" level=info timestamp=2018-07-30T10:19:18.941492Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibmlwf\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibmlwf, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f2a86b3b-93e1-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibmlwf" level=info timestamp=2018-07-30T10:19:49.067387Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibqfr6 kind= uid=04fc1832-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:19:49.078644Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibqfr6 kind= uid=04fc1832-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:19:49.603219Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibqfr6\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibqfr6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 04fc1832-93e2-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibqfr6" level=info timestamp=2018-07-30T10:20:19.791169Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqscg kind= uid=174b6f30-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:20:19.791997Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqscg kind= uid=174b6f30-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:20:50.611322Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifnhgf kind= uid=29a154e3-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:20:50.619831Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifnhgf kind= uid=29a154e3-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.607465Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.607881Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.612458Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi22lf4" level=info timestamp=2018-07-30T10:14:11.622110Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.622257Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.638396Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi24vzl" level=info timestamp=2018-07-30T10:14:11.682637Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.793370Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.029048Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.029169Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.030737Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.037742Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.037837Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.040322Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:14:12.654113Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.654453Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.718921Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.719209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.720541Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.720649Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.721464Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.740855Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.741104Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.741235Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.741717Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.747788Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.748099Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.758463Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.758575Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmifnhgf-d8r8h Pod phase: Pending • Failure [30.708 seconds] CloudInit UserData /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:46 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:80 with cloudInitNoCloud userDataBase64 source /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:81 should have cloud-init data [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:82 Expected <*errors.StatusError | 0xc42016bef0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } to be nil /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:56 ------------------------------ STEP: Starting a VirtualMachineInstance Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:19:00 http: TLS handshake error from 10.244.1.1:37736: EOF 2018/07/30 10:19:10 http: TLS handshake error from 10.244.1.1:37742: EOF 2018/07/30 10:19:20 http: TLS handshake error from 10.244.1.1:37748: EOF 2018/07/30 10:19:30 http: TLS handshake error from 10.244.1.1:37754: EOF 2018/07/30 10:19:40 http: TLS handshake error from 10.244.1.1:37760: EOF 2018/07/30 10:19:50 http: TLS handshake error from 10.244.1.1:37766: EOF 2018/07/30 10:20:00 http: TLS handshake error from 10.244.1.1:37772: EOF 2018/07/30 10:20:10 http: TLS handshake error from 10.244.1.1:37778: EOF 2018/07/30 10:20:20 http: TLS handshake error from 10.244.1.1:37784: EOF 2018/07/30 10:20:30 http: TLS handshake error from 10.244.1.1:37790: EOF 2018/07/30 10:20:40 http: TLS handshake error from 10.244.1.1:37796: EOF 2018/07/30 10:20:50 http: TLS handshake error from 10.244.1.1:37802: EOF 2018/07/30 10:21:00 http: TLS handshake error from 10.244.1.1:37808: EOF 2018/07/30 10:21:10 http: TLS handshake error from 10.244.1.1:37814: EOF 2018/07/30 10:21:20 http: TLS handshake error from 10.244.1.1:37820: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:17:46.793622Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmihcgrl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmihcgrl" level=info timestamp=2018-07-30T10:19:18.318625Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibmlwf kind= uid=f2a86b3b-93e1-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:19:18.322072Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibmlwf kind= uid=f2a86b3b-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:19:18.525106Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibmlwf\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibmlwf" level=info timestamp=2018-07-30T10:19:18.941492Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibmlwf\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibmlwf, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f2a86b3b-93e1-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibmlwf" level=info timestamp=2018-07-30T10:19:49.067387Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibqfr6 kind= uid=04fc1832-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:19:49.078644Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibqfr6 kind= uid=04fc1832-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:19:49.603219Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibqfr6\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibqfr6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 04fc1832-93e2-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibqfr6" level=info timestamp=2018-07-30T10:20:19.791169Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqscg kind= uid=174b6f30-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:20:19.791997Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqscg kind= uid=174b6f30-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:20:50.611322Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifnhgf kind= uid=29a154e3-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:20:50.619831Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifnhgf kind= uid=29a154e3-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:21:21.228849Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6h5c6 kind= uid=3beac2a7-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:21:21.229565Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6h5c6 kind= uid=3beac2a7-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:21:21.420624Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi6h5c6\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi6h5c6" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.607465Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.607881Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.612458Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi22lf4" level=info timestamp=2018-07-30T10:14:11.622110Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.622257Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.638396Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi24vzl" level=info timestamp=2018-07-30T10:14:11.682637Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.793370Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.029048Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.029169Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.030737Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.037742Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.037837Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.040322Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:14:12.654113Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.654453Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.718921Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.719209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.720541Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.720649Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.721464Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.740855Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.741104Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.741235Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.741717Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.747788Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.748099Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.758463Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.758575Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi6h5c6-fmxxd Pod phase: Pending • Failure [30.615 seconds] CloudInit UserData /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:46 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:80 with cloudInitNoCloud userDataBase64 source /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:81 with injected ssh-key /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:92 should have ssh-key under authorized keys [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:93 Expected <*errors.StatusError | 0xc4209774d0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } to be nil /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:56 ------------------------------ STEP: Starting a VirtualMachineInstance Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:19:30 http: TLS handshake error from 10.244.1.1:37754: EOF 2018/07/30 10:19:40 http: TLS handshake error from 10.244.1.1:37760: EOF 2018/07/30 10:19:50 http: TLS handshake error from 10.244.1.1:37766: EOF 2018/07/30 10:20:00 http: TLS handshake error from 10.244.1.1:37772: EOF 2018/07/30 10:20:10 http: TLS handshake error from 10.244.1.1:37778: EOF 2018/07/30 10:20:20 http: TLS handshake error from 10.244.1.1:37784: EOF 2018/07/30 10:20:30 http: TLS handshake error from 10.244.1.1:37790: EOF 2018/07/30 10:20:40 http: TLS handshake error from 10.244.1.1:37796: EOF 2018/07/30 10:20:50 http: TLS handshake error from 10.244.1.1:37802: EOF 2018/07/30 10:21:00 http: TLS handshake error from 10.244.1.1:37808: EOF 2018/07/30 10:21:10 http: TLS handshake error from 10.244.1.1:37814: EOF 2018/07/30 10:21:20 http: TLS handshake error from 10.244.1.1:37820: EOF 2018/07/30 10:21:30 http: TLS handshake error from 10.244.1.1:37826: EOF 2018/07/30 10:21:40 http: TLS handshake error from 10.244.1.1:37832: EOF 2018/07/30 10:21:50 http: TLS handshake error from 10.244.1.1:37838: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:19:18.322072Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibmlwf kind= uid=f2a86b3b-93e1-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:19:18.525106Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibmlwf\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibmlwf" level=info timestamp=2018-07-30T10:19:18.941492Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibmlwf\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibmlwf, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f2a86b3b-93e1-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibmlwf" level=info timestamp=2018-07-30T10:19:49.067387Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibqfr6 kind= uid=04fc1832-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:19:49.078644Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibqfr6 kind= uid=04fc1832-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:19:49.603219Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibqfr6\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibqfr6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 04fc1832-93e2-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibqfr6" level=info timestamp=2018-07-30T10:20:19.791169Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqscg kind= uid=174b6f30-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:20:19.791997Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqscg kind= uid=174b6f30-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:20:50.611322Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifnhgf kind= uid=29a154e3-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:20:50.619831Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifnhgf kind= uid=29a154e3-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:21:21.228849Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6h5c6 kind= uid=3beac2a7-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:21:21.229565Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6h5c6 kind= uid=3beac2a7-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:21:21.420624Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi6h5c6\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi6h5c6" level=info timestamp=2018-07-30T10:21:51.851046Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirfff5 kind= uid=4e29e917-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:21:51.852171Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirfff5 kind= uid=4e29e917-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.607465Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.607881Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.612458Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi22lf4" level=info timestamp=2018-07-30T10:14:11.622110Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.622257Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.638396Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi24vzl" level=info timestamp=2018-07-30T10:14:11.682637Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.793370Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.029048Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.029169Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.030737Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.037742Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.037837Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.040322Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:14:12.654113Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.654453Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.718921Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.719209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.720541Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.720649Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.721464Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.740855Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.741104Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.741235Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.741717Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.747788Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.748099Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.758463Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.758575Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmirfff5-zjgsc Pod phase: Pending • Failure [30.700 seconds] CloudInit UserData /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:46 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:80 with cloudInitNoCloud userData source /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:118 should process provided cloud-init data [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:119 Expected <*errors.StatusError | 0xc420bf5dd0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } to be nil /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:56 ------------------------------ STEP: Starting a VirtualMachineInstance Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:20:00 http: TLS handshake error from 10.244.1.1:37772: EOF 2018/07/30 10:20:10 http: TLS handshake error from 10.244.1.1:37778: EOF 2018/07/30 10:20:20 http: TLS handshake error from 10.244.1.1:37784: EOF 2018/07/30 10:20:30 http: TLS handshake error from 10.244.1.1:37790: EOF 2018/07/30 10:20:40 http: TLS handshake error from 10.244.1.1:37796: EOF 2018/07/30 10:20:50 http: TLS handshake error from 10.244.1.1:37802: EOF 2018/07/30 10:21:00 http: TLS handshake error from 10.244.1.1:37808: EOF 2018/07/30 10:21:10 http: TLS handshake error from 10.244.1.1:37814: EOF 2018/07/30 10:21:20 http: TLS handshake error from 10.244.1.1:37820: EOF 2018/07/30 10:21:30 http: TLS handshake error from 10.244.1.1:37826: EOF 2018/07/30 10:21:40 http: TLS handshake error from 10.244.1.1:37832: EOF 2018/07/30 10:21:50 http: TLS handshake error from 10.244.1.1:37838: EOF 2018/07/30 10:22:00 http: TLS handshake error from 10.244.1.1:37844: EOF 2018/07/30 10:22:10 http: TLS handshake error from 10.244.1.1:37850: EOF 2018/07/30 10:22:20 http: TLS handshake error from 10.244.1.1:37856: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:19:49.078644Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibqfr6 kind= uid=04fc1832-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:19:49.603219Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmibqfr6\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmibqfr6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 04fc1832-93e2-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmibqfr6" level=info timestamp=2018-07-30T10:20:19.791169Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqscg kind= uid=174b6f30-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:20:19.791997Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqscg kind= uid=174b6f30-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:20:50.611322Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifnhgf kind= uid=29a154e3-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:20:50.619831Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifnhgf kind= uid=29a154e3-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:21:21.228849Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6h5c6 kind= uid=3beac2a7-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:21:21.229565Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6h5c6 kind= uid=3beac2a7-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:21:21.420624Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi6h5c6\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi6h5c6" level=info timestamp=2018-07-30T10:21:51.851046Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirfff5 kind= uid=4e29e917-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:21:51.852171Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirfff5 kind= uid=4e29e917-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:21:52.366467Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirfff5\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmirfff5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4e29e917-93e2-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirfff5" level=info timestamp=2018-07-30T10:21:52.388863Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirfff5\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmirfff5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4e29e917-93e2-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirfff5" level=info timestamp=2018-07-30T10:22:22.560486Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmic8fwb kind= uid=6079464f-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:22:22.563295Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmic8fwb kind= uid=6079464f-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.607465Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.607881Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.612458Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi22lf4" level=info timestamp=2018-07-30T10:14:11.622110Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.622257Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.638396Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi24vzl" level=info timestamp=2018-07-30T10:14:11.682637Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.793370Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.029048Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.029169Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.030737Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.037742Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.037837Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.040322Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:14:12.654113Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.654453Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.718921Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.719209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.720541Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.720649Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.721464Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.740855Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.741104Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.741235Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.741717Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.747788Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.748099Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.758463Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.758575Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmic8fwb-9wcfs Pod phase: Pending • Failure [30.680 seconds] CloudInit UserData /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:46 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:80 should take user-data from k8s secret [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:162 Expected <*errors.StatusError | 0xc42016afc0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } to be nil /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:56 ------------------------------ STEP: Creating a user-data secret STEP: Starting a VirtualMachineInstance Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:20:30 http: TLS handshake error from 10.244.1.1:37790: EOF 2018/07/30 10:20:40 http: TLS handshake error from 10.244.1.1:37796: EOF 2018/07/30 10:20:50 http: TLS handshake error from 10.244.1.1:37802: EOF 2018/07/30 10:21:00 http: TLS handshake error from 10.244.1.1:37808: EOF 2018/07/30 10:21:10 http: TLS handshake error from 10.244.1.1:37814: EOF 2018/07/30 10:21:20 http: TLS handshake error from 10.244.1.1:37820: EOF 2018/07/30 10:21:30 http: TLS handshake error from 10.244.1.1:37826: EOF 2018/07/30 10:21:40 http: TLS handshake error from 10.244.1.1:37832: EOF 2018/07/30 10:21:50 http: TLS handshake error from 10.244.1.1:37838: EOF 2018/07/30 10:22:00 http: TLS handshake error from 10.244.1.1:37844: EOF 2018/07/30 10:22:10 http: TLS handshake error from 10.244.1.1:37850: EOF 2018/07/30 10:22:20 http: TLS handshake error from 10.244.1.1:37856: EOF 2018/07/30 10:22:30 http: TLS handshake error from 10.244.1.1:37862: EOF 2018/07/30 10:22:40 http: TLS handshake error from 10.244.1.1:37868: EOF 2018/07/30 10:22:50 http: TLS handshake error from 10.244.1.1:37874: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:20:50.611322Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifnhgf kind= uid=29a154e3-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:20:50.619831Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifnhgf kind= uid=29a154e3-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:21:21.228849Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6h5c6 kind= uid=3beac2a7-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:21:21.229565Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6h5c6 kind= uid=3beac2a7-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:21:21.420624Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi6h5c6\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi6h5c6" level=info timestamp=2018-07-30T10:21:51.851046Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirfff5 kind= uid=4e29e917-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:21:51.852171Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirfff5 kind= uid=4e29e917-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:21:52.366467Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirfff5\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmirfff5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4e29e917-93e2-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirfff5" level=info timestamp=2018-07-30T10:21:52.388863Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirfff5\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmirfff5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4e29e917-93e2-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirfff5" level=info timestamp=2018-07-30T10:22:22.560486Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmic8fwb kind= uid=6079464f-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:22:22.563295Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmic8fwb kind= uid=6079464f-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:22:23.069239Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmic8fwb\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmic8fwb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6079464f-93e2-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmic8fwb" level=info timestamp=2018-07-30T10:22:53.229797Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4zcjm kind= uid=72c11411-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:22:53.230826Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4zcjm kind= uid=72c11411-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:22:53.427174Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4zcjm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4zcjm" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.607465Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.607881Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.612458Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi22lf4" level=info timestamp=2018-07-30T10:14:11.622110Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.622257Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.638396Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi24vzl" level=info timestamp=2018-07-30T10:14:11.682637Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.793370Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.029048Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.029169Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.030737Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.037742Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.037837Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.040322Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:14:12.654113Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.654453Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.718921Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.719209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.720541Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.720649Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.721464Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.740855Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.741104Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.741235Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.741717Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.747788Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.748099Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.758463Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.758575Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi4zcjm-9kfbs Pod phase: Pending • Failure in Spec Setup (BeforeEach) [30.630 seconds] VNC /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:46 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:54 with VNC connection [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:62 should allow accessing the VNC device /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:64 Expected success, but got an error: <*errors.StatusError | 0xc4209766c0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:58 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:21:00 http: TLS handshake error from 10.244.1.1:37808: EOF 2018/07/30 10:21:10 http: TLS handshake error from 10.244.1.1:37814: EOF 2018/07/30 10:21:20 http: TLS handshake error from 10.244.1.1:37820: EOF 2018/07/30 10:21:30 http: TLS handshake error from 10.244.1.1:37826: EOF 2018/07/30 10:21:40 http: TLS handshake error from 10.244.1.1:37832: EOF 2018/07/30 10:21:50 http: TLS handshake error from 10.244.1.1:37838: EOF 2018/07/30 10:22:00 http: TLS handshake error from 10.244.1.1:37844: EOF 2018/07/30 10:22:10 http: TLS handshake error from 10.244.1.1:37850: EOF 2018/07/30 10:22:20 http: TLS handshake error from 10.244.1.1:37856: EOF 2018/07/30 10:22:30 http: TLS handshake error from 10.244.1.1:37862: EOF 2018/07/30 10:22:40 http: TLS handshake error from 10.244.1.1:37868: EOF 2018/07/30 10:22:50 http: TLS handshake error from 10.244.1.1:37874: EOF 2018/07/30 10:23:00 http: TLS handshake error from 10.244.1.1:37880: EOF 2018/07/30 10:23:10 http: TLS handshake error from 10.244.1.1:37886: EOF 2018/07/30 10:23:20 http: TLS handshake error from 10.244.1.1:37892: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:21:21.229565Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6h5c6 kind= uid=3beac2a7-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:21:21.420624Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi6h5c6\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi6h5c6" level=info timestamp=2018-07-30T10:21:51.851046Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirfff5 kind= uid=4e29e917-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:21:51.852171Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirfff5 kind= uid=4e29e917-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:21:52.366467Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirfff5\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmirfff5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4e29e917-93e2-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirfff5" level=info timestamp=2018-07-30T10:21:52.388863Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirfff5\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmirfff5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4e29e917-93e2-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirfff5" level=info timestamp=2018-07-30T10:22:22.560486Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmic8fwb kind= uid=6079464f-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:22:22.563295Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmic8fwb kind= uid=6079464f-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:22:23.069239Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmic8fwb\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmic8fwb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6079464f-93e2-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmic8fwb" level=info timestamp=2018-07-30T10:22:53.229797Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4zcjm kind= uid=72c11411-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:22:53.230826Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4zcjm kind= uid=72c11411-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:22:53.427174Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4zcjm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4zcjm" level=info timestamp=2018-07-30T10:23:23.861375Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi88l5p kind= uid=8502c8c0-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:23:23.864805Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi88l5p kind= uid=8502c8c0-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:23:24.056019Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi88l5p\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi88l5p" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.607465Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.607881Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.612458Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi22lf4" level=info timestamp=2018-07-30T10:14:11.622110Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.622257Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.638396Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi24vzl" level=info timestamp=2018-07-30T10:14:11.682637Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.793370Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.029048Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.029169Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.030737Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.037742Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.037837Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.040322Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:14:12.654113Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.654453Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.718921Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.719209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.720541Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.720649Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.721464Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.740855Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.741104Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.741235Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.741717Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.747788Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.748099Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.758463Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.758575Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi88l5p-mdnz7 Pod phase: Pending • Failure in Spec Setup (BeforeEach) [30.634 seconds] VNC /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:46 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:54 should upgrade subresource connections if an origin header is given [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 for vnc /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Expected success, but got an error: <*errors.StatusError | 0xc420e08bd0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:58 ------------------------------ Pod name: disks-images-provider-cmxpm Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-d7lwz Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-tjq8k Pod phase: Running 2018/07/30 10:21:30 http: TLS handshake error from 10.244.1.1:37826: EOF 2018/07/30 10:21:40 http: TLS handshake error from 10.244.1.1:37832: EOF 2018/07/30 10:21:50 http: TLS handshake error from 10.244.1.1:37838: EOF 2018/07/30 10:22:00 http: TLS handshake error from 10.244.1.1:37844: EOF 2018/07/30 10:22:10 http: TLS handshake error from 10.244.1.1:37850: EOF 2018/07/30 10:22:20 http: TLS handshake error from 10.244.1.1:37856: EOF 2018/07/30 10:22:30 http: TLS handshake error from 10.244.1.1:37862: EOF 2018/07/30 10:22:40 http: TLS handshake error from 10.244.1.1:37868: EOF 2018/07/30 10:22:50 http: TLS handshake error from 10.244.1.1:37874: EOF 2018/07/30 10:23:00 http: TLS handshake error from 10.244.1.1:37880: EOF 2018/07/30 10:23:10 http: TLS handshake error from 10.244.1.1:37886: EOF 2018/07/30 10:23:20 http: TLS handshake error from 10.244.1.1:37892: EOF 2018/07/30 10:23:30 http: TLS handshake error from 10.244.1.1:37898: EOF 2018/07/30 10:23:40 http: TLS handshake error from 10.244.1.1:37904: EOF 2018/07/30 10:23:50 http: TLS handshake error from 10.244.1.1:37910: EOF Pod name: virt-controller-7d57d96b65-d4wkj Pod phase: Running level=info timestamp=2018-07-30T10:10:09.870245Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-pcvlz Pod phase: Running level=info timestamp=2018-07-30T10:21:52.366467Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirfff5\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmirfff5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4e29e917-93e2-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirfff5" level=info timestamp=2018-07-30T10:21:52.388863Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirfff5\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmirfff5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4e29e917-93e2-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirfff5" level=info timestamp=2018-07-30T10:22:22.560486Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmic8fwb kind= uid=6079464f-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:22:22.563295Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmic8fwb kind= uid=6079464f-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:22:23.069239Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmic8fwb\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmic8fwb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6079464f-93e2-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmic8fwb" level=info timestamp=2018-07-30T10:22:53.229797Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4zcjm kind= uid=72c11411-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:22:53.230826Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4zcjm kind= uid=72c11411-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:22:53.427174Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4zcjm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4zcjm" level=info timestamp=2018-07-30T10:23:23.861375Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi88l5p kind= uid=8502c8c0-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:23:23.864805Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi88l5p kind= uid=8502c8c0-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-30T10:23:24.056019Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi88l5p\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi88l5p" level=info timestamp=2018-07-30T10:23:24.424451Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi88l5p\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi88l5p, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8502c8c0-93e2-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi88l5p" level=info timestamp=2018-07-30T10:23:24.444798Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi88l5p\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi88l5p, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8502c8c0-93e2-11e8-adf7-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi88l5p" level=info timestamp=2018-07-30T10:23:54.600779Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvminpjxc kind= uid=9755bba7-93e2-11e8-adf7-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-30T10:23:54.601804Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvminpjxc kind= uid=9755bba7-93e2-11e8-adf7-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-9pz9z Pod phase: Running level=info timestamp=2018-07-30T10:06:49.990260Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.607465Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.607881Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.612458Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi22lf4" level=info timestamp=2018-07-30T10:14:11.622110Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-30T10:14:11.622257Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:11.638396Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi24vzl" level=info timestamp=2018-07-30T10:14:11.682637Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind= uid=3a645eae-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:11.793370Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind= uid=3a69262e-93e0-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.029048Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.029169Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.030737Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi22lf4 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.037742Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.037837Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.040322Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi24vzl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-w4jj7 Pod phase: Running level=info timestamp=2018-07-30T10:14:12.654113Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.654453Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihwk9v kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.718921Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.719209Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi8bp2k kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.720541Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.720649Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.721464Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi9h86j kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.740855Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind= uid=26538483-93e1-11e8-adf7-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.741104Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-30T10:14:12.741235Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-30T10:14:12.741717Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmicdkqc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.747788Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.748099Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqhthf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-30T10:14:12.758463Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-30T10:14:12.758575Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmitxj5x kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvminpjxc-kdblx Pod phase: Pending • Failure in Spec Setup (BeforeEach) [30.781 seconds] VNC /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:46 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:54 should upgrade subresource connections if an origin header is given [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 for serial console /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Expected success, but got an error: <*errors.StatusError | 0xc420976630>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: {SelfLink: "", ResourceVersion: "", Continue: ""}, Status: "Failure", Message: "Timeout: request did not complete within allowed duration", Reason: "Timeout", Details: {Name: "", Group: "", Kind: "", UID: "", Causes: nil, RetryAfterSeconds: 0}, Code: 504, }, } Timeout: request did not complete within allowed duration /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:58 ------------------------------ Waiting for namespace kubevirt-test-default to be removed, this can take a while ... Waiting for namespace kubevirt-test-alternative to be removed, this can take a while ... Summarizing 58 Failures: [Fail] Health Monitoring A VirtualMachineInstance with a watchdog device [It] should be shut down when the watchdog expires /root/go/src/kubevirt.io/kubevirt/tests/vmi_monitoring_test.go:85 [Fail] Storage Starting a VirtualMachineInstance with Alpine PVC should be successfully started and stopped multiple times [It] with Disk PVC /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1065 [Fail] Storage Starting a VirtualMachineInstance with Alpine PVC should be successfully started and stopped multiple times [It] with CDRom PVC /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1065 [Fail] Storage Starting a VirtualMachineInstance With ephemeral alpine PVC [It] should not persist data /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1065 [Fail] Storage Starting a VirtualMachineInstance With VirtualMachineInstance with two PVCs [It] should start vmi multiple times /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1065 [Fail] VMIlifecycle Creating a VirtualMachineInstance [It] should attach virt-launcher to it /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:92 [Fail] VMIlifecycle Creating a VirtualMachineInstance when virt-handler is not responsive [BeforeEach] the node controller should react /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:379 [Fail] VMIlifecycle Creating a VirtualMachineInstance with node tainted [It] the vmi with tolerations should be scheduled /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:498 [Fail] VMIlifecycle Creating a VirtualMachineInstance with node tainted [It] the vmi without tolerations should not be scheduled /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:518 [Fail] VMIlifecycle Creating a VirtualMachineInstance VM Accelerated Mode [It] should request a KVM and TUN device /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:735 [Fail] VMIlifecycle Creating a VirtualMachineInstance VM Accelerated Mode [It] should not enable emulation in virt-launcher /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:770 [Fail] VMIlifecycle Delete a VirtualMachineInstance's Pod [It] should result in the VirtualMachineInstance moving to a finalized state /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:841 [Fail] VMIlifecycle Delete a VirtualMachineInstance with an active pod. [It] should result in pod being terminated /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:875 [Fail] VMIlifecycle Delete a VirtualMachineInstance with grace period greater than 0 [It] should run graceful shutdown /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:919 [Fail] VMIlifecycle Killed VirtualMachineInstance [It] should be in Failed phase /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:950 [Fail] VMIlifecycle Killed VirtualMachineInstance [It] should be left alone by virt-handler /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:977 [Fail] Slirp [BeforeEach] should be able to VirtualMachineInstance with slirp interface /root/go/src/kubevirt.io/kubevirt/tests/vmi_slirp_interface_test.go:58 [Fail] Slirp [BeforeEach] should be able to VirtualMachineInstance with slirp interface with custom MAC address /root/go/src/kubevirt.io/kubevirt/tests/vmi_slirp_interface_test.go:58 [Fail] LeaderElection Start a VirtualMachineInstance when the controller pod is not running [It] should success /root/go/src/kubevirt.io/kubevirt/tests/controller_leader_election_test.go:91 [Fail] VirtualMachine An invalid VirtualMachine given [It] should reject POST if validation webhoook deems the spec is invalid /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:103 [Fail] VirtualMachine A valid VirtualMachine given [It] should update VirtualMachine once VMIs are up /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 [Fail] VirtualMachine A valid VirtualMachine given [It] should remove VirtualMachineInstance once the VMI is marked for deletion /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 [Fail] VirtualMachine A valid VirtualMachine given [It] should remove owner references on the VirtualMachineInstance if it is orphan deleted /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 [Fail] VirtualMachine A valid VirtualMachine given [It] should recreate VirtualMachineInstance if it gets deleted /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 [Fail] VirtualMachine A valid VirtualMachine given [It] should recreate VirtualMachineInstance if the VirtualMachineInstance's pod gets deleted /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 [Fail] VirtualMachine A valid VirtualMachine given [It] should stop VirtualMachineInstance if running set to false /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 [Fail] VirtualMachine A valid VirtualMachine given [It] should start and stop VirtualMachineInstance multiple times /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 [Fail] VirtualMachine A valid VirtualMachine given [It] should not update the VirtualMachineInstance spec if Running /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 [Fail] VirtualMachine A valid VirtualMachine given [It] should survive guest shutdown, multiple times /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 [Fail] VirtualMachine A valid VirtualMachine given Using virtctl interface [It] should start a VirtualMachineInstance once /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 [Fail] VirtualMachine A valid VirtualMachine given Using virtctl interface [It] should stop a VirtualMachineInstance once /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:127 [Fail] VMIDefaults Disk defaults [It] Should be applied to VMIs /root/go/src/kubevirt.io/kubevirt/tests/vmidefaults_test.go:71 [Fail] Console A new VirtualMachineInstance with a serial console with a cirros image [It] should return that we are running cirros /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:51 [Fail] Console A new VirtualMachineInstance with a serial console with a fedora image [It] should return that we are running fedora /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:51 [Fail] Console A new VirtualMachineInstance with a serial console [It] should be able to reconnect to console multiple times /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:91 [Fail] Networking VirtualMachineInstance with custom MAC address [It] should configure custom MAC address /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:94 [Fail] Networking VirtualMachineInstance with custom MAC address in non-conventional format [It] should configure custom MAC address /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:435 [Fail] Networking VirtualMachineInstance with custom MAC address and slirp interface [It] should configure custom MAC address /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:448 [Fail] Networking VirtualMachineInstance with disabled automatic attachment of interfaces [It] should not configure any external interfaces /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:463 [Fail] VMIPreset CRD Validation [It] should reject POST if validation webhoook deems the spec is invalid /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:124 [Fail] VMIPreset Preset Matching [It] Should be accepted on POST /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:139 [Fail] VMIPreset Preset Matching [It] Should reject a second submission of a VMIPreset /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:147 [Fail] VMIPreset Preset Matching [It] Should reject presets that conflict with VirtualMachineInstance settings /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:169 [Fail] VMIPreset Preset Matching [It] Should accept presets that don't conflict with VirtualMachineInstance settings /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:189 [Fail] VMIPreset Preset Matching [It] Should ignore VMIs that don't match /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:214 [Fail] VMIPreset Preset Matching [It] Should not be applied to existing VMIs /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:236 [Fail] VMIPreset Exclusions [It] Should not apply presets to VirtualMachineInstance's with the exclusion marking /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:256 [Fail] VMIPreset Conflict [It] should not apply any presets in case of conflict /root/go/src/kubevirt.io/kubevirt/tests/vmipreset_test.go:309 [Fail] RegistryDisk Starting and stopping the same VirtualMachineInstance with ephemeral registry disk [It] should success multiple times /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:98 [Fail] RegistryDisk Starting a VirtualMachineInstance with ephemeral registry disk [It] should not modify the spec on status update /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:119 [Fail] RegistryDisk Starting multiple VMIs with ephemeral registry disk [It] should success /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:55 [Fail] CloudInit UserData A new VirtualMachineInstance with cloudInitNoCloud userDataBase64 source [It] should have cloud-init data /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:56 [Fail] CloudInit UserData A new VirtualMachineInstance with cloudInitNoCloud userDataBase64 source with injected ssh-key [It] should have ssh-key under authorized keys /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:56 [Fail] CloudInit UserData A new VirtualMachineInstance with cloudInitNoCloud userData source [It] should process provided cloud-init data /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:56 [Fail] CloudInit UserData A new VirtualMachineInstance [It] should take user-data from k8s secret /root/go/src/kubevirt.io/kubevirt/tests/vmi_userdata_test.go:56 [Fail] VNC A new VirtualMachineInstance [BeforeEach] with VNC connection should allow accessing the VNC device /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:58 [Fail] VNC A new VirtualMachineInstance [BeforeEach] should upgrade subresource connections if an origin header is given for vnc /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:58 [Fail] VNC A new VirtualMachineInstance [BeforeEach] should upgrade subresource connections if an origin header is given for serial console /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:58 Ran 133 of 149 Specs in 4169.041 seconds FAIL! -- 75 Passed | 58 Failed | 0 Pending | 16 Skipped --- FAIL: TestTests (4169.06s) FAIL make: *** [functest] Error 1 + make cluster-down ./cluster/down.sh