+ export WORKSPACE=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev + WORKSPACE=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev + [[ k8s-1.11.0-dev =~ openshift-.* ]] + [[ k8s-1.11.0-dev =~ .*-1.9.3-.* ]] + export KUBEVIRT_PROVIDER=k8s-1.10.3 + KUBEVIRT_PROVIDER=k8s-1.10.3 + export KUBEVIRT_NUM_NODES=2 + KUBEVIRT_NUM_NODES=2 + export NFS_WINDOWS_DIR=/home/nfs/images/windows2016 + NFS_WINDOWS_DIR=/home/nfs/images/windows2016 + export NAMESPACE=kube-system + NAMESPACE=kube-system + trap '{ make cluster-down; }' EXIT SIGINT SIGTERM SIGSTOP + make cluster-down ./cluster/down.sh + make cluster-up ./cluster/up.sh Downloading ....... Downloading ....... 2018/07/27 06:17:55 Waiting for host: 192.168.66.101:22 2018/07/27 06:17:58 Problem with dial: dial tcp 192.168.66.101:22: getsockopt: no route to host. Sleeping 5s 2018/07/27 06:18:06 Problem with dial: dial tcp 192.168.66.101:22: getsockopt: no route to host. Sleeping 5s 2018/07/27 06:18:11 Problem with dial: dial tcp 192.168.66.101:22: getsockopt: connection refused. Sleeping 5s 2018/07/27 06:18:16 Connected to tcp://192.168.66.101:22 + kubeadm init --config /etc/kubernetes/kubeadm.conf [init] Using Kubernetes version: v1.10.3 [init] Using Authorization modes: [Node RBAC] [preflight] Running pre-flight checks. [WARNING FileExisting-crictl]: crictl not found in system path Suggestion: go get github.com/kubernetes-incubator/cri-tools/cmd/crictl Flag --admission-control has been deprecated, Use --enable-admission-plugins or --disable-admission-plugins instead. Will be removed in a future version. [certificates] Generated ca certificate and key. [certificates] Generated apiserver certificate and key. [certificates] apiserver serving cert is signed for DNS names [node01 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 192.168.66.101] [certificates] Generated apiserver-kubelet-client certificate and key. [certificates] Generated etcd/ca certificate and key. [certificates] Generated etcd/server certificate and key. [certificates] etcd/server serving cert is signed for DNS names [localhost] and IPs [127.0.0.1] [certificates] Generated etcd/peer certificate and key. [certificates] etcd/peer serving cert is signed for DNS names [node01] and IPs [192.168.66.101] [certificates] Generated etcd/healthcheck-client certificate and key. [certificates] Generated apiserver-etcd-client certificate and key. [certificates] Generated sa key and public key. [certificates] Generated front-proxy-ca certificate and key. [certificates] Generated front-proxy-client certificate and key. [certificates] Valid certificates and keys now exist in "/etc/kubernetes/pki" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/admin.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/kubelet.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/controller-manager.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/scheduler.conf" [controlplane] Wrote Static Pod manifest for component kube-apiserver to "/etc/kubernetes/manifests/kube-apiserver.yaml" [controlplane] Wrote Static Pod manifest for component kube-controller-manager to "/etc/kubernetes/manifests/kube-controller-manager.yaml" [controlplane] Wrote Static Pod manifest for component kube-scheduler to "/etc/kubernetes/manifests/kube-scheduler.yaml" [etcd] Wrote Static Pod manifest for a local etcd instance to "/etc/kubernetes/manifests/etcd.yaml" [init] Waiting for the kubelet to boot up the control plane as Static Pods from directory "/etc/kubernetes/manifests". [init] This might take a minute or longer if the control plane images have to be pulled. [apiclient] All control plane components are healthy after 25.509833 seconds [uploadconfig] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace [markmaster] Will mark node node01 as master by adding a label and a taint [markmaster] Master node01 tainted and labelled with key/value: node-role.kubernetes.io/master="" [bootstraptoken] Using token: abcdef.1234567890123456 [bootstraptoken] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials [bootstraptoken] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token [bootstraptoken] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster [bootstraptoken] Creating the "cluster-info" ConfigMap in the "kube-public" namespace [addons] Applied essential addon: kube-dns [addons] Applied essential addon: kube-proxy Your Kubernetes master has initialized successfully! To start using your cluster, you need to run the following as a regular user: mkdir -p $HOME/.kube sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config sudo chown $(id -u):$(id -g) $HOME/.kube/config You should now deploy a pod network to the cluster. Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at: https://kubernetes.io/docs/concepts/cluster-administration/addons/ You can now join any number of machines by running the following on each node as root: kubeadm join 192.168.66.101:6443 --token abcdef.1234567890123456 --discovery-token-ca-cert-hash sha256:bbff3d067101e27c48dd3886116f1c62cc712473c48303360c3a98e7f9e25538 + kubectl --kubeconfig=/etc/kubernetes/admin.conf apply -f https://raw.githubusercontent.com/coreos/flannel/v0.9.1/Documentation/kube-flannel.yml clusterrole.rbac.authorization.k8s.io "flannel" created clusterrolebinding.rbac.authorization.k8s.io "flannel" created serviceaccount "flannel" created configmap "kube-flannel-cfg" created daemonset.extensions "kube-flannel-ds" created + kubectl --kubeconfig=/etc/kubernetes/admin.conf taint nodes node01 node-role.kubernetes.io/master:NoSchedule- node "node01" untainted 2018/07/27 06:19:00 Waiting for host: 192.168.66.102:22 2018/07/27 06:19:03 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: no route to host. Sleeping 5s 2018/07/27 06:19:11 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: no route to host. Sleeping 5s 2018/07/27 06:19:16 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: connection refused. Sleeping 5s 2018/07/27 06:19:21 Connected to tcp://192.168.66.102:22 + kubeadm join --token abcdef.1234567890123456 192.168.66.101:6443 --ignore-preflight-errors=all --discovery-token-unsafe-skip-ca-verification=true [preflight] Running pre-flight checks. [discovery] Trying to connect to API Server "192.168.66.101:6443" [discovery] Created cluster-info discovery client, requesting info from "https://192.168.66.101:6443" [WARNING FileExisting-crictl]: crictl not found in system path Suggestion: go get github.com/kubernetes-incubator/cri-tools/cmd/crictl [discovery] Cluster info signature and contents are valid and no TLS pinning was specified, will use API Server "192.168.66.101:6443" [discovery] Successfully established connection with API Server "192.168.66.101:6443" This node has joined the cluster: * Certificate signing request was sent to master and a response was received. * The Kubelet was informed of the new secure connection details. Run 'kubectl get nodes' on the master to see this node join the cluster. Sending file modes: C0755 39588992 kubectl Sending file modes: C0600 5454 admin.conf Cluster "kubernetes" set. Cluster "kubernetes" set. + set +e + kubectl get nodes --no-headers + cluster/kubectl.sh get nodes --no-headers node01 Ready master 56s v1.10.3 node02 Ready 24s v1.10.3 + kubectl_rc=0 + '[' 0 -ne 0 ']' ++ kubectl get nodes --no-headers ++ cluster/kubectl.sh get nodes --no-headers ++ grep NotReady + '[' -n '' ']' + set -e + echo 'Nodes are ready:' Nodes are ready: + kubectl get nodes + cluster/kubectl.sh get nodes NAME STATUS ROLES AGE VERSION node01 Ready master 57s v1.10.3 node02 Ready 25s v1.10.3 + make cluster-sync ./cluster/build.sh Building ... Untagged: localhost:32821/kubevirt/fedora-cloud-registry-disk-demo:devel Untagged: localhost:32821/kubevirt/fedora-cloud-registry-disk-demo@sha256:eb6b2be4adeca053c033494dbbea0b6db40de582d4949e038aa283b2486b8f02 Deleted: sha256:2cac63f8af128fe73ffbac396304cd354e2f16b0417ff2a347e2382571317f26 Deleted: sha256:aff50ef07c8f87bf94410d81348044407ffe6950950fff82f172eb2c916a38df Deleted: sha256:621e17887e06d6aca7d929e2d49dc5941f222a3ea648b008516dc7656158c58f Untagged: localhost:32821/kubevirt/cirros-registry-disk-demo:devel Untagged: localhost:32821/kubevirt/cirros-registry-disk-demo@sha256:2ffdba521b96fc4e6e368dd42e2620d247655f5246d5a43877047fdeda427390 Deleted: sha256:855532153f1e508d6b2e21c408fb5e44e4f34b4dabe79875422b718ab72bdb18 Deleted: sha256:eb9e01939a9f91b9d3f7a70a04b0b445a3aa07d7ed8b525b8128d47d1229ad2d Deleted: sha256:914cb87a0d23638cc3e258d3baa5a9420c326a37271aa909c00c10755a9345dd Deleted: sha256:4599b7494a9d00d65c45f0e4d85b300236c364068a3e94f0cbed6d10aa67c6a6 Untagged: localhost:32821/kubevirt/registry-disk-v1alpha:devel Untagged: localhost:32821/kubevirt/registry-disk-v1alpha@sha256:fb82c6069d1c39caed15ea00061f5f820cb353048f2ed80c8550ddd0c48348bd sha256:dcf2b21fa2ed11dcf9dbba21b1cca0ee3fad521a0e9aee61c06d0b0b66a4b200 go version go1.10 linux/amd64 go version go1.10 linux/amd64 make[1]: Entering directory `/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt' hack/dockerized "./hack/check.sh && KUBEVIRT_VERSION= ./hack/build-go.sh install " && ./hack/build-copy-artifacts.sh sha256:dcf2b21fa2ed11dcf9dbba21b1cca0ee3fad521a0e9aee61c06d0b0b66a4b200 go version go1.10 linux/amd64 go version go1.10 linux/amd64 find: '/root/go/src/kubevirt.io/kubevirt/_out/cmd': No such file or directory Compiling tests... compiled tests.test hack/build-docker.sh build Sending build context to Docker daemon 40.38 MB Step 1/8 : FROM fedora:28 ---> cc510acfcd70 Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virt-controller ---> Using cache ---> b00c84523b53 Step 4/8 : WORKDIR /home/virt-controller ---> Using cache ---> b76b8bd8cd39 Step 5/8 : USER 1001 ---> Using cache ---> b6d9ad9ed232 Step 6/8 : COPY virt-controller /usr/bin/virt-controller ---> 75153e63e399 Removing intermediate container 72c175313e91 Step 7/8 : ENTRYPOINT /usr/bin/virt-controller ---> Running in 37815f42bff7 ---> 23aa9ebbeba7 Removing intermediate container 37815f42bff7 Step 8/8 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev0" '' "virt-controller" '' ---> Running in 1db8fcc4bc15 ---> 97f2a22b7c14 Removing intermediate container 1db8fcc4bc15 Successfully built 97f2a22b7c14 Sending build context to Docker daemon 43.31 MB Step 1/10 : FROM kubevirt/libvirt:4.2.0 ---> 5f0bfe81a3e0 Step 2/10 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 945996802736 Step 3/10 : RUN dnf -y install socat genisoimage util-linux libcgroup-tools ethtool net-tools sudo && dnf -y clean all && test $(id -u qemu) = 107 # make sure that the qemu user really is 107 ---> Using cache ---> 672f9ab56316 Step 4/10 : COPY virt-launcher /usr/bin/virt-launcher ---> 0667ad96cf94 Removing intermediate container 1686383d7b90 Step 5/10 : COPY kubevirt-sudo /etc/sudoers.d/kubevirt ---> 1546af5ce827 Removing intermediate container fce8b181a6a6 Step 6/10 : RUN setcap CAP_NET_BIND_SERVICE=+eip /usr/bin/qemu-system-x86_64 ---> Running in 8731d1373280  ---> 785de5649030 Removing intermediate container 8731d1373280 Step 7/10 : RUN mkdir -p /usr/share/kubevirt/virt-launcher ---> Running in 0883b60fe624  ---> 31206d1c39e0 Removing intermediate container 0883b60fe624 Step 8/10 : COPY entrypoint.sh libvirtd.sh sock-connector /usr/share/kubevirt/virt-launcher/ ---> 5f3e4e44b6ca Removing intermediate container b125fc6d351c Step 9/10 : ENTRYPOINT /usr/share/kubevirt/virt-launcher/entrypoint.sh ---> Running in e50c208444d6 ---> da0ab303a2c8 Removing intermediate container e50c208444d6 Step 10/10 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev0" '' "virt-launcher" '' ---> Running in 5fbfe6c3be00 ---> 4cee503356b8 Removing intermediate container 5fbfe6c3be00 Successfully built 4cee503356b8 Sending build context to Docker daemon 41.69 MB Step 1/5 : FROM fedora:28 ---> cc510acfcd70 Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/5 : COPY virt-handler /usr/bin/virt-handler ---> 37c999a8abe7 Removing intermediate container 96eecbcb160b Step 4/5 : ENTRYPOINT /usr/bin/virt-handler ---> Running in ff50e683110c ---> 573ce1d0da07 Removing intermediate container ff50e683110c Step 5/5 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev0" '' "virt-handler" '' ---> Running in 85bae83256a3 ---> b4c744821c75 Removing intermediate container 85bae83256a3 Successfully built b4c744821c75 Sending build context to Docker daemon 38.81 MB Step 1/8 : FROM fedora:28 ---> cc510acfcd70 Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virt-api ---> Using cache ---> ed1ebf600ee1 Step 4/8 : WORKDIR /home/virt-api ---> Using cache ---> 0769dad023e5 Step 5/8 : USER 1001 ---> Using cache ---> 0cb65afb0c2b Step 6/8 : COPY virt-api /usr/bin/virt-api ---> 28841773c558 Removing intermediate container 5c4e4614d2f8 Step 7/8 : ENTRYPOINT /usr/bin/virt-api ---> Running in 696fc70677d9 ---> 580168497302 Removing intermediate container 696fc70677d9 Step 8/8 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev0" '' "virt-api" '' ---> Running in c4040eab3a34 ---> d7852ae15b27 Removing intermediate container c4040eab3a34 Successfully built d7852ae15b27 Sending build context to Docker daemon 4.096 kB Step 1/7 : FROM fedora:28 ---> cc510acfcd70 Step 2/7 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/7 : ENV container docker ---> Using cache ---> 62847a2a1fa8 Step 4/7 : RUN mkdir -p /images/custom /images/alpine && truncate -s 64M /images/custom/disk.img && curl http://dl-cdn.alpinelinux.org/alpine/v3.7/releases/x86_64/alpine-virt-3.7.0-x86_64.iso > /images/alpine/disk.img ---> Using cache ---> 02134835a6aa Step 5/7 : ADD entrypoint.sh / ---> Using cache ---> ec0843818da7 Step 6/7 : CMD /entrypoint.sh ---> Using cache ---> 754029bb4bd2 Step 7/7 : LABEL "disks-images-provider" '' "kubevirt-functional-tests-k8s-1.11.0-dev0" '' ---> Using cache ---> ce29f424cc93 Successfully built ce29f424cc93 Sending build context to Docker daemon 2.56 kB Step 1/5 : FROM fedora:28 ---> cc510acfcd70 Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/5 : ENV container docker ---> Using cache ---> 62847a2a1fa8 Step 4/5 : RUN dnf -y install procps-ng nmap-ncat && dnf -y clean all ---> Using cache ---> 207487abe7b2 Step 5/5 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev0" '' "vm-killer" '' ---> Using cache ---> 08e9fdc44c13 Successfully built 08e9fdc44c13 Sending build context to Docker daemon 5.12 kB Step 1/7 : FROM debian:sid ---> 68f33cf86aab Step 2/7 : MAINTAINER "David Vossel" \ ---> Using cache ---> 5734d749eb5c Step 3/7 : ENV container docker ---> Using cache ---> f8775a77966f Step 4/7 : RUN apt-get update && apt-get install -y bash curl bzip2 qemu-utils && mkdir -p /disk && rm -rf /var/lib/apt/lists/* ---> Using cache ---> 1a40cf222a61 Step 5/7 : ADD entry-point.sh / ---> Using cache ---> 77b545d92fe7 Step 6/7 : CMD /entry-point.sh ---> Using cache ---> dfe20d463305 Step 7/7 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev0" '' "registry-disk-v1alpha" '' ---> Using cache ---> 8de7f4959dd4 Successfully built 8de7f4959dd4 Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33021/kubevirt/registry-disk-v1alpha:devel ---> 8de7f4959dd4 Step 2/4 : MAINTAINER "David Vossel" \ ---> Using cache ---> 49a3f493dc16 Step 3/4 : RUN curl https://download.cirros-cloud.net/0.4.0/cirros-0.4.0-x86_64-disk.img > /disk/cirros.img ---> Using cache ---> 8e5011e93ffa Step 4/4 : LABEL "cirros-registry-disk-demo" '' "kubevirt-functional-tests-k8s-1.11.0-dev0" '' ---> Using cache ---> a1b0ec251983 Successfully built a1b0ec251983 Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33021/kubevirt/registry-disk-v1alpha:devel ---> 8de7f4959dd4 Step 2/4 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> d22f57947ffb Step 3/4 : RUN curl -g -L https://download.fedoraproject.org/pub/fedora/linux/releases/27/CloudImages/x86_64/images/Fedora-Cloud-Base-27-1.6.x86_64.qcow2 > /disk/fedora.qcow2 ---> Using cache ---> 5c1be4f0e759 Step 4/4 : LABEL "fedora-cloud-registry-disk-demo" '' "kubevirt-functional-tests-k8s-1.11.0-dev0" '' ---> Using cache ---> 0d3284ce9dbb Successfully built 0d3284ce9dbb Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33021/kubevirt/registry-disk-v1alpha:devel ---> 8de7f4959dd4 Step 2/4 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> d22f57947ffb Step 3/4 : RUN curl http://dl-cdn.alpinelinux.org/alpine/v3.7/releases/x86_64/alpine-virt-3.7.0-x86_64.iso > /disk/alpine.iso ---> Using cache ---> b3fefa2de4bc Step 4/4 : LABEL "alpine-registry-disk-demo" '' "kubevirt-functional-tests-k8s-1.11.0-dev0" '' ---> Using cache ---> 0c1cb3296027 Successfully built 0c1cb3296027 Sending build context to Docker daemon 35.59 MB Step 1/8 : FROM fedora:28 ---> cc510acfcd70 Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virtctl ---> Using cache ---> 985fe391c056 Step 4/8 : WORKDIR /home/virtctl ---> Using cache ---> 3b2cae8ac543 Step 5/8 : USER 1001 ---> Using cache ---> 0c06e5b4a900 Step 6/8 : COPY subresource-access-test /subresource-access-test ---> 53f349cb5ba6 Removing intermediate container 4261b24fd620 Step 7/8 : ENTRYPOINT /subresource-access-test ---> Running in e0debaed96af ---> 8b2a255e685d Removing intermediate container e0debaed96af Step 8/8 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev0" '' "subresource-access-test" '' ---> Running in 7b7b5159a9dc ---> e32a17fd9640 Removing intermediate container 7b7b5159a9dc Successfully built e32a17fd9640 Sending build context to Docker daemon 3.072 kB Step 1/9 : FROM fedora:28 ---> cc510acfcd70 Step 2/9 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> bfe77d5699ed Step 3/9 : ENV container docker ---> Using cache ---> 62847a2a1fa8 Step 4/9 : RUN dnf -y install make git gcc && dnf -y clean all ---> Using cache ---> d3456b1644b1 Step 5/9 : ENV GIMME_GO_VERSION 1.9.2 ---> Using cache ---> 0ba81fddbba1 Step 6/9 : RUN mkdir -p /gimme && curl -sL https://raw.githubusercontent.com/travis-ci/gimme/master/gimme | HOME=/gimme bash >> /etc/profile.d/gimme.sh ---> Using cache ---> 5d33abe3f819 Step 7/9 : ENV GOPATH "/go" GOBIN "/usr/bin" ---> Using cache ---> 783826523be1 Step 8/9 : RUN mkdir -p /go && source /etc/profile.d/gimme.sh && go get github.com/masterzen/winrm-cli ---> Using cache ---> 711bc8d15952 Step 9/9 : LABEL "kubevirt-functional-tests-k8s-1.11.0-dev0" '' "winrmcli" '' ---> Running in b6dfcc5c9e08 ---> 7693f5193568 Removing intermediate container b6dfcc5c9e08 Successfully built 7693f5193568 Sending build context to Docker daemon 36.79 MB Step 1/5 : FROM fedora:27 ---> 9110ae7f579f Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> e3238544ad97 Step 3/5 : COPY example-hook-sidecar /example-hook-sidecar ---> e86b885cab32 Removing intermediate container 1c08cfa58581 Step 4/5 : ENTRYPOINT /example-hook-sidecar ---> Running in a8c0fc1ad666 ---> 9d1cf3c2b487 Removing intermediate container a8c0fc1ad666 Step 5/5 : LABEL "example-hook-sidecar" '' "kubevirt-functional-tests-k8s-1.11.0-dev0" '' ---> Running in 1c3fadd4fed8 ---> 1cbb65662543 Removing intermediate container 1c3fadd4fed8 Successfully built 1cbb65662543 hack/build-docker.sh push The push refers to a repository [localhost:33021/kubevirt/virt-controller] 199d5a885e6b: Preparing aa89340cf7a8: Preparing 891e1e4ef82a: Preparing aa89340cf7a8: Pushed 199d5a885e6b: Pushed 891e1e4ef82a: Pushed devel: digest: sha256:41f1dd6b8a631cb4f271b7f6dd738e45187337ebc605536cbb030a3ceb8c42dd size: 949 The push refers to a repository [localhost:33021/kubevirt/virt-launcher] c62252612106: Preparing 64c26d28633a: Preparing 73476dd395b6: Preparing cb10bfe724ac: Preparing 4e32917b2c5b: Preparing 633427c64a24: Preparing da38cf808aa5: Preparing b83399358a92: Preparing 64c26d28633a: Waiting 186d8b3e4fd8: Preparing fa6154170bf5: Preparing 73476dd395b6: Waiting 5eefb9960a36: Preparing 891e1e4ef82a: Preparing 633427c64a24: Waiting 4e32917b2c5b: Waiting 186d8b3e4fd8: Waiting b83399358a92: Waiting da38cf808aa5: Waiting fa6154170bf5: Waiting c62252612106: Pushed 64c26d28633a: Pushed cb10bfe724ac: Pushed 73476dd395b6: Pushed da38cf808aa5: Pushed b83399358a92: Pushed 186d8b3e4fd8: Pushed fa6154170bf5: Pushed 891e1e4ef82a: Mounted from kubevirt/virt-controller 633427c64a24: Pushed 4e32917b2c5b: Pushed 5eefb9960a36: Pushed devel: digest: sha256:fe26f6b317327351d0fb63fba956d69fb433aae95432e918c33a8f55a45fc31c size: 2828 The push refers to a repository [localhost:33021/kubevirt/virt-handler] d9a2f0b207d9: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/virt-launcher d9a2f0b207d9: Pushed devel: digest: sha256:faed5d93067df538b130d58e3abc26efbe484463e7b476afa385568cc2eb0689 size: 741 The push refers to a repository [localhost:33021/kubevirt/virt-api] 264aae7048b5: Preparing 82fc744c99b4: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/virt-handler 82fc744c99b4: Pushed 264aae7048b5: Pushed devel: digest: sha256:ebf55fe7f4c4e9432daa8babe1276b1e7497665805f2aa650fc4461ddad8a388 size: 948 The push refers to a repository [localhost:33021/kubevirt/disks-images-provider] 71ad31feb2c5: Preparing 21d4b721776e: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/virt-api 71ad31feb2c5: Pushed 21d4b721776e: Pushed devel: digest: sha256:93a2d8fbd58f732bcc0ddfa782eb0ec8b66841da3432d4d076031b0cf0374893 size: 948 The push refers to a repository [localhost:33021/kubevirt/vm-killer] c4cfadeeaf5f: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/disks-images-provider c4cfadeeaf5f: Pushed devel: digest: sha256:1c6e16fdf1220d75998f09c67409a225579ff3e3d90208aa38d8f824316c1437 size: 740 The push refers to a repository [localhost:33021/kubevirt/registry-disk-v1alpha] 661cce8d8e52: Preparing 41e0baba3077: Preparing 25edbec0eaea: Preparing 661cce8d8e52: Pushed 41e0baba3077: Pushed 25edbec0eaea: Pushed devel: digest: sha256:03a06bd0321a8a1693e5ef2e7fac4e99c8a868c8d67c89d00d29393fc49834cf size: 948 The push refers to a repository [localhost:33021/kubevirt/cirros-registry-disk-demo] ce69c857cc6c: Preparing 661cce8d8e52: Preparing 41e0baba3077: Preparing 25edbec0eaea: Preparing 41e0baba3077: Mounted from kubevirt/registry-disk-v1alpha 25edbec0eaea: Mounted from kubevirt/registry-disk-v1alpha 661cce8d8e52: Mounted from kubevirt/registry-disk-v1alpha ce69c857cc6c: Pushed devel: digest: sha256:eaac17e61b627a9d84311f369185deb054f9e728f308695d91d7bedc9e1dcb86 size: 1160 The push refers to a repository [localhost:33021/kubevirt/fedora-cloud-registry-disk-demo] ac5988afc68a: Preparing 661cce8d8e52: Preparing 41e0baba3077: Preparing 25edbec0eaea: Preparing 25edbec0eaea: Mounted from kubevirt/cirros-registry-disk-demo 41e0baba3077: Mounted from kubevirt/cirros-registry-disk-demo 661cce8d8e52: Mounted from kubevirt/cirros-registry-disk-demo ac5988afc68a: Pushed devel: digest: sha256:bcd44fd2ce40c282482794eee80e6b10c3ff2a8be2b4c36c26d12a732df91434 size: 1161 The push refers to a repository [localhost:33021/kubevirt/alpine-registry-disk-demo] 2670ecb7d9d9: Preparing 661cce8d8e52: Preparing 41e0baba3077: Preparing 25edbec0eaea: Preparing 25edbec0eaea: Mounted from kubevirt/fedora-cloud-registry-disk-demo 41e0baba3077: Mounted from kubevirt/fedora-cloud-registry-disk-demo 661cce8d8e52: Mounted from kubevirt/fedora-cloud-registry-disk-demo 2670ecb7d9d9: Pushed devel: digest: sha256:82f5ee9b5fd9f1095618f692bae697f204012415acada61cadd3465f2075818d size: 1160 The push refers to a repository [localhost:33021/kubevirt/subresource-access-test] 3246dec4ef5f: Preparing 25cb73590a9d: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/vm-killer 25cb73590a9d: Pushed 3246dec4ef5f: Pushed devel: digest: sha256:f1273bf840102178ce4888378af22248940da90f881aade6978a72cda4dbf1b4 size: 948 The push refers to a repository [localhost:33021/kubevirt/winrmcli] f8083e002d0b: Preparing 53c709abc882: Preparing 9ca98a0f492b: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Waiting f8083e002d0b: Pushed 891e1e4ef82a: Mounted from kubevirt/subresource-access-test 9ca98a0f492b: Pushed 53c709abc882: Pushed devel: digest: sha256:b90cb25cae51d5b205fd12ac5d635365f53da75eed215e41c0e50e01d75c9bf1 size: 1165 The push refers to a repository [localhost:33021/kubevirt/example-hook-sidecar] b741817bfda1: Preparing 39bae602f753: Preparing b741817bfda1: Pushed 39bae602f753: Pushed devel: digest: sha256:f48fa364163266c94c36c8a3c755a3c5b68b23ab2fd1bb0e4203d8107bbefd1a size: 740 make[1]: Leaving directory `/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt' Done ./cluster/clean.sh + source hack/common.sh ++++ dirname 'hack/common.sh[0]' +++ cd hack/../ +++ pwd ++ KUBEVIRT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt ++ OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out ++ VENDOR_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/vendor ++ CMD_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/cmd ++ TESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/tests ++ APIDOCS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/apidocs ++ MANIFESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/manifests ++ MANIFEST_TEMPLATES_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/templates/manifests ++ PYTHON_CLIENT_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/client-python ++ KUBEVIRT_PROVIDER=k8s-1.10.3 ++ KUBEVIRT_NUM_NODES=2 ++ '[' -z kubevirt-functional-tests-k8s-1.11.0-dev ']' ++ provider_prefix=kubevirt-functional-tests-k8s-1.11.0-dev0 ++ job_prefix=kubevirt-functional-tests-k8s-1.11.0-dev0 +++ kubevirt_version +++ '[' -n '' ']' +++ '[' -d /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/.git ']' ++++ git describe --always --tags +++ echo v0.7.0-138-g319cb65 ++ KUBEVIRT_VERSION=v0.7.0-138-g319cb65 + source cluster/k8s-1.10.3/provider.sh ++ set -e ++ image=k8s-1.10.3@sha256:d6290260e7e6b84419984f12719cf592ccbe327373b8df76aa0481f8ec01d357 ++ source cluster/ephemeral-provider-common.sh +++ set -e +++ _cli='docker run --privileged --net=host --rm -v /var/run/docker.sock:/var/run/docker.sock kubevirtci/gocli@sha256:aa7f295a7908fa333ab5e98ef3af0bfafbabfd3cee2b83f9af47f722e3000f6a' + source hack/config.sh ++ unset binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig manifest_docker_prefix namespace ++ KUBEVIRT_PROVIDER=k8s-1.10.3 ++ KUBEVIRT_PROVIDER=k8s-1.10.3 ++ source hack/config-default.sh source hack/config-k8s-1.10.3.sh +++ binaries='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virtctl cmd/fake-qemu-process cmd/virt-api cmd/subresource-access-test cmd/example-hook-sidecar' +++ docker_images='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virt-api images/disks-images-provider images/vm-killer cmd/registry-disk-v1alpha images/cirros-registry-disk-demo images/fedora-cloud-registry-disk-demo images/alpine-registry-disk-demo cmd/subresource-access-test images/winrmcli cmd/example-hook-sidecar' +++ docker_prefix=kubevirt +++ docker_tag=latest +++ master_ip=192.168.200.2 +++ network_provider=flannel +++ namespace=kube-system ++ test -f hack/config-provider-k8s-1.10.3.sh ++ source hack/config-provider-k8s-1.10.3.sh +++ master_ip=127.0.0.1 +++ docker_tag=devel +++ kubeconfig=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/cluster/k8s-1.10.3/.kubeconfig +++ kubectl=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/cluster/k8s-1.10.3/.kubectl +++ docker_prefix=localhost:33021/kubevirt +++ manifest_docker_prefix=registry:5000/kubevirt ++ test -f hack/config-local.sh ++ export binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig namespace + echo 'Cleaning up ...' Cleaning up ... + cluster/kubectl.sh get vmis --all-namespaces -o=custom-columns=NAME:.metadata.name,NAMESPACE:.metadata.namespace,FINALIZERS:.metadata.finalizers --no-headers + grep foregroundDeleteVirtualMachine + read p error: the server doesn't have a resource type "vmis" + _kubectl delete ds -l kubevirt.io -n kube-system --cascade=false --grace-period 0 No resources found + _kubectl delete pods -n kube-system -l=kubevirt.io=libvirt --force --grace-period 0 No resources found + _kubectl delete pods -n kube-system -l=kubevirt.io=virt-handler --force --grace-period 0 No resources found + namespaces=(default ${namespace}) + for i in '${namespaces[@]}' + _kubectl -n default delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete apiservices -l kubevirt.io No resources found + _kubectl -n default delete deployment -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete deployment -l kubevirt.io No resources found + _kubectl -n default delete rs -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete rs -l kubevirt.io No resources found + _kubectl -n default delete services -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete services -l kubevirt.io No resources found + _kubectl -n default delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete apiservices -l kubevirt.io No resources found + _kubectl -n default delete validatingwebhookconfiguration -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete validatingwebhookconfiguration -l kubevirt.io No resources found + _kubectl -n default delete secrets -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete secrets -l kubevirt.io No resources found + _kubectl -n default delete pv -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete pv -l kubevirt.io No resources found + _kubectl -n default delete pvc -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete pvc -l kubevirt.io No resources found + _kubectl -n default delete ds -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete ds -l kubevirt.io No resources found + _kubectl -n default delete customresourcedefinitions -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete customresourcedefinitions -l kubevirt.io No resources found + _kubectl -n default delete pods -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete pods -l kubevirt.io No resources found + _kubectl -n default delete clusterrolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete clusterrolebinding -l kubevirt.io No resources found + _kubectl -n default delete rolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete rolebinding -l kubevirt.io No resources found + _kubectl -n default delete roles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete roles -l kubevirt.io No resources found + _kubectl -n default delete clusterroles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete clusterroles -l kubevirt.io No resources found + _kubectl -n default delete serviceaccounts -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n default delete serviceaccounts -l kubevirt.io No resources found ++ _kubectl -n default get crd offlinevirtualmachines.kubevirt.io ++ export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig ++ KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig ++ cluster/k8s-1.10.3/.kubectl -n default get crd offlinevirtualmachines.kubevirt.io ++ wc -l Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "offlinevirtualmachines.kubevirt.io" not found + '[' 0 -gt 0 ']' + for i in '${namespaces[@]}' + _kubectl -n kube-system delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete apiservices -l kubevirt.io No resources found + _kubectl -n kube-system delete deployment -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete deployment -l kubevirt.io No resources found + _kubectl -n kube-system delete rs -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete rs -l kubevirt.io No resources found + _kubectl -n kube-system delete services -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete services -l kubevirt.io No resources found + _kubectl -n kube-system delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete apiservices -l kubevirt.io No resources found + _kubectl -n kube-system delete validatingwebhookconfiguration -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete validatingwebhookconfiguration -l kubevirt.io No resources found + _kubectl -n kube-system delete secrets -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete secrets -l kubevirt.io No resources found + _kubectl -n kube-system delete pv -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete pv -l kubevirt.io No resources found + _kubectl -n kube-system delete pvc -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete pvc -l kubevirt.io No resources found + _kubectl -n kube-system delete ds -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete ds -l kubevirt.io No resources found + _kubectl -n kube-system delete customresourcedefinitions -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete customresourcedefinitions -l kubevirt.io No resources found + _kubectl -n kube-system delete pods -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete pods -l kubevirt.io No resources found + _kubectl -n kube-system delete clusterrolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete clusterrolebinding -l kubevirt.io No resources found + _kubectl -n kube-system delete rolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete rolebinding -l kubevirt.io No resources found + _kubectl -n kube-system delete roles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete roles -l kubevirt.io No resources found + _kubectl -n kube-system delete clusterroles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete clusterroles -l kubevirt.io No resources found + _kubectl -n kube-system delete serviceaccounts -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl -n kube-system delete serviceaccounts -l kubevirt.io No resources found ++ _kubectl -n kube-system get crd offlinevirtualmachines.kubevirt.io ++ wc -l ++ export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig ++ KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig ++ cluster/k8s-1.10.3/.kubectl -n kube-system get crd offlinevirtualmachines.kubevirt.io Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "offlinevirtualmachines.kubevirt.io" not found + '[' 0 -gt 0 ']' + sleep 2 + echo Done Done ./cluster/deploy.sh + source hack/common.sh ++++ dirname 'hack/common.sh[0]' +++ cd hack/../ +++ pwd ++ KUBEVIRT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt ++ OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out ++ VENDOR_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/vendor ++ CMD_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/cmd ++ TESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/tests ++ APIDOCS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/apidocs ++ MANIFESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/manifests ++ MANIFEST_TEMPLATES_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/templates/manifests ++ PYTHON_CLIENT_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/client-python ++ KUBEVIRT_PROVIDER=k8s-1.10.3 ++ KUBEVIRT_NUM_NODES=2 ++ '[' -z kubevirt-functional-tests-k8s-1.11.0-dev ']' ++ provider_prefix=kubevirt-functional-tests-k8s-1.11.0-dev0 ++ job_prefix=kubevirt-functional-tests-k8s-1.11.0-dev0 +++ kubevirt_version +++ '[' -n '' ']' +++ '[' -d /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/.git ']' ++++ git describe --always --tags +++ echo v0.7.0-138-g319cb65 ++ KUBEVIRT_VERSION=v0.7.0-138-g319cb65 + source cluster/k8s-1.10.3/provider.sh ++ set -e ++ image=k8s-1.10.3@sha256:d6290260e7e6b84419984f12719cf592ccbe327373b8df76aa0481f8ec01d357 ++ source cluster/ephemeral-provider-common.sh +++ set -e +++ _cli='docker run --privileged --net=host --rm -v /var/run/docker.sock:/var/run/docker.sock kubevirtci/gocli@sha256:aa7f295a7908fa333ab5e98ef3af0bfafbabfd3cee2b83f9af47f722e3000f6a' + source hack/config.sh ++ unset binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig manifest_docker_prefix namespace ++ KUBEVIRT_PROVIDER=k8s-1.10.3 ++ KUBEVIRT_PROVIDER=k8s-1.10.3 ++ source hack/config-default.sh source hack/config-k8s-1.10.3.sh +++ binaries='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virtctl cmd/fake-qemu-process cmd/virt-api cmd/subresource-access-test cmd/example-hook-sidecar' +++ docker_images='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virt-api images/disks-images-provider images/vm-killer cmd/registry-disk-v1alpha images/cirros-registry-disk-demo images/fedora-cloud-registry-disk-demo images/alpine-registry-disk-demo cmd/subresource-access-test images/winrmcli cmd/example-hook-sidecar' +++ docker_prefix=kubevirt +++ docker_tag=latest +++ master_ip=192.168.200.2 +++ network_provider=flannel +++ namespace=kube-system ++ test -f hack/config-provider-k8s-1.10.3.sh ++ source hack/config-provider-k8s-1.10.3.sh +++ master_ip=127.0.0.1 +++ docker_tag=devel +++ kubeconfig=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/cluster/k8s-1.10.3/.kubeconfig +++ kubectl=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/cluster/k8s-1.10.3/.kubectl +++ docker_prefix=localhost:33021/kubevirt +++ manifest_docker_prefix=registry:5000/kubevirt ++ test -f hack/config-local.sh ++ export binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig namespace + echo 'Deploying ...' Deploying ... + [[ -z k8s-1.11.0-dev ]] + [[ k8s-1.11.0-dev =~ .*-dev ]] + _kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/manifests/dev -R + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/manifests/dev -R serviceaccount "kubevirt-apiserver" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-apiserver" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-apiserver-auth-delegator" created rolebinding.rbac.authorization.k8s.io "kubevirt-apiserver" created role.rbac.authorization.k8s.io "kubevirt-apiserver" created clusterrole.rbac.authorization.k8s.io "kubevirt-apiserver" created clusterrole.rbac.authorization.k8s.io "kubevirt-controller" created serviceaccount "kubevirt-controller" created serviceaccount "kubevirt-privileged" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-controller" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-controller-cluster-admin" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-privileged-cluster-admin" created clusterrole.rbac.authorization.k8s.io "kubevirt.io:admin" created clusterrole.rbac.authorization.k8s.io "kubevirt.io:edit" created clusterrole.rbac.authorization.k8s.io "kubevirt.io:view" created clusterrole.rbac.authorization.k8s.io "kubevirt.io:default" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt.io:default" created customresourcedefinition.apiextensions.k8s.io "virtualmachineinstancereplicasets.kubevirt.io" created service "virt-api" created deployment.extensions "virt-api" created service "virt-controller" created deployment.extensions "virt-controller" created daemonset.extensions "virt-handler" created customresourcedefinition.apiextensions.k8s.io "virtualmachines.kubevirt.io" created customresourcedefinition.apiextensions.k8s.io "virtualmachineinstances.kubevirt.io" created customresourcedefinition.apiextensions.k8s.io "virtualmachineinstancepresets.kubevirt.io" created + _kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/manifests/testing -R + export KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.3/.kubeconfig + cluster/k8s-1.10.3/.kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/go/src/kubevirt.io/kubevirt/_out/manifests/testing -R persistentvolumeclaim "disk-alpine" created persistentvolume "host-path-disk-alpine" created persistentvolumeclaim "disk-custom" created persistentvolume "host-path-disk-custom" created daemonset.extensions "disks-images-provider" created serviceaccount "kubevirt-testing" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-testing-cluster-admin" created + [[ k8s-1.10.3 =~ os-* ]] + echo Done Done + namespaces=(kube-system default) + [[ kube-system != \k\u\b\e\-\s\y\s\t\e\m ]] + timeout=300 + sample=30 + for i in '${namespaces[@]}' + current_time=0 ++ kubectl get pods -n kube-system --no-headers ++ grep -v Running ++ cluster/kubectl.sh get pods -n kube-system --no-headers + '[' -n 'virt-api-7586947775-gg8jc 0/1 ContainerCreating 0 5s virt-controller-7d57d96b65-9xnqb 0/1 ContainerCreating 0 5s virt-controller-7d57d96b65-bjr94 0/1 ContainerCreating 0 5s virt-handler-mwlnz 0/1 ContainerCreating 0 5s virt-handler-xc8bs 0/1 ContainerCreating 0 4s' ']' + echo 'Waiting for kubevirt pods to enter the Running state ...' Waiting for kubevirt pods to enter the Running state ... + kubectl get pods -n kube-system --no-headers + grep -v Running + cluster/kubectl.sh get pods -n kube-system --no-headers disks-images-provider-tkjs9 0/1 Pending 0 2s disks-images-provider-vtv7n 0/1 ContainerCreating 0 2s virt-api-7586947775-gg8jc 0/1 ContainerCreating 0 6s virt-controller-7d57d96b65-9xnqb 0/1 ContainerCreating 0 6s virt-controller-7d57d96b65-bjr94 0/1 ContainerCreating 0 6s virt-handler-mwlnz 0/1 ContainerCreating 0 6s virt-handler-xc8bs 0/1 ContainerCreating 0 5s + sleep 30 + current_time=30 + '[' 30 -gt 300 ']' ++ kubectl get pods -n kube-system --no-headers ++ cluster/kubectl.sh get pods -n kube-system --no-headers ++ grep -v Running + '[' -n '' ']' + current_time=0 ++ kubectl get pods -n kube-system '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers ++ cluster/kubectl.sh get pods -n kube-system '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers ++ grep false + '[' -n '' ']' + kubectl get pods -n kube-system + cluster/kubectl.sh get pods -n kube-system NAME READY STATUS RESTARTS AGE disks-images-provider-tkjs9 1/1 Running 0 35s disks-images-provider-vtv7n 1/1 Running 0 35s etcd-node01 1/1 Running 0 18m kube-apiserver-node01 1/1 Running 0 18m kube-controller-manager-node01 1/1 Running 0 18m kube-dns-86f4d74b45-hggwt 3/3 Running 0 19m kube-flannel-ds-lxz2b 1/1 Running 0 19m kube-flannel-ds-v9mt7 1/1 Running 0 19m kube-proxy-cc8v9 1/1 Running 0 19m kube-proxy-f8nhs 1/1 Running 0 19m kube-scheduler-node01 1/1 Running 0 18m virt-api-7586947775-gg8jc 1/1 Running 0 39s virt-controller-7d57d96b65-9xnqb 1/1 Running 0 39s virt-controller-7d57d96b65-bjr94 1/1 Running 0 39s virt-handler-mwlnz 1/1 Running 0 39s virt-handler-xc8bs 1/1 Running 0 38s + for i in '${namespaces[@]}' + current_time=0 ++ kubectl get pods -n default --no-headers ++ grep -v Running ++ cluster/kubectl.sh get pods -n default --no-headers No resources found. + '[' -n '' ']' + current_time=0 ++ kubectl get pods -n default '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers ++ grep false ++ cluster/kubectl.sh get pods -n default '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers + '[' -n '' ']' + kubectl get pods -n default + cluster/kubectl.sh get pods -n default No resources found. + kubectl version + cluster/kubectl.sh version Client Version: version.Info{Major:"1", Minor:"10", GitVersion:"v1.10.3", GitCommit:"2bba0127d85d5a46ab4b778548be28623b32d0b0", GitTreeState:"clean", BuildDate:"2018-05-21T09:17:39Z", GoVersion:"go1.9.3", Compiler:"gc", Platform:"linux/amd64"} Server Version: version.Info{Major:"1", Minor:"10", GitVersion:"v1.10.3", GitCommit:"2bba0127d85d5a46ab4b778548be28623b32d0b0", GitTreeState:"clean", BuildDate:"2018-05-21T09:05:37Z", GoVersion:"go1.9.3", Compiler:"gc", Platform:"linux/amd64"} + ginko_params='--ginkgo.noColor --junit-output=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/junit.xml' + [[ k8s-1.11.0-dev =~ windows.* ]] + FUNC_TEST_ARGS='--ginkgo.noColor --junit-output=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.11.0-dev/junit.xml' + make functest hack/dockerized "hack/build-func-tests.sh" sha256:dcf2b21fa2ed11dcf9dbba21b1cca0ee3fad521a0e9aee61c06d0b0b66a4b200 go version go1.10 linux/amd64 go version go1.10 linux/amd64 Compiling tests... compiled tests.test hack/functests.sh Running Suite: Tests Suite ========================== Random Seed: 1532673525 Will run 148 of 148 specs S [SKIPPING] in Spec Setup (BeforeEach) [0.002 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 should succeed to generate a VM JSON file using oc-process command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:150 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1393 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.002 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 with given VM JSON from the Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:152 should succeed to create a VM using oc-create command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:156 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1393 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.002 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 with given VM JSON from the Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:152 with given VM from the VM JSON /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:158 should succeed to launch a VMI using oc-patch command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:161 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1393 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.002 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 with given VM JSON from the Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:152 with given VM from the VM JSON /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:158 with given VMI from the VM /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:163 should succeed to terminate the VMI using oc-patch command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:166 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1393 ------------------------------ • ------------------------------ • [SLOW TEST:13.849 seconds] VirtualMachineInstanceReplicaSet /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:46 should scale /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 to five, to six and then to zero replicas /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ •• ------------------------------ • [SLOW TEST:23.149 seconds] VirtualMachineInstanceReplicaSet /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:46 should update readyReplicas once VMIs are up /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:157 ------------------------------ • [SLOW TEST:17.866 seconds] VirtualMachineInstanceReplicaSet /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:46 should remove VMIs once it is marked for deletion /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:169 ------------------------------ ••••• ------------------------------ • [SLOW TEST:18.455 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 should update VirtualMachine once VMIs are up /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:195 ------------------------------ •• ------------------------------ • [SLOW TEST:71.506 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 should recreate VirtualMachineInstance if it gets deleted /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:245 ------------------------------ • [SLOW TEST:76.758 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 should recreate VirtualMachineInstance if the VirtualMachineInstance's pod gets deleted /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:265 ------------------------------ • [SLOW TEST:42.928 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 should stop VirtualMachineInstance if running set to false /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:325 ------------------------------ • [SLOW TEST:299.834 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 should start and stop VirtualMachineInstance multiple times /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:333 ------------------------------ • [SLOW TEST:49.346 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 should not update the VirtualMachineInstance spec if Running /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:346 ------------------------------ • [SLOW TEST:190.576 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 should survive guest shutdown, multiple times /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:387 ------------------------------ 2018/07/27 02:52:36 read closing down: EOF 2018/07/27 02:52:36 read closing down: EOF 2018/07/27 02:52:36 read closing down: EOF VM testvmiktcdn was scheduled to start • [SLOW TEST:17.653 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 Using virtctl interface /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:435 should start a VirtualMachineInstance once /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:436 ------------------------------ VM testvmilwbcp was scheduled to stop • [SLOW TEST:97.875 seconds] VirtualMachine /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:47 A valid VirtualMachine given /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:115 Using virtctl interface /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:435 should stop a VirtualMachineInstance once /root/go/src/kubevirt.io/kubevirt/tests/vm_test.go:467 ------------------------------ •• Pod name: disks-images-provider-tkjs9 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-vtv7n Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-gg8jc Pod phase: Running 2018/07/27 06:56:30 http: TLS handshake error from 10.244.1.1:55228: EOF 2018/07/27 06:56:40 http: TLS handshake error from 10.244.1.1:55234: EOF 2018/07/27 06:56:50 http: TLS handshake error from 10.244.1.1:55240: EOF level=info timestamp=2018-07-27T06:56:52.886719Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T06:56:53.175177Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T06:56:56.038801Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 06:57:00 http: TLS handshake error from 10.244.1.1:55246: EOF level=info timestamp=2018-07-27T06:57:02.285808Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T06:57:02.289928Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/27 06:57:10 http: TLS handshake error from 10.244.1.1:55252: EOF 2018/07/27 06:57:20 http: TLS handshake error from 10.244.1.1:55258: EOF level=info timestamp=2018-07-27T06:57:23.054441Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T06:57:23.190390Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T06:57:26.172203Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 06:57:30 http: TLS handshake error from 10.244.1.1:55264: EOF Pod name: virt-controller-7d57d96b65-9xnqb Pod phase: Running level=info timestamp=2018-07-27T06:53:12.426239Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af0f17ba-9169-11e8-a364-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-27T06:53:12.426424Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af0f17ba-9169-11e8-a364-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-27T06:53:12.473749Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af0f17ba-9169-11e8-a364-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-27T06:53:12.473944Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af0f17ba-9169-11e8-a364-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-27T06:54:30.702576Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af0f17ba-9169-11e8-a364-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-27T06:54:30.703113Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af0f17ba-9169-11e8-a364-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-27T06:54:30.703212Z pos=vm.go:262 component=virt-controller service=http msg="vmi is nil" level=info timestamp=2018-07-27T06:54:30.740649Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af0f17ba-9169-11e8-a364-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-27T06:54:30.740814Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af0f17ba-9169-11e8-a364-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-27T06:54:30.740917Z pos=vm.go:262 component=virt-controller service=http msg="vmi is nil" level=info timestamp=2018-07-27T06:54:31.820825Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizgzz8 kind= uid=e9742f1f-9169-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T06:54:31.821172Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizgzz8 kind= uid=e9742f1f-9169-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T06:54:32.255085Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijr2gm kind= uid=e9b99610-9169-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T06:54:32.255370Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijr2gm kind= uid=e9b99610-9169-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T06:54:32.440699Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijr2gm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijr2gm" Pod name: virt-controller-7d57d96b65-bjr94 Pod phase: Running level=info timestamp=2018-07-27T06:37:55.441019Z pos=application.go:174 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-mwlnz Pod phase: Running level=info timestamp=2018-07-27T06:39:43.167263Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T06:39:43.156751Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:39:43.189171Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.190996Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T06:39:43.192273Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:39:43.193259Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind= uid=c2e98d76-9167-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.193534Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-27T06:39:43.194041Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T06:39:43.195276Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.196034Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.200036Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:39:43.210020Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:39:43.210483Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T06:39:43.212032Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:39:43.212326Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-xc8bs Pod phase: Running level=info timestamp=2018-07-27T06:53:12.388065Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:53:12.390834Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:53:12.391084Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T06:53:12.391252Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-27T06:53:12.391343Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T06:53:12.397534Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:53:12.442579Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:53:12.442910Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:53:12.443190Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:53:12.894664Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:53:12.895022Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:53:12.895510Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:53:12.895811Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:54:30.714817Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:54:30.715607Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmijr2gm-gcldr Pod phase: Running level=info timestamp=2018-07-27T06:54:36.578882Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-07-27T06:54:36.579162Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-07-27T06:54:36.581074Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-07-27T06:54:46.592722Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-07-27T06:54:46.713187Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmijr2gm" level=info timestamp=2018-07-27T06:54:46.716116Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-07-27T06:54:46.716615Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure [180.997 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 should start it [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:76 Timed out after 90.013s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1049 ------------------------------ level=info timestamp=2018-07-27T06:54:32.933692Z pos=utils.go:243 component=tests msg="Created virtual machine pod virt-launcher-testvmijr2gm-gcldr" Pod name: disks-images-provider-tkjs9 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-vtv7n Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-gg8jc Pod phase: Running 2018/07/27 06:59:30 http: TLS handshake error from 10.244.1.1:55336: EOF 2018/07/27 06:59:40 http: TLS handshake error from 10.244.1.1:55342: EOF 2018/07/27 06:59:50 http: TLS handshake error from 10.244.1.1:55348: EOF level=info timestamp=2018-07-27T06:59:53.146800Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T06:59:53.834164Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T06:59:56.790443Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:00:00 http: TLS handshake error from 10.244.1.1:55354: EOF level=info timestamp=2018-07-27T07:00:03.440132Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:00:03.443954Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/27 07:00:10 http: TLS handshake error from 10.244.1.1:55360: EOF 2018/07/27 07:00:20 http: TLS handshake error from 10.244.1.1:55366: EOF level=info timestamp=2018-07-27T07:00:23.078978Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:00:23.997564Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T07:00:26.914633Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:00:30 http: TLS handshake error from 10.244.1.1:55372: EOF Pod name: virt-controller-7d57d96b65-9xnqb Pod phase: Running level=info timestamp=2018-07-27T06:53:12.473944Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af0f17ba-9169-11e8-a364-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-27T06:54:30.702576Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af0f17ba-9169-11e8-a364-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-27T06:54:30.703113Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af0f17ba-9169-11e8-a364-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-27T06:54:30.703212Z pos=vm.go:262 component=virt-controller service=http msg="vmi is nil" level=info timestamp=2018-07-27T06:54:30.740649Z pos=vm.go:135 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af0f17ba-9169-11e8-a364-525500d15501 msg="Started processing VM" level=info timestamp=2018-07-27T06:54:30.740814Z pos=vm.go:186 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af0f17ba-9169-11e8-a364-525500d15501 msg="Creating or the VirtualMachineInstance: false" level=info timestamp=2018-07-27T06:54:30.740917Z pos=vm.go:262 component=virt-controller service=http msg="vmi is nil" level=info timestamp=2018-07-27T06:54:31.820825Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizgzz8 kind= uid=e9742f1f-9169-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T06:54:31.821172Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizgzz8 kind= uid=e9742f1f-9169-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T06:54:32.255085Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijr2gm kind= uid=e9b99610-9169-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T06:54:32.255370Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijr2gm kind= uid=e9b99610-9169-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T06:54:32.440699Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijr2gm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijr2gm" level=info timestamp=2018-07-27T06:57:33.278822Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8bmfv kind= uid=559d86f1-916a-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T06:57:33.282035Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8bmfv kind= uid=559d86f1-916a-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T06:57:33.459671Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi8bmfv\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi8bmfv" Pod name: virt-controller-7d57d96b65-bjr94 Pod phase: Running level=info timestamp=2018-07-27T06:37:55.441019Z pos=application.go:174 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-mwlnz Pod phase: Running level=info timestamp=2018-07-27T06:39:43.167263Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T06:39:43.156751Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:39:43.189171Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.190996Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T06:39:43.192273Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:39:43.193259Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind= uid=c2e98d76-9167-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.193534Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-27T06:39:43.194041Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T06:39:43.195276Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.196034Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.200036Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:39:43.210020Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:39:43.210483Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T06:39:43.212032Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:39:43.212326Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-xc8bs Pod phase: Running level=info timestamp=2018-07-27T06:53:12.388065Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:53:12.390834Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:53:12.391084Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T06:53:12.391252Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-27T06:53:12.391343Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T06:53:12.397534Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:53:12.442579Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:53:12.442910Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:53:12.443190Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:53:12.894664Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:53:12.895022Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:53:12.895510Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:53:12.895811Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:54:30.714817Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:54:30.715607Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi8bmfv-w4trf Pod phase: Running level=info timestamp=2018-07-27T06:57:37.637035Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-07-27T06:57:37.637325Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-07-27T06:57:37.639129Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-07-27T06:57:47.648033Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-07-27T06:57:47.733117Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi8bmfv" level=info timestamp=2018-07-27T06:57:47.736083Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-07-27T06:57:47.736630Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.789 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 should attach virt-launcher to it [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:82 Timed out after 90.009s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1049 ------------------------------ level=info timestamp=2018-07-27T06:57:33.812259Z pos=utils.go:243 component=tests msg="Created virtual machine pod virt-launcher-testvmi8bmfv-w4trf" •••• Pod name: disks-images-provider-tkjs9 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-vtv7n Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-gg8jc Pod phase: Running level=info timestamp=2018-07-27T07:02:24.635017Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T07:02:27.459827Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:02:30 http: TLS handshake error from 10.244.1.1:55444: EOF 2018/07/27 07:02:40 http: TLS handshake error from 10.244.1.1:55450: EOF 2018/07/27 07:02:50 http: TLS handshake error from 10.244.1.1:55456: EOF level=info timestamp=2018-07-27T07:02:53.216171Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:02:54.778032Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T07:02:57.587361Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:03:00 http: TLS handshake error from 10.244.1.1:55462: EOF 2018/07/27 07:03:10 http: TLS handshake error from 10.244.1.1:55468: EOF 2018/07/27 07:03:20 http: TLS handshake error from 10.244.1.1:55474: EOF level=info timestamp=2018-07-27T07:03:23.130002Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:03:24.953238Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T07:03:27.718783Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:03:30 http: TLS handshake error from 10.244.1.1:55480: EOF Pod name: virt-controller-7d57d96b65-9xnqb Pod phase: Running level=info timestamp=2018-07-27T06:54:32.440699Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijr2gm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijr2gm" level=info timestamp=2018-07-27T06:57:33.278822Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8bmfv kind= uid=559d86f1-916a-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T06:57:33.282035Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8bmfv kind= uid=559d86f1-916a-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T06:57:33.459671Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi8bmfv\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi8bmfv" level=info timestamp=2018-07-27T07:00:33.895763Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi8bmfv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi8bmfv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 559d86f1-916a-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi8bmfv" level=info timestamp=2018-07-27T07:00:33.962451Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi8bmfv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi8bmfv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 559d86f1-916a-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi8bmfv" level=info timestamp=2018-07-27T07:00:34.767787Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizr6s8 kind= uid=c1cb8bad-916a-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:00:34.768335Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizr6s8 kind= uid=c1cb8bad-916a-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:00:34.954438Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizr6s8\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizr6s8" level=info timestamp=2018-07-27T07:00:35.193420Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizr6s8\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmizr6s8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c1cb8bad-916a-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizr6s8" level=info timestamp=2018-07-27T07:00:35.298964Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4kmwg kind= uid=c21ec817-916a-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:00:35.299198Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4kmwg kind= uid=c21ec817-916a-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:00:35.498336Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4kmwg\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi4kmwg, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c21ec817-916a-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4kmwg" level=info timestamp=2018-07-27T07:00:35.631445Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5w76m kind= uid=c250c2e2-916a-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:00:35.631698Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5w76m kind= uid=c250c2e2-916a-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-bjr94 Pod phase: Running level=info timestamp=2018-07-27T06:37:55.441019Z pos=application.go:174 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-mwlnz Pod phase: Running level=info timestamp=2018-07-27T06:39:43.167263Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T06:39:43.156751Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:39:43.189171Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.190996Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T06:39:43.192273Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:39:43.193259Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind= uid=c2e98d76-9167-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.193534Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-27T06:39:43.194041Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T06:39:43.195276Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.196034Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.200036Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:39:43.210020Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:39:43.210483Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T06:39:43.212032Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:39:43.212326Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-xc8bs Pod phase: Running level=info timestamp=2018-07-27T06:53:12.388065Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:53:12.390834Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:53:12.391084Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T06:53:12.391252Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-27T06:53:12.391343Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T06:53:12.397534Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:53:12.442579Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:53:12.442910Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:53:12.443190Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:53:12.894664Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:53:12.895022Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:53:12.895510Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:53:12.895811Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:54:30.714817Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:54:30.715607Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi5w76m-x4q8d Pod phase: Running level=info timestamp=2018-07-27T07:00:40.097244Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-07-27T07:00:40.097532Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-07-27T07:00:40.113365Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-07-27T07:00:50.127367Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-07-27T07:00:50.156190Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi5w76m" level=info timestamp=2018-07-27T07:00:50.157537Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-07-27T07:00:50.157841Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure [180.746 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 with boot order /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:170 should be able to boot from selected disk /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 Alpine as first boot [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.013s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1049 ------------------------------ STEP: defining a VirtualMachineInstance with an Alpine disk STEP: adding a Cirros Disk STEP: setting boot order STEP: starting VirtualMachineInstance STEP: Waiting the VirtualMachineInstance start level=info timestamp=2018-07-27T07:00:36.219055Z pos=utils.go:243 component=tests msg="Created virtual machine pod virt-launcher-testvmi5w76m-x4q8d" Pod name: disks-images-provider-tkjs9 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-vtv7n Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-gg8jc Pod phase: Running level=info timestamp=2018-07-27T07:05:25.765258Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T07:05:28.678643Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:05:30 http: TLS handshake error from 10.244.1.1:55552: EOF 2018/07/27 07:05:40 http: TLS handshake error from 10.244.1.1:55558: EOF 2018/07/27 07:05:50 http: TLS handshake error from 10.244.1.1:55564: EOF level=info timestamp=2018-07-27T07:05:53.104199Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:05:55.905862Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T07:05:58.817823Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:06:00 http: TLS handshake error from 10.244.1.1:55570: EOF 2018/07/27 07:06:10 http: TLS handshake error from 10.244.1.1:55576: EOF 2018/07/27 07:06:20 http: TLS handshake error from 10.244.1.1:55582: EOF level=info timestamp=2018-07-27T07:06:23.200957Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:06:26.013965Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T07:06:28.938032Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:06:30 http: TLS handshake error from 10.244.1.1:55588: EOF Pod name: virt-controller-7d57d96b65-9xnqb Pod phase: Running level=info timestamp=2018-07-27T06:57:33.459671Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi8bmfv\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi8bmfv" level=info timestamp=2018-07-27T07:00:33.895763Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi8bmfv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi8bmfv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 559d86f1-916a-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi8bmfv" level=info timestamp=2018-07-27T07:00:33.962451Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi8bmfv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi8bmfv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 559d86f1-916a-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi8bmfv" level=info timestamp=2018-07-27T07:00:34.767787Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizr6s8 kind= uid=c1cb8bad-916a-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:00:34.768335Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizr6s8 kind= uid=c1cb8bad-916a-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:00:34.954438Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizr6s8\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizr6s8" level=info timestamp=2018-07-27T07:00:35.193420Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizr6s8\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmizr6s8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c1cb8bad-916a-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizr6s8" level=info timestamp=2018-07-27T07:00:35.298964Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4kmwg kind= uid=c21ec817-916a-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:00:35.299198Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4kmwg kind= uid=c21ec817-916a-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:00:35.498336Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4kmwg\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi4kmwg, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c21ec817-916a-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4kmwg" level=info timestamp=2018-07-27T07:00:35.631445Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5w76m kind= uid=c250c2e2-916a-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:00:35.631698Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5w76m kind= uid=c250c2e2-916a-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:03:36.581809Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwnknn kind= uid=2e2a3817-916b-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:03:36.588239Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwnknn kind= uid=2e2a3817-916b-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:03:36.697562Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwnknn\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwnknn" Pod name: virt-controller-7d57d96b65-bjr94 Pod phase: Running level=info timestamp=2018-07-27T06:37:55.441019Z pos=application.go:174 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-mwlnz Pod phase: Running level=info timestamp=2018-07-27T06:39:43.167263Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T06:39:43.156751Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:39:43.189171Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.190996Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T06:39:43.192273Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:39:43.193259Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind= uid=c2e98d76-9167-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.193534Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-27T06:39:43.194041Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T06:39:43.195276Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.196034Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.200036Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:39:43.210020Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:39:43.210483Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T06:39:43.212032Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:39:43.212326Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-xc8bs Pod phase: Running level=info timestamp=2018-07-27T06:53:12.388065Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:53:12.390834Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:53:12.391084Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T06:53:12.391252Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-27T06:53:12.391343Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T06:53:12.397534Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:53:12.442579Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:53:12.442910Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:53:12.443190Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:53:12.894664Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:53:12.895022Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:53:12.895510Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:53:12.895811Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind= uid=af148cc3-9169-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:54:30.714817Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:54:30.715607Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmilwbcp kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmiwnknn-vlngw Pod phase: Running level=info timestamp=2018-07-27T07:03:41.214392Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-07-27T07:03:41.214641Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-07-27T07:03:41.216033Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-07-27T07:03:51.224046Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-07-27T07:03:51.309211Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiwnknn" level=info timestamp=2018-07-27T07:03:51.311634Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-07-27T07:03:51.312094Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.938 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 with boot order /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:170 should be able to boot from selected disk /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 Cirros as first boot [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Timed out after 90.013s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1049 ------------------------------ STEP: defining a VirtualMachineInstance with an Alpine disk STEP: adding a Cirros Disk STEP: setting boot order STEP: starting VirtualMachineInstance STEP: Waiting the VirtualMachineInstance start level=info timestamp=2018-07-27T07:03:37.082230Z pos=utils.go:243 component=tests msg="Created virtual machine pod virt-launcher-testvmiwnknn-vlngw" • [SLOW TEST:60.492 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 with user-data /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:201 without k8s secret /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:202 should retry starting the VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:203 ------------------------------ • [SLOW TEST:18.171 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 with user-data /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:201 without k8s secret /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:202 should log warning and proceed once the secret is there /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:233 ------------------------------ Pod name: disks-images-provider-tkjs9 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-vtv7n Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-gg8jc Pod phase: Running level=info timestamp=2018-07-27T07:09:53.139895Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:09:57.209501Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T07:09:59.920729Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:10:00 http: TLS handshake error from 10.244.1.1:55714: EOF level=info timestamp=2018-07-27T07:10:01.922384Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:10:01.926080Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/27 07:10:10 http: TLS handshake error from 10.244.1.1:55720: EOF 2018/07/27 07:10:20 http: TLS handshake error from 10.244.1.1:55726: EOF level=info timestamp=2018-07-27T07:10:23.158254Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:10:27.366696Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T07:10:30.071355Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:10:30 http: TLS handshake error from 10.244.1.1:55732: EOF 2018/07/27 07:10:40 http: TLS handshake error from 10.244.1.1:55738: EOF 2018/07/27 07:10:50 http: TLS handshake error from 10.244.1.1:55744: EOF level=info timestamp=2018-07-27T07:10:53.112550Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-controller-7d57d96b65-9xnqb Pod phase: Running level=info timestamp=2018-07-27T07:00:35.298964Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4kmwg kind= uid=c21ec817-916a-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:00:35.299198Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4kmwg kind= uid=c21ec817-916a-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:00:35.498336Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4kmwg\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi4kmwg, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c21ec817-916a-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4kmwg" level=info timestamp=2018-07-27T07:00:35.631445Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5w76m kind= uid=c250c2e2-916a-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:00:35.631698Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5w76m kind= uid=c250c2e2-916a-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:03:36.581809Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwnknn kind= uid=2e2a3817-916b-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:03:36.588239Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwnknn kind= uid=2e2a3817-916b-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:03:36.697562Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwnknn\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwnknn" level=info timestamp=2018-07-27T07:06:37.474643Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirhpt6 kind= uid=99fc9577-916b-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:06:37.484219Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirhpt6 kind= uid=99fc9577-916b-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:07:37.784153Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirhpt6\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmirhpt6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 99fc9577-916b-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirhpt6" level=info timestamp=2018-07-27T07:07:37.989009Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:07:37.989401Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:07:56.100667Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5xwxm kind= uid=c8dad74d-916b-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:07:56.111140Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5xwxm kind= uid=c8dad74d-916b-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-bjr94 Pod phase: Running level=info timestamp=2018-07-27T06:37:55.441019Z pos=application.go:174 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-mwlnz Pod phase: Running level=info timestamp=2018-07-27T06:39:43.167263Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T06:39:43.156751Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:39:43.189171Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.190996Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T06:39:43.192273Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:39:43.193259Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind= uid=c2e98d76-9167-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.193534Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-27T06:39:43.194041Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T06:39:43.195276Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.196034Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.200036Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:39:43.210020Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:39:43.210483Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T06:39:43.212032Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:39:43.212326Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-xc8bs Pod phase: Running level=error timestamp=2018-07-27T07:07:55.695953Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi89cqd\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-27T07:07:55.696085Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi89cqd\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi89cqd" level=info timestamp=2018-07-27T07:07:55.696194Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-27T07:07:55.742616Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:07:55.742776Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-27T07:07:55.767783Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:07:55.885045Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-27T07:07:55.885283Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:07:55.887266Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi89cqd" level=info timestamp=2018-07-27T07:07:56.126284Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:07:56.126923Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T07:07:56.132427Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:07:56.133027Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:07:56.133230Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:07:56.133704Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" Pod name: virt-launcher-testvmi5xwxm-2sq78 Pod phase: Running level=info timestamp=2018-07-27T07:08:00.771890Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-07-27T07:08:00.772145Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-07-27T07:08:00.773790Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-07-27T07:08:10.782326Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-07-27T07:08:10.882163Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi5xwxm" level=info timestamp=2018-07-27T07:08:10.884888Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-07-27T07:08:10.885363Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.865 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 when virt-launcher crashes /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:281 should be stopped and have Failed phase [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:282 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1049 ------------------------------ level=info timestamp=2018-07-27T07:07:56.649243Z pos=utils.go:243 component=tests msg="Created virtual machine pod virt-launcher-testvmi5xwxm-2sq78" Pod name: disks-images-provider-tkjs9 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-vtv7n Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-gg8jc Pod phase: Running 2018/07/27 07:12:40 http: TLS handshake error from 10.244.1.1:55810: EOF 2018/07/27 07:12:50 http: TLS handshake error from 10.244.1.1:55816: EOF level=info timestamp=2018-07-27T07:12:53.281236Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:12:58.037186Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:13:00 http: TLS handshake error from 10.244.1.1:55822: EOF level=info timestamp=2018-07-27T07:13:00.851987Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:13:10 http: TLS handshake error from 10.244.1.1:55828: EOF 2018/07/27 07:13:20 http: TLS handshake error from 10.244.1.1:55834: EOF level=info timestamp=2018-07-27T07:13:23.127041Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:13:28.229304Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:13:30 http: TLS handshake error from 10.244.1.1:55840: EOF level=info timestamp=2018-07-27T07:13:31.010000Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:13:40 http: TLS handshake error from 10.244.1.1:55846: EOF 2018/07/27 07:13:50 http: TLS handshake error from 10.244.1.1:55852: EOF level=info timestamp=2018-07-27T07:13:53.333123Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-controller-7d57d96b65-9xnqb Pod phase: Running level=info timestamp=2018-07-27T07:00:35.631445Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5w76m kind= uid=c250c2e2-916a-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:00:35.631698Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5w76m kind= uid=c250c2e2-916a-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:03:36.581809Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwnknn kind= uid=2e2a3817-916b-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:03:36.588239Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwnknn kind= uid=2e2a3817-916b-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:03:36.697562Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwnknn\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwnknn" level=info timestamp=2018-07-27T07:06:37.474643Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirhpt6 kind= uid=99fc9577-916b-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:06:37.484219Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirhpt6 kind= uid=99fc9577-916b-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:07:37.784153Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmirhpt6\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmirhpt6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 99fc9577-916b-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmirhpt6" level=info timestamp=2018-07-27T07:07:37.989009Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:07:37.989401Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:07:56.100667Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5xwxm kind= uid=c8dad74d-916b-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:07:56.111140Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5xwxm kind= uid=c8dad74d-916b-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:10:56.756120Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi5xwxm\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi5xwxm, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c8dad74d-916b-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi5xwxm" level=info timestamp=2018-07-27T07:10:56.940764Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwng6j kind= uid=349ff556-916c-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:10:56.941299Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwng6j kind= uid=349ff556-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-bjr94 Pod phase: Running level=info timestamp=2018-07-27T06:37:55.441019Z pos=application.go:174 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-mwlnz Pod phase: Running level=info timestamp=2018-07-27T06:39:43.167263Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T06:39:43.156751Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:39:43.189171Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.190996Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T06:39:43.192273Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:39:43.193259Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind= uid=c2e98d76-9167-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.193534Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-27T06:39:43.194041Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T06:39:43.195276Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.196034Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzxzhj6s kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T06:39:43.200036Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:39:43.210020Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T06:39:43.210483Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T06:39:43.212032Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T06:39:43.212326Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiqllzx9qqrf kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-xc8bs Pod phase: Running level=error timestamp=2018-07-27T07:07:55.695953Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi89cqd\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-27T07:07:55.696085Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi89cqd\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi89cqd" level=info timestamp=2018-07-27T07:07:55.696194Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-27T07:07:55.742616Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:07:55.742776Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-27T07:07:55.767783Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:07:55.885045Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-27T07:07:55.885283Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:07:55.887266Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi89cqd" level=info timestamp=2018-07-27T07:07:56.126284Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:07:56.126923Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T07:07:56.132427Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind= uid=be0b0798-916b-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:07:56.133027Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:07:56.133230Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi89cqd kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:07:56.133704Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" Pod name: virt-launcher-testvmiwng6j-56swz Pod phase: Running level=info timestamp=2018-07-27T07:11:01.215724Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-07-27T07:11:01.215992Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-07-27T07:11:01.218593Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-07-27T07:11:11.227769Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-07-27T07:11:11.282059Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiwng6j" level=info timestamp=2018-07-27T07:11:11.285645Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-07-27T07:11:11.286135Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.993 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 when virt-handler crashes /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:304 should recover and continue management [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:305 Timed out after 90.014s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1049 ------------------------------ level=info timestamp=2018-07-27T07:10:57.605323Z pos=utils.go:243 component=tests msg="Created virtual machine pod virt-launcher-testvmiwng6j-56swz" • [SLOW TEST:30.905 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 when virt-handler is responsive /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:335 should indicate that a node is ready for vmis /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:336 ------------------------------ • [SLOW TEST:81.028 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 when virt-handler is not responsive /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:366 the node controller should react /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:405 ------------------------------ • [SLOW TEST:19.595 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 with node tainted /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:458 the vmi with tolerations should be scheduled /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:480 ------------------------------ • ------------------------------ S [SKIPPING] [0.255 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 with non default namespace /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:530 should log libvirt start and stop lifecycle events of the domain /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 kubevirt-test-default [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Skip log query tests for JENKINS ci test environment /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:535 ------------------------------ S [SKIPPING] [0.121 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 with non default namespace /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:530 should log libvirt start and stop lifecycle events of the domain /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 kubevirt-test-alternative [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Skip log query tests for JENKINS ci test environment /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:535 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.199 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 VirtualMachineInstance Emulation Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:591 should enable emulation in virt-launcher [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:603 Software emulation is not enabled on this cluster /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:599 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.229 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 VirtualMachineInstance Emulation Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:591 should be reflected in domain XML [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:640 Software emulation is not enabled on this cluster /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:599 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.218 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:70 VirtualMachineInstance Emulation Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:591 should request a TUN device but not KVM [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:684 Software emulation is not enabled on this cluster /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:599 ------------------------------ •••• Pod name: disks-images-provider-tkjs9 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-vtv7n Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-gg8jc Pod phase: Running level=info timestamp=2018-07-27T07:18:23.190259Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:18:29.713224Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:18:30 http: TLS handshake error from 10.244.1.1:56022: EOF level=info timestamp=2018-07-27T07:18:32.283598Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:18:40 http: TLS handshake error from 10.244.1.1:56028: EOF 2018/07/27 07:18:50 http: TLS handshake error from 10.244.1.1:56034: EOF level=info timestamp=2018-07-27T07:18:52.915911Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:18:52.936847Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:18:53.236061Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:18:59.856719Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:19:00 http: TLS handshake error from 10.244.1.1:56040: EOF level=info timestamp=2018-07-27T07:19:01.620865Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:19:01.624847Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:19:02.377557Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:19:10 http: TLS handshake error from 10.244.1.1:56046: EOF Pod name: virt-controller-7d57d96b65-9xnqb Pod phase: Running level=info timestamp=2018-07-27T07:14:28.680364Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwsm9h kind= uid=b2d7891a-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:14:28.828752Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwsm9h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwsm9h" level=info timestamp=2018-07-27T07:15:38.985658Z pos=node.go:194 component=virt-controller service=http name=node02 kind= uid=01e5a9ac-9165-11e8-a364-525500d15501 msg="Moving vmi testvmiwsm9h in namespace kubevirt-test-default on unresponsive node to failed state" level=info timestamp=2018-07-27T07:15:49.852600Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:15:49.855538Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:16:09.526280Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirmk2h kind= uid=eeedb5e2-916c-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:16:09.526993Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirmk2h kind= uid=eeedb5e2-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:16:11.985269Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigdq2q kind= uid=f06cc401-916c-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:16:11.985604Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigdq2q kind= uid=f06cc401-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:16:12.312189Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmigdq2q\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmigdq2q, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f06cc401-916c-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmigdq2q" level=info timestamp=2018-07-27T07:16:12.421210Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgx7w kind= uid=f0af6cc4-916c-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:16:12.421444Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgx7w kind= uid=f0af6cc4-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:16:12.594047Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijgx7w\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmijgx7w, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f0af6cc4-916c-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijgx7w" level=info timestamp=2018-07-27T07:16:13.377184Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4j6x kind= uid=f140a197-916c-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:16:13.377412Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4j6x kind= uid=f140a197-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-bjr94 Pod phase: Running level=info timestamp=2018-07-27T06:37:55.441019Z pos=application.go:174 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-j4dhz Pod phase: Running level=info timestamp=2018-07-27T07:16:07.772938Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:07.773135Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-27T07:16:07.783440Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.378115Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-27T07:16:08.378239Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:16:08.378882Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi5qf2m" level=info timestamp=2018-07-27T07:16:08.623226Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.623430Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-27T07:16:08.623480Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T07:16:08.631272Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.633455Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:16:08.636053Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T07:16:08.636257Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:16:08.636331Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.644098Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" Pod name: virt-handler-l7xxz Pod phase: Running level=info timestamp=2018-07-27T07:15:42.744136Z pos=cache.go:121 component=virt-handler msg="List domains from sock /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwng6j_sock" level=error timestamp=2018-07-27T07:15:42.744183Z pos=cache.go:124 component=virt-handler reason="dial unix /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwng6j_sock: connect: connection refused" msg="failed to connect to cmd client socket" level=info timestamp=2018-07-27T07:15:42.744206Z pos=cache.go:121 component=virt-handler msg="List domains from sock /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwnknn_sock" level=error timestamp=2018-07-27T07:15:42.744250Z pos=cache.go:124 component=virt-handler reason="dial unix /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwnknn_sock: connect: connection refused" msg="failed to connect to cmd client socket" level=info timestamp=2018-07-27T07:15:42.744271Z pos=cache.go:121 component=virt-handler msg="List domains from sock /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwsm9h_sock" level=error timestamp=2018-07-27T07:15:42.744316Z pos=cache.go:124 component=virt-handler reason="dial unix /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwsm9h_sock: connect: connection refused" msg="failed to connect to cmd client socket" level=info timestamp=2018-07-27T07:15:42.842904Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-07-27T07:15:42.856728Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-07-27T07:15:42.863001Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-07-27T07:15:43.043515Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid=b2d7891a-916c-11e8-a364-525500d15501 msg="No update processing required" level=info timestamp=2018-07-27T07:15:43.043942Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid=b2d7891a-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:15:49.622188Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:15:49.623017Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:15:49.624017Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:15:49.624344Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmih4j6x-7j6lv Pod phase: Running level=info timestamp=2018-07-27T07:16:18.638762Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-07-27T07:16:18.639248Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-07-27T07:16:18.643176Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-07-27T07:16:28.653262Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-07-27T07:16:28.742876Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmih4j6x" level=info timestamp=2018-07-27T07:16:28.745160Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-07-27T07:16:28.745770Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure [180.839 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Delete a VirtualMachineInstance's Pod /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:836 should result in the VirtualMachineInstance moving to a finalized state [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:837 Timed out after 90.010s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1049 ------------------------------ STEP: Creating the VirtualMachineInstance level=info timestamp=2018-07-27T07:16:14.027411Z pos=utils.go:243 component=tests msg="Created virtual machine pod virt-launcher-testvmih4j6x-7j6lv" Pod name: disks-images-provider-tkjs9 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-vtv7n Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-gg8jc Pod phase: Running 2018/07/27 07:21:10 http: TLS handshake error from 10.244.1.1:56118: EOF 2018/07/27 07:21:20 http: TLS handshake error from 10.244.1.1:56124: EOF level=info timestamp=2018-07-27T07:21:23.182361Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/27 07:21:30 http: TLS handshake error from 10.244.1.1:56130: EOF level=info timestamp=2018-07-27T07:21:30.907707Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T07:21:33.033435Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:21:40 http: TLS handshake error from 10.244.1.1:56136: EOF 2018/07/27 07:21:50 http: TLS handshake error from 10.244.1.1:56142: EOF level=info timestamp=2018-07-27T07:21:53.140740Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/27 07:22:00 http: TLS handshake error from 10.244.1.1:56148: EOF level=info timestamp=2018-07-27T07:22:01.054761Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T07:22:01.644011Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:22:01.647950Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:22:03.195933Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:22:10 http: TLS handshake error from 10.244.1.1:56154: EOF Pod name: virt-controller-7d57d96b65-9xnqb Pod phase: Running level=info timestamp=2018-07-27T07:15:49.852600Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:15:49.855538Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:16:09.526280Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirmk2h kind= uid=eeedb5e2-916c-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:16:09.526993Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirmk2h kind= uid=eeedb5e2-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:16:11.985269Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigdq2q kind= uid=f06cc401-916c-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:16:11.985604Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigdq2q kind= uid=f06cc401-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:16:12.312189Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmigdq2q\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmigdq2q, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f06cc401-916c-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmigdq2q" level=info timestamp=2018-07-27T07:16:12.421210Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgx7w kind= uid=f0af6cc4-916c-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:16:12.421444Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgx7w kind= uid=f0af6cc4-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:16:12.594047Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijgx7w\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmijgx7w, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f0af6cc4-916c-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijgx7w" level=info timestamp=2018-07-27T07:16:13.377184Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4j6x kind= uid=f140a197-916c-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:16:13.377412Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4j6x kind= uid=f140a197-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:19:14.394272Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4mn5h kind= uid=5d2184ce-916d-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:19:14.399437Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4mn5h kind= uid=5d2184ce-916d-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:19:14.631440Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4mn5h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4mn5h" Pod name: virt-controller-7d57d96b65-bjr94 Pod phase: Running level=info timestamp=2018-07-27T06:37:55.441019Z pos=application.go:174 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-j4dhz Pod phase: Running level=info timestamp=2018-07-27T07:16:07.772938Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:07.773135Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-27T07:16:07.783440Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.378115Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-27T07:16:08.378239Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:16:08.378882Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi5qf2m" level=info timestamp=2018-07-27T07:16:08.623226Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.623430Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-27T07:16:08.623480Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T07:16:08.631272Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.633455Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:16:08.636053Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T07:16:08.636257Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:16:08.636331Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.644098Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" Pod name: virt-handler-l7xxz Pod phase: Running level=info timestamp=2018-07-27T07:15:42.744136Z pos=cache.go:121 component=virt-handler msg="List domains from sock /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwng6j_sock" level=error timestamp=2018-07-27T07:15:42.744183Z pos=cache.go:124 component=virt-handler reason="dial unix /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwng6j_sock: connect: connection refused" msg="failed to connect to cmd client socket" level=info timestamp=2018-07-27T07:15:42.744206Z pos=cache.go:121 component=virt-handler msg="List domains from sock /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwnknn_sock" level=error timestamp=2018-07-27T07:15:42.744250Z pos=cache.go:124 component=virt-handler reason="dial unix /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwnknn_sock: connect: connection refused" msg="failed to connect to cmd client socket" level=info timestamp=2018-07-27T07:15:42.744271Z pos=cache.go:121 component=virt-handler msg="List domains from sock /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwsm9h_sock" level=error timestamp=2018-07-27T07:15:42.744316Z pos=cache.go:124 component=virt-handler reason="dial unix /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwsm9h_sock: connect: connection refused" msg="failed to connect to cmd client socket" level=info timestamp=2018-07-27T07:15:42.842904Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-07-27T07:15:42.856728Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-07-27T07:15:42.863001Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-07-27T07:15:43.043515Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid=b2d7891a-916c-11e8-a364-525500d15501 msg="No update processing required" level=info timestamp=2018-07-27T07:15:43.043942Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid=b2d7891a-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:15:49.622188Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:15:49.623017Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:15:49.624017Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:15:49.624344Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi4mn5h-wtf4z Pod phase: Running level=info timestamp=2018-07-27T07:19:19.577122Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-07-27T07:19:19.578837Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-07-27T07:19:19.583230Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-07-27T07:19:29.593304Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-07-27T07:19:29.679335Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi4mn5h" level=info timestamp=2018-07-27T07:19:29.681580Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-07-27T07:19:29.682029Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.958 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:868 with an active pod. /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:869 should result in pod being terminated [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:870 Timed out after 90.012s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1049 ------------------------------ STEP: Creating the VirtualMachineInstance level=info timestamp=2018-07-27T07:19:15.107951Z pos=utils.go:243 component=tests msg="Created virtual machine pod virt-launcher-testvmi4mn5h-wtf4z" Pod name: disks-images-provider-tkjs9 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-vtv7n Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-gg8jc Pod phase: Running 2018/07/27 07:24:10 http: TLS handshake error from 10.244.1.1:56226: EOF 2018/07/27 07:24:20 http: TLS handshake error from 10.244.1.1:56232: EOF level=info timestamp=2018-07-27T07:24:23.229309Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/27 07:24:30 http: TLS handshake error from 10.244.1.1:56238: EOF level=info timestamp=2018-07-27T07:24:31.745120Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T07:24:33.949547Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:24:40 http: TLS handshake error from 10.244.1.1:56244: EOF 2018/07/27 07:24:50 http: TLS handshake error from 10.244.1.1:56250: EOF level=info timestamp=2018-07-27T07:24:53.208523Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/27 07:25:00 http: TLS handshake error from 10.244.1.1:56256: EOF level=info timestamp=2018-07-27T07:25:01.624242Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:25:01.628146Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:25:01.860159Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T07:25:04.175194Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:25:10 http: TLS handshake error from 10.244.1.1:56262: EOF Pod name: virt-controller-7d57d96b65-9xnqb Pod phase: Running level=info timestamp=2018-07-27T07:16:09.526280Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirmk2h kind= uid=eeedb5e2-916c-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:16:09.526993Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirmk2h kind= uid=eeedb5e2-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:16:11.985269Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigdq2q kind= uid=f06cc401-916c-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:16:11.985604Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigdq2q kind= uid=f06cc401-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:16:12.312189Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmigdq2q\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmigdq2q, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f06cc401-916c-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmigdq2q" level=info timestamp=2018-07-27T07:16:12.421210Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgx7w kind= uid=f0af6cc4-916c-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:16:12.421444Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgx7w kind= uid=f0af6cc4-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:16:12.594047Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijgx7w\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmijgx7w, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f0af6cc4-916c-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijgx7w" level=info timestamp=2018-07-27T07:16:13.377184Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4j6x kind= uid=f140a197-916c-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:16:13.377412Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4j6x kind= uid=f140a197-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:19:14.394272Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4mn5h kind= uid=5d2184ce-916d-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:19:14.399437Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4mn5h kind= uid=5d2184ce-916d-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:19:14.631440Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4mn5h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4mn5h" level=info timestamp=2018-07-27T07:22:15.264240Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiskd9r kind= uid=c8f11cd4-916d-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:22:15.269796Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiskd9r kind= uid=c8f11cd4-916d-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-bjr94 Pod phase: Running level=info timestamp=2018-07-27T06:37:55.441019Z pos=application.go:174 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-j4dhz Pod phase: Running level=info timestamp=2018-07-27T07:16:07.772938Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:07.773135Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-27T07:16:07.783440Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.378115Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-27T07:16:08.378239Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:16:08.378882Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi5qf2m" level=info timestamp=2018-07-27T07:16:08.623226Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.623430Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-27T07:16:08.623480Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T07:16:08.631272Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.633455Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:16:08.636053Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T07:16:08.636257Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:16:08.636331Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.644098Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" Pod name: virt-handler-l7xxz Pod phase: Running level=info timestamp=2018-07-27T07:15:42.744136Z pos=cache.go:121 component=virt-handler msg="List domains from sock /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwng6j_sock" level=error timestamp=2018-07-27T07:15:42.744183Z pos=cache.go:124 component=virt-handler reason="dial unix /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwng6j_sock: connect: connection refused" msg="failed to connect to cmd client socket" level=info timestamp=2018-07-27T07:15:42.744206Z pos=cache.go:121 component=virt-handler msg="List domains from sock /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwnknn_sock" level=error timestamp=2018-07-27T07:15:42.744250Z pos=cache.go:124 component=virt-handler reason="dial unix /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwnknn_sock: connect: connection refused" msg="failed to connect to cmd client socket" level=info timestamp=2018-07-27T07:15:42.744271Z pos=cache.go:121 component=virt-handler msg="List domains from sock /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwsm9h_sock" level=error timestamp=2018-07-27T07:15:42.744316Z pos=cache.go:124 component=virt-handler reason="dial unix /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwsm9h_sock: connect: connection refused" msg="failed to connect to cmd client socket" level=info timestamp=2018-07-27T07:15:42.842904Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-07-27T07:15:42.856728Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-07-27T07:15:42.863001Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-07-27T07:15:43.043515Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid=b2d7891a-916c-11e8-a364-525500d15501 msg="No update processing required" level=info timestamp=2018-07-27T07:15:43.043942Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid=b2d7891a-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:15:49.622188Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:15:49.623017Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:15:49.624017Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:15:49.624344Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmiskd9r-cs2hx Pod phase: Running level=info timestamp=2018-07-27T07:22:19.450672Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-07-27T07:22:19.451006Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-07-27T07:22:19.453459Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-07-27T07:22:30.147466Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-07-27T07:22:30.201496Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiskd9r" level=info timestamp=2018-07-27T07:22:30.205790Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-07-27T07:22:30.206224Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.906 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:868 with grace period greater than 0 /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:893 should run graceful shutdown [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:894 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1049 ------------------------------ STEP: Setting a VirtualMachineInstance termination grace period to 5 STEP: Creating the VirtualMachineInstance level=info timestamp=2018-07-27T07:22:15.981536Z pos=utils.go:243 component=tests msg="Created virtual machine pod virt-launcher-testvmiskd9r-cs2hx" Pod name: disks-images-provider-tkjs9 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-vtv7n Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-gg8jc Pod phase: Running level=info timestamp=2018-07-27T07:27:02.467624Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T07:27:04.708736Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:27:10 http: TLS handshake error from 10.244.1.1:56334: EOF 2018/07/27 07:27:20 http: TLS handshake error from 10.244.1.1:56340: EOF level=info timestamp=2018-07-27T07:27:23.156090Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/27 07:27:30 http: TLS handshake error from 10.244.1.1:56346: EOF level=info timestamp=2018-07-27T07:27:32.649210Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T07:27:34.842034Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:27:40 http: TLS handshake error from 10.244.1.1:56352: EOF 2018/07/27 07:27:50 http: TLS handshake error from 10.244.1.1:56358: EOF level=info timestamp=2018-07-27T07:27:53.153338Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/27 07:28:00 http: TLS handshake error from 10.244.1.1:56364: EOF level=info timestamp=2018-07-27T07:28:02.776564Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T07:28:04.952829Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:28:10 http: TLS handshake error from 10.244.1.1:56370: EOF Pod name: virt-controller-7d57d96b65-9xnqb Pod phase: Running level=info timestamp=2018-07-27T07:16:11.985269Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigdq2q kind= uid=f06cc401-916c-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:16:11.985604Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmigdq2q kind= uid=f06cc401-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:16:12.312189Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmigdq2q\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmigdq2q, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f06cc401-916c-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmigdq2q" level=info timestamp=2018-07-27T07:16:12.421210Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgx7w kind= uid=f0af6cc4-916c-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:16:12.421444Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijgx7w kind= uid=f0af6cc4-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:16:12.594047Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijgx7w\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmijgx7w, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f0af6cc4-916c-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijgx7w" level=info timestamp=2018-07-27T07:16:13.377184Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4j6x kind= uid=f140a197-916c-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:16:13.377412Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4j6x kind= uid=f140a197-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:19:14.394272Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4mn5h kind= uid=5d2184ce-916d-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:19:14.399437Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4mn5h kind= uid=5d2184ce-916d-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:19:14.631440Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4mn5h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4mn5h" level=info timestamp=2018-07-27T07:22:15.264240Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiskd9r kind= uid=c8f11cd4-916d-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:22:15.269796Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiskd9r kind= uid=c8f11cd4-916d-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:25:16.063039Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixbjsd kind= uid=34b7edca-916e-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:25:16.069320Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixbjsd kind= uid=34b7edca-916e-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-bjr94 Pod phase: Running level=info timestamp=2018-07-27T06:37:55.441019Z pos=application.go:174 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-j4dhz Pod phase: Running level=info timestamp=2018-07-27T07:16:07.772938Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:07.773135Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-27T07:16:07.783440Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.378115Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-27T07:16:08.378239Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:16:08.378882Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi5qf2m" level=info timestamp=2018-07-27T07:16:08.623226Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.623430Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-27T07:16:08.623480Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T07:16:08.631272Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.633455Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:16:08.636053Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T07:16:08.636257Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:16:08.636331Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.644098Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" Pod name: virt-handler-l7xxz Pod phase: Running level=info timestamp=2018-07-27T07:15:42.744136Z pos=cache.go:121 component=virt-handler msg="List domains from sock /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwng6j_sock" level=error timestamp=2018-07-27T07:15:42.744183Z pos=cache.go:124 component=virt-handler reason="dial unix /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwng6j_sock: connect: connection refused" msg="failed to connect to cmd client socket" level=info timestamp=2018-07-27T07:15:42.744206Z pos=cache.go:121 component=virt-handler msg="List domains from sock /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwnknn_sock" level=error timestamp=2018-07-27T07:15:42.744250Z pos=cache.go:124 component=virt-handler reason="dial unix /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwnknn_sock: connect: connection refused" msg="failed to connect to cmd client socket" level=info timestamp=2018-07-27T07:15:42.744271Z pos=cache.go:121 component=virt-handler msg="List domains from sock /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwsm9h_sock" level=error timestamp=2018-07-27T07:15:42.744316Z pos=cache.go:124 component=virt-handler reason="dial unix /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwsm9h_sock: connect: connection refused" msg="failed to connect to cmd client socket" level=info timestamp=2018-07-27T07:15:42.842904Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-07-27T07:15:42.856728Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-07-27T07:15:42.863001Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-07-27T07:15:43.043515Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid=b2d7891a-916c-11e8-a364-525500d15501 msg="No update processing required" level=info timestamp=2018-07-27T07:15:43.043942Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid=b2d7891a-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:15:49.622188Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:15:49.623017Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:15:49.624017Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:15:49.624344Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmixbjsd-z5tvd Pod phase: Running level=info timestamp=2018-07-27T07:25:21.052649Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-07-27T07:25:21.053408Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-07-27T07:25:21.055441Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-07-27T07:25:31.084687Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-07-27T07:25:31.140087Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmixbjsd" level=info timestamp=2018-07-27T07:25:31.142225Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-07-27T07:25:31.142868Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.740 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Killed VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:945 should be in Failed phase [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:946 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1049 ------------------------------ STEP: Starting a VirtualMachineInstance level=info timestamp=2018-07-27T07:25:16.603688Z pos=utils.go:243 component=tests msg="Created virtual machine pod virt-launcher-testvmixbjsd-z5tvd" Pod name: disks-images-provider-tkjs9 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-vtv7n Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-gg8jc Pod phase: Running level=info timestamp=2018-07-27T07:30:03.325926Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T07:30:05.474189Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:30:10 http: TLS handshake error from 10.244.1.1:56442: EOF 2018/07/27 07:30:20 http: TLS handshake error from 10.244.1.1:56448: EOF level=info timestamp=2018-07-27T07:30:23.283231Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/27 07:30:30 http: TLS handshake error from 10.244.1.1:56454: EOF level=info timestamp=2018-07-27T07:30:33.465280Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T07:30:35.675368Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:30:40 http: TLS handshake error from 10.244.1.1:56460: EOF 2018/07/27 07:30:50 http: TLS handshake error from 10.244.1.1:56466: EOF level=info timestamp=2018-07-27T07:30:53.160599Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/27 07:31:00 http: TLS handshake error from 10.244.1.1:56472: EOF level=info timestamp=2018-07-27T07:31:03.594964Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-07-27T07:31:05.822925Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:31:10 http: TLS handshake error from 10.244.1.1:56478: EOF Pod name: virt-controller-7d57d96b65-9xnqb Pod phase: Running level=info timestamp=2018-07-27T07:16:12.594047Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijgx7w\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmijgx7w, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f0af6cc4-916c-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijgx7w" level=info timestamp=2018-07-27T07:16:13.377184Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4j6x kind= uid=f140a197-916c-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:16:13.377412Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4j6x kind= uid=f140a197-916c-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:19:14.394272Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4mn5h kind= uid=5d2184ce-916d-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:19:14.399437Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4mn5h kind= uid=5d2184ce-916d-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:19:14.631440Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi4mn5h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi4mn5h" level=info timestamp=2018-07-27T07:22:15.264240Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiskd9r kind= uid=c8f11cd4-916d-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:22:15.269796Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiskd9r kind= uid=c8f11cd4-916d-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:25:16.063039Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixbjsd kind= uid=34b7edca-916e-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:25:16.069320Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmixbjsd kind= uid=34b7edca-916e-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:28:16.716626Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmixbjsd\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmixbjsd, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 34b7edca-916e-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmixbjsd" level=info timestamp=2018-07-27T07:28:16.850037Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim4sv9 kind= uid=a079b0bb-916e-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:28:16.850668Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmim4sv9 kind= uid=a079b0bb-916e-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:28:17.021445Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmim4sv9\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmim4sv9" level=info timestamp=2018-07-27T07:28:17.102245Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmim4sv9\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmim4sv9" Pod name: virt-controller-7d57d96b65-bjr94 Pod phase: Running level=info timestamp=2018-07-27T06:37:55.441019Z pos=application.go:174 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-j4dhz Pod phase: Running level=info timestamp=2018-07-27T07:16:07.772938Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:07.773135Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-27T07:16:07.783440Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.378115Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-27T07:16:08.378239Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:16:08.378882Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi5qf2m" level=info timestamp=2018-07-27T07:16:08.623226Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind= uid=e3376eca-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.623430Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-27T07:16:08.623480Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T07:16:08.631272Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.633455Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:16:08.636053Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T07:16:08.636257Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:16:08.636331Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi5qf2m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:16:08.644098Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" Pod name: virt-handler-l7xxz Pod phase: Running level=info timestamp=2018-07-27T07:15:42.744136Z pos=cache.go:121 component=virt-handler msg="List domains from sock /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwng6j_sock" level=error timestamp=2018-07-27T07:15:42.744183Z pos=cache.go:124 component=virt-handler reason="dial unix /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwng6j_sock: connect: connection refused" msg="failed to connect to cmd client socket" level=info timestamp=2018-07-27T07:15:42.744206Z pos=cache.go:121 component=virt-handler msg="List domains from sock /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwnknn_sock" level=error timestamp=2018-07-27T07:15:42.744250Z pos=cache.go:124 component=virt-handler reason="dial unix /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwnknn_sock: connect: connection refused" msg="failed to connect to cmd client socket" level=info timestamp=2018-07-27T07:15:42.744271Z pos=cache.go:121 component=virt-handler msg="List domains from sock /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwsm9h_sock" level=error timestamp=2018-07-27T07:15:42.744316Z pos=cache.go:124 component=virt-handler reason="dial unix /var/run/kubevirt/sockets/kubevirt-test-default_testvmiwsm9h_sock: connect: connection refused" msg="failed to connect to cmd client socket" level=info timestamp=2018-07-27T07:15:42.842904Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-07-27T07:15:42.856728Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" level=info timestamp=2018-07-27T07:15:42.863001Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-07-27T07:15:43.043515Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid=b2d7891a-916c-11e8-a364-525500d15501 msg="No update processing required" level=info timestamp=2018-07-27T07:15:43.043942Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid=b2d7891a-916c-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:15:49.622188Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:15:49.623017Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:15:49.624017Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:15:49.624344Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmiwsm9h kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmim4sv9-ml7xf Pod phase: Running level=info timestamp=2018-07-27T07:28:21.157980Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-07-27T07:28:21.158382Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-07-27T07:28:21.161562Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-07-27T07:28:31.176807Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-07-27T07:28:31.275829Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmim4sv9" level=info timestamp=2018-07-27T07:28:31.278513Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-07-27T07:28:31.278947Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.782 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:48 Killed VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:945 should be left alone by virt-handler [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:973 Timed out after 90.011s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1049 ------------------------------ STEP: Starting a VirtualMachineInstance level=info timestamp=2018-07-27T07:28:17.417400Z pos=utils.go:243 component=tests msg="Created virtual machine pod virt-launcher-testvmim4sv9-ml7xf" •••••••••••2018/07/27 03:32:11 read closing down: EOF 2018/07/27 03:33:00 read closing down: EOF 2018/07/27 03:33:02 read closing down: EOF ------------------------------ • [SLOW TEST:99.664 seconds] Slirp /root/go/src/kubevirt.io/kubevirt/tests/vmi_slirp_interface_test.go:39 should be able to /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 VirtualMachineInstance with slirp interface /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ •2018/07/27 03:33:05 read closing down: EOF ------------------------------ • [SLOW TEST:5.344 seconds] Subresource Api /root/go/src/kubevirt.io/kubevirt/tests/subresource_api_test.go:37 Rbac Authorization /root/go/src/kubevirt.io/kubevirt/tests/subresource_api_test.go:48 with correct permissions /root/go/src/kubevirt.io/kubevirt/tests/subresource_api_test.go:51 should be allowed to access subresource endpoint /root/go/src/kubevirt.io/kubevirt/tests/subresource_api_test.go:52 ------------------------------ • [SLOW TEST:5.451 seconds] Subresource Api /root/go/src/kubevirt.io/kubevirt/tests/subresource_api_test.go:37 Rbac Authorization /root/go/src/kubevirt.io/kubevirt/tests/subresource_api_test.go:48 Without permissions /root/go/src/kubevirt.io/kubevirt/tests/subresource_api_test.go:56 should not be able to access subresource endpoint /root/go/src/kubevirt.io/kubevirt/tests/subresource_api_test.go:57 ------------------------------ •• ------------------------------ • [SLOW TEST:18.293 seconds] VNC /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:46 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:54 with VNC connection /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:62 should allow accessing the VNC device /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:64 ------------------------------ ••2018/07/27 03:34:29 read closing down: EOF ------------------------------ • [SLOW TEST:44.642 seconds] Console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:37 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:65 with a serial console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:66 with a cirros image /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:67 should return that we are running cirros /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:68 ------------------------------ Pod name: disks-images-provider-tkjs9 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-vtv7n Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-gg8jc Pod phase: Running level=error timestamp=2018-07-27T07:34:52.424750Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:34:52.425091Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmitqc2z/console proto=HTTP/1.1 statusCode=400 contentLength=90 level=info timestamp=2018-07-27T07:34:53.314741Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=error timestamp=2018-07-27T07:34:53.546851Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:34:53.547121Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmitqc2z/console proto=HTTP/1.1 statusCode=400 contentLength=90 level=error timestamp=2018-07-27T07:34:54.688418Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:34:54.688958Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmitqc2z/console proto=HTTP/1.1 statusCode=400 contentLength=90 level=error timestamp=2018-07-27T07:34:55.811920Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:34:55.812125Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmitqc2z/console proto=HTTP/1.1 statusCode=400 contentLength=90 level=error timestamp=2018-07-27T07:34:56.928617Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:34:56.928896Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmitqc2z/console proto=HTTP/1.1 statusCode=400 contentLength=90 level=error timestamp=2018-07-27T07:34:58.092270Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:34:58.092614Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmitqc2z/console proto=HTTP/1.1 statusCode=400 contentLength=90 level=error timestamp=2018-07-27T07:34:59.239740Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:34:59.239956Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmitqc2z/console proto=HTTP/1.1 statusCode=400 contentLength=90 Pod name: virt-controller-7d57d96b65-9xnqb Pod phase: Running level=info timestamp=2018-07-27T07:31:22.679083Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiqttnb kind= uid=0f3cd583-916f-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:31:22.887873Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:31:22.888124Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:31:23.083629Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikzq5m\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikzq5m" level=info timestamp=2018-07-27T07:31:23.125146Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikzq5m\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikzq5m" level=info timestamp=2018-07-27T07:32:11.623597Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi788nt kind= uid=2c694542-916f-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:32:11.624594Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi788nt kind= uid=2c694542-916f-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:32:11.726020Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi788nt\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi788nt" level=info timestamp=2018-07-27T07:33:26.058949Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmil7l4n kind= uid=58c55c19-916f-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:33:26.062285Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmil7l4n kind= uid=58c55c19-916f-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:33:44.640143Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi62s84 kind= uid=63dc55b3-916f-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:33:44.641587Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi62s84 kind= uid=63dc55b3-916f-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:33:44.764685Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi62s84\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi62s84" level=info timestamp=2018-07-27T07:34:29.452308Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqc2z kind= uid=7e906c3a-916f-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:34:29.455419Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqc2z kind= uid=7e906c3a-916f-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-bjr94 Pod phase: Running level=info timestamp=2018-07-27T06:37:55.441019Z pos=application.go:174 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-j4dhz Pod phase: Running level=info timestamp=2018-07-27T07:33:04.491882Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:33:04.500495Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmikzq5m" level=info timestamp=2018-07-27T07:33:04.765704Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:33:04.771100Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:33:04.774911Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T07:33:04.775538Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-27T07:33:04.778824Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:33:04.781239Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:33:04.937280Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:33:04.937456Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:33:04.937541Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:33:04.969408Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:33:04.973033Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:33:04.974275Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:33:04.974516Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-l7xxz Pod phase: Running level=info timestamp=2018-07-27T07:34:29.156083Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind= uid=63dc55b3-916f-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:34:29.159358Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind= uid=63dc55b3-916f-11e8-a364-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi62s84" level=info timestamp=2018-07-27T07:34:29.391051Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind= uid=63dc55b3-916f-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:34:29.391897Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-27T07:34:29.392074Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T07:34:29.392844Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:34:29.394979Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:34:29.395558Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T07:34:29.395883Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:34:29.396094Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:34:29.402229Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:34:29.472088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:34:29.472398Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:34:29.473673Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:34:29.473961Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmitqc2z-9rcph Pod phase: Running level=info timestamp=2018-07-27T07:34:33.494987Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-07-27T07:34:33.495185Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-07-27T07:34:33.496973Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-07-27T07:34:43.505967Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-07-27T07:34:43.604958Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmitqc2z" level=info timestamp=2018-07-27T07:34:43.607123Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-07-27T07:34:43.607611Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [30.739 seconds] Console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:37 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:65 with a serial console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:66 with a fedora image /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:77 should return that we are running fedora [It] /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:78 Expected error: <*errors.errorString | 0xc420398750>: { s: "Timeout trying to connect to the virtual machine instance", } Timeout trying to connect to the virtual machine instance not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:55 ------------------------------ STEP: Creating a new VirtualMachineInstance STEP: Expecting the VirtualMachineInstance console Pod name: disks-images-provider-tkjs9 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-vtv7n Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-gg8jc Pod phase: Running level=error timestamp=2018-07-27T07:35:23.009884Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:35:23.010230Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmifgqjf/console proto=HTTP/1.1 statusCode=400 contentLength=90 level=info timestamp=2018-07-27T07:35:23.304577Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=error timestamp=2018-07-27T07:35:24.143819Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:35:24.144007Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmifgqjf/console proto=HTTP/1.1 statusCode=400 contentLength=90 level=error timestamp=2018-07-27T07:35:25.264007Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:35:25.264267Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmifgqjf/console proto=HTTP/1.1 statusCode=400 contentLength=90 level=error timestamp=2018-07-27T07:35:26.387389Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:35:26.387642Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmifgqjf/console proto=HTTP/1.1 statusCode=400 contentLength=90 level=error timestamp=2018-07-27T07:35:27.528966Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:35:27.529567Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmifgqjf/console proto=HTTP/1.1 statusCode=400 contentLength=90 level=error timestamp=2018-07-27T07:35:28.646024Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:35:28.646216Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmifgqjf/console proto=HTTP/1.1 statusCode=400 contentLength=90 level=error timestamp=2018-07-27T07:35:29.772932Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:35:29.773114Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmifgqjf/console proto=HTTP/1.1 statusCode=400 contentLength=90 Pod name: virt-controller-7d57d96b65-9xnqb Pod phase: Running level=info timestamp=2018-07-27T07:31:23.083629Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikzq5m\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikzq5m" level=info timestamp=2018-07-27T07:31:23.125146Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikzq5m\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikzq5m" level=info timestamp=2018-07-27T07:32:11.623597Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi788nt kind= uid=2c694542-916f-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:32:11.624594Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi788nt kind= uid=2c694542-916f-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:32:11.726020Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi788nt\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi788nt" level=info timestamp=2018-07-27T07:33:26.058949Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmil7l4n kind= uid=58c55c19-916f-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:33:26.062285Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmil7l4n kind= uid=58c55c19-916f-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:33:44.640143Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi62s84 kind= uid=63dc55b3-916f-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:33:44.641587Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi62s84 kind= uid=63dc55b3-916f-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:33:44.764685Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi62s84\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi62s84" level=info timestamp=2018-07-27T07:34:29.452308Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqc2z kind= uid=7e906c3a-916f-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:34:29.455419Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqc2z kind= uid=7e906c3a-916f-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:34:59.944848Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitqc2z\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmitqc2z, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7e906c3a-916f-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitqc2z" level=info timestamp=2018-07-27T07:35:00.118820Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifgqjf kind= uid=90d378e0-916f-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:35:00.120346Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifgqjf kind= uid=90d378e0-916f-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-bjr94 Pod phase: Running level=info timestamp=2018-07-27T06:37:55.441019Z pos=application.go:174 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-j4dhz Pod phase: Running level=info timestamp=2018-07-27T07:33:04.491882Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:33:04.500495Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmikzq5m" level=info timestamp=2018-07-27T07:33:04.765704Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:33:04.771100Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:33:04.774911Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T07:33:04.775538Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-27T07:33:04.778824Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:33:04.781239Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:33:04.937280Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:33:04.937456Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:33:04.937541Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:33:04.969408Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:33:04.973033Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:33:04.974275Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:33:04.974516Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-l7xxz Pod phase: Running level=info timestamp=2018-07-27T07:34:29.156083Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind= uid=63dc55b3-916f-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:34:29.159358Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind= uid=63dc55b3-916f-11e8-a364-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi62s84" level=info timestamp=2018-07-27T07:34:29.391051Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind= uid=63dc55b3-916f-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:34:29.391897Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-27T07:34:29.392074Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T07:34:29.392844Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:34:29.394979Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:34:29.395558Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T07:34:29.395883Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:34:29.396094Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:34:29.402229Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:34:29.472088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:34:29.472398Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:34:29.473673Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:34:29.473961Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmifgqjf-8snjt Pod phase: Running level=info timestamp=2018-07-27T07:35:04.932144Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-07-27T07:35:04.933236Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-07-27T07:35:04.935859Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-07-27T07:35:14.984064Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-07-27T07:35:15.041252Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmifgqjf" level=info timestamp=2018-07-27T07:35:15.043400Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-07-27T07:35:15.044005Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmitqc2z-9rcph Pod phase: Failed Unable to retrieve container logs for docker://daaa182303b1d3763d1800f177f18562e9d394a4a20a92408d8be7d1f709917b• Failure [30.740 seconds] Console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:37 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:65 with a serial console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:66 should be able to reconnect to console multiple times [It] /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:87 Expected error: <*errors.errorString | 0xc420451040>: { s: "Timeout trying to connect to the virtual machine instance", } Timeout trying to connect to the virtual machine instance not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:100 ------------------------------ STEP: Creating a new VirtualMachineInstance STEP: Checking that the console output equals to expected one Pod name: disks-images-provider-tkjs9 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-vtv7n Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-gg8jc Pod phase: Running level=error timestamp=2018-07-27T07:35:53.778895Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:35:53.779180Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmidrxrp/console proto=HTTP/1.1 statusCode=400 contentLength=90 level=error timestamp=2018-07-27T07:35:54.930009Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:35:54.930247Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmidrxrp/console proto=HTTP/1.1 statusCode=400 contentLength=90 level=error timestamp=2018-07-27T07:35:56.052334Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:35:56.052669Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmidrxrp/console proto=HTTP/1.1 statusCode=400 contentLength=90 level=error timestamp=2018-07-27T07:35:57.165898Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:35:57.166107Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmidrxrp/console proto=HTTP/1.1 statusCode=400 contentLength=90 level=error timestamp=2018-07-27T07:35:58.298438Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:35:58.298904Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmidrxrp/console proto=HTTP/1.1 statusCode=400 contentLength=90 level=error timestamp=2018-07-27T07:35:59.433219Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:35:59.433442Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmidrxrp/console proto=HTTP/1.1 statusCode=400 contentLength=90 level=error timestamp=2018-07-27T07:36:00.552159Z pos=subresource.go:54 component=virt-api reason="Unable to connect to VirtualMachineInstance because phase is Scheduling instead of Running" msg="Failed to gather remote exec info for subresource request." level=info timestamp=2018-07-27T07:36:00.552415Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/namespaces/kubevirt-test-default/virtualmachineinstances/testvmidrxrp/console proto=HTTP/1.1 statusCode=400 contentLength=90 2018/07/27 07:36:00 http: TLS handshake error from 10.244.1.1:56702: EOF Pod name: virt-controller-7d57d96b65-9xnqb Pod phase: Running level=info timestamp=2018-07-27T07:32:11.726020Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi788nt\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi788nt" level=info timestamp=2018-07-27T07:33:26.058949Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmil7l4n kind= uid=58c55c19-916f-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:33:26.062285Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmil7l4n kind= uid=58c55c19-916f-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:33:44.640143Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi62s84 kind= uid=63dc55b3-916f-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:33:44.641587Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi62s84 kind= uid=63dc55b3-916f-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:33:44.764685Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi62s84\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi62s84" level=info timestamp=2018-07-27T07:34:29.452308Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqc2z kind= uid=7e906c3a-916f-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:34:29.455419Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitqc2z kind= uid=7e906c3a-916f-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:34:59.944848Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmitqc2z\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmitqc2z, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7e906c3a-916f-11e8-a364-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmitqc2z" level=info timestamp=2018-07-27T07:35:00.118820Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifgqjf kind= uid=90d378e0-916f-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:35:00.120346Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmifgqjf kind= uid=90d378e0-916f-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:35:30.946960Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidrxrp kind= uid=a335da2a-916f-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:35:30.951516Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidrxrp kind= uid=a335da2a-916f-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:35:31.118646Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidrxrp\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidrxrp" level=info timestamp=2018-07-27T07:35:31.142297Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidrxrp\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidrxrp" Pod name: virt-controller-7d57d96b65-bjr94 Pod phase: Running level=info timestamp=2018-07-27T06:37:55.441019Z pos=application.go:174 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-j4dhz Pod phase: Running level=info timestamp=2018-07-27T07:33:04.491882Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:33:04.500495Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmikzq5m" level=info timestamp=2018-07-27T07:33:04.765704Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:33:04.771100Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:33:04.774911Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T07:33:04.775538Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-27T07:33:04.778824Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:33:04.781239Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:33:04.937280Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:33:04.937456Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:33:04.937541Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:33:04.969408Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:33:04.973033Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:33:04.974275Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:33:04.974516Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-l7xxz Pod phase: Running level=info timestamp=2018-07-27T07:34:29.156083Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind= uid=63dc55b3-916f-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:34:29.159358Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind= uid=63dc55b3-916f-11e8-a364-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmi62s84" level=info timestamp=2018-07-27T07:34:29.391051Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind= uid=63dc55b3-916f-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:34:29.391897Z pos=vm.go:330 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Shutting down domain for deleted VirtualMachineInstance object." level=info timestamp=2018-07-27T07:34:29.392074Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Processing shutdown." level=info timestamp=2018-07-27T07:34:29.392844Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:34:29.394979Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:34:29.395558Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T07:34:29.395883Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:34:29.396094Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:34:29.402229Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:34:29.472088Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:34:29.472398Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:34:29.473673Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:34:29.473961Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi62s84 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmidrxrp-vh927 Pod phase: Running level=info timestamp=2018-07-27T07:35:35.919539Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-07-27T07:35:35.919734Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-07-27T07:35:35.921183Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-07-27T07:35:45.929973Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-07-27T07:35:46.031927Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmidrxrp" level=info timestamp=2018-07-27T07:35:46.034987Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-07-27T07:35:46.035444Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmifgqjf-8snjt Pod phase: Pending • Failure [30.800 seconds] Console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:37 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:65 with a serial console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:66 should wait until the virtual machine is in running state and return a stream interface [It] /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:103 Expected error: <*errors.errorString | 0xc420b475a0>: { s: "Timeout trying to connect to the virtual machine instance", } Timeout trying to connect to the virtual machine instance not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:109 ------------------------------ STEP: Creating a new VirtualMachineInstance • [SLOW TEST:30.337 seconds] Console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:37 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:65 with a serial console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:66 should fail waiting for the virtual machine instance to be running /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:111 ------------------------------ • [SLOW TEST:30.335 seconds] Console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:37 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:65 with a serial console /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:66 should fail waiting for the expecter /root/go/src/kubevirt.io/kubevirt/tests/console_test.go:134 ------------------------------ 2018/07/27 03:37:38 read closing down: EOF • [SLOW TEST:35.732 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 with Alpine PVC /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:71 should be successfully started /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 with Disk PVC /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:33.252 seconds] 2018/07/27 03:38:11 read closing down: EOF Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 with Alpine PVC /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:71 should be successfully started /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 with CDRom PVC /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ 2018/07/27 03:40:08 read closing down: EOF • [SLOW TEST:124.768 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 with Alpine PVC /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:71 should be successfully started and stopped multiple times /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 with Disk PVC /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ 2018/07/27 03:42:10 read closing down: EOF • [SLOW TEST:119.584 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 with Alpine PVC /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:71 should be successfully started and stopped multiple times /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 with CDRom PVC /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:46.246 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 With an emptyDisk defined 2018/07/27 03:43:01 read closing down: EOF /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:113 should create a writeable emptyDisk with the right capacity /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:115 ------------------------------ • [SLOW TEST:45.428 seconds] 2018/07/27 03:43:47 read closing down: EOF Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 With an emptyDisk defined and a specified serial number /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:163 should create a writeable emptyDisk with the specified serial number /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:165 ------------------------------ 2018/07/27 03:44:22 read closing down: EOF • [SLOW TEST:35.624 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 With ephemeral alpine PVC /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:205 should be successfully started /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:207 ------------------------------ • [SLOW TEST:78.227 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance 2018/07/27 03:45:41 read closing down: EOF /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 With ephemeral alpine PVC /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:205 should not persist data 2018/07/27 03:45:41 read closing down: EOF /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:218 ------------------------------ 2018/07/27 03:47:56 read closing down: EOF • [SLOW TEST:135.162 seconds] Storage /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:46 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:70 With VirtualMachineInstance with two PVCs /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:266 should start vmi multiple times /root/go/src/kubevirt.io/kubevirt/tests/storage_test.go:278 ------------------------------ Pod name: disks-images-provider-tkjs9 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-vtv7n Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-gg8jc Pod phase: Running level=info timestamp=2018-07-27T07:49:53.380532Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/27 07:50:00 http: TLS handshake error from 10.244.1.1:57226: EOF level=info timestamp=2018-07-27T07:50:01.645971Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:50:01.649869Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T07:50:09.198296Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:50:10 http: TLS handshake error from 10.244.1.1:57232: EOF level=info timestamp=2018-07-27T07:50:10.956832Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:50:20 http: TLS handshake error from 10.244.1.1:57238: EOF level=info timestamp=2018-07-27T07:50:23.406857Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/27 07:50:30 http: TLS handshake error from 10.244.1.1:57244: EOF level=info timestamp=2018-07-27T07:50:39.376339Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:50:40 http: TLS handshake error from 10.244.1.1:57250: EOF level=info timestamp=2018-07-27T07:50:41.081991Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 07:50:50 http: TLS handshake error from 10.244.1.1:57256: EOF level=info timestamp=2018-07-27T07:50:53.408577Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-controller-7d57d96b65-9xnqb Pod phase: Running level=info timestamp=2018-07-27T07:43:47.732874Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijsgcq\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijsgcq" level=info timestamp=2018-07-27T07:44:22.933988Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmildt2t kind= uid=e04d7a89-9170-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:44:22.937138Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmildt2t kind= uid=e04d7a89-9170-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:45:06.074199Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmildt2t kind= uid=fa03732d-9170-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:45:06.077510Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmildt2t kind= uid=fa03732d-9170-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:45:06.392905Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmildt2t\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmildt2t" level=info timestamp=2018-07-27T07:45:41.313529Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihlv58 kind= uid=0f03689e-9171-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:45:41.316841Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihlv58 kind= uid=0f03689e-9171-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:46:19.016607Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihlv58 kind= uid=257d54c9-9171-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:46:19.019652Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihlv58 kind= uid=257d54c9-9171-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:47:05.961286Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihlv58 kind= uid=41770492-9171-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:47:05.963046Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihlv58 kind= uid=41770492-9171-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:47:56.338075Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidcx8b kind= uid=5f7f2c96-9171-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T07:47:56.340616Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidcx8b kind= uid=5f7f2c96-9171-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T07:47:56.545996Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidcx8b\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidcx8b" Pod name: virt-controller-7d57d96b65-bjr94 Pod phase: Running level=info timestamp=2018-07-27T06:37:55.441019Z pos=application.go:174 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-j4dhz Pod phase: Running level=info timestamp=2018-07-27T07:33:04.491882Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:33:04.500495Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmikzq5m" level=info timestamp=2018-07-27T07:33:04.765704Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:33:04.771100Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:33:04.774911Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T07:33:04.775538Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-27T07:33:04.778824Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:33:04.781239Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:33:04.937280Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind= uid=0f5d2553-916f-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:33:04.937456Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:33:04.937541Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:33:04.969408Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:33:04.973033Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:33:04.974275Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:33:04.974516Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmikzq5m kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-l7xxz Pod phase: Running level=info timestamp=2018-07-27T07:47:24.032833Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihlv58 kind= uid=41770492-9171-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:47:40.751147Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmihlv58 kind= uid=41770492-9171-11e8-a364-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-27T07:47:40.751302Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmihlv58 kind= uid=41770492-9171-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:47:40.752492Z pos=vm.go:540 component=virt-handler namespace=kubevirt-test-default name=testvmihlv58 kind= uid=41770492-9171-11e8-a364-525500d15501 msg="grace period expired, killing deleted VirtualMachineInstance testvmihlv58" level=info timestamp=2018-07-27T07:47:40.976201Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihlv58 kind= uid=41770492-9171-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:47:40.979716Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:47:40.980107Z pos=vm.go:678 component=virt-handler namespace=kubevirt-test-default name=testvmihlv58 kind=Domain uid= msg="Domain deleted" level=info timestamp=2018-07-27T07:47:40.980321Z pos=vm.go:342 component=virt-handler namespace=kubevirt-test-default name=testvmihlv58 kind= uid=41770492-9171-11e8-a364-525500d15501 msg="Shutting down domain for VirtualMachineInstance with deletion timestamp." level=info timestamp=2018-07-27T07:47:40.980441Z pos=vm.go:383 component=virt-handler namespace=kubevirt-test-default name=testvmihlv58 kind= uid=41770492-9171-11e8-a364-525500d15501 msg="Processing shutdown." level=info timestamp=2018-07-27T07:47:40.987044Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type DELETED" level=info timestamp=2018-07-27T07:47:41.031217Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihlv58 kind= uid=41770492-9171-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:47:41.034949Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihlv58 kind= uid=41770492-9171-11e8-a364-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:47:41.035324Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihlv58 kind= uid=41770492-9171-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T07:47:55.309958Z pos=vm.go:386 component=virt-handler namespace=kubevirt-test-default name=testvmihlv58 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-07-27T07:47:55.311011Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihlv58 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmidcx8b-5rt4m Pod phase: Running level=info timestamp=2018-07-27T07:48:01.081035Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-07-27T07:48:01.081252Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-07-27T07:48:01.083588Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-07-27T07:48:11.089008Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-07-27T07:48:11.129822Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmidcx8b" level=info timestamp=2018-07-27T07:48:11.131445Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-07-27T07:48:11.131905Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.758 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 VirtualMachineInstance definition /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:55 with 3 CPU cores /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:56 should report 3 cpu cores under guest OS [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:62 Timed out after 90.023s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1049 ------------------------------ STEP: Starting a VirtualMachineInstance level=info timestamp=2018-07-27T07:47:56.946732Z pos=utils.go:243 component=tests msg="Created virtual machine pod virt-launcher-testvmidcx8b-5rt4m" • [SLOW TEST:18.273 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 VirtualMachineInstance definition /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:55 with hugepages /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:108 should consume hugepages /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 hugepages-2Mi /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ S [SKIPPING] [0.242 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 VirtualMachineInstance definition /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:55 with hugepages /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:108 should consume hugepages /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 hugepages-1Gi [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 No node with hugepages hugepages-1Gi capacity /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:160 ------------------------------ •2018/07/27 03:53:02 read closing down: EOF ------------------------------ • [SLOW TEST:105.305 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 with CPU spec /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:238 when CPU model defined /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:284 should report defined CPU model /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:285 ------------------------------ 2018/07/27 03:54:57 read closing down: EOF • [SLOW TEST:115.239 seconds] Configurations /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 with CPU spec /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:238 when CPU model equals to passthrough /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:312 should report exactly the same model as node CPU /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:313 ------------------------------ • [SLOW TEST:114.346 seconds] Configurations 2018/07/27 03:56:51 read closing down: EOF /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 with CPU spec /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:238 when CPU model not defined /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:336 should report CPU model from libvirt capabilities /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:337 ------------------------------ • [SLOW TEST:45.760 seconds] Configurations 2018/07/27 03:57:37 read closing down: EOF /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:44 New VirtualMachineInstance with all supported drives /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:357 should have all the device nodes /root/go/src/kubevirt.io/kubevirt/tests/vmi_configuration_test.go:380 ------------------------------ • [SLOW TEST:15.258 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given a vmi /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:14.177 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given an vm /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:14.499 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given a vmi preset /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:14.390 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given a vmi replica set /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ 2018/07/27 03:59:22 read closing down: EOF Service cluster-ip-vmi successfully exposed for virtualmachineinstance testvmiml8tp • [SLOW TEST:51.979 seconds] Expose /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:53 Expose service on a VM /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:61 Expose ClusterIP service /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:68 Should expose a Cluster IP service on a VMI and connect to it /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:71 ------------------------------ Service cluster-ip-target-vmi successfully exposed for virtualmachineinstance testvmiml8tp •Service node-port-vmi successfully exposed for virtualmachineinstance testvmiml8tp ------------------------------ • [SLOW TEST:7.448 seconds] Expose /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:53 Expose service on a VM /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:61 Expose NodePort service /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:124 Should expose a NodePort service on a VMI and connect to it /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:129 ------------------------------ 2018/07/27 04:00:20 read closing down: EOF Service cluster-ip-udp-vmi successfully exposed for virtualmachineinstance testvmihxfcc • [SLOW TEST:49.783 seconds] Expose /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:53 Expose UDP service on a VMI /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:166 Expose ClusterIP UDP service /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:173 Should expose a ClusterIP service on a VMI and connect to it /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:177 ------------------------------ Service node-port-udp-vmi successfully exposed for virtualmachineinstance testvmihxfcc • [SLOW TEST:8.603 seconds] Expose /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:53 Expose UDP service on a VMI /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:166 Expose NodePort UDP service /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:205 Should expose a NodePort service on a VMI and connect to it /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:210 ------------------------------ 2018/07/27 04:01:16 read closing down: EOF 2018/07/27 04:01:27 read closing down: EOF Service cluster-ip-vmirs successfully exposed for vmirs replicasetpgm49 • [SLOW TEST:56.987 seconds] Expose /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:53 Expose service on a VMI replica set /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:253 Expose ClusterIP service /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:286 Should create a ClusterIP service on VMRS and connect to it /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:290 ------------------------------ Service cluster-ip-vm successfully exposed for virtualmachine testvmidlb7s VM testvmidlb7s was scheduled to start 2018/07/27 04:02:18 read closing down: EOF • [SLOW TEST:52.483 seconds] Expose /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:53 Expose service on an VM /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:318 Expose ClusterIP service /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:362 Connect to ClusterIP services that was set when VM was offline /root/go/src/kubevirt.io/kubevirt/tests/expose_test.go:363 ------------------------------ • [SLOW TEST:141.827 seconds] RegistryDisk /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:41 Starting and stopping the same VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:90 with ephemeral registry disk /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:91 should success multiple times /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:92 ------------------------------ • [SLOW TEST:19.461 seconds] RegistryDisk /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:41 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:111 with ephemeral registry disk /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:112 should not modify the spec on status update /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:113 ------------------------------ • [SLOW TEST:27.312 seconds] RegistryDisk /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:41 Starting multiple VMIs /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:129 with ephemeral registry disk /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:130 should success /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:131 ------------------------------ Pod name: disks-images-provider-tkjs9 Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-vtv7n Pod phase: Running copy all images to host mount directory Pod name: virt-api-7586947775-gg8jc Pod phase: Running level=info timestamp=2018-07-27T08:04:55.017094Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 08:05:00 http: TLS handshake error from 10.244.1.1:57790: EOF level=info timestamp=2018-07-27T08:05:01.158443Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T08:05:01.165038Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/27 08:05:10 http: TLS handshake error from 10.244.1.1:57796: EOF level=info timestamp=2018-07-27T08:05:19.247274Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 08:05:20 http: TLS handshake error from 10.244.1.1:57802: EOF level=info timestamp=2018-07-27T08:05:23.397111Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-07-27T08:05:25.305223Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 08:05:30 http: TLS handshake error from 10.244.1.1:57808: EOF 2018/07/27 08:05:40 http: TLS handshake error from 10.244.1.1:57814: EOF level=info timestamp=2018-07-27T08:05:50.054414Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/07/27 08:05:50 http: TLS handshake error from 10.244.1.1:57820: EOF level=info timestamp=2018-07-27T08:05:53.579538Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/07/27 08:06:00 http: TLS handshake error from 10.244.1.1:57826: EOF Pod name: virt-controller-7d57d96b65-9xnqb Pod phase: Running level=info timestamp=2018-07-27T08:05:05.834447Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilf54t kind= uid=c5210c77-9173-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T08:05:05.855979Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwr5z2\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwr5z2" level=info timestamp=2018-07-27T08:05:05.856862Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi65dml\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi65dml" level=info timestamp=2018-07-27T08:05:33.711054Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2kswm kind= uid=d5ba5cc8-9173-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T08:05:33.716980Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2kswm kind= uid=d5ba5cc8-9173-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T08:05:33.817241Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2nznt kind= uid=d5c40d0b-9173-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T08:05:33.817356Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2nznt kind= uid=d5c40d0b-9173-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T08:05:33.970445Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmipdn97 kind= uid=d5d7dff0-9173-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T08:05:33.971018Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmipdn97 kind= uid=d5d7dff0-9173-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T08:05:34.025167Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi2kswm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi2kswm" level=info timestamp=2018-07-27T08:05:34.091524Z pos=preset.go:139 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihql9d kind= uid=d5e896be-9173-11e8-a364-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-07-27T08:05:34.091655Z pos=preset.go:165 component=virt-controller service=http namespace=kubevirt-test-default name=testvmihql9d kind= uid=d5e896be-9173-11e8-a364-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-07-27T08:05:34.339964Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi2nznt\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi2nznt" level=info timestamp=2018-07-27T08:05:34.437305Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi2nznt\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi2nznt" level=info timestamp=2018-07-27T08:05:34.926754Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmihql9d\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmihql9d" Pod name: virt-controller-7d57d96b65-bjr94 Pod phase: Running level=info timestamp=2018-07-27T06:37:55.441019Z pos=application.go:174 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-j4dhz Pod phase: Running level=info timestamp=2018-07-27T08:05:51.017893Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-27T08:05:51.117516Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihql9d kind= uid=d5e896be-9173-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T08:05:51.118422Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmihql9d kind= uid=d5e896be-9173-11e8-a364-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-27T08:05:51.131444Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmihql9d kind= uid=d5e896be-9173-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T08:05:51.372131Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi2nznt kind= uid=d5c40d0b-9173-11e8-a364-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-27T08:05:52.429312Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type ADDED" level=info timestamp=2018-07-27T08:05:52.431997Z pos=vm.go:657 component=virt-handler namespace=kubevirt-test-default name=testvmi2nznt kind=Domain uid=d5c40d0b-9173-11e8-a364-525500d15501 msg="Domain is in state Paused reason StartingUp" level=info timestamp=2018-07-27T08:05:53.538752Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-27T08:05:53.539092Z pos=vm.go:688 component=virt-handler namespace=kubevirt-test-default name=testvmi2nznt kind=Domain uid=d5c40d0b-9173-11e8-a364-525500d15501 msg="Domain is in state Running reason Unknown" level=info timestamp=2018-07-27T08:05:54.352419Z pos=server.go:75 component=virt-handler msg="Received Domain Event of type MODIFIED" level=info timestamp=2018-07-27T08:05:58.546239Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi2nznt kind= uid=d5c40d0b-9173-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T08:05:58.546503Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmi2nznt kind= uid=d5c40d0b-9173-11e8-a364-525500d15501 msg="No update processing required" level=info timestamp=2018-07-27T08:06:04.199532Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi2nznt kind= uid=d5c40d0b-9173-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T08:06:04.199781Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi2nznt kind= uid=d5c40d0b-9173-11e8-a364-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-27T08:06:04.221002Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi2nznt kind= uid=d5c40d0b-9173-11e8-a364-525500d15501 msg="Synchronization loop succeeded." Pod name: virt-handler-l7xxz Pod phase: Running level=info timestamp=2018-07-27T08:05:52.085337Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmipdn97 kind= uid=d5d7dff0-9173-11e8-a364-525500d15501 msg="No update processing required" level=info timestamp=2018-07-27T08:05:52.179063Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi2kswm kind= uid=d5ba5cc8-9173-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T08:05:52.179225Z pos=vm.go:392 component=virt-handler namespace=kubevirt-test-default name=testvmi2kswm kind= uid=d5ba5cc8-9173-11e8-a364-525500d15501 msg="No update processing required" level=error timestamp=2018-07-27T08:05:52.185270Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmipdn97 kind= uid=d5d7dff0-9173-11e8-a364-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmipdn97\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-27T08:05:52.189238Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmipdn97\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmipdn97" level=info timestamp=2018-07-27T08:05:52.189430Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmipdn97 kind= uid=d5d7dff0-9173-11e8-a364-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-27T08:05:52.200295Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmipdn97 kind= uid=d5d7dff0-9173-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T08:05:52.201771Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmipdn97 kind= uid=d5d7dff0-9173-11e8-a364-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-27T08:05:52.206712Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmipdn97 kind= uid=d5d7dff0-9173-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=error timestamp=2018-07-27T08:05:52.266630Z pos=vm.go:404 component=virt-handler namespace=kubevirt-test-default name=testvmi2kswm kind= uid=d5ba5cc8-9173-11e8-a364-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi2kswm\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-07-27T08:05:52.268566Z pos=vm.go:251 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi2kswm\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi2kswm" level=info timestamp=2018-07-27T08:05:52.268720Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi2kswm kind= uid=d5ba5cc8-9173-11e8-a364-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-27T08:05:52.283920Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi2kswm kind= uid=d5ba5cc8-9173-11e8-a364-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-07-27T08:05:52.284064Z pos=vm.go:389 component=virt-handler namespace=kubevirt-test-default name=testvmi2kswm kind= uid=d5ba5cc8-9173-11e8-a364-525500d15501 msg="Processing vmi update" level=info timestamp=2018-07-27T08:05:52.303216Z pos=vm.go:413 component=virt-handler namespace=kubevirt-test-default name=testvmi2kswm kind= uid=d5ba5cc8-9173-11e8-a364-525500d15501 msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi2kswm-8d8d7 Pod phase: Running level=info timestamp=2018-07-27T08:05:51.540673Z pos=virt-launcher.go:214 component=virt-launcher msg="Detected domain with UUID 1790d922-f8f9-4f05-9af4-8b68def4c9a5" level=info timestamp=2018-07-27T08:05:51.541392Z pos=monitor.go:253 component=virt-launcher msg="Monitoring loop: rate 1s start timeout 5m0s" level=info timestamp=2018-07-27T08:05:51.542004Z pos=client.go:119 component=virt-launcher msg="domain status: 3:11" level=info timestamp=2018-07-27T08:05:51.864495Z pos=manager.go:196 component=virt-launcher namespace=kubevirt-test-default name=testvmi2kswm kind= uid=d5ba5cc8-9173-11e8-a364-525500d15501 msg="Domain started." level=info timestamp=2018-07-27T08:05:51.866406Z pos=server.go:74 component=virt-launcher namespace=kubevirt-test-default name=testvmi2kswm kind= uid=d5ba5cc8-9173-11e8-a364-525500d15501 msg="Synced vmi" level=info timestamp=2018-07-27T08:05:51.871926Z pos=client.go:145 component=virt-launcher msg="processed event" level=info timestamp=2018-07-27T08:05:51.872102Z pos=client.go:136 component=virt-launcher msg="Libvirt event 4 with reason 0 received" level=info timestamp=2018-07-27T08:05:51.885059Z pos=client.go:119 component=virt-launcher msg="domain status: 1:1" level=info timestamp=2018-07-27T08:05:51.902605Z pos=client.go:145 component=virt-launcher msg="processed event" level=info timestamp=2018-07-27T08:05:51.902764Z pos=client.go:136 component=virt-launcher msg="Libvirt event 2 with reason 0 received" level=info timestamp=2018-07-27T08:05:51.920353Z pos=client.go:119 component=virt-launcher msg="domain status: 1:1" level=info timestamp=2018-07-27T08:05:51.923446Z pos=client.go:145 component=virt-launcher msg="processed event" level=info timestamp=2018-07-27T08:05:52.281816Z pos=server.go:74 component=virt-launcher namespace=kubevirt-test-default name=testvmi2kswm kind= uid=d5ba5cc8-9173-11e8-a364-525500d15501 msg="Synced vmi" level=info timestamp=2018-07-27T08:05:52.298633Z pos=server.go:74 component=virt-launcher namespace=kubevirt-test-default name=testvmi2kswm kind= uid=d5ba5cc8-9173-11e8-a364-525500d15501 msg="Synced vmi" level=info timestamp=2018-07-27T08:05:52.553271Z pos=monitor.go:222 component=virt-launcher msg="Found PID for 1790d922-f8f9-4f05-9af4-8b68def4c9a5: 186" Pod name: virt-launcher-testvmi2nznt-t8jlh Pod phase: Running level=info timestamp=2018-07-27T08:05:51.696488Z pos=client.go:136 component=virt-launcher msg="Libvirt event 0 with reason 0 received" level=info timestamp=2018-07-27T08:05:52.416793Z pos=client.go:119 component=virt-launcher msg="domain status: 3:11" level=info timestamp=2018-07-27T08:05:52.423212Z pos=virt-launcher.go:214 component=virt-launcher msg="Detected domain with UUID dc082b8e-3b25-4d0c-985b-fa6d4b8e0deb" level=info timestamp=2018-07-27T08:05:52.423485Z pos=monitor.go:253 component=virt-launcher msg="Monitoring loop: rate 1s start timeout 5m0s" level=info timestamp=2018-07-27T08:05:52.429916Z pos=client.go:145 component=virt-launcher msg="processed event" level=info timestamp=2018-07-27T08:05:52.965679Z pos=client.go:136 component=virt-launcher msg="Libvirt event 4 with reason 0 received" level=info timestamp=2018-07-27T08:05:52.988910Z pos=client.go:119 component=virt-launcher msg="domain status: 1:1" level=info timestamp=2018-07-27T08:05:53.014952Z pos=manager.go:196 component=virt-launcher namespace=kubevirt-test-default name=testvmi2nznt kind= uid=d5c40d0b-9173-11e8-a364-525500d15501 msg="Domain started." level=info timestamp=2018-07-27T08:05:53.020766Z pos=server.go:74 component=virt-launcher namespace=kubevirt-test-default name=testvmi2nznt kind= uid=d5c40d0b-9173-11e8-a364-525500d15501 msg="Synced vmi" level=info timestamp=2018-07-27T08:05:53.430261Z pos=monitor.go:222 component=virt-launcher msg="Found PID for dc082b8e-3b25-4d0c-985b-fa6d4b8e0deb: 186" level=info timestamp=2018-07-27T08:05:53.541129Z pos=client.go:145 component=virt-launcher msg="processed event" level=info timestamp=2018-07-27T08:05:53.541442Z pos=client.go:136 component=virt-launcher msg="Libvirt event 2 with reason 0 received" level=info timestamp=2018-07-27T08:05:53.568766Z pos=client.go:119 component=virt-launcher msg="domain status: 1:1" level=info timestamp=2018-07-27T08:05:54.353433Z pos=client.go:145 component=virt-launcher msg="processed event" level=info timestamp=2018-07-27T08:06:04.217969Z pos=server.go:74 component=virt-launcher namespace=kubevirt-test-default name=testvmi2nznt kind= uid=d5c40d0b-9173-11e8-a364-525500d15501 msg="Synced vmi" Pod name: virt-launcher-testvmi65dml-g8xpn Pod phase: Pending Pod name: virt-launcher-testvmihql9d-lr6nc Pod phase: Running level=info timestamp=2018-07-27T08:05:49.561018Z pos=client.go:136 component=virt-launcher msg="Libvirt event 0 with reason 0 received" level=info timestamp=2018-07-27T08:05:50.340783Z pos=client.go:119 component=virt-launcher msg="domain status: 3:11" level=info timestamp=2018-07-27T08:05:50.343040Z pos=virt-launcher.go:214 component=virt-launcher msg="Detected domain with UUID 5ee2c71d-77a7-4cab-aeb7-1fcc7c2ababd" level=info timestamp=2018-07-27T08:05:50.343332Z pos=monitor.go:253 component=virt-launcher msg="Monitoring loop: rate 1s start timeout 5m0s" level=info timestamp=2018-07-27T08:05:50.368600Z pos=client.go:145 component=virt-launcher msg="processed event" level=info timestamp=2018-07-27T08:05:50.937241Z pos=client.go:136 component=virt-launcher msg="Libvirt event 4 with reason 0 received" level=info timestamp=2018-07-27T08:05:50.966489Z pos=client.go:119 component=virt-launcher msg="domain status: 1:1" level=info timestamp=2018-07-27T08:05:50.972394Z pos=client.go:145 component=virt-launcher msg="processed event" level=info timestamp=2018-07-27T08:05:50.981401Z pos=client.go:136 component=virt-launcher msg="Libvirt event 2 with reason 0 received" level=info timestamp=2018-07-27T08:05:50.997051Z pos=manager.go:196 component=virt-launcher namespace=kubevirt-test-default name=testvmihql9d kind= uid=d5e896be-9173-11e8-a364-525500d15501 msg="Domain started." level=info timestamp=2018-07-27T08:05:50.999358Z pos=server.go:74 component=virt-launcher namespace=kubevirt-test-default name=testvmihql9d kind= uid=d5e896be-9173-11e8-a364-525500d15501 msg="Synced vmi" level=info timestamp=2018-07-27T08:05:51.002918Z pos=client.go:119 component=virt-launcher msg="domain status: 1:1" level=info timestamp=2018-07-27T08:05:51.019682Z pos=client.go:145 component=virt-launcher msg="processed event" level=info timestamp=2018-07-27T08:05:51.127494Z pos=server.go:74 component=virt-launcher namespace=kubevirt-test-default name=testvmihql9d kind= uid=d5e896be-9173-11e8-a364-525500d15501 msg="Synced vmi" level=info timestamp=2018-07-27T08:05:51.352216Z pos=monitor.go:222 component=virt-launcher msg="Found PID for 5ee2c71d-77a7-4cab-aeb7-1fcc7c2ababd: 180" Pod name: virt-launcher-testvmipdn97-rhcvm Pod phase: Running level=info timestamp=2018-07-27T08:05:51.363091Z pos=client.go:119 component=virt-launcher msg="domain status: 3:11" level=info timestamp=2018-07-27T08:05:51.371096Z pos=virt-launcher.go:214 component=virt-launcher msg="Detected domain with UUID 5e1186d9-e9bc-4e46-a8e4-457133e18c79" level=info timestamp=2018-07-27T08:05:51.371374Z pos=monitor.go:253 component=virt-launcher msg="Monitoring loop: rate 1s start timeout 5m0s" level=info timestamp=2018-07-27T08:05:51.486680Z pos=client.go:145 component=virt-launcher msg="processed event" level=info timestamp=2018-07-27T08:05:51.705743Z pos=client.go:136 component=virt-launcher msg="Libvirt event 4 with reason 0 received" level=info timestamp=2018-07-27T08:05:51.782589Z pos=client.go:119 component=virt-launcher msg="domain status: 1:1" level=info timestamp=2018-07-27T08:05:51.791652Z pos=client.go:145 component=virt-launcher msg="processed event" level=info timestamp=2018-07-27T08:05:51.791806Z pos=client.go:136 component=virt-launcher msg="Libvirt event 2 with reason 0 received" level=info timestamp=2018-07-27T08:05:51.826958Z pos=manager.go:196 component=virt-launcher namespace=kubevirt-test-default name=testvmipdn97 kind= uid=d5d7dff0-9173-11e8-a364-525500d15501 msg="Domain started." level=info timestamp=2018-07-27T08:05:51.830491Z pos=server.go:74 component=virt-launcher namespace=kubevirt-test-default name=testvmipdn97 kind= uid=d5d7dff0-9173-11e8-a364-525500d15501 msg="Synced vmi" level=info timestamp=2018-07-27T08:05:51.831660Z pos=client.go:119 component=virt-launcher msg="domain status: 1:1" level=info timestamp=2018-07-27T08:05:51.911231Z pos=client.go:145 component=virt-launcher msg="processed event" level=info timestamp=2018-07-27T08:05:52.198942Z pos=server.go:74 component=virt-launcher namespace=kubevirt-test-default name=testvmipdn97 kind= uid=d5d7dff0-9173-11e8-a364-525500d15501 msg="Synced vmi" level=info timestamp=2018-07-27T08:05:52.206310Z pos=server.go:74 component=virt-launcher namespace=kubevirt-test-default name=testvmipdn97 kind= uid=d5d7dff0-9173-11e8-a364-525500d15501 msg="Synced vmi" level=info timestamp=2018-07-27T08:05:52.379385Z pos=monitor.go:222 component=virt-launcher msg="Found PID for 5e1186d9-e9bc-4e46-a8e4-457133e18c79: 185" Pod name: virt-launcher-testvmis62sz-wd47v Pod phase: Succeeded • Failure in Spec Setup (BeforeEach) [45.414 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be able to reach [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 the Inbound VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Expected error: <*errors.errorString | 0xc420a3c120>: { s: "Timeout trying to connect to the virtual machine instance", } Timeout trying to connect to the virtual machine instance not to have occurred /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:94 ------------------------------ level=info timestamp=2018-07-27T08:05:34.600778Z pos=utils.go:243 component=tests msg="Created virtual machine pod virt-launcher-testvmi2kswm-8d8d7" level=info timestamp=2018-07-27T08:05:50.994251Z pos=utils.go:243 component=tests msg="Pod owner ship transferred to the node virt-launcher-testvmi2kswm-8d8d7" level=info timestamp=2018-07-27T08:05:52.266415Z pos=utils.go:243 component=tests msg="VirtualMachineInstance defined." level=info timestamp=2018-07-27T08:05:52.718599Z pos=utils.go:243 component=tests msg="VirtualMachineInstance started." 2018/07/27 04:07:15 read closing down: EOF 2018/07/27 04:07:25 read closing down: EOF 2018/07/27 04:07:37 read closing down: EOF 2018/07/27 04:07:48 read closing down: EOF 2018/07/27 04:07:48 read closing down: EOF 2018/07/27 04:07:51 read closing down: EOF 2018/07/27 04:07:52 read closing down: EOF • [SLOW TEST:93.806 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 2018/07/27 04:07:52 read closing down: EOF should be able to reach /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 the Inbound VirtualMachineInstance with pod network connectivity explicitly set /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ 2018/07/27 04:07:54 read closing down: EOF 2018/07/27 04:07:55 read closing down: EOF •2018/07/27 04:07:55 read closing down: EOF 2018/07/27 04:07:58 read closing down: EOF •2018/07/27 04:07:59 read closing down: EOF 2018/07/27 04:07:59 read closing down: EOF • ------------------------------ • [SLOW TEST:5.203 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 should be reachable via the propagated IP from a Pod /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 on a different node from Pod /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ •• ------------------------------ • [SLOW TEST:5.582 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 with a service matching the vmi exposed /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:283 should be able to reach the vmi based on labels specified on the vmi /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:303 ------------------------------ • ------------------------------ • [SLOW TEST:5.325 seconds] Networking /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:48 with a subdomain and a headless service given /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:330 should be able to reach the vmi via its unique fully qualified domain name /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:353 ------------------------------ panic: test timed out after 1h30m0s goroutine 12215 [running]: testing.(*M).startAlarm.func1() /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:1240 +0xfc created by time.goFunc /gimme/.gimme/versions/go1.10.linux.amd64/src/time/sleep.go:172 +0x44 goroutine 1 [chan receive, 90 minutes]: testing.(*T).Run(0xc4204dfe00, 0x139cbc3, 0x9, 0x142ef00, 0x4801e6) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:825 +0x301 testing.runTests.func1(0xc4204dfd10) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:1063 +0x64 testing.tRunner(0xc4204dfd10, 0xc42081fdf8) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:777 +0xd0 testing.runTests(0xc42045bce0, 0x1d2fa50, 0x1, 0x1, 0x412009) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:1061 +0x2c4 testing.(*M).Run(0xc42096ac00, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:978 +0x171 main.main() _testmain.go:44 +0x151 goroutine 5 [chan receive]: kubevirt.io/kubevirt/vendor/github.com/golang/glog.(*loggingT).flushDaemon(0x1d5b280) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/golang/glog/glog.go:879 +0x8b created by kubevirt.io/kubevirt/vendor/github.com/golang/glog.init.0 /root/go/src/kubevirt.io/kubevirt/vendor/github.com/golang/glog/glog.go:410 +0x203 goroutine 6 [syscall, 90 minutes]: os/signal.signal_recv(0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/sigqueue.go:139 +0xa6 os/signal.loop() /gimme/.gimme/versions/go1.10.linux.amd64/src/os/signal/signal_unix.go:22 +0x22 created by os/signal.init.0 /gimme/.gimme/versions/go1.10.linux.amd64/src/os/signal/signal_unix.go:28 +0x41 goroutine 13 [select]: kubevirt.io/kubevirt/tests.(*ObjectEventWatcher).Watch(0xc4211d9088, 0xc420b48120) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:288 +0x57e kubevirt.io/kubevirt/tests.(*ObjectEventWatcher).WaitFor(0xc4211d9088, 0x139896b, 0x6, 0x11e17c0, 0x14af0e0, 0x0) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:298 +0xba kubevirt.io/kubevirt/tests.waitForVMIStart(0x14b86e0, 0xc42015e780, 0x5a, 0x0, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1035 +0x4ea kubevirt.io/kubevirt/tests.WaitForSuccessfulVMIStart(0x14b86e0, 0xc42015e780, 0xc420be8240, 0xc4211d9180) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1072 +0x43 kubevirt.io/kubevirt/tests_test.glob..func18.3(0xc42015e780, 0x142eed0, 0x1d79938) /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:86 +0x4d kubevirt.io/kubevirt/tests_test.glob..func18.11.1() /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:387 +0x1a4 kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).runSync(0xc420978120, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113 +0x9c kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).run(0xc420978120, 0x3, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:64 +0x13e kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*ItNode).Run(0xc42098a0a0, 0x14b4b80, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes/it_node.go:26 +0x7f kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec.(*Spec).runSample(0xc420861a40, 0x0, 0x14b4b80, 0xc4200c3500) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec/spec.go:203 +0x648 kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec.(*Spec).Run(0xc420861a40, 0x14b4b80, 0xc4200c3500) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec/spec.go:138 +0xff kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).runSpec(0xc420126140, 0xc420861a40, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:200 +0x10d kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).runSpecs(0xc420126140, 0x1) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:170 +0x329 kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).Run(0xc420126140, 0xb) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:66 +0x11b kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/suite.(*Suite).Run(0xc4200eaaf0, 0x7f55b8f50518, 0xc4204dfe00, 0x139f1a6, 0xb, 0xc42045bd40, 0x2, 0x2, 0x14d1400, 0xc4200c3500, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/suite/suite.go:62 +0x27c kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo.RunSpecsWithCustomReporters(0x14b5be0, 0xc4204dfe00, 0x139f1a6, 0xb, 0xc42045bd20, 0x2, 0x2, 0x2) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/ginkgo_dsl.go:221 +0x258 kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo.RunSpecsWithDefaultAndCustomReporters(0x14b5be0, 0xc4204dfe00, 0x139f1a6, 0xb, 0xc420398f90, 0x1, 0x1, 0x1) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/ginkgo_dsl.go:209 +0xab kubevirt.io/kubevirt/tests_test.TestTests(0xc4204dfe00) /root/go/src/kubevirt.io/kubevirt/tests/tests_suite_test.go:43 +0xaa testing.tRunner(0xc4204dfe00, 0x142ef00) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:777 +0xd0 created by testing.(*T).Run /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:824 +0x2e0 goroutine 14 [chan receive, 90 minutes]: kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).registerForInterrupts(0xc420126140, 0xc420905e60) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:223 +0xd1 created by kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).Run /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:60 +0x88 goroutine 15 [select, 90 minutes, locked to thread]: runtime.gopark(0x14310d8, 0x0, 0x13996e5, 0x6, 0x18, 0x1) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/proc.go:291 +0x11a runtime.selectgo(0xc420497750, 0xc420905f20) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/select.go:392 +0xe50 runtime.ensureSigM.func1() /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/signal_unix.go:549 +0x1f4 runtime.goexit() /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/asm_amd64.s:2361 +0x1 goroutine 43 [IO wait]: internal/poll.runtime_pollWait(0x7f55b8f36f00, 0x72, 0xc420e71850) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/netpoll.go:173 +0x57 internal/poll.(*pollDesc).wait(0xc4207ea318, 0x72, 0xffffffffffffff00, 0x14b6da0, 0x1c467d0) /gimme/.gimme/versions/go1.10.linux.amd64/src/internal/poll/fd_poll_runtime.go:85 +0x9b internal/poll.(*pollDesc).waitRead(0xc4207ea318, 0xc420c24000, 0x8000, 0x8000) /gimme/.gimme/versions/go1.10.linux.amd64/src/internal/poll/fd_poll_runtime.go:90 +0x3d internal/poll.(*FD).Read(0xc4207ea300, 0xc420c24000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/internal/poll/fd_unix.go:157 +0x17d net.(*netFD).Read(0xc4207ea300, 0xc420c24000, 0x8000, 0x8000, 0x0, 0x8, 0x7ffb) /gimme/.gimme/versions/go1.10.linux.amd64/src/net/fd_unix.go:202 +0x4f net.(*conn).Read(0xc420984358, 0xc420c24000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/net/net.go:176 +0x6a crypto/tls.(*block).readFromUntil(0xc4206b9110, 0x7f55b4361210, 0xc420984358, 0x5, 0xc420984358, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/crypto/tls/conn.go:493 +0x96 crypto/tls.(*Conn).readRecord(0xc4207f0700, 0x1431217, 0xc4207f0820, 0x20) /gimme/.gimme/versions/go1.10.linux.amd64/src/crypto/tls/conn.go:595 +0xe0 crypto/tls.(*Conn).Read(0xc4207f0700, 0xc4207b3000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/crypto/tls/conn.go:1156 +0x100 bufio.(*Reader).Read(0xc4208b3260, 0xc4206f82d8, 0x9, 0x9, 0xc4207888a8, 0x1, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/bufio/bufio.go:216 +0x238 io.ReadAtLeast(0x14b3980, 0xc4208b3260, 0xc4206f82d8, 0x9, 0x9, 0x9, 0xc4206a82e0, 0x43f2c1, 0xc42073fc80) /gimme/.gimme/versions/go1.10.linux.amd64/src/io/io.go:309 +0x86 io.ReadFull(0x14b3980, 0xc4208b3260, 0xc4206f82d8, 0x9, 0x9, 0x1431220, 0xc420e71d10, 0x462d33) /gimme/.gimme/versions/go1.10.linux.amd64/src/io/io.go:327 +0x58 kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.readFrameHeader(0xc4206f82d8, 0x9, 0x9, 0x14b3980, 0xc4208b3260, 0x0, 0xc400000000, 0x7efbe0, 0xc4208a7928) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/frame.go:237 +0x7b kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc4206f82a0, 0xc420697c50, 0x0, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/frame.go:492 +0xa4 kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*clientConnReadLoop).run(0xc420e71fb0, 0x142fe58, 0xc42047afb0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/transport.go:1428 +0x8e kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*ClientConn).readLoop(0xc4207b0000) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/transport.go:1354 +0x76 created by kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*Transport).newClientConn /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/transport.go:579 +0x651 goroutine 12214 [chan receive]: kubevirt.io/kubevirt/tests.(*ObjectEventWatcher).Watch.func3(0x14bdbe0, 0xc4206db5c0, 0x0, 0xc420880990, 0xc420a917a0) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:275 +0x93 created by kubevirt.io/kubevirt/tests.(*ObjectEventWatcher).Watch /root/go/src/kubevirt.io/kubevirt/tests/utils.go:273 +0x4b3 goroutine 11868 [chan receive, 2 minutes]: kubevirt.io/kubevirt/pkg/kubecli.(*asyncWSRoundTripper).WebsocketCallback(0xc420d2f4b0, 0xc4210368c0, 0xc4211ee5a0, 0x0, 0x0, 0x18, 0xc421099ec8) /root/go/src/kubevirt.io/kubevirt/pkg/kubecli/vmi.go:163 +0x32b kubevirt.io/kubevirt/pkg/kubecli.(*asyncWSRoundTripper).WebsocketCallback-fm(0xc4210368c0, 0xc4211ee5a0, 0x0, 0x0, 0xc4210368c0, 0xc4211ee5a0) /root/go/src/kubevirt.io/kubevirt/pkg/kubecli/vmi.go:313 +0x52 kubevirt.io/kubevirt/pkg/kubecli.(*WebsocketRoundTripper).RoundTrip(0xc420d2f950, 0xc420ce1c00, 0x0, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/pkg/kubecli/vmi.go:142 +0xab kubevirt.io/kubevirt/pkg/kubecli.(*vmis).asyncSubresourceHelper.func1(0x14b3e60, 0xc420d2f950, 0xc420ce1c00, 0xc420bc7980) /root/go/src/kubevirt.io/kubevirt/pkg/kubecli/vmi.go:328 +0x56 created by kubevirt.io/kubevirt/pkg/kubecli.(*vmis).asyncSubresourceHelper /root/go/src/kubevirt.io/kubevirt/pkg/kubecli/vmi.go:326 +0x33a goroutine 9277 [chan send, 28 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc420550ba0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 9629 [chan send, 23 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc420882ae0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 9095 [chan send, 29 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc4206cc1e0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 11584 [chan send, 6 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc4206b8690) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 12213 [semacquire]: sync.runtime_notifyListWait(0xc4208a7940, 0xc400000001) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/sema.go:510 +0x10b sync.(*Cond).Wait(0xc4208a7930) /gimme/.gimme/versions/go1.10.linux.amd64/src/sync/cond.go:56 +0x80 kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*pipe).Read(0xc4208a7928, 0xc42110ac01, 0x5ff, 0x5ff, 0x0, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/pipe.go:64 +0x8f kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.transportResponseBody.Read(0xc4208a7900, 0xc42110ac01, 0x5ff, 0x5ff, 0x0, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/transport.go:1674 +0xa1 encoding/json.(*Decoder).refill(0xc4201d4d20, 0x835c0a, 0x9) /gimme/.gimme/versions/go1.10.linux.amd64/src/encoding/json/stream.go:159 +0x132 encoding/json.(*Decoder).readValue(0xc4201d4d20, 0x0, 0x0, 0x11f3720) /gimme/.gimme/versions/go1.10.linux.amd64/src/encoding/json/stream.go:134 +0x23d encoding/json.(*Decoder).Decode(0xc4201d4d20, 0x120f6c0, 0xc420a62300, 0x14bb9a0, 0xc420a9e280) /gimme/.gimme/versions/go1.10.linux.amd64/src/encoding/json/stream.go:63 +0x78 kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc4206db590, 0xc420ffa400, 0x400, 0x400, 0xc42090ce00, 0x40, 0x38) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:150 +0x295 kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc42056c960, 0x0, 0x14bd660, 0xc42090ce00, 0x380, 0x14bb9a0, 0xc420a91798, 0x456ae0, 0xc420a91740) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0x95 kubevirt.io/kubevirt/vendor/k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc42087ffc0, 0xc420dddfa8, 0x5, 0x14bb9a0, 0xc420a9e280, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0x7c kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc4206db5c0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:93 +0x12e created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 9397 [chan send, 27 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc4203d6ae0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 6743 [chan send, 35 minutes]: kubevirt.io/kubevirt/tests_test.glob..func23.1.2.1.1(0x14ef100, 0xc4206dce00, 0xc4201440f0, 0xc4203e2ea0, 0xc420984528, 0xc420984560) /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:81 +0x138 created by kubevirt.io/kubevirt/tests_test.glob..func23.1.2.1 /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:73 +0x386 goroutine 9949 [chan send, 22 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc420420a50) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 make: *** [functest] Error 2 + make cluster-down ./cluster/down.sh