+ export WORKSPACE=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release + WORKSPACE=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release + [[ k8s-1.10.4-release =~ openshift-.* ]] + [[ k8s-1.10.4-release =~ .*-1.10.4-.* ]] + export KUBEVIRT_PROVIDER=k8s-1.10.4 + KUBEVIRT_PROVIDER=k8s-1.10.4 + export KUBEVIRT_NUM_NODES=2 + KUBEVIRT_NUM_NODES=2 + export NFS_WINDOWS_DIR=/home/nfs/images/windows2016 + NFS_WINDOWS_DIR=/home/nfs/images/windows2016 + export NAMESPACE=kube-system + NAMESPACE=kube-system + trap '{ make cluster-down; }' EXIT SIGINT SIGTERM SIGSTOP + make cluster-down ./cluster/down.sh + make cluster-up ./cluster/up.sh Downloading ....... Downloading ....... 2018/08/02 10:18:02 Waiting for host: 192.168.66.101:22 2018/08/02 10:18:05 Problem with dial: dial tcp 192.168.66.101:22: getsockopt: no route to host. Sleeping 5s 2018/08/02 10:18:13 Problem with dial: dial tcp 192.168.66.101:22: getsockopt: no route to host. Sleeping 5s 2018/08/02 10:18:18 Connected to tcp://192.168.66.101:22 + kubeadm init --config /etc/kubernetes/kubeadm.conf [init] Using Kubernetes version: v1.10.4 [init] Using Authorization modes: [Node RBAC] [preflight] Running pre-flight checks. [WARNING FileExisting-crictl]: crictl not found in system path Suggestion: go get github.com/kubernetes-incubator/cri-tools/cmd/crictl Flag --admission-control has been deprecated, Use --enable-admission-plugins or --disable-admission-plugins instead. Will be removed in a future version. [certificates] Generated ca certificate and key. [certificates] Generated apiserver certificate and key. [certificates] apiserver serving cert is signed for DNS names [node01 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 192.168.66.101] [certificates] Generated apiserver-kubelet-client certificate and key. [certificates] Generated sa key and public key. [certificates] Generated front-proxy-ca certificate and key. [certificates] Generated front-proxy-client certificate and key. [certificates] Generated etcd/ca certificate and key. [certificates] Generated etcd/server certificate and key. [certificates] etcd/server serving cert is signed for DNS names [localhost] and IPs [127.0.0.1] [certificates] Generated etcd/peer certificate and key. [certificates] etcd/peer serving cert is signed for DNS names [node01] and IPs [192.168.66.101] [certificates] Generated etcd/healthcheck-client certificate and key. [certificates] Generated apiserver-etcd-client certificate and key. [certificates] Valid certificates and keys now exist in "/etc/kubernetes/pki" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/admin.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/kubelet.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/controller-manager.conf" [kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/scheduler.conf" [controlplane] Wrote Static Pod manifest for component kube-apiserver to "/etc/kubernetes/manifests/kube-apiserver.yaml" [controlplane] Wrote Static Pod manifest for component kube-controller-manager to "/etc/kubernetes/manifests/kube-controller-manager.yaml" [controlplane] Wrote Static Pod manifest for component kube-scheduler to "/etc/kubernetes/manifests/kube-scheduler.yaml" [etcd] Wrote Static Pod manifest for a local etcd instance to "/etc/kubernetes/manifests/etcd.yaml" [init] Waiting for the kubelet to boot up the control plane as Static Pods from directory "/etc/kubernetes/manifests". [init] This might take a minute or longer if the control plane images have to be pulled. [apiclient] All control plane components are healthy after 29.036698 seconds [uploadconfig] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace [markmaster] Will mark node node01 as master by adding a label and a taint [markmaster] Master node01 tainted and labelled with key/value: node-role.kubernetes.io/master="" [bootstraptoken] Using token: abcdef.1234567890123456 [bootstraptoken] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials [bootstraptoken] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token [bootstraptoken] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster [bootstraptoken] Creating the "cluster-info" ConfigMap in the "kube-public" namespace [addons] Applied essential addon: kube-dns [addons] Applied essential addon: kube-proxy Your Kubernetes master has initialized successfully! To start using your cluster, you need to run the following as a regular user: mkdir -p $HOME/.kube sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config sudo chown $(id -u):$(id -g) $HOME/.kube/config You should now deploy a pod network to the cluster. Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at: https://kubernetes.io/docs/concepts/cluster-administration/addons/ You can now join any number of machines by running the following on each node as root: kubeadm join 192.168.66.101:6443 --token abcdef.1234567890123456 --discovery-token-ca-cert-hash sha256:27261037da83967ffb9762e1952b52072309495f988ba45017fda571012b3ced + kubectl --kubeconfig=/etc/kubernetes/admin.conf apply -f https://raw.githubusercontent.com/coreos/flannel/v0.9.1/Documentation/kube-flannel.yml clusterrole.rbac.authorization.k8s.io "flannel" created clusterrolebinding.rbac.authorization.k8s.io "flannel" created serviceaccount "flannel" created configmap "kube-flannel-cfg" created daemonset.extensions "kube-flannel-ds" created + kubectl --kubeconfig=/etc/kubernetes/admin.conf taint nodes node01 node-role.kubernetes.io/master:NoSchedule- node "node01" untainted 2018/08/02 10:19:04 Waiting for host: 192.168.66.102:22 2018/08/02 10:19:07 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: no route to host. Sleeping 5s 2018/08/02 10:19:15 Problem with dial: dial tcp 192.168.66.102:22: getsockopt: connection refused. Sleeping 5s 2018/08/02 10:19:20 Connected to tcp://192.168.66.102:22 + kubeadm join --token abcdef.1234567890123456 192.168.66.101:6443 --ignore-preflight-errors=all --discovery-token-unsafe-skip-ca-verification=true [preflight] Running pre-flight checks. [WARNING FileExisting-crictl]: crictl not found in system path Suggestion: go get github.com/kubernetes-incubator/cri-tools/cmd/crictl [discovery] Trying to connect to API Server "192.168.66.101:6443" [discovery] Created cluster-info discovery client, requesting info from "https://192.168.66.101:6443" [discovery] Cluster info signature and contents are valid and no TLS pinning was specified, will use API Server "192.168.66.101:6443" [discovery] Successfully established connection with API Server "192.168.66.101:6443" This node has joined the cluster: * Certificate signing request was sent to master and a response was received. * The Kubelet was informed of the new secure connection details. Run 'kubectl get nodes' on the master to see this node join the cluster. Sending file modes: C0755 39611920 kubectl Sending file modes: C0600 5454 admin.conf Cluster "kubernetes" set. Cluster "kubernetes" set. + set +e + kubectl get nodes --no-headers + cluster/kubectl.sh get nodes --no-headers node01 Ready master 37s v1.10.4 node02 Ready 11s v1.10.4 + kubectl_rc=0 + '[' 0 -ne 0 ']' ++ kubectl get nodes --no-headers ++ cluster/kubectl.sh get nodes --no-headers ++ grep NotReady + '[' -n '' ']' + set -e + echo 'Nodes are ready:' Nodes are ready: + kubectl get nodes + cluster/kubectl.sh get nodes NAME STATUS ROLES AGE VERSION node01 Ready master 38s v1.10.4 node02 Ready 12s v1.10.4 + make cluster-sync ./cluster/build.sh Building ... Untagged: localhost:33088/kubevirt/virt-controller:devel Untagged: localhost:33088/kubevirt/virt-controller@sha256:f7a655d6e908a8b040cc490893586f6cd620e1a3d36a508fc28565f75d475d11 Deleted: sha256:d40420ac21c33340832ac4cd91bf899967cbca9dd7481dd46d84e3d8309b2a02 Untagged: localhost:33088/kubevirt/virt-launcher:devel Untagged: localhost:33088/kubevirt/virt-launcher@sha256:cf34408bbe6a883237c5fa3de76cefabb06d0e1d10c15d3c05971b3d91e78b85 Deleted: sha256:91fb5782c98785c1644b59a0ff08bfb636bb0bdbfeda8be840fa41824f0c89f0 Untagged: localhost:33088/kubevirt/virt-handler:devel Untagged: localhost:33088/kubevirt/virt-handler@sha256:1a0cf511e5007b383a053987a44abe4c5e2548bace907c809f8c57cf209b5492 Deleted: sha256:d2262f8551350415dcae4d41946782be2a6ce9a72bf2ffd3a2cab7ca22e85c8c Untagged: localhost:33088/kubevirt/virt-api:devel Untagged: localhost:33088/kubevirt/virt-api@sha256:0f621bfe3c872195e88d79c62a0ff4ed5d74b0cabca74d2bc8ad3b5b10eea5d1 Deleted: sha256:30ca9e6ddadcbccdb0d1c23cd7ee6bae4e60bd480176c0750321679b825bf4a9 Untagged: localhost:33088/kubevirt/subresource-access-test:devel Untagged: localhost:33088/kubevirt/subresource-access-test@sha256:25426397a1cac085e95dfed5e08b135b3986960e4a5a904c8c83cded57f014f3 Deleted: sha256:3c9fcb5882bd864fe4bd98708576be7f4f5e4eb0dffe1c31129ff411abc69f62 Untagged: localhost:33073/kubevirt/example-hook-sidecar:devel Untagged: localhost:33073/kubevirt/example-hook-sidecar@sha256:cd05d0c787ef531a968916b220f54c46d75acb12c79adaca62e044b7e4acb072 Deleted: sha256:5bd7496f7797f10dcaa886bad751cf4236f2328b9def997f62f07779f5a36f63 sha256:559a45ac63f40982ccce3a1b80cb62788566f2032c847ad9c45ee993eb9c48d4 go version go1.10 linux/amd64 go version go1.10 linux/amd64 make[1]: Entering directory `/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt' hack/dockerized "./hack/check.sh && KUBEVIRT_VERSION= ./hack/build-go.sh install " && ./hack/build-copy-artifacts.sh sha256:559a45ac63f40982ccce3a1b80cb62788566f2032c847ad9c45ee993eb9c48d4 go version go1.10 linux/amd64 go version go1.10 linux/amd64 find: '/root/go/src/kubevirt.io/kubevirt/_out/cmd': No such file or directory Compiling tests... compiled tests.test hack/build-docker.sh build Sending build context to Docker daemon 40.39 MB Step 1/8 : FROM fedora:28 ---> cc510acfcd70 Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> d3c656a2b485 Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virt-controller ---> Using cache ---> a776f834c795 Step 4/8 : WORKDIR /home/virt-controller ---> Using cache ---> 714b6ef15e78 Step 5/8 : USER 1001 ---> Using cache ---> cadd485aa8f4 Step 6/8 : COPY virt-controller /usr/bin/virt-controller ---> d6e5605d569e Removing intermediate container 4773f263197b Step 7/8 : ENTRYPOINT /usr/bin/virt-controller ---> Running in 07b662e03988 ---> 06bb58b11134 Removing intermediate container 07b662e03988 Step 8/8 : LABEL "kubevirt-functional-tests-k8s-1.10.4-release0" '' "virt-controller" '' ---> Running in 89e09de9cd01 ---> 3231ec73f2fb Removing intermediate container 89e09de9cd01 Successfully built 3231ec73f2fb Sending build context to Docker daemon 43.31 MB Step 1/10 : FROM kubevirt/libvirt:4.2.0 ---> 5f0bfe81a3e0 Step 2/10 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 795ad92a5172 Step 3/10 : RUN dnf -y install socat genisoimage util-linux libcgroup-tools ethtool net-tools sudo && dnf -y clean all && test $(id -u qemu) = 107 # make sure that the qemu user really is 107 ---> Using cache ---> 49e8a67155c8 Step 4/10 : COPY virt-launcher /usr/bin/virt-launcher ---> 82a62f8809d8 Removing intermediate container 1ba768975e25 Step 5/10 : COPY kubevirt-sudo /etc/sudoers.d/kubevirt ---> 5c0548863af7 Removing intermediate container 479d0f374e82 Step 6/10 : RUN setcap CAP_NET_BIND_SERVICE=+eip /usr/bin/qemu-system-x86_64 ---> Running in 9cb09d5136af  ---> f25325822b98 Removing intermediate container 9cb09d5136af Step 7/10 : RUN mkdir -p /usr/share/kubevirt/virt-launcher ---> Running in c4b07936a42d  ---> c28a6a560029 Removing intermediate container c4b07936a42d Step 8/10 : COPY entrypoint.sh libvirtd.sh sock-connector /usr/share/kubevirt/virt-launcher/ ---> 9013e59c3ecd Removing intermediate container 304cd549b404 Step 9/10 : ENTRYPOINT /usr/share/kubevirt/virt-launcher/entrypoint.sh ---> Running in 8f01fc27aa4e ---> 477b2d4d3030 Removing intermediate container 8f01fc27aa4e Step 10/10 : LABEL "kubevirt-functional-tests-k8s-1.10.4-release0" '' "virt-launcher" '' ---> Running in 52d2e467c71e ---> c4da54139fdd Removing intermediate container 52d2e467c71e Successfully built c4da54139fdd Sending build context to Docker daemon 41.74 MB Step 1/5 : FROM fedora:28 ---> cc510acfcd70 Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> d3c656a2b485 Step 3/5 : COPY virt-handler /usr/bin/virt-handler ---> 52fdd0312b58 Removing intermediate container 934eda199177 Step 4/5 : ENTRYPOINT /usr/bin/virt-handler ---> Running in 5151c279f19e ---> 1a9da879167a Removing intermediate container 5151c279f19e Step 5/5 : LABEL "kubevirt-functional-tests-k8s-1.10.4-release0" '' "virt-handler" '' ---> Running in 7dbeac4b1f92 ---> 0a0bfb3eb039 Removing intermediate container 7dbeac4b1f92 Successfully built 0a0bfb3eb039 Sending build context to Docker daemon 38.81 MB Step 1/8 : FROM fedora:28 ---> cc510acfcd70 Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> d3c656a2b485 Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virt-api ---> Using cache ---> 9bbbc9ec8ccc Step 4/8 : WORKDIR /home/virt-api ---> Using cache ---> 6ff95ae380a5 Step 5/8 : USER 1001 ---> Using cache ---> 0026fc44bed8 Step 6/8 : COPY virt-api /usr/bin/virt-api ---> bff38b76aed7 Removing intermediate container 90e516236196 Step 7/8 : ENTRYPOINT /usr/bin/virt-api ---> Running in 45f3c8e6d62d ---> 01180add24c8 Removing intermediate container 45f3c8e6d62d Step 8/8 : LABEL "kubevirt-functional-tests-k8s-1.10.4-release0" '' "virt-api" '' ---> Running in 6eea3b46fa4b ---> 816164d200eb Removing intermediate container 6eea3b46fa4b Successfully built 816164d200eb Sending build context to Docker daemon 4.096 kB Step 1/7 : FROM fedora:28 ---> cc510acfcd70 Step 2/7 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> d3c656a2b485 Step 3/7 : ENV container docker ---> Using cache ---> d7ee9dd5410a Step 4/7 : RUN mkdir -p /images/custom /images/alpine && truncate -s 64M /images/custom/disk.img && curl http://dl-cdn.alpinelinux.org/alpine/v3.7/releases/x86_64/alpine-virt-3.7.0-x86_64.iso > /images/alpine/disk.img ---> Using cache ---> 0b64ac188f84 Step 5/7 : ADD entrypoint.sh / ---> Using cache ---> c9569040fd52 Step 6/7 : CMD /entrypoint.sh ---> Using cache ---> b0887fd36d1c Step 7/7 : LABEL "disks-images-provider" '' "kubevirt-functional-tests-k8s-1.10.4-release0" '' ---> Using cache ---> 5e827c2df99f Successfully built 5e827c2df99f Sending build context to Docker daemon 2.56 kB Step 1/5 : FROM fedora:28 ---> cc510acfcd70 Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> d3c656a2b485 Step 3/5 : ENV container docker ---> Using cache ---> d7ee9dd5410a Step 4/5 : RUN dnf -y install procps-ng nmap-ncat && dnf -y clean all ---> Using cache ---> e96d3e3c109a Step 5/5 : LABEL "kubevirt-functional-tests-k8s-1.10.4-release0" '' "vm-killer" '' ---> Using cache ---> b82659934a82 Successfully built b82659934a82 Sending build context to Docker daemon 5.12 kB Step 1/7 : FROM debian:sid ---> 68f33cf86aab Step 2/7 : MAINTAINER "David Vossel" \ ---> Using cache ---> b7f20b0c4c41 Step 3/7 : ENV container docker ---> Using cache ---> 83fc28f38982 Step 4/7 : RUN apt-get update && apt-get install -y bash curl bzip2 qemu-utils && mkdir -p /disk && rm -rf /var/lib/apt/lists/* ---> Using cache ---> 604b0b292d97 Step 5/7 : ADD entry-point.sh / ---> Using cache ---> 78792d6f56cd Step 6/7 : CMD /entry-point.sh ---> Using cache ---> 7f24cc15e083 Step 7/7 : LABEL "kubevirt-functional-tests-k8s-1.10.4-release0" '' "registry-disk-v1alpha" '' ---> Using cache ---> 9f185ea05af0 Successfully built 9f185ea05af0 Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33205/kubevirt/registry-disk-v1alpha:devel ---> 9f185ea05af0 Step 2/4 : MAINTAINER "David Vossel" \ ---> Using cache ---> 144098c857f6 Step 3/4 : RUN curl https://download.cirros-cloud.net/0.4.0/cirros-0.4.0-x86_64-disk.img > /disk/cirros.img ---> Using cache ---> 470c8c941f3b Step 4/4 : LABEL "cirros-registry-disk-demo" '' "kubevirt-functional-tests-k8s-1.10.4-release0" '' ---> Using cache ---> 5c3573aee555 Successfully built 5c3573aee555 Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33205/kubevirt/registry-disk-v1alpha:devel ---> 9f185ea05af0 Step 2/4 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 163d18ada1f5 Step 3/4 : RUN curl -g -L https://download.fedoraproject.org/pub/fedora/linux/releases/27/CloudImages/x86_64/images/Fedora-Cloud-Base-27-1.6.x86_64.qcow2 > /disk/fedora.qcow2 ---> Using cache ---> df03150f97f7 Step 4/4 : LABEL "fedora-cloud-registry-disk-demo" '' "kubevirt-functional-tests-k8s-1.10.4-release0" '' ---> Using cache ---> d2698a39e323 Successfully built d2698a39e323 Sending build context to Docker daemon 2.56 kB Step 1/4 : FROM localhost:33205/kubevirt/registry-disk-v1alpha:devel ---> 9f185ea05af0 Step 2/4 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 163d18ada1f5 Step 3/4 : RUN curl http://dl-cdn.alpinelinux.org/alpine/v3.7/releases/x86_64/alpine-virt-3.7.0-x86_64.iso > /disk/alpine.iso ---> Using cache ---> d98139a655a4 Step 4/4 : LABEL "alpine-registry-disk-demo" '' "kubevirt-functional-tests-k8s-1.10.4-release0" '' ---> Using cache ---> 9e041444a39a Successfully built 9e041444a39a Sending build context to Docker daemon 35.59 MB Step 1/8 : FROM fedora:28 ---> cc510acfcd70 Step 2/8 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> d3c656a2b485 Step 3/8 : RUN useradd -u 1001 --create-home -s /bin/bash virtctl ---> Using cache ---> 5704030d2070 Step 4/8 : WORKDIR /home/virtctl ---> Using cache ---> 624a72b3ef33 Step 5/8 : USER 1001 ---> Using cache ---> 74157fb56326 Step 6/8 : COPY subresource-access-test /subresource-access-test ---> d27cc9347e16 Removing intermediate container f6722d7a25fd Step 7/8 : ENTRYPOINT /subresource-access-test ---> Running in 2d5908535341 ---> e9f0c822b7e2 Removing intermediate container 2d5908535341 Step 8/8 : LABEL "kubevirt-functional-tests-k8s-1.10.4-release0" '' "subresource-access-test" '' ---> Running in d2cfbfcf918e ---> e18d8106abf7 Removing intermediate container d2cfbfcf918e Successfully built e18d8106abf7 Sending build context to Docker daemon 3.072 kB Step 1/9 : FROM fedora:28 ---> cc510acfcd70 Step 2/9 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> d3c656a2b485 Step 3/9 : ENV container docker ---> Using cache ---> d7ee9dd5410a Step 4/9 : RUN dnf -y install make git gcc && dnf -y clean all ---> Using cache ---> e4ae555b2a96 Step 5/9 : ENV GIMME_GO_VERSION 1.9.2 ---> Using cache ---> 4805ef8280c3 Step 6/9 : RUN mkdir -p /gimme && curl -sL https://raw.githubusercontent.com/travis-ci/gimme/master/gimme | HOME=/gimme bash >> /etc/profile.d/gimme.sh ---> Using cache ---> 7c1f17e56984 Step 7/9 : ENV GOPATH "/go" GOBIN "/usr/bin" ---> Using cache ---> c388427c6a76 Step 8/9 : RUN mkdir -p /go && source /etc/profile.d/gimme.sh && go get github.com/masterzen/winrm-cli ---> Using cache ---> 5da240e34c8d Step 9/9 : LABEL "kubevirt-functional-tests-k8s-1.10.4-release0" '' "winrmcli" '' ---> Using cache ---> fc4af18e41a0 Successfully built fc4af18e41a0 Sending build context to Docker daemon 36.8 MB Step 1/5 : FROM fedora:27 ---> 9110ae7f579f Step 2/5 : MAINTAINER "The KubeVirt Project" ---> Using cache ---> 58c7014d7bc4 Step 3/5 : COPY example-hook-sidecar /example-hook-sidecar ---> 6e5ecc6579f6 Removing intermediate container 798e340fe65d Step 4/5 : ENTRYPOINT /example-hook-sidecar ---> Running in 0d27a28abf7c ---> 1aa3d67b0c3c Removing intermediate container 0d27a28abf7c Step 5/5 : LABEL "example-hook-sidecar" '' "kubevirt-functional-tests-k8s-1.10.4-release0" '' ---> Running in c9c056655385 ---> 536967e2a44c Removing intermediate container c9c056655385 Successfully built 536967e2a44c hack/build-docker.sh push The push refers to a repository [localhost:33205/kubevirt/virt-controller] dbd034ab6fa9: Preparing efce1557ba86: Preparing 891e1e4ef82a: Preparing efce1557ba86: Pushed dbd034ab6fa9: Pushed 891e1e4ef82a: Pushed devel: digest: sha256:5471cdba09c894f25311d8ed19186d649330b29bf9864884ca5156123d9d84c4 size: 949 The push refers to a repository [localhost:33205/kubevirt/virt-launcher] 0551ef9a48a0: Preparing 04359919c014: Preparing 11546f1f69f6: Preparing 414378b3109e: Preparing 7040268af3fe: Preparing 779823b58976: Preparing da38cf808aa5: Preparing b83399358a92: Preparing 186d8b3e4fd8: Preparing fa6154170bf5: Preparing 5eefb9960a36: Preparing 891e1e4ef82a: Preparing 779823b58976: Waiting da38cf808aa5: Waiting b83399358a92: Waiting 186d8b3e4fd8: Waiting 5eefb9960a36: Waiting fa6154170bf5: Waiting 891e1e4ef82a: Waiting 414378b3109e: Pushed 04359919c014: Pushed 0551ef9a48a0: Pushed 11546f1f69f6: Pushed b83399358a92: Pushed da38cf808aa5: Pushed 186d8b3e4fd8: Pushed 891e1e4ef82a: Mounted from kubevirt/virt-controller fa6154170bf5: Pushed 7040268af3fe: Pushed 779823b58976: Pushed 5eefb9960a36: Pushed devel: digest: sha256:c0df71552f23fecf4177ccb63eb3d7e1a2b5d10f729bcf25f550ee948802943c size: 2828 The push refers to a repository [localhost:33205/kubevirt/virt-handler] 16ef3be2d3c8: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/virt-launcher 16ef3be2d3c8: Pushed devel: digest: sha256:dfc76fd5544179124986115a317f98665cc56e25055a16231a2827cf40daae6a size: 741 The push refers to a repository [localhost:33205/kubevirt/virt-api] c14ee7460a0d: Preparing 1cd776a5872d: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/virt-handler 1cd776a5872d: Pushed c14ee7460a0d: Pushed devel: digest: sha256:0fcedf81ecabbfca99cb48218805a442fda33fd26f957c7be69f8a2a48ef9d25 size: 948 The push refers to a repository [localhost:33205/kubevirt/disks-images-provider] 031ac8f2509a: Preparing df0d85013ae0: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/virt-api 031ac8f2509a: Pushed df0d85013ae0: Pushed devel: digest: sha256:0a781ba0f345d564653bd766261d224da653d3eb7df0f5abeb67f1fcb1226455 size: 948 The push refers to a repository [localhost:33205/kubevirt/vm-killer] c6d1250c13a6: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/disks-images-provider c6d1250c13a6: Pushed devel: digest: sha256:5680325ca88ab683e8ee0ce34f458871a0ea66b9031da653a8255dfdea55ffa2 size: 740 The push refers to a repository [localhost:33205/kubevirt/registry-disk-v1alpha] 3e288742e937: Preparing 7c38bbdf0880: Preparing 25edbec0eaea: Preparing 3e288742e937: Pushed 7c38bbdf0880: Pushed 25edbec0eaea: Pushed devel: digest: sha256:2c4bce549c7130c9b25183e6b8ff2d59d86b0e679a57b41b0efa5bebf9dee583 size: 948 The push refers to a repository [localhost:33205/kubevirt/cirros-registry-disk-demo] a899196b92d1: Preparing 3e288742e937: Preparing 7c38bbdf0880: Preparing 25edbec0eaea: Preparing 7c38bbdf0880: Mounted from kubevirt/registry-disk-v1alpha 3e288742e937: Mounted from kubevirt/registry-disk-v1alpha 25edbec0eaea: Mounted from kubevirt/registry-disk-v1alpha a899196b92d1: Pushed devel: digest: sha256:5454dcadb097cd68f295984545c12abb43aeeacde79b1e0e8a64a55119f1bf11 size: 1160 The push refers to a repository [localhost:33205/kubevirt/fedora-cloud-registry-disk-demo] aac41f162526: Preparing 3e288742e937: Preparing 7c38bbdf0880: Preparing 25edbec0eaea: Preparing 25edbec0eaea: Mounted from kubevirt/cirros-registry-disk-demo 3e288742e937: Mounted from kubevirt/cirros-registry-disk-demo 7c38bbdf0880: Mounted from kubevirt/cirros-registry-disk-demo aac41f162526: Pushed devel: digest: sha256:b0168476647c9b25e598d6123cd4b3e0b4797127716e28b6f0acd0304d343c3f size: 1161 The push refers to a repository [localhost:33205/kubevirt/alpine-registry-disk-demo] 92fe70a24761: Preparing 3e288742e937: Preparing 7c38bbdf0880: Preparing 25edbec0eaea: Preparing 7c38bbdf0880: Mounted from kubevirt/fedora-cloud-registry-disk-demo 3e288742e937: Mounted from kubevirt/fedora-cloud-registry-disk-demo 25edbec0eaea: Mounted from kubevirt/fedora-cloud-registry-disk-demo 92fe70a24761: Pushed devel: digest: sha256:14e0b91736ca44747541e9799c0909b4ad13e9eed7036941119c6f8cf63ee57e size: 1160 The push refers to a repository [localhost:33205/kubevirt/subresource-access-test] fda62ade919a: Preparing c3b63a8b92e2: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/vm-killer c3b63a8b92e2: Pushed fda62ade919a: Pushed devel: digest: sha256:6a66f09d51251883f00ab1f0ed07ea8fae0a66e12fd7908b3a3e7a19d50f46b3 size: 948 The push refers to a repository [localhost:33205/kubevirt/winrmcli] 03859482cdc2: Preparing a0f8b95b0bdd: Preparing 2aa87109f2ed: Preparing 891e1e4ef82a: Preparing 891e1e4ef82a: Mounted from kubevirt/subresource-access-test 03859482cdc2: Pushed 2aa87109f2ed: Pushed a0f8b95b0bdd: Pushed devel: digest: sha256:d75c7d87431edda3eeae4a8a02a774789bb14105c171bc6ed0141bb778390775 size: 1165 The push refers to a repository [localhost:33205/kubevirt/example-hook-sidecar] 4c1a48ff30ff: Preparing 39bae602f753: Preparing 4c1a48ff30ff: Pushed 39bae602f753: Pushed devel: digest: sha256:b05f6bb6e8bb5615d8973815f4bc380db7282c60f1d698237e79b97fbf8f768c size: 740 make[1]: Leaving directory `/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt' Done ./cluster/clean.sh + source hack/common.sh ++++ dirname 'hack/common.sh[0]' +++ cd hack/../ +++ pwd ++ KUBEVIRT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt ++ OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out ++ VENDOR_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/vendor ++ CMD_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/cmd ++ TESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/tests ++ APIDOCS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/apidocs ++ MANIFESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/manifests ++ MANIFEST_TEMPLATES_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/templates/manifests ++ PYTHON_CLIENT_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/client-python ++ KUBEVIRT_PROVIDER=k8s-1.10.4 ++ KUBEVIRT_NUM_NODES=2 ++ '[' -z kubevirt-functional-tests-k8s-1.10.4-release ']' ++ provider_prefix=kubevirt-functional-tests-k8s-1.10.4-release0 ++ job_prefix=kubevirt-functional-tests-k8s-1.10.4-release0 +++ kubevirt_version +++ '[' -n '' ']' +++ '[' -d /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/.git ']' ++++ git describe --always --tags +++ echo v0.7.0-180-g2b4f231 ++ KUBEVIRT_VERSION=v0.7.0-180-g2b4f231 + source cluster/k8s-1.10.4/provider.sh ++ set -e ++ image=k8s-1.10.4@sha256:09ac918cc16f13a5d0af51d4c98e3e25cbf4f97b7b32fe18ec61b32f04ca1009 ++ source cluster/ephemeral-provider-common.sh +++ set -e +++ _cli='docker run --privileged --net=host --rm -v /var/run/docker.sock:/var/run/docker.sock kubevirtci/gocli@sha256:aa7f295a7908fa333ab5e98ef3af0bfafbabfd3cee2b83f9af47f722e3000f6a' + source hack/config.sh ++ unset binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig manifest_docker_prefix namespace ++ KUBEVIRT_PROVIDER=k8s-1.10.4 ++ source hack/config-default.sh source hack/config-k8s-1.10.4.sh +++ binaries='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virtctl cmd/fake-qemu-process cmd/virt-api cmd/subresource-access-test cmd/example-hook-sidecar' +++ docker_images='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virt-api images/disks-images-provider images/vm-killer cmd/registry-disk-v1alpha images/cirros-registry-disk-demo images/fedora-cloud-registry-disk-demo images/alpine-registry-disk-demo cmd/subresource-access-test images/winrmcli cmd/example-hook-sidecar' +++ docker_prefix=kubevirt +++ docker_tag=latest +++ master_ip=192.168.200.2 +++ network_provider=flannel +++ namespace=kube-system ++ test -f hack/config-provider-k8s-1.10.4.sh ++ source hack/config-provider-k8s-1.10.4.sh +++ master_ip=127.0.0.1 +++ docker_tag=devel +++ kubeconfig=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/cluster/k8s-1.10.4/.kubeconfig +++ kubectl=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/cluster/k8s-1.10.4/.kubectl +++ docker_prefix=localhost:33205/kubevirt +++ manifest_docker_prefix=registry:5000/kubevirt ++ test -f hack/config-local.sh ++ export binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig namespace + echo 'Cleaning up ...' Cleaning up ... + cluster/kubectl.sh get vmis --all-namespaces -o=custom-columns=NAME:.metadata.name,NAMESPACE:.metadata.namespace,FINALIZERS:.metadata.finalizers --no-headers + grep foregroundDeleteVirtualMachine + read p error: the server doesn't have a resource type "vmis" + _kubectl delete ds -l kubevirt.io -n kube-system --cascade=false --grace-period 0 No resources found + _kubectl delete pods -n kube-system -l=kubevirt.io=libvirt --force --grace-period 0 No resources found + _kubectl delete pods -n kube-system -l=kubevirt.io=virt-handler --force --grace-period 0 No resources found + namespaces=(default ${namespace}) + for i in '${namespaces[@]}' + _kubectl -n default delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete apiservices -l kubevirt.io No resources found + _kubectl -n default delete deployment -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete deployment -l kubevirt.io No resources found + _kubectl -n default delete rs -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete rs -l kubevirt.io No resources found + _kubectl -n default delete services -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete services -l kubevirt.io No resources found + _kubectl -n default delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete apiservices -l kubevirt.io No resources found + _kubectl -n default delete validatingwebhookconfiguration -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete validatingwebhookconfiguration -l kubevirt.io No resources found + _kubectl -n default delete secrets -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete secrets -l kubevirt.io No resources found + _kubectl -n default delete pv -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete pv -l kubevirt.io No resources found + _kubectl -n default delete pvc -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete pvc -l kubevirt.io No resources found + _kubectl -n default delete ds -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete ds -l kubevirt.io No resources found + _kubectl -n default delete customresourcedefinitions -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete customresourcedefinitions -l kubevirt.io No resources found + _kubectl -n default delete pods -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete pods -l kubevirt.io No resources found + _kubectl -n default delete clusterrolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete clusterrolebinding -l kubevirt.io No resources found + _kubectl -n default delete rolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete rolebinding -l kubevirt.io No resources found + _kubectl -n default delete roles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete roles -l kubevirt.io No resources found + _kubectl -n default delete clusterroles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete clusterroles -l kubevirt.io No resources found + _kubectl -n default delete serviceaccounts -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n default delete serviceaccounts -l kubevirt.io No resources found ++ _kubectl -n default get crd offlinevirtualmachines.kubevirt.io ++ export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig ++ KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig ++ wc -l ++ cluster/k8s-1.10.4/.kubectl -n default get crd offlinevirtualmachines.kubevirt.io Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "offlinevirtualmachines.kubevirt.io" not found + '[' 0 -gt 0 ']' + for i in '${namespaces[@]}' + _kubectl -n kube-system delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete apiservices -l kubevirt.io No resources found + _kubectl -n kube-system delete deployment -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete deployment -l kubevirt.io No resources found + _kubectl -n kube-system delete rs -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete rs -l kubevirt.io No resources found + _kubectl -n kube-system delete services -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete services -l kubevirt.io No resources found + _kubectl -n kube-system delete apiservices -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete apiservices -l kubevirt.io No resources found + _kubectl -n kube-system delete validatingwebhookconfiguration -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete validatingwebhookconfiguration -l kubevirt.io No resources found + _kubectl -n kube-system delete secrets -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete secrets -l kubevirt.io No resources found + _kubectl -n kube-system delete pv -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete pv -l kubevirt.io No resources found + _kubectl -n kube-system delete pvc -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete pvc -l kubevirt.io No resources found + _kubectl -n kube-system delete ds -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete ds -l kubevirt.io No resources found + _kubectl -n kube-system delete customresourcedefinitions -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete customresourcedefinitions -l kubevirt.io No resources found + _kubectl -n kube-system delete pods -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete pods -l kubevirt.io No resources found + _kubectl -n kube-system delete clusterrolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete clusterrolebinding -l kubevirt.io No resources found + _kubectl -n kube-system delete rolebinding -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete rolebinding -l kubevirt.io No resources found + _kubectl -n kube-system delete roles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete roles -l kubevirt.io No resources found + _kubectl -n kube-system delete clusterroles -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete clusterroles -l kubevirt.io No resources found + _kubectl -n kube-system delete serviceaccounts -l kubevirt.io + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl -n kube-system delete serviceaccounts -l kubevirt.io No resources found ++ _kubectl -n kube-system get crd offlinevirtualmachines.kubevirt.io ++ wc -l ++ export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig ++ KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig ++ cluster/k8s-1.10.4/.kubectl -n kube-system get crd offlinevirtualmachines.kubevirt.io Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "offlinevirtualmachines.kubevirt.io" not found + '[' 0 -gt 0 ']' + sleep 2 + echo Done Done ./cluster/deploy.sh + source hack/common.sh ++++ dirname 'hack/common.sh[0]' +++ cd hack/../ +++ pwd ++ KUBEVIRT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt ++ OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out ++ VENDOR_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/vendor ++ CMD_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/cmd ++ TESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/tests ++ APIDOCS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/apidocs ++ MANIFESTS_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/manifests ++ MANIFEST_TEMPLATES_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/templates/manifests ++ PYTHON_CLIENT_OUT_DIR=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/client-python ++ KUBEVIRT_PROVIDER=k8s-1.10.4 ++ KUBEVIRT_NUM_NODES=2 ++ '[' -z kubevirt-functional-tests-k8s-1.10.4-release ']' ++ provider_prefix=kubevirt-functional-tests-k8s-1.10.4-release0 ++ job_prefix=kubevirt-functional-tests-k8s-1.10.4-release0 +++ kubevirt_version +++ '[' -n '' ']' +++ '[' -d /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/.git ']' ++++ git describe --always --tags +++ echo v0.7.0-180-g2b4f231 ++ KUBEVIRT_VERSION=v0.7.0-180-g2b4f231 + source cluster/k8s-1.10.4/provider.sh ++ set -e ++ image=k8s-1.10.4@sha256:09ac918cc16f13a5d0af51d4c98e3e25cbf4f97b7b32fe18ec61b32f04ca1009 ++ source cluster/ephemeral-provider-common.sh +++ set -e +++ _cli='docker run --privileged --net=host --rm -v /var/run/docker.sock:/var/run/docker.sock kubevirtci/gocli@sha256:aa7f295a7908fa333ab5e98ef3af0bfafbabfd3cee2b83f9af47f722e3000f6a' + source hack/config.sh ++ unset binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig manifest_docker_prefix namespace ++ KUBEVIRT_PROVIDER=k8s-1.10.4 ++ source hack/config-default.sh source hack/config-k8s-1.10.4.sh +++ binaries='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virtctl cmd/fake-qemu-process cmd/virt-api cmd/subresource-access-test cmd/example-hook-sidecar' +++ docker_images='cmd/virt-controller cmd/virt-launcher cmd/virt-handler cmd/virt-api images/disks-images-provider images/vm-killer cmd/registry-disk-v1alpha images/cirros-registry-disk-demo images/fedora-cloud-registry-disk-demo images/alpine-registry-disk-demo cmd/subresource-access-test images/winrmcli cmd/example-hook-sidecar' +++ docker_prefix=kubevirt +++ docker_tag=latest +++ master_ip=192.168.200.2 +++ network_provider=flannel +++ namespace=kube-system ++ test -f hack/config-provider-k8s-1.10.4.sh ++ source hack/config-provider-k8s-1.10.4.sh +++ master_ip=127.0.0.1 +++ docker_tag=devel +++ kubeconfig=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/cluster/k8s-1.10.4/.kubeconfig +++ kubectl=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/cluster/k8s-1.10.4/.kubectl +++ docker_prefix=localhost:33205/kubevirt +++ manifest_docker_prefix=registry:5000/kubevirt ++ test -f hack/config-local.sh ++ export binaries docker_images docker_prefix docker_tag manifest_templates master_ip network_provider kubeconfig namespace + echo 'Deploying ...' Deploying ... + [[ -z k8s-1.10.4-release ]] + [[ k8s-1.10.4-release =~ .*-dev ]] + [[ k8s-1.10.4-release =~ .*-release ]] + for manifest in '${MANIFESTS_OUT_DIR}/release/*' + [[ /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/manifests/release/demo-content.yaml =~ .*demo.* ]] + continue + for manifest in '${MANIFESTS_OUT_DIR}/release/*' + [[ /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/manifests/release/kubevirt.yaml =~ .*demo.* ]] + _kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/manifests/release/kubevirt.yaml + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/manifests/release/kubevirt.yaml clusterrole.rbac.authorization.k8s.io "kubevirt.io:admin" created clusterrole.rbac.authorization.k8s.io "kubevirt.io:edit" created clusterrole.rbac.authorization.k8s.io "kubevirt.io:view" created serviceaccount "kubevirt-apiserver" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-apiserver" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-apiserver-auth-delegator" created rolebinding.rbac.authorization.k8s.io "kubevirt-apiserver" created role.rbac.authorization.k8s.io "kubevirt-apiserver" created clusterrole.rbac.authorization.k8s.io "kubevirt-apiserver" created clusterrole.rbac.authorization.k8s.io "kubevirt-controller" created serviceaccount "kubevirt-controller" created serviceaccount "kubevirt-privileged" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-controller" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-controller-cluster-admin" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-privileged-cluster-admin" created clusterrole.rbac.authorization.k8s.io "kubevirt.io:default" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt.io:default" created service "virt-api" created deployment.extensions "virt-api" created deployment.extensions "virt-controller" created daemonset.extensions "virt-handler" created customresourcedefinition.apiextensions.k8s.io "virtualmachineinstances.kubevirt.io" created customresourcedefinition.apiextensions.k8s.io "virtualmachineinstancereplicasets.kubevirt.io" created customresourcedefinition.apiextensions.k8s.io "virtualmachineinstancepresets.kubevirt.io" created customresourcedefinition.apiextensions.k8s.io "virtualmachines.kubevirt.io" created + _kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/manifests/testing -R + export KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + KUBECONFIG=cluster/k8s-1.10.4/.kubeconfig + cluster/k8s-1.10.4/.kubectl create -f /var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/go/src/kubevirt.io/kubevirt/_out/manifests/testing -R persistentvolumeclaim "disk-alpine" created persistentvolume "host-path-disk-alpine" created persistentvolumeclaim "disk-custom" created persistentvolume "host-path-disk-custom" created daemonset.extensions "disks-images-provider" created serviceaccount "kubevirt-testing" created clusterrolebinding.rbac.authorization.k8s.io "kubevirt-testing-cluster-admin" created + [[ k8s-1.10.4 =~ os-* ]] + echo Done Done + namespaces=(kube-system default) + [[ kube-system != \k\u\b\e\-\s\y\s\t\e\m ]] + timeout=300 + sample=30 + for i in '${namespaces[@]}' + current_time=0 ++ kubectl get pods -n kube-system --no-headers ++ cluster/kubectl.sh get pods -n kube-system --no-headers ++ grep -v Running + '[' -n 'virt-api-7d79764579-kk8rs 0/1 ContainerCreating 0 2s virt-api-7d79764579-qbwqf 0/1 ContainerCreating 0 2s virt-controller-7d57d96b65-l9p5w 0/1 ContainerCreating 0 2s virt-controller-7d57d96b65-t48v6 0/1 ContainerCreating 0 1s virt-handler-8hwbb 0/1 ContainerCreating 0 2s virt-handler-pgqmx 0/1 ContainerCreating 0 2s' ']' + echo 'Waiting for kubevirt pods to enter the Running state ...' Waiting for kubevirt pods to enter the Running state ... + kubectl get pods -n kube-system --no-headers + grep -v Running + cluster/kubectl.sh get pods -n kube-system --no-headers virt-api-7d79764579-kk8rs 0/1 ContainerCreating 0 3s virt-api-7d79764579-qbwqf 0/1 ContainerCreating 0 3s virt-controller-7d57d96b65-l9p5w 0/1 ContainerCreating 0 3s virt-controller-7d57d96b65-t48v6 0/1 ContainerCreating 0 2s virt-handler-8hwbb 0/1 ContainerCreating 0 3s virt-handler-pgqmx 0/1 ContainerCreating 0 3s + sleep 30 + current_time=30 + '[' 30 -gt 300 ']' ++ kubectl get pods -n kube-system --no-headers ++ grep -v Running ++ cluster/kubectl.sh get pods -n kube-system --no-headers + '[' -n '' ']' + current_time=0 ++ kubectl get pods -n kube-system '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers ++ cluster/kubectl.sh get pods -n kube-system '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers ++ grep false + '[' -n '' ']' + kubectl get pods -n kube-system + cluster/kubectl.sh get pods -n kube-system NAME READY STATUS RESTARTS AGE disks-images-provider-44cpl 1/1 Running 0 31s disks-images-provider-l2td6 1/1 Running 0 31s etcd-node01 1/1 Running 0 7m kube-apiserver-node01 1/1 Running 0 7m kube-controller-manager-node01 1/1 Running 0 7m kube-dns-86f4d74b45-rdwlg 3/3 Running 0 8m kube-flannel-ds-gwnsj 1/1 Running 1 8m kube-flannel-ds-rdz46 1/1 Running 0 8m kube-proxy-jfggl 1/1 Running 0 8m kube-proxy-xfz6x 1/1 Running 0 8m kube-scheduler-node01 1/1 Running 0 7m virt-api-7d79764579-kk8rs 1/1 Running 0 34s virt-api-7d79764579-qbwqf 1/1 Running 0 34s virt-controller-7d57d96b65-l9p5w 1/1 Running 0 34s virt-controller-7d57d96b65-t48v6 1/1 Running 0 33s virt-handler-8hwbb 1/1 Running 0 34s virt-handler-pgqmx 1/1 Running 0 34s + for i in '${namespaces[@]}' + current_time=0 ++ kubectl get pods -n default --no-headers ++ grep -v Running ++ cluster/kubectl.sh get pods -n default --no-headers No resources found. + '[' -n '' ']' + current_time=0 ++ kubectl get pods -n default '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers ++ grep false ++ cluster/kubectl.sh get pods -n default '-ocustom-columns=status:status.containerStatuses[*].ready' --no-headers + '[' -n '' ']' + kubectl get pods -n default + cluster/kubectl.sh get pods -n default No resources found. + kubectl version + cluster/kubectl.sh version Client Version: version.Info{Major:"1", Minor:"10", GitVersion:"v1.10.4", GitCommit:"5ca598b4ba5abb89bb773071ce452e33fb66339d", GitTreeState:"clean", BuildDate:"2018-06-06T08:13:03Z", GoVersion:"go1.9.3", Compiler:"gc", Platform:"linux/amd64"} Server Version: version.Info{Major:"1", Minor:"10", GitVersion:"v1.10.4", GitCommit:"5ca598b4ba5abb89bb773071ce452e33fb66339d", GitTreeState:"clean", BuildDate:"2018-06-06T08:00:59Z", GoVersion:"go1.9.3", Compiler:"gc", Platform:"linux/amd64"} + ginko_params='--ginkgo.noColor --junit-output=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/junit.xml' + [[ k8s-1.10.4-release =~ windows.* ]] + FUNC_TEST_ARGS='--ginkgo.noColor --junit-output=/var/lib/swarm/workspace/kubevirt-functional-tests-k8s-1.10.4-release/junit.xml' + make functest hack/dockerized "hack/build-func-tests.sh" sha256:559a45ac63f40982ccce3a1b80cb62788566f2032c847ad9c45ee993eb9c48d4 go version go1.10 linux/amd64 go version go1.10 linux/amd64 Compiling tests... compiled tests.test hack/functests.sh Running Suite: Tests Suite ========================== Random Seed: 1533205669 Will run 151 of 151 specs • [SLOW TEST:6.824 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given a vmi /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:15.320 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given an vm /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:6.573 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given a vmi preset /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:6.905 seconds] User Access /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:33 With default kubevirt service accounts /root/go/src/kubevirt.io/kubevirt/tests/access_test.go:41 should verify permissions are correct for view, edit, and admin /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 given a vmi replica set /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.005 seconds] Windows VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:57 should succeed to start a vmi [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:133 Skip Windows tests that requires PVC disk-windows /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1384 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.009 seconds] Windows VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:57 should succeed to stop a running vmi [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:139 Skip Windows tests that requires PVC disk-windows /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1384 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.004 seconds] Windows VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:57 with winrm connection [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:150 should have correct UUID /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:192 Skip Windows tests that requires PVC disk-windows /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1384 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.003 seconds] Windows VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:57 with winrm connection [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:150 should have pod IP /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:208 Skip Windows tests that requires PVC disk-windows /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1384 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.006 seconds] Windows VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:57 with kubectl command [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:226 should succeed to start a vmi /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:242 Skip Windows tests that requires PVC disk-windows /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1384 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.003 seconds] Windows VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:57 with kubectl command [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:226 should succeed to stop a vmi /root/go/src/kubevirt.io/kubevirt/tests/windows_test.go:250 Skip Windows tests that requires PVC disk-windows /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1384 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 should succeed to generate a VM JSON file using oc-process command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:150 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1422 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 with given VM JSON from the Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:152 should succeed to create a VM using oc-create command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:156 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1422 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 with given VM JSON from the Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:152 with given VM from the VM JSON /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:158 should succeed to launch a VMI using oc-patch command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:161 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1422 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds] Templates /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:42 Launching VMI from VM Template [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:60 with given Fedora Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:193 with given VM JSON from the Template /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:152 with given VM from the VM JSON /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:158 with given VMI from the VM /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:163 should succeed to terminate the VMI using oc-patch command /root/go/src/kubevirt.io/kubevirt/tests/template_test.go:166 Skip test that requires oc binary /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1422 ------------------------------ • [SLOW TEST:5.650 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 should success /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:75 ------------------------------ Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running level=info timestamp=2018-08-02T10:27:25.942207Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:27:25.961896Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:27:28.712808Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:27:34 http: TLS handshake error from 10.244.1.1:45222: EOF 2018/08/02 10:27:44 http: TLS handshake error from 10.244.1.1:45248: EOF 2018/08/02 10:27:54 http: TLS handshake error from 10.244.1.1:45264: EOF level=info timestamp=2018-08-02T10:27:57.894674Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:28:04 http: TLS handshake error from 10.244.1.1:45296: EOF 2018/08/02 10:28:14 http: TLS handshake error from 10.244.1.1:45302: EOF 2018/08/02 10:28:24 http: TLS handshake error from 10.244.1.1:45308: EOF level=info timestamp=2018-08-02T10:28:27.852161Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:28:34 http: TLS handshake error from 10.244.1.1:45314: EOF 2018/08/02 10:28:44 http: TLS handshake error from 10.244.1.1:45332: EOF 2018/08/02 10:28:54 http: TLS handshake error from 10.244.1.1:45338: EOF level=info timestamp=2018-08-02T10:28:58.041969Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T10:28:24.821721Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:28:24.967968Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:28:24.977900Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:28:24.986761Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:28:25.141360Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:28:25.150259Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:28:25.163448Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:28:27 http: TLS handshake error from 10.244.0.1:41330: EOF level=info timestamp=2018-08-02T10:28:32.816926Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:28:32.817563Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:28:37 http: TLS handshake error from 10.244.0.1:41366: EOF 2018/08/02 10:28:47 http: TLS handshake error from 10.244.0.1:41390: EOF level=info timestamp=2018-08-02T10:28:49.411922Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:28:50.536020Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:28:57 http: TLS handshake error from 10.244.0.1:41414: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:27:09.067024Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmInformer" level=info timestamp=2018-08-02T10:27:09.067045Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer limitrangeInformer" level=info timestamp=2018-08-02T10:27:09.067114Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-08-02T10:27:09.069011Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-08-02T10:27:09.069060Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-08-02T10:27:09.069100Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-08-02T10:27:09.069172Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-08-02T10:28:38.616736Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:28:38.621073Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz2xjv kind= uid=c9dfa996-963e-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:28:39.214336Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz2xjv kind= uid=c9dfa996-963e-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:28:39.220902Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=error timestamp=2018-08-02T10:28:39.226397Z pos=preset.go:175 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz2xjv kind= uid=c9dfa996-963e-11e8-9cfb-525500d15501 msg="Could not update VirtualMachineInstance: Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz2xjv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiz2xjv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c9dfa996-963e-11e8-9cfb-525500d15501, UID in object meta: " level=info timestamp=2018-08-02T10:28:39.226461Z pos=preset.go:102 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz2xjv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiz2xjv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c9dfa996-963e-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiz2xjv" level=info timestamp=2018-08-02T10:28:41.754167Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwvw4h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" level=info timestamp=2018-08-02T10:28:41.766907Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwvw4h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:28:59.808883Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:28:59.809398Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:28:59.809461Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" level=info timestamp=2018-08-02T10:28:59.849699Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmiwvw4h, existing: true\n" level=info timestamp=2018-08-02T10:28:59.849744Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:28:59.849766Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:28:59.849830Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:28:59.850505Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:28:59.850608Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" level=info timestamp=2018-08-02T10:28:59.930867Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmiwvw4h, existing: true\n" level=info timestamp=2018-08-02T10:28:59.930972Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:28:59.930997Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:28:59.931122Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:28:59.932119Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:28:59.932238Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:27:12.410286Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-02T10:27:12.423151Z pos=vm.go:212 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-02T10:27:12.424330Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-02T10:27:12.590839Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-02T10:27:12.703478Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-02T10:27:12.709948Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-launcher-testvmiwvw4h-b5wfn Pod phase: Running level=info timestamp=2018-08-02T10:28:49.103956Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:28:49.104252Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:28:49.105519Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:28:59.136159Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:28:59.295186Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiwvw4h" level=info timestamp=2018-08-02T10:28:59.296850Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:28:59.297081Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 10:29:54 http: TLS handshake error from 10.244.1.1:45374: EOF level=info timestamp=2018-08-02T10:29:57.848761Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:30:04 http: TLS handshake error from 10.244.1.1:45380: EOF 2018/08/02 10:30:14 http: TLS handshake error from 10.244.1.1:45386: EOF 2018/08/02 10:30:24 http: TLS handshake error from 10.244.1.1:45392: EOF level=info timestamp=2018-08-02T10:30:27.849063Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:30:34 http: TLS handshake error from 10.244.1.1:45398: EOF 2018/08/02 10:30:44 http: TLS handshake error from 10.244.1.1:45404: EOF 2018/08/02 10:30:54 http: TLS handshake error from 10.244.1.1:45410: EOF level=info timestamp=2018-08-02T10:30:57.827885Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:31:04 http: TLS handshake error from 10.244.1.1:45416: EOF 2018/08/02 10:31:14 http: TLS handshake error from 10.244.1.1:45422: EOF 2018/08/02 10:31:24 http: TLS handshake error from 10.244.1.1:45428: EOF level=info timestamp=2018-08-02T10:31:27.844036Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:31:34 http: TLS handshake error from 10.244.1.1:45434: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running 2018/08/02 10:30:07 http: TLS handshake error from 10.244.0.1:41586: EOF 2018/08/02 10:30:17 http: TLS handshake error from 10.244.0.1:41610: EOF level=info timestamp=2018-08-02T10:30:19.499064Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:30:21.741950Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:30:27 http: TLS handshake error from 10.244.0.1:41634: EOF 2018/08/02 10:30:37 http: TLS handshake error from 10.244.0.1:41658: EOF 2018/08/02 10:30:47 http: TLS handshake error from 10.244.0.1:41682: EOF level=info timestamp=2018-08-02T10:30:49.529427Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:30:51.771145Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:30:57 http: TLS handshake error from 10.244.0.1:41706: EOF 2018/08/02 10:31:07 http: TLS handshake error from 10.244.0.1:41730: EOF 2018/08/02 10:31:17 http: TLS handshake error from 10.244.0.1:41754: EOF level=info timestamp=2018-08-02T10:31:19.556106Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:31:21.795020Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:31:27 http: TLS handshake error from 10.244.0.1:41778: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:27:09.067024Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmInformer" level=info timestamp=2018-08-02T10:27:09.067045Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer limitrangeInformer" level=info timestamp=2018-08-02T10:27:09.067114Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-08-02T10:27:09.069011Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-08-02T10:27:09.069060Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-08-02T10:27:09.069100Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-08-02T10:27:09.069172Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-08-02T10:28:38.616736Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:28:38.621073Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz2xjv kind= uid=c9dfa996-963e-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:28:39.214336Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz2xjv kind= uid=c9dfa996-963e-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:28:39.220902Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=error timestamp=2018-08-02T10:28:39.226397Z pos=preset.go:175 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz2xjv kind= uid=c9dfa996-963e-11e8-9cfb-525500d15501 msg="Could not update VirtualMachineInstance: Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz2xjv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiz2xjv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c9dfa996-963e-11e8-9cfb-525500d15501, UID in object meta: " level=info timestamp=2018-08-02T10:28:39.226461Z pos=preset.go:102 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz2xjv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiz2xjv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c9dfa996-963e-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiz2xjv" level=info timestamp=2018-08-02T10:28:41.754167Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwvw4h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" level=info timestamp=2018-08-02T10:28:41.766907Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwvw4h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:29:20.263039Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:29:20.264521Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:29:20.264641Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" level=info timestamp=2018-08-02T10:29:40.744841Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmiwvw4h, existing: true\n" level=info timestamp=2018-08-02T10:29:40.744924Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:29:40.744977Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:29:40.745192Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:29:40.746172Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:29:40.746341Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" level=info timestamp=2018-08-02T10:30:21.706667Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmiwvw4h, existing: true\n" level=info timestamp=2018-08-02T10:30:21.706762Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:30:21.706871Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:30:21.707000Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:30:21.708103Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:30:21.708327Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:27:12.410286Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-02T10:27:12.423151Z pos=vm.go:212 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-02T10:27:12.424330Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-02T10:27:12.590839Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-02T10:27:12.703478Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-02T10:27:12.709948Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-launcher-testvmiwvw4h-b5wfn Pod phase: Running level=info timestamp=2018-08-02T10:28:49.103956Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:28:49.104252Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:28:49.105519Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:28:59.136159Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:28:59.295186Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiwvw4h" level=info timestamp=2018-08-02T10:28:59.296850Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:28:59.297081Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [185.770 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 should start it [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:80 Unexpected Warning event received: testvmiwvw4h,d06ec295-963e-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ level=info timestamp=2018-08-02T10:28:42.422126Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmiwvw4h kind=VirtualMachineInstance uid=d06ec295-963e-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmiwvw4h-b5wfn" level=info timestamp=2018-08-02T10:29:00.369891Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmiwvw4h kind=VirtualMachineInstance uid=d06ec295-963e-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmiwvw4h-b5wfn" level=error timestamp=2018-08-02T10:29:00.451574Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmiwvw4h kind=VirtualMachineInstance uid=d06ec295-963e-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running level=info timestamp=2018-08-02T10:29:57.848761Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:30:04 http: TLS handshake error from 10.244.1.1:45380: EOF 2018/08/02 10:30:14 http: TLS handshake error from 10.244.1.1:45386: EOF 2018/08/02 10:30:24 http: TLS handshake error from 10.244.1.1:45392: EOF level=info timestamp=2018-08-02T10:30:27.849063Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:30:34 http: TLS handshake error from 10.244.1.1:45398: EOF 2018/08/02 10:30:44 http: TLS handshake error from 10.244.1.1:45404: EOF 2018/08/02 10:30:54 http: TLS handshake error from 10.244.1.1:45410: EOF level=info timestamp=2018-08-02T10:30:57.827885Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:31:04 http: TLS handshake error from 10.244.1.1:45416: EOF 2018/08/02 10:31:14 http: TLS handshake error from 10.244.1.1:45422: EOF 2018/08/02 10:31:24 http: TLS handshake error from 10.244.1.1:45428: EOF level=info timestamp=2018-08-02T10:31:27.844036Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:31:34 http: TLS handshake error from 10.244.1.1:45434: EOF 2018/08/02 10:31:44 http: TLS handshake error from 10.244.1.1:45440: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running 2018/08/02 10:30:27 http: TLS handshake error from 10.244.0.1:41634: EOF 2018/08/02 10:30:37 http: TLS handshake error from 10.244.0.1:41658: EOF 2018/08/02 10:30:47 http: TLS handshake error from 10.244.0.1:41682: EOF level=info timestamp=2018-08-02T10:30:49.529427Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:30:51.771145Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:30:57 http: TLS handshake error from 10.244.0.1:41706: EOF 2018/08/02 10:31:07 http: TLS handshake error from 10.244.0.1:41730: EOF 2018/08/02 10:31:17 http: TLS handshake error from 10.244.0.1:41754: EOF level=info timestamp=2018-08-02T10:31:19.556106Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:31:21.795020Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:31:27 http: TLS handshake error from 10.244.0.1:41778: EOF 2018/08/02 10:31:37 http: TLS handshake error from 10.244.0.1:41802: EOF 2018/08/02 10:31:47 http: TLS handshake error from 10.244.0.1:41826: EOF level=info timestamp=2018-08-02T10:31:49.586090Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:31:51.819959Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:27:09.067114Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-08-02T10:27:09.069011Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-08-02T10:27:09.069060Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-08-02T10:27:09.069100Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-08-02T10:27:09.069172Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-08-02T10:28:38.616736Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:28:38.621073Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz2xjv kind= uid=c9dfa996-963e-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:28:39.214336Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz2xjv kind= uid=c9dfa996-963e-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:28:39.220902Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=error timestamp=2018-08-02T10:28:39.226397Z pos=preset.go:175 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz2xjv kind= uid=c9dfa996-963e-11e8-9cfb-525500d15501 msg="Could not update VirtualMachineInstance: Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz2xjv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiz2xjv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c9dfa996-963e-11e8-9cfb-525500d15501, UID in object meta: " level=info timestamp=2018-08-02T10:28:39.226461Z pos=preset.go:102 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz2xjv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiz2xjv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c9dfa996-963e-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiz2xjv" level=info timestamp=2018-08-02T10:28:41.754167Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwvw4h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" level=info timestamp=2018-08-02T10:28:41.766907Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwvw4h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" level=info timestamp=2018-08-02T10:31:36.467137Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:31:36.468268Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:31:51.579872Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:31:51.580564Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:31:51.580637Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmimp772" level=info timestamp=2018-08-02T10:31:51.600825Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmimp772, existing: true\n" level=info timestamp=2018-08-02T10:31:51.600875Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:31:51.600899Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:31:51.600952Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:31:51.601340Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:31:51.601415Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmimp772" level=info timestamp=2018-08-02T10:31:51.641596Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmimp772, existing: true\n" level=info timestamp=2018-08-02T10:31:51.641664Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:31:51.641693Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:31:51.641770Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:31:51.642180Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:31:51.642263Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmimp772" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:27:12.410286Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-02T10:27:12.423151Z pos=vm.go:212 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-02T10:27:12.424330Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-02T10:27:12.590839Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-02T10:27:12.703478Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-02T10:27:12.709948Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-launcher-testvmimp772-6hzhw Pod phase: Running level=info timestamp=2018-08-02T10:31:40.444276Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:31:40.444578Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:31:40.446885Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:31:50.452300Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:31:50.472328Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmimp772" level=info timestamp=2018-08-02T10:31:50.474317Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:31:50.474478Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmiwvw4h-b5wfn Pod phase: Pending level=info timestamp=2018-08-02T10:28:49.103956Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:28:49.104252Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:28:49.105519Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:28:59.136159Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:28:59.295186Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiwvw4h" level=info timestamp=2018-08-02T10:28:59.296850Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:28:59.297081Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" caught signal virt-launcher exited with code 127 Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 10:32:54 http: TLS handshake error from 10.244.1.1:45482: EOF level=info timestamp=2018-08-02T10:32:57.843236Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:33:04 http: TLS handshake error from 10.244.1.1:45488: EOF 2018/08/02 10:33:14 http: TLS handshake error from 10.244.1.1:45494: EOF 2018/08/02 10:33:24 http: TLS handshake error from 10.244.1.1:45500: EOF level=info timestamp=2018-08-02T10:33:27.823264Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:33:34 http: TLS handshake error from 10.244.1.1:45506: EOF 2018/08/02 10:33:44 http: TLS handshake error from 10.244.1.1:45512: EOF 2018/08/02 10:33:54 http: TLS handshake error from 10.244.1.1:45518: EOF level=info timestamp=2018-08-02T10:33:57.865451Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:34:04 http: TLS handshake error from 10.244.1.1:45524: EOF 2018/08/02 10:34:14 http: TLS handshake error from 10.244.1.1:45530: EOF 2018/08/02 10:34:24 http: TLS handshake error from 10.244.1.1:45536: EOF level=info timestamp=2018-08-02T10:34:27.857901Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:34:34 http: TLS handshake error from 10.244.1.1:45542: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T10:33:19.675917Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:33:21.913577Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:33:27 http: TLS handshake error from 10.244.0.1:42066: EOF 2018/08/02 10:33:37 http: TLS handshake error from 10.244.0.1:42090: EOF 2018/08/02 10:33:47 http: TLS handshake error from 10.244.0.1:42114: EOF level=info timestamp=2018-08-02T10:33:49.705264Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:33:51.940792Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:33:57 http: TLS handshake error from 10.244.0.1:42138: EOF level=info timestamp=2018-08-02T10:34:03.248810Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:34:03.255937Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:34:07 http: TLS handshake error from 10.244.0.1:42162: EOF 2018/08/02 10:34:17 http: TLS handshake error from 10.244.0.1:42186: EOF level=info timestamp=2018-08-02T10:34:19.740739Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:34:21.970373Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:34:27 http: TLS handshake error from 10.244.0.1:42210: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:27:09.067114Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-08-02T10:27:09.069011Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-08-02T10:27:09.069060Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-08-02T10:27:09.069100Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-08-02T10:27:09.069172Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-08-02T10:28:38.616736Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:28:38.621073Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz2xjv kind= uid=c9dfa996-963e-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:28:39.214336Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz2xjv kind= uid=c9dfa996-963e-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:28:39.220902Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=error timestamp=2018-08-02T10:28:39.226397Z pos=preset.go:175 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz2xjv kind= uid=c9dfa996-963e-11e8-9cfb-525500d15501 msg="Could not update VirtualMachineInstance: Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz2xjv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiz2xjv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c9dfa996-963e-11e8-9cfb-525500d15501, UID in object meta: " level=info timestamp=2018-08-02T10:28:39.226461Z pos=preset.go:102 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz2xjv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiz2xjv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c9dfa996-963e-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiz2xjv" level=info timestamp=2018-08-02T10:28:41.754167Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwvw4h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" level=info timestamp=2018-08-02T10:28:41.766907Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwvw4h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" level=info timestamp=2018-08-02T10:31:36.467137Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:31:36.468268Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:32:32.534467Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:32:32.535646Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:32:32.535787Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmimp772" level=info timestamp=2018-08-02T10:33:13.495985Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmimp772, existing: true\n" level=info timestamp=2018-08-02T10:33:13.496077Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:33:13.496101Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:33:13.496188Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:33:13.496806Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:33:13.496883Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmimp772" level=info timestamp=2018-08-02T10:34:35.417129Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmimp772, existing: true\n" level=info timestamp=2018-08-02T10:34:35.417223Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:34:35.417315Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:34:35.417417Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:34:35.418145Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:34:35.418251Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmimp772" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:27:12.410286Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-02T10:27:12.423151Z pos=vm.go:212 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-02T10:27:12.424330Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-02T10:27:12.590839Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-02T10:27:12.703478Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-02T10:27:12.709948Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-launcher-testvmimp772-6hzhw Pod phase: Running level=info timestamp=2018-08-02T10:31:40.444276Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:31:40.444578Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:31:40.446885Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:31:50.452300Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:31:50.472328Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmimp772" level=info timestamp=2018-08-02T10:31:50.474317Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:31:50.474478Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.466 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 should attach virt-launcher to it [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:86 Unexpected Warning event received: testvmimp772,3bffb938-963f-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ level=info timestamp=2018-08-02T10:31:37.220943Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmimp772 kind=VirtualMachineInstance uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmimp772-6hzhw" level=info timestamp=2018-08-02T10:31:52.232171Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmimp772 kind=VirtualMachineInstance uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmimp772-6hzhw" level=error timestamp=2018-08-02T10:31:52.247882Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmimp772 kind=VirtualMachineInstance uid=3bffb938-963f-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" •••• Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 10:33:04 http: TLS handshake error from 10.244.1.1:45488: EOF 2018/08/02 10:33:14 http: TLS handshake error from 10.244.1.1:45494: EOF 2018/08/02 10:33:24 http: TLS handshake error from 10.244.1.1:45500: EOF level=info timestamp=2018-08-02T10:33:27.823264Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:33:34 http: TLS handshake error from 10.244.1.1:45506: EOF 2018/08/02 10:33:44 http: TLS handshake error from 10.244.1.1:45512: EOF 2018/08/02 10:33:54 http: TLS handshake error from 10.244.1.1:45518: EOF level=info timestamp=2018-08-02T10:33:57.865451Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:34:04 http: TLS handshake error from 10.244.1.1:45524: EOF 2018/08/02 10:34:14 http: TLS handshake error from 10.244.1.1:45530: EOF 2018/08/02 10:34:24 http: TLS handshake error from 10.244.1.1:45536: EOF level=info timestamp=2018-08-02T10:34:27.857901Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:34:34 http: TLS handshake error from 10.244.1.1:45542: EOF level=info timestamp=2018-08-02T10:34:36.996729Z pos=validating-webhook.go:84 component=virt-api msg="rejected vmi admission" 2018/08/02 10:34:44 http: TLS handshake error from 10.244.1.1:45548: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running 2018/08/02 10:33:47 http: TLS handshake error from 10.244.0.1:42114: EOF level=info timestamp=2018-08-02T10:33:49.705264Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:33:51.940792Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:33:57 http: TLS handshake error from 10.244.0.1:42138: EOF level=info timestamp=2018-08-02T10:34:03.248810Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:34:03.255937Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:34:07 http: TLS handshake error from 10.244.0.1:42162: EOF 2018/08/02 10:34:17 http: TLS handshake error from 10.244.0.1:42186: EOF level=info timestamp=2018-08-02T10:34:19.740739Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:34:21.970373Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:34:27 http: TLS handshake error from 10.244.0.1:42210: EOF 2018/08/02 10:34:37 http: TLS handshake error from 10.244.0.1:42234: EOF 2018/08/02 10:34:47 http: TLS handshake error from 10.244.0.1:42258: EOF level=info timestamp=2018-08-02T10:34:49.768029Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:34:52.000294Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:28:38.621073Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz2xjv kind= uid=c9dfa996-963e-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:28:39.214336Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz2xjv kind= uid=c9dfa996-963e-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:28:39.220902Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=error timestamp=2018-08-02T10:28:39.226397Z pos=preset.go:175 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz2xjv kind= uid=c9dfa996-963e-11e8-9cfb-525500d15501 msg="Could not update VirtualMachineInstance: Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz2xjv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiz2xjv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c9dfa996-963e-11e8-9cfb-525500d15501, UID in object meta: " level=info timestamp=2018-08-02T10:28:39.226461Z pos=preset.go:102 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz2xjv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiz2xjv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c9dfa996-963e-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiz2xjv" level=info timestamp=2018-08-02T10:28:41.754167Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwvw4h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" level=info timestamp=2018-08-02T10:28:41.766907Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwvw4h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" level=info timestamp=2018-08-02T10:31:36.467137Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:31:36.468268Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:34:37.064118Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivxlfj kind= uid=a7a45a6b-963f-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:34:37.065431Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivxlfj kind= uid=a7a45a6b-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:34:37.322578Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikzh4z kind= uid=a7cc8861-963f-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:34:37.322722Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikzh4z kind= uid=a7cc8861-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:34:39.198720Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:34:39.198891Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:34:53.346617Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:34:53.347064Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:34:53.347160Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilgf25" level=info timestamp=2018-08-02T10:34:53.367356Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmilgf25, existing: true\n" level=info timestamp=2018-08-02T10:34:53.367433Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:34:53.367458Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:34:53.367611Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:34:53.368175Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:34:53.368383Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilgf25" level=info timestamp=2018-08-02T10:34:53.408695Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmilgf25, existing: true\n" level=info timestamp=2018-08-02T10:34:53.408837Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:34:53.408898Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:34:53.409024Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:34:53.409684Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:34:53.409770Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilgf25" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:27:12.410286Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-02T10:27:12.423151Z pos=vm.go:212 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-02T10:27:12.424330Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-02T10:27:12.590839Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-02T10:27:12.703478Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-02T10:27:12.709948Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-launcher-testvmilgf25-vw2gl Pod phase: Running level=info timestamp=2018-08-02T10:34:42.689574Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:34:42.689862Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:34:42.692769Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:34:52.699895Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:34:52.742093Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmilgf25" level=info timestamp=2018-08-02T10:34:52.744815Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:34:52.745014Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmimp772-6hzhw Pod phase: Failed level=info timestamp=2018-08-02T10:31:40.444276Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:31:40.444578Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:31:40.446885Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:31:50.452300Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:31:50.472328Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmimp772" level=info timestamp=2018-08-02T10:31:50.474317Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:31:50.474478Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" caught signal virt-launcher exited with code 127 Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 10:35:54 http: TLS handshake error from 10.244.1.1:45590: EOF level=info timestamp=2018-08-02T10:35:57.847371Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:36:04 http: TLS handshake error from 10.244.1.1:45596: EOF 2018/08/02 10:36:14 http: TLS handshake error from 10.244.1.1:45602: EOF 2018/08/02 10:36:24 http: TLS handshake error from 10.244.1.1:45608: EOF level=info timestamp=2018-08-02T10:36:27.833617Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:36:34 http: TLS handshake error from 10.244.1.1:45614: EOF 2018/08/02 10:36:44 http: TLS handshake error from 10.244.1.1:45620: EOF 2018/08/02 10:36:54 http: TLS handshake error from 10.244.1.1:45626: EOF level=info timestamp=2018-08-02T10:36:57.858258Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:37:04 http: TLS handshake error from 10.244.1.1:45632: EOF 2018/08/02 10:37:14 http: TLS handshake error from 10.244.1.1:45638: EOF 2018/08/02 10:37:24 http: TLS handshake error from 10.244.1.1:45644: EOF level=info timestamp=2018-08-02T10:37:27.843015Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:37:34 http: TLS handshake error from 10.244.1.1:45650: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T10:36:22.093726Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:36:27 http: TLS handshake error from 10.244.0.1:42498: EOF 2018/08/02 10:36:37 http: TLS handshake error from 10.244.0.1:42522: EOF 2018/08/02 10:36:47 http: TLS handshake error from 10.244.0.1:42546: EOF level=info timestamp=2018-08-02T10:36:49.883798Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:36:52.129248Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:36:57 http: TLS handshake error from 10.244.0.1:42570: EOF level=info timestamp=2018-08-02T10:37:03.259927Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:37:03.261086Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:37:07 http: TLS handshake error from 10.244.0.1:42594: EOF 2018/08/02 10:37:17 http: TLS handshake error from 10.244.0.1:42618: EOF level=info timestamp=2018-08-02T10:37:19.909408Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:37:22.165464Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:37:27 http: TLS handshake error from 10.244.0.1:42642: EOF 2018/08/02 10:37:37 http: TLS handshake error from 10.244.0.1:42666: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:28:38.621073Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz2xjv kind= uid=c9dfa996-963e-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:28:39.214336Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz2xjv kind= uid=c9dfa996-963e-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:28:39.220902Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiwvw4h kind= uid=d06ec295-963e-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=error timestamp=2018-08-02T10:28:39.226397Z pos=preset.go:175 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiz2xjv kind= uid=c9dfa996-963e-11e8-9cfb-525500d15501 msg="Could not update VirtualMachineInstance: Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz2xjv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiz2xjv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c9dfa996-963e-11e8-9cfb-525500d15501, UID in object meta: " level=info timestamp=2018-08-02T10:28:39.226461Z pos=preset.go:102 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz2xjv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiz2xjv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c9dfa996-963e-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiz2xjv" level=info timestamp=2018-08-02T10:28:41.754167Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwvw4h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" level=info timestamp=2018-08-02T10:28:41.766907Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwvw4h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" level=info timestamp=2018-08-02T10:31:36.467137Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:31:36.468268Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:34:37.064118Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivxlfj kind= uid=a7a45a6b-963f-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:34:37.065431Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivxlfj kind= uid=a7a45a6b-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:34:37.322578Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikzh4z kind= uid=a7cc8861-963f-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:34:37.322722Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikzh4z kind= uid=a7cc8861-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:34:39.198720Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:34:39.198891Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:36:15.264791Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:36:15.264840Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:36:15.264955Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:36:15.265688Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:36:15.265788Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilgf25" level=info timestamp=2018-08-02T10:37:19.258609Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmimp772, existing: false\n" level=info timestamp=2018-08-02T10:37:19.258688Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:37:19.258848Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmimp772 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:37:19.258967Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmimp772 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:37:37.186054Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmilgf25, existing: true\n" level=info timestamp=2018-08-02T10:37:37.186138Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:37:37.186166Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:37:37.186262Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:37:37.187380Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:37:37.187504Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmilgf25" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:27:12.410286Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-02T10:27:12.423151Z pos=vm.go:212 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-02T10:27:12.424330Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-02T10:27:12.590839Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-02T10:27:12.703478Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-02T10:27:12.709948Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-launcher-testvmilgf25-vw2gl Pod phase: Running level=info timestamp=2018-08-02T10:34:42.689574Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:34:42.689862Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:34:42.692769Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:34:52.699895Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:34:52.742093Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmilgf25" level=info timestamp=2018-08-02T10:34:52.744815Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:34:52.745014Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure [180.567 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with boot order /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:174 should be able to boot from selected disk /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 Alpine as first boot [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Unexpected Warning event received: testvmilgf25,a8ea6d61-963f-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ STEP: defining a VirtualMachineInstance with an Alpine disk STEP: adding a Cirros Disk STEP: setting boot order STEP: starting VirtualMachineInstance STEP: Waiting the VirtualMachineInstance start level=info timestamp=2018-08-02T10:34:39.945592Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmilgf25 kind=VirtualMachineInstance uid=a8ea6d61-963f-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmilgf25-vw2gl" level=info timestamp=2018-08-02T10:34:53.997229Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmilgf25 kind=VirtualMachineInstance uid=a8ea6d61-963f-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmilgf25-vw2gl" level=error timestamp=2018-08-02T10:34:54.016016Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmilgf25 kind=VirtualMachineInstance uid=a8ea6d61-963f-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 10:36:04 http: TLS handshake error from 10.244.1.1:45596: EOF 2018/08/02 10:36:14 http: TLS handshake error from 10.244.1.1:45602: EOF 2018/08/02 10:36:24 http: TLS handshake error from 10.244.1.1:45608: EOF level=info timestamp=2018-08-02T10:36:27.833617Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:36:34 http: TLS handshake error from 10.244.1.1:45614: EOF 2018/08/02 10:36:44 http: TLS handshake error from 10.244.1.1:45620: EOF 2018/08/02 10:36:54 http: TLS handshake error from 10.244.1.1:45626: EOF level=info timestamp=2018-08-02T10:36:57.858258Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:37:04 http: TLS handshake error from 10.244.1.1:45632: EOF 2018/08/02 10:37:14 http: TLS handshake error from 10.244.1.1:45638: EOF 2018/08/02 10:37:24 http: TLS handshake error from 10.244.1.1:45644: EOF level=info timestamp=2018-08-02T10:37:27.843015Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:37:34 http: TLS handshake error from 10.244.1.1:45650: EOF 2018/08/02 10:37:44 http: TLS handshake error from 10.244.1.1:45656: EOF 2018/08/02 10:37:54 http: TLS handshake error from 10.244.1.1:45662: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running 2018/08/02 10:36:47 http: TLS handshake error from 10.244.0.1:42546: EOF level=info timestamp=2018-08-02T10:36:49.883798Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:36:52.129248Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:36:57 http: TLS handshake error from 10.244.0.1:42570: EOF level=info timestamp=2018-08-02T10:37:03.259927Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:37:03.261086Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:37:07 http: TLS handshake error from 10.244.0.1:42594: EOF 2018/08/02 10:37:17 http: TLS handshake error from 10.244.0.1:42618: EOF level=info timestamp=2018-08-02T10:37:19.909408Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:37:22.165464Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:37:27 http: TLS handshake error from 10.244.0.1:42642: EOF 2018/08/02 10:37:37 http: TLS handshake error from 10.244.0.1:42666: EOF 2018/08/02 10:37:47 http: TLS handshake error from 10.244.0.1:42690: EOF level=info timestamp=2018-08-02T10:37:49.940609Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:37:52.191773Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:28:39.226461Z pos=preset.go:102 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz2xjv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiz2xjv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c9dfa996-963e-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiz2xjv" level=info timestamp=2018-08-02T10:28:41.754167Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwvw4h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" level=info timestamp=2018-08-02T10:28:41.766907Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwvw4h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" level=info timestamp=2018-08-02T10:31:36.467137Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:31:36.468268Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:34:37.064118Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivxlfj kind= uid=a7a45a6b-963f-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:34:37.065431Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivxlfj kind= uid=a7a45a6b-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:34:37.322578Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikzh4z kind= uid=a7cc8861-963f-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:34:37.322722Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikzh4z kind= uid=a7cc8861-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:34:39.198720Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:34:39.198891Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:37:39.671376Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7khsg kind= uid=147c7971-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:37:39.672500Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7khsg kind= uid=147c7971-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:37:39.708440Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7khsg\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7khsg" level=info timestamp=2018-08-02T10:37:39.733152Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7khsg\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7khsg" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:37:55.815093Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi7khsg kind= uid=147c7971-9640-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:37:55.815490Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi7khsg kind= uid=147c7971-9640-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:37:55.815620Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi7khsg" level=info timestamp=2018-08-02T10:37:55.836264Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi7khsg, existing: true\n" level=info timestamp=2018-08-02T10:37:55.836312Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:37:55.836352Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:37:55.836417Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi7khsg kind= uid=147c7971-9640-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:37:55.836872Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi7khsg kind= uid=147c7971-9640-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:37:55.836963Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi7khsg" level=info timestamp=2018-08-02T10:37:55.877154Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi7khsg, existing: true\n" level=info timestamp=2018-08-02T10:37:55.877232Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:37:55.877261Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:37:55.877335Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi7khsg kind= uid=147c7971-9640-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:37:55.877926Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi7khsg kind= uid=147c7971-9640-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:37:55.878036Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi7khsg" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:27:12.410286Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-02T10:27:12.423151Z pos=vm.go:212 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-02T10:27:12.424330Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-02T10:27:12.590839Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-02T10:27:12.703478Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-02T10:27:12.709948Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-launcher-testvmi7khsg-k4fjn Pod phase: Running level=info timestamp=2018-08-02T10:37:44.048154Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:37:44.048433Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:37:44.049856Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:37:54.055715Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:37:54.091486Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi7khsg" level=info timestamp=2018-08-02T10:37:54.093932Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:37:54.094102Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmilgf25-vw2gl Pod phase: Failed Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running level=info timestamp=2018-08-02T10:38:57.825456Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:38:57.883641Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:39:04 http: TLS handshake error from 10.244.1.1:45704: EOF 2018/08/02 10:39:14 http: TLS handshake error from 10.244.1.1:45710: EOF 2018/08/02 10:39:24 http: TLS handshake error from 10.244.1.1:45716: EOF level=info timestamp=2018-08-02T10:39:27.846068Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:39:34 http: TLS handshake error from 10.244.1.1:45722: EOF 2018/08/02 10:39:44 http: TLS handshake error from 10.244.1.1:45728: EOF 2018/08/02 10:39:54 http: TLS handshake error from 10.244.1.1:45734: EOF level=info timestamp=2018-08-02T10:39:57.851806Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:40:04 http: TLS handshake error from 10.244.1.1:45740: EOF 2018/08/02 10:40:14 http: TLS handshake error from 10.244.1.1:45746: EOF 2018/08/02 10:40:24 http: TLS handshake error from 10.244.1.1:45752: EOF level=info timestamp=2018-08-02T10:40:27.843233Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:40:34 http: TLS handshake error from 10.244.1.1:45758: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T10:39:22.290566Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:39:27 http: TLS handshake error from 10.244.0.1:42930: EOF 2018/08/02 10:39:37 http: TLS handshake error from 10.244.0.1:42954: EOF 2018/08/02 10:39:47 http: TLS handshake error from 10.244.0.1:42978: EOF level=info timestamp=2018-08-02T10:39:50.057540Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:39:52.318472Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:39:57 http: TLS handshake error from 10.244.0.1:43002: EOF level=info timestamp=2018-08-02T10:40:03.369394Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:40:03.370523Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:40:07 http: TLS handshake error from 10.244.0.1:43026: EOF 2018/08/02 10:40:17 http: TLS handshake error from 10.244.0.1:43050: EOF level=info timestamp=2018-08-02T10:40:20.082547Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:40:22.347850Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:40:27 http: TLS handshake error from 10.244.0.1:43074: EOF 2018/08/02 10:40:37 http: TLS handshake error from 10.244.0.1:43098: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:28:39.226461Z pos=preset.go:102 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiz2xjv\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmiz2xjv, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c9dfa996-963e-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiz2xjv" level=info timestamp=2018-08-02T10:28:41.754167Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwvw4h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" level=info timestamp=2018-08-02T10:28:41.766907Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmiwvw4h\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmiwvw4h" level=info timestamp=2018-08-02T10:31:36.467137Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:31:36.468268Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimp772 kind= uid=3bffb938-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:34:37.064118Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivxlfj kind= uid=a7a45a6b-963f-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:34:37.065431Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivxlfj kind= uid=a7a45a6b-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:34:37.322578Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikzh4z kind= uid=a7cc8861-963f-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:34:37.322722Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikzh4z kind= uid=a7cc8861-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:34:39.198720Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:34:39.198891Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:37:39.671376Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7khsg kind= uid=147c7971-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:37:39.672500Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7khsg kind= uid=147c7971-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:37:39.708440Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7khsg\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7khsg" level=info timestamp=2018-08-02T10:37:39.733152Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7khsg\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7khsg" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:39:17.731850Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:39:17.731874Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:39:17.731966Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi7khsg kind= uid=147c7971-9640-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:39:17.732900Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi7khsg kind= uid=147c7971-9640-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:39:17.732989Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi7khsg" level=info timestamp=2018-08-02T10:40:21.027801Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmilgf25, existing: false\n" level=info timestamp=2018-08-02T10:40:21.027907Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:21.027982Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmilgf25 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:21.028073Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmilgf25 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:40:39.654780Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi7khsg, existing: true\n" level=info timestamp=2018-08-02T10:40:39.654847Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:40:39.654870Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:39.654944Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi7khsg kind= uid=147c7971-9640-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:40:39.655462Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi7khsg kind= uid=147c7971-9640-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:40:39.655537Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi7khsg" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:27:12.410286Z pos=virt-handler.go:87 component=virt-handler hostname=node01 level=info timestamp=2018-08-02T10:27:12.423151Z pos=vm.go:212 component=virt-handler msg="Starting virt-handler controller." level=info timestamp=2018-08-02T10:27:12.424330Z pos=cache.go:151 component=virt-handler msg="Synchronizing domains" level=info timestamp=2018-08-02T10:27:12.590839Z pos=device_controller.go:133 component=virt-handler msg="Starting device plugin controller" level=info timestamp=2018-08-02T10:27:12.703478Z pos=device_controller.go:127 component=virt-handler msg="tun device plugin started" level=info timestamp=2018-08-02T10:27:12.709948Z pos=device_controller.go:127 component=virt-handler msg="kvm device plugin started" Pod name: virt-launcher-testvmi7khsg-k4fjn Pod phase: Running level=info timestamp=2018-08-02T10:37:44.048154Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:37:44.048433Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:37:44.049856Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:37:54.055715Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:37:54.091486Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi7khsg" level=info timestamp=2018-08-02T10:37:54.093932Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:37:54.094102Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.467 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with boot order /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:174 should be able to boot from selected disk /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 Cirros as first boot [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Unexpected Warning event received: testvmi7khsg,147c7971-9640-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ STEP: defining a VirtualMachineInstance with an Alpine disk STEP: adding a Cirros Disk STEP: setting boot order STEP: starting VirtualMachineInstance STEP: Waiting the VirtualMachineInstance start level=info timestamp=2018-08-02T10:37:40.453150Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmi7khsg kind=VirtualMachineInstance uid=147c7971-9640-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi7khsg-k4fjn" level=info timestamp=2018-08-02T10:37:56.467470Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmi7khsg kind=VirtualMachineInstance uid=147c7971-9640-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmi7khsg-k4fjn" level=error timestamp=2018-08-02T10:37:56.483997Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmi7khsg kind=VirtualMachineInstance uid=147c7971-9640-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" • [SLOW TEST:15.740 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with user-data /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:205 without k8s secret /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:206 should retry starting the VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:207 ------------------------------ • [SLOW TEST:44.854 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with user-data /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:205 without k8s secret /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:206 should log warning and proceed once the secret is there /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:237 ------------------------------ Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running level=info timestamp=2018-08-02T10:39:57.851806Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:40:04 http: TLS handshake error from 10.244.1.1:45740: EOF 2018/08/02 10:40:14 http: TLS handshake error from 10.244.1.1:45746: EOF 2018/08/02 10:40:24 http: TLS handshake error from 10.244.1.1:45752: EOF level=info timestamp=2018-08-02T10:40:27.843233Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:40:34 http: TLS handshake error from 10.244.1.1:45758: EOF 2018/08/02 10:40:44 http: TLS handshake error from 10.244.1.1:45764: EOF 2018/08/02 10:40:54 http: TLS handshake error from 10.244.1.1:45770: EOF level=info timestamp=2018-08-02T10:40:57.851011Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:41:04 http: TLS handshake error from 10.244.1.1:45776: EOF 2018/08/02 10:41:14 http: TLS handshake error from 10.244.1.1:45782: EOF 2018/08/02 10:41:24 http: TLS handshake error from 10.244.1.1:45788: EOF level=info timestamp=2018-08-02T10:41:27.825866Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:41:34 http: TLS handshake error from 10.244.1.1:45794: EOF 2018/08/02 10:41:44 http: TLS handshake error from 10.244.1.1:45800: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running 2018/08/02 10:40:27 http: TLS handshake error from 10.244.0.1:43074: EOF 2018/08/02 10:40:37 http: TLS handshake error from 10.244.0.1:43098: EOF 2018/08/02 10:40:47 http: TLS handshake error from 10.244.0.1:43122: EOF level=info timestamp=2018-08-02T10:40:50.107002Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:40:52.367139Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:40:57 http: TLS handshake error from 10.244.0.1:43146: EOF 2018/08/02 10:41:07 http: TLS handshake error from 10.244.0.1:43170: EOF 2018/08/02 10:41:17 http: TLS handshake error from 10.244.0.1:43194: EOF level=info timestamp=2018-08-02T10:41:20.148254Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:41:22.397772Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:41:27 http: TLS handshake error from 10.244.0.1:43218: EOF 2018/08/02 10:41:37 http: TLS handshake error from 10.244.0.1:43242: EOF 2018/08/02 10:41:47 http: TLS handshake error from 10.244.0.1:43266: EOF level=info timestamp=2018-08-02T10:41:50.178698Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:41:52.423075Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:34:39.198891Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:37:39.671376Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7khsg kind= uid=147c7971-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:37:39.672500Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7khsg kind= uid=147c7971-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:37:39.708440Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7khsg\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7khsg" level=info timestamp=2018-08-02T10:37:39.733152Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7khsg\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7khsg" level=info timestamp=2018-08-02T10:40:40.134670Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:40:40.135761Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:40:40.170819Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikrhvk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikrhvk" level=info timestamp=2018-08-02T10:40:40.183024Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikrhvk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikrhvk" level=info timestamp=2018-08-02T10:40:55.879031Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi72x5h kind= uid=896fa102-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:40:55.879146Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi72x5h kind= uid=896fa102-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:41:40.728004Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:41:40.729385Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:41:40.774915Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivskk5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" level=info timestamp=2018-08-02T10:41:40.816951Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivskk5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:41:54.776064Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:41:54.776953Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:41:54.777082Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" level=info timestamp=2018-08-02T10:41:54.797270Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmivskk5, existing: true\n" level=info timestamp=2018-08-02T10:41:54.797343Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:41:54.797374Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:41:54.797463Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:41:54.798591Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:41:54.798733Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" level=info timestamp=2018-08-02T10:41:54.839128Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmivskk5, existing: true\n" level=info timestamp=2018-08-02T10:41:54.839203Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:41:54.839234Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:41:54.839327Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:41:54.840092Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:41:54.840260Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:40:56.072337Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.088571Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:40:56.090453Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmikrhvk, existing: true\n" level=info timestamp=2018-08-02T10:40:56.090479Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T10:40:56.091600Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:56.091667Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.091789Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:40:56.091892Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmikrhvk, existing: false\n" level=info timestamp=2018-08-02T10:40:56.091909Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:56.091936Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.091992Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:40:56.094620Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmikrhvk, existing: false\n" level=info timestamp=2018-08-02T10:40:56.094686Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:56.094756Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.094899Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi72x5h-bcwn2 Pod phase: Failed Pod name: virt-launcher-testvmivskk5-x5mc6 Pod phase: Running level=info timestamp=2018-08-02T10:41:43.724979Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:41:43.725243Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:41:43.727017Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:41:53.733664Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:41:53.782099Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmivskk5" level=info timestamp=2018-08-02T10:41:53.783930Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:41:53.784156Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 10:42:54 http: TLS handshake error from 10.244.1.1:45842: EOF level=info timestamp=2018-08-02T10:42:57.854962Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:43:04 http: TLS handshake error from 10.244.1.1:45848: EOF 2018/08/02 10:43:14 http: TLS handshake error from 10.244.1.1:45854: EOF 2018/08/02 10:43:24 http: TLS handshake error from 10.244.1.1:45860: EOF level=info timestamp=2018-08-02T10:43:27.848113Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:43:34 http: TLS handshake error from 10.244.1.1:45866: EOF 2018/08/02 10:43:44 http: TLS handshake error from 10.244.1.1:45872: EOF 2018/08/02 10:43:54 http: TLS handshake error from 10.244.1.1:45878: EOF level=info timestamp=2018-08-02T10:43:57.871063Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:44:04 http: TLS handshake error from 10.244.1.1:45884: EOF 2018/08/02 10:44:14 http: TLS handshake error from 10.244.1.1:45890: EOF 2018/08/02 10:44:24 http: TLS handshake error from 10.244.1.1:45896: EOF level=info timestamp=2018-08-02T10:44:27.827138Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:44:34 http: TLS handshake error from 10.244.1.1:45902: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T10:43:22.508864Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:43:27 http: TLS handshake error from 10.244.0.1:43506: EOF 2018/08/02 10:43:37 http: TLS handshake error from 10.244.0.1:43530: EOF 2018/08/02 10:43:47 http: TLS handshake error from 10.244.0.1:43554: EOF level=info timestamp=2018-08-02T10:43:50.300556Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:43:52.537212Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:43:57 http: TLS handshake error from 10.244.0.1:43578: EOF level=info timestamp=2018-08-02T10:44:03.266702Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:44:03.267399Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:44:07 http: TLS handshake error from 10.244.0.1:43602: EOF 2018/08/02 10:44:17 http: TLS handshake error from 10.244.0.1:43626: EOF level=info timestamp=2018-08-02T10:44:20.330639Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:44:22.561131Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:44:27 http: TLS handshake error from 10.244.0.1:43650: EOF 2018/08/02 10:44:37 http: TLS handshake error from 10.244.0.1:43674: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:34:39.198891Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilgf25 kind= uid=a8ea6d61-963f-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:37:39.671376Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7khsg kind= uid=147c7971-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:37:39.672500Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7khsg kind= uid=147c7971-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:37:39.708440Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7khsg\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7khsg" level=info timestamp=2018-08-02T10:37:39.733152Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7khsg\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7khsg" level=info timestamp=2018-08-02T10:40:40.134670Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:40:40.135761Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:40:40.170819Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikrhvk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikrhvk" level=info timestamp=2018-08-02T10:40:40.183024Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikrhvk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikrhvk" level=info timestamp=2018-08-02T10:40:55.879031Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi72x5h kind= uid=896fa102-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:40:55.879146Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi72x5h kind= uid=896fa102-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:41:40.728004Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:41:40.729385Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:41:40.774915Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivskk5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" level=info timestamp=2018-08-02T10:41:40.816951Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivskk5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:43:16.694518Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:43:16.694581Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:43:16.694672Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:43:16.695362Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:43:16.695479Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" level=info timestamp=2018-08-02T10:43:23.495828Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi7khsg, existing: false\n" level=info timestamp=2018-08-02T10:43:23.495905Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:43:23.495962Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi7khsg kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:43:23.496032Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi7khsg kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:44:38.615710Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmivskk5, existing: true\n" level=info timestamp=2018-08-02T10:44:38.615804Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:44:38.615832Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:44:38.615920Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:44:38.616575Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:44:38.616661Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:40:56.072337Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.088571Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:40:56.090453Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmikrhvk, existing: true\n" level=info timestamp=2018-08-02T10:40:56.090479Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T10:40:56.091600Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:56.091667Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.091789Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:40:56.091892Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmikrhvk, existing: false\n" level=info timestamp=2018-08-02T10:40:56.091909Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:56.091936Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.091992Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:40:56.094620Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmikrhvk, existing: false\n" level=info timestamp=2018-08-02T10:40:56.094686Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:56.094756Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.094899Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmivskk5-x5mc6 Pod phase: Running level=info timestamp=2018-08-02T10:41:43.724979Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:41:43.725243Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:41:43.727017Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:41:53.733664Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:41:53.782099Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmivskk5" level=info timestamp=2018-08-02T10:41:53.783930Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:41:53.784156Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.466 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 when virt-launcher crashes /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:285 should be stopped and have Failed phase [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:286 Unexpected Warning event received: testvmivskk5,a42ad594-9640-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ level=info timestamp=2018-08-02T10:41:41.497035Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmivskk5 kind=VirtualMachineInstance uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmivskk5-x5mc6" level=info timestamp=2018-08-02T10:41:55.410840Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmivskk5 kind=VirtualMachineInstance uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmivskk5-x5mc6" level=error timestamp=2018-08-02T10:41:55.448943Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmivskk5 kind=VirtualMachineInstance uid=a42ad594-9640-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 10:43:04 http: TLS handshake error from 10.244.1.1:45848: EOF 2018/08/02 10:43:14 http: TLS handshake error from 10.244.1.1:45854: EOF 2018/08/02 10:43:24 http: TLS handshake error from 10.244.1.1:45860: EOF level=info timestamp=2018-08-02T10:43:27.848113Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:43:34 http: TLS handshake error from 10.244.1.1:45866: EOF 2018/08/02 10:43:44 http: TLS handshake error from 10.244.1.1:45872: EOF 2018/08/02 10:43:54 http: TLS handshake error from 10.244.1.1:45878: EOF level=info timestamp=2018-08-02T10:43:57.871063Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:44:04 http: TLS handshake error from 10.244.1.1:45884: EOF 2018/08/02 10:44:14 http: TLS handshake error from 10.244.1.1:45890: EOF 2018/08/02 10:44:24 http: TLS handshake error from 10.244.1.1:45896: EOF level=info timestamp=2018-08-02T10:44:27.827138Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:44:34 http: TLS handshake error from 10.244.1.1:45902: EOF 2018/08/02 10:44:44 http: TLS handshake error from 10.244.1.1:45908: EOF 2018/08/02 10:44:54 http: TLS handshake error from 10.244.1.1:45914: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running 2018/08/02 10:43:47 http: TLS handshake error from 10.244.0.1:43554: EOF level=info timestamp=2018-08-02T10:43:50.300556Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:43:52.537212Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:43:57 http: TLS handshake error from 10.244.0.1:43578: EOF level=info timestamp=2018-08-02T10:44:03.266702Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:44:03.267399Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:44:07 http: TLS handshake error from 10.244.0.1:43602: EOF 2018/08/02 10:44:17 http: TLS handshake error from 10.244.0.1:43626: EOF level=info timestamp=2018-08-02T10:44:20.330639Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:44:22.561131Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:44:27 http: TLS handshake error from 10.244.0.1:43650: EOF 2018/08/02 10:44:37 http: TLS handshake error from 10.244.0.1:43674: EOF 2018/08/02 10:44:47 http: TLS handshake error from 10.244.0.1:43698: EOF level=info timestamp=2018-08-02T10:44:50.365402Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:44:52.587965Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:37:39.708440Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7khsg\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7khsg" level=info timestamp=2018-08-02T10:37:39.733152Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7khsg\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7khsg" level=info timestamp=2018-08-02T10:40:40.134670Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:40:40.135761Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:40:40.170819Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikrhvk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikrhvk" level=info timestamp=2018-08-02T10:40:40.183024Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikrhvk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikrhvk" level=info timestamp=2018-08-02T10:40:55.879031Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi72x5h kind= uid=896fa102-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:40:55.879146Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi72x5h kind= uid=896fa102-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:41:40.728004Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:41:40.729385Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:41:40.774915Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivskk5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" level=info timestamp=2018-08-02T10:41:40.816951Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivskk5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" level=info timestamp=2018-08-02T10:44:41.195194Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:44:41.196425Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:44:41.236662Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmih4z46\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmih4z46" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:44:56.701687Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:44:56.702011Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:44:56.702082Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmih4z46" level=info timestamp=2018-08-02T10:44:56.722267Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmih4z46, existing: true\n" level=info timestamp=2018-08-02T10:44:56.722324Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:44:56.722361Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:44:56.722405Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:44:56.723449Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:44:56.723518Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmih4z46" level=info timestamp=2018-08-02T10:44:56.763728Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmih4z46, existing: true\n" level=info timestamp=2018-08-02T10:44:56.763795Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:44:56.763840Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:44:56.763891Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:44:56.764264Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:44:56.764337Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmih4z46" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:40:56.072337Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.088571Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:40:56.090453Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmikrhvk, existing: true\n" level=info timestamp=2018-08-02T10:40:56.090479Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T10:40:56.091600Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:56.091667Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.091789Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:40:56.091892Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmikrhvk, existing: false\n" level=info timestamp=2018-08-02T10:40:56.091909Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:56.091936Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.091992Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:40:56.094620Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmikrhvk, existing: false\n" level=info timestamp=2018-08-02T10:40:56.094686Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:56.094756Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.094899Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmih4z46-82w4v Pod phase: Running level=info timestamp=2018-08-02T10:44:44.656959Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:44:44.657223Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:44:44.658500Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:44:54.665174Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:44:54.714761Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmih4z46" level=info timestamp=2018-08-02T10:44:54.717067Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:44:54.717222Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 10:45:54 http: TLS handshake error from 10.244.1.1:45950: EOF level=info timestamp=2018-08-02T10:45:57.857037Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:46:04 http: TLS handshake error from 10.244.1.1:45956: EOF 2018/08/02 10:46:14 http: TLS handshake error from 10.244.1.1:45962: EOF 2018/08/02 10:46:24 http: TLS handshake error from 10.244.1.1:45968: EOF level=info timestamp=2018-08-02T10:46:27.833747Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:46:34 http: TLS handshake error from 10.244.1.1:45974: EOF 2018/08/02 10:46:44 http: TLS handshake error from 10.244.1.1:45980: EOF 2018/08/02 10:46:54 http: TLS handshake error from 10.244.1.1:45986: EOF level=info timestamp=2018-08-02T10:46:57.851131Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:47:04 http: TLS handshake error from 10.244.1.1:45992: EOF 2018/08/02 10:47:14 http: TLS handshake error from 10.244.1.1:45998: EOF 2018/08/02 10:47:24 http: TLS handshake error from 10.244.1.1:46004: EOF level=info timestamp=2018-08-02T10:47:27.860446Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:47:34 http: TLS handshake error from 10.244.1.1:46010: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T10:46:22.696897Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:46:27 http: TLS handshake error from 10.244.0.1:43938: EOF 2018/08/02 10:46:37 http: TLS handshake error from 10.244.0.1:43962: EOF 2018/08/02 10:46:47 http: TLS handshake error from 10.244.0.1:43986: EOF level=info timestamp=2018-08-02T10:46:50.496367Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:46:52.724928Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:46:57 http: TLS handshake error from 10.244.0.1:44010: EOF level=info timestamp=2018-08-02T10:47:03.270959Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:47:03.271961Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:47:07 http: TLS handshake error from 10.244.0.1:44034: EOF 2018/08/02 10:47:17 http: TLS handshake error from 10.244.0.1:44058: EOF level=info timestamp=2018-08-02T10:47:20.529867Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:47:22.767465Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:47:27 http: TLS handshake error from 10.244.0.1:44082: EOF 2018/08/02 10:47:37 http: TLS handshake error from 10.244.0.1:44106: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:37:39.708440Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7khsg\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7khsg" level=info timestamp=2018-08-02T10:37:39.733152Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7khsg\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7khsg" level=info timestamp=2018-08-02T10:40:40.134670Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:40:40.135761Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:40:40.170819Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikrhvk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikrhvk" level=info timestamp=2018-08-02T10:40:40.183024Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikrhvk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikrhvk" level=info timestamp=2018-08-02T10:40:55.879031Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi72x5h kind= uid=896fa102-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:40:55.879146Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi72x5h kind= uid=896fa102-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:41:40.728004Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:41:40.729385Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:41:40.774915Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivskk5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" level=info timestamp=2018-08-02T10:41:40.816951Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivskk5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" level=info timestamp=2018-08-02T10:44:41.195194Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:44:41.196425Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:44:41.236662Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmih4z46\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmih4z46" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:46:18.620530Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:46:18.620574Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:46:18.620659Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:46:18.621554Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:46:18.621631Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmih4z46" level=info timestamp=2018-08-02T10:47:22.456883Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmivskk5, existing: false\n" level=info timestamp=2018-08-02T10:47:22.456968Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:47:22.457041Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmivskk5 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:47:22.457165Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmivskk5 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:47:40.541929Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmih4z46, existing: true\n" level=info timestamp=2018-08-02T10:47:40.542002Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:47:40.542024Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:47:40.542097Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:47:40.542755Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:47:40.542835Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmih4z46" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:40:56.072337Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.088571Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:40:56.090453Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmikrhvk, existing: true\n" level=info timestamp=2018-08-02T10:40:56.090479Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T10:40:56.091600Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:56.091667Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.091789Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:40:56.091892Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmikrhvk, existing: false\n" level=info timestamp=2018-08-02T10:40:56.091909Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:56.091936Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.091992Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:40:56.094620Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmikrhvk, existing: false\n" level=info timestamp=2018-08-02T10:40:56.094686Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:56.094756Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.094899Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmih4z46-82w4v Pod phase: Running level=info timestamp=2018-08-02T10:44:44.656959Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:44:44.657223Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:44:44.658500Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:44:54.665174Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:44:54.714761Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmih4z46" level=info timestamp=2018-08-02T10:44:54.717067Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:44:54.717222Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.464 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 when virt-handler crashes /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:309 should recover and continue management [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:310 Unexpected Warning event received: testvmih4z46,0fbbcdd5-9641-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ level=info timestamp=2018-08-02T10:44:41.915913Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmih4z46 kind=VirtualMachineInstance uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmih4z46-82w4v" level=info timestamp=2018-08-02T10:44:57.354044Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmih4z46 kind=VirtualMachineInstance uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmih4z46-82w4v" level=error timestamp=2018-08-02T10:44:57.370752Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmih4z46 kind=VirtualMachineInstance uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" • [SLOW TEST:86.529 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 when virt-handler is responsive /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:340 should indicate that a node is ready for vmis /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:341 ------------------------------ Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 10:47:34 http: TLS handshake error from 10.244.1.1:46010: EOF 2018/08/02 10:47:44 http: TLS handshake error from 10.244.1.1:46016: EOF 2018/08/02 10:47:54 http: TLS handshake error from 10.244.1.1:46022: EOF level=info timestamp=2018-08-02T10:47:57.835841Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:48:04 http: TLS handshake error from 10.244.1.1:46028: EOF 2018/08/02 10:48:14 http: TLS handshake error from 10.244.1.1:46034: EOF 2018/08/02 10:48:24 http: TLS handshake error from 10.244.1.1:46040: EOF level=info timestamp=2018-08-02T10:48:27.843151Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:48:34 http: TLS handshake error from 10.244.1.1:46046: EOF 2018/08/02 10:48:44 http: TLS handshake error from 10.244.1.1:46052: EOF 2018/08/02 10:48:54 http: TLS handshake error from 10.244.1.1:46058: EOF level=info timestamp=2018-08-02T10:48:57.831351Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:48:57.890765Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:49:04 http: TLS handshake error from 10.244.1.1:46064: EOF 2018/08/02 10:49:14 http: TLS handshake error from 10.244.1.1:46070: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running 2018/08/02 10:48:07 http: TLS handshake error from 10.244.0.1:44178: EOF 2018/08/02 10:48:17 http: TLS handshake error from 10.244.0.1:44202: EOF level=info timestamp=2018-08-02T10:48:20.584360Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:48:22.824359Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:48:27 http: TLS handshake error from 10.244.0.1:44226: EOF 2018/08/02 10:48:37 http: TLS handshake error from 10.244.0.1:44250: EOF 2018/08/02 10:48:47 http: TLS handshake error from 10.244.0.1:44274: EOF level=info timestamp=2018-08-02T10:48:50.614816Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:48:52.851131Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:48:57 http: TLS handshake error from 10.244.0.1:44298: EOF level=info timestamp=2018-08-02T10:49:03.351354Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:49:03.352143Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:49:07 http: TLS handshake error from 10.244.0.1:44322: EOF 2018/08/02 10:49:17 http: TLS handshake error from 10.244.0.1:44346: EOF level=info timestamp=2018-08-02T10:49:20.650314Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:40:40.135761Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:40:40.170819Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikrhvk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikrhvk" level=info timestamp=2018-08-02T10:40:40.183024Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikrhvk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikrhvk" level=info timestamp=2018-08-02T10:40:55.879031Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi72x5h kind= uid=896fa102-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:40:55.879146Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi72x5h kind= uid=896fa102-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:41:40.728004Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:41:40.729385Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:41:40.774915Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivskk5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" level=info timestamp=2018-08-02T10:41:40.816951Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivskk5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" level=info timestamp=2018-08-02T10:44:41.195194Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:44:41.196425Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:44:41.236662Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmih4z46\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmih4z46" level=info timestamp=2018-08-02T10:49:08.032752Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:49:08.034026Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:49:08.078297Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmip9vg7\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmip9vg7" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:49:22.034454Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:49:22.034917Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:49:22.035001Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmip9vg7" level=info timestamp=2018-08-02T10:49:22.055192Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: true\n" level=info timestamp=2018-08-02T10:49:22.055287Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:49:22.055318Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:49:22.055396Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:49:22.056153Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:49:22.056263Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmip9vg7" level=info timestamp=2018-08-02T10:49:22.096534Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: true\n" level=info timestamp=2018-08-02T10:49:22.096654Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:49:22.096684Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:49:22.096773Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:49:22.097306Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:49:22.097410Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmip9vg7" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:40:56.072337Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.088571Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:40:56.090453Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmikrhvk, existing: true\n" level=info timestamp=2018-08-02T10:40:56.090479Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T10:40:56.091600Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:56.091667Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.091789Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:40:56.091892Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmikrhvk, existing: false\n" level=info timestamp=2018-08-02T10:40:56.091909Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:56.091936Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.091992Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:40:56.094620Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmikrhvk, existing: false\n" level=info timestamp=2018-08-02T10:40:56.094686Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:56.094756Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.094899Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmip9vg7-qnvlr Pod phase: Running level=info timestamp=2018-08-02T10:49:11.418926Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:49:11.419238Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:49:11.421466Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:49:21.427826Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:49:21.452292Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmip9vg7" level=info timestamp=2018-08-02T10:49:21.453945Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:49:21.454145Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 10:50:24 http: TLS handshake error from 10.244.1.1:46112: EOF level=info timestamp=2018-08-02T10:50:27.866452Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:50:34 http: TLS handshake error from 10.244.1.1:46118: EOF 2018/08/02 10:50:44 http: TLS handshake error from 10.244.1.1:46124: EOF 2018/08/02 10:50:54 http: TLS handshake error from 10.244.1.1:46130: EOF level=info timestamp=2018-08-02T10:50:57.830533Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:51:04 http: TLS handshake error from 10.244.1.1:46136: EOF 2018/08/02 10:51:14 http: TLS handshake error from 10.244.1.1:46142: EOF 2018/08/02 10:51:24 http: TLS handshake error from 10.244.1.1:46148: EOF level=info timestamp=2018-08-02T10:51:27.861992Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:51:34 http: TLS handshake error from 10.244.1.1:46154: EOF 2018/08/02 10:51:44 http: TLS handshake error from 10.244.1.1:46160: EOF 2018/08/02 10:51:54 http: TLS handshake error from 10.244.1.1:46166: EOF level=info timestamp=2018-08-02T10:51:57.861272Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:52:04 http: TLS handshake error from 10.244.1.1:46172: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T10:50:52.948934Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:50:57 http: TLS handshake error from 10.244.0.1:44586: EOF 2018/08/02 10:51:07 http: TLS handshake error from 10.244.0.1:44610: EOF 2018/08/02 10:51:17 http: TLS handshake error from 10.244.0.1:44634: EOF level=info timestamp=2018-08-02T10:51:20.767342Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:51:22.972415Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:51:27 http: TLS handshake error from 10.244.0.1:44658: EOF 2018/08/02 10:51:37 http: TLS handshake error from 10.244.0.1:44682: EOF 2018/08/02 10:51:47 http: TLS handshake error from 10.244.0.1:44706: EOF level=info timestamp=2018-08-02T10:51:50.790784Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:51:53.005259Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:51:57 http: TLS handshake error from 10.244.0.1:44730: EOF level=info timestamp=2018-08-02T10:52:03.355814Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:52:03.356587Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:52:07 http: TLS handshake error from 10.244.0.1:44754: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:40:40.135761Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:40:40.170819Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikrhvk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikrhvk" level=info timestamp=2018-08-02T10:40:40.183024Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikrhvk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikrhvk" level=info timestamp=2018-08-02T10:40:55.879031Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi72x5h kind= uid=896fa102-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:40:55.879146Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi72x5h kind= uid=896fa102-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:41:40.728004Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:41:40.729385Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:41:40.774915Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivskk5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" level=info timestamp=2018-08-02T10:41:40.816951Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivskk5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" level=info timestamp=2018-08-02T10:44:41.195194Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:44:41.196425Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:44:41.236662Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmih4z46\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmih4z46" level=info timestamp=2018-08-02T10:49:08.032752Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:49:08.034026Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:49:08.078297Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmip9vg7\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmip9vg7" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:50:24.383284Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:50:24.383357Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmih4z46 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:50:24.383435Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmih4z46 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:50:43.949966Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: true\n" level=info timestamp=2018-08-02T10:50:43.950082Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:50:43.950114Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:50:43.950202Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:50:43.952107Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:50:43.952292Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmip9vg7" level=info timestamp=2018-08-02T10:52:05.872519Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: true\n" level=info timestamp=2018-08-02T10:52:05.872627Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:52:05.872659Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:05.872754Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:52:05.873325Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:52:05.873417Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmip9vg7" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:40:56.072337Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.088571Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:40:56.090453Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmikrhvk, existing: true\n" level=info timestamp=2018-08-02T10:40:56.090479Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T10:40:56.091600Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:56.091667Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.091789Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind= uid=800d062d-9640-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:40:56.091892Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmikrhvk, existing: false\n" level=info timestamp=2018-08-02T10:40:56.091909Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:56.091936Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.091992Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:40:56.094620Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmikrhvk, existing: false\n" level=info timestamp=2018-08-02T10:40:56.094686Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:40:56.094756Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:40:56.094899Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmikrhvk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmip9vg7-qnvlr Pod phase: Running level=info timestamp=2018-08-02T10:49:11.418926Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:49:11.419238Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:49:11.421466Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:49:21.427826Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:49:21.452292Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmip9vg7" level=info timestamp=2018-08-02T10:49:21.453945Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:49:21.454145Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [180.311 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 when virt-handler is not responsive /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:371 the node controller should react [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:410 Unexpected Warning event received: testvmip9vg7,aec7e8fd-9641-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ level=info timestamp=2018-08-02T10:49:08.761830Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmip9vg7-qnvlr" level=info timestamp=2018-08-02T10:49:22.684229Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmip9vg7-qnvlr" level=error timestamp=2018-08-02T10:49:22.703703Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid=aec7e8fd-9641-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running level=info timestamp=2018-08-02T10:50:27.866452Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:50:34 http: TLS handshake error from 10.244.1.1:46118: EOF 2018/08/02 10:50:44 http: TLS handshake error from 10.244.1.1:46124: EOF 2018/08/02 10:50:54 http: TLS handshake error from 10.244.1.1:46130: EOF level=info timestamp=2018-08-02T10:50:57.830533Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:51:04 http: TLS handshake error from 10.244.1.1:46136: EOF 2018/08/02 10:51:14 http: TLS handshake error from 10.244.1.1:46142: EOF 2018/08/02 10:51:24 http: TLS handshake error from 10.244.1.1:46148: EOF level=info timestamp=2018-08-02T10:51:27.861992Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:51:34 http: TLS handshake error from 10.244.1.1:46154: EOF 2018/08/02 10:51:44 http: TLS handshake error from 10.244.1.1:46160: EOF 2018/08/02 10:51:54 http: TLS handshake error from 10.244.1.1:46166: EOF level=info timestamp=2018-08-02T10:51:57.861272Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:52:04 http: TLS handshake error from 10.244.1.1:46172: EOF 2018/08/02 10:52:14 http: TLS handshake error from 10.244.1.1:46178: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running 2018/08/02 10:51:17 http: TLS handshake error from 10.244.0.1:44634: EOF level=info timestamp=2018-08-02T10:51:20.767342Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:51:22.972415Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:51:27 http: TLS handshake error from 10.244.0.1:44658: EOF 2018/08/02 10:51:37 http: TLS handshake error from 10.244.0.1:44682: EOF 2018/08/02 10:51:47 http: TLS handshake error from 10.244.0.1:44706: EOF level=info timestamp=2018-08-02T10:51:50.790784Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:51:53.005259Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:51:57 http: TLS handshake error from 10.244.0.1:44730: EOF level=info timestamp=2018-08-02T10:52:03.355814Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:52:03.356587Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:52:07 http: TLS handshake error from 10.244.0.1:44754: EOF 2018/08/02 10:52:17 http: TLS handshake error from 10.244.0.1:44778: EOF level=info timestamp=2018-08-02T10:52:20.817827Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:52:23.034152Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:40:40.183024Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikrhvk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikrhvk" level=info timestamp=2018-08-02T10:40:55.879031Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi72x5h kind= uid=896fa102-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:40:55.879146Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi72x5h kind= uid=896fa102-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:41:40.728004Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:41:40.729385Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:41:40.774915Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivskk5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" level=info timestamp=2018-08-02T10:41:40.816951Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivskk5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" level=info timestamp=2018-08-02T10:44:41.195194Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:44:41.196425Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:44:41.236662Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmih4z46\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmih4z46" level=info timestamp=2018-08-02T10:49:08.032752Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:49:08.034026Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:49:08.078297Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmip9vg7\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmip9vg7" level=info timestamp=2018-08-02T10:52:08.518821Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:52:08.520036Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:52:05.873417Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmip9vg7" level=info timestamp=2018-08-02T10:52:08.297519Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: true\n" level=info timestamp=2018-08-02T10:52:08.297637Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:52:08.297661Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:08.297742Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.304214Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:52:08.304778Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: true\n" level=info timestamp=2018-08-02T10:52:08.304806Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T10:52:08.304829Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:08.304871Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.304933Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:52:08.325266Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: false\n" level=info timestamp=2018-08-02T10:52:08.325343Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:08.325425Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.325501Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:52:23.520712Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:52:23.525466Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6620/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:52:23.529624Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6620/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmirhmnw" level=info timestamp=2018-08-02T10:52:23.550405Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmirhmnw, existing: true\n" level=info timestamp=2018-08-02T10:52:23.550565Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:52:23.550597Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:23.550691Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:52:23.551339Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6636/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:52:23.551447Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6636/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmirhmnw" level=info timestamp=2018-08-02T10:52:23.598388Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmirhmnw, existing: true\n" level=info timestamp=2018-08-02T10:52:23.598478Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:52:23.598531Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:23.598617Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:52:23.599866Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:52:23.600173Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmirhmnw" Pod name: virt-launcher-testvmip9vg7-qnvlr Pod phase: Failed level=info timestamp=2018-08-02T10:49:11.418926Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:49:11.419238Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:49:11.421466Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:49:21.427826Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:49:21.452292Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmip9vg7" level=info timestamp=2018-08-02T10:49:21.453945Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:49:21.454145Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" caught signal virt-launcher exited with code 127 Pod name: virt-launcher-testvmirhmnw-rtxfs Pod phase: Running level=info timestamp=2018-08-02T10:52:12.920809Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:52:12.921105Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:52:12.925883Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:52:22.930976Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:52:22.951674Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmirhmnw" level=info timestamp=2018-08-02T10:52:22.954155Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:52:22.954583Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 10:53:24 http: TLS handshake error from 10.244.1.1:46220: EOF level=info timestamp=2018-08-02T10:53:27.861322Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:53:34 http: TLS handshake error from 10.244.1.1:46226: EOF 2018/08/02 10:53:44 http: TLS handshake error from 10.244.1.1:46232: EOF 2018/08/02 10:53:54 http: TLS handshake error from 10.244.1.1:46238: EOF level=info timestamp=2018-08-02T10:53:57.895765Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:54:04 http: TLS handshake error from 10.244.1.1:46244: EOF 2018/08/02 10:54:14 http: TLS handshake error from 10.244.1.1:46250: EOF 2018/08/02 10:54:24 http: TLS handshake error from 10.244.1.1:46256: EOF level=info timestamp=2018-08-02T10:54:27.850951Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:54:34 http: TLS handshake error from 10.244.1.1:46262: EOF 2018/08/02 10:54:44 http: TLS handshake error from 10.244.1.1:46268: EOF 2018/08/02 10:54:54 http: TLS handshake error from 10.244.1.1:46274: EOF level=info timestamp=2018-08-02T10:54:57.859844Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:55:04 http: TLS handshake error from 10.244.1.1:46280: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T10:54:03.449208Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:54:03.450532Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:54:07 http: TLS handshake error from 10.244.0.1:45042: EOF 2018/08/02 10:54:17 http: TLS handshake error from 10.244.0.1:45066: EOF level=info timestamp=2018-08-02T10:54:20.942753Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:54:23.161383Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:54:27 http: TLS handshake error from 10.244.0.1:45090: EOF 2018/08/02 10:54:37 http: TLS handshake error from 10.244.0.1:45114: EOF 2018/08/02 10:54:47 http: TLS handshake error from 10.244.0.1:45138: EOF level=info timestamp=2018-08-02T10:54:50.971009Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:54:53.191751Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:54:57 http: TLS handshake error from 10.244.0.1:45162: EOF level=info timestamp=2018-08-02T10:55:03.454617Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:55:03.456200Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:55:07 http: TLS handshake error from 10.244.0.1:45186: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:40:40.183024Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmikrhvk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmikrhvk" level=info timestamp=2018-08-02T10:40:55.879031Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi72x5h kind= uid=896fa102-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:40:55.879146Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi72x5h kind= uid=896fa102-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:41:40.728004Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:41:40.729385Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivskk5 kind= uid=a42ad594-9640-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:41:40.774915Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivskk5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" level=info timestamp=2018-08-02T10:41:40.816951Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivskk5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivskk5" level=info timestamp=2018-08-02T10:44:41.195194Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:44:41.196425Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmih4z46 kind= uid=0fbbcdd5-9641-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:44:41.236662Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmih4z46\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmih4z46" level=info timestamp=2018-08-02T10:49:08.032752Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:49:08.034026Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:49:08.078297Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmip9vg7\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmip9vg7" level=info timestamp=2018-08-02T10:52:08.518821Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:52:08.520036Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:52:08.297742Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.304214Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:52:08.304778Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: true\n" level=info timestamp=2018-08-02T10:52:08.304806Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T10:52:08.304829Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:08.304871Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.304933Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:52:08.325266Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: false\n" level=info timestamp=2018-08-02T10:52:08.325343Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:08.325425Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.325501Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:54:49.713701Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: false\n" level=info timestamp=2018-08-02T10:54:49.713783Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:54:49.713845Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:54:49.713919Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:53:04.502709Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:53:04.505024Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:53:04.505153Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmirhmnw" level=info timestamp=2018-08-02T10:53:45.465549Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmirhmnw, existing: true\n" level=info timestamp=2018-08-02T10:53:45.465639Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:53:45.465672Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:53:45.465798Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:53:45.466657Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:53:45.466777Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmirhmnw" level=info timestamp=2018-08-02T10:55:07.387051Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmirhmnw, existing: true\n" level=info timestamp=2018-08-02T10:55:07.387176Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:55:07.387208Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:55:07.387302Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:55:07.388347Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:55:07.388454Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmirhmnw" Pod name: virt-launcher-testvmirhmnw-rtxfs Pod phase: Running level=info timestamp=2018-08-02T10:52:12.920809Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:52:12.921105Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:52:12.925883Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:52:22.930976Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:52:22.951674Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmirhmnw" level=info timestamp=2018-08-02T10:52:22.954155Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:52:22.954583Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.560 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with node tainted /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:463 the vmi with tolerations should be scheduled [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:485 Unexpected Warning event received: testvmirhmnw,1a5b2cca-9642-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6627/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ level=info timestamp=2018-08-02T10:52:09.313304Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmirhmnw kind=VirtualMachineInstance uid=1a5b2cca-9642-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmirhmnw-rtxfs" level=info timestamp=2018-08-02T10:52:23.768672Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmirhmnw kind=VirtualMachineInstance uid=1a5b2cca-9642-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmirhmnw-rtxfs" level=error timestamp=2018-08-02T10:52:23.794190Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmirhmnw kind=VirtualMachineInstance uid=1a5b2cca-9642-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6627/ns/mnt" • Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 10:53:34 http: TLS handshake error from 10.244.1.1:46226: EOF 2018/08/02 10:53:44 http: TLS handshake error from 10.244.1.1:46232: EOF 2018/08/02 10:53:54 http: TLS handshake error from 10.244.1.1:46238: EOF level=info timestamp=2018-08-02T10:53:57.895765Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:54:04 http: TLS handshake error from 10.244.1.1:46244: EOF 2018/08/02 10:54:14 http: TLS handshake error from 10.244.1.1:46250: EOF 2018/08/02 10:54:24 http: TLS handshake error from 10.244.1.1:46256: EOF level=info timestamp=2018-08-02T10:54:27.850951Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:54:34 http: TLS handshake error from 10.244.1.1:46262: EOF 2018/08/02 10:54:44 http: TLS handshake error from 10.244.1.1:46268: EOF 2018/08/02 10:54:54 http: TLS handshake error from 10.244.1.1:46274: EOF level=info timestamp=2018-08-02T10:54:57.859844Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:55:04 http: TLS handshake error from 10.244.1.1:46280: EOF 2018/08/02 10:55:14 http: TLS handshake error from 10.244.1.1:46286: EOF 2018/08/02 10:55:24 http: TLS handshake error from 10.244.1.1:46292: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running 2018/08/02 10:54:17 http: TLS handshake error from 10.244.0.1:45066: EOF level=info timestamp=2018-08-02T10:54:20.942753Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:54:23.161383Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:54:27 http: TLS handshake error from 10.244.0.1:45090: EOF 2018/08/02 10:54:37 http: TLS handshake error from 10.244.0.1:45114: EOF 2018/08/02 10:54:47 http: TLS handshake error from 10.244.0.1:45138: EOF level=info timestamp=2018-08-02T10:54:50.971009Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:54:53.191751Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:54:57 http: TLS handshake error from 10.244.0.1:45162: EOF level=info timestamp=2018-08-02T10:55:03.454617Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:55:03.456200Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:55:07 http: TLS handshake error from 10.244.0.1:45186: EOF 2018/08/02 10:55:17 http: TLS handshake error from 10.244.0.1:45210: EOF level=info timestamp=2018-08-02T10:55:20.998721Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:55:23.221583Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:49:08.032752Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:49:08.034026Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:49:08.078297Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmip9vg7\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmip9vg7" level=info timestamp=2018-08-02T10:52:08.518821Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:52:08.520036Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:55:09.087167Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9fv2f kind= uid=85fb00f8-9642-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:55:09.087351Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9fv2f kind= uid=85fb00f8-9642-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:55:09.172781Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9fv2f\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9fv2f" level=info timestamp=2018-08-02T10:55:09.264719Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9fv2f\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9fv2f" level=info timestamp=2018-08-02T10:55:10.210159Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9fv2f\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi9fv2f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 85fb00f8-9642-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9fv2f" level=info timestamp=2018-08-02T10:55:10.217051Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9fv2f\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi9fv2f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 85fb00f8-9642-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9fv2f" level=info timestamp=2018-08-02T10:55:10.398330Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmif8zkl kind= uid=86c50498-9642-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:55:10.398488Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmif8zkl kind= uid=86c50498-9642-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:55:10.461865Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmif8zkl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmif8zkl" level=info timestamp=2018-08-02T10:55:10.475154Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmif8zkl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmif8zkl" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:52:08.297742Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.304214Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:52:08.304778Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: true\n" level=info timestamp=2018-08-02T10:52:08.304806Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T10:52:08.304829Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:08.304871Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.304933Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:52:08.325266Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: false\n" level=info timestamp=2018-08-02T10:52:08.325343Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:08.325425Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.325501Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:54:49.713701Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: false\n" level=info timestamp=2018-08-02T10:54:49.713783Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:54:49.713845Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:54:49.713919Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:55:25.637303Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmif8zkl kind= uid=86c50498-9642-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:55:25.637856Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmif8zkl kind= uid=86c50498-9642-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6627/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:55:25.637930Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6627/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmif8zkl" level=info timestamp=2018-08-02T10:55:25.658156Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmif8zkl, existing: true\n" level=info timestamp=2018-08-02T10:55:25.658241Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:55:25.658269Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:55:25.658350Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmif8zkl kind= uid=86c50498-9642-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:55:25.658887Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmif8zkl kind= uid=86c50498-9642-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:55:25.658968Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmif8zkl" level=info timestamp=2018-08-02T10:55:25.699373Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmif8zkl, existing: true\n" level=info timestamp=2018-08-02T10:55:25.699446Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:55:25.699471Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:55:25.700299Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmif8zkl kind= uid=86c50498-9642-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:55:25.701027Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmif8zkl kind= uid=86c50498-9642-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:55:25.701121Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmif8zkl" Pod name: virt-launcher-testvmif8zkl-sc8x2 Pod phase: Running level=info timestamp=2018-08-02T10:55:14.417868Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:55:14.418480Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:55:14.420871Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:55:24.428396Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:55:24.451373Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmif8zkl" level=info timestamp=2018-08-02T10:55:24.453685Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:55:24.453858Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmirhmnw-rtxfs Pod phase: Failed level=info timestamp=2018-08-02T10:52:12.920809Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:52:12.921105Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:52:12.925883Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:52:22.930976Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:52:22.951674Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmirhmnw" level=info timestamp=2018-08-02T10:52:22.954155Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:52:22.954583Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" caught signal virt-launcher exited with code 127 Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 10:56:24 http: TLS handshake error from 10.244.1.1:46328: EOF level=info timestamp=2018-08-02T10:56:27.849923Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:56:34 http: TLS handshake error from 10.244.1.1:46334: EOF 2018/08/02 10:56:44 http: TLS handshake error from 10.244.1.1:46340: EOF 2018/08/02 10:56:54 http: TLS handshake error from 10.244.1.1:46346: EOF level=info timestamp=2018-08-02T10:56:57.858271Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:57:04 http: TLS handshake error from 10.244.1.1:46352: EOF 2018/08/02 10:57:14 http: TLS handshake error from 10.244.1.1:46358: EOF 2018/08/02 10:57:24 http: TLS handshake error from 10.244.1.1:46364: EOF level=info timestamp=2018-08-02T10:57:27.855290Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:57:34 http: TLS handshake error from 10.244.1.1:46370: EOF 2018/08/02 10:57:44 http: TLS handshake error from 10.244.1.1:46376: EOF 2018/08/02 10:57:54 http: TLS handshake error from 10.244.1.1:46382: EOF level=info timestamp=2018-08-02T10:57:57.857235Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:58:04 http: TLS handshake error from 10.244.1.1:46388: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T10:56:53.305773Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:56:57 http: TLS handshake error from 10.244.0.1:45450: EOF level=info timestamp=2018-08-02T10:57:03.458929Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T10:57:03.459728Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:57:07 http: TLS handshake error from 10.244.0.1:45474: EOF 2018/08/02 10:57:17 http: TLS handshake error from 10.244.0.1:45498: EOF level=info timestamp=2018-08-02T10:57:21.122090Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:57:23.330684Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:57:27 http: TLS handshake error from 10.244.0.1:45522: EOF 2018/08/02 10:57:37 http: TLS handshake error from 10.244.0.1:45546: EOF 2018/08/02 10:57:47 http: TLS handshake error from 10.244.0.1:45570: EOF level=info timestamp=2018-08-02T10:57:51.146881Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:57:53.359174Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:57:57 http: TLS handshake error from 10.244.0.1:45594: EOF 2018/08/02 10:58:07 http: TLS handshake error from 10.244.0.1:45618: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:49:08.032752Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:49:08.034026Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:49:08.078297Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmip9vg7\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmip9vg7" level=info timestamp=2018-08-02T10:52:08.518821Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:52:08.520036Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:55:09.087167Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9fv2f kind= uid=85fb00f8-9642-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:55:09.087351Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9fv2f kind= uid=85fb00f8-9642-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:55:09.172781Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9fv2f\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9fv2f" level=info timestamp=2018-08-02T10:55:09.264719Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9fv2f\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9fv2f" level=info timestamp=2018-08-02T10:55:10.210159Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9fv2f\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi9fv2f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 85fb00f8-9642-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9fv2f" level=info timestamp=2018-08-02T10:55:10.217051Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9fv2f\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi9fv2f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 85fb00f8-9642-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9fv2f" level=info timestamp=2018-08-02T10:55:10.398330Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmif8zkl kind= uid=86c50498-9642-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:55:10.398488Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmif8zkl kind= uid=86c50498-9642-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:55:10.461865Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmif8zkl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmif8zkl" level=info timestamp=2018-08-02T10:55:10.475154Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmif8zkl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmif8zkl" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:52:08.297742Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.304214Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:52:08.304778Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: true\n" level=info timestamp=2018-08-02T10:52:08.304806Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T10:52:08.304829Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:08.304871Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.304933Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:52:08.325266Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: false\n" level=info timestamp=2018-08-02T10:52:08.325343Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:08.325425Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.325501Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:54:49.713701Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: false\n" level=info timestamp=2018-08-02T10:54:49.713783Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:54:49.713845Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:54:49.713919Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:56:47.557669Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:56:47.557699Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:56:47.557806Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmif8zkl kind= uid=86c50498-9642-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:56:47.559296Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmif8zkl kind= uid=86c50498-9642-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6627/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:56:47.559385Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6627/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmif8zkl" level=info timestamp=2018-08-02T10:57:51.228801Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmirhmnw, existing: false\n" level=info timestamp=2018-08-02T10:57:51.228886Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:57:51.228945Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmirhmnw kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:57:51.229016Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmirhmnw kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:58:09.479656Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmif8zkl, existing: true\n" level=info timestamp=2018-08-02T10:58:09.479765Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:58:09.479796Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:58:09.479879Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmif8zkl kind= uid=86c50498-9642-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:58:09.482272Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmif8zkl kind= uid=86c50498-9642-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6627/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:58:09.482372Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6627/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmif8zkl" Pod name: virt-launcher-testvmif8zkl-sc8x2 Pod phase: Running level=info timestamp=2018-08-02T10:55:14.417868Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T10:55:14.418480Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T10:55:14.420871Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T10:55:24.428396Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T10:55:24.451373Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmif8zkl" level=info timestamp=2018-08-02T10:55:24.453685Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T10:55:24.453858Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure [180.475 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with non default namespace /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:535 should log libvirt start and stop lifecycle events of the domain /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 kubevirt-test-default [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Unexpected Warning event received: testvmif8zkl,86c50498-9642-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6620/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ STEP: Creating a VirtualMachineInstance with different namespace level=info timestamp=2018-08-02T10:55:11.150636Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmif8zkl kind=VirtualMachineInstance uid=86c50498-9642-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmif8zkl-sc8x2" level=info timestamp=2018-08-02T10:55:25.897751Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmif8zkl kind=VirtualMachineInstance uid=86c50498-9642-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmif8zkl-sc8x2" level=error timestamp=2018-08-02T10:55:25.914071Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmif8zkl kind=VirtualMachineInstance uid=86c50498-9642-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6620/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running level=info timestamp=2018-08-02T10:56:27.849923Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:56:34 http: TLS handshake error from 10.244.1.1:46334: EOF 2018/08/02 10:56:44 http: TLS handshake error from 10.244.1.1:46340: EOF 2018/08/02 10:56:54 http: TLS handshake error from 10.244.1.1:46346: EOF level=info timestamp=2018-08-02T10:56:57.858271Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:57:04 http: TLS handshake error from 10.244.1.1:46352: EOF 2018/08/02 10:57:14 http: TLS handshake error from 10.244.1.1:46358: EOF 2018/08/02 10:57:24 http: TLS handshake error from 10.244.1.1:46364: EOF level=info timestamp=2018-08-02T10:57:27.855290Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:57:34 http: TLS handshake error from 10.244.1.1:46370: EOF 2018/08/02 10:57:44 http: TLS handshake error from 10.244.1.1:46376: EOF 2018/08/02 10:57:54 http: TLS handshake error from 10.244.1.1:46382: EOF level=info timestamp=2018-08-02T10:57:57.857235Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:58:04 http: TLS handshake error from 10.244.1.1:46388: EOF 2018/08/02 10:58:14 http: TLS handshake error from 10.244.1.1:46394: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T10:57:03.459728Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:57:07 http: TLS handshake error from 10.244.0.1:45474: EOF 2018/08/02 10:57:17 http: TLS handshake error from 10.244.0.1:45498: EOF level=info timestamp=2018-08-02T10:57:21.122090Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:57:23.330684Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:57:27 http: TLS handshake error from 10.244.0.1:45522: EOF 2018/08/02 10:57:37 http: TLS handshake error from 10.244.0.1:45546: EOF 2018/08/02 10:57:47 http: TLS handshake error from 10.244.0.1:45570: EOF level=info timestamp=2018-08-02T10:57:51.146881Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:57:53.359174Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:57:57 http: TLS handshake error from 10.244.0.1:45594: EOF 2018/08/02 10:58:07 http: TLS handshake error from 10.244.0.1:45618: EOF 2018/08/02 10:58:17 http: TLS handshake error from 10.244.0.1:45642: EOF level=info timestamp=2018-08-02T10:58:21.185386Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T10:58:23.389044Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:52:08.520036Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:55:09.087167Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9fv2f kind= uid=85fb00f8-9642-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:55:09.087351Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9fv2f kind= uid=85fb00f8-9642-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:55:09.172781Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9fv2f\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9fv2f" level=info timestamp=2018-08-02T10:55:09.264719Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9fv2f\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9fv2f" level=info timestamp=2018-08-02T10:55:10.210159Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9fv2f\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi9fv2f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 85fb00f8-9642-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9fv2f" level=info timestamp=2018-08-02T10:55:10.217051Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9fv2f\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi9fv2f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 85fb00f8-9642-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9fv2f" level=info timestamp=2018-08-02T10:55:10.398330Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmif8zkl kind= uid=86c50498-9642-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:55:10.398488Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmif8zkl kind= uid=86c50498-9642-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:55:10.461865Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmif8zkl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmif8zkl" level=info timestamp=2018-08-02T10:55:10.475154Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmif8zkl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmif8zkl" level=info timestamp=2018-08-02T10:58:10.876092Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-alternative name=testvmilqmpl kind= uid=f2572fdb-9642-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:58:10.876241Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-alternative name=testvmilqmpl kind= uid=f2572fdb-9642-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:58:10.933774Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilqmpl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-alternative/testvmilqmpl" level=info timestamp=2018-08-02T10:58:10.952798Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilqmpl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-alternative/testvmilqmpl" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:52:08.297742Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.304214Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:52:08.304778Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: true\n" level=info timestamp=2018-08-02T10:52:08.304806Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T10:52:08.304829Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:08.304871Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.304933Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:52:08.325266Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: false\n" level=info timestamp=2018-08-02T10:52:08.325343Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:08.325425Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.325501Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:54:49.713701Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: false\n" level=info timestamp=2018-08-02T10:54:49.713783Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:54:49.713845Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:54:49.713919Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:58:25.034960Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-alternative name=testvmilqmpl kind= uid=f2572fdb-9642-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:58:25.035368Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-alternative name=testvmilqmpl kind= uid=f2572fdb-9642-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:58:25.035462Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-alternative/testvmilqmpl" level=info timestamp=2018-08-02T10:58:25.059722Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmilqmpl, existing: true\n" level=info timestamp=2018-08-02T10:58:25.059798Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:58:25.059824Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:58:25.059935Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-alternative name=testvmilqmpl kind= uid=f2572fdb-9642-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:58:25.060460Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-alternative name=testvmilqmpl kind= uid=f2572fdb-9642-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:58:25.060667Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-alternative/testvmilqmpl" level=info timestamp=2018-08-02T10:58:25.100925Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmilqmpl, existing: true\n" level=info timestamp=2018-08-02T10:58:25.101021Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:58:25.101046Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:58:25.101125Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-alternative name=testvmilqmpl kind= uid=f2572fdb-9642-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:58:25.108018Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-alternative name=testvmilqmpl kind= uid=f2572fdb-9642-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:58:25.108141Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-alternative/testvmilqmpl" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 10:59:24 http: TLS handshake error from 10.244.1.1:46436: EOF level=info timestamp=2018-08-02T10:59:27.862590Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 10:59:34 http: TLS handshake error from 10.244.1.1:46442: EOF 2018/08/02 10:59:44 http: TLS handshake error from 10.244.1.1:46448: EOF 2018/08/02 10:59:54 http: TLS handshake error from 10.244.1.1:46454: EOF level=info timestamp=2018-08-02T10:59:57.867966Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:00:04 http: TLS handshake error from 10.244.1.1:46460: EOF 2018/08/02 11:00:14 http: TLS handshake error from 10.244.1.1:46466: EOF 2018/08/02 11:00:24 http: TLS handshake error from 10.244.1.1:46472: EOF level=info timestamp=2018-08-02T11:00:27.842293Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:00:34 http: TLS handshake error from 10.244.1.1:46478: EOF 2018/08/02 11:00:44 http: TLS handshake error from 10.244.1.1:46484: EOF 2018/08/02 11:00:54 http: TLS handshake error from 10.244.1.1:46490: EOF level=info timestamp=2018-08-02T11:00:57.847595Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:01:04 http: TLS handshake error from 10.244.1.1:46496: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T10:59:53.479108Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 10:59:57 http: TLS handshake error from 10.244.0.1:45882: EOF level=info timestamp=2018-08-02T11:00:03.436565Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:00:03.437574Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:00:07 http: TLS handshake error from 10.244.0.1:45906: EOF 2018/08/02 11:00:17 http: TLS handshake error from 10.244.0.1:45930: EOF level=info timestamp=2018-08-02T11:00:21.324251Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:00:23.506012Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:00:27 http: TLS handshake error from 10.244.0.1:45954: EOF 2018/08/02 11:00:37 http: TLS handshake error from 10.244.0.1:45978: EOF 2018/08/02 11:00:47 http: TLS handshake error from 10.244.0.1:46002: EOF level=info timestamp=2018-08-02T11:00:51.350376Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:00:53.536173Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:00:57 http: TLS handshake error from 10.244.0.1:46026: EOF 2018/08/02 11:01:07 http: TLS handshake error from 10.244.0.1:46050: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:52:08.520036Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmirhmnw kind= uid=1a5b2cca-9642-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:55:09.087167Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9fv2f kind= uid=85fb00f8-9642-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:55:09.087351Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9fv2f kind= uid=85fb00f8-9642-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:55:09.172781Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9fv2f\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9fv2f" level=info timestamp=2018-08-02T10:55:09.264719Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9fv2f\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9fv2f" level=info timestamp=2018-08-02T10:55:10.210159Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9fv2f\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi9fv2f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 85fb00f8-9642-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9fv2f" level=info timestamp=2018-08-02T10:55:10.217051Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9fv2f\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmi9fv2f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 85fb00f8-9642-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9fv2f" level=info timestamp=2018-08-02T10:55:10.398330Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmif8zkl kind= uid=86c50498-9642-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:55:10.398488Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmif8zkl kind= uid=86c50498-9642-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:55:10.461865Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmif8zkl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmif8zkl" level=info timestamp=2018-08-02T10:55:10.475154Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmif8zkl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmif8zkl" level=info timestamp=2018-08-02T10:58:10.876092Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-alternative name=testvmilqmpl kind= uid=f2572fdb-9642-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T10:58:10.876241Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-alternative name=testvmilqmpl kind= uid=f2572fdb-9642-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:58:10.933774Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilqmpl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-alternative/testvmilqmpl" level=info timestamp=2018-08-02T10:58:10.952798Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilqmpl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-alternative/testvmilqmpl" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:52:08.297742Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.304214Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:52:08.304778Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: true\n" level=info timestamp=2018-08-02T10:52:08.304806Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T10:52:08.304829Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:08.304871Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.304933Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:52:08.325266Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: false\n" level=info timestamp=2018-08-02T10:52:08.325343Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:08.325425Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.325501Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:54:49.713701Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: false\n" level=info timestamp=2018-08-02T10:54:49.713783Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:54:49.713845Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:54:49.713919Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T10:59:46.963740Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T10:59:46.963764Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:59:46.963852Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-alternative name=testvmilqmpl kind= uid=f2572fdb-9642-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T10:59:46.965812Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-alternative name=testvmilqmpl kind= uid=f2572fdb-9642-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T10:59:46.965917Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-alternative/testvmilqmpl" level=info timestamp=2018-08-02T11:00:53.322617Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmif8zkl, existing: false\n" level=info timestamp=2018-08-02T11:00:53.322697Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:00:53.322779Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmif8zkl kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:00:53.322857Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmif8zkl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:01:08.886232Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmilqmpl, existing: true\n" level=info timestamp=2018-08-02T11:01:08.886954Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:01:08.887003Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:01:08.887417Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-alternative name=testvmilqmpl kind= uid=f2572fdb-9642-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:01:08.895750Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-alternative name=testvmilqmpl kind= uid=f2572fdb-9642-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:01:08.895938Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-alternative/testvmilqmpl" • Failure [180.355 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 with non default namespace /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:535 should log libvirt start and stop lifecycle events of the domain /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 kubevirt-test-alternative [It] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Unexpected Warning event received: testvmilqmpl,f2572fdb-9642-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6636/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ STEP: Creating a VirtualMachineInstance with different namespace level=info timestamp=2018-08-02T10:58:11.601975Z pos=utils.go:245 component=tests namespace=kubevirt-test-alternative name=testvmilqmpl kind=VirtualMachineInstance uid=f2572fdb-9642-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmilqmpl-z4v84" level=info timestamp=2018-08-02T10:58:25.297216Z pos=utils.go:245 component=tests namespace=kubevirt-test-alternative name=testvmilqmpl kind=VirtualMachineInstance uid=f2572fdb-9642-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmilqmpl-z4v84" level=error timestamp=2018-08-02T10:58:25.312050Z pos=utils.go:243 component=tests namespace=kubevirt-test-alternative name=testvmilqmpl kind=VirtualMachineInstance uid=f2572fdb-9642-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6636/ns/mnt" S [SKIPPING] in Spec Setup (BeforeEach) [0.232 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 VirtualMachineInstance Emulation Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:592 should enable emulation in virt-launcher [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:604 Software emulation is not enabled on this cluster /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:600 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.062 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 VirtualMachineInstance Emulation Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:592 should be reflected in domain XML [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:641 Software emulation is not enabled on this cluster /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:600 ------------------------------ S [SKIPPING] in Spec Setup (BeforeEach) [0.064 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Creating a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:74 VirtualMachineInstance Emulation Mode /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:592 should request a TUN device but not KVM [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:685 Software emulation is not enabled on this cluster /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:600 ------------------------------ •••• Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 10:59:44 http: TLS handshake error from 10.244.1.1:46448: EOF 2018/08/02 10:59:54 http: TLS handshake error from 10.244.1.1:46454: EOF level=info timestamp=2018-08-02T10:59:57.867966Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:00:04 http: TLS handshake error from 10.244.1.1:46460: EOF 2018/08/02 11:00:14 http: TLS handshake error from 10.244.1.1:46466: EOF 2018/08/02 11:00:24 http: TLS handshake error from 10.244.1.1:46472: EOF level=info timestamp=2018-08-02T11:00:27.842293Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:00:34 http: TLS handshake error from 10.244.1.1:46478: EOF 2018/08/02 11:00:44 http: TLS handshake error from 10.244.1.1:46484: EOF 2018/08/02 11:00:54 http: TLS handshake error from 10.244.1.1:46490: EOF level=info timestamp=2018-08-02T11:00:57.847595Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:01:04 http: TLS handshake error from 10.244.1.1:46496: EOF 2018/08/02 11:01:14 http: TLS handshake error from 10.244.1.1:46502: EOF 2018/08/02 11:01:24 http: TLS handshake error from 10.244.1.1:46508: EOF level=info timestamp=2018-08-02T11:01:27.843844Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-api-7d79764579-qbwqf Pod phase: Running 2018/08/02 11:00:07 http: TLS handshake error from 10.244.0.1:45906: EOF 2018/08/02 11:00:17 http: TLS handshake error from 10.244.0.1:45930: EOF level=info timestamp=2018-08-02T11:00:21.324251Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:00:23.506012Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:00:27 http: TLS handshake error from 10.244.0.1:45954: EOF 2018/08/02 11:00:37 http: TLS handshake error from 10.244.0.1:45978: EOF 2018/08/02 11:00:47 http: TLS handshake error from 10.244.0.1:46002: EOF level=info timestamp=2018-08-02T11:00:51.350376Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:00:53.536173Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:00:57 http: TLS handshake error from 10.244.0.1:46026: EOF 2018/08/02 11:01:07 http: TLS handshake error from 10.244.0.1:46050: EOF 2018/08/02 11:01:17 http: TLS handshake error from 10.244.0.1:46074: EOF level=info timestamp=2018-08-02T11:01:21.409841Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:01:23.561080Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:01:27 http: TLS handshake error from 10.244.0.1:46098: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:58:10.876241Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-alternative name=testvmilqmpl kind= uid=f2572fdb-9642-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:58:10.933774Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilqmpl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-alternative/testvmilqmpl" level=info timestamp=2018-08-02T10:58:10.952798Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilqmpl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-alternative/testvmilqmpl" level=info timestamp=2018-08-02T11:01:11.398895Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid5fjm kind= uid=5df12789-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:11.400101Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid5fjm kind= uid=5df12789-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:11.424988Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid5fjm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid5fjm" level=info timestamp=2018-08-02T11:01:11.443251Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid5fjm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid5fjm" level=info timestamp=2018-08-02T11:01:11.952929Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid5fjm\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmid5fjm, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5df12789-9643-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid5fjm" level=info timestamp=2018-08-02T11:01:12.142133Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid9b8w kind= uid=5e629d9f-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:12.142245Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid9b8w kind= uid=5e629d9f-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:12.172370Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid9b8w\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid9b8w" level=info timestamp=2018-08-02T11:01:12.233758Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid9b8w\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmid9b8w, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5e629d9f-9643-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid9b8w" level=info timestamp=2018-08-02T11:01:12.785212Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:12.785342Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:12.860307Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidpssk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidpssk" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:52:08.297742Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.304214Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:52:08.304778Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: true\n" level=info timestamp=2018-08-02T10:52:08.304806Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T10:52:08.304829Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:08.304871Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.304933Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:52:08.325266Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: false\n" level=info timestamp=2018-08-02T10:52:08.325343Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:08.325425Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.325501Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:54:49.713701Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: false\n" level=info timestamp=2018-08-02T10:54:49.713783Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:54:49.713845Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:54:49.713919Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:01:29.210992Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:01:29.215955Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6627/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:01:29.216077Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6627/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmidpssk" level=info timestamp=2018-08-02T11:01:29.236299Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: true\n" level=info timestamp=2018-08-02T11:01:29.236378Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:01:29.236410Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:01:29.236530Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:01:29.237429Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:01:29.237820Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmidpssk" level=info timestamp=2018-08-02T11:01:29.278041Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: true\n" level=info timestamp=2018-08-02T11:01:29.278125Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:01:29.278152Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:01:29.278246Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:01:29.279016Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:01:29.279094Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmidpssk" Pod name: virt-launcher-testvmidpssk-zglw8 Pod phase: Running level=info timestamp=2018-08-02T11:01:17.436683Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:01:17.436973Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:01:17.439784Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:01:27.445946Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:01:27.506451Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmidpssk" level=info timestamp=2018-08-02T11:01:27.508142Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:01:27.508396Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:02:24 http: TLS handshake error from 10.244.1.1:46544: EOF level=info timestamp=2018-08-02T11:02:27.836358Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:02:34 http: TLS handshake error from 10.244.1.1:46550: EOF 2018/08/02 11:02:44 http: TLS handshake error from 10.244.1.1:46556: EOF 2018/08/02 11:02:54 http: TLS handshake error from 10.244.1.1:46562: EOF level=info timestamp=2018-08-02T11:02:57.860647Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:03:04 http: TLS handshake error from 10.244.1.1:46568: EOF 2018/08/02 11:03:14 http: TLS handshake error from 10.244.1.1:46574: EOF 2018/08/02 11:03:24 http: TLS handshake error from 10.244.1.1:46580: EOF level=info timestamp=2018-08-02T11:03:27.844814Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:03:34 http: TLS handshake error from 10.244.1.1:46586: EOF 2018/08/02 11:03:44 http: TLS handshake error from 10.244.1.1:46592: EOF 2018/08/02 11:03:54 http: TLS handshake error from 10.244.1.1:46598: EOF level=info timestamp=2018-08-02T11:03:57.845355Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:04:04 http: TLS handshake error from 10.244.1.1:46604: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:02:53.656752Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:02:57 http: TLS handshake error from 10.244.0.1:46314: EOF 2018/08/02 11:03:07 http: TLS handshake error from 10.244.0.1:46338: EOF 2018/08/02 11:03:17 http: TLS handshake error from 10.244.0.1:46362: EOF level=info timestamp=2018-08-02T11:03:21.515568Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:03:23.685911Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:03:27 http: TLS handshake error from 10.244.0.1:46386: EOF 2018/08/02 11:03:37 http: TLS handshake error from 10.244.0.1:46410: EOF 2018/08/02 11:03:47 http: TLS handshake error from 10.244.0.1:46434: EOF level=info timestamp=2018-08-02T11:03:51.542327Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:03:53.714690Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:03:57 http: TLS handshake error from 10.244.0.1:46458: EOF level=info timestamp=2018-08-02T11:04:03.487893Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:04:03.489575Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:04:07 http: TLS handshake error from 10.244.0.1:46482: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T10:58:10.876241Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-alternative name=testvmilqmpl kind= uid=f2572fdb-9642-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T10:58:10.933774Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilqmpl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-alternative/testvmilqmpl" level=info timestamp=2018-08-02T10:58:10.952798Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmilqmpl\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-alternative/testvmilqmpl" level=info timestamp=2018-08-02T11:01:11.398895Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid5fjm kind= uid=5df12789-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:11.400101Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid5fjm kind= uid=5df12789-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:11.424988Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid5fjm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid5fjm" level=info timestamp=2018-08-02T11:01:11.443251Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid5fjm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid5fjm" level=info timestamp=2018-08-02T11:01:11.952929Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid5fjm\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmid5fjm, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5df12789-9643-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid5fjm" level=info timestamp=2018-08-02T11:01:12.142133Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid9b8w kind= uid=5e629d9f-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:12.142245Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid9b8w kind= uid=5e629d9f-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:12.172370Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid9b8w\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid9b8w" level=info timestamp=2018-08-02T11:01:12.233758Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid9b8w\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmid9b8w, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5e629d9f-9643-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid9b8w" level=info timestamp=2018-08-02T11:01:12.785212Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:12.785342Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:12.860307Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidpssk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidpssk" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T10:52:08.297742Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.304214Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:52:08.304778Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: true\n" level=info timestamp=2018-08-02T10:52:08.304806Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T10:52:08.304829Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:08.304871Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.304933Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind= uid=aec7e8fd-9641-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:52:08.325266Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: false\n" level=info timestamp=2018-08-02T10:52:08.325343Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:52:08.325425Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:52:08.325501Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T10:54:49.713701Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmip9vg7, existing: false\n" level=info timestamp=2018-08-02T10:54:49.713783Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T10:54:49.713845Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T10:54:49.713919Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmip9vg7 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:02:51.133685Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:02:51.133715Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:02:51.133801Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:02:51.135942Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6627/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:02:51.139757Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6627/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmidpssk" level=info timestamp=2018-08-02T11:03:52.736322Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmilqmpl, existing: false\n" level=info timestamp=2018-08-02T11:03:52.736403Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:03:52.736462Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-alternative name=testvmilqmpl kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:03:52.737137Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-alternative name=testvmilqmpl kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:04:13.060020Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: true\n" level=info timestamp=2018-08-02T11:04:13.060089Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:04:13.060112Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:04:13.060188Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:04:13.061108Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:04:13.061193Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmidpssk" Pod name: virt-launcher-testvmidpssk-zglw8 Pod phase: Running level=info timestamp=2018-08-02T11:01:17.436683Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:01:17.436973Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:01:17.439784Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:01:27.445946Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:01:27.506451Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmidpssk" level=info timestamp=2018-08-02T11:01:27.508142Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:01:27.508396Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure [180.391 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance's Pod /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:837 should result in the VirtualMachineInstance moving to a finalized state [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:838 Unexpected Warning event received: testvmidpssk,5ec42ffd-9643-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6620/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-02T11:01:13.543504Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmidpssk-zglw8" level=info timestamp=2018-08-02T11:01:29.469045Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmidpssk-zglw8" level=error timestamp=2018-08-02T11:01:29.484817Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid=5ec42ffd-9643-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6620/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:02:44 http: TLS handshake error from 10.244.1.1:46556: EOF 2018/08/02 11:02:54 http: TLS handshake error from 10.244.1.1:46562: EOF level=info timestamp=2018-08-02T11:02:57.860647Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:03:04 http: TLS handshake error from 10.244.1.1:46568: EOF 2018/08/02 11:03:14 http: TLS handshake error from 10.244.1.1:46574: EOF 2018/08/02 11:03:24 http: TLS handshake error from 10.244.1.1:46580: EOF level=info timestamp=2018-08-02T11:03:27.844814Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:03:34 http: TLS handshake error from 10.244.1.1:46586: EOF 2018/08/02 11:03:44 http: TLS handshake error from 10.244.1.1:46592: EOF 2018/08/02 11:03:54 http: TLS handshake error from 10.244.1.1:46598: EOF level=info timestamp=2018-08-02T11:03:57.845355Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:04:04 http: TLS handshake error from 10.244.1.1:46604: EOF 2018/08/02 11:04:14 http: TLS handshake error from 10.244.1.1:46610: EOF 2018/08/02 11:04:24 http: TLS handshake error from 10.244.1.1:46616: EOF level=info timestamp=2018-08-02T11:04:27.869806Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:03:21.515568Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:03:23.685911Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:03:27 http: TLS handshake error from 10.244.0.1:46386: EOF 2018/08/02 11:03:37 http: TLS handshake error from 10.244.0.1:46410: EOF 2018/08/02 11:03:47 http: TLS handshake error from 10.244.0.1:46434: EOF level=info timestamp=2018-08-02T11:03:51.542327Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:03:53.714690Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:03:57 http: TLS handshake error from 10.244.0.1:46458: EOF level=info timestamp=2018-08-02T11:04:03.487893Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:04:03.489575Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:04:07 http: TLS handshake error from 10.244.0.1:46482: EOF 2018/08/02 11:04:17 http: TLS handshake error from 10.244.0.1:46506: EOF level=info timestamp=2018-08-02T11:04:21.593858Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:04:23.740941Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:04:27 http: TLS handshake error from 10.244.0.1:46530: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:01:11.398895Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid5fjm kind= uid=5df12789-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:11.400101Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid5fjm kind= uid=5df12789-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:11.424988Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid5fjm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid5fjm" level=info timestamp=2018-08-02T11:01:11.443251Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid5fjm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid5fjm" level=info timestamp=2018-08-02T11:01:11.952929Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid5fjm\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmid5fjm, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5df12789-9643-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid5fjm" level=info timestamp=2018-08-02T11:01:12.142133Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid9b8w kind= uid=5e629d9f-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:12.142245Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid9b8w kind= uid=5e629d9f-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:12.172370Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid9b8w\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid9b8w" level=info timestamp=2018-08-02T11:01:12.233758Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid9b8w\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmid9b8w, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5e629d9f-9643-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid9b8w" level=info timestamp=2018-08-02T11:01:12.785212Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:12.785342Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:12.860307Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidpssk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidpssk" level=info timestamp=2018-08-02T11:04:13.253495Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:04:13.253707Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:04:13.297083Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizdfkc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizdfkc" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:04:28.595316Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:04:28.596432Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:04:28.596564Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmizdfkc" level=info timestamp=2018-08-02T11:04:28.616759Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmizdfkc, existing: true\n" level=info timestamp=2018-08-02T11:04:28.616823Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:04:28.616853Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:04:28.616961Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:04:28.617928Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:04:28.618755Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmizdfkc" level=info timestamp=2018-08-02T11:04:28.658987Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmizdfkc, existing: true\n" level=info timestamp=2018-08-02T11:04:28.659084Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:04:28.659123Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:04:28.659229Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:04:28.660063Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:04:28.660210Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmizdfkc" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:04:13.061193Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmidpssk" level=info timestamp=2018-08-02T11:04:13.443629Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: true\n" level=info timestamp=2018-08-02T11:04:13.443701Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:04:13.443737Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:04:13.443862Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:04:13.457305Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:04:13.457393Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: true\n" level=info timestamp=2018-08-02T11:04:13.457416Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:04:13.457443Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:04:13.458459Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:04:13.458642Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:04:13.478400Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: false\n" level=info timestamp=2018-08-02T11:04:13.478461Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:04:13.479563Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:04:13.479634Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmidpssk-zglw8 Pod phase: Pending level=info timestamp=2018-08-02T11:01:17.436683Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:01:17.436973Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:01:17.439784Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:01:27.445946Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:01:27.506451Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmidpssk" level=info timestamp=2018-08-02T11:01:27.508142Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:01:27.508396Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" caught signal virt-launcher exited with code 127 Pod name: virt-launcher-testvmizdfkc-64zqj Pod phase: Running level=info timestamp=2018-08-02T11:04:17.100472Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:04:17.100798Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:04:17.102108Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:04:27.108038Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:04:27.128611Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmizdfkc" level=info timestamp=2018-08-02T11:04:27.131173Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:04:27.131348Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:05:24 http: TLS handshake error from 10.244.1.1:46652: EOF level=info timestamp=2018-08-02T11:05:27.846509Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:05:34 http: TLS handshake error from 10.244.1.1:46658: EOF 2018/08/02 11:05:44 http: TLS handshake error from 10.244.1.1:46664: EOF 2018/08/02 11:05:54 http: TLS handshake error from 10.244.1.1:46670: EOF level=info timestamp=2018-08-02T11:05:57.863238Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:06:04 http: TLS handshake error from 10.244.1.1:46676: EOF 2018/08/02 11:06:14 http: TLS handshake error from 10.244.1.1:46682: EOF 2018/08/02 11:06:24 http: TLS handshake error from 10.244.1.1:46688: EOF level=info timestamp=2018-08-02T11:06:27.855608Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:06:34 http: TLS handshake error from 10.244.1.1:46694: EOF 2018/08/02 11:06:44 http: TLS handshake error from 10.244.1.1:46700: EOF 2018/08/02 11:06:54 http: TLS handshake error from 10.244.1.1:46706: EOF level=info timestamp=2018-08-02T11:06:57.845161Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:07:04 http: TLS handshake error from 10.244.1.1:46712: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:05:53.851391Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:05:57 http: TLS handshake error from 10.244.0.1:46746: EOF 2018/08/02 11:06:07 http: TLS handshake error from 10.244.0.1:46770: EOF 2018/08/02 11:06:17 http: TLS handshake error from 10.244.0.1:46794: EOF level=info timestamp=2018-08-02T11:06:21.705873Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:06:23.876856Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:06:27 http: TLS handshake error from 10.244.0.1:46818: EOF 2018/08/02 11:06:37 http: TLS handshake error from 10.244.0.1:46842: EOF 2018/08/02 11:06:47 http: TLS handshake error from 10.244.0.1:46866: EOF level=info timestamp=2018-08-02T11:06:51.735627Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:06:53.904887Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:06:57 http: TLS handshake error from 10.244.0.1:46890: EOF level=info timestamp=2018-08-02T11:07:03.493414Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:07:03.494422Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:07:07 http: TLS handshake error from 10.244.0.1:46914: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:01:11.398895Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid5fjm kind= uid=5df12789-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:11.400101Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid5fjm kind= uid=5df12789-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:11.424988Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid5fjm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid5fjm" level=info timestamp=2018-08-02T11:01:11.443251Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid5fjm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid5fjm" level=info timestamp=2018-08-02T11:01:11.952929Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid5fjm\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmid5fjm, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5df12789-9643-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid5fjm" level=info timestamp=2018-08-02T11:01:12.142133Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid9b8w kind= uid=5e629d9f-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:12.142245Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid9b8w kind= uid=5e629d9f-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:12.172370Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid9b8w\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid9b8w" level=info timestamp=2018-08-02T11:01:12.233758Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid9b8w\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmid9b8w, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5e629d9f-9643-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid9b8w" level=info timestamp=2018-08-02T11:01:12.785212Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:12.785342Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:12.860307Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidpssk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidpssk" level=info timestamp=2018-08-02T11:04:13.253495Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:04:13.253707Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:04:13.297083Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizdfkc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizdfkc" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:05:09.556515Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:05:09.557452Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:05:09.557864Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmizdfkc" level=info timestamp=2018-08-02T11:05:50.518253Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmizdfkc, existing: true\n" level=info timestamp=2018-08-02T11:05:50.518338Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:05:50.518367Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:05:50.518472Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:05:50.519532Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:05:50.519620Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmizdfkc" level=info timestamp=2018-08-02T11:07:12.439895Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmizdfkc, existing: true\n" level=info timestamp=2018-08-02T11:07:12.439994Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:07:12.440025Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:07:12.440107Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:07:12.440816Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:07:12.440923Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmizdfkc" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:04:13.443862Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:04:13.457305Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:04:13.457393Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: true\n" level=info timestamp=2018-08-02T11:04:13.457416Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:04:13.457443Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:04:13.458459Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:04:13.458642Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:04:13.478400Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: false\n" level=info timestamp=2018-08-02T11:04:13.478461Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:04:13.479563Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:04:13.479634Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:06:56.901589Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: false\n" level=info timestamp=2018-08-02T11:06:56.901667Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:06:56.901737Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:06:56.901810Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmizdfkc-64zqj Pod phase: Running level=info timestamp=2018-08-02T11:04:17.100472Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:04:17.100798Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:04:17.102108Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:04:27.108038Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:04:27.128611Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmizdfkc" level=info timestamp=2018-08-02T11:04:27.131173Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:04:27.131348Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.470 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:869 with an active pod. /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:870 should result in pod being terminated [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:871 Unexpected Warning event received: testvmizdfkc,ca55c7bf-9643-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-02T11:04:14.064567Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmizdfkc kind=VirtualMachineInstance uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmizdfkc-64zqj" level=info timestamp=2018-08-02T11:04:29.234247Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmizdfkc kind=VirtualMachineInstance uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmizdfkc-64zqj" level=error timestamp=2018-08-02T11:04:29.266523Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmizdfkc kind=VirtualMachineInstance uid=ca55c7bf-9643-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:05:44 http: TLS handshake error from 10.244.1.1:46664: EOF 2018/08/02 11:05:54 http: TLS handshake error from 10.244.1.1:46670: EOF level=info timestamp=2018-08-02T11:05:57.863238Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:06:04 http: TLS handshake error from 10.244.1.1:46676: EOF 2018/08/02 11:06:14 http: TLS handshake error from 10.244.1.1:46682: EOF 2018/08/02 11:06:24 http: TLS handshake error from 10.244.1.1:46688: EOF level=info timestamp=2018-08-02T11:06:27.855608Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:06:34 http: TLS handshake error from 10.244.1.1:46694: EOF 2018/08/02 11:06:44 http: TLS handshake error from 10.244.1.1:46700: EOF 2018/08/02 11:06:54 http: TLS handshake error from 10.244.1.1:46706: EOF level=info timestamp=2018-08-02T11:06:57.845161Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:07:04 http: TLS handshake error from 10.244.1.1:46712: EOF 2018/08/02 11:07:14 http: TLS handshake error from 10.244.1.1:46718: EOF 2018/08/02 11:07:24 http: TLS handshake error from 10.244.1.1:46724: EOF level=info timestamp=2018-08-02T11:07:27.847411Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:06:21.705873Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:06:23.876856Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:06:27 http: TLS handshake error from 10.244.0.1:46818: EOF 2018/08/02 11:06:37 http: TLS handshake error from 10.244.0.1:46842: EOF 2018/08/02 11:06:47 http: TLS handshake error from 10.244.0.1:46866: EOF level=info timestamp=2018-08-02T11:06:51.735627Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:06:53.904887Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:06:57 http: TLS handshake error from 10.244.0.1:46890: EOF level=info timestamp=2018-08-02T11:07:03.493414Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:07:03.494422Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:07:07 http: TLS handshake error from 10.244.0.1:46914: EOF 2018/08/02 11:07:17 http: TLS handshake error from 10.244.0.1:46938: EOF level=info timestamp=2018-08-02T11:07:21.771913Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:07:23.934767Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:07:27 http: TLS handshake error from 10.244.0.1:46962: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:01:11.443251Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid5fjm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid5fjm" level=info timestamp=2018-08-02T11:01:11.952929Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid5fjm\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmid5fjm, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5df12789-9643-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid5fjm" level=info timestamp=2018-08-02T11:01:12.142133Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid9b8w kind= uid=5e629d9f-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:12.142245Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid9b8w kind= uid=5e629d9f-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:12.172370Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid9b8w\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid9b8w" level=info timestamp=2018-08-02T11:01:12.233758Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid9b8w\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmid9b8w, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5e629d9f-9643-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid9b8w" level=info timestamp=2018-08-02T11:01:12.785212Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:12.785342Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:12.860307Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidpssk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidpssk" level=info timestamp=2018-08-02T11:04:13.253495Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:04:13.253707Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:04:13.297083Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizdfkc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizdfkc" level=info timestamp=2018-08-02T11:07:13.728296Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:07:13.729703Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:07:13.787990Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9958g\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9958g" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:07:27.921131Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:07:27.921577Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:07:27.921719Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi9958g" level=info timestamp=2018-08-02T11:07:27.941973Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi9958g, existing: true\n" level=info timestamp=2018-08-02T11:07:27.942073Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:07:27.942105Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:07:27.942231Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:07:27.942963Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:07:27.943066Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi9958g" level=info timestamp=2018-08-02T11:07:27.983340Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi9958g, existing: true\n" level=info timestamp=2018-08-02T11:07:27.983424Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:07:27.983448Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:07:27.983566Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:07:27.984198Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:07:27.984284Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi9958g" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:04:13.443862Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:04:13.457305Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:04:13.457393Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: true\n" level=info timestamp=2018-08-02T11:04:13.457416Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:04:13.457443Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:04:13.458459Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:04:13.458642Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:04:13.478400Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: false\n" level=info timestamp=2018-08-02T11:04:13.478461Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:04:13.479563Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:04:13.479634Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:06:56.901589Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: false\n" level=info timestamp=2018-08-02T11:06:56.901667Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:06:56.901737Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:06:56.901810Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi9958g-fjw6s Pod phase: Running level=info timestamp=2018-08-02T11:07:16.792142Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:07:16.792558Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:07:16.794013Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:07:26.803964Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:07:26.856869Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi9958g" level=info timestamp=2018-08-02T11:07:26.858441Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:07:26.858674Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmizdfkc-64zqj Pod phase: Failed Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:08:24 http: TLS handshake error from 10.244.1.1:46760: EOF level=info timestamp=2018-08-02T11:08:27.842393Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:08:34 http: TLS handshake error from 10.244.1.1:46766: EOF 2018/08/02 11:08:44 http: TLS handshake error from 10.244.1.1:46772: EOF 2018/08/02 11:08:54 http: TLS handshake error from 10.244.1.1:46778: EOF level=info timestamp=2018-08-02T11:08:57.885032Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:09:04 http: TLS handshake error from 10.244.1.1:46784: EOF 2018/08/02 11:09:14 http: TLS handshake error from 10.244.1.1:46790: EOF 2018/08/02 11:09:24 http: TLS handshake error from 10.244.1.1:46796: EOF level=info timestamp=2018-08-02T11:09:27.847121Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:09:34 http: TLS handshake error from 10.244.1.1:46802: EOF 2018/08/02 11:09:44 http: TLS handshake error from 10.244.1.1:46808: EOF 2018/08/02 11:09:54 http: TLS handshake error from 10.244.1.1:46814: EOF level=info timestamp=2018-08-02T11:09:57.840315Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:10:04 http: TLS handshake error from 10.244.1.1:46820: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:09:03.339609Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:09:03.340216Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:09:07 http: TLS handshake error from 10.244.0.1:47202: EOF 2018/08/02 11:09:17 http: TLS handshake error from 10.244.0.1:47226: EOF level=info timestamp=2018-08-02T11:09:21.909477Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:09:24.039997Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:09:27 http: TLS handshake error from 10.244.0.1:47250: EOF 2018/08/02 11:09:37 http: TLS handshake error from 10.244.0.1:47274: EOF 2018/08/02 11:09:47 http: TLS handshake error from 10.244.0.1:47298: EOF level=info timestamp=2018-08-02T11:09:51.936961Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:09:54.067402Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:09:57 http: TLS handshake error from 10.244.0.1:47322: EOF level=info timestamp=2018-08-02T11:10:03.341465Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:10:03.342289Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:10:07 http: TLS handshake error from 10.244.0.1:47346: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:01:11.443251Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid5fjm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid5fjm" level=info timestamp=2018-08-02T11:01:11.952929Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid5fjm\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmid5fjm, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5df12789-9643-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid5fjm" level=info timestamp=2018-08-02T11:01:12.142133Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid9b8w kind= uid=5e629d9f-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:12.142245Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid9b8w kind= uid=5e629d9f-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:12.172370Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid9b8w\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid9b8w" level=info timestamp=2018-08-02T11:01:12.233758Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid9b8w\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmid9b8w, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5e629d9f-9643-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid9b8w" level=info timestamp=2018-08-02T11:01:12.785212Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:12.785342Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:12.860307Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidpssk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidpssk" level=info timestamp=2018-08-02T11:04:13.253495Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:04:13.253707Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:04:13.297083Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizdfkc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizdfkc" level=info timestamp=2018-08-02T11:07:13.728296Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:07:13.729703Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:07:13.787990Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9958g\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9958g" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:08:49.841846Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:08:49.841900Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:08:49.841981Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:08:49.842611Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:08:49.842688Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi9958g" level=info timestamp=2018-08-02T11:09:56.281262Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmizdfkc, existing: false\n" level=info timestamp=2018-08-02T11:09:56.281352Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:09:56.281458Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmizdfkc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:09:56.281597Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmizdfkc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:10:11.762948Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi9958g, existing: true\n" level=info timestamp=2018-08-02T11:10:11.763028Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:10:11.763060Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:10:11.763167Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:10:11.763844Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:10:11.763966Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi9958g" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:04:13.443862Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:04:13.457305Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:04:13.457393Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: true\n" level=info timestamp=2018-08-02T11:04:13.457416Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:04:13.457443Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:04:13.458459Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:04:13.458642Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:04:13.478400Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: false\n" level=info timestamp=2018-08-02T11:04:13.478461Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:04:13.479563Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:04:13.479634Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:06:56.901589Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: false\n" level=info timestamp=2018-08-02T11:06:56.901667Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:06:56.901737Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:06:56.901810Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi9958g-fjw6s Pod phase: Running level=info timestamp=2018-08-02T11:07:16.792142Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:07:16.792558Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:07:16.794013Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:07:26.803964Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:07:26.856869Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi9958g" level=info timestamp=2018-08-02T11:07:26.858441Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:07:26.858674Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.486 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:869 with ACPI and 0 grace period seconds /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:895 should result in vmi status failed [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:896 Unexpected Warning event received: testvmi9958g,35e78836-9644-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-02T11:07:14.464130Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmi9958g kind=VirtualMachineInstance uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi9958g-fjw6s" level=info timestamp=2018-08-02T11:07:28.578842Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmi9958g kind=VirtualMachineInstance uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmi9958g-fjw6s" level=error timestamp=2018-08-02T11:07:28.594308Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmi9958g kind=VirtualMachineInstance uid=35e78836-9644-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:08:44 http: TLS handshake error from 10.244.1.1:46772: EOF 2018/08/02 11:08:54 http: TLS handshake error from 10.244.1.1:46778: EOF level=info timestamp=2018-08-02T11:08:57.885032Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:09:04 http: TLS handshake error from 10.244.1.1:46784: EOF 2018/08/02 11:09:14 http: TLS handshake error from 10.244.1.1:46790: EOF 2018/08/02 11:09:24 http: TLS handshake error from 10.244.1.1:46796: EOF level=info timestamp=2018-08-02T11:09:27.847121Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:09:34 http: TLS handshake error from 10.244.1.1:46802: EOF 2018/08/02 11:09:44 http: TLS handshake error from 10.244.1.1:46808: EOF 2018/08/02 11:09:54 http: TLS handshake error from 10.244.1.1:46814: EOF level=info timestamp=2018-08-02T11:09:57.840315Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:10:04 http: TLS handshake error from 10.244.1.1:46820: EOF 2018/08/02 11:10:14 http: TLS handshake error from 10.244.1.1:46826: EOF 2018/08/02 11:10:24 http: TLS handshake error from 10.244.1.1:46832: EOF level=info timestamp=2018-08-02T11:10:27.839492Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:09:21.909477Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:09:24.039997Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:09:27 http: TLS handshake error from 10.244.0.1:47250: EOF 2018/08/02 11:09:37 http: TLS handshake error from 10.244.0.1:47274: EOF 2018/08/02 11:09:47 http: TLS handshake error from 10.244.0.1:47298: EOF level=info timestamp=2018-08-02T11:09:51.936961Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:09:54.067402Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:09:57 http: TLS handshake error from 10.244.0.1:47322: EOF level=info timestamp=2018-08-02T11:10:03.341465Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:10:03.342289Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:10:07 http: TLS handshake error from 10.244.0.1:47346: EOF 2018/08/02 11:10:17 http: TLS handshake error from 10.244.0.1:47370: EOF level=info timestamp=2018-08-02T11:10:21.966401Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:10:24.096679Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:10:27 http: TLS handshake error from 10.244.0.1:47394: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:01:12.142245Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid9b8w kind= uid=5e629d9f-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:12.172370Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid9b8w\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid9b8w" level=info timestamp=2018-08-02T11:01:12.233758Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid9b8w\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmid9b8w, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5e629d9f-9643-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid9b8w" level=info timestamp=2018-08-02T11:01:12.785212Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:12.785342Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:12.860307Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidpssk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidpssk" level=info timestamp=2018-08-02T11:04:13.253495Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:04:13.253707Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:04:13.297083Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizdfkc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizdfkc" level=info timestamp=2018-08-02T11:07:13.728296Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:07:13.729703Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:07:13.787990Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9958g\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9958g" level=info timestamp=2018-08-02T11:10:14.210084Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:10:14.211228Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:10:14.270263Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij2r7z\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:10:28.128284Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:10:28.128603Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:10:28.128669Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" level=info timestamp=2018-08-02T11:10:28.148770Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij2r7z, existing: true\n" level=info timestamp=2018-08-02T11:10:28.148816Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:10:28.148840Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:10:28.148898Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:10:28.149303Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:10:28.149384Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" level=info timestamp=2018-08-02T11:10:28.189607Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij2r7z, existing: true\n" level=info timestamp=2018-08-02T11:10:28.189679Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:10:28.189702Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:10:28.189778Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:10:28.190365Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:10:28.190434Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:04:13.443862Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:04:13.457305Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:04:13.457393Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: true\n" level=info timestamp=2018-08-02T11:04:13.457416Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:04:13.457443Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:04:13.458459Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:04:13.458642Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:04:13.478400Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: false\n" level=info timestamp=2018-08-02T11:04:13.478461Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:04:13.479563Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:04:13.479634Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:06:56.901589Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: false\n" level=info timestamp=2018-08-02T11:06:56.901667Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:06:56.901737Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:06:56.901810Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmij2r7z-7zcc5 Pod phase: Running level=info timestamp=2018-08-02T11:10:17.739407Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:10:17.739986Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:10:17.741873Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:10:27.748443Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:10:27.790731Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmij2r7z" level=info timestamp=2018-08-02T11:10:27.793067Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:10:27.793364Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:11:24 http: TLS handshake error from 10.244.1.1:46868: EOF level=info timestamp=2018-08-02T11:11:27.847636Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:11:34 http: TLS handshake error from 10.244.1.1:46874: EOF 2018/08/02 11:11:44 http: TLS handshake error from 10.244.1.1:46880: EOF 2018/08/02 11:11:54 http: TLS handshake error from 10.244.1.1:46886: EOF level=info timestamp=2018-08-02T11:11:57.865524Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:12:04 http: TLS handshake error from 10.244.1.1:46892: EOF 2018/08/02 11:12:14 http: TLS handshake error from 10.244.1.1:46898: EOF 2018/08/02 11:12:24 http: TLS handshake error from 10.244.1.1:46904: EOF level=info timestamp=2018-08-02T11:12:27.849842Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:12:34 http: TLS handshake error from 10.244.1.1:46910: EOF 2018/08/02 11:12:44 http: TLS handshake error from 10.244.1.1:46916: EOF 2018/08/02 11:12:54 http: TLS handshake error from 10.244.1.1:46922: EOF level=info timestamp=2018-08-02T11:12:57.843953Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:13:04 http: TLS handshake error from 10.244.1.1:46928: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:11:54.185295Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:11:57 http: TLS handshake error from 10.244.0.1:47610: EOF level=info timestamp=2018-08-02T11:12:03.343668Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:12:03.344654Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:12:07 http: TLS handshake error from 10.244.0.1:47634: EOF 2018/08/02 11:12:17 http: TLS handshake error from 10.244.0.1:47658: EOF level=info timestamp=2018-08-02T11:12:22.079676Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:12:24.220376Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:12:27 http: TLS handshake error from 10.244.0.1:47682: EOF 2018/08/02 11:12:37 http: TLS handshake error from 10.244.0.1:47706: EOF 2018/08/02 11:12:47 http: TLS handshake error from 10.244.0.1:47730: EOF level=info timestamp=2018-08-02T11:12:52.104338Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:12:54.248654Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:12:57 http: TLS handshake error from 10.244.0.1:47754: EOF 2018/08/02 11:13:07 http: TLS handshake error from 10.244.0.1:47778: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:01:12.142245Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmid9b8w kind= uid=5e629d9f-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:12.172370Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid9b8w\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid9b8w" level=info timestamp=2018-08-02T11:01:12.233758Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmid9b8w\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmid9b8w, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5e629d9f-9643-11e8-9cfb-525500d15501, UID in object meta: " msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmid9b8w" level=info timestamp=2018-08-02T11:01:12.785212Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:12.785342Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:12.860307Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidpssk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidpssk" level=info timestamp=2018-08-02T11:04:13.253495Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:04:13.253707Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:04:13.297083Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizdfkc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizdfkc" level=info timestamp=2018-08-02T11:07:13.728296Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:07:13.729703Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:07:13.787990Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9958g\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9958g" level=info timestamp=2018-08-02T11:10:14.210084Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:10:14.211228Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:10:14.270263Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij2r7z\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:11:50.046175Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:11:50.046263Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:11:50.046389Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:11:50.047203Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:11:50.047336Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" level=info timestamp=2018-08-02T11:12:55.604270Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi9958g, existing: false\n" level=info timestamp=2018-08-02T11:12:55.604364Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:12:55.604437Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi9958g kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:12:55.604594Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi9958g kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:13:11.967613Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij2r7z, existing: true\n" level=info timestamp=2018-08-02T11:13:11.967685Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:13:11.967708Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:13:11.967777Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:13:11.968731Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:13:11.968812Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:04:13.443862Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:04:13.457305Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:04:13.457393Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: true\n" level=info timestamp=2018-08-02T11:04:13.457416Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:04:13.457443Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:04:13.458459Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:04:13.458642Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:04:13.478400Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: false\n" level=info timestamp=2018-08-02T11:04:13.478461Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:04:13.479563Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:04:13.479634Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:06:56.901589Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmidpssk, existing: false\n" level=info timestamp=2018-08-02T11:06:56.901667Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:06:56.901737Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:06:56.901810Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmidpssk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmij2r7z-7zcc5 Pod phase: Running level=info timestamp=2018-08-02T11:10:17.739407Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:10:17.739986Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:10:17.741873Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:10:27.748443Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:10:27.790731Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmij2r7z" level=info timestamp=2018-08-02T11:10:27.793067Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:10:27.793364Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.471 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:869 with ACPI and some grace period seconds /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:920 should result in vmi status succeeded [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:921 Unexpected Warning event received: testvmij2r7z,a17b8941-9644-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-02T11:10:15.018347Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmij2r7z kind=VirtualMachineInstance uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmij2r7z-7zcc5" level=info timestamp=2018-08-02T11:10:28.775536Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmij2r7z kind=VirtualMachineInstance uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmij2r7z-7zcc5" level=error timestamp=2018-08-02T11:10:28.801974Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmij2r7z kind=VirtualMachineInstance uid=a17b8941-9644-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:11:44 http: TLS handshake error from 10.244.1.1:46880: EOF 2018/08/02 11:11:54 http: TLS handshake error from 10.244.1.1:46886: EOF level=info timestamp=2018-08-02T11:11:57.865524Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:12:04 http: TLS handshake error from 10.244.1.1:46892: EOF 2018/08/02 11:12:14 http: TLS handshake error from 10.244.1.1:46898: EOF 2018/08/02 11:12:24 http: TLS handshake error from 10.244.1.1:46904: EOF level=info timestamp=2018-08-02T11:12:27.849842Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:12:34 http: TLS handshake error from 10.244.1.1:46910: EOF 2018/08/02 11:12:44 http: TLS handshake error from 10.244.1.1:46916: EOF 2018/08/02 11:12:54 http: TLS handshake error from 10.244.1.1:46922: EOF level=info timestamp=2018-08-02T11:12:57.843953Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:13:04 http: TLS handshake error from 10.244.1.1:46928: EOF 2018/08/02 11:13:14 http: TLS handshake error from 10.244.1.1:46934: EOF 2018/08/02 11:13:24 http: TLS handshake error from 10.244.1.1:46940: EOF level=info timestamp=2018-08-02T11:13:27.870736Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-api-7d79764579-qbwqf Pod phase: Running 2018/08/02 11:12:07 http: TLS handshake error from 10.244.0.1:47634: EOF 2018/08/02 11:12:17 http: TLS handshake error from 10.244.0.1:47658: EOF level=info timestamp=2018-08-02T11:12:22.079676Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:12:24.220376Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:12:27 http: TLS handshake error from 10.244.0.1:47682: EOF 2018/08/02 11:12:37 http: TLS handshake error from 10.244.0.1:47706: EOF 2018/08/02 11:12:47 http: TLS handshake error from 10.244.0.1:47730: EOF level=info timestamp=2018-08-02T11:12:52.104338Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:12:54.248654Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:12:57 http: TLS handshake error from 10.244.0.1:47754: EOF 2018/08/02 11:13:07 http: TLS handshake error from 10.244.0.1:47778: EOF 2018/08/02 11:13:17 http: TLS handshake error from 10.244.0.1:47802: EOF level=info timestamp=2018-08-02T11:13:22.161893Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:13:24.286289Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:13:27 http: TLS handshake error from 10.244.0.1:47826: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:01:12.785212Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:12.785342Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:12.860307Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidpssk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidpssk" level=info timestamp=2018-08-02T11:04:13.253495Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:04:13.253707Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:04:13.297083Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizdfkc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizdfkc" level=info timestamp=2018-08-02T11:07:13.728296Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:07:13.729703Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:07:13.787990Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9958g\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9958g" level=info timestamp=2018-08-02T11:10:14.210084Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:10:14.211228Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:10:14.270263Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij2r7z\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" level=info timestamp=2018-08-02T11:13:14.688412Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:13:14.689626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:13:14.772648Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij5sfj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:13:11.967685Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:13:11.967708Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:13:11.967777Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:13:11.968731Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:13:11.968812Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" level=info timestamp=2018-08-02T11:13:14.478425Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij2r7z, existing: true\n" level=info timestamp=2018-08-02T11:13:14.478492Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:13:14.478525Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:13:14.478659Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=error timestamp=2018-08-02T11:13:14.503933Z pos=vm.go:433 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij2r7z\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmij2r7z, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a17b8941-9644-11e8-9cfb-525500d15501, UID in object meta: " msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-08-02T11:13:14.504076Z pos=vm.go:253 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij2r7z\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmij2r7z, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a17b8941-9644-11e8-9cfb-525500d15501, UID in object meta: " msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" level=info timestamp=2018-08-02T11:13:14.504142Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij2r7z, existing: false\n" level=info timestamp=2018-08-02T11:13:14.504165Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:13:14.504233Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:13:14.504304Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:13:30.382920Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:13:30.384191Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6620/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:13:30.385151Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6620/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" level=info timestamp=2018-08-02T11:13:30.405382Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: true\n" level=info timestamp=2018-08-02T11:13:30.405529Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:13:30.405555Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:13:30.405661Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:13:30.406462Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:13:30.407165Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" level=info timestamp=2018-08-02T11:13:30.447524Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: true\n" level=info timestamp=2018-08-02T11:13:30.447608Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:13:30.447641Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:13:30.447741Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:13:30.449170Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6636/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:13:30.449255Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6636/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" Pod name: virt-launcher-testvmij2r7z-7zcc5 Pod phase: Failed Unable to retrieve container logs for docker://238740f439b17f51e0e07ff9b974cd6ccfdb38a88ec260637a8acd231ffa346e Pod name: virt-launcher-testvmij5sfj-vp64g Pod phase: Running level=info timestamp=2018-08-02T11:13:18.691322Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:13:18.692054Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:13:18.693542Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:13:28.702592Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:13:28.745915Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmij5sfj" level=info timestamp=2018-08-02T11:13:28.749270Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:13:28.749560Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:14:24 http: TLS handshake error from 10.244.1.1:46976: EOF level=info timestamp=2018-08-02T11:14:27.882741Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:14:34 http: TLS handshake error from 10.244.1.1:46982: EOF 2018/08/02 11:14:44 http: TLS handshake error from 10.244.1.1:46988: EOF 2018/08/02 11:14:54 http: TLS handshake error from 10.244.1.1:46994: EOF level=info timestamp=2018-08-02T11:14:57.894317Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:15:04 http: TLS handshake error from 10.244.1.1:47000: EOF 2018/08/02 11:15:14 http: TLS handshake error from 10.244.1.1:47006: EOF 2018/08/02 11:15:24 http: TLS handshake error from 10.244.1.1:47012: EOF level=info timestamp=2018-08-02T11:15:27.841855Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:15:34 http: TLS handshake error from 10.244.1.1:47018: EOF 2018/08/02 11:15:44 http: TLS handshake error from 10.244.1.1:47024: EOF 2018/08/02 11:15:54 http: TLS handshake error from 10.244.1.1:47030: EOF level=info timestamp=2018-08-02T11:15:57.850041Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:16:04 http: TLS handshake error from 10.244.1.1:47036: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:14:54.393542Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:14:57 http: TLS handshake error from 10.244.0.1:48042: EOF level=info timestamp=2018-08-02T11:15:03.457315Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:15:03.458426Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:15:07 http: TLS handshake error from 10.244.0.1:48066: EOF 2018/08/02 11:15:17 http: TLS handshake error from 10.244.0.1:48090: EOF level=info timestamp=2018-08-02T11:15:22.315982Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:15:24.417393Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:15:27 http: TLS handshake error from 10.244.0.1:48114: EOF 2018/08/02 11:15:37 http: TLS handshake error from 10.244.0.1:48138: EOF 2018/08/02 11:15:47 http: TLS handshake error from 10.244.0.1:48162: EOF level=info timestamp=2018-08-02T11:15:52.358098Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:15:54.446208Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:15:57 http: TLS handshake error from 10.244.0.1:48186: EOF 2018/08/02 11:16:07 http: TLS handshake error from 10.244.0.1:48210: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:01:12.785212Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:01:12.785342Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmidpssk kind= uid=5ec42ffd-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:01:12.860307Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidpssk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidpssk" level=info timestamp=2018-08-02T11:04:13.253495Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:04:13.253707Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:04:13.297083Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizdfkc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizdfkc" level=info timestamp=2018-08-02T11:07:13.728296Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:07:13.729703Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:07:13.787990Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9958g\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9958g" level=info timestamp=2018-08-02T11:10:14.210084Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:10:14.211228Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:10:14.270263Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij2r7z\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" level=info timestamp=2018-08-02T11:13:14.688412Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:13:14.689626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:13:14.772648Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij5sfj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:13:11.968812Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" level=info timestamp=2018-08-02T11:13:14.478425Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij2r7z, existing: true\n" level=info timestamp=2018-08-02T11:13:14.478492Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:13:14.478525Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:13:14.478659Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=error timestamp=2018-08-02T11:13:14.503933Z pos=vm.go:433 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij2r7z\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmij2r7z, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a17b8941-9644-11e8-9cfb-525500d15501, UID in object meta: " msg="Updating the VirtualMachineInstance status failed." level=info timestamp=2018-08-02T11:13:14.504076Z pos=vm.go:253 component=virt-handler reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij2r7z\": StorageError: invalid object, Code: 4, Key: /registry/kubevirt.io/virtualmachineinstances/kubevirt-test-default/testvmij2r7z, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a17b8941-9644-11e8-9cfb-525500d15501, UID in object meta: " msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" level=info timestamp=2018-08-02T11:13:14.504142Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij2r7z, existing: false\n" level=info timestamp=2018-08-02T11:13:14.504165Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:13:14.504233Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:13:14.504304Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:15:55.809123Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij2r7z, existing: false\n" level=info timestamp=2018-08-02T11:15:55.809216Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:15:55.809285Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:15:55.809374Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij2r7z kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:14:11.345600Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:14:11.346112Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6627/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:14:11.346189Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6627/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" level=info timestamp=2018-08-02T11:14:52.306415Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: true\n" level=info timestamp=2018-08-02T11:14:52.306529Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:14:52.306562Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:14:52.306660Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:14:52.307951Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6636/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:14:52.308110Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6636/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" level=info timestamp=2018-08-02T11:16:14.228724Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: true\n" level=info timestamp=2018-08-02T11:16:14.228824Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:16:14.228855Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:14.228971Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:16:14.233149Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6620/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:16:14.233265Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6620/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" Pod name: virt-launcher-testvmij5sfj-vp64g Pod phase: Running level=info timestamp=2018-08-02T11:13:18.691322Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:13:18.692054Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:13:18.693542Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:13:28.702592Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:13:28.745915Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmij5sfj" level=info timestamp=2018-08-02T11:13:28.749270Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:13:28.749560Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.480 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Delete a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:869 with grace period greater than 0 /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:945 should run graceful shutdown [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:946 Unexpected Warning event received: testvmij5sfj,0d0e1a60-9645-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6627/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ STEP: Setting a VirtualMachineInstance termination grace period to 5 STEP: Creating the VirtualMachineInstance level=info timestamp=2018-08-02T11:13:15.441908Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmij5sfj-vp64g" level=info timestamp=2018-08-02T11:13:30.641333Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmij5sfj-vp64g" level=error timestamp=2018-08-02T11:13:30.657063Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid=0d0e1a60-9645-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6627/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:14:44 http: TLS handshake error from 10.244.1.1:46988: EOF 2018/08/02 11:14:54 http: TLS handshake error from 10.244.1.1:46994: EOF level=info timestamp=2018-08-02T11:14:57.894317Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:15:04 http: TLS handshake error from 10.244.1.1:47000: EOF 2018/08/02 11:15:14 http: TLS handshake error from 10.244.1.1:47006: EOF 2018/08/02 11:15:24 http: TLS handshake error from 10.244.1.1:47012: EOF level=info timestamp=2018-08-02T11:15:27.841855Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:15:34 http: TLS handshake error from 10.244.1.1:47018: EOF 2018/08/02 11:15:44 http: TLS handshake error from 10.244.1.1:47024: EOF 2018/08/02 11:15:54 http: TLS handshake error from 10.244.1.1:47030: EOF level=info timestamp=2018-08-02T11:15:57.850041Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:16:04 http: TLS handshake error from 10.244.1.1:47036: EOF 2018/08/02 11:16:14 http: TLS handshake error from 10.244.1.1:47042: EOF 2018/08/02 11:16:24 http: TLS handshake error from 10.244.1.1:47048: EOF level=info timestamp=2018-08-02T11:16:27.853803Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-api-7d79764579-qbwqf Pod phase: Running 2018/08/02 11:15:07 http: TLS handshake error from 10.244.0.1:48066: EOF 2018/08/02 11:15:17 http: TLS handshake error from 10.244.0.1:48090: EOF level=info timestamp=2018-08-02T11:15:22.315982Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:15:24.417393Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:15:27 http: TLS handshake error from 10.244.0.1:48114: EOF 2018/08/02 11:15:37 http: TLS handshake error from 10.244.0.1:48138: EOF 2018/08/02 11:15:47 http: TLS handshake error from 10.244.0.1:48162: EOF level=info timestamp=2018-08-02T11:15:52.358098Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:15:54.446208Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:15:57 http: TLS handshake error from 10.244.0.1:48186: EOF 2018/08/02 11:16:07 http: TLS handshake error from 10.244.0.1:48210: EOF 2018/08/02 11:16:17 http: TLS handshake error from 10.244.0.1:48234: EOF level=info timestamp=2018-08-02T11:16:22.385059Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:16:24.474602Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:16:27 http: TLS handshake error from 10.244.0.1:48258: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:01:12.860307Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidpssk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidpssk" level=info timestamp=2018-08-02T11:04:13.253495Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:04:13.253707Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:04:13.297083Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizdfkc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizdfkc" level=info timestamp=2018-08-02T11:07:13.728296Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:07:13.729703Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:07:13.787990Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9958g\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9958g" level=info timestamp=2018-08-02T11:10:14.210084Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:10:14.211228Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:10:14.270263Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij2r7z\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" level=info timestamp=2018-08-02T11:13:14.688412Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:13:14.689626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:13:14.772648Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij5sfj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" level=info timestamp=2018-08-02T11:16:15.159586Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:16:15.160819Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:16:29.145184Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:16:29.145617Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:16:29.148435Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmijq6lc" level=info timestamp=2018-08-02T11:16:29.168644Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmijq6lc, existing: true\n" level=info timestamp=2018-08-02T11:16:29.168728Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:16:29.168759Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:29.168855Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:16:29.169495Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:16:29.169631Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmijq6lc" level=info timestamp=2018-08-02T11:16:29.209842Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmijq6lc, existing: true\n" level=info timestamp=2018-08-02T11:16:29.209934Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:16:29.209969Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:29.210064Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:16:29.210675Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:16:29.210776Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmijq6lc" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:16:14.233265Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6620/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" level=info timestamp=2018-08-02T11:16:15.357799Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: true\n" level=info timestamp=2018-08-02T11:16:15.357865Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:16:15.357889Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.357977Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.379855Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.379943Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: true\n" level=info timestamp=2018-08-02T11:16:15.379961Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:16:15.379982Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.380040Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.380111Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.385725Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:16:15.385761Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.385806Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.385859Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmij5sfj-vp64g Pod phase: Failed level=info timestamp=2018-08-02T11:13:18.691322Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:13:18.692054Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:13:18.693542Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:13:28.702592Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:13:28.745915Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmij5sfj" level=info timestamp=2018-08-02T11:13:28.749270Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:13:28.749560Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" caught signal virt-launcher exited with code 127 Pod name: virt-launcher-testvmijq6lc-xkltq Pod phase: Running level=info timestamp=2018-08-02T11:16:18.711628Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:16:18.711903Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:16:18.713878Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:16:28.719157Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:16:28.771493Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmijq6lc" level=info timestamp=2018-08-02T11:16:28.773048Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:16:28.773225Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running level=info timestamp=2018-08-02T11:17:27.862451Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:17:34 http: TLS handshake error from 10.244.1.1:47090: EOF 2018/08/02 11:17:44 http: TLS handshake error from 10.244.1.1:47096: EOF 2018/08/02 11:17:54 http: TLS handshake error from 10.244.1.1:47102: EOF level=info timestamp=2018-08-02T11:17:57.881453Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:18:04 http: TLS handshake error from 10.244.1.1:47108: EOF 2018/08/02 11:18:14 http: TLS handshake error from 10.244.1.1:47114: EOF 2018/08/02 11:18:24 http: TLS handshake error from 10.244.1.1:47120: EOF level=info timestamp=2018-08-02T11:18:27.854857Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:18:34 http: TLS handshake error from 10.244.1.1:47126: EOF 2018/08/02 11:18:44 http: TLS handshake error from 10.244.1.1:47132: EOF 2018/08/02 11:18:54 http: TLS handshake error from 10.244.1.1:47138: EOF level=info timestamp=2018-08-02T11:18:57.894899Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:19:04 http: TLS handshake error from 10.244.1.1:47144: EOF 2018/08/02 11:19:14 http: TLS handshake error from 10.244.1.1:47150: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:17:54.561450Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:17:57 http: TLS handshake error from 10.244.0.1:48474: EOF 2018/08/02 11:18:07 http: TLS handshake error from 10.244.0.1:48498: EOF 2018/08/02 11:18:17 http: TLS handshake error from 10.244.0.1:48522: EOF level=info timestamp=2018-08-02T11:18:22.503636Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:18:24.591798Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:18:27 http: TLS handshake error from 10.244.0.1:48546: EOF 2018/08/02 11:18:37 http: TLS handshake error from 10.244.0.1:48570: EOF 2018/08/02 11:18:47 http: TLS handshake error from 10.244.0.1:48594: EOF level=info timestamp=2018-08-02T11:18:52.536591Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:18:54.620237Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:18:57 http: TLS handshake error from 10.244.0.1:48618: EOF level=info timestamp=2018-08-02T11:19:03.427784Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:19:03.428556Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:19:07 http: TLS handshake error from 10.244.0.1:48642: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:01:12.860307Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmidpssk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmidpssk" level=info timestamp=2018-08-02T11:04:13.253495Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:04:13.253707Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:04:13.297083Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizdfkc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizdfkc" level=info timestamp=2018-08-02T11:07:13.728296Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:07:13.729703Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:07:13.787990Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9958g\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9958g" level=info timestamp=2018-08-02T11:10:14.210084Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:10:14.211228Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:10:14.270263Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij2r7z\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" level=info timestamp=2018-08-02T11:13:14.688412Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:13:14.689626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:13:14.772648Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij5sfj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" level=info timestamp=2018-08-02T11:16:15.159586Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:16:15.160819Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:17:10.100884Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:17:10.101656Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:17:10.101750Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmijq6lc" level=info timestamp=2018-08-02T11:17:51.062668Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmijq6lc, existing: true\n" level=info timestamp=2018-08-02T11:17:51.062992Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:17:51.063093Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:17:51.063503Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:17:51.065378Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:17:51.065578Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmijq6lc" level=info timestamp=2018-08-02T11:19:12.985839Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmijq6lc, existing: true\n" level=info timestamp=2018-08-02T11:19:12.985931Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:19:12.985972Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:19:12.986063Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:19:12.987093Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:19:12.987674Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmijq6lc" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:16:15.357977Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.379855Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.379943Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: true\n" level=info timestamp=2018-08-02T11:16:15.379961Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:16:15.379982Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.380040Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.380111Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.385725Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:16:15.385761Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.385806Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.385859Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:18:58.073553Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:18:58.073650Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:18:58.073746Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:18:58.073868Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmijq6lc-xkltq Pod phase: Running level=info timestamp=2018-08-02T11:16:18.711628Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:16:18.711903Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:16:18.713878Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:16:28.719157Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:16:28.771493Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmijq6lc" level=info timestamp=2018-08-02T11:16:28.773048Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:16:28.773225Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.465 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Killed VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:997 should be in Failed phase [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:998 Unexpected Warning event received: testvmijq6lc,78a008cb-9645-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ STEP: Starting a VirtualMachineInstance level=info timestamp=2018-08-02T11:16:15.913664Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmijq6lc kind=VirtualMachineInstance uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmijq6lc-xkltq" level=info timestamp=2018-08-02T11:16:29.802222Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmijq6lc kind=VirtualMachineInstance uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmijq6lc-xkltq" level=error timestamp=2018-08-02T11:16:29.820308Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmijq6lc kind=VirtualMachineInstance uid=78a008cb-9645-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:17:44 http: TLS handshake error from 10.244.1.1:47096: EOF 2018/08/02 11:17:54 http: TLS handshake error from 10.244.1.1:47102: EOF level=info timestamp=2018-08-02T11:17:57.881453Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:18:04 http: TLS handshake error from 10.244.1.1:47108: EOF 2018/08/02 11:18:14 http: TLS handshake error from 10.244.1.1:47114: EOF 2018/08/02 11:18:24 http: TLS handshake error from 10.244.1.1:47120: EOF level=info timestamp=2018-08-02T11:18:27.854857Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:18:34 http: TLS handshake error from 10.244.1.1:47126: EOF 2018/08/02 11:18:44 http: TLS handshake error from 10.244.1.1:47132: EOF 2018/08/02 11:18:54 http: TLS handshake error from 10.244.1.1:47138: EOF level=info timestamp=2018-08-02T11:18:57.894899Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:19:04 http: TLS handshake error from 10.244.1.1:47144: EOF 2018/08/02 11:19:14 http: TLS handshake error from 10.244.1.1:47150: EOF 2018/08/02 11:19:24 http: TLS handshake error from 10.244.1.1:47156: EOF level=info timestamp=2018-08-02T11:19:27.845442Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:18:22.503636Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:18:24.591798Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:18:27 http: TLS handshake error from 10.244.0.1:48546: EOF 2018/08/02 11:18:37 http: TLS handshake error from 10.244.0.1:48570: EOF 2018/08/02 11:18:47 http: TLS handshake error from 10.244.0.1:48594: EOF level=info timestamp=2018-08-02T11:18:52.536591Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:18:54.620237Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:18:57 http: TLS handshake error from 10.244.0.1:48618: EOF level=info timestamp=2018-08-02T11:19:03.427784Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:19:03.428556Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:19:07 http: TLS handshake error from 10.244.0.1:48642: EOF 2018/08/02 11:19:17 http: TLS handshake error from 10.244.0.1:48666: EOF level=info timestamp=2018-08-02T11:19:22.565096Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:19:24.644148Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:19:27 http: TLS handshake error from 10.244.0.1:48690: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:04:13.253707Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:04:13.297083Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizdfkc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizdfkc" level=info timestamp=2018-08-02T11:07:13.728296Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:07:13.729703Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:07:13.787990Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9958g\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9958g" level=info timestamp=2018-08-02T11:10:14.210084Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:10:14.211228Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:10:14.270263Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij2r7z\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" level=info timestamp=2018-08-02T11:13:14.688412Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:13:14.689626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:13:14.772648Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij5sfj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" level=info timestamp=2018-08-02T11:16:15.159586Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:16:15.160819Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:19:15.629102Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:19:15.629298Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:19:29.876952Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:19:29.877341Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:19:29.877414Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmimk8z2" level=info timestamp=2018-08-02T11:19:29.897622Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmimk8z2, existing: true\n" level=info timestamp=2018-08-02T11:19:29.897688Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:19:29.897714Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:19:29.897801Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:19:29.898295Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:19:29.898374Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmimk8z2" level=info timestamp=2018-08-02T11:19:29.938647Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmimk8z2, existing: true\n" level=info timestamp=2018-08-02T11:19:29.938701Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:19:29.938732Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:19:29.938810Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:19:29.939431Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:19:29.939511Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmimk8z2" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:16:15.357977Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.379855Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.379943Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: true\n" level=info timestamp=2018-08-02T11:16:15.379961Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:16:15.379982Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.380040Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.380111Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.385725Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:16:15.385761Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.385806Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.385859Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:18:58.073553Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:18:58.073650Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:18:58.073746Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:18:58.073868Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmijq6lc-xkltq Pod phase: Pending Pod name: virt-launcher-testvmimk8z2-456vg Pod phase: Running level=info timestamp=2018-08-02T11:19:19.152410Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:19:19.152698Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:19:19.154030Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:19:29.161045Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:19:29.208932Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmimk8z2" level=info timestamp=2018-08-02T11:19:29.211034Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:19:29.211227Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running level=info timestamp=2018-08-02T11:20:27.867093Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:20:34 http: TLS handshake error from 10.244.1.1:47198: EOF 2018/08/02 11:20:44 http: TLS handshake error from 10.244.1.1:47204: EOF 2018/08/02 11:20:54 http: TLS handshake error from 10.244.1.1:47210: EOF level=info timestamp=2018-08-02T11:20:57.872769Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:21:04 http: TLS handshake error from 10.244.1.1:47216: EOF 2018/08/02 11:21:14 http: TLS handshake error from 10.244.1.1:47222: EOF 2018/08/02 11:21:24 http: TLS handshake error from 10.244.1.1:47228: EOF level=info timestamp=2018-08-02T11:21:27.856037Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:21:34 http: TLS handshake error from 10.244.1.1:47234: EOF 2018/08/02 11:21:44 http: TLS handshake error from 10.244.1.1:47240: EOF 2018/08/02 11:21:54 http: TLS handshake error from 10.244.1.1:47246: EOF level=info timestamp=2018-08-02T11:21:57.852814Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:22:04 http: TLS handshake error from 10.244.1.1:47252: EOF 2018/08/02 11:22:14 http: TLS handshake error from 10.244.1.1:47258: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:20:54.737733Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:20:57 http: TLS handshake error from 10.244.0.1:48906: EOF 2018/08/02 11:21:07 http: TLS handshake error from 10.244.0.1:48930: EOF 2018/08/02 11:21:17 http: TLS handshake error from 10.244.0.1:48954: EOF level=info timestamp=2018-08-02T11:21:22.724417Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:21:24.761855Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:21:27 http: TLS handshake error from 10.244.0.1:48978: EOF 2018/08/02 11:21:37 http: TLS handshake error from 10.244.0.1:49002: EOF 2018/08/02 11:21:47 http: TLS handshake error from 10.244.0.1:49026: EOF level=info timestamp=2018-08-02T11:21:52.755206Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:21:54.789257Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:21:57 http: TLS handshake error from 10.244.0.1:49050: EOF level=info timestamp=2018-08-02T11:22:03.432566Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:22:03.433580Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:22:07 http: TLS handshake error from 10.244.0.1:49074: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:04:13.253707Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmizdfkc kind= uid=ca55c7bf-9643-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:04:13.297083Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmizdfkc\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmizdfkc" level=info timestamp=2018-08-02T11:07:13.728296Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:07:13.729703Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:07:13.787990Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9958g\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9958g" level=info timestamp=2018-08-02T11:10:14.210084Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:10:14.211228Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:10:14.270263Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij2r7z\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" level=info timestamp=2018-08-02T11:13:14.688412Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:13:14.689626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:13:14.772648Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij5sfj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" level=info timestamp=2018-08-02T11:16:15.159586Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:16:15.160819Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:19:15.629102Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:19:15.629298Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:20:51.791139Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:20:51.791168Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:20:51.791259Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:20:51.792381Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:20:51.792473Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmimk8z2" level=info timestamp=2018-08-02T11:21:56.828003Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmijq6lc, existing: false\n" level=info timestamp=2018-08-02T11:21:56.828097Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:21:56.828201Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmijq6lc kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:21:56.828303Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmijq6lc kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:22:13.712781Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmimk8z2, existing: true\n" level=info timestamp=2018-08-02T11:22:13.712876Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:22:13.712948Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:22:13.713035Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:22:13.713759Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:22:13.714505Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmimk8z2" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:16:15.357977Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.379855Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.379943Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: true\n" level=info timestamp=2018-08-02T11:16:15.379961Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:16:15.379982Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.380040Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.380111Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.385725Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:16:15.385761Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.385806Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.385859Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:18:58.073553Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:18:58.073650Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:18:58.073746Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:18:58.073868Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmimk8z2-456vg Pod phase: Running level=info timestamp=2018-08-02T11:19:19.152410Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:19:19.152698Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:19:19.154030Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:19:29.161045Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:19:29.208932Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmimk8z2" level=info timestamp=2018-08-02T11:19:29.211034Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:19:29.211227Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.475 seconds] VMIlifecycle /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:52 Killed VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:997 should be left alone by virt-handler [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_lifecycle_test.go:1025 Unexpected Warning event received: testvmimk8z2,e4315c8e-9645-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ STEP: Starting a VirtualMachineInstance level=info timestamp=2018-08-02T11:19:16.378592Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmimk8z2 kind=VirtualMachineInstance uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmimk8z2-456vg" level=info timestamp=2018-08-02T11:19:30.541768Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmimk8z2 kind=VirtualMachineInstance uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmimk8z2-456vg" level=error timestamp=2018-08-02T11:19:30.549527Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmimk8z2 kind=VirtualMachineInstance uid=e4315c8e-9645-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" • Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:20:44 http: TLS handshake error from 10.244.1.1:47204: EOF 2018/08/02 11:20:54 http: TLS handshake error from 10.244.1.1:47210: EOF level=info timestamp=2018-08-02T11:20:57.872769Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:21:04 http: TLS handshake error from 10.244.1.1:47216: EOF 2018/08/02 11:21:14 http: TLS handshake error from 10.244.1.1:47222: EOF 2018/08/02 11:21:24 http: TLS handshake error from 10.244.1.1:47228: EOF level=info timestamp=2018-08-02T11:21:27.856037Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:21:34 http: TLS handshake error from 10.244.1.1:47234: EOF 2018/08/02 11:21:44 http: TLS handshake error from 10.244.1.1:47240: EOF 2018/08/02 11:21:54 http: TLS handshake error from 10.244.1.1:47246: EOF level=info timestamp=2018-08-02T11:21:57.852814Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:22:04 http: TLS handshake error from 10.244.1.1:47252: EOF 2018/08/02 11:22:14 http: TLS handshake error from 10.244.1.1:47258: EOF 2018/08/02 11:22:24 http: TLS handshake error from 10.244.1.1:47264: EOF level=info timestamp=2018-08-02T11:22:27.869475Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:21:24.761855Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:21:27 http: TLS handshake error from 10.244.0.1:48978: EOF 2018/08/02 11:21:37 http: TLS handshake error from 10.244.0.1:49002: EOF 2018/08/02 11:21:47 http: TLS handshake error from 10.244.0.1:49026: EOF level=info timestamp=2018-08-02T11:21:52.755206Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:21:54.789257Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:21:57 http: TLS handshake error from 10.244.0.1:49050: EOF level=info timestamp=2018-08-02T11:22:03.432566Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:22:03.433580Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:22:07 http: TLS handshake error from 10.244.0.1:49074: EOF level=info timestamp=2018-08-02T11:22:16.487668Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2/version proto=HTTP/2.0 statusCode=200 contentLength=247 2018/08/02 11:22:17 http: TLS handshake error from 10.244.0.1:49098: EOF level=info timestamp=2018-08-02T11:22:22.821910Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:22:24.822465Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:22:27 http: TLS handshake error from 10.244.0.1:49122: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:07:13.728296Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:07:13.729703Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:07:13.787990Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9958g\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9958g" level=info timestamp=2018-08-02T11:10:14.210084Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:10:14.211228Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:10:14.270263Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij2r7z\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" level=info timestamp=2018-08-02T11:13:14.688412Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:13:14.689626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:13:14.772648Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij5sfj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" level=info timestamp=2018-08-02T11:16:15.159586Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:16:15.160819Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:19:15.629102Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:19:15.629298Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:22:16.153010Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:22:16.154128Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:22:30.431890Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:22:30.432420Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:22:30.432499Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi297qm" level=info timestamp=2018-08-02T11:22:30.452649Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi297qm, existing: true\n" level=info timestamp=2018-08-02T11:22:30.452758Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:22:30.452781Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:22:30.452856Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:22:30.453337Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:22:30.453426Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi297qm" level=info timestamp=2018-08-02T11:22:30.493711Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi297qm, existing: true\n" level=info timestamp=2018-08-02T11:22:30.493793Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:22:30.493818Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:22:30.493893Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:22:30.494437Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:22:30.494525Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi297qm" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:16:15.357977Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.379855Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.379943Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: true\n" level=info timestamp=2018-08-02T11:16:15.379961Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:16:15.379982Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.380040Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.380111Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.385725Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:16:15.385761Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.385806Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.385859Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:18:58.073553Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:18:58.073650Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:18:58.073746Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:18:58.073868Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi297qm-6qf96 Pod phase: Running level=info timestamp=2018-08-02T11:22:20.216220Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:22:20.216655Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[OnDefineDomain:[0xc4202aca00]]" level=info timestamp=2018-08-02T11:22:20.218366Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:22:30.226528Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:22:30.250322Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi297qm" level=info timestamp=2018-08-02T11:22:30.251814Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:22:30.252045Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmimk8z2-456vg Pod phase: Pending Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running level=info timestamp=2018-08-02T11:23:27.874821Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:23:34 http: TLS handshake error from 10.244.1.1:47306: EOF 2018/08/02 11:23:44 http: TLS handshake error from 10.244.1.1:47312: EOF 2018/08/02 11:23:54 http: TLS handshake error from 10.244.1.1:47318: EOF level=info timestamp=2018-08-02T11:23:57.870142Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:24:04 http: TLS handshake error from 10.244.1.1:47324: EOF 2018/08/02 11:24:14 http: TLS handshake error from 10.244.1.1:47330: EOF 2018/08/02 11:24:24 http: TLS handshake error from 10.244.1.1:47336: EOF level=info timestamp=2018-08-02T11:24:27.875210Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:24:34 http: TLS handshake error from 10.244.1.1:47342: EOF 2018/08/02 11:24:44 http: TLS handshake error from 10.244.1.1:47348: EOF 2018/08/02 11:24:54 http: TLS handshake error from 10.244.1.1:47354: EOF level=info timestamp=2018-08-02T11:24:57.857340Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:25:04 http: TLS handshake error from 10.244.1.1:47360: EOF 2018/08/02 11:25:14 http: TLS handshake error from 10.244.1.1:47366: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:24:03.425850Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:24:03.426633Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:24:07 http: TLS handshake error from 10.244.0.1:49362: EOF 2018/08/02 11:24:17 http: TLS handshake error from 10.244.0.1:49386: EOF level=info timestamp=2018-08-02T11:24:22.939854Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:24:24.943511Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:24:27 http: TLS handshake error from 10.244.0.1:49410: EOF 2018/08/02 11:24:37 http: TLS handshake error from 10.244.0.1:49434: EOF 2018/08/02 11:24:47 http: TLS handshake error from 10.244.0.1:49458: EOF level=info timestamp=2018-08-02T11:24:52.966645Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:24:54.975444Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:24:57 http: TLS handshake error from 10.244.0.1:49482: EOF level=info timestamp=2018-08-02T11:25:03.427764Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:25:03.428965Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:25:07 http: TLS handshake error from 10.244.0.1:49506: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:07:13.728296Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:07:13.729703Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9958g kind= uid=35e78836-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:07:13.787990Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9958g\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9958g" level=info timestamp=2018-08-02T11:10:14.210084Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:10:14.211228Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:10:14.270263Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij2r7z\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" level=info timestamp=2018-08-02T11:13:14.688412Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:13:14.689626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:13:14.772648Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij5sfj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" level=info timestamp=2018-08-02T11:16:15.159586Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:16:15.160819Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:19:15.629102Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:19:15.629298Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:22:16.153010Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:22:16.154128Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:23:52.348630Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:23:52.348673Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:23:52.348940Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:23:52.350033Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:23:52.350270Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi297qm" level=info timestamp=2018-08-02T11:24:57.554995Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmimk8z2, existing: false\n" level=info timestamp=2018-08-02T11:24:57.555084Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:24:57.555160Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmimk8z2 kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:24:57.555264Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmimk8z2 kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:25:14.270489Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi297qm, existing: true\n" level=info timestamp=2018-08-02T11:25:14.270636Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:25:14.270701Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:25:14.270801Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:25:14.271573Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:25:14.271688Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi297qm" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:16:15.357977Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.379855Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.379943Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: true\n" level=info timestamp=2018-08-02T11:16:15.379961Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:16:15.379982Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.380040Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.380111Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.385725Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:16:15.385761Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.385806Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.385859Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:18:58.073553Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:18:58.073650Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:18:58.073746Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:18:58.073868Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi297qm-6qf96 Pod phase: Running level=info timestamp=2018-08-02T11:22:20.216220Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:22:20.216655Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[OnDefineDomain:[0xc4202aca00]]" level=info timestamp=2018-08-02T11:22:20.218366Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:22:30.226528Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:22:30.250322Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi297qm" level=info timestamp=2018-08-02T11:22:30.251814Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:22:30.252045Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure [180.297 seconds] HookSidecars /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:40 VMI definition /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:58 with SM BIOS hook sidecar /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:59 should successfully start with hook sidecar annotation [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:60 Unexpected Warning event received: testvmi297qm,4fcb207a-9646-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ STEP: Starting a VMI level=info timestamp=2018-08-02T11:22:16.974825Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmi297qm kind=VirtualMachineInstance uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi297qm-6qf96" level=info timestamp=2018-08-02T11:22:31.085627Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmi297qm kind=VirtualMachineInstance uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmi297qm-6qf96" level=error timestamp=2018-08-02T11:22:31.102621Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmi297qm kind=VirtualMachineInstance uid=4fcb207a-9646-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:23:44 http: TLS handshake error from 10.244.1.1:47312: EOF 2018/08/02 11:23:54 http: TLS handshake error from 10.244.1.1:47318: EOF level=info timestamp=2018-08-02T11:23:57.870142Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:24:04 http: TLS handshake error from 10.244.1.1:47324: EOF 2018/08/02 11:24:14 http: TLS handshake error from 10.244.1.1:47330: EOF 2018/08/02 11:24:24 http: TLS handshake error from 10.244.1.1:47336: EOF level=info timestamp=2018-08-02T11:24:27.875210Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:24:34 http: TLS handshake error from 10.244.1.1:47342: EOF 2018/08/02 11:24:44 http: TLS handshake error from 10.244.1.1:47348: EOF 2018/08/02 11:24:54 http: TLS handshake error from 10.244.1.1:47354: EOF level=info timestamp=2018-08-02T11:24:57.857340Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:25:04 http: TLS handshake error from 10.244.1.1:47360: EOF 2018/08/02 11:25:14 http: TLS handshake error from 10.244.1.1:47366: EOF 2018/08/02 11:25:24 http: TLS handshake error from 10.244.1.1:47372: EOF level=info timestamp=2018-08-02T11:25:27.876111Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:24:22.939854Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:24:24.943511Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:24:27 http: TLS handshake error from 10.244.0.1:49410: EOF 2018/08/02 11:24:37 http: TLS handshake error from 10.244.0.1:49434: EOF 2018/08/02 11:24:47 http: TLS handshake error from 10.244.0.1:49458: EOF level=info timestamp=2018-08-02T11:24:52.966645Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:24:54.975444Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:24:57 http: TLS handshake error from 10.244.0.1:49482: EOF level=info timestamp=2018-08-02T11:25:03.427764Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:25:03.428965Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:25:07 http: TLS handshake error from 10.244.0.1:49506: EOF 2018/08/02 11:25:17 http: TLS handshake error from 10.244.0.1:49530: EOF level=info timestamp=2018-08-02T11:25:22.994254Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:25:25.002193Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:25:27 http: TLS handshake error from 10.244.0.1:49554: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:10:14.210084Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:10:14.211228Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:10:14.270263Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij2r7z\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" level=info timestamp=2018-08-02T11:13:14.688412Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:13:14.689626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:13:14.772648Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij5sfj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" level=info timestamp=2018-08-02T11:16:15.159586Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:16:15.160819Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:19:15.629102Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:19:15.629298Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:22:16.153010Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:22:16.154128Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:25:16.610378Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:25:16.611641Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:25:16.666196Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7vvwm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7vvwm" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:25:31.450947Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:25:31.451247Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:25:31.451325Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi7vvwm" level=info timestamp=2018-08-02T11:25:31.471499Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi7vvwm, existing: true\n" level=info timestamp=2018-08-02T11:25:31.471571Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:25:31.471595Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:25:31.471671Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:25:31.472092Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:25:31.472166Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi7vvwm" level=info timestamp=2018-08-02T11:25:31.512519Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi7vvwm, existing: true\n" level=info timestamp=2018-08-02T11:25:31.512645Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:25:31.512677Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:25:31.512805Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:25:31.513488Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:25:31.513626Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi7vvwm" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:16:15.357977Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.379855Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.379943Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: true\n" level=info timestamp=2018-08-02T11:16:15.379961Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:16:15.379982Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.380040Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.380111Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.385725Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:16:15.385761Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.385806Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.385859Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:18:58.073553Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:18:58.073650Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:18:58.073746Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:18:58.073868Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi297qm-6qf96 Pod phase: Failed Unable to retrieve container logs for docker://bde5fe9c0a76aa3e0d2903e0007136026e3a672be3795d4d537976ffc5917366 Pod name: virt-launcher-testvmi7vvwm-c76q2 Pod phase: Running level=info timestamp=2018-08-02T11:25:21.087154Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:25:21.087583Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[OnDefineDomain:[0xc4202a87c0]]" level=info timestamp=2018-08-02T11:25:21.089753Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:25:31.095987Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:25:31.118138Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi7vvwm" level=info timestamp=2018-08-02T11:25:31.119342Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:25:31.119521Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running level=info timestamp=2018-08-02T11:26:27.860968Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:26:34 http: TLS handshake error from 10.244.1.1:47414: EOF 2018/08/02 11:26:44 http: TLS handshake error from 10.244.1.1:47420: EOF 2018/08/02 11:26:54 http: TLS handshake error from 10.244.1.1:47426: EOF level=info timestamp=2018-08-02T11:26:57.865973Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:27:04 http: TLS handshake error from 10.244.1.1:47432: EOF 2018/08/02 11:27:14 http: TLS handshake error from 10.244.1.1:47438: EOF 2018/08/02 11:27:24 http: TLS handshake error from 10.244.1.1:47444: EOF level=info timestamp=2018-08-02T11:27:27.853585Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:27:34 http: TLS handshake error from 10.244.1.1:47450: EOF 2018/08/02 11:27:44 http: TLS handshake error from 10.244.1.1:47456: EOF 2018/08/02 11:27:54 http: TLS handshake error from 10.244.1.1:47462: EOF level=info timestamp=2018-08-02T11:27:57.866811Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:28:04 http: TLS handshake error from 10.244.1.1:47468: EOF 2018/08/02 11:28:14 http: TLS handshake error from 10.244.1.1:47474: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:26:55.086665Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:26:57 http: TLS handshake error from 10.244.0.1:49770: EOF level=info timestamp=2018-08-02T11:27:03.430172Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:27:03.431125Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:27:07 http: TLS handshake error from 10.244.0.1:49794: EOF 2018/08/02 11:27:17 http: TLS handshake error from 10.244.0.1:49818: EOF level=info timestamp=2018-08-02T11:27:23.145884Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:27:25.108201Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:27:27 http: TLS handshake error from 10.244.0.1:49842: EOF 2018/08/02 11:27:37 http: TLS handshake error from 10.244.0.1:49866: EOF 2018/08/02 11:27:47 http: TLS handshake error from 10.244.0.1:49890: EOF level=info timestamp=2018-08-02T11:27:53.176236Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:27:55.136051Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:27:57 http: TLS handshake error from 10.244.0.1:49914: EOF 2018/08/02 11:28:07 http: TLS handshake error from 10.244.0.1:49938: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:10:14.210084Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:10:14.211228Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij2r7z kind= uid=a17b8941-9644-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:10:14.270263Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij2r7z\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" level=info timestamp=2018-08-02T11:13:14.688412Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:13:14.689626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:13:14.772648Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij5sfj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" level=info timestamp=2018-08-02T11:16:15.159586Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:16:15.160819Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:19:15.629102Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:19:15.629298Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:22:16.153010Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:22:16.154128Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:25:16.610378Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:25:16.611641Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:25:16.666196Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7vvwm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7vvwm" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:26:53.368822Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:26:53.368846Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:26:53.368924Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:26:53.369503Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:26:53.369606Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi7vvwm" level=info timestamp=2018-08-02T11:27:58.115746Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi297qm, existing: false\n" level=info timestamp=2018-08-02T11:27:58.115817Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:27:58.115877Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi297qm kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:27:58.115958Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi297qm kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:28:15.289963Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi7vvwm, existing: true\n" level=info timestamp=2018-08-02T11:28:15.290043Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:28:15.290075Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:28:15.290168Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:28:15.290893Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:28:15.291007Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi7vvwm" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:16:15.357977Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.379855Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.379943Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: true\n" level=info timestamp=2018-08-02T11:16:15.379961Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:16:15.379982Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.380040Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.380111Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.385725Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:16:15.385761Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.385806Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.385859Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:18:58.073553Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:18:58.073650Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:18:58.073746Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:18:58.073868Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi7vvwm-c76q2 Pod phase: Running level=info timestamp=2018-08-02T11:25:21.087154Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:25:21.087583Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[OnDefineDomain:[0xc4202a87c0]]" level=info timestamp=2018-08-02T11:25:21.089753Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:25:31.095987Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:25:31.118138Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi7vvwm" level=info timestamp=2018-08-02T11:25:31.119342Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:25:31.119521Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.450 seconds] HookSidecars /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:40 VMI definition /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:58 with SM BIOS hook sidecar /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:59 should call Collect and OnDefineDomain on the hook sidecar [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:67 Unexpected Warning event received: testvmi7vvwm,bb5aced4-9646-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ STEP: Getting hook-sidecar logs level=info timestamp=2018-08-02T11:25:17.390760Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmi7vvwm kind=VirtualMachineInstance uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi7vvwm-c76q2" level=info timestamp=2018-08-02T11:25:32.115500Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmi7vvwm kind=VirtualMachineInstance uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmi7vvwm-c76q2" level=error timestamp=2018-08-02T11:25:32.122899Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmi7vvwm kind=VirtualMachineInstance uid=bb5aced4-9646-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:26:44 http: TLS handshake error from 10.244.1.1:47420: EOF 2018/08/02 11:26:54 http: TLS handshake error from 10.244.1.1:47426: EOF level=info timestamp=2018-08-02T11:26:57.865973Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:27:04 http: TLS handshake error from 10.244.1.1:47432: EOF 2018/08/02 11:27:14 http: TLS handshake error from 10.244.1.1:47438: EOF 2018/08/02 11:27:24 http: TLS handshake error from 10.244.1.1:47444: EOF level=info timestamp=2018-08-02T11:27:27.853585Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:27:34 http: TLS handshake error from 10.244.1.1:47450: EOF 2018/08/02 11:27:44 http: TLS handshake error from 10.244.1.1:47456: EOF 2018/08/02 11:27:54 http: TLS handshake error from 10.244.1.1:47462: EOF level=info timestamp=2018-08-02T11:27:57.866811Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:28:04 http: TLS handshake error from 10.244.1.1:47468: EOF 2018/08/02 11:28:14 http: TLS handshake error from 10.244.1.1:47474: EOF 2018/08/02 11:28:24 http: TLS handshake error from 10.244.1.1:47480: EOF level=info timestamp=2018-08-02T11:28:27.876860Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-api-7d79764579-qbwqf Pod phase: Running 2018/08/02 11:27:07 http: TLS handshake error from 10.244.0.1:49794: EOF 2018/08/02 11:27:17 http: TLS handshake error from 10.244.0.1:49818: EOF level=info timestamp=2018-08-02T11:27:23.145884Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:27:25.108201Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:27:27 http: TLS handshake error from 10.244.0.1:49842: EOF 2018/08/02 11:27:37 http: TLS handshake error from 10.244.0.1:49866: EOF 2018/08/02 11:27:47 http: TLS handshake error from 10.244.0.1:49890: EOF level=info timestamp=2018-08-02T11:27:53.176236Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:27:55.136051Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:27:57 http: TLS handshake error from 10.244.0.1:49914: EOF 2018/08/02 11:28:07 http: TLS handshake error from 10.244.0.1:49938: EOF 2018/08/02 11:28:17 http: TLS handshake error from 10.244.0.1:49962: EOF level=info timestamp=2018-08-02T11:28:23.212843Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:28:25.159361Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:28:27 http: TLS handshake error from 10.244.0.1:49986: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:10:14.270263Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij2r7z\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" level=info timestamp=2018-08-02T11:13:14.688412Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:13:14.689626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:13:14.772648Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij5sfj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" level=info timestamp=2018-08-02T11:16:15.159586Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:16:15.160819Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:19:15.629102Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:19:15.629298Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:22:16.153010Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:22:16.154128Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:25:16.610378Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:25:16.611641Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:25:16.666196Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7vvwm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7vvwm" level=info timestamp=2018-08-02T11:28:17.059002Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:28:17.059780Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:28:33.303442Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:28:33.303856Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:28:33.304024Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmimg6nv" level=info timestamp=2018-08-02T11:28:33.324277Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmimg6nv, existing: true\n" level=info timestamp=2018-08-02T11:28:33.324364Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:28:33.324395Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:28:33.324493Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:28:33.325181Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:28:33.325268Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmimg6nv" level=info timestamp=2018-08-02T11:28:33.365560Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmimg6nv, existing: true\n" level=info timestamp=2018-08-02T11:28:33.365631Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:28:33.365655Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:28:33.365738Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:28:33.366223Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:28:33.366294Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmimg6nv" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:16:15.357977Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.379855Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.379943Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: true\n" level=info timestamp=2018-08-02T11:16:15.379961Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:16:15.379982Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.380040Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.380111Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.385725Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:16:15.385761Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.385806Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.385859Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:18:58.073553Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:18:58.073650Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:18:58.073746Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:18:58.073868Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi7vvwm-c76q2 Pod phase: Failed Pod name: virt-launcher-testvmimg6nv-n4psl Pod phase: Running level=info timestamp=2018-08-02T11:28:22.427338Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:28:22.427701Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[OnDefineDomain:[0xc4203d4c00]]" level=info timestamp=2018-08-02T11:28:22.429672Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:28:32.440636Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:28:32.471624Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmimg6nv" level=info timestamp=2018-08-02T11:28:32.472988Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:28:32.473166Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running level=info timestamp=2018-08-02T11:29:27.856871Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:29:34 http: TLS handshake error from 10.244.1.1:47522: EOF 2018/08/02 11:29:44 http: TLS handshake error from 10.244.1.1:47528: EOF 2018/08/02 11:29:54 http: TLS handshake error from 10.244.1.1:47534: EOF level=info timestamp=2018-08-02T11:29:57.849059Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:30:04 http: TLS handshake error from 10.244.1.1:47540: EOF 2018/08/02 11:30:14 http: TLS handshake error from 10.244.1.1:47546: EOF 2018/08/02 11:30:24 http: TLS handshake error from 10.244.1.1:47552: EOF level=info timestamp=2018-08-02T11:30:27.873926Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:30:34 http: TLS handshake error from 10.244.1.1:47558: EOF 2018/08/02 11:30:44 http: TLS handshake error from 10.244.1.1:47564: EOF 2018/08/02 11:30:54 http: TLS handshake error from 10.244.1.1:47570: EOF level=info timestamp=2018-08-02T11:30:57.849957Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:31:04 http: TLS handshake error from 10.244.1.1:47576: EOF 2018/08/02 11:31:14 http: TLS handshake error from 10.244.1.1:47582: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:29:55.249655Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:29:57 http: TLS handshake error from 10.244.0.1:50202: EOF level=info timestamp=2018-08-02T11:30:03.323853Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:30:03.324945Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:30:07 http: TLS handshake error from 10.244.0.1:50226: EOF 2018/08/02 11:30:17 http: TLS handshake error from 10.244.0.1:50250: EOF level=info timestamp=2018-08-02T11:30:23.332689Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:30:25.280898Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:30:27 http: TLS handshake error from 10.244.0.1:50274: EOF 2018/08/02 11:30:37 http: TLS handshake error from 10.244.0.1:50298: EOF 2018/08/02 11:30:47 http: TLS handshake error from 10.244.0.1:50322: EOF level=info timestamp=2018-08-02T11:30:53.361296Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:30:55.310872Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:30:57 http: TLS handshake error from 10.244.0.1:50346: EOF 2018/08/02 11:31:07 http: TLS handshake error from 10.244.0.1:50370: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:10:14.270263Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij2r7z\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij2r7z" level=info timestamp=2018-08-02T11:13:14.688412Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:13:14.689626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:13:14.772648Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij5sfj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" level=info timestamp=2018-08-02T11:16:15.159586Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:16:15.160819Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:19:15.629102Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:19:15.629298Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:22:16.153010Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:22:16.154128Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:25:16.610378Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:25:16.611641Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:25:16.666196Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7vvwm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7vvwm" level=info timestamp=2018-08-02T11:28:17.059002Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:28:17.059780Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:29:55.217079Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:29:55.217114Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:29:55.217252Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:29:55.218304Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:29:55.218447Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmimg6nv" level=info timestamp=2018-08-02T11:30:59.131316Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi7vvwm, existing: false\n" level=info timestamp=2018-08-02T11:30:59.131412Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:30:59.131480Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi7vvwm kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:30:59.131612Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi7vvwm kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:31:17.138771Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmimg6nv, existing: true\n" level=info timestamp=2018-08-02T11:31:17.138841Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:31:17.138864Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:31:17.138941Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:31:17.139622Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:31:17.139711Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmimg6nv" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:16:15.357977Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.379855Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.379943Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: true\n" level=info timestamp=2018-08-02T11:16:15.379961Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:16:15.379982Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.380040Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.380111Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.385725Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:16:15.385761Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.385806Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.385859Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:18:58.073553Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:18:58.073650Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:18:58.073746Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:18:58.073868Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmimg6nv-n4psl Pod phase: Running level=info timestamp=2018-08-02T11:28:22.427338Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:28:22.427701Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[OnDefineDomain:[0xc4203d4c00]]" level=info timestamp=2018-08-02T11:28:22.429672Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:28:32.440636Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:28:32.471624Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmimg6nv" level=info timestamp=2018-08-02T11:28:32.472988Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:28:32.473166Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [180.447 seconds] HookSidecars /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:40 VMI definition /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:58 with SM BIOS hook sidecar /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:59 should update domain XML with SM BIOS properties [It] /root/go/src/kubevirt.io/kubevirt/tests/vmi_hook_sidecar_test.go:83 Unexpected Warning event received: testvmimg6nv,26e92d25-9647-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ STEP: Reading domain XML using virsh level=info timestamp=2018-08-02T11:28:17.853960Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmimg6nv kind=VirtualMachineInstance uid=26e92d25-9647-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmimg6nv-n4psl" level=info timestamp=2018-08-02T11:28:33.954142Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmimg6nv kind=VirtualMachineInstance uid=26e92d25-9647-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmimg6nv-n4psl" level=error timestamp=2018-08-02T11:28:33.973623Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmimg6nv kind=VirtualMachineInstance uid=26e92d25-9647-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:29:44 http: TLS handshake error from 10.244.1.1:47528: EOF 2018/08/02 11:29:54 http: TLS handshake error from 10.244.1.1:47534: EOF level=info timestamp=2018-08-02T11:29:57.849059Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:30:04 http: TLS handshake error from 10.244.1.1:47540: EOF 2018/08/02 11:30:14 http: TLS handshake error from 10.244.1.1:47546: EOF 2018/08/02 11:30:24 http: TLS handshake error from 10.244.1.1:47552: EOF level=info timestamp=2018-08-02T11:30:27.873926Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:30:34 http: TLS handshake error from 10.244.1.1:47558: EOF 2018/08/02 11:30:44 http: TLS handshake error from 10.244.1.1:47564: EOF 2018/08/02 11:30:54 http: TLS handshake error from 10.244.1.1:47570: EOF level=info timestamp=2018-08-02T11:30:57.849957Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:31:04 http: TLS handshake error from 10.244.1.1:47576: EOF 2018/08/02 11:31:14 http: TLS handshake error from 10.244.1.1:47582: EOF 2018/08/02 11:31:24 http: TLS handshake error from 10.244.1.1:47588: EOF level=info timestamp=2018-08-02T11:31:27.866812Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-api-7d79764579-qbwqf Pod phase: Running 2018/08/02 11:30:07 http: TLS handshake error from 10.244.0.1:50226: EOF 2018/08/02 11:30:17 http: TLS handshake error from 10.244.0.1:50250: EOF level=info timestamp=2018-08-02T11:30:23.332689Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:30:25.280898Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:30:27 http: TLS handshake error from 10.244.0.1:50274: EOF 2018/08/02 11:30:37 http: TLS handshake error from 10.244.0.1:50298: EOF 2018/08/02 11:30:47 http: TLS handshake error from 10.244.0.1:50322: EOF level=info timestamp=2018-08-02T11:30:53.361296Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:30:55.310872Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:30:57 http: TLS handshake error from 10.244.0.1:50346: EOF 2018/08/02 11:31:07 http: TLS handshake error from 10.244.0.1:50370: EOF 2018/08/02 11:31:17 http: TLS handshake error from 10.244.0.1:50394: EOF level=info timestamp=2018-08-02T11:31:23.391300Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:31:25.341864Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:31:27 http: TLS handshake error from 10.244.0.1:50418: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:13:14.689626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:13:14.772648Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij5sfj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" level=info timestamp=2018-08-02T11:16:15.159586Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:16:15.160819Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:19:15.629102Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:19:15.629298Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:22:16.153010Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:22:16.154128Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:25:16.610378Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:25:16.611641Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:25:16.666196Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7vvwm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7vvwm" level=info timestamp=2018-08-02T11:28:17.059002Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:28:17.059780Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:31:17.509932Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:31:17.511446Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:31:31.951762Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:31:31.952130Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:31:31.952220Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmibm56g" level=info timestamp=2018-08-02T11:31:31.972424Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmibm56g, existing: true\n" level=info timestamp=2018-08-02T11:31:31.972501Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:31:31.972531Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:31:31.972634Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:31:31.973072Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:31:31.973150Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmibm56g" level=info timestamp=2018-08-02T11:31:32.014696Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmibm56g, existing: true\n" level=info timestamp=2018-08-02T11:31:32.014800Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:31:32.014832Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:31:32.014932Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:31:32.015536Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:31:32.015652Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmibm56g" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:16:15.357977Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.379855Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.379943Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: true\n" level=info timestamp=2018-08-02T11:16:15.379961Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:16:15.379982Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.380040Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.380111Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.385725Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:16:15.385761Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.385806Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.385859Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:18:58.073553Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:18:58.073650Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:18:58.073746Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:18:58.073868Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmibm56g-frzz6 Pod phase: Running level=info timestamp=2018-08-02T11:31:21.160303Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:31:21.160608Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:31:21.163078Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:31:31.167930Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:31:31.209874Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmibm56g" level=info timestamp=2018-08-02T11:31:31.211563Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:31:31.211809Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmimg6nv-n4psl Pod phase: Pending Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running level=info timestamp=2018-08-02T11:35:27.852505Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:35:34 http: TLS handshake error from 10.244.1.1:47738: EOF 2018/08/02 11:35:44 http: TLS handshake error from 10.244.1.1:47744: EOF 2018/08/02 11:35:54 http: TLS handshake error from 10.244.1.1:47750: EOF level=info timestamp=2018-08-02T11:35:57.862077Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:36:04 http: TLS handshake error from 10.244.1.1:47756: EOF 2018/08/02 11:36:14 http: TLS handshake error from 10.244.1.1:47762: EOF 2018/08/02 11:36:24 http: TLS handshake error from 10.244.1.1:47768: EOF level=info timestamp=2018-08-02T11:36:27.852355Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:36:34 http: TLS handshake error from 10.244.1.1:47774: EOF 2018/08/02 11:36:44 http: TLS handshake error from 10.244.1.1:47780: EOF 2018/08/02 11:36:54 http: TLS handshake error from 10.244.1.1:47786: EOF level=info timestamp=2018-08-02T11:36:57.884710Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:37:04 http: TLS handshake error from 10.244.1.1:47792: EOF 2018/08/02 11:37:14 http: TLS handshake error from 10.244.1.1:47798: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running 2018/08/02 11:35:57 http: TLS handshake error from 10.244.0.1:51066: EOF 2018/08/02 11:36:07 http: TLS handshake error from 10.244.0.1:51090: EOF 2018/08/02 11:36:17 http: TLS handshake error from 10.244.0.1:51114: EOF level=info timestamp=2018-08-02T11:36:23.670923Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:36:25.626628Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:36:27 http: TLS handshake error from 10.244.0.1:51138: EOF 2018/08/02 11:36:37 http: TLS handshake error from 10.244.0.1:51162: EOF 2018/08/02 11:36:47 http: TLS handshake error from 10.244.0.1:51186: EOF level=info timestamp=2018-08-02T11:36:53.699242Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:36:55.651924Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:36:57 http: TLS handshake error from 10.244.0.1:51210: EOF level=info timestamp=2018-08-02T11:37:03.478062Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:37:03.479112Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:37:07 http: TLS handshake error from 10.244.0.1:51234: EOF 2018/08/02 11:37:17 http: TLS handshake error from 10.244.0.1:51258: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:13:14.689626Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:13:14.772648Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmij5sfj\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmij5sfj" level=info timestamp=2018-08-02T11:16:15.159586Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:16:15.160819Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:19:15.629102Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:19:15.629298Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:22:16.153010Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:22:16.154128Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:25:16.610378Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:25:16.611641Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:25:16.666196Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7vvwm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7vvwm" level=info timestamp=2018-08-02T11:28:17.059002Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:28:17.059780Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:31:17.509932Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:31:17.511446Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:34:15.789790Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:34:15.789825Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:34:15.789922Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:34:15.790513Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:34:15.790642Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmibm56g" level=info timestamp=2018-08-02T11:36:59.630951Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmibm56g, existing: true\n" level=info timestamp=2018-08-02T11:36:59.631043Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:36:59.631113Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:36:59.631214Z pos=vm.go:421 component=virt-handler namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 msg="No update processing required" level=info timestamp=2018-08-02T11:36:59.643636Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:36:59.643700Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmibm56g, existing: true\n" level=info timestamp=2018-08-02T11:36:59.643723Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:36:59.643759Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:36:59.643800Z pos=vm.go:421 component=virt-handler namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 msg="No update processing required" level=info timestamp=2018-08-02T11:36:59.643837Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:16:15.357977Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.379855Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.379943Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: true\n" level=info timestamp=2018-08-02T11:16:15.379961Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:16:15.379982Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.380040Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.380111Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.385725Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:16:15.385761Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.385806Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.385859Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:18:58.073553Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:18:58.073650Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:18:58.073746Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:18:58.073868Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmibm56g-frzz6 Pod phase: Running level=info timestamp=2018-08-02T11:31:21.160303Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:31:21.160608Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:31:21.163078Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:31:31.167930Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:31:31.209874Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmibm56g" level=info timestamp=2018-08-02T11:31:31.211563Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:31:31.211809Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" panic: timed out waiting for domain to be defined goroutine 1 [running]: main.waitForDomainUUID(0x45d964b800, 0x1444740, 0xc4201f62c0, 0xc4202020e0, 0xc421a6cf60) /root/go/src/kubevirt.io/kubevirt/cmd/virt-launcher/virt-launcher.go:219 +0x2cc main.main() /root/go/src/kubevirt.io/kubevirt/cmd/virt-launcher/virt-launcher.go:333 +0x836 virt-launcher exited with code 2 • Failure [360.446 seconds] RegistryDisk /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:41 Starting and stopping the same VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:90 with ephemeral registry disk /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:91 should success multiple times [It] /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:92 Unexpected Warning event received: testvmibm56g,927749cd-9647-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ STEP: Starting the VirtualMachineInstance level=info timestamp=2018-08-02T11:31:18.246530Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmibm56g kind=VirtualMachineInstance uid=927749cd-9647-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmibm56g-frzz6" level=info timestamp=2018-08-02T11:31:32.610298Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmibm56g kind=VirtualMachineInstance uid=927749cd-9647-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmibm56g-frzz6" level=error timestamp=2018-08-02T11:31:32.629236Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmibm56g kind=VirtualMachineInstance uid=927749cd-9647-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:35:44 http: TLS handshake error from 10.244.1.1:47744: EOF 2018/08/02 11:35:54 http: TLS handshake error from 10.244.1.1:47750: EOF level=info timestamp=2018-08-02T11:35:57.862077Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:36:04 http: TLS handshake error from 10.244.1.1:47756: EOF 2018/08/02 11:36:14 http: TLS handshake error from 10.244.1.1:47762: EOF 2018/08/02 11:36:24 http: TLS handshake error from 10.244.1.1:47768: EOF level=info timestamp=2018-08-02T11:36:27.852355Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:36:34 http: TLS handshake error from 10.244.1.1:47774: EOF 2018/08/02 11:36:44 http: TLS handshake error from 10.244.1.1:47780: EOF 2018/08/02 11:36:54 http: TLS handshake error from 10.244.1.1:47786: EOF level=info timestamp=2018-08-02T11:36:57.884710Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:37:04 http: TLS handshake error from 10.244.1.1:47792: EOF 2018/08/02 11:37:14 http: TLS handshake error from 10.244.1.1:47798: EOF 2018/08/02 11:37:24 http: TLS handshake error from 10.244.1.1:47804: EOF level=info timestamp=2018-08-02T11:37:27.885373Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:36:23.670923Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:36:25.626628Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:36:27 http: TLS handshake error from 10.244.0.1:51138: EOF 2018/08/02 11:36:37 http: TLS handshake error from 10.244.0.1:51162: EOF 2018/08/02 11:36:47 http: TLS handshake error from 10.244.0.1:51186: EOF level=info timestamp=2018-08-02T11:36:53.699242Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:36:55.651924Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:36:57 http: TLS handshake error from 10.244.0.1:51210: EOF level=info timestamp=2018-08-02T11:37:03.478062Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:37:03.479112Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:37:07 http: TLS handshake error from 10.244.0.1:51234: EOF 2018/08/02 11:37:17 http: TLS handshake error from 10.244.0.1:51258: EOF level=info timestamp=2018-08-02T11:37:23.728171Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:37:25.682128Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:37:27 http: TLS handshake error from 10.244.0.1:51282: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:16:15.159586Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:16:15.160819Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:19:15.629102Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:19:15.629298Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:22:16.153010Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:22:16.154128Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:25:16.610378Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:25:16.611641Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:25:16.666196Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7vvwm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7vvwm" level=info timestamp=2018-08-02T11:28:17.059002Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:28:17.059780Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:31:17.509932Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:31:17.511446Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:37:17.962141Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmik5ndd kind= uid=69500acf-9648-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:37:17.963360Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmik5ndd kind= uid=69500acf-9648-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:37:32.407338Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmik5ndd kind= uid=69500acf-9648-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:37:32.407993Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmik5ndd kind= uid=69500acf-9648-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:37:32.408390Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmik5ndd" level=info timestamp=2018-08-02T11:37:32.428631Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmik5ndd, existing: true\n" level=info timestamp=2018-08-02T11:37:32.428695Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:37:32.428742Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:37:32.428849Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmik5ndd kind= uid=69500acf-9648-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:37:32.429625Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmik5ndd kind= uid=69500acf-9648-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:37:32.429852Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmik5ndd" level=info timestamp=2018-08-02T11:37:32.470036Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmik5ndd, existing: true\n" level=info timestamp=2018-08-02T11:37:32.470139Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:37:32.470251Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:37:32.470341Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmik5ndd kind= uid=69500acf-9648-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:37:32.471073Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmik5ndd kind= uid=69500acf-9648-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:37:32.471512Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmik5ndd" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:16:15.357977Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.379855Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.379943Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: true\n" level=info timestamp=2018-08-02T11:16:15.379961Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:16:15.379982Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.380040Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.380111Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.385725Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:16:15.385761Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.385806Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.385859Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:18:58.073553Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:18:58.073650Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:18:58.073746Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:18:58.073868Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmibm56g-frzz6 Pod phase: Failed Unable to retrieve container logs for docker://bdce9289a40d8a549520fac0052112169dfafdf51f54553541eb12805b9514da Pod name: virt-launcher-testvmik5ndd-z745q Pod phase: Running level=info timestamp=2018-08-02T11:37:20.919258Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:37:20.919524Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:37:20.921758Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:37:30.926896Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:37:30.973239Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmik5ndd" level=info timestamp=2018-08-02T11:37:30.975103Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:37:30.975264Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running level=info timestamp=2018-08-02T11:37:27.885373Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:37:34 http: TLS handshake error from 10.244.1.1:47810: EOF 2018/08/02 11:37:44 http: TLS handshake error from 10.244.1.1:47816: EOF 2018/08/02 11:37:54 http: TLS handshake error from 10.244.1.1:47822: EOF level=info timestamp=2018-08-02T11:37:57.886955Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:38:04 http: TLS handshake error from 10.244.1.1:47828: EOF 2018/08/02 11:38:14 http: TLS handshake error from 10.244.1.1:47834: EOF 2018/08/02 11:38:24 http: TLS handshake error from 10.244.1.1:47840: EOF level=info timestamp=2018-08-02T11:38:27.876285Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:38:34 http: TLS handshake error from 10.244.1.1:47846: EOF 2018/08/02 11:38:44 http: TLS handshake error from 10.244.1.1:47852: EOF 2018/08/02 11:38:54 http: TLS handshake error from 10.244.1.1:47858: EOF level=info timestamp=2018-08-02T11:38:57.901380Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:39:04 http: TLS handshake error from 10.244.1.1:47864: EOF 2018/08/02 11:39:14 http: TLS handshake error from 10.244.1.1:47870: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running 2018/08/02 11:37:57 http: TLS handshake error from 10.244.0.1:51354: EOF 2018/08/02 11:38:07 http: TLS handshake error from 10.244.0.1:51378: EOF 2018/08/02 11:38:17 http: TLS handshake error from 10.244.0.1:51402: EOF level=info timestamp=2018-08-02T11:38:23.783047Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:38:25.741823Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:38:27 http: TLS handshake error from 10.244.0.1:51426: EOF 2018/08/02 11:38:37 http: TLS handshake error from 10.244.0.1:51450: EOF 2018/08/02 11:38:47 http: TLS handshake error from 10.244.0.1:51474: EOF level=info timestamp=2018-08-02T11:38:53.813332Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:38:55.773672Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:38:57 http: TLS handshake error from 10.244.0.1:51498: EOF level=info timestamp=2018-08-02T11:39:03.402289Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:39:03.403413Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:39:07 http: TLS handshake error from 10.244.0.1:51522: EOF 2018/08/02 11:39:17 http: TLS handshake error from 10.244.0.1:51546: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:16:15.159586Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:16:15.160819Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijq6lc kind= uid=78a008cb-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:19:15.629102Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:19:15.629298Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimk8z2 kind= uid=e4315c8e-9645-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:22:16.153010Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:22:16.154128Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi297qm kind= uid=4fcb207a-9646-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:25:16.610378Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:25:16.611641Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7vvwm kind= uid=bb5aced4-9646-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:25:16.666196Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi7vvwm\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi7vvwm" level=info timestamp=2018-08-02T11:28:17.059002Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:28:17.059780Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmimg6nv kind= uid=26e92d25-9647-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:31:17.509932Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:31:17.511446Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:37:17.962141Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmik5ndd kind= uid=69500acf-9648-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:37:17.963360Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmik5ndd kind= uid=69500acf-9648-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:37:52.885108Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmik5ndd kind= uid=69500acf-9648-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:37:52.886621Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmik5ndd kind= uid=69500acf-9648-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:37:52.886733Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmik5ndd" level=info timestamp=2018-08-02T11:38:13.366986Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmik5ndd, existing: true\n" level=info timestamp=2018-08-02T11:38:13.367078Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:38:13.367156Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:38:13.367256Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmik5ndd kind= uid=69500acf-9648-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:38:13.367932Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmik5ndd kind= uid=69500acf-9648-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:38:13.368052Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmik5ndd" level=info timestamp=2018-08-02T11:38:54.328721Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmik5ndd, existing: true\n" level=info timestamp=2018-08-02T11:38:54.328816Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:38:54.328846Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:38:54.328934Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmik5ndd kind= uid=69500acf-9648-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:38:54.329721Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmik5ndd kind= uid=69500acf-9648-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:38:54.329819Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmik5ndd" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:16:15.357977Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.379855Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.379943Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: true\n" level=info timestamp=2018-08-02T11:16:15.379961Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:16:15.379982Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.380040Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.380111Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind= uid=0d0e1a60-9645-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:16:15.385725Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:16:15.385761Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:16:15.385806Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:16:15.385859Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:18:58.073553Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmij5sfj, existing: false\n" level=info timestamp=2018-08-02T11:18:58.073650Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:18:58.073746Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:18:58.073868Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmij5sfj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmik5ndd-z745q Pod phase: Running level=info timestamp=2018-08-02T11:37:20.919258Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:37:20.919524Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:37:20.921758Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:37:30.926896Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:37:30.973239Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmik5ndd" level=info timestamp=2018-08-02T11:37:30.975103Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:37:30.975264Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [120.457 seconds] RegistryDisk /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:41 Starting a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:111 with ephemeral registry disk /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:112 should not modify the spec on status update [It] /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:113 Unexpected Warning event received: testvmik5ndd,69500acf-9648-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ STEP: Starting the VirtualMachineInstance level=info timestamp=2018-08-02T11:37:18.702123Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmik5ndd kind=VirtualMachineInstance uid=69500acf-9648-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmik5ndd-z745q" level=info timestamp=2018-08-02T11:37:33.064144Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmik5ndd kind=VirtualMachineInstance uid=69500acf-9648-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmik5ndd-z745q" level=error timestamp=2018-08-02T11:37:33.083006Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmik5ndd kind=VirtualMachineInstance uid=69500acf-9648-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running level=info timestamp=2018-08-02T11:38:27.876285Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:38:34 http: TLS handshake error from 10.244.1.1:47846: EOF 2018/08/02 11:38:44 http: TLS handshake error from 10.244.1.1:47852: EOF 2018/08/02 11:38:54 http: TLS handshake error from 10.244.1.1:47858: EOF level=info timestamp=2018-08-02T11:38:57.901380Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:39:04 http: TLS handshake error from 10.244.1.1:47864: EOF 2018/08/02 11:39:14 http: TLS handshake error from 10.244.1.1:47870: EOF 2018/08/02 11:39:24 http: TLS handshake error from 10.244.1.1:47876: EOF level=info timestamp=2018-08-02T11:39:27.893399Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:39:34 http: TLS handshake error from 10.244.1.1:47882: EOF 2018/08/02 11:39:44 http: TLS handshake error from 10.244.1.1:47888: EOF 2018/08/02 11:39:54 http: TLS handshake error from 10.244.1.1:47894: EOF level=info timestamp=2018-08-02T11:39:57.863471Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:40:04 http: TLS handshake error from 10.244.1.1:47900: EOF 2018/08/02 11:40:14 http: TLS handshake error from 10.244.1.1:47906: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:39:03.403413Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:39:07 http: TLS handshake error from 10.244.0.1:51522: EOF 2018/08/02 11:39:17 http: TLS handshake error from 10.244.0.1:51546: EOF level=info timestamp=2018-08-02T11:39:23.840372Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:39:25.813081Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:39:27 http: TLS handshake error from 10.244.0.1:51570: EOF 2018/08/02 11:39:37 http: TLS handshake error from 10.244.0.1:51594: EOF 2018/08/02 11:39:47 http: TLS handshake error from 10.244.0.1:51618: EOF level=info timestamp=2018-08-02T11:39:53.872835Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:39:55.841771Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:39:57 http: TLS handshake error from 10.244.0.1:51642: EOF level=info timestamp=2018-08-02T11:40:03.407102Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:40:03.408320Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:40:07 http: TLS handshake error from 10.244.0.1:51666: EOF 2018/08/02 11:40:17 http: TLS handshake error from 10.244.0.1:51690: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:31:17.509932Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:31:17.511446Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmibm56g kind= uid=927749cd-9647-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:37:17.962141Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmik5ndd kind= uid=69500acf-9648-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:37:17.963360Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmik5ndd kind= uid=69500acf-9648-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:39:18.411783Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmig4shv kind= uid=b11b54ee-9648-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:39:18.412910Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmig4shv kind= uid=b11b54ee-9648-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:39:18.417584Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijbw9x kind= uid=b11cbd46-9648-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:39:18.417671Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmijbw9x kind= uid=b11cbd46-9648-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:39:18.433404Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiq8vxs kind= uid=b11e0545-9648-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:39:18.433473Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmiq8vxs kind= uid=b11e0545-9648-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:39:18.437381Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6knr4 kind= uid=b11f9272-9648-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:39:18.437426Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi6knr4 kind= uid=b11f9272-9648-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:39:18.452605Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4mc2f kind= uid=b120cf76-9648-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:39:18.452865Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi4mc2f kind= uid=b120cf76-9648-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:39:18.520252Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmijbw9x\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmijbw9x" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:40:02.911115Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:40:02.911145Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:40:02.911233Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi6knr4 kind= uid=b11f9272-9648-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:40:02.911994Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi6knr4 kind= uid=b11f9272-9648-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:40:02.912131Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi6knr4" level=info timestamp=2018-08-02T11:40:04.440027Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmijbw9x, existing: true\n" level=info timestamp=2018-08-02T11:40:04.440127Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:40:04.440198Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:40:04.440302Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmijbw9x kind= uid=b11cbd46-9648-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:40:04.441132Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmijbw9x kind= uid=b11cbd46-9648-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:40:04.441230Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmijbw9x" level=info timestamp=2018-08-02T11:40:16.250162Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmik5ndd, existing: false\n" level=info timestamp=2018-08-02T11:40:16.250233Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:40:16.250290Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmik5ndd kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:40:16.250365Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmik5ndd kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:39:42.849886Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmig4shv kind= uid=b11b54ee-9648-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:39:42.851405Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmig4shv kind= uid=b11b54ee-9648-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:39:42.851723Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmig4shv" level=info timestamp=2018-08-02T11:39:53.091957Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmig4shv, existing: true\n" level=info timestamp=2018-08-02T11:39:53.092070Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:39:53.092106Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:39:53.092208Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmig4shv kind= uid=b11b54ee-9648-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:39:53.093566Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmig4shv kind= uid=b11b54ee-9648-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:39:53.093654Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6631/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmig4shv" level=info timestamp=2018-08-02T11:40:13.573901Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmig4shv, existing: true\n" level=info timestamp=2018-08-02T11:40:13.573991Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:40:13.574021Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:40:13.574148Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmig4shv kind= uid=b11b54ee-9648-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:40:13.575628Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmig4shv kind= uid=b11b54ee-9648-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:40:13.575725Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmig4shv" Pod name: virt-launcher-testvmi4mc2f-7742j Pod phase: Running level=info timestamp=2018-08-02T11:39:24.320193Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:39:24.320466Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:39:24.323587Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:39:40.766175Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:39:40.820138Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi4mc2f" level=info timestamp=2018-08-02T11:39:40.829876Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:39:40.830085Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmi6knr4-zmg4q Pod phase: Running level=info timestamp=2018-08-02T11:39:24.324628Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:39:24.325035Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:39:24.334905Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:39:41.745566Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:39:41.803175Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi6knr4" level=info timestamp=2018-08-02T11:39:41.808528Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:39:41.808828Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmig4shv-2jgz5 Pod phase: Running level=info timestamp=2018-08-02T11:39:22.452961Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:39:22.453287Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:39:22.454696Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:39:32.463386Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:39:32.524893Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmig4shv" level=info timestamp=2018-08-02T11:39:32.527250Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:39:32.527400Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmijbw9x-vrpgc Pod phase: Running level=info timestamp=2018-08-02T11:39:24.614950Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:39:24.646768Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:39:24.648186Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:39:42.203401Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:39:42.264941Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmijbw9x" level=info timestamp=2018-08-02T11:39:42.267324Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:39:42.267462Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmiq8vxs-k5hsd Pod phase: Running level=info timestamp=2018-08-02T11:39:23.363028Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:39:23.363280Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:39:23.365959Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:39:41.082446Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:39:41.247979Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmiq8vxs" level=info timestamp=2018-08-02T11:39:41.256821Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:39:41.256997Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [61.301 seconds] RegistryDisk /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:41 Starting multiple VMIs /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:129 with ephemeral registry disk /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:130 should success [It] /root/go/src/kubevirt.io/kubevirt/tests/registry_disk_test.go:131 Timed out after 30.004s. Timed out waiting for VMI to enter Running phase Expected : false to equal : true /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1071 ------------------------------ STEP: Starting a VirtualMachineInstance STEP: Starting a VirtualMachineInstance STEP: Starting a VirtualMachineInstance STEP: Starting a VirtualMachineInstance STEP: Starting a VirtualMachineInstance level=info timestamp=2018-08-02T11:39:19.244715Z pos=utils.go:256 component=tests namespace=kubevirt-test-default name=testvmig4shv kind=VirtualMachineInstance uid=b11b54ee-9648-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmig4shv-2jgz5" level=info timestamp=2018-08-02T11:39:32.861153Z pos=utils.go:256 component=tests namespace=kubevirt-test-default name=testvmig4shv kind=VirtualMachineInstance uid=b11b54ee-9648-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmig4shv-2jgz5" level=error timestamp=2018-08-02T11:39:32.883527Z pos=utils.go:254 component=tests namespace=kubevirt-test-default name=testvmig4shv kind=VirtualMachineInstance uid=b11b54ee-9648-11e8-9cfb-525500d15501 reason="Warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6627/ns/mnt" level=error timestamp=2018-08-02T11:39:32.896168Z pos=utils.go:254 component=tests namespace=kubevirt-test-default name=testvmig4shv kind=VirtualMachineInstance uid=b11b54ee-9648-11e8-9cfb-525500d15501 reason="Warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6627/ns/mnt" level=error timestamp=2018-08-02T11:39:32.911942Z pos=utils.go:254 component=tests namespace=kubevirt-test-default name=testvmig4shv kind=VirtualMachineInstance uid=b11b54ee-9648-11e8-9cfb-525500d15501 reason="Warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6627/ns/mnt" level=error timestamp=2018-08-02T11:39:32.924662Z pos=utils.go:254 component=tests namespace=kubevirt-test-default name=testvmig4shv kind=VirtualMachineInstance uid=b11b54ee-9648-11e8-9cfb-525500d15501 reason="Warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6620/ns/mnt" level=error timestamp=2018-08-02T11:39:32.971580Z pos=utils.go:254 component=tests namespace=kubevirt-test-default name=testvmig4shv kind=VirtualMachineInstance uid=b11b54ee-9648-11e8-9cfb-525500d15501 reason="Warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" level=error timestamp=2018-08-02T11:39:33.058929Z pos=utils.go:254 component=tests namespace=kubevirt-test-default name=testvmig4shv kind=VirtualMachineInstance uid=b11b54ee-9648-11e8-9cfb-525500d15501 reason="Warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6620/ns/mnt" level=error timestamp=2018-08-02T11:39:33.213705Z pos=utils.go:254 component=tests namespace=kubevirt-test-default name=testvmig4shv kind=VirtualMachineInstance uid=b11b54ee-9648-11e8-9cfb-525500d15501 reason="Warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6620/ns/mnt" level=error timestamp=2018-08-02T11:39:33.535431Z pos=utils.go:254 component=tests namespace=kubevirt-test-default name=testvmig4shv kind=VirtualMachineInstance uid=b11b54ee-9648-11e8-9cfb-525500d15501 reason="Warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" level=error timestamp=2018-08-02T11:39:34.178976Z pos=utils.go:254 component=tests namespace=kubevirt-test-default name=testvmig4shv kind=VirtualMachineInstance uid=b11b54ee-9648-11e8-9cfb-525500d15501 reason="Warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6620/ns/mnt" level=error timestamp=2018-08-02T11:39:35.458533Z pos=utils.go:254 component=tests namespace=kubevirt-test-default name=testvmig4shv kind=VirtualMachineInstance uid=b11b54ee-9648-11e8-9cfb-525500d15501 reason="Warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6636/ns/mnt" level=error timestamp=2018-08-02T11:39:38.024079Z pos=utils.go:254 component=tests namespace=kubevirt-test-default name=testvmig4shv kind=VirtualMachineInstance uid=b11b54ee-9648-11e8-9cfb-525500d15501 reason="Warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6620/ns/mnt" level=error timestamp=2018-08-02T11:39:43.144296Z pos=utils.go:254 component=tests namespace=kubevirt-test-default name=testvmig4shv kind=VirtualMachineInstance uid=b11b54ee-9648-11e8-9cfb-525500d15501 reason="Warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" • [SLOW TEST:5.087 seconds] VirtualMachineInstanceReplicaSet /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:46 should scale /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 to three, to two and then to zero replicas /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ • [SLOW TEST:8.015 seconds] VirtualMachineInstanceReplicaSet /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:46 should scale /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 to five, to six and then to zero replicas /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 ------------------------------ •• Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:40:54 http: TLS handshake error from 10.244.1.1:47930: EOF level=info timestamp=2018-08-02T11:40:57.856570Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:41:04 http: TLS handshake error from 10.244.1.1:47936: EOF 2018/08/02 11:41:14 http: TLS handshake error from 10.244.1.1:47942: EOF 2018/08/02 11:41:24 http: TLS handshake error from 10.244.1.1:47948: EOF level=info timestamp=2018-08-02T11:41:27.885021Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:41:34 http: TLS handshake error from 10.244.1.1:47954: EOF 2018/08/02 11:41:44 http: TLS handshake error from 10.244.1.1:47960: EOF 2018/08/02 11:41:54 http: TLS handshake error from 10.244.1.1:47966: EOF level=info timestamp=2018-08-02T11:41:57.885978Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:42:04 http: TLS handshake error from 10.244.1.1:47972: EOF 2018/08/02 11:42:14 http: TLS handshake error from 10.244.1.1:47978: EOF 2018/08/02 11:42:24 http: TLS handshake error from 10.244.1.1:47984: EOF level=info timestamp=2018-08-02T11:42:27.884644Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:42:34 http: TLS handshake error from 10.244.1.1:47990: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:41:23.967876Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:41:26.080670Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:41:27 http: TLS handshake error from 10.244.0.1:51858: EOF 2018/08/02 11:41:37 http: TLS handshake error from 10.244.0.1:51882: EOF 2018/08/02 11:41:47 http: TLS handshake error from 10.244.0.1:51906: EOF level=info timestamp=2018-08-02T11:41:53.998050Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:41:56.116775Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:41:57 http: TLS handshake error from 10.244.0.1:51930: EOF level=info timestamp=2018-08-02T11:42:03.410821Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:42:03.411786Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:42:07 http: TLS handshake error from 10.244.0.1:51954: EOF 2018/08/02 11:42:17 http: TLS handshake error from 10.244.0.1:51978: EOF level=info timestamp=2018-08-02T11:42:24.026675Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:42:26.153617Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:42:27 http: TLS handshake error from 10.244.0.1:52002: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:40:29.134113Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmic8nxklrq8g\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmic8nxklrq8g" level=error timestamp=2018-08-02T11:40:29.575975Z pos=replicaset.go:230 component=virt-controller service=http namespace=kubevirt-test-default name=replicaset9mhfr kind= uid=d8eaadb0-9648-11e8-9cfb-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicaset9mhfr\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the replicaset status failed." level=info timestamp=2018-08-02T11:40:29.576086Z pos=replicaset.go:137 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicaset9mhfr\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstanceReplicaSet kubevirt-test-default/replicaset9mhfr" level=info timestamp=2018-08-02T11:40:29.971959Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmic8nxkhfsw5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmic8nxkhfsw5" level=info timestamp=2018-08-02T11:40:31.557152Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmic8nxkhfsw5\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmic8nxkhfsw5" level=info timestamp=2018-08-02T11:40:34.356407Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2bjmm5xhrh kind= uid=de5f1680-9648-11e8-9cfb-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=error timestamp=2018-08-02T11:40:34.357652Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2bjmm5xhrh kind= uid=de5f1680-9648-11e8-9cfb-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvmi2bjmm5xhrh" level=info timestamp=2018-08-02T11:40:34.358129Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2bjmm5xhrh kind= uid=de5f1680-9648-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:40:34.358192Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2bjmm5xhrh kind= uid=de5f1680-9648-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:40:34.358653Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:40:34.358710Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:40:34.358938Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=error timestamp=2018-08-02T11:40:34.358965Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvmi2bjmmmfppx" level=info timestamp=2018-08-02T11:40:34.526523Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi2bjmmmfppx\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi2bjmmmfppx" level=info timestamp=2018-08-02T11:40:35.127935Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi2bjmmmfppx\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi2bjmmmfppx" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:41:10.481685Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmm5xhrh kind= uid=de5f1680-9648-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:41:10.482369Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmm5xhrh kind= uid=de5f1680-9648-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:41:10.482474Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi2bjmm5xhrh" level=info timestamp=2018-08-02T11:41:30.962650Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmm5xhrh, existing: true\n" level=info timestamp=2018-08-02T11:41:30.962753Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:41:30.962776Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:41:30.962858Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmm5xhrh kind= uid=de5f1680-9648-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:41:30.963528Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmm5xhrh kind= uid=de5f1680-9648-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:41:30.963635Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi2bjmm5xhrh" level=info timestamp=2018-08-02T11:42:11.923883Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmm5xhrh, existing: true\n" level=info timestamp=2018-08-02T11:42:11.923983Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:42:11.924015Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:42:11.924121Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmm5xhrh kind= uid=de5f1680-9648-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:42:11.924852Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmm5xhrh kind= uid=de5f1680-9648-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:42:11.924961Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi2bjmm5xhrh" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:41:10.054085Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:41:10.055232Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6636/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:41:10.055341Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6636/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi2bjmmmfppx" level=info timestamp=2018-08-02T11:41:30.535626Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: true\n" level=info timestamp=2018-08-02T11:41:30.535732Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:41:30.535765Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:41:30.535881Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:41:30.537143Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:41:30.537247Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi2bjmmmfppx" level=info timestamp=2018-08-02T11:42:11.497534Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: true\n" level=info timestamp=2018-08-02T11:42:11.497738Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:42:11.497802Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:42:11.497885Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:42:11.500093Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:42:11.501910Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi2bjmmmfppx" Pod name: virt-launcher-testvmi2bjmm5xhrh-dh6hz Pod phase: Running level=info timestamp=2018-08-02T11:40:38.322200Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:40:38.322519Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:40:38.323786Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:40:48.331367Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:40:48.353930Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi2bjmm5xhrh" level=info timestamp=2018-08-02T11:40:48.355069Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:40:48.355240Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmi2bjmmmfppx-xz66n Pod phase: Running level=info timestamp=2018-08-02T11:40:38.670449Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:40:38.670723Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:40:38.673104Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:40:48.678633Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:40:48.718567Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi2bjmmmfppx" level=info timestamp=2018-08-02T11:40:48.720124Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:40:48.720265Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" ------------------------------ • Failure [121.513 seconds] VirtualMachineInstanceReplicaSet /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:46 should update readyReplicas once VMIs are up [It] /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:157 Timed out after 120.000s. Expected : 0 to equal : 2 /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:166 ------------------------------ STEP: Create a new VirtualMachineInstance replica set STEP: Scaling to 2 STEP: Checking the number of replicas STEP: Checking the number of ready replicas • [SLOW TEST:8.498 seconds] VirtualMachineInstanceReplicaSet /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:46 should remove VMIs once it is marked for deletion /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:169 ------------------------------ •• ------------------------------ • [SLOW TEST:5.500 seconds] VirtualMachineInstanceReplicaSet /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:46 should remove the finished VM /root/go/src/kubevirt.io/kubevirt/tests/replicaset_test.go:279 ------------------------------ Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:41:24 http: TLS handshake error from 10.244.1.1:47948: EOF level=info timestamp=2018-08-02T11:41:27.885021Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:41:34 http: TLS handshake error from 10.244.1.1:47954: EOF 2018/08/02 11:41:44 http: TLS handshake error from 10.244.1.1:47960: EOF 2018/08/02 11:41:54 http: TLS handshake error from 10.244.1.1:47966: EOF level=info timestamp=2018-08-02T11:41:57.885978Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:42:04 http: TLS handshake error from 10.244.1.1:47972: EOF 2018/08/02 11:42:14 http: TLS handshake error from 10.244.1.1:47978: EOF 2018/08/02 11:42:24 http: TLS handshake error from 10.244.1.1:47984: EOF level=info timestamp=2018-08-02T11:42:27.884644Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:42:34 http: TLS handshake error from 10.244.1.1:47990: EOF 2018/08/02 11:42:44 http: TLS handshake error from 10.244.1.1:47996: EOF 2018/08/02 11:42:54 http: TLS handshake error from 10.244.1.1:48002: EOF level=info timestamp=2018-08-02T11:42:57.866711Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:43:04 http: TLS handshake error from 10.244.1.1:48008: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:41:56.116775Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:41:57 http: TLS handshake error from 10.244.0.1:51930: EOF level=info timestamp=2018-08-02T11:42:03.410821Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:42:03.411786Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:42:07 http: TLS handshake error from 10.244.0.1:51954: EOF 2018/08/02 11:42:17 http: TLS handshake error from 10.244.0.1:51978: EOF level=info timestamp=2018-08-02T11:42:24.026675Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:42:26.153617Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:42:27 http: TLS handshake error from 10.244.0.1:52002: EOF 2018/08/02 11:42:37 http: TLS handshake error from 10.244.0.1:52026: EOF 2018/08/02 11:42:47 http: TLS handshake error from 10.244.0.1:52050: EOF level=info timestamp=2018-08-02T11:42:54.056347Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:42:56.183370Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:42:57 http: TLS handshake error from 10.244.0.1:52074: EOF 2018/08/02 11:43:07 http: TLS handshake error from 10.244.0.1:52098: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:42:51.266796Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6g4nfz kind= uid=2ff9b72f-9649-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=error timestamp=2018-08-02T11:42:52.214594Z pos=replicaset.go:230 component=virt-controller service=http namespace=kubevirt-test-default name=replicasetr7vvf kind= uid=2ff74356-9649-11e8-9cfb-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicasetr7vvf\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the replicaset status failed." level=info timestamp=2018-08-02T11:42:52.214678Z pos=replicaset.go:137 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicasetr7vvf\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstanceReplicaSet kubevirt-test-default/replicasetr7vvf" level=info timestamp=2018-08-02T11:42:52.618404Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6g4nfz\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6g4nfz" level=info timestamp=2018-08-02T11:42:53.013451Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6g4nfz\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6g4nfz" level=info timestamp=2018-08-02T11:42:53.417889Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=error timestamp=2018-08-02T11:42:53.417976Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvmistrh6znjpw" level=info timestamp=2018-08-02T11:42:53.418024Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:42:53.418159Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:42:54.615605Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6znjpw\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6znjpw" level=error timestamp=2018-08-02T11:42:54.813893Z pos=replicaset.go:230 component=virt-controller service=http namespace=kubevirt-test-default name=replicasetr7vvf kind= uid=2ff74356-9649-11e8-9cfb-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicasetr7vvf\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the replicaset status failed." level=info timestamp=2018-08-02T11:42:54.813983Z pos=replicaset.go:137 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicasetr7vvf\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstanceReplicaSet kubevirt-test-default/replicasetr7vvf" level=info timestamp=2018-08-02T11:42:55.214801Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6znjpw\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6znjpw" level=info timestamp=2018-08-02T11:42:56.740803Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:42:56.740891Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:43:11.918734Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:43:11.919085Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:43:11.919154Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmitht2p" level=info timestamp=2018-08-02T11:43:11.939340Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmitht2p, existing: true\n" level=info timestamp=2018-08-02T11:43:11.939418Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:43:11.939450Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:43:11.939560Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:43:11.940059Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:43:11.940139Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmitht2p" level=info timestamp=2018-08-02T11:43:11.980345Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmitht2p, existing: true\n" level=info timestamp=2018-08-02T11:43:11.980399Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:43:11.980438Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:43:11.980517Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:43:11.980897Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:43:11.980969Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmitht2p" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:42:11.501910Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi2bjmmmfppx" level=info timestamp=2018-08-02T11:42:36.256289Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: true\n" level=info timestamp=2018-08-02T11:42:36.257035Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:42:36.257064Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:42:36.257160Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.307816Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:42:36.307917Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: true\n" level=info timestamp=2018-08-02T11:42:36.307937Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:42:36.307959Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:42:36.308028Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.308109Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:42:36.310465Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: false\n" level=info timestamp=2018-08-02T11:42:36.311602Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:42:36.311643Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.311698Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi9ljptcntwx-t9lqt Pod phase: Pending Pod name: virt-launcher-testvmistrh6nwrdk-qbdt5 Pod phase: Failed Unable to retrieve container logs for docker://fb5b1a5c72b72a049644fba9aa21e45b5be8d1654e6c5c6037bb45f56ac49943 Pod name: virt-launcher-testvmitht2p-g9hf2 Pod phase: Running level=info timestamp=2018-08-02T11:43:00.222187Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:43:00.222480Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:43:00.224981Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:43:10.230861Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:43:10.275196Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmitht2p" level=info timestamp=2018-08-02T11:43:10.277702Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:43:10.277869Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:44:04 http: TLS handshake error from 10.244.1.1:48044: EOF 2018/08/02 11:44:14 http: TLS handshake error from 10.244.1.1:48050: EOF 2018/08/02 11:44:24 http: TLS handshake error from 10.244.1.1:48056: EOF level=info timestamp=2018-08-02T11:44:27.858126Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:44:34 http: TLS handshake error from 10.244.1.1:48062: EOF 2018/08/02 11:44:44 http: TLS handshake error from 10.244.1.1:48068: EOF 2018/08/02 11:44:54 http: TLS handshake error from 10.244.1.1:48074: EOF level=info timestamp=2018-08-02T11:44:57.864295Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:45:04 http: TLS handshake error from 10.244.1.1:48080: EOF 2018/08/02 11:45:14 http: TLS handshake error from 10.244.1.1:48086: EOF 2018/08/02 11:45:24 http: TLS handshake error from 10.244.1.1:48092: EOF level=info timestamp=2018-08-02T11:45:27.877626Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:45:34 http: TLS handshake error from 10.244.1.1:48098: EOF 2018/08/02 11:45:44 http: TLS handshake error from 10.244.1.1:48104: EOF 2018/08/02 11:45:54 http: TLS handshake error from 10.244.1.1:48110: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running 2018/08/02 11:44:47 http: TLS handshake error from 10.244.0.1:52338: EOF level=info timestamp=2018-08-02T11:44:54.190533Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:44:56.333893Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:44:57 http: TLS handshake error from 10.244.0.1:52362: EOF level=info timestamp=2018-08-02T11:45:03.491991Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:45:03.492870Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:45:07 http: TLS handshake error from 10.244.0.1:52386: EOF 2018/08/02 11:45:17 http: TLS handshake error from 10.244.0.1:52410: EOF level=info timestamp=2018-08-02T11:45:24.219201Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:45:26.354440Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:45:27 http: TLS handshake error from 10.244.0.1:52434: EOF 2018/08/02 11:45:37 http: TLS handshake error from 10.244.0.1:52458: EOF 2018/08/02 11:45:47 http: TLS handshake error from 10.244.0.1:52482: EOF level=info timestamp=2018-08-02T11:45:54.252763Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:45:56.379580Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:42:51.266796Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6g4nfz kind= uid=2ff9b72f-9649-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=error timestamp=2018-08-02T11:42:52.214594Z pos=replicaset.go:230 component=virt-controller service=http namespace=kubevirt-test-default name=replicasetr7vvf kind= uid=2ff74356-9649-11e8-9cfb-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicasetr7vvf\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the replicaset status failed." level=info timestamp=2018-08-02T11:42:52.214678Z pos=replicaset.go:137 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicasetr7vvf\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstanceReplicaSet kubevirt-test-default/replicasetr7vvf" level=info timestamp=2018-08-02T11:42:52.618404Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6g4nfz\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6g4nfz" level=info timestamp=2018-08-02T11:42:53.013451Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6g4nfz\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6g4nfz" level=info timestamp=2018-08-02T11:42:53.417889Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=error timestamp=2018-08-02T11:42:53.417976Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvmistrh6znjpw" level=info timestamp=2018-08-02T11:42:53.418024Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:42:53.418159Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:42:54.615605Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6znjpw\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6znjpw" level=error timestamp=2018-08-02T11:42:54.813893Z pos=replicaset.go:230 component=virt-controller service=http namespace=kubevirt-test-default name=replicasetr7vvf kind= uid=2ff74356-9649-11e8-9cfb-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicasetr7vvf\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the replicaset status failed." level=info timestamp=2018-08-02T11:42:54.813983Z pos=replicaset.go:137 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicasetr7vvf\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstanceReplicaSet kubevirt-test-default/replicasetr7vvf" level=info timestamp=2018-08-02T11:42:55.214801Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6znjpw\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6znjpw" level=info timestamp=2018-08-02T11:42:56.740803Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:42:56.740891Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:43:52.870856Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:43:52.871583Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:43:52.871683Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmitht2p" level=info timestamp=2018-08-02T11:44:33.832342Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmitht2p, existing: true\n" level=info timestamp=2018-08-02T11:44:33.832469Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:44:33.832512Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:44:33.832636Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:44:33.834288Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:44:33.834383Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmitht2p" level=info timestamp=2018-08-02T11:45:55.754680Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmitht2p, existing: true\n" level=info timestamp=2018-08-02T11:45:55.754766Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:45:55.754800Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:45:55.754890Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:45:55.755498Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:45:55.755652Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmitht2p" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:42:36.257160Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.307816Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:42:36.307917Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: true\n" level=info timestamp=2018-08-02T11:42:36.307937Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:42:36.307959Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:42:36.308028Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.308109Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:42:36.310465Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: false\n" level=info timestamp=2018-08-02T11:42:36.311602Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:42:36.311643Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.311698Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:43:33.422175Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: false\n" level=info timestamp=2018-08-02T11:43:33.422269Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:43:33.422363Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:43:33.422508Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmitht2p-g9hf2 Pod phase: Running level=info timestamp=2018-08-02T11:43:00.222187Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:43:00.222480Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:43:00.224981Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:43:10.230861Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:43:10.275196Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmitht2p" level=info timestamp=2018-08-02T11:43:10.277702Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:43:10.277869Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [180.644 seconds] VNC /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:46 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:54 with VNC connection [BeforeEach] /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:62 should allow accessing the VNC device /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:64 Unexpected Warning event received: testvmitht2p,333e3eee-9649-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ level=info timestamp=2018-08-02T11:42:57.580108Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmitht2p kind=VirtualMachineInstance uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmitht2p-g9hf2" level=info timestamp=2018-08-02T11:43:12.576309Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmitht2p kind=VirtualMachineInstance uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmitht2p-g9hf2" level=error timestamp=2018-08-02T11:43:12.592509Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmitht2p kind=VirtualMachineInstance uid=333e3eee-9649-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:44:24 http: TLS handshake error from 10.244.1.1:48056: EOF level=info timestamp=2018-08-02T11:44:27.858126Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:44:34 http: TLS handshake error from 10.244.1.1:48062: EOF 2018/08/02 11:44:44 http: TLS handshake error from 10.244.1.1:48068: EOF 2018/08/02 11:44:54 http: TLS handshake error from 10.244.1.1:48074: EOF level=info timestamp=2018-08-02T11:44:57.864295Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:45:04 http: TLS handshake error from 10.244.1.1:48080: EOF 2018/08/02 11:45:14 http: TLS handshake error from 10.244.1.1:48086: EOF 2018/08/02 11:45:24 http: TLS handshake error from 10.244.1.1:48092: EOF level=info timestamp=2018-08-02T11:45:27.877626Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:45:34 http: TLS handshake error from 10.244.1.1:48098: EOF 2018/08/02 11:45:44 http: TLS handshake error from 10.244.1.1:48104: EOF 2018/08/02 11:45:54 http: TLS handshake error from 10.244.1.1:48110: EOF level=info timestamp=2018-08-02T11:45:57.863464Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:46:04 http: TLS handshake error from 10.244.1.1:48116: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:44:56.333893Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:44:57 http: TLS handshake error from 10.244.0.1:52362: EOF level=info timestamp=2018-08-02T11:45:03.491991Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:45:03.492870Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:45:07 http: TLS handshake error from 10.244.0.1:52386: EOF 2018/08/02 11:45:17 http: TLS handshake error from 10.244.0.1:52410: EOF level=info timestamp=2018-08-02T11:45:24.219201Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:45:26.354440Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:45:27 http: TLS handshake error from 10.244.0.1:52434: EOF 2018/08/02 11:45:37 http: TLS handshake error from 10.244.0.1:52458: EOF 2018/08/02 11:45:47 http: TLS handshake error from 10.244.0.1:52482: EOF level=info timestamp=2018-08-02T11:45:54.252763Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:45:56.379580Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:45:57 http: TLS handshake error from 10.244.0.1:52506: EOF 2018/08/02 11:46:07 http: TLS handshake error from 10.244.0.1:52530: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:42:52.214678Z pos=replicaset.go:137 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicasetr7vvf\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstanceReplicaSet kubevirt-test-default/replicasetr7vvf" level=info timestamp=2018-08-02T11:42:52.618404Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6g4nfz\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6g4nfz" level=info timestamp=2018-08-02T11:42:53.013451Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6g4nfz\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6g4nfz" level=info timestamp=2018-08-02T11:42:53.417889Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=error timestamp=2018-08-02T11:42:53.417976Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvmistrh6znjpw" level=info timestamp=2018-08-02T11:42:53.418024Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:42:53.418159Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:42:54.615605Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6znjpw\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6znjpw" level=error timestamp=2018-08-02T11:42:54.813893Z pos=replicaset.go:230 component=virt-controller service=http namespace=kubevirt-test-default name=replicasetr7vvf kind= uid=2ff74356-9649-11e8-9cfb-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicasetr7vvf\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the replicaset status failed." level=info timestamp=2018-08-02T11:42:54.813983Z pos=replicaset.go:137 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicasetr7vvf\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstanceReplicaSet kubevirt-test-default/replicasetr7vvf" level=info timestamp=2018-08-02T11:42:55.214801Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6znjpw\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6znjpw" level=info timestamp=2018-08-02T11:42:56.740803Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:42:56.740891Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:45:57.203335Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2dprj kind= uid=9ece2ec3-9649-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:45:57.204628Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2dprj kind= uid=9ece2ec3-9649-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:46:11.788676Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi2dprj kind= uid=9ece2ec3-9649-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:46:11.789087Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi2dprj kind= uid=9ece2ec3-9649-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:46:11.789176Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi2dprj" level=info timestamp=2018-08-02T11:46:11.809380Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2dprj, existing: true\n" level=info timestamp=2018-08-02T11:46:11.809453Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:46:11.809506Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:46:11.809643Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi2dprj kind= uid=9ece2ec3-9649-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:46:11.810104Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi2dprj kind= uid=9ece2ec3-9649-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:46:11.810201Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi2dprj" level=info timestamp=2018-08-02T11:46:11.850424Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2dprj, existing: true\n" level=info timestamp=2018-08-02T11:46:11.850493Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:46:11.850522Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:46:11.850645Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi2dprj kind= uid=9ece2ec3-9649-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:46:11.851177Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi2dprj kind= uid=9ece2ec3-9649-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:46:11.851281Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi2dprj" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:42:36.257160Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.307816Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:42:36.307917Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: true\n" level=info timestamp=2018-08-02T11:42:36.307937Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:42:36.307959Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:42:36.308028Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.308109Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:42:36.310465Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: false\n" level=info timestamp=2018-08-02T11:42:36.311602Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:42:36.311643Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.311698Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:43:33.422175Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: false\n" level=info timestamp=2018-08-02T11:43:33.422269Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:43:33.422363Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:43:33.422508Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi2dprj-tq7tc Pod phase: Running level=info timestamp=2018-08-02T11:46:00.571025Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:46:00.571313Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:46:00.572734Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:46:10.578709Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:46:10.604673Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi2dprj" level=info timestamp=2018-08-02T11:46:10.606011Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:46:10.606207Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:47:04 http: TLS handshake error from 10.244.1.1:48152: EOF 2018/08/02 11:47:14 http: TLS handshake error from 10.244.1.1:48158: EOF 2018/08/02 11:47:24 http: TLS handshake error from 10.244.1.1:48164: EOF level=info timestamp=2018-08-02T11:47:27.858195Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:47:34 http: TLS handshake error from 10.244.1.1:48170: EOF 2018/08/02 11:47:44 http: TLS handshake error from 10.244.1.1:48176: EOF 2018/08/02 11:47:54 http: TLS handshake error from 10.244.1.1:48182: EOF level=info timestamp=2018-08-02T11:47:57.863207Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:48:04 http: TLS handshake error from 10.244.1.1:48188: EOF 2018/08/02 11:48:14 http: TLS handshake error from 10.244.1.1:48194: EOF 2018/08/02 11:48:24 http: TLS handshake error from 10.244.1.1:48200: EOF level=info timestamp=2018-08-02T11:48:27.882245Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:48:34 http: TLS handshake error from 10.244.1.1:48206: EOF 2018/08/02 11:48:44 http: TLS handshake error from 10.244.1.1:48212: EOF 2018/08/02 11:48:54 http: TLS handshake error from 10.244.1.1:48218: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running 2018/08/02 11:47:27 http: TLS handshake error from 10.244.0.1:52722: EOF 2018/08/02 11:47:37 http: TLS handshake error from 10.244.0.1:52746: EOF 2018/08/02 11:47:47 http: TLS handshake error from 10.244.0.1:52770: EOF level=info timestamp=2018-08-02T11:47:54.369248Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:47:56.482191Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:47:57 http: TLS handshake error from 10.244.0.1:52794: EOF 2018/08/02 11:48:07 http: TLS handshake error from 10.244.0.1:52818: EOF 2018/08/02 11:48:17 http: TLS handshake error from 10.244.0.1:52842: EOF level=info timestamp=2018-08-02T11:48:24.399044Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:48:26.509814Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:48:27 http: TLS handshake error from 10.244.0.1:52866: EOF 2018/08/02 11:48:37 http: TLS handshake error from 10.244.0.1:52890: EOF 2018/08/02 11:48:47 http: TLS handshake error from 10.244.0.1:52914: EOF level=info timestamp=2018-08-02T11:48:54.429324Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:48:56.535413Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:42:52.214678Z pos=replicaset.go:137 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicasetr7vvf\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstanceReplicaSet kubevirt-test-default/replicasetr7vvf" level=info timestamp=2018-08-02T11:42:52.618404Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6g4nfz\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6g4nfz" level=info timestamp=2018-08-02T11:42:53.013451Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6g4nfz\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6g4nfz" level=info timestamp=2018-08-02T11:42:53.417889Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=error timestamp=2018-08-02T11:42:53.417976Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvmistrh6znjpw" level=info timestamp=2018-08-02T11:42:53.418024Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:42:53.418159Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:42:54.615605Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6znjpw\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6znjpw" level=error timestamp=2018-08-02T11:42:54.813893Z pos=replicaset.go:230 component=virt-controller service=http namespace=kubevirt-test-default name=replicasetr7vvf kind= uid=2ff74356-9649-11e8-9cfb-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicasetr7vvf\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the replicaset status failed." level=info timestamp=2018-08-02T11:42:54.813983Z pos=replicaset.go:137 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicasetr7vvf\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstanceReplicaSet kubevirt-test-default/replicasetr7vvf" level=info timestamp=2018-08-02T11:42:55.214801Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6znjpw\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6znjpw" level=info timestamp=2018-08-02T11:42:56.740803Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:42:56.740891Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:45:57.203335Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2dprj kind= uid=9ece2ec3-9649-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:45:57.204628Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2dprj kind= uid=9ece2ec3-9649-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:47:33.703483Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:47:33.703506Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:47:33.703608Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi2dprj kind= uid=9ece2ec3-9649-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:47:33.704122Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi2dprj kind= uid=9ece2ec3-9649-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:47:33.704198Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi2dprj" level=info timestamp=2018-08-02T11:48:39.595984Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmitht2p, existing: false\n" level=info timestamp=2018-08-02T11:48:39.596066Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:48:39.596145Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmitht2p kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:48:39.596237Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmitht2p kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:48:55.624820Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2dprj, existing: true\n" level=info timestamp=2018-08-02T11:48:55.624903Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:48:55.624935Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:48:55.625026Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi2dprj kind= uid=9ece2ec3-9649-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:48:55.625762Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi2dprj kind= uid=9ece2ec3-9649-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:48:55.626046Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi2dprj" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:42:36.257160Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.307816Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:42:36.307917Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: true\n" level=info timestamp=2018-08-02T11:42:36.307937Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:42:36.307959Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:42:36.308028Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.308109Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:42:36.310465Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: false\n" level=info timestamp=2018-08-02T11:42:36.311602Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:42:36.311643Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.311698Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:43:33.422175Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: false\n" level=info timestamp=2018-08-02T11:43:33.422269Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:43:33.422363Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:43:33.422508Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi2dprj-tq7tc Pod phase: Running level=info timestamp=2018-08-02T11:46:00.571025Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:46:00.571313Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:46:00.572734Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:46:10.578709Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:46:10.604673Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi2dprj" level=info timestamp=2018-08-02T11:46:10.606011Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:46:10.606207Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [180.463 seconds] VNC /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:46 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:54 should upgrade subresource connections if an origin header is given [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 for vnc /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Unexpected Warning event received: testvmi2dprj,9ece2ec3-9649-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ level=info timestamp=2018-08-02T11:45:57.974390Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmi2dprj kind=VirtualMachineInstance uid=9ece2ec3-9649-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi2dprj-tq7tc" level=info timestamp=2018-08-02T11:46:12.449052Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmi2dprj kind=VirtualMachineInstance uid=9ece2ec3-9649-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmi2dprj-tq7tc" level=error timestamp=2018-08-02T11:46:12.464267Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmi2dprj kind=VirtualMachineInstance uid=9ece2ec3-9649-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:47:24 http: TLS handshake error from 10.244.1.1:48164: EOF level=info timestamp=2018-08-02T11:47:27.858195Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:47:34 http: TLS handshake error from 10.244.1.1:48170: EOF 2018/08/02 11:47:44 http: TLS handshake error from 10.244.1.1:48176: EOF 2018/08/02 11:47:54 http: TLS handshake error from 10.244.1.1:48182: EOF level=info timestamp=2018-08-02T11:47:57.863207Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:48:04 http: TLS handshake error from 10.244.1.1:48188: EOF 2018/08/02 11:48:14 http: TLS handshake error from 10.244.1.1:48194: EOF 2018/08/02 11:48:24 http: TLS handshake error from 10.244.1.1:48200: EOF level=info timestamp=2018-08-02T11:48:27.882245Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:48:34 http: TLS handshake error from 10.244.1.1:48206: EOF 2018/08/02 11:48:44 http: TLS handshake error from 10.244.1.1:48212: EOF 2018/08/02 11:48:54 http: TLS handshake error from 10.244.1.1:48218: EOF level=info timestamp=2018-08-02T11:48:57.868612Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:49:04 http: TLS handshake error from 10.244.1.1:48224: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:47:56.482191Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:47:57 http: TLS handshake error from 10.244.0.1:52794: EOF 2018/08/02 11:48:07 http: TLS handshake error from 10.244.0.1:52818: EOF 2018/08/02 11:48:17 http: TLS handshake error from 10.244.0.1:52842: EOF level=info timestamp=2018-08-02T11:48:24.399044Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:48:26.509814Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:48:27 http: TLS handshake error from 10.244.0.1:52866: EOF 2018/08/02 11:48:37 http: TLS handshake error from 10.244.0.1:52890: EOF 2018/08/02 11:48:47 http: TLS handshake error from 10.244.0.1:52914: EOF level=info timestamp=2018-08-02T11:48:54.429324Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:48:56.535413Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:48:57 http: TLS handshake error from 10.244.0.1:52938: EOF level=info timestamp=2018-08-02T11:49:03.560248Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:49:03.561042Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:49:07 http: TLS handshake error from 10.244.0.1:52962: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:42:53.013451Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6g4nfz\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6g4nfz" level=info timestamp=2018-08-02T11:42:53.417889Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=error timestamp=2018-08-02T11:42:53.417976Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvmistrh6znjpw" level=info timestamp=2018-08-02T11:42:53.418024Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:42:53.418159Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:42:54.615605Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6znjpw\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6znjpw" level=error timestamp=2018-08-02T11:42:54.813893Z pos=replicaset.go:230 component=virt-controller service=http namespace=kubevirt-test-default name=replicasetr7vvf kind= uid=2ff74356-9649-11e8-9cfb-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicasetr7vvf\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the replicaset status failed." level=info timestamp=2018-08-02T11:42:54.813983Z pos=replicaset.go:137 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicasetr7vvf\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstanceReplicaSet kubevirt-test-default/replicasetr7vvf" level=info timestamp=2018-08-02T11:42:55.214801Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6znjpw\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6znjpw" level=info timestamp=2018-08-02T11:42:56.740803Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:42:56.740891Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:45:57.203335Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2dprj kind= uid=9ece2ec3-9649-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:45:57.204628Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2dprj kind= uid=9ece2ec3-9649-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:48:57.649162Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7zcbk kind= uid=0a5c1592-964a-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:48:57.650379Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7zcbk kind= uid=0a5c1592-964a-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:49:12.314706Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi7zcbk kind= uid=0a5c1592-964a-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:49:12.315103Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi7zcbk kind= uid=0a5c1592-964a-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:49:12.315185Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi7zcbk" level=info timestamp=2018-08-02T11:49:12.335424Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi7zcbk, existing: true\n" level=info timestamp=2018-08-02T11:49:12.335498Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:49:12.335566Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:49:12.335651Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi7zcbk kind= uid=0a5c1592-964a-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:49:12.336205Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi7zcbk kind= uid=0a5c1592-964a-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:49:12.336293Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi7zcbk" level=info timestamp=2018-08-02T11:49:12.376475Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi7zcbk, existing: true\n" level=info timestamp=2018-08-02T11:49:12.376574Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:49:12.376618Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:49:12.376703Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi7zcbk kind= uid=0a5c1592-964a-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:49:12.377186Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi7zcbk kind= uid=0a5c1592-964a-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:49:12.377368Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi7zcbk" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:42:36.257160Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.307816Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:42:36.307917Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: true\n" level=info timestamp=2018-08-02T11:42:36.307937Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:42:36.307959Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:42:36.308028Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.308109Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:42:36.310465Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: false\n" level=info timestamp=2018-08-02T11:42:36.311602Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:42:36.311643Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.311698Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:43:33.422175Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: false\n" level=info timestamp=2018-08-02T11:43:33.422269Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:43:33.422363Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:43:33.422508Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi7zcbk-tqgnr Pod phase: Running level=info timestamp=2018-08-02T11:49:00.796988Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:49:00.797344Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:49:00.800785Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:49:10.807218Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:49:10.829208Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi7zcbk" level=info timestamp=2018-08-02T11:49:10.830649Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:49:10.830796Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:50:04 http: TLS handshake error from 10.244.1.1:48260: EOF 2018/08/02 11:50:14 http: TLS handshake error from 10.244.1.1:48266: EOF 2018/08/02 11:50:24 http: TLS handshake error from 10.244.1.1:48272: EOF level=info timestamp=2018-08-02T11:50:27.866888Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:50:34 http: TLS handshake error from 10.244.1.1:48278: EOF 2018/08/02 11:50:44 http: TLS handshake error from 10.244.1.1:48284: EOF 2018/08/02 11:50:54 http: TLS handshake error from 10.244.1.1:48290: EOF level=info timestamp=2018-08-02T11:50:57.886864Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:51:04 http: TLS handshake error from 10.244.1.1:48296: EOF 2018/08/02 11:51:14 http: TLS handshake error from 10.244.1.1:48302: EOF 2018/08/02 11:51:24 http: TLS handshake error from 10.244.1.1:48308: EOF level=info timestamp=2018-08-02T11:51:27.860823Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:51:34 http: TLS handshake error from 10.244.1.1:48314: EOF 2018/08/02 11:51:44 http: TLS handshake error from 10.244.1.1:48320: EOF 2018/08/02 11:51:54 http: TLS handshake error from 10.244.1.1:48326: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running 2018/08/02 11:50:37 http: TLS handshake error from 10.244.0.1:53178: EOF 2018/08/02 11:50:47 http: TLS handshake error from 10.244.0.1:53202: EOF level=info timestamp=2018-08-02T11:50:54.549378Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:50:56.657410Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:50:57 http: TLS handshake error from 10.244.0.1:53226: EOF 2018/08/02 11:51:07 http: TLS handshake error from 10.244.0.1:53250: EOF 2018/08/02 11:51:17 http: TLS handshake error from 10.244.0.1:53274: EOF level=info timestamp=2018-08-02T11:51:24.578892Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:51:26.684467Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:51:27 http: TLS handshake error from 10.244.0.1:53298: EOF 2018/08/02 11:51:37 http: TLS handshake error from 10.244.0.1:53322: EOF 2018/08/02 11:51:47 http: TLS handshake error from 10.244.0.1:53346: EOF level=info timestamp=2018-08-02T11:51:54.605264Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:51:56.715450Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:51:57 http: TLS handshake error from 10.244.0.1:53370: EOF Pod name: virt-controller-7d57d96b65-l9p5w Pod phase: Running level=info timestamp=2018-08-02T11:42:53.013451Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6g4nfz\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6g4nfz" level=info timestamp=2018-08-02T11:42:53.417889Z pos=vm.go:459 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Looking for VirtualMachineInstance Ref" level=error timestamp=2018-08-02T11:42:53.417976Z pos=vm.go:462 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Cant find the matching VM for VirtualMachineInstance: testvmistrh6znjpw" level=info timestamp=2018-08-02T11:42:53.418024Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:42:53.418159Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmistrh6znjpw kind= uid=3142e14f-9649-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:42:54.615605Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6znjpw\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6znjpw" level=error timestamp=2018-08-02T11:42:54.813893Z pos=replicaset.go:230 component=virt-controller service=http namespace=kubevirt-test-default name=replicasetr7vvf kind= uid=2ff74356-9649-11e8-9cfb-525500d15501 reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicasetr7vvf\": the object has been modified; please apply your changes to the latest version and try again" msg="Updating the replicaset status failed." level=info timestamp=2018-08-02T11:42:54.813983Z pos=replicaset.go:137 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstancereplicasets.kubevirt.io \"replicasetr7vvf\": the object has been modified; please apply your changes to the latest version and try again" msg="re-enqueuing VirtualMachineInstanceReplicaSet kubevirt-test-default/replicasetr7vvf" level=info timestamp=2018-08-02T11:42:55.214801Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmistrh6znjpw\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmistrh6znjpw" level=info timestamp=2018-08-02T11:42:56.740803Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:42:56.740891Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmitht2p kind= uid=333e3eee-9649-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:45:57.203335Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2dprj kind= uid=9ece2ec3-9649-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:45:57.204628Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi2dprj kind= uid=9ece2ec3-9649-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:48:57.649162Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7zcbk kind= uid=0a5c1592-964a-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:48:57.650379Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi7zcbk kind= uid=0a5c1592-964a-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T10:27:12.623926Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:50:34.228793Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:50:34.228823Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:50:34.228907Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi7zcbk kind= uid=0a5c1592-964a-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:50:34.230123Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi7zcbk kind= uid=0a5c1592-964a-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:50:34.230219Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi7zcbk" level=info timestamp=2018-08-02T11:51:39.466277Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2dprj, existing: false\n" level=info timestamp=2018-08-02T11:51:39.466372Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:51:39.466448Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2dprj kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:51:39.466619Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2dprj kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:51:56.150488Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi7zcbk, existing: true\n" level=info timestamp=2018-08-02T11:51:56.150585Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:51:56.150616Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:51:56.150705Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi7zcbk kind= uid=0a5c1592-964a-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:51:56.151443Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi7zcbk kind= uid=0a5c1592-964a-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:51:56.151627Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3159/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi7zcbk" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:42:36.257160Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.307816Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:42:36.307917Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: true\n" level=info timestamp=2018-08-02T11:42:36.307937Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:42:36.307959Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:42:36.308028Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.308109Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:42:36.310465Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: false\n" level=info timestamp=2018-08-02T11:42:36.311602Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:42:36.311643Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.311698Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:43:33.422175Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: false\n" level=info timestamp=2018-08-02T11:43:33.422269Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:43:33.422363Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:43:33.422508Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi7zcbk-tqgnr Pod phase: Running level=info timestamp=2018-08-02T11:49:00.796988Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:49:00.797344Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:49:00.800785Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:49:10.807218Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:49:10.829208Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi7zcbk" level=info timestamp=2018-08-02T11:49:10.830649Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:49:10.830796Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure in Spec Setup (BeforeEach) [180.462 seconds] VNC /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:46 A new VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/vnc_test.go:54 should upgrade subresource connections if an origin header is given [BeforeEach] /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table.go:92 for serial console /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/extensions/table/table_entry.go:46 Unexpected Warning event received: testvmi7zcbk,0a5c1592-964a-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ level=info timestamp=2018-08-02T11:48:58.456143Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmi7zcbk kind=VirtualMachineInstance uid=0a5c1592-964a-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi7zcbk-tqgnr" level=info timestamp=2018-08-02T11:49:12.977186Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmi7zcbk kind=VirtualMachineInstance uid=0a5c1592-964a-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmi7zcbk-tqgnr" level=error timestamp=2018-08-02T11:49:12.994622Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmi7zcbk kind=VirtualMachineInstance uid=0a5c1592-964a-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3160/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:50:44 http: TLS handshake error from 10.244.1.1:48284: EOF 2018/08/02 11:50:54 http: TLS handshake error from 10.244.1.1:48290: EOF level=info timestamp=2018-08-02T11:50:57.886864Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:51:04 http: TLS handshake error from 10.244.1.1:48296: EOF 2018/08/02 11:51:14 http: TLS handshake error from 10.244.1.1:48302: EOF 2018/08/02 11:51:24 http: TLS handshake error from 10.244.1.1:48308: EOF level=info timestamp=2018-08-02T11:51:27.860823Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:51:34 http: TLS handshake error from 10.244.1.1:48314: EOF 2018/08/02 11:51:44 http: TLS handshake error from 10.244.1.1:48320: EOF 2018/08/02 11:51:54 http: TLS handshake error from 10.244.1.1:48326: EOF level=info timestamp=2018-08-02T11:51:57.891726Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:52:04 http: TLS handshake error from 10.244.1.1:48330: EOF 2018/08/02 11:52:14 http: TLS handshake error from 10.244.1.1:48332: EOF 2018/08/02 11:52:24 http: TLS handshake error from 10.244.1.1:48338: EOF level=info timestamp=2018-08-02T11:52:27.873369Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:51:24.578892Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:51:26.684467Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:51:27 http: TLS handshake error from 10.244.0.1:53298: EOF 2018/08/02 11:51:37 http: TLS handshake error from 10.244.0.1:53322: EOF 2018/08/02 11:51:47 http: TLS handshake error from 10.244.0.1:53346: EOF level=info timestamp=2018-08-02T11:51:54.605264Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:51:56.715450Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:51:57 http: TLS handshake error from 10.244.0.1:53370: EOF level=info timestamp=2018-08-02T11:52:03.564995Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:52:03.565902Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:52:07 http: TLS handshake error from 10.244.0.1:53394: EOF 2018/08/02 11:52:17 http: TLS handshake error from 10.244.0.1:53418: EOF level=info timestamp=2018-08-02T11:52:24.630808Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:52:26.745988Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:52:27 http: TLS handshake error from 10.244.0.1:53442: EOF Pod name: virt-controller-7d57d96b65-lqm76 Pod phase: Running level=info timestamp=2018-08-02T11:52:00.454498Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T11:52:17.727694Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer limitrangeInformer" level=info timestamp=2018-08-02T11:52:17.728962Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmiInformer" level=info timestamp=2018-08-02T11:52:17.728987Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer kubeVirtPodInformer" level=info timestamp=2018-08-02T11:52:17.729007Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer kubeVirtNodeInformer" level=info timestamp=2018-08-02T11:52:17.729026Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmiPresetInformer" level=info timestamp=2018-08-02T11:52:17.729045Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmirsInformer" level=info timestamp=2018-08-02T11:52:17.729066Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer configMapInformer" level=info timestamp=2018-08-02T11:52:17.729084Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmInformer" level=info timestamp=2018-08-02T11:52:17.729210Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-08-02T11:52:17.746437Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-08-02T11:52:17.747094Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-08-02T11:52:17.747207Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-08-02T11:52:17.747859Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-08-02T11:52:18.597837Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi68mdc kind= uid=81e52410-964a-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:52:18.599270Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi68mdc kind= uid=81e52410-964a-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:52:31.917834Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi68mdc kind= uid=81e52410-964a-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:52:31.918751Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi68mdc kind= uid=81e52410-964a-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:52:31.918839Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi68mdc" level=info timestamp=2018-08-02T11:52:31.939012Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi68mdc, existing: true\n" level=info timestamp=2018-08-02T11:52:31.939056Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:52:31.939085Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:52:31.939149Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi68mdc kind= uid=81e52410-964a-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:52:31.939581Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi68mdc kind= uid=81e52410-964a-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:52:31.939662Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi68mdc" level=info timestamp=2018-08-02T11:52:31.979859Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi68mdc, existing: true\n" level=info timestamp=2018-08-02T11:52:31.979909Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:52:31.979937Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:52:31.980001Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi68mdc kind= uid=81e52410-964a-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:52:31.980514Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi68mdc kind= uid=81e52410-964a-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:52:31.980653Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi68mdc" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:42:36.257160Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.307816Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:42:36.307917Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: true\n" level=info timestamp=2018-08-02T11:42:36.307937Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:42:36.307959Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:42:36.308028Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.308109Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:42:36.310465Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: false\n" level=info timestamp=2018-08-02T11:42:36.311602Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:42:36.311643Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.311698Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:43:33.422175Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: false\n" level=info timestamp=2018-08-02T11:43:33.422269Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:43:33.422363Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:43:33.422508Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi68mdc-8dpxh Pod phase: Running level=info timestamp=2018-08-02T11:52:21.410644Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:52:21.410944Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:52:21.413054Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:52:31.419381Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:52:31.441290Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi68mdc" level=info timestamp=2018-08-02T11:52:31.443109Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:52:31.443257Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running level=info timestamp=2018-08-02T11:53:27.885475Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:53:34 http: TLS handshake error from 10.244.1.1:48380: EOF 2018/08/02 11:53:44 http: TLS handshake error from 10.244.1.1:48386: EOF 2018/08/02 11:53:54 http: TLS handshake error from 10.244.1.1:48392: EOF level=info timestamp=2018-08-02T11:53:57.877660Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:54:04 http: TLS handshake error from 10.244.1.1:48398: EOF 2018/08/02 11:54:14 http: TLS handshake error from 10.244.1.1:48404: EOF 2018/08/02 11:54:24 http: TLS handshake error from 10.244.1.1:48410: EOF level=info timestamp=2018-08-02T11:54:27.871592Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:54:34 http: TLS handshake error from 10.244.1.1:48416: EOF 2018/08/02 11:54:44 http: TLS handshake error from 10.244.1.1:48422: EOF 2018/08/02 11:54:54 http: TLS handshake error from 10.244.1.1:48428: EOF level=info timestamp=2018-08-02T11:54:57.865884Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:55:04 http: TLS handshake error from 10.244.1.1:48434: EOF 2018/08/02 11:55:14 http: TLS handshake error from 10.244.1.1:48440: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:54:03.473258Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:54:07 http: TLS handshake error from 10.244.0.1:53682: EOF 2018/08/02 11:54:17 http: TLS handshake error from 10.244.0.1:53706: EOF level=info timestamp=2018-08-02T11:54:24.746062Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:54:26.861869Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:54:27 http: TLS handshake error from 10.244.0.1:53730: EOF 2018/08/02 11:54:37 http: TLS handshake error from 10.244.0.1:53754: EOF 2018/08/02 11:54:47 http: TLS handshake error from 10.244.0.1:53778: EOF level=info timestamp=2018-08-02T11:54:54.773598Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:54:56.895241Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:54:57 http: TLS handshake error from 10.244.0.1:53802: EOF level=info timestamp=2018-08-02T11:55:03.474436Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:55:03.475673Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:55:07 http: TLS handshake error from 10.244.0.1:53826: EOF 2018/08/02 11:55:17 http: TLS handshake error from 10.244.0.1:53850: EOF Pod name: virt-controller-7d57d96b65-lqm76 Pod phase: Running level=info timestamp=2018-08-02T11:52:00.454498Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T11:52:17.727694Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer limitrangeInformer" level=info timestamp=2018-08-02T11:52:17.728962Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmiInformer" level=info timestamp=2018-08-02T11:52:17.728987Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer kubeVirtPodInformer" level=info timestamp=2018-08-02T11:52:17.729007Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer kubeVirtNodeInformer" level=info timestamp=2018-08-02T11:52:17.729026Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmiPresetInformer" level=info timestamp=2018-08-02T11:52:17.729045Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmirsInformer" level=info timestamp=2018-08-02T11:52:17.729066Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer configMapInformer" level=info timestamp=2018-08-02T11:52:17.729084Z pos=virtinformers.go:107 component=virt-controller service=http msg="STARTING informer vmInformer" level=info timestamp=2018-08-02T11:52:17.729210Z pos=vm.go:85 component=virt-controller service=http msg="Starting VirtualMachine controller." level=info timestamp=2018-08-02T11:52:17.746437Z pos=node.go:104 component=virt-controller service=http msg="Starting node controller." level=info timestamp=2018-08-02T11:52:17.747094Z pos=vmi.go:129 component=virt-controller service=http msg="Starting vmi controller." level=info timestamp=2018-08-02T11:52:17.747207Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-08-02T11:52:17.747859Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-08-02T11:52:18.597837Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi68mdc kind= uid=81e52410-964a-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:52:18.599270Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi68mdc kind= uid=81e52410-964a-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:53:53.834563Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:53:53.834600Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:53:53.834688Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi68mdc kind= uid=81e52410-964a-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:53:53.835324Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi68mdc kind= uid=81e52410-964a-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:53:53.835408Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3125/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi68mdc" level=info timestamp=2018-08-02T11:54:39.992729Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi7zcbk, existing: false\n" level=info timestamp=2018-08-02T11:54:39.992825Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:54:39.992895Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi7zcbk kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:54:39.992984Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi7zcbk kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:55:15.755694Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi68mdc, existing: true\n" level=info timestamp=2018-08-02T11:55:15.755798Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:55:15.755838Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:55:15.755930Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi68mdc kind= uid=81e52410-964a-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:55:15.757672Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi68mdc kind= uid=81e52410-964a-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:55:15.757778Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi68mdc" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:42:36.257160Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.307816Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:42:36.307917Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: true\n" level=info timestamp=2018-08-02T11:42:36.307937Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Failed\n" level=info timestamp=2018-08-02T11:42:36.307959Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:42:36.308028Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.308109Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind= uid=de5f4487-9648-11e8-9cfb-525500d15501 msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:42:36.310465Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: false\n" level=info timestamp=2018-08-02T11:42:36.311602Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:42:36.311643Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:42:36.311698Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." level=info timestamp=2018-08-02T11:43:33.422175Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi2bjmmmfppx, existing: false\n" level=info timestamp=2018-08-02T11:43:33.422269Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:43:33.422363Z pos=vm.go:415 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Processing local ephemeral data cleanup for shutdown domain." level=info timestamp=2018-08-02T11:43:33.422508Z pos=vm.go:442 component=virt-handler namespace=kubevirt-test-default name=testvmi2bjmmmfppx kind=VirtualMachineInstance uid= msg="Synchronization loop succeeded." Pod name: virt-launcher-testvmi68mdc-8dpxh Pod phase: Running level=info timestamp=2018-08-02T11:52:21.410644Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:52:21.410944Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:52:21.413054Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:52:31.419381Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:52:31.441290Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi68mdc" level=info timestamp=2018-08-02T11:52:31.443109Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:52:31.443257Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" • Failure [200.533 seconds] LeaderElection /root/go/src/kubevirt.io/kubevirt/tests/controller_leader_election_test.go:43 Start a VirtualMachineInstance /root/go/src/kubevirt.io/kubevirt/tests/controller_leader_election_test.go:53 when the controller pod is not running /root/go/src/kubevirt.io/kubevirt/tests/controller_leader_election_test.go:54 should success [It] /root/go/src/kubevirt.io/kubevirt/tests/controller_leader_election_test.go:55 Unexpected Warning event received: testvmi68mdc,81e52410-964a-11e8-9cfb-525500d15501: Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt Expected : Warning not to equal : Warning /root/go/src/kubevirt.io/kubevirt/tests/utils.go:247 ------------------------------ STEP: Destroying the leading controller pod STEP: Starting a new VirtualMachineInstance level=info timestamp=2018-08-02T11:52:19.022580Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmi68mdc kind=VirtualMachineInstance uid=81e52410-964a-11e8-9cfb-525500d15501 msg="Created virtual machine pod virt-launcher-testvmi68mdc-8dpxh" level=info timestamp=2018-08-02T11:52:32.572557Z pos=utils.go:245 component=tests namespace=kubevirt-test-default name=testvmi68mdc kind=VirtualMachineInstance uid=81e52410-964a-11e8-9cfb-525500d15501 msg="Pod owner ship transferred to the node virt-launcher-testvmi68mdc-8dpxh" level=error timestamp=2018-08-02T11:52:32.592133Z pos=utils.go:243 component=tests namespace=kubevirt-test-default name=testvmi68mdc kind=VirtualMachineInstance uid=81e52410-964a-11e8-9cfb-525500d15501 reason="unexpected warning event received" msg="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3559/ns/mnt" Pod name: disks-images-provider-44cpl Pod phase: Running copy all images to host mount directory Pod name: disks-images-provider-l2td6 Pod phase: Running copy all images to host mount directory Pod name: virt-api-7d79764579-kk8rs Pod phase: Running 2018/08/02 11:53:54 http: TLS handshake error from 10.244.1.1:48392: EOF level=info timestamp=2018-08-02T11:53:57.877660Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:54:04 http: TLS handshake error from 10.244.1.1:48398: EOF 2018/08/02 11:54:14 http: TLS handshake error from 10.244.1.1:48404: EOF 2018/08/02 11:54:24 http: TLS handshake error from 10.244.1.1:48410: EOF level=info timestamp=2018-08-02T11:54:27.871592Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:54:34 http: TLS handshake error from 10.244.1.1:48416: EOF 2018/08/02 11:54:44 http: TLS handshake error from 10.244.1.1:48422: EOF 2018/08/02 11:54:54 http: TLS handshake error from 10.244.1.1:48428: EOF level=info timestamp=2018-08-02T11:54:57.865884Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:55:04 http: TLS handshake error from 10.244.1.1:48434: EOF 2018/08/02 11:55:14 http: TLS handshake error from 10.244.1.1:48440: EOF 2018/08/02 11:55:24 http: TLS handshake error from 10.244.1.1:48446: EOF level=info timestamp=2018-08-02T11:55:27.901291Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.0 username=- method=GET url=/ proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:55:34 http: TLS handshake error from 10.244.1.1:48452: EOF Pod name: virt-api-7d79764579-qbwqf Pod phase: Running level=info timestamp=2018-08-02T11:54:24.746062Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:54:26.861869Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:54:27 http: TLS handshake error from 10.244.0.1:53730: EOF 2018/08/02 11:54:37 http: TLS handshake error from 10.244.0.1:53754: EOF 2018/08/02 11:54:47 http: TLS handshake error from 10.244.0.1:53778: EOF level=info timestamp=2018-08-02T11:54:54.773598Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:54:56.895241Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:54:57 http: TLS handshake error from 10.244.0.1:53802: EOF level=info timestamp=2018-08-02T11:55:03.474436Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/openapi/v2 proto=HTTP/2.0 statusCode=404 contentLength=19 level=info timestamp=2018-08-02T11:55:03.475673Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/swagger.json proto=HTTP/2.0 statusCode=404 contentLength=19 2018/08/02 11:55:07 http: TLS handshake error from 10.244.0.1:53826: EOF 2018/08/02 11:55:17 http: TLS handshake error from 10.244.0.1:53850: EOF level=info timestamp=2018-08-02T11:55:24.807215Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 level=info timestamp=2018-08-02T11:55:26.942028Z pos=filter.go:46 component=virt-api remoteAddress=10.244.0.1 username=- method=GET url=/apis/subresources.kubevirt.io/v1alpha2 proto=HTTP/2.0 statusCode=200 contentLength=136 2018/08/02 11:55:27 http: TLS handshake error from 10.244.0.1:53874: EOF Pod name: virt-controller-7d57d96b65-lqm76 Pod phase: Running level=info timestamp=2018-08-02T11:52:00.454498Z pos=application.go:177 component=virt-controller service=http action=listening interface=0.0.0.0 port=8182 Pod name: virt-controller-7d57d96b65-t48v6 Pod phase: Running level=info timestamp=2018-08-02T11:52:17.747207Z pos=replicaset.go:111 component=virt-controller service=http msg="Starting VirtualMachineInstanceReplicaSet controller." level=info timestamp=2018-08-02T11:52:17.747859Z pos=preset.go:74 component=virt-controller service=http msg="Starting Virtual Machine Initializer." level=info timestamp=2018-08-02T11:52:18.597837Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi68mdc kind= uid=81e52410-964a-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:52:18.599270Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi68mdc kind= uid=81e52410-964a-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:55:19.044827Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivvsnw kind= uid=ed746bbe-964a-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:55:19.045000Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmivvsnw kind= uid=ed746bbe-964a-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:55:19.056849Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8n8b5 kind= uid=ed75a355-964a-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:55:19.056997Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi8n8b5 kind= uid=ed75a355-964a-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:55:19.069133Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilrncr kind= uid=ed773ed4-964a-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:55:19.069274Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmilrncr kind= uid=ed773ed4-964a-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:55:19.089837Z pos=preset.go:142 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9pcxk kind= uid=ed792ec2-964a-11e8-9cfb-525500d15501 msg="Initializing VirtualMachineInstance" level=info timestamp=2018-08-02T11:55:19.089946Z pos=preset.go:171 component=virt-controller service=http namespace=kubevirt-test-default name=testvmi9pcxk kind= uid=ed792ec2-964a-11e8-9cfb-525500d15501 msg="Marking VirtualMachineInstance as initialized" level=info timestamp=2018-08-02T11:55:19.142227Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmivvsnw\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmivvsnw" level=info timestamp=2018-08-02T11:55:19.652103Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9pcxk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9pcxk" level=info timestamp=2018-08-02T11:55:20.049123Z pos=vmi.go:157 component=virt-controller service=http reason="Operation cannot be fulfilled on virtualmachineinstances.kubevirt.io \"testvmi9pcxk\": the object has been modified; please apply your changes to the latest version and try again" msg="reenqueuing VirtualMachineInstance kubevirt-test-default/testvmi9pcxk" Pod name: virt-handler-8hwbb Pod phase: Running level=info timestamp=2018-08-02T11:55:37.227354Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmivvsnw kind= uid=ed746bbe-964a-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:55:37.228080Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmivvsnw kind= uid=ed746bbe-964a-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:55:37.228152Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmivvsnw" level=info timestamp=2018-08-02T11:55:37.262141Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi8n8b5, existing: true\n" level=info timestamp=2018-08-02T11:55:37.262214Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:55:37.262244Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:55:37.262359Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi8n8b5 kind= uid=ed75a355-964a-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:55:37.263869Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi8n8b5 kind= uid=ed75a355-964a-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:55:37.263972Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3156/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi8n8b5" level=info timestamp=2018-08-02T11:55:37.268961Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmivvsnw, existing: true\n" level=info timestamp=2018-08-02T11:55:37.269040Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:55:37.269063Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:55:37.269204Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmivvsnw kind= uid=ed746bbe-964a-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:55:37.270084Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmivvsnw kind= uid=ed746bbe-964a-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:55:37.270214Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/3125/task/3158/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmivvsnw" Pod name: virt-handler-pgqmx Pod phase: Running level=info timestamp=2018-08-02T11:55:34.032734Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi9pcxk kind= uid=ed792ec2-964a-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:55:34.034020Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi9pcxk kind= uid=ed792ec2-964a-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:55:34.034131Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6632/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi9pcxk" level=info timestamp=2018-08-02T11:55:34.674380Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi9pcxk, existing: true\n" level=info timestamp=2018-08-02T11:55:34.674467Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:55:34.674530Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:55:34.674628Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi9pcxk kind= uid=ed792ec2-964a-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:55:34.676318Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi9pcxk kind= uid=ed792ec2-964a-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6636/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:55:34.676434Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6636/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi9pcxk" level=info timestamp=2018-08-02T11:55:35.956652Z pos=vm.go:315 component=virt-handler msg="Processing vmi testvmi9pcxk, existing: true\n" level=info timestamp=2018-08-02T11:55:35.956748Z pos=vm.go:317 component=virt-handler msg="vmi is in phase: Scheduled\n" level=info timestamp=2018-08-02T11:55:35.956787Z pos=vm.go:331 component=virt-handler msg="Domain: existing: false\n" level=info timestamp=2018-08-02T11:55:35.956887Z pos=vm.go:418 component=virt-handler namespace=kubevirt-test-default name=testvmi9pcxk kind= uid=ed792ec2-964a-11e8-9cfb-525500d15501 msg="Processing vmi update" level=error timestamp=2018-08-02T11:55:35.958536Z pos=vm.go:426 component=virt-handler namespace=kubevirt-test-default name=testvmi9pcxk kind= uid=ed792ec2-964a-11e8-9cfb-525500d15501 reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6636/ns/mnt" msg="Synchronizing the VirtualMachineInstance failed." level=info timestamp=2018-08-02T11:55:35.958767Z pos=vm.go:253 component=virt-handler reason="Failed to open current namespace: Error detecting namespace type from path: /proc/6546/task/6636/ns/mnt" msg="re-enqueuing VirtualMachineInstance kubevirt-test-default/testvmi9pcxk" Pod name: virt-launcher-testvmi8n8b5-zs4k6 Pod phase: Running level=info timestamp=2018-08-02T11:55:22.590352Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:55:22.590639Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:55:22.592007Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:55:35.595754Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:55:35.658834Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi8n8b5" level=info timestamp=2018-08-02T11:55:35.673357Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:55:35.673671Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmi9pcxk-pqwdm Pod phase: Running level=info timestamp=2018-08-02T11:55:22.362218Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:55:22.362914Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:55:22.364360Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:55:32.371444Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:55:32.411429Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmi9pcxk" level=info timestamp=2018-08-02T11:55:32.413713Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:55:32.413863Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmilrncr-w5jhq Pod phase: Running level=info timestamp=2018-08-02T11:55:24.388213Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:55:24.389001Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:55:24.392688Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:55:35.788698Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:55:35.810303Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmilrncr" level=info timestamp=2018-08-02T11:55:35.811796Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:55:35.812003Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" Pod name: virt-launcher-testvmivvsnw-494qw Pod phase: Running level=info timestamp=2018-08-02T11:55:22.920795Z pos=manager.go:69 component=virt-launcher msg="Collected all requested hook sidecar sockets" level=info timestamp=2018-08-02T11:55:22.921062Z pos=manager.go:72 component=virt-launcher msg="Sorted all collected sidecar sockets per hook point based on their priority and name: map[]" level=info timestamp=2018-08-02T11:55:22.922389Z pos=libvirt.go:261 component=virt-launcher msg="Connecting to libvirt daemon: qemu:///system" level=info timestamp=2018-08-02T11:55:35.872765Z pos=libvirt.go:276 component=virt-launcher msg="Connected to libvirt daemon" level=info timestamp=2018-08-02T11:55:35.891567Z pos=virt-launcher.go:143 component=virt-launcher msg="Watchdog file created at /var/run/kubevirt/watchdog-files/kubevirt-test-default_testvmivvsnw" level=info timestamp=2018-08-02T11:55:35.892886Z pos=client.go:152 component=virt-launcher msg="Registered libvirt event notify callback" level=info timestamp=2018-08-02T11:55:35.893041Z pos=virt-launcher.go:60 component=virt-launcher msg="Marked as ready" panic: test timed out after 1h30m0s goroutine 15699 [running]: testing.(*M).startAlarm.func1() /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:1240 +0xfc created by time.goFunc /gimme/.gimme/versions/go1.10.linux.amd64/src/time/sleep.go:172 +0x44 goroutine 1 [chan receive, 90 minutes]: testing.(*T).Run(0xc420531e00, 0x139e775, 0x9, 0x1430cc8, 0x4801e6) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:825 +0x301 testing.runTests.func1(0xc420531d10) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:1063 +0x64 testing.tRunner(0xc420531d10, 0xc420547df8) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:777 +0xd0 testing.runTests(0xc420771dc0, 0x1d32a50, 0x1, 0x1, 0x412009) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:1061 +0x2c4 testing.(*M).Run(0xc4207ced80, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:978 +0x171 main.main() _testmain.go:44 +0x151 goroutine 5 [chan receive]: kubevirt.io/kubevirt/vendor/github.com/golang/glog.(*loggingT).flushDaemon(0x1d5e280) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/golang/glog/glog.go:879 +0x8b created by kubevirt.io/kubevirt/vendor/github.com/golang/glog.init.0 /root/go/src/kubevirt.io/kubevirt/vendor/github.com/golang/glog/glog.go:410 +0x203 goroutine 6 [syscall, 90 minutes]: os/signal.signal_recv(0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/sigqueue.go:139 +0xa6 os/signal.loop() /gimme/.gimme/versions/go1.10.linux.amd64/src/os/signal/signal_unix.go:22 +0x22 created by os/signal.init.0 /gimme/.gimme/versions/go1.10.linux.amd64/src/os/signal/signal_unix.go:28 +0x41 goroutine 11 [sleep]: time.Sleep(0xb14bf95) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/time.go:102 +0x166 kubevirt.io/kubevirt/vendor/k8s.io/client-go/util/flowcontrol.realClock.Sleep(0xb14bf95) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/client-go/util/flowcontrol/throttle.go:66 +0x2b kubevirt.io/kubevirt/vendor/k8s.io/client-go/util/flowcontrol.(*tokenBucketRateLimiter).Accept(0xc420576160) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/client-go/util/flowcontrol/throttle.go:91 +0xbd kubevirt.io/kubevirt/vendor/k8s.io/client-go/rest.(*Request).tryThrottle(0xc420d60600) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/client-go/rest/request.go:478 +0x1fd kubevirt.io/kubevirt/vendor/k8s.io/client-go/rest.(*Request).Do(0xc420d60600, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/client-go/rest/request.go:733 +0x62 kubevirt.io/kubevirt/pkg/kubecli.(*vmis).Get(0xc420869b60, 0xc420c7e920, 0xc, 0xc420a8d400, 0xc420869b60, 0xc42007ac00, 0x8) /root/go/src/kubevirt.io/kubevirt/pkg/kubecli/vmi.go:369 +0x125 kubevirt.io/kubevirt/tests.waitForVMIStart.func1(0x0) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1055 +0xc2 reflect.Value.call(0x118b3e0, 0xc42077b980, 0x13, 0x1398830, 0x4, 0xc420cdccb8, 0x0, 0x0, 0x118b3e0, 0x118b3e0, ...) /gimme/.gimme/versions/go1.10.linux.amd64/src/reflect/value.go:447 +0x969 reflect.Value.Call(0x118b3e0, 0xc42077b980, 0x13, 0xc420cdccb8, 0x0, 0x0, 0x44b21b, 0xc420ba0a08, 0xc420cdccf0) /gimme/.gimme/versions/go1.10.linux.amd64/src/reflect/value.go:308 +0xa4 kubevirt.io/kubevirt/vendor/github.com/onsi/gomega/internal/asyncassertion.(*AsyncAssertion).pollActual(0xc420ad1000, 0x0, 0x0, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/gomega/internal/asyncassertion/async_assertion.go:71 +0x9f kubevirt.io/kubevirt/vendor/github.com/onsi/gomega/internal/asyncassertion.(*AsyncAssertion).match(0xc420ad1000, 0x14c4b20, 0xc420691c70, 0x412801, 0xc420691c90, 0x1, 0x1, 0xc420691c90) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/gomega/internal/asyncassertion/async_assertion.go:141 +0x305 kubevirt.io/kubevirt/vendor/github.com/onsi/gomega/internal/asyncassertion.(*AsyncAssertion).Should(0xc420ad1000, 0x14c4b20, 0xc420691c70, 0xc420691c90, 0x1, 0x1, 0x14bbac0) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/gomega/internal/asyncassertion/async_assertion.go:48 +0x62 kubevirt.io/kubevirt/tests.waitForVMIStart(0x14ba840, 0xc420c78280, 0x5a, 0x0, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1065 +0x703 kubevirt.io/kubevirt/tests.WaitForSuccessfulVMIStart(0x14ba840, 0xc420c78280, 0xc420cdd120, 0xa5a8de) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1088 +0x43 kubevirt.io/kubevirt/tests.WaitUntilVMIReady(0xc420c78280, 0x1430ca0, 0x1d7c938) /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1093 +0x3b kubevirt.io/kubevirt/tests_test.glob..func18.4() /root/go/src/kubevirt.io/kubevirt/tests/vmi_networking_test.go:135 +0x72b kubevirt.io/kubevirt/tests.BeforeAll.func1() /root/go/src/kubevirt.io/kubevirt/tests/utils.go:1375 +0x3f kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).runSync(0xc4206cacc0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:113 +0x9c kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*runner).run(0xc4206cacc0, 0xc42071ec90, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes/runner.go:64 +0x13e kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes.(*SetupNode).Run(0xc42000e060, 0x14b6ce0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/leafnodes/setup_nodes.go:15 +0x7f kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec.(*Spec).runSample(0xc420592870, 0x0, 0x14b6ce0, 0xc420055500) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec/spec.go:181 +0x1f1 kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec.(*Spec).Run(0xc420592870, 0x14b6ce0, 0xc420055500) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/spec/spec.go:138 +0xff kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).runSpec(0xc42032e280, 0xc420592870, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:200 +0x10d kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).runSpecs(0xc42032e280, 0x1) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:170 +0x329 kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).Run(0xc42032e280, 0xb) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:66 +0x11b kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/suite.(*Suite).Run(0xc4200ccaf0, 0x7fbf55d16048, 0xc420531e00, 0x13a0d58, 0xb, 0xc420771e00, 0x2, 0x2, 0x14d35e0, 0xc420055500, ...) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/suite/suite.go:62 +0x27c kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo.RunSpecsWithCustomReporters(0x14b7d40, 0xc420531e00, 0x13a0d58, 0xb, 0xc420771de0, 0x2, 0x2, 0x2) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/ginkgo_dsl.go:221 +0x258 kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo.RunSpecsWithDefaultAndCustomReporters(0x14b7d40, 0xc420531e00, 0x13a0d58, 0xb, 0xc42057c7f0, 0x1, 0x1, 0x1) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/ginkgo_dsl.go:209 +0xab kubevirt.io/kubevirt/tests_test.TestTests(0xc420531e00) /root/go/src/kubevirt.io/kubevirt/tests/tests_suite_test.go:43 +0xaa testing.tRunner(0xc420531e00, 0x1430cc8) /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:777 +0xd0 created by testing.(*T).Run /gimme/.gimme/versions/go1.10.linux.amd64/src/testing/testing.go:824 +0x2e0 goroutine 12 [chan receive, 90 minutes]: kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).registerForInterrupts(0xc42032e280, 0xc4200b2ea0) /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:223 +0xd1 created by kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner.(*SpecRunner).Run /root/go/src/kubevirt.io/kubevirt/vendor/github.com/onsi/ginkgo/internal/specrunner/spec_runner.go:60 +0x88 goroutine 13 [select, 90 minutes, locked to thread]: runtime.gopark(0x1432ea0, 0x0, 0x139b297, 0x6, 0x18, 0x1) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/proc.go:291 +0x11a runtime.selectgo(0xc42047df50, 0xc4200b2f60) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/select.go:392 +0xe50 runtime.ensureSigM.func1() /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/signal_unix.go:549 +0x1f4 runtime.goexit() /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/asm_amd64.s:2361 +0x1 goroutine 23 [IO wait]: internal/poll.runtime_pollWait(0x7fbf55d01f00, 0x72, 0xc420613850) /gimme/.gimme/versions/go1.10.linux.amd64/src/runtime/netpoll.go:173 +0x57 internal/poll.(*pollDesc).wait(0xc420744918, 0x72, 0xffffffffffffff00, 0x14b8f00, 0x1c497d0) /gimme/.gimme/versions/go1.10.linux.amd64/src/internal/poll/fd_poll_runtime.go:85 +0x9b internal/poll.(*pollDesc).waitRead(0xc420744918, 0xc420726000, 0x8000, 0x8000) /gimme/.gimme/versions/go1.10.linux.amd64/src/internal/poll/fd_poll_runtime.go:90 +0x3d internal/poll.(*FD).Read(0xc420744900, 0xc420726000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/internal/poll/fd_unix.go:157 +0x17d net.(*netFD).Read(0xc420744900, 0xc420726000, 0x8000, 0x8000, 0x0, 0x8, 0x7ffb) /gimme/.gimme/versions/go1.10.linux.amd64/src/net/fd_unix.go:202 +0x4f net.(*conn).Read(0xc420122130, 0xc420726000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/net/net.go:176 +0x6a crypto/tls.(*block).readFromUntil(0xc42079c090, 0x7fbf55cb6b58, 0xc420122130, 0x5, 0xc420122130, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/crypto/tls/conn.go:493 +0x96 crypto/tls.(*Conn).readRecord(0xc42079e000, 0x1432f17, 0xc42079e120, 0x20) /gimme/.gimme/versions/go1.10.linux.amd64/src/crypto/tls/conn.go:595 +0xe0 crypto/tls.(*Conn).Read(0xc42079e000, 0xc420605000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /gimme/.gimme/versions/go1.10.linux.amd64/src/crypto/tls/conn.go:1156 +0x100 bufio.(*Reader).Read(0xc42070a300, 0xc4208d42d8, 0x9, 0x9, 0xc4208dff78, 0xc4208c2220, 0xc420613d10) /gimme/.gimme/versions/go1.10.linux.amd64/src/bufio/bufio.go:216 +0x238 io.ReadAtLeast(0x14b5ae0, 0xc42070a300, 0xc4208d42d8, 0x9, 0x9, 0x9, 0xc420613ce0, 0xc420613ce0, 0x406614) /gimme/.gimme/versions/go1.10.linux.amd64/src/io/io.go:309 +0x86 io.ReadFull(0x14b5ae0, 0xc42070a300, 0xc4208d42d8, 0x9, 0x9, 0xc4208dff20, 0xc420613d10, 0xc400007501) /gimme/.gimme/versions/go1.10.linux.amd64/src/io/io.go:327 +0x58 kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.readFrameHeader(0xc4208d42d8, 0x9, 0x9, 0x14b5ae0, 0xc42070a300, 0x0, 0xc400000000, 0x7ef9ad, 0xc420613fb0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/frame.go:237 +0x7b kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc4208d42a0, 0xc42079d860, 0x0, 0x0, 0x0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/frame.go:492 +0xa4 kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*clientConnReadLoop).run(0xc420613fb0, 0x1431c20, 0xc4204777b0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/transport.go:1428 +0x8e kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*ClientConn).readLoop(0xc4200d49c0) /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/transport.go:1354 +0x76 created by kubevirt.io/kubevirt/vendor/golang.org/x/net/http2.(*Transport).newClientConn /root/go/src/kubevirt.io/kubevirt/vendor/golang.org/x/net/http2/transport.go:579 +0x651 goroutine 7631 [chan send, 47 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc42079cd20) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 483 [chan send, 89 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc4206502d0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 249 [chan send, 80 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc42078c060) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 10279 [chan send, 32 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc4205a1260) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 13803 [chan send, 11 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc420881a10) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 1637 [chan send, 83 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc420810240) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 993 [chan send, 86 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc420561080) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 2726 [chan send, 76 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc420810840) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 8678 [chan send, 41 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc42071af30) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 3792 [chan send, 68 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc4208a9d70) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 5411 [chan send, 59 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc42062d0e0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 13303 [chan send, 14 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc4205618c0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 3232 [chan send, 73 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc4206519e0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 4879 [chan send, 62 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc420707e90) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 4341 [chan send, 65 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc420799050) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 8178 [chan send, 44 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc4207c1a70) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 6639 [chan send, 53 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc42056d770) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 15356 [chan send, 2 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc42079d020) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 7086 [chan send, 50 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc420515500) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 6131 [chan send, 56 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc4205140f0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 11292 [chan send, 26 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc420656930) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 9224 [chan send, 38 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc4204271a0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 9753 [chan send, 35 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc42079d3b0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 8832 [chan send, 29 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc42083a0f0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 14849 [chan send, 5 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc42054c7e0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 12259 [chan send, 20 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc4208805a0) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 goroutine 14340 [chan send, 9 minutes]: kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc4204d4390) /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:114 +0x114 created by kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch.NewStreamWatcher /root/go/src/kubevirt.io/kubevirt/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:60 +0xa8 make: *** [functest] Error 2 + make cluster-down ./cluster/down.sh