5:35 a.m.
Hello everybody,
I installed eucalyptus on ubuntu10, basic configuration . Everything is ok
untill I start the instances, the disk is being created but it terminates
soon.
Environment:
NFS , KVM, ubuntu10 x64, Euca on 2 machines (wc sc cc clc on one machine,
and nc on another).
libvirtd (libvirt) 0.7.5
QEMU PC emulator version 0.12.3 (qemu-kvm-0.12.3), Copyright (c) 2003-2008
Fabrice Bellard.
Logs:
/var/log/eucalyptus/nc.log:
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] doStartNetwork() invoked
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] StartNetwork(): SUCCESS
return from vnetStartNetwork 0
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] StartNetwork(): done
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] doRunInstance() invoked
(id=i-4C9D08C3 cores=2 disk=10 memory=512)
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ]
image=emi-DDBD105C at
http://10.1.1.2:8773/services/Walrus/image-store-1308215076/image.manifes...
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ]
krnel=eki-F41F10E3 at
http://10.1.1.2:8773/services/Walrus/image-store-1308215076/kernel.manife...
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ]
rmdsk=eri-08841148 at
http://10.1.1.2:8773/services/Walrus/image-store-1308215076/ramdisk.manif...
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ]
vlan=10 priMAC=d0:0d:4C:9D:08:C3 pubMAC=d0:0d:4C:9D:08:C3
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] network started for instance
i-4C9D08C3
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] retrieving images for
instance i-4C9D08C3 (disk limit=10240MB)...
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] verifying cached file in
/var/lib/eucalyptus/instances//eucalyptus/cache/eki-F41F10E3/kernel...
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] walrus_request(): downloading
/tmp/walrus-digest-3D4AKY
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] from
http://10.1.1.2:8773/services/Walrus/image-store-1308215076/kernel.manife...
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): writing GET
output to /tmp/walrus-digest-3D4AKY
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): wrote 3479
bytes in 3 writes
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] walrus_request(): saved image
in /tmp/walrus-digest-3D4AKY
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] vrun(): [cp -a
/var/lib/eucalyptus/instances//eucalyptus/cache/eki-F41F10E3/kernel
/var/lib/eucalyptus/instances//admin/i-4C9D08C3/ker
nel]
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] verifying cached file in
/var/lib/eucalyptus/instances//eucalyptus/cache/eri-08841148/ramdisk...
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] walrus_request(): downloading
/tmp/walrus-digest-sVEVa4
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] from
http://10.1.1.2:8773/services/Walrus/image-store-1308215076/ramdisk.manif...
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): writing GET
output to /tmp/walrus-digest-sVEVa4
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): wrote 3482
bytes in 3 writes
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] walrus_request(): saved image
in /tmp/walrus-digest-sVEVa4
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] vrun(): [cp -a
/var/lib/eucalyptus/instances//eucalyptus/cache/eri-08841148/ramdisk
/var/lib/eucalyptus/instances//admin/i-4C9D08C3/ramdisk]
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] verifying cached file in
/var/lib/eucalyptus/instances//eucalyptus/cache/emi-DDBD105C/disk...
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] walrus_request(): downloading
/tmp/walrus-digest-RQEzI9
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] from
http://10.1.1.2:8773/services/Walrus/image-store-1308215076/image.manifes...
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): writing GET
output to /tmp/walrus-digest-RQEzI9
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): wrote 5887
bytes in 5 writes
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] walrus_request(): saved image
in /tmp/walrus-digest-RQEzI9
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] vrun(): [cp -a
/var/lib/eucalyptus/instances//eucalyptus/cache/emi-DDBD105C/disk
/var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk]
[Thu Jun 16 03:54:32 2011][003755][EUCAINFO ] vrun():
[//usr/lib/eucalyptus/euca_rootwrap //usr/share/eucalyptus/partition2disk
/var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk 512 8280]
[Thu Jun 16 03:54:37 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:54:37 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:54:43 2011][003755][EUCAINFO ] preparing images for instance
i-4C9D08C3...
[Thu Jun 16 03:54:43 2011][003755][EUCAINFO ] adding key/tmp/sckey.uUHVTI
to the root file system at
/var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk using
(//usr/lib/eucalyptus/euca_rootwrap
//usr/share/eucalyptus/add_key.pl//usr/lib/eucalyptus/euca_mountwrap)
[Thu Jun 16 03:54:43 2011][003755][EUCAINFO ] vrun():
[//usr/lib/eucalyptus/euca_rootwrap
//usr/share/eucalyptus/add_key.pl//usr/lib/eucalyptus/euca_mountwrap
32256
/var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk /tmp/sckey.uUHVTI]
[Thu Jun 16 03:54:43 2011][003755][EUCADEBUG ] system_output():
[//usr/lib/eucalyptus/euca_rootwrap
//usr/share/eucalyptus/gen_kvm_libvirt_xml --ramdisk --ephemeral]
[Thu Jun 16 03:54:43 2011][003755][EUCAINFO ] currently running/booting:
i-4C9D08C3
[Thu Jun 16 03:54:43 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:54:43 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:54:49 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:54:49 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:54:55 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:54:55 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:55:01 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:55:01 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:55:07 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:55:07 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:55:13 2011][003755][EUCAERROR ] libvirt: monitor socket did
not show up.: No such file or directory (code=38)
[Thu Jun 16 03:55:13 2011][003755][EUCAFATAL ] hypervisor failed to start
domain
[Thu Jun 16 03:55:13 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:55:13 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:55:15 2011][003755][EUCAERROR ] libvirt: Domain not found: no
domain with matching name 'i-4C9D08C3' (code=42)
[Thu Jun 16 03:55:15 2011][003755][EUCAINFO ] vrun(): [rm -rf
/var/lib/eucalyptus/instances//admin/i-4C9D08C3/]
[Thu Jun 16 03:55:15 2011][003755][EUCAINFO ] stopping the network
(vlan=10)
[Thu Jun 16 03:55:19 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:55:19 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:55:25 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:55:25 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:55:26 2011][003755][EUCAINFO ] doTerminateInstance() invoked
(id=i-4C9D08C3)
[Thu Jun 16 03:55:26 2011][003755][EUCAERROR ] libvirt: Domain not found: no
domain with matching name 'i-4C9D08C3' (code=42)
[Thu Jun 16 03:55:26 2011][003755][EUCAWARN ] warning: domain i-4C9D08C3 to
be terminated not running on hypervisor
[Thu Jun 16 03:55:31 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:55:31 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
/var/log/libvirt/qemu/i-4C9D08C3.log:
LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/bin:/usr/sbin:/sbin:/bin
/usr/bin/kvm -S -M pc-0.12 -enable-kvm -m 512 -smp 2 -name i-3D4B085B -uuid
68e17542-66cb-0240-81f5-d71c935e5a5e -nographic -chardev
socket,id=monitor,path=/var/lib/libvirt/qemu/i-3D4B085B.monitor,server,nowait
-monitor chardev:monitor -boot c -kernel
/var/lib/eucalyptus/instances//admin/i-3D4B085B/kernel -initrd
/var/lib/eucalyptus/instances//admin/i-3D4B085B/ramdisk -append
root=/dev/sda1 console=ttyS0 -drive
file=/var/lib/eucalyptus/instances//admin/i-3D4B085B/disk,if=scsi,index=0,boot=on,format=raw
-net nic,macaddr=d0:0d:3d:4b:08:5b,vlan=0,model=e1000,name=e1000.0 -net
tap,fd=44,vlan=0,name=tap.0 -chardev
file,id=serial0,path=/var/lib/eucalyptus/instances//admin/i-3D4B085B/console.log
-serial chardev:serial0 -parallel none -usb
libvir: QEMU error : cannot set ownership on
/var/lib/eucalyptus/instances//admin/i-3D4B085B/kernel: Permission denied
more info:
qemu user/group is eucalyptus/root
I noticed that soem process (libvirt or qemu) is changing the ownership
before termination:
Before and after:
1. ll /var/lib/eucalyptus/instances//admin/i-3D4B085B/
2. total 715912K
3. -rw-r--r-- 1 eucalyptus eucalyptus 10767826944 2011-06-16 04:01 disk
4. -rw------- 1 eucalyptus eucalyptus 571064 2011-06-16 04:01
instance-checkpoint
5. -rw-r--r-- 1 eucalyptus eucalyptus 4159008 2011-06-16 03:09 kernel
6. -rw-r--r-- 1 eucalyptus eucalyptus 933 2011-06-16 04:01
libvirt.xml
7. -rw-r--r-- 1 eucalyptus eucalyptus 3899035 2011-06-16 03:09
ramdisk
8.
9. ll /var/lib/eucalyptus/instances//admin/i-3D4B085B/
10. total 715912K
11. -rw-r--r-- 1 root root 10767826944 2011-06-16 04:01 disk
12. -rw------- 1 eucalyptus eucalyptus 571064 2011-06-16 04:01
instance-checkpoint
13. -rw-r--r-- 1 root root 4159008 2011-06-16 03:09
kernel
14. -rw-r--r-- 1 eucalyptus eucalyptus 933 2011-06-16 04:01
libvirt.xml
15. -rw-r--r-- 1 root root 3899035 2011-06-16 03:09
ramdisk
additional info:
ls -al /var/lib/eucalyptus
total 24K
drwxr-xr-x 5 eucalyptus eucalyptus 4096 2011-06-16 03:34 .
drwxr-xr-x 43 root root 4096 2011-06-16 02:29 ..
-rw------- 1 eucalyptus eucalyptus 16 2011-06-16 03:34 .bash_history
drwx------ 2 eucalyptus eucalyptus 4096 2011-06-16 02:52 .cache
lrwxrwxrwx 1 eucalyptus eucalyptus 14 2011-06-16 02:49 instances ->
/mnt/instances
drwx------ 2 eucalyptus eucalyptus 4096 2011-06-16 02:52 keys
drwxr-xr-x 2 eucalyptus root 4096 2011-06-16 02:43 .ssh
ls -al /mnt/instances
total 16K
drwxrwxrwx 4 eucalyptus eucalyptus 4096 2011-06-16 03:09 .
drwxr-xr-x 5 eucalyptus eucalyptus 4096 2011-06-16 02:25 ..
drwxr-xr-x 2 eucalyptus eucalyptus 4096 2011-06-16 04:02 admin
drwxr-xr-x 3 eucalyptus eucalyptus 4096 2011-06-16 03:09 eucalyptus
Is there any solution to this problem? A workaround also works. Thanks
Best,
Ali