Hello everybody,

I installed eucalyptus on ubuntu10, basic configuration . Everything is ok untill I start the instances, the disk is being created but it terminates soon.

Environment:
NFS , KVM, ubuntu10 x64, Euca on 2 machines (wc sc cc clc on one machine, and nc on another).
libvirtd (libvirt) 0.7.5
QEMU PC emulator version 0.12.3 (qemu-kvm-0.12.3), Copyright (c) 2003-2008 Fabrice Bellard.

Logs:
/var/log/eucalyptus/nc.log:

[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] doStartNetwork() invoked
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] StartNetwork(): SUCCESS return from vnetStartNetwork 0
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] StartNetwork(): done
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] doRunInstance() invoked (id=i-4C9D08C3 cores=2 disk=10 memory=512)
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ]                          image=emi-DDBD105C at http://10.1.1.2:8773/services/Walrus/image-store-1308215076/image.manifest.xml
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ]                          krnel=eki-F41F10E3 at http://10.1.1.2:8773/services/Walrus/image-store-1308215076/kernel.manifest.xml
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ]                          rmdsk=eri-08841148 at http://10.1.1.2:8773/services/Walrus/image-store-1308215076/ramdisk.manifest.xml
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ]                          vlan=10 priMAC=d0:0d:4C:9D:08:C3 pubMAC=d0:0d:4C:9D:08:C3
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] network started for instance i-4C9D08C3
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] retrieving images for instance i-4C9D08C3 (disk limit=10240MB)...
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] verifying cached file in /var/lib/eucalyptus/instances//eucalyptus/cache/eki-F41F10E3/kernel...
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] walrus_request(): downloading /tmp/walrus-digest-3D4AKY
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ]                   from http://10.1.1.2:8773/services/Walrus/image-store-1308215076/kernel.manifest.xml
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): writing GET output to /tmp/walrus-digest-3D4AKY
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): wrote 3479 bytes in 3 writes
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] walrus_request(): saved image in /tmp/walrus-digest-3D4AKY
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] vrun(): [cp -a /var/lib/eucalyptus/instances//eucalyptus/cache/eki-F41F10E3/kernel /var/lib/eucalyptus/instances//admin/i-4C9D08C3/ker
nel]
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] verifying cached file in /var/lib/eucalyptus/instances//eucalyptus/cache/eri-08841148/ramdisk...
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] walrus_request(): downloading /tmp/walrus-digest-sVEVa4
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ]                   from http://10.1.1.2:8773/services/Walrus/image-store-1308215076/ramdisk.manifest.xml
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): writing GET output to /tmp/walrus-digest-sVEVa4
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): wrote 3482 bytes in 3 writes
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] walrus_request(): saved image in /tmp/walrus-digest-sVEVa4
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] vrun(): [cp -a /var/lib/eucalyptus/instances//eucalyptus/cache/eri-08841148/ramdisk /var/lib/eucalyptus/instances//admin/i-4C9D08C3/ramdisk]
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] verifying cached file in /var/lib/eucalyptus/instances//eucalyptus/cache/emi-DDBD105C/disk...
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] walrus_request(): downloading /tmp/walrus-digest-RQEzI9
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ]                   from http://10.1.1.2:8773/services/Walrus/image-store-1308215076/image.manifest.xml
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): writing GET output to /tmp/walrus-digest-RQEzI9
[Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): wrote 5887 bytes in 5 writes
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] walrus_request(): saved image in /tmp/walrus-digest-RQEzI9
[Thu Jun 16 03:54:31 2011][003755][EUCAINFO  ] vrun(): [cp -a /var/lib/eucalyptus/instances//eucalyptus/cache/emi-DDBD105C/disk /var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk]
[Thu Jun 16 03:54:32 2011][003755][EUCAINFO  ] vrun(): [//usr/lib/eucalyptus/euca_rootwrap //usr/share/eucalyptus/partition2disk /var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk 512 8280]
[Thu Jun 16 03:54:37 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:54:37 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:54:43 2011][003755][EUCAINFO  ] preparing images for instance i-4C9D08C3...
[Thu Jun 16 03:54:43 2011][003755][EUCAINFO  ] adding key/tmp/sckey.uUHVTI to the root file system at /var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk using (//usr/lib/eucalyptus/euca_rootwrap //usr/share/eucalyptus/add_key.pl //usr/lib/eucalyptus/euca_mountwrap)
[Thu Jun 16 03:54:43 2011][003755][EUCAINFO  ] vrun(): [//usr/lib/eucalyptus/euca_rootwrap //usr/share/eucalyptus/add_key.pl //usr/lib/eucalyptus/euca_mountwrap 32256 /var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk /tmp/sckey.uUHVTI]
[Thu Jun 16 03:54:43 2011][003755][EUCADEBUG ] system_output(): [//usr/lib/eucalyptus/euca_rootwrap //usr/share/eucalyptus/gen_kvm_libvirt_xml --ramdisk --ephemeral]
[Thu Jun 16 03:54:43 2011][003755][EUCAINFO  ] currently running/booting:  i-4C9D08C3
[Thu Jun 16 03:54:43 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:54:43 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:54:49 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:54:49 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:54:55 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:54:55 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:55:01 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:55:01 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:55:07 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:55:07 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:55:13 2011][003755][EUCAERROR ] libvirt: monitor socket did not show up.: No such file or directory (code=38)
[Thu Jun 16 03:55:13 2011][003755][EUCAFATAL ] hypervisor failed to start domain
[Thu Jun 16 03:55:13 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:55:13 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:55:15 2011][003755][EUCAERROR ] libvirt: Domain not found: no domain with matching name 'i-4C9D08C3' (code=42)
[Thu Jun 16 03:55:15 2011][003755][EUCAINFO  ] vrun(): [rm -rf /var/lib/eucalyptus/instances//admin/i-4C9D08C3/]
[Thu Jun 16 03:55:15 2011][003755][EUCAINFO  ] stopping the network (vlan=10)
[Thu Jun 16 03:55:19 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:55:19 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:55:25 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:55:25 2011][003755][EUCADEBUG ] doDescribeInstances() invoked
[Thu Jun 16 03:55:26 2011][003755][EUCAINFO  ] doTerminateInstance() invoked (id=i-4C9D08C3)
[Thu Jun 16 03:55:26 2011][003755][EUCAERROR ] libvirt: Domain not found: no domain with matching name 'i-4C9D08C3' (code=42)
[Thu Jun 16 03:55:26 2011][003755][EUCAWARN  ] warning: domain i-4C9D08C3 to be terminated not running on hypervisor
[Thu Jun 16 03:55:31 2011][003755][EUCADEBUG ] doDescribeResource() invoked
[Thu Jun 16 03:55:31 2011][003755][EUCADEBUG ] doDescribeInstances() invoked


 /var/log/libvirt/qemu/i-4C9D08C3.log:


LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/bin:/usr/sbin:/sbin:/bin /usr/bin/kvm -S -M pc-0.12 -enable-kvm -m 512 -smp 2 -name i-3D4B085B -uuid 68e17542-66cb-0240-81f5-d71c935e5a5e -nographic -chardev socket,id=monitor,path=/var/lib/libvirt/qemu/i-3D4B085B.monitor,server,nowait -monitor chardev:monitor -boot c -kernel /var/lib/eucalyptus/instances//admin/i-3D4B085B/kernel -initrd /var/lib/eucalyptus/instances//admin/i-3D4B085B/ramdisk -append root=/dev/sda1 console=ttyS0 -drive file=/var/lib/eucalyptus/instances//admin/i-3D4B085B/disk,if=scsi,index=0,boot=on,format=raw -net nic,macaddr=d0:0d:3d:4b:08:5b,vlan=0,model=e1000,name=e1000.0 -net tap,fd=44,vlan=0,name=tap.0 -chardev file,id=serial0,path=/var/lib/eucalyptus/instances//admin/i-3D4B085B/console.log -serial chardev:serial0 -parallel none -usb

libvir: QEMU error : cannot set ownership on /var/lib/eucalyptus/instances//admin/i-3D4B085B/kernel: Permission denied


more info:

qemu user/group is eucalyptus/root


I noticed that soem process (libvirt or qemu) is changing the ownership before termination:

Before and after:
  1.  ll /var/lib/eucalyptus/instances//admin/i-3D4B085B/
  2. total 715912K
  3. -rw-r--r-- 1 eucalyptus eucalyptus 10767826944 2011-06-16 04:01 disk
  4. -rw------- 1 eucalyptus eucalyptus      571064 2011-06-16 04:01 instance-checkpoint
  5. -rw-r--r-- 1 eucalyptus eucalyptus     4159008 2011-06-16 03:09 kernel
  6. -rw-r--r-- 1 eucalyptus eucalyptus         933 2011-06-16 04:01 libvirt.xml
  7. -rw-r--r-- 1 eucalyptus eucalyptus     3899035 2011-06-16 03:09 ramdisk

  9.  ll /var/lib/eucalyptus/instances//admin/i-3D4B085B/
  10. total 715912K
  11. -rw-r--r-- 1 root       root       10767826944 2011-06-16 04:01 disk
  12. -rw------- 1 eucalyptus eucalyptus      571064 2011-06-16 04:01 instance-checkpoint
  13. -rw-r--r-- 1 root       root           4159008 2011-06-16 03:09 kernel
  14. -rw-r--r-- 1 eucalyptus eucalyptus         933 2011-06-16 04:01 libvirt.xml
  15. -rw-r--r-- 1 root       root           3899035 2011-06-16 03:09 ramdisk

additional info:

 ls -al /var/lib/eucalyptus
total 24K
drwxr-xr-x  5 eucalyptus eucalyptus 4096 2011-06-16 03:34 .
drwxr-xr-x 43 root       root       4096 2011-06-16 02:29 ..
-rw-------  1 eucalyptus eucalyptus   16 2011-06-16 03:34 .bash_history
drwx------  2 eucalyptus eucalyptus 4096 2011-06-16 02:52 .cache
lrwxrwxrwx  1 eucalyptus eucalyptus   14 2011-06-16 02:49 instances -> /mnt/instances
drwx------  2 eucalyptus eucalyptus 4096 2011-06-16 02:52 keys
drwxr-xr-x  2 eucalyptus root       4096 2011-06-16 02:43 .ssh

ls -al /mnt/instances
total 16K
drwxrwxrwx 4 eucalyptus eucalyptus 4096 2011-06-16 03:09 .
drwxr-xr-x 5 eucalyptus eucalyptus 4096 2011-06-16 02:25 ..
drwxr-xr-x 2 eucalyptus eucalyptus 4096 2011-06-16 04:02 admin
drwxr-xr-x 3 eucalyptus eucalyptus 4096 2011-06-16 03:09 eucalyptus



Is there any solution to this problem? A workaround also works. Thanks


Best,
Ali