CimTest Report for KVM on F9 13-08-2008
======================================================================== CIM Test Report for KVM on F9 with latest libvirt-cim and libcmpiutil ======================================================================== Distro : Fedora 9 Beta Kernel : 2.6.25-0.121.rc5.git4.fc9 Libvirt : libvirt-0.4.2-1.fc9.x86_64 CIMOM : pegasus PyWBEM : pywbem-0.6 CIM Schema : cimv216Experimental LibCMPIutil : 83 LibVirtCIM : 665 CIMTEST : 299 ======================================================= PASS : 125 FAIL : 1 ACUTAL FAILED : 0 XFAIL : 2 SKIP : 6 ACTUAL SKIPPED : 4 --------------------- Total : 134 ======================================================= Here is one of the tc that failed, this tc passed when ran manually: VirtualSystemManagementService - 06_addresource.py: FAIL The following skipped tc passed when run manually: ComputerSystem - 22_define_suspend.py: SKIP ComputerSystem - 40_RSC_start.py: SKIP Here is the list of tc that skipped : VSSD - 02_bootldr.py: SKIP VirtualSystemMigrationService - 01_migratable_host.py: SKIP VirtualSystemMigrationService - 02_host_migrate_type.py: SKIP VirtualSystemMigrationService - 05_migratable_host_errs.py: SKIP Below is the list of tc that XFAIL : ComputerSystem - 32_start_reboot.py: XFAIL Bug: 00005 ComputerSystem - 33_suspend_reboot.py: XFAIL Bug: 00005 These are XFailing as the libvirt does not yet support rebooting a KVM guest. Please find the complete report attached with the mail. Thanks and Regards, Deepti. Starting test suite: libvirt-cim Cleaned log files. Testing KVM hypervisor AllocationCapabilities - 01_enum.py: PASS AllocationCapabilities - 02_alloccap_gi_errs.py: PASS ComputerSystem - 01_enum.py: PASS ComputerSystem - 02_nosystems.py: PASS ComputerSystem - 03_defineVS.py: PASS ComputerSystem - 04_defineStartVS.py: PASS ComputerSystem - 05_activate_defined_start.py: PASS ComputerSystem - 06_paused_active_suspend.py: PASS ComputerSystem - 22_define_suspend.py: SKIP ERROR - Need to give different bridge name since it already exists ComputerSystem - 23_suspend_suspend.py: PASS ComputerSystem - 27_define_suspend_errs.py: PASS libvir: error : this function is not supported by the hypervisor: virDomainReboot ComputerSystem - 32_start_reboot.py: XFAIL Bug: 00005 ERROR - Exception: (1, u'CIM_ERR_FAILED: Domain Operation Failed') ERROR - Unable to 'Reboot' dom 'cs_test_domain' using RequestedStateChange() InvokeMethod(RequestStateChange): CIM_ERR_FAILED: Domain Operation Failed Bug:<00005> libvir: error : this function is not supported by the hypervisor: virDomainReboot ComputerSystem - 33_suspend_reboot.py: XFAIL Bug: 00005 ERROR - Exception: (1, u'CIM_ERR_FAILED: Domain Operation Failed') ERROR - Unable to 'Reboot' dom 'test_domain' using RequestedStateChange() InvokeMethod(RequestStateChange): CIM_ERR_FAILED: Domain Operation Failed Bug:<00005> ComputerSystem - 35_start_reset.py: PASS ComputerSystem - 40_RSC_start.py: SKIP ERROR - Need to give different bridge name since it already exists ComputerSystem - 41_cs_to_settingdefinestate.py: PASS libvir: QEMU error : Domain not found libvir: Domain error : invalid domain pointer in virDomainFree ComputerSystem - 42_cs_gi_errs.py: PASS ComputerSystemIndication - 01_created_indication.py: PASS ElementAllocatedFromPool - 01_forward.py: PASS ElementAllocatedFromPool - 02_reverse.py: PASS ElementAllocatedFromPool - 03_reverse_errs.py: PASS ElementAllocatedFromPool - 04_forward_errs.py: PASS ElementCapabilities - 01_forward.py: PASS ElementCapabilities - 02_reverse.py: PASS libvir: QEMU error : Domain not found libvir: Domain error : invalid domain pointer in virDomainFree ElementCapabilities - 03_forward_errs.py: PASS libvir: QEMU error : Domain not found ElementCapabilities - 04_reverse_errs.py: PASS ElementCapabilities - 05_hostsystem_cap.py: PASS ElementConforms - 01_forward.py: PASS ElementConforms - 02_reverse.py: PASS ElementConforms - 03_ectp_fwd_errs.py: PASS libvir: QEMU error : Domain not found libvir: Domain error : invalid domain pointer in virDomainFree ElementConforms - 04_ectp_rev_errs.py: PASS ElementSettingData - 01_forward.py: PASS ElementSettingData - 03_esd_assoc_with_rasd_errs.py: PASS EnabledLogicalElementCapabilities - 01_enum.py: PASS libvir: QEMU error : Domain not found EnabledLogicalElementCapabilities - 02_elecap_gi_errs.py: PASS HostSystem - 01_enum.py: PASS HostSystem - 02_hostsystem_to_rasd.py: PASS HostSystem - 03_hs_to_settdefcap.py: PASS HostSystem - 04_hs_to_EAPF.py: PASS HostSystem - 05_hs_gi_errs.py: PASS HostSystem - 06_hs_to_vsms.py: PASS HostedDependency - 01_forward.py: PASS HostedDependency - 02_reverse.py: PASS HostedDependency - 03_enabledstate.py: PASS HostedDependency - 04_reverse_errs.py: PASS HostedResourcePool - 01_forward.py: PASS HostedResourcePool - 02_reverse.py: PASS HostedResourcePool - 03_forward_errs.py: PASS HostedResourcePool - 04_reverse_errs.py: PASS HostedService - 01_forward.py: PASS HostedService - 02_reverse.py: PASS HostedService - 03_forward_errs.py: PASS HostedService - 04_reverse_errs.py: PASS LogicalDisk - 01_disk.py: PASS LogicalDisk - 02_nodevs.py: PASS LogicalDisk - 03_ld_gi_errs.py: PASS Memory - 01_memory.py: PASS Memory - 02_defgetmem.py: PASS Memory - 03_mem_gi_errs.py: PASS NetworkPort - 01_netport.py: PASS NetworkPort - 02_np_gi_errors.py: PASS NetworkPort - 03_user_netport.py: PASS Processor - 01_processor.py: PASS Processor - 02_definesys_get_procs.py: PASS Processor - 03_proc_gi_errs.py: PASS Profile - 01_enum.py: PASS Profile - 02_profile_to_elec.py: PASS libvir: Xen Daemon error : internal error failed to connect to xend libvir: Xen Daemon error : internal error failed to connect to xend Profile - 03_rprofile_gi_errs.py: PASS RASD - 01_verify_rasd_fields.py: PASS RASD - 02_enum.py: PASS libvir: Xen Daemon error : internal error failed to connect to xend RASD - 03_rasd_errs.py: PASS libvir: Storage error : no storage vol with matching path libvir: Storage error : invalid storage volume pointer in virStorageVolFree RASD - 04_disk_rasd_size.py: PASS ReferencedProfile - 01_verify_refprof.py: PASS ReferencedProfile - 02_refprofile_errs.py: PASS ResourceAllocationFromPool - 01_forward.py: PASS ResourceAllocationFromPool - 02_reverse.py: PASS ResourceAllocationFromPool - 03_forward_errs.py: PASS ResourceAllocationFromPool - 04_reverse_errs.py: PASS libvir: Network error : invalid network pointer in virNetworkFree libvir: QEMU error : Network not found: no network with matching name libvir: Network error : invalid network pointer in virNetworkFree ResourceAllocationFromPool - 05_RAPF_err.py: PASS ResourcePool - 01_enum.py: PASS ResourcePool - 02_rp_gi_errors.py: PASS ResourcePoolConfigurationCapabilities - 01_enum.py: PASS ResourcePoolConfigurationCapabilities - 02_rpcc_gi_errs.py: PASS ResourcePoolConfigurationService - 01_enum.py: PASS ResourcePoolConfigurationService - 02_rcps_gi_errors.py: PASS ResourcePoolConfigurationService - 03_CreateResourcePool.py: PASS ResourcePoolConfigurationService - 04_CreateChildResourcePool.py: PASS ResourcePoolConfigurationService - 05_AddResourcesToResourcePool.py: PASS ResourcePoolConfigurationService - 06_RemoveResourcesFromResourcePool.py: PASS ResourcePoolConfigurationService - 07_DeleteResourcePool.py: PASS SettingsDefine - 01_forward.py: PASS SettingsDefine - 02_reverse.py: PASS SettingsDefine - 03_sds_fwd_errs.py: PASS SettingsDefine - 04_sds_rev_errs.py: PASS SettingsDefineCapabilities - 01_forward.py: PASS SettingsDefineCapabilities - 03_forward_errs.py: PASS SettingsDefineCapabilities - 04_forward_vsmsdata.py: PASS SettingsDefineCapabilities - 05_reverse_vsmcap.py: PASS SystemDevice - 01_forward.py: PASS SystemDevice - 02_reverse.py: PASS SystemDevice - 03_fwderrs.py: PASS VSSD - 01_enum.py: PASS VSSD - 02_bootldr.py: SKIP VSSD - 03_vssd_gi_errs.py: PASS VSSD - 04_vssd_to_rasd.py: PASS VirtualSystemManagementCapabilities - 01_enum.py: PASS VirtualSystemManagementCapabilities - 02_vsmcap_gi_errs.py: PASS VirtualSystemManagementService - 01_definesystem_name.py: PASS VirtualSystemManagementService - 02_destroysystem.py: PASS error line 1: syntax error in 'wrong' VirtualSystemManagementService - 03_definesystem_ess.py: PASS error line 1: syntax error in 'wrong' VirtualSystemManagementService - 04_definesystem_ers.py: PASS libvir: Domain error : invalid domain pointer in virDomainFree libvir: QEMU error : Domain not found libvir: Domain error : invalid domain pointer in virDomainFree VirtualSystemManagementService - 05_destroysystem_neg.py: PASS VirtualSystemManagementService - 06_addresource.py: FAIL ERROR - Got 99:aa:bb:cc:ee:ff, exp 99:aa:bb:cc:ee:ff. Got None, exp default-net51. ERROR - Error invoking AddRS: add_net_res ERROR - Error adding rs for net mac error line 1: syntax error in 'ever' VirtualSystemManagementService - 07_addresource_neg.py: PASS VirtualSystemManagementService - 08_modifyresource.py: PASS VirtualSystemManagementService - 09_procrasd_persist.py: PASS VirtualSystemManagementService - 10_hv_version.py: PASS VirtualSystemManagementService - 11_define_memrasdunits.py: PASS VirtualSystemManagementService - 12_referenced_config.py: PASS VirtualSystemMigrationCapabilities - 01_enum.py: PASS VirtualSystemMigrationCapabilities - 02_vsmc_gi_errs.py: PASS VirtualSystemMigrationService - 01_migratable_host.py: SKIP VirtualSystemMigrationService - 02_host_migrate_type.py: SKIP VirtualSystemMigrationService - 05_migratable_host_errs.py: SKIP VirtualSystemMigrationSettingData - 01_enum.py: PASS VirtualSystemMigrationSettingData - 02_vsmsd_gi_errs.py: PASS VirtualSystemSettingDataComponent - 01_forward.py: PASS VirtualSystemSettingDataComponent - 02_reverse.py: PASS VirtualSystemSettingDataComponent - 03_vssdc_fwd_errs.py: PASS VirtualSystemSettingDataComponent - 04_vssdc_rev_errs.py: PASS VirtualSystemSnapshotService - 01_enum.py: PASS VirtualSystemSnapshotService - 02_vs_sservice_gi_errs.py: PASS VirtualSystemSnapshotServiceCapabilities - 01_enum.py: PASS VirtualSystemSnapshotServiceCapabilities - 02_vs_sservicecap_gi_errs.py: PASS
======================================================= PASS : 125 FAIL : 1 ACUTAL FAILED : 0
I'd call this an actual fail. We do see some caching issues with Xen on RHEL 5.2 which causes some tests to fail when they should really pass (will hopefully finish patching those tests soon). However, we don't have a caching issue with KVM. So if a test fails but then passes when it's run individually, I'd still consider that a fail. --- VirtualSystemManagementService - 06_addresource.py: FAIL ERROR - Got 99:aa:bb:cc:ee:ff, exp 99:aa:bb:cc:ee:ff. Got None, exp default-net51. It looks like the test tried to add a network device to a guest, and the verification failed. I'm not sure if this is a test case issue or if there was an actual issue adding the network device. When I did a bulk run, this test failed due to the following: ERROR - Failed to create Virtual Network 'default-net76' ERROR - Unable to create network pool There's been a number for network pool related issues lately. I'm planning on writing a patch that does the following: 1) Do some environment setup before any of the tests are called - create a network pool and a disk pool, etc 2) Use the network pool and disk pool names in all the test of the tests. 3) After the tests are finished, destroy the net / disk pools. The only problem I see with this are tests that need a net / disk pool free environment. However, this would allow us to create a guest without having to worry about also creating a network pool (and then subsequently cleaning up that pool properly). -- Kaitlin Rupert IBM Linux Technology Center kaitlin@linux.vnet.ibm.com
======================================================= PASS : 125 FAIL : 1 ACUTAL FAILED : 0
I'd call this an actual fail. We do see some caching issues with Xen on RHEL 5.2 which causes some tests to fail when they should really pass (will hopefully finish patching those tests soon).
However, we don't have a caching issue with KVM. So if a test fails but then passes when it's run individually, I'd still consider that a fail. Yes the caching issue is not seen with KVM. I did try to look at the
Kaitlin Rupert wrote: problem. But was not able to find the actual cause for this particular problem. I will try to look into this again.
---
VirtualSystemManagementService - 06_addresource.py: FAIL ERROR - Got 99:aa:bb:cc:ee:ff, exp 99:aa:bb:cc:ee:ff. Got None, exp default-net51.
It looks like the test tried to add a network device to a guest, and the verification failed.
I'm not sure if this is a test case issue or if there was an actual issue adding the network device. When I did a bulk run, this test failed due to the following:
ERROR - Failed to create Virtual Network 'default-net76' ERROR - Unable to create network pool
There's been a number for network pool related issues lately. I'm planning on writing a patch that does the following:
1) Do some environment setup before any of the tests are called - create a network pool and a disk pool, etc
2) Use the network pool and disk pool names in all the test of the tests.
3) After the tests are finished, destroy the net / disk pools.
The only problem I see with this are tests that need a net / disk pool free environment. However, this would allow us to create a guest without having to worry about also creating a network pool (and then subsequently cleaning up that pool properly).
Yes doing this will be good. As of now all of the tc which uses the vxml define, destroy etc methods take care of the network pool, the only need is to take care of the diskpool. We need to look into the test case which are calling the create_netpool_conf()and also using the vxml define etc methods since these might be the tc that might fail intermittently. Thanks and Regards, Deepti.
participants (2)
-
Deepti B Kalakeri -
Kaitlin Rupert