Could not find data source

**nbartolome** · February 23rd, 2011

Hi,

I've been googling for the past few days trying to get instances on my UEC cluster to run but haven't had much success.

I have the CLC/CC/WC/SC running on one machine.

I have the NC running on a separate machine.

Both machines are HP DL160 with dual nics. eth0 is reserved for the iLO (management interface) and eth1 is being used as the primary network interface.

I've installed both hosts using the UECCDinstall (except that I'm installing with a USB drive) with this document: https://help.ubuntu.com/community/UEC/CDInstall

The cloud comes up. The issue is that I cannot get any instance to successfully boot. The only image that I can get to run is Lucid AMD64 from the store. Any of the other images from store the or http://uec-images.ubuntu.com will remain in pending mode until they eventually terminate themselves.

The Lucid amd64 image will go into a running state, however it won't boot up successfully. The error from the console is:

<snip>
Begin: Running /scripts/init-bottom ...
Done.
[ 3.803895] e1000: eth0: e1000_probe: Intel(R) PRO/1000 Network Connection
[ 3.917240] EXT3-fs warning: checktime reached, running e2fsck is recommended

[ 3.950516] EXT3 FS on sda1, internal journal
sleeping 1
sleeping 1
sleeping 1
sleeping 1
sleeping 1
sleeping 1
sleeping 1
sleeping 1
sleeping 1
sleeping 1
Could not find data source
Failed to get instance datainit: cloud-init main process (541) terminated with s
tatus 1
mountall: Event failed
</snip>

I apologize if this is a repost but there has to be someone else that has encountered this same situation. Please let me know what logs/info I could provide as I've been at it for the past week and just don't know where else to look.

Thanks.

**nbartolome** · February 23rd, 2011

A few updates:

I've primarily been using the command line from the CC/CLC/SC/WC to try and run instances.

I've read suggestions on running instances as a different user other than 'admin'. So on the frontend I created a new user. Then using Hybridfox I've been trying to launch instances as that new user. The good news is that most of my instances actually go into a running state instead of pending/terminated.

The bad news is that they still don't successfully boot into the OS.

When I try to launch Ubuntu 10.04 the error is still "Could not find data source".

When I try to launch Ubuntu 9.04 the error waits at "[80G * Waiting for EC2 meta-data service"

**kim0** · February 23rd, 2011

It seems metadata service is not running correctly. Assuming that is not a bug, you might have configured a networking mode that doesn't have a metadata service

Can you please revert to the standard setting of managed_novlan

**raymdt** · February 23rd, 2011

Post edited

**nbartolome** · February 23rd, 2011

Originally Posted by kim0

Can you please revert to the standard setting of managed_novlan

Thanks for replying.

I am using managed-novlan.

**raymdt** · February 23rd, 2011

Hi,
hmmm this problem is a bit little bit curious.
So we need more informations about your problem.

Can you post the result of the following commands(as root).

Code:

euca_conf --list-clusters
euca_conf --list-walruses
euca_conf --list-scs
euca_conf --list-nodes

And the cotent of the following files

Code:

/var/log/eucalyptus/cc.log
/var/log/eucalyptus/registration.log

**nbartolome** · February 23rd, 2011

Thanks for the reply. Here's the info requested.

Originally Posted by raymdt

Hi,
hmmm this problem is a bit little bit curious.
So we need more informations about your problem.

Can you post the result of the following commands(as root).

Code:

euca_conf --list-clusters
euca_conf --list-walruses
euca_conf --list-scs
euca_conf --list-nodes

cloud@uec01:/etc/eucalyptus$ sudo euca_conf --list-clusters
registered clusters:
cluster1 10.12.10.100
cloud@uec01:/etc/eucalyptus$ sudo euca_conf --list-walruses
registered walruses:
walrus 10.12.10.100
cloud@uec01:/etc/eucalyptus$ sudo euca_conf --list-scs
registered storage controllers:
cluster1 10.12.10.100
cloud@uec01:/etc/eucalyptus$ sudo euca_conf --list-nodes
registered nodes:
10.12.10.102 cluster1 i-4493083A i-595C0A8A
cloud@uec01:/etc/eucalyptus$

And the cotent of the following files

Code:

/var/log/eucalyptus/cc.log
/var/log/eucalyptus/registration.log

cc.log is quite noisy so I've only attached the last 100 lines:
cloud@uec01:/var/log/eucalyptus$ tail -100 cc.log
[Wed Feb 23 11:57:44 2011][025285][EUCADEBUG ] vnetSetCCS(): setting localIpId: 0
[Wed Feb 23 11:57:44 2011][025250][EUCAINFO ] DescribeResources(): called
[Wed Feb 23 11:57:44 2011][025250][EUCADEBUG ] DescribeResources(): params: userId=eucalyptus, vmLen=5
[Wed Feb 23 11:57:44 2011][025250][EUCADEBUG ] init_thread(): init=1 607CF000 F752B000 FD5A9000 6074F000
[Wed Feb 23 11:57:44 2011][025250][EUCAWARN ] vnetInitTunnels(): in MANAGED-NOVLAN mode, priv interface 'eth1' must be a bridge, tunneling disabled
[Wed Feb 23 11:57:44 2011][025250][EUCAINFO ] DescribeResources(): resource response summary (name{avail/max}): m1.small{2/4} c1.medium{2/4} m1.large{1/2} m1.xlarge{1/2} c1.xlarge{0/1}
[Wed Feb 23 11:57:44 2011][025250][EUCADEBUG ] DescribeResources(): done
[Wed Feb 23 11:57:44 2011][025225][EUCAINFO ] DescribeInstances(): called
[Wed Feb 23 11:57:44 2011][025225][EUCADEBUG ] DescribeInstances(): params: userId=eucalyptus, instIdsLen=0
[Wed Feb 23 11:57:44 2011][025225][EUCADEBUG ] init_thread(): init=1 607CF000 FE01E000 0409C000 6074F000
[Wed Feb 23 11:57:44 2011][025225][EUCAWARN ] vnetInitTunnels(): in MANAGED-NOVLAN mode, priv interface 'eth1' must be a bridge, tunneling disabled
[Wed Feb 23 11:57:44 2011][025221][EUCADEBUG ] init_thread(): init=1 607CF000 F7FA0000 FE01E000 6074F000
[Wed Feb 23 11:57:44 2011][025221][EUCAWARN ] vnetInitTunnels(): in MANAGED-NOVLAN mode, priv interface 'eth1' must be a bridge, tunneling disabled
[Wed Feb 23 11:57:44 2011][025221][EUCAINFO ] DescribePublicAddresses(): called
[Wed Feb 23 11:57:44 2011][025221][EUCADEBUG ] DescribePublicAddresses(): params: userId=eucalyptus
[Wed Feb 23 11:57:44 2011][025221][EUCADEBUG ] DescribePublicAddresses(): done
[Wed Feb 23 11:57:44 2011][025225][EUCAINFO ] DescribeInstances(): instance response summary: instanceId=i-4493083A, state=Extant, publicIp=10.12.10.230, privateIp=172.19.1.2
[Wed Feb 23 11:57:44 2011][025225][EUCAINFO ] DescribeInstances(): instance response summary: instanceId=i-595C0A8A, state=Extant, publicIp=10.12.10.231, privateIp=172.19.1.3
[Wed Feb 23 11:57:44 2011][025225][EUCADEBUG ] DescribeInstances(): done
[Wed Feb 23 11:57:44 2011][025285][EUCADEBUG ] DescribeNetworks(): done
[Wed Feb 23 11:57:48 2011][025844][EUCADEBUG ] monitor_thread(): running
[Wed Feb 23 11:57:48 2011][025844][EUCAINFO ] refresh_resources(): called
[Wed Feb 23 11:57:48 2011][025844][EUCADEBUG ] ncClientCall(ncDescribeResource): called ncURL=http://10.12.10.102:8775/axis2/services/EucalyptusNC timeout=20
[Wed Feb 23 11:57:48 2011][013885][EUCADEBUG ] DEBUG: requested URI http://10.12.10.102:8775/axis2/services/EucalyptusNC
[Wed Feb 23 11:57:48 2011][013885][EUCADEBUG ] ncClientCall(ncDescribeResource): ppid=25844 client calling 'ncDescribeResource'
[Wed Feb 23 11:57:48 2011][013885][EUCADEBUG ] ncClientCall(ncDescribeResource): ppid=25844 done calling 'ncDescribeResource' with exit code '0'
[Wed Feb 23 11:57:48 2011][025844][EUCADEBUG ] ncClientCall(ncDescribeResource): done clientrc=0 opFail=0
[Wed Feb 23 11:57:48 2011][025844][EUCADEBUG ] refresh_resources(): received data from node=10.12.10.102 mem=5860/5348 disk=429110/428076 cores=4/2
[Wed Feb 23 11:57:48 2011][025844][EUCADEBUG ] refresh_resources(): done
[Wed Feb 23 11:57:48 2011][025844][EUCAINFO ] refresh_instances(): called
[Wed Feb 23 11:57:48 2011][025844][EUCADEBUG ] ncClientCall(ncDescribeInstances): called ncURL=http://10.12.10.102:8775/axis2/services/EucalyptusNC timeout=20
[Wed Feb 23 11:57:48 2011][013886][EUCADEBUG ] DEBUG: requested URI http://10.12.10.102:8775/axis2/services/EucalyptusNC
[Wed Feb 23 11:57:48 2011][013886][EUCADEBUG ] ncClientCall(ncDescribeInstances): ppid=25844 client calling 'ncDescribeInstances'
[Wed Feb 23 11:57:48 2011][013886][EUCADEBUG ] ncClientCall(ncDescribeInstances): ppid=25844 done calling 'ncDescribeInstances' with exit code '0'
[Wed Feb 23 11:57:48 2011][025844][EUCADEBUG ] ncClientCall(ncDescribeInstances): done clientrc=0 opFail=0
[Wed Feb 23 11:57:48 2011][025844][EUCADEBUG ] refresh_instances(): describing instance i-4493083A, Extant, 0
[Wed Feb 23 11:57:48 2011][025844][EUCADEBUG ] find_instanceCache(): found instance in cache 'i-4493083A/10.12.10.230/172.19.1.2'
[Wed Feb 23 11:57:48 2011][025844][EUCADEBUG ] refresh_instances(): storing instance state: i-4493083A/Extant/10.12.10.230/172.19.1.2
[Wed Feb 23 11:57:48 2011][025844][EUCADEBUG ] print_ccInstance(): refresh_instances(): instanceId=i-4493083A reservationId=r-37F8077F emiId=emi-DF4E1078 kernelId=eki-F56310EF ramdiskId=eri-09E41160 emiURL=http://10.12.10.100:8773/services/Walrus/image-store-1298416313/image.manifest.xml kernelURL=http://10.12.10.100:8773/services/Walrus/image-store-1298416313/kernel.manifest.xml ramdiskURL=http://10.12.10.100:8773/services/Walrus/image-store-1298416313/ramdisk.manifest.xml state=Extant ts=1298487983 ownerId=cloud keyName=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCbXDronRkN3F5ZK4rupf YLyD2ZJZFqQ1IAxdOEMbAJSaZL7Wju5ffrYmheOBf8SWen7K7K MpqJxFip++k7QR0x2Z9herpeDAYY078jdY8EVer0V0cjf2jRD4 Ewf4XgOKv0uh8Ro+rQUoTxUI/8ETnPN4KNlSuEcVg1ujTxsNmG09Us2nZh35Zy+JEz+PGx3dVYr icIEPBacpv+Jq7WwQ7IL+Far+5u4pAPhozgfdesqxpoUtgRocV aaS1NWx4JqGd+0jR+t8vDCDpB9BZTAOyp0p/aHxHdgiXwHBuEijzvnCe6PRwmd6ouh7kx5tSYIkxInYZVF1PWD OC43+1GbehH cloud@eucalyptus ccnet={privateIp=172.19.1.2 publicIp=10.12.10.230 privateMac=D0:0D:44:93:08:3A vlan=10 networkIndex=2} ccvm={cores=1 mem=256 disk=5} ncHostIdx=0 serviceTag=http://10.12.10.102:8775/axis2/services/EucalyptusNC userData= launchIndex=0 volumesSize=0 volumes={} groupNames={default }
[Wed Feb 23 11:57:48 2011][025844][EUCADEBUG ] refresh_instances(): describing instance i-595C0A8A, Extant, 1
[Wed Feb 23 11:57:48 2011][025844][EUCADEBUG ] find_instanceCache(): found instance in cache 'i-595C0A8A/10.12.10.231/172.19.1.3'
[Wed Feb 23 11:57:48 2011][025844][EUCADEBUG ] refresh_instances(): storing instance state: i-595C0A8A/Extant/10.12.10.231/172.19.1.3
[Wed Feb 23 11:57:48 2011][025844][EUCADEBUG ] print_ccInstance(): refresh_instances(): instanceId=i-595C0A8A reservationId=r-5AC50972 emiId=emi-E08A107A kernelId=eki-F6F51103 ramdiskId=eri-0B66116A emiURL=http://10.12.10.100:8773/services/Walrus/image-store-1298414784/image.manifest.xml kernelURL=http://10.12.10.100:8773/services/Walrus/image-store-1298414784/kernel.manifest.xml ramdiskURL=http://10.12.10.100:8773/services/Walrus/image-store-1298414784/ramdisk.manifest.xml state=Extant ts=1298488106 ownerId=cloud keyName=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCbXDronRkN3F5ZK4rupf YLyD2ZJZFqQ1IAxdOEMbAJSaZL7Wju5ffrYmheOBf8SWen7K7K MpqJxFip++k7QR0x2Z9herpeDAYY078jdY8EVer0V0cjf2jRD4 Ewf4XgOKv0uh8Ro+rQUoTxUI/8ETnPN4KNlSuEcVg1ujTxsNmG09Us2nZh35Zy+JEz+PGx3dVYr icIEPBacpv+Jq7WwQ7IL+Far+5u4pAPhozgfdesqxpoUtgRocV aaS1NWx4JqGd+0jR+t8vDCDpB9BZTAOyp0p/aHxHdgiXwHBuEijzvnCe6PRwmd6ouh7kx5tSYIkxInYZVF1PWD OC43+1GbehH cloud@eucalyptus ccnet={privateIp=172.19.1.3 publicIp=10.12.10.231 privateMac=D0:0D:59:5C:0A:8A vlan=10 networkIndex=3} ccvm={cores=1 mem=256 disk=5} ncHostIdx=0 serviceTag=http://10.12.10.102:8775/axis2/services/EucalyptusNC userData= launchIndex=0 volumesSize=0 volumes={} groupNames={default }
[Wed Feb 23 11:57:48 2011][025844][EUCADEBUG ] refresh_instances(): done
[Wed Feb 23 11:57:48 2011][025844][EUCADEBUG ] monitor_thread(): done
[Wed Feb 23 11:57:54 2011][025224][EUCADEBUG ] init_thread(): init=1 607CF000 F7FA0000 FE01E000 6074F000
[Wed Feb 23 11:57:54 2011][025224][EUCAWARN ] vnetInitTunnels(): in MANAGED-NOVLAN mode, priv interface 'eth1' must be a bridge, tunneling disabled
[Wed Feb 23 11:57:54 2011][025224][EUCAINFO ] DescribePublicAddresses(): called
[Wed Feb 23 11:57:54 2011][025224][EUCADEBUG ] DescribePublicAddresses(): params: userId=eucalyptus
[Wed Feb 23 11:57:54 2011][025224][EUCADEBUG ] DescribePublicAddresses(): done
[Wed Feb 23 11:57:54 2011][025844][EUCADEBUG ] monitor_thread(): running
[Wed Feb 23 11:57:54 2011][025844][EUCAINFO ] refresh_resources(): called
[Wed Feb 23 11:57:54 2011][025844][EUCADEBUG ] ncClientCall(ncDescribeResource): called ncURL=http://10.12.10.102:8775/axis2/services/EucalyptusNC timeout=20
[Wed Feb 23 11:57:54 2011][013905][EUCADEBUG ] DEBUG: requested URI http://10.12.10.102:8775/axis2/services/EucalyptusNC
[Wed Feb 23 11:57:54 2011][013905][EUCADEBUG ] ncClientCall(ncDescribeResource): ppid=25844 client calling 'ncDescribeResource'
[Wed Feb 23 11:57:54 2011][013905][EUCADEBUG ] ncClientCall(ncDescribeResource): ppid=25844 done calling 'ncDescribeResource' with exit code '0'
[Wed Feb 23 11:57:54 2011][025844][EUCADEBUG ] ncClientCall(ncDescribeResource): done clientrc=0 opFail=0
[Wed Feb 23 11:57:54 2011][025844][EUCADEBUG ] refresh_resources(): received data from node=10.12.10.102 mem=5860/5348 disk=429110/428076 cores=4/2
[Wed Feb 23 11:57:54 2011][025844][EUCADEBUG ] refresh_resources(): done
[Wed Feb 23 11:57:54 2011][025844][EUCAINFO ] refresh_instances(): called
[Wed Feb 23 11:57:54 2011][025844][EUCADEBUG ] ncClientCall(ncDescribeInstances): called ncURL=http://10.12.10.102:8775/axis2/services/EucalyptusNC timeout=20
[Wed Feb 23 11:57:54 2011][013906][EUCADEBUG ] DEBUG: requested URI http://10.12.10.102:8775/axis2/services/EucalyptusNC
[Wed Feb 23 11:57:54 2011][013906][EUCADEBUG ] ncClientCall(ncDescribeInstances): ppid=25844 client calling 'ncDescribeInstances'
[Wed Feb 23 11:57:54 2011][013906][EUCADEBUG ] ncClientCall(ncDescribeInstances): ppid=25844 done calling 'ncDescribeInstances' with exit code '0'
[Wed Feb 23 11:57:54 2011][025844][EUCADEBUG ] ncClientCall(ncDescribeInstances): done clientrc=0 opFail=0
[Wed Feb 23 11:57:54 2011][025844][EUCADEBUG ] refresh_instances(): describing instance i-4493083A, Extant, 0
[Wed Feb 23 11:57:54 2011][025844][EUCADEBUG ] find_instanceCache(): found instance in cache 'i-4493083A/10.12.10.230/172.19.1.2'
[Wed Feb 23 11:57:54 2011][025844][EUCADEBUG ] refresh_instances(): storing instance state: i-4493083A/Extant/10.12.10.230/172.19.1.2
[Wed Feb 23 11:57:54 2011][025844][EUCADEBUG ] print_ccInstance(): refresh_instances(): instanceId=i-4493083A reservationId=r-37F8077F emiId=emi-DF4E1078 kernelId=eki-F56310EF ramdiskId=eri-09E41160 emiURL=http://10.12.10.100:8773/services/Walrus/image-store-1298416313/image.manifest.xml kernelURL=http://10.12.10.100:8773/services/Walrus/image-store-1298416313/kernel.manifest.xml ramdiskURL=http://10.12.10.100:8773/services/Walrus/image-store-1298416313/ramdisk.manifest.xml state=Extant ts=1298487983 ownerId=cloud keyName=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCbXDronRkN3F5ZK4rupf YLyD2ZJZFqQ1IAxdOEMbAJSaZL7Wju5ffrYmheOBf8SWen7K7K MpqJxFip++k7QR0x2Z9herpeDAYY078jdY8EVer0V0cjf2jRD4 Ewf4XgOKv0uh8Ro+rQUoTxUI/8ETnPN4KNlSuEcVg1ujTxsNmG09Us2nZh35Zy+JEz+PGx3dVYr icIEPBacpv+Jq7WwQ7IL+Far+5u4pAPhozgfdesqxpoUtgRocV aaS1NWx4JqGd+0jR+t8vDCDpB9BZTAOyp0p/aHxHdgiXwHBuEijzvnCe6PRwmd6ouh7kx5tSYIkxInYZVF1PWD OC43+1GbehH cloud@eucalyptus ccnet={privateIp=172.19.1.2 publicIp=10.12.10.230 privateMac=D0:0D:44:93:08:3A vlan=10 networkIndex=2} ccvm={cores=1 mem=256 disk=5} ncHostIdx=0 serviceTag=http://10.12.10.102:8775/axis2/services/EucalyptusNC userData= launchIndex=0 volumesSize=0 volumes={} groupNames={default }
[Wed Feb 23 11:57:54 2011][025844][EUCADEBUG ] refresh_instances(): describing instance i-595C0A8A, Extant, 1
[Wed Feb 23 11:57:54 2011][025844][EUCADEBUG ] find_instanceCache(): found instance in cache 'i-595C0A8A/10.12.10.231/172.19.1.3'
[Wed Feb 23 11:57:54 2011][025844][EUCADEBUG ] refresh_instances(): storing instance state: i-595C0A8A/Extant/10.12.10.231/172.19.1.3
[Wed Feb 23 11:57:54 2011][025844][EUCADEBUG ] print_ccInstance(): refresh_instances(): instanceId=i-595C0A8A reservationId=r-5AC50972 emiId=emi-E08A107A kernelId=eki-F6F51103 ramdiskId=eri-0B66116A emiURL=http://10.12.10.100:8773/services/Walrus/image-store-1298414784/image.manifest.xml kernelURL=http://10.12.10.100:8773/services/Walrus/image-store-1298414784/kernel.manifest.xml ramdiskURL=http://10.12.10.100:8773/services/Walrus/image-store-1298414784/ramdisk.manifest.xml state=Extant ts=1298488106 ownerId=cloud keyName=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCbXDronRkN3F5ZK4rupf YLyD2ZJZFqQ1IAxdOEMbAJSaZL7Wju5ffrYmheOBf8SWen7K7K MpqJxFip++k7QR0x2Z9herpeDAYY078jdY8EVer0V0cjf2jRD4 Ewf4XgOKv0uh8Ro+rQUoTxUI/8ETnPN4KNlSuEcVg1ujTxsNmG09Us2nZh35Zy+JEz+PGx3dVYr icIEPBacpv+Jq7WwQ7IL+Far+5u4pAPhozgfdesqxpoUtgRocV aaS1NWx4JqGd+0jR+t8vDCDpB9BZTAOyp0p/aHxHdgiXwHBuEijzvnCe6PRwmd6ouh7kx5tSYIkxInYZVF1PWD OC43+1GbehH cloud@eucalyptus ccnet={privateIp=172.19.1.3 publicIp=10.12.10.231 privateMac=D0:0D:59:5C:0A:8A vlan=10 networkIndex=3} ccvm={cores=1 mem=256 disk=5} ncHostIdx=0 serviceTag=http://10.12.10.102:8775/axis2/services/EucalyptusNC userData= launchIndex=0 volumesSize=0 volumes={} groupNames={default }
[Wed Feb 23 11:57:54 2011][025844][EUCADEBUG ] refresh_instances(): done
[Wed Feb 23 11:57:54 2011][025844][EUCADEBUG ] monitor_thread(): done
[Wed Feb 23 11:58:00 2011][025844][EUCADEBUG ] monitor_thread(): running
[Wed Feb 23 11:58:00 2011][025844][EUCAINFO ] refresh_resources(): called
[Wed Feb 23 11:58:00 2011][025844][EUCADEBUG ] ncClientCall(ncDescribeResource): called ncURL=http://10.12.10.102:8775/axis2/services/EucalyptusNC timeout=20
[Wed Feb 23 11:58:00 2011][013972][EUCADEBUG ] DEBUG: requested URI http://10.12.10.102:8775/axis2/services/EucalyptusNC
[Wed Feb 23 11:58:00 2011][013972][EUCADEBUG ] ncClientCall(ncDescribeResource): ppid=25844 client calling 'ncDescribeResource'
[Wed Feb 23 11:58:00 2011][013972][EUCADEBUG ] ncClientCall(ncDescribeResource): ppid=25844 done calling 'ncDescribeResource' with exit code '0'
[Wed Feb 23 11:58:00 2011][025844][EUCADEBUG ] ncClientCall(ncDescribeResource): done clientrc=0 opFail=0
[Wed Feb 23 11:58:00 2011][025844][EUCADEBUG ] refresh_resources(): received data from node=10.12.10.102 mem=5860/5348 disk=429110/428076 cores=4/2
[Wed Feb 23 11:58:00 2011][025844][EUCADEBUG ] refresh_resources(): done
[Wed Feb 23 11:58:00 2011][025844][EUCAINFO ] refresh_instances(): called
[Wed Feb 23 11:58:00 2011][025844][EUCADEBUG ] ncClientCall(ncDescribeInstances): called ncURL=http://10.12.10.102:8775/axis2/services/EucalyptusNC timeout=20
[Wed Feb 23 11:58:00 2011][013975][EUCADEBUG ] DEBUG: requested URI http://10.12.10.102:8775/axis2/services/EucalyptusNC
[Wed Feb 23 11:58:00 2011][013975][EUCADEBUG ] ncClientCall(ncDescribeInstances): ppid=25844 client calling 'ncDescribeInstances'
[Wed Feb 23 11:58:00 2011][013975][EUCADEBUG ] ncClientCall(ncDescribeInstances): ppid=25844 done calling 'ncDescribeInstances' with exit code '0'
[Wed Feb 23 11:58:00 2011][025844][EUCADEBUG ] ncClientCall(ncDescribeInstances): done clientrc=0 opFail=0
[Wed Feb 23 11:58:00 2011][025844][EUCADEBUG ] refresh_instances(): describing instance i-4493083A, Extant, 0
[Wed Feb 23 11:58:00 2011][025844][EUCADEBUG ] find_instanceCache(): found instance in cache 'i-4493083A/10.12.10.230/172.19.1.2'
[Wed Feb 23 11:58:00 2011][025844][EUCADEBUG ] refresh_instances(): storing instance state: i-4493083A/Extant/10.12.10.230/172.19.1.2
[Wed Feb 23 11:58:00 2011][025844][EUCADEBUG ] print_ccInstance(): refresh_instances(): instanceId=i-4493083A reservationId=r-37F8077F emiId=emi-DF4E1078 kernelId=eki-F56310EF ramdiskId=eri-09E41160 emiURL=http://10.12.10.100:8773/services/Walrus/image-store-1298416313/image.manifest.xml kernelURL=http://10.12.10.100:8773/services/Walrus/image-store-1298416313/kernel.manifest.xml ramdiskURL=http://10.12.10.100:8773/services/Walrus/image-store-1298416313/ramdisk.manifest.xml state=Extant ts=1298487983 ownerId=cloud keyName=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCbXDronRkN3F5ZK4rupf YLyD2ZJZFqQ1IAxdOEMbAJSaZL7Wju5ffrYmheOBf8SWen7K7K MpqJxFip++k7QR0x2Z9herpeDAYY078jdY8EVer0V0cjf2jRD4 Ewf4XgOKv0uh8Ro+rQUoTxUI/8ETnPN4KNlSuEcVg1ujTxsNmG09Us2nZh35Zy+JEz+PGx3dVYr icIEPBacpv+Jq7WwQ7IL+Far+5u4pAPhozgfdesqxpoUtgRocV aaS1NWx4JqGd+0jR+t8vDCDpB9BZTAOyp0p/aHxHdgiXwHBuEijzvnCe6PRwmd6ouh7kx5tSYIkxInYZVF1PWD OC43+1GbehH cloud@eucalyptus ccnet={privateIp=172.19.1.2 publicIp=10.12.10.230 privateMac=D0:0D:44:93:08:3A vlan=10 networkIndex=2} ccvm={cores=1 mem=256 disk=5} ncHostIdx=0 serviceTag=http://10.12.10.102:8775/axis2/services/EucalyptusNC userData= launchIndex=0 volumesSize=0 volumes={} groupNames={default }
[Wed Feb 23 11:58:00 2011][025844][EUCADEBUG ] refresh_instances(): describing instance i-595C0A8A, Extant, 1
[Wed Feb 23 11:58:00 2011][025844][EUCADEBUG ] find_instanceCache(): found instance in cache 'i-595C0A8A/10.12.10.231/172.19.1.3'
[Wed Feb 23 11:58:00 2011][025844][EUCADEBUG ] refresh_instances(): storing instance state: i-595C0A8A/Extant/10.12.10.231/172.19.1.3
[Wed Feb 23 11:58:00 2011][025844][EUCADEBUG ] print_ccInstance(): refresh_instances(): instanceId=i-595C0A8A reservationId=r-5AC50972 emiId=emi-E08A107A kernelId=eki-F6F51103 ramdiskId=eri-0B66116A emiURL=http://10.12.10.100:8773/services/Walrus/image-store-1298414784/image.manifest.xml kernelURL=http://10.12.10.100:8773/services/Walrus/image-store-1298414784/kernel.manifest.xml ramdiskURL=http://10.12.10.100:8773/services/Walrus/image-store-1298414784/ramdisk.manifest.xml state=Extant ts=1298488106 ownerId=cloud keyName=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCbXDronRkN3F5ZK4rupf YLyD2ZJZFqQ1IAxdOEMbAJSaZL7Wju5ffrYmheOBf8SWen7K7K MpqJxFip++k7QR0x2Z9herpeDAYY078jdY8EVer0V0cjf2jRD4 Ewf4XgOKv0uh8Ro+rQUoTxUI/8ETnPN4KNlSuEcVg1ujTxsNmG09Us2nZh35Zy+JEz+PGx3dVYr icIEPBacpv+Jq7WwQ7IL+Far+5u4pAPhozgfdesqxpoUtgRocV aaS1NWx4JqGd+0jR+t8vDCDpB9BZTAOyp0p/aHxHdgiXwHBuEijzvnCe6PRwmd6ouh7kx5tSYIkxInYZVF1PWD OC43+1GbehH cloud@eucalyptus ccnet={privateIp=172.19.1.3 publicIp=10.12.10.231 privateMac=D0:0D:59:5C:0A:8A vlan=10 networkIndex=3} ccvm={cores=1 mem=256 disk=5} ncHostIdx=0 serviceTag=http://10.12.10.102:8775/axis2/services/EucalyptusNC userData= launchIndex=0 volumesSize=0 volumes={} groupNames={default }
[Wed Feb 23 11:58:00 2011][025844][EUCADEBUG ] refresh_instances(): done
[Wed Feb 23 11:58:00 2011][025844][EUCADEBUG ] monitor_thread(): done
cloud@uec01:/var/log/eucalyptus$

/var/log/eucalyptus/registration.log:

2011-02-23 10:54:23-08:00 | 21572 -> Calling storage cluster1 storage 10.12.10.100
2011-02-23 10:54:23-08:00 | 21573 -> Calling walrus Walrus 10.12.10.100
2011-02-23 10:54:23-08:00 | 21571 -> Calling cluster cluster1 10.12.10.100
2011-02-23 10:54:23-08:00 | 21571 -> Cluster cluster1 is already registered.
2011-02-23 10:54:23-08:00 | 21572 -> SC for cluster1 is already registered.
2011-02-23 10:54:23-08:00 | 21573 -> Walrus 10.12.10.100 is already registered.
2011-02-23 11:02:11-08:00 | 25854 -> Calling storage cluster1 storage 10.12.10.100
2011-02-23 11:02:11-08:00 | 25857 -> Calling node cluster1 node 10.12.10.102
2011-02-23 11:02:11-08:00 | 25856 -> Calling walrus Walrus 10.12.10.100
2011-02-23 11:02:11-08:00 | 25858 -> Calling node cluster1 node #2 10.12.10.104
2011-02-23 11:02:11-08:00 | 25855 -> Calling cluster cluster1 10.12.10.100
2011-02-23 11:02:11-08:00 | 25857 -> Node 10.12.10.102 is already registered.
2011-02-23 11:02:11-08:00 | 25855 -> Cluster cluster1 is already registered.
2011-02-23 11:02:11-08:00 | 25854 -> SC for cluster1 is already registered.
2011-02-23 11:02:11-08:00 | 25856 -> Walrus 10.12.10.100 is already registered.
2011-02-23 11:02:11-08:00 | 25858 -> euca_conf --register-nodes returned FAILURE (error 1): Command attempted was /usr/sbin/euca_conf --no-rsync --skip-scp-hostcheck --register-nodes 10.12.10.104, and had the following output:
INFO: We expect all nodes to have eucalyptus installed in //var/lib/eucalyptus/keys for key synchronization.

Trying scp to sync keys to: eucalyptus@10.12.10.104://var/lib/eucalyptus/keys/...
failed.

ERROR: could not synchronize keys with 10.12.10.104!
The configuration will not have this node.
Hint: to setup passwordless login to the nodes as user eucalyptus, you can
run the following commands on node 10.12.10.104:
sudo -u eucalyptus mkdir -p ~eucalyptus/.ssh
sudo -u eucalyptus tee ~eucalyptus/.ssh/authorized_keys > /dev/null <<EOT
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCS5h6VJMUL3Q/aLEstit9nDumPP+XLFlSaShKUXjHcZ+IH2zJ9sSSaxjA+pH4tQ EWLD76VId8QLvKTc4yn2u1+IQhoPQcUeMCKqQq4FDSkDVtjfDi r1DPKqt1uCMFFZYgQ3R9rnlIGElYnCz45jIprKV2QV3W53bxCe H+Q4jL8a1j4fGSC2tHAgsQFPIXtmcMppJry2NICtMamFUV1Zh+ hzpfZNdEyYkB0xwHccsd/y9yagOwl98jxlwh4pQscXuDVbnk9UGK5VYENrd8G0sByO64c+T 04XFouuRwaUQL4CO8nkPP8S0y25lzMq36yytN5HfKfdaztUnun iL3deHgb eucalyptus@uec01
EOT

Be sure that authorized_keys is not group/world readable or writable

I intentionally stopped eucalyptus-nc on 10.12.10.104 to help simplify my troubleshooting. So that error should be okay.

Thanks again.

**nbartolome** · February 24th, 2011

and a snippet from nc.log on my NC (10.12.10.102)

[Wed Feb 23 16:20:15 2011][005684][EUCADEBUG ] doDescribeResource() invoked
[Wed Feb 23 16:20:15 2011][005684][EUCADEBUG ] doDescribeInstances() invoked
[Wed Feb 23 16:20:15 2011][005684][EUCADEBUG ] doDescribeInstances(): instanceId=i-354705E8 publicIp=0.0.0.0 privateIp=172.19.1.2 mac=D0:0D:35:47:05:E8 vlan=10 networkIndex=2
[Wed Feb 23 16:20:21 2011][005684][EUCADEBUG ] doDescribeResource() invoked
[Wed Feb 23 16:20:21 2011][005684][EUCADEBUG ] doDescribeInstances() invoked
[Wed Feb 23 16:20:21 2011][005684][EUCADEBUG ] doDescribeInstances(): instanceId=i-354705E8 publicIp=0.0.0.0 privateIp=172.19.1.2 mac=D0:0D:35:47:05:E8 vlan=10 networkIndex=2
[Wed Feb 23 16:20:27 2011][005684][EUCADEBUG ] doDescribeResource() invoked
[Wed Feb 23 16:20:27 2011][005684][EUCADEBUG ] doDescribeInstances() invoked
[Wed Feb 23 16:20:27 2011][005684][EUCADEBUG ] doDescribeInstances(): instanceId=i-354705E8 publicIp=0.0.0.0 privateIp=172.19.1.2 mac=D0:0D:35:47:05:E8 vlan=10 networkIndex=2

I suspect it has something to do with my networking, but just not sure what.

**raymdt** · February 24th, 2011

hi nbartolome,
i suppose that you
- have activate the "VT-Extension" in Bios
- that you use kvm as hypervisor
- that you use an "unused ip-range" for your public addresses and an "unused network" for private addresses
- You are not running a firewall on the CLC

[Wed Feb 23 16:20:15 2011][005684][EUCADEBUG ] doDescribeInstances(): instanceId=i-354705E8 publicIp=0.0.0.0 privateIp=172.19.1.2 mac=D0:0D:35:47:05:E8 vlan=10 networkIndex=2

There is some problem with your public addresses

can you please post the content of /etc/eucalyptus/eucalyptus.local.con /etc/eucalyptus/eucalyptus.conf

**nbartolome** · February 24th, 2011

Hi raymdt. Thanks for the response. I really appreciate it.

Originally Posted by raymdt

hi nbartolome,
i suppose that you
- have activate the "VT-Extension" in Bios
- that you use kvm as hypervisor
- that you use an "unused ip-range" for your public addresses and an "unused network" for private addresses
- You are not running a firewall on the CLC

I'll have to double-check the VT-Extension thing, but I am able to successfully run the Maverick image on my NC outside of the cloud. I followed the instructions here: https://help.ubuntu.com/community/UEC/Images

KVM is indeed the hypervisor. I tried to use XEN and eucalyptus-nc failed to start.

The IP range is unused. I'm using 10.12.10.230 - 10.12.10.250 for the cloud. My CLC uses 10.12.10.100 and the NC uses 10.12.10.102.

No firewall on the CLC that I know of. I simply did an Ubuntu Enterprise Cloud installation from the 10.10 CD and followed the document here: https://help.ubuntu.com/community/UEC/CDInstall

can you please post the content of /etc/eucalyptus/eucalyptus.local.con /etc/eucalyptus/eucalyptus.conf

The reason I suspect networking is because of the error that you pointed out and that my instances aren't able to receive any metadata. From what I've been reading it should gather the metadata from http://169.254.169.254/.... I do see that address on my CLC, but my NC isn't able to contact that address.

Here are the eucalyptus.conf and eucalyptus.local.conf files from my CLC and NC:

From the CLC:

cloud@uec01:/etc/eucalyptus$ cat eucalyptus.conf
# /etc/eucalyptus/eucalyptus.conf
#
# These are the Ubuntu Enterprise Cloud's default Eucalyptus parameters.

# Affects: All
# See: **NOTE** below
EUCALYPTUS="/"
EUCA_USER="eucalyptus"

# Affects: CLC, Walrus, SC
DISABLE_DNS="Y"
CLOUD_OPTS="-Xmx512m"

# Affects: SC
DISABLE_EBS="N"
DISABLE_ISCSI="N"

# Affects: CC, NC
# See: **NOTE** below
ENABLE_WS_SECURITY="Y"
LOGLEVEL="DEBUG"
VNET_PUBINTERFACE="eth1"
VNET_PRIVINTERFACE="eth1"
VNET_MODE="MANAGED-NOVLAN"

# Affects: CC
# See: **NOTE** below
CC_PORT="8774"
SCHEDPOLICY="ROUNDROBIN"
POWER_IDLETHRESH="300"
POWER_WAKETHRESH="300"
NC_SERVICE="axis2/services/EucalyptusNC"
VNET_DHCPDAEMON="/usr/sbin/dhcpd3"
VNET_DHCPUSER="dhcpd"
DISABLE_TUNNELLING="N"
NODES=""
VNET_ADDRSPERNET="32"
#VNET_SUBNET=""
#VNET_NETMASK=""
#VNET_DNS=""
#VNET_PUBLICIPS=""

# Affects: NC
NC_PORT="8775"
HYPERVISOR="kvm"
MANUAL_INSTANCES_CLEANUP=0
VNET_BRIDGE="br0"
INSTANCE_PATH="/var/lib/eucalyptus/instances/"
USE_VIRTIO_NET="0"
USE_VIRTIO_DISK="1"
USE_VIRTIO_ROOT="0"
#MAX_MEM=2048
#MAX_CORES="2"
#MAX_DISK="100"

################################################## ########################
#
# Administrative overrides and customizations may go below, in accordance
# with the manpage for eucalyptus.conf(5).
#
# However, to modify Eucalyptus parameters, you are advised to use
# euca_conf(8), which will update eucalyptus.local.conf(5) and ensure
# smooth package upgrades.
#
# **NOTE**: To activate changes of these parameters on a CC, you must:
# sudo restart eucalyptus-cc CLEAN=1
# HOWEVER, if you do this, all currently running virtual
# machines in this cluster will lose network connectivity.
#
################################################## ########################

cloud@uec01:/etc/eucalyptus$ cat eucalyptus.local.conf
# /etc/eucalyptus/eucalyptus.local.conf

# This file is read and written by euca_conf(8)
# WARNING: You should *never* edit this file directly.

# To modify Eucalyptus parameters, either use euca_conf(8), or
# edit /etc/eucalyptus/eucalyptus.conf according to eucalyptus.conf(5).

# network configuration from the input configuration file
VNET_MODE="MANAGED-NOVLAN"
VNET_SUBNET="172.19.0.0"
VNET_NETMASK="255.255.0.0"
VNET_DNS="209.242.128.100"
VNET_ADDRSPERNET="32"
VNET_PUBLICIPS="10.12.10.230-10.12.10.250"

From the NC:

cloud@uec02:/etc/eucalyptus$ cat eucalyptus.conf
# /etc/eucalyptus/eucalyptus.conf
#
# These are the Ubuntu Enterprise Cloud's default Eucalyptus parameters.

# Affects: All
# See: **NOTE** below
EUCALYPTUS="/"
EUCA_USER="eucalyptus"

# Affects: CLC, Walrus, SC
DISABLE_DNS="Y"
CLOUD_OPTS="-Xmx512m"

# Affects: SC
DISABLE_EBS="N"
DISABLE_ISCSI="N"

# Affects: CC, NC
# See: **NOTE** below
ENABLE_WS_SECURITY="Y"
LOGLEVEL="DEBUG"
#VNET_PUBINTERFACE="eth0"
#VNET_PRIVINTERFACE="eth0"
VNET_PUBINTERFACE="br0"
VNET_PRIVINTERFACE="br0"
VNET_MODE="MANAGED-NOVLAN"

# Affects: CC
# See: **NOTE** below
CC_PORT="8774"
SCHEDPOLICY="ROUNDROBIN"
POWER_IDLETHRESH="300"
POWER_WAKETHRESH="300"
NC_SERVICE="axis2/services/EucalyptusNC"
VNET_DHCPDAEMON="/usr/sbin/dhcpd3"
VNET_DHCPUSER="dhcpd"
DISABLE_TUNNELLING="N"
NODES=""
VNET_ADDRSPERNET="32"
#VNET_SUBNET=""
#VNET_NETMASK=""
#VNET_DNS=""
#VNET_PUBLICIPS=""

VNET_MODE="MANAGED-NOVLAN"

# Affects: CC
# See: **NOTE** below
CC_PORT="8774"
SCHEDPOLICY="ROUNDROBIN"
POWER_IDLETHRESH="300"
POWER_WAKETHRESH="300"
NC_SERVICE="axis2/services/EucalyptusNC"
VNET_DHCPDAEMON="/usr/sbin/dhcpd3"
VNET_DHCPUSER="dhcpd"
DISABLE_TUNNELLING="N"
NODES=""
VNET_ADDRSPERNET="32"
#VNET_SUBNET=""
#VNET_NETMASK=""
#VNET_DNS=""
#VNET_PUBLICIPS=""

# Affects: NC
NC_PORT="8775"
HYPERVISOR="kvm"
MANUAL_INSTANCES_CLEANUP=0
VNET_BRIDGE="br0"
INSTANCE_PATH="/var/lib/eucalyptus/instances/"
USE_VIRTIO_NET="0"
USE_VIRTIO_DISK="1"
USE_VIRTIO_ROOT="0"
#MAX_MEM=2048
#MAX_CORES="2"
#MAX_DISK="100"

################################################## ########################
#
# Administrative overrides and customizations may go below, in accordance
# with the manpage for eucalyptus.conf(5).
#
# However, to modify Eucalyptus parameters, you are advised to use
# euca_conf(8), which will update eucalyptus.local.conf(5) and ensure
# smooth package upgrades.
#
# **NOTE**: To activate changes of these parameters on a CC, you must:
# sudo restart eucalyptus-cc CLEAN=1
# HOWEVER, if you do this, all currently running virtual
# machines in this cluster will lose network connectivity.
#
################################################## ########################

cloud@uec02:/etc/eucalyptus$ cat eucalyptus.local.conf
# /etc/eucalyptus/eucalyptus.local.conf

# This file is read and written by euca_conf(8)
# WARNING: You should *never* edit this file directly.

# To modify Eucalyptus parameters, either use euca_conf(8), or
# edit /etc/eucalyptus/eucalyptus.conf according to eucalyptus.conf(5).

Thread: Could not find data source

Thread Tools

Display

Could not find data source

Re: Could not find data source

Re: Could not find data source

Re: Could not find data source

Re: Could not find data source

Re: Could not find data source

Re: Could not find data source

Re: Could not find data source

Re: Could not find data source

Re: Could not find data source

Bookmarks

Bookmarks

Posting Permissions