在 CentOS 6.4 上安装和配置 OpenNebula 4.0
2013年05月16日 | 标签: centos, cloud computing, iaas, opennebula | 作者：vpsee
我们实验室的 OpenNebula 3.2 已经很稳定的运行了两年，除了开头一个月不熟悉这套云计算软件有点乱、容易犯错外接下来的时间里都很稳定，期间还包括一次防火演习（突然拉闸似断电）和安全检查（计划中的断电），服务器、虚拟机、存储设备、系统和服务都能自动起来并能正常工作。现在正在考虑升级的事情，OpenNebula 4.0 有很多新特性值得一试，现在的问题是升级很麻烦，官方文档貌似说要逐个版本升级，这个是小问题，更大的问题是如何升级整个运行中的生产环境，这里面有太多的因素需要考虑到，想了都头大～先安装一个 OpenNebula 4.0 试玩一下，看看数据库表结构、一些工具、配置文件，看看能不能琢磨出一个可行的升级方案出来，具体的升级操作将会在圣诞节期间进行（人最少的时候），不过现在应该开始计划和测试了。
下面的安装过程采用最小化的 CentOS 6.4 安装版本（CentOS-6.4-x86_64-minimal.iso）。不熟悉 OpenNebula 和云计算的朋友可以先看看 “在 CentOS 上安装和配置 OpenNebula” 的开头部分预热一下。
开始之前先装上 EPEL 源，然后升级系统：
# yum install wget # wget http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm # rpm -ivh epel-release-6-8.noarch.rpm # yum update
到官网 http://downloads.opennebula.org/ 下载 OpenNebula 4.0 for CentOS 6.4 的安装包、解压后安装，因为有包依赖问题，所以最好用 yum localinstall 安装，不要用 rpm -ivh 命令直接安装。在控制节点（或叫做头节点）上安装 opennebula 和 opennebula-sunstone 等：
# cd /usr/src # tar zxvf CentOS-6.4-opennebula-4.0.0-1.tar.gz # cd opennebula-4.0.0-1 # yum localinstall opennebula-common-4.0.0-1.x86_64.rpm # yum localinstall opennebula-ruby-4.0.0-1.x86_64.rpm # yum localinstall opennebula-4.0.0-1.x86_64.rpm # yum localinstall opennebula-sunstone-4.0.0-1.x86_64.rpm # yum localinstall opennebula-server-4.0.0-1.x86_64.rpm
在计算节点上安装 kvm 和 opennebula-node-kvm：
# yum install qemu-kvm qemu-kvm-tools libvirt # yum localinstall opennebula-node-kvm-4.0.0-1.x86_64.rpm # /etc/init.d/libvirtd start
安装搞定，OpenNebula 4.0 的安装就是这么简单，开始在控制节点上启动服务吧：
# service opennebula start
Starting OpenNebula daemon: [ OK ]
# service opennebula-sunstone start
Starting Sunstone Server daemon: VNC proxy started
sunstone-server started
[ OK ]
我们通常都会通过 IP 访问（或者内部域名）访问 sunstone 界面，所以需要改变 sunstone 的默认接听地址，把 host: 127.0.0.1 换成机器所在 IP 地址，需要重启服务让设置生效。注意这里使用 9869 端口，CentOS 6.x 默认是开启防火墙的，所以可以把这个端口加到防火墙规则里也可以直接把防火墙关掉：
# vi /etc/one/sunstone-server.conf
...
# Server Configuration
#
:host: 192.168.2.150
:port: 9869
# service opennebula-sunstone restart
Stopping Sunstone Server daemon: VNC server is not running
sunstone-server stopped
[ OK ]
Starting Sunstone Server daemon: VNC proxy started
sunstone-server started
[ OK ]
# /etc/init.d/iptables stop
iptables: Flushing firewall rules: [ OK ]
iptables: Setting chains to policy ACCEPT: filter [ OK ]
iptables: Unloading modules: [ OK ]
打开浏览器，访问 http://192.168.2.150:9869 登陆界面，那登陆的用户名和密码是啥呢？用户名和密码在安装的时候已经随机生成，oneadmin 是用户名，后面的一串是密码：
# cat /var/lib/one/.one/one_auth oneadmin:0dee417dfb22f2372866d686c7b12889
登陆成功后界面比以前的版本有很大改进：
学习了！老大，centos 6.4 安装的 kvm+libvirt ，libvirt提供的带宽限制怎么不准？
请教大神一个问题，我是用的centos5+xen做的虚拟机安装win2003，如果设的vcpu超过2个，重启就会死在最后阶段，cpu占用12%左右，google没找到什么资料，只在citrix网站论坛里08、09年有人报告这个，但是没有解决方案。这边也用citrix的xenserver6装过测试，没有这个问题，开始装上时是1个vcpu，设成超过2个也没问题。烦请赐教，谢谢！
问：在ubuntu弄了很久，怎么建不了虚机，安装在一台机应该没有问题吧
@goog
可以在一台机器上安装整个 openebula 系统。
@vpsee
请教openebula系统如何管理已经存在的xen或kvm的guest？
@aaron
openebula 不能管理已存在的 guest，因为 guest 数据不在 opennebula 数据库里面，可以手动添加到数据库，不过很麻烦。
@vpsee我在官网没有找到相关资料，不知道你能否给点参考的意见！
@vpsee 安装成功之后怎样创建虚拟机呢？如果我在win7系统下通过VMware创建了一个CentOS，然后在该linux系统下安装opennebula，那么是否可以再在opennebula里面创建虚拟机？
我在ubuntu上搞了好久，最后安装成功了，也能登陆sunstone界面了，最后却发现不知道怎样搞的连不上网了。。。
@young
如果觉得麻烦的话，不用自己做虚拟机，在 OpenNebula Marketplace 上已经有别人做好的虚拟机，下载下来就可以用了。
hi, vpsee:
我们公司也使用opennebula来管理测试环境，我学习与使用大概1年左右，我目前版本是3.8
我有一个问题想和你交流一下，关于capacity。我查过官方文档与邮件列表，这方面说的很含糊。我有个实例
物理宿主机 双C四核，16G物理内存，centos 6.2 最小化安装且优化。cpu 总容量 800， memory 总容量 16G
虚拟机模板 vcpu ‘1’, cpu ‘0.9’, mem ‘2048M’，最后2台物理机 1204M
规划 8台，总cpu 1 * 0.9 * 8 * 100 = 720, 总内存 6 * 2G + 2 * 1G =14G
但是分配完7台，无法建第8台，日志‘no enough capacity’，我想请教，物理宿主机最小资源是多少？
@骡骡
没有太明白你的意思啊～
貌似你上面给的虚拟机模版是 2GB，但是你的物理宿主机只有 1GB，也就是说当 OpenNebula 企图创建第8台 2GB 的虚拟机是无法成功的（因为无法在 1GB 物理机上创建1个 2GB 的虚拟机，也无法在2各 1GB 物理机上创建1个 2GB 的虚拟机）。虽然2台物理机器的内存加起来是2GB，但是1台 2GB虚拟机不能创建在2台 1GB 物理宿主机上。
物理宿主机 双C四核，16G物理内存， 计划部8台虚拟机
虚拟机模板 vcpu ’1′, cpu ’0.9′, mem ’2048M’；前6台虚拟机内存2048M，最后2台虚拟机 1204M，cpu分配都一致。
我想问，物理宿主机，也就是计算节点，自身需要消耗多少cpu与内存资源，这部分资源是不是也包括在opennebula的总资源内。
@骡骡
自身消耗的 CPU 和内存随着上面运行的虚拟机个数和每个虚拟机繁忙程度不同而不同。OpenNebula 会保留部分资源留给自己和宿主机（hypervisor）用，可以通过 sched.conf 里的 HYPERVISOR_MEM 参数来调整这个预留内存大小。也就是说这部分资源是包括在 OpenNebula 的总资源内了，所以总资源如果是 16GB，每个虚拟机用 2GB，就只能创建7个虚拟机。
谢谢，我去看看 sched.conf 里面关于 cpu与memory资源方面的配置
在 CentOS 6.4 上安装和配置 OpenNebula 4.0 我已经按照你的文档安装成功，
但是我在OpenNebula 4.0 管理平台里加KVM节点设备出错，总是加不上请问 添加节点还需要做那些配置，我目前做了节点到管理台SSH-ISA 交换。但是到下面这一步总是过不了。
ue Jul 16 10:11:17 2013 [ReM][D]: Req:4288 UID:0 TemplatePoolInfo invoked, -2, -1, -1
Tue Jul 16 10:11:17 2013 [ReM][D]: Req:4288 UID:0 TemplatePoolInfo result SUCCESS, “</V…"
Tue Jul 16 10:11:25 2013 [ReM][D]: Req:5376 UID:0 AclInfo invoked
Tue Jul 16 10:11:25 2013 [ReM][D]: Req:5376 UID:0 AclInfo result SUCCESS, "0…”
Tue Jul 16 10:11:27 2013 [ReM][D]: Req:5280 UID:0 VirtualMachinePoolInfo invoked, -2, -1, -1, -1
Tue Jul 16 10:11:27 2013 [ReM][D]: Req:5280 UID:0 VirtualMachinePoolInfo result SUCCESS, “”
Tue Jul 16 10:11:30 2013 [ReM][D]: Req:2720 UID:0 VirtualMachinePoolInfo invoked, -2, -1, -1, -1
Tue Jul 16 10:11:30 2013 [ReM][D]: Req:2720 UID:0 VirtualMachinePoolInfo result SUCCESS, “”
Tue Jul 16 10:11:30 2013 [ReM][D]: Req:9760 UID:0 VirtualMachinePoolInfo invoked, -2, -1, -1, -1
Tue Jul 16 10:11:30 2013 [ReM][D]: Req:9760 UID:0 VirtualMachinePoolInfo result SUCCESS, “”
Tue Jul 16 10:11:39 2013 [AuM][D]: Message received: LOG I 290 ExitCode: 0
Tue Jul 16 10:11:39 2013 [AuM][I]: ExitCode: 0
Tue Jul 16 10:11:39 2013 [AuM][D]: Message received: AUTHENTICATE SUCCESS 290 –
Tue Jul 16 10:11:39 2013 [ReM][D]: Req:1424 UID:0 VirtualNetworkPoolInfo invoked, -2, -1, -1
Tue Jul 16 10:11:39 2013 [ReM][D]: Req:1424 UID:0 VirtualNetworkPoolInfo result SUCCESS, “</VNET_PO…"
Tue Jul 16 10:11:41 2013 [InM][I]: Monitoring host node1.icloud.com (14)
Tue Jul 16 10:11:41 2013 [InM][I]: Command execution fail: 'if [ -x "/var/tmp/one/im/run_probes" ]; then /var/tmp/one/im/run_probes kvm 14 node1.icloud.com; else exit 42; fi'
Tue Jul 16 10:11:41 2013 [InM][I]: Host key verification failed.
Tue Jul 16 10:11:41 2013 [InM][I]: ExitCode: 255
Tue Jul 16 10:11:41 2013 [ONE][E]: Error monitoring Host node1.icloud.com (14): –
@hack
貌似是 ssh key 的问题，需要确认4件事：
1、确认从控制节点到各 KVM 节点之间可以无密码 ssh；
2、确认从各 KVM 节点到控制节点之间可以无密码 ssh；
3、确认从控制节点到控制节点（也就是自己到自己）之间可以无密码 ssh；
4、确认使用同一个用户 ssh，各个节点上都是同一个用户 oneadmin 来 ssh，不要控制节点上的 root 去 ssh 某个 KVM 节点上的 oneadmin.
@vpsee
我按你的方法做了 现在报如下错误码
ue Jul 16 15:40:42 2013 [ReM][D]: Req:6976 UID:0 AclInfo invoked
Tue Jul 16 15:40:42 2013 [ReM][D]: Req:6976 UID:0 AclInfo result SUCCESS, “0…”
Tue Jul 16 15:40:46 2013 [ReM][D]: Req:48 UID:0 ClusterPoolInfo invoked
Tue Jul 16 15:40:46 2013 [ReM][D]: Req:48 UID:0 ClusterPoolInfo result SUCCESS, “<CLUST…"
Tue Jul 16 15:40:49 2013 [ReM][D]: Req:5424 UID:0 VirtualNetworkPoolInfo invoked, -2, -1, -1
Tue Jul 16 15:40:49 2013 [ReM][D]: Req:5424 UID:0 VirtualNetworkPoolInfo result SUCCESS, "</VNET_PO…"
Tue Jul 16 15:40:51 2013 [InM][I]: Monitoring host node1.icloud.com (15)
Tue Jul 16 15:40:51 2013 [InM][I]: Command execution fail: 'if [ -x "/var/tmp/one/im/run_probes" ]; then /var/tmp/one/im/run_probes kvm 15 node1.icloud.com; else exit 42; fi'
Tue Jul 16 15:40:51 2013 [InM][I]: Permission denied, please try again.
Tue Jul 16 15:40:51 2013 [InM][I]: Permission denied, please try again.
Tue Jul 16 15:40:51 2013 [InM][I]: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).
Tue Jul 16 15:40:51 2013 [InM][I]: ExitCode: 255
Tue Jul 16 15:40:51 2013 [ONE][E]: Error monitoring Host node1.icloud.com (15): –
Tue Jul 16 15:40:53 2013 [ReM][D]: Req:8176 UID:0 ImagePoolInfo invoked, -2, -1, -1
Tue Jul 16 15:40:53 2013 [ReM][D]: Req:8176 UID:0 ImagePoolInfo result SUCCESS, "</IMAGE_…"
Tue Jul 16 15:41:00 2013 [ReM][D]: Req:8400 UID:0 VirtualMachinePoolInfo invoked, -2, -1, -1, -1
Tue Jul 16 15:41:00 2013 [ReM][D]: Req:8400 UID:0 VirtualMachinePoolInfo result SUCCESS, "”
Tue Jul 16 15:41:00 2013 [ReM][D]: Req:8960 UID:0 VirtualMachinePoolInfo invoked, -2, -1, -1, -1
Tue Jul 16 15:41:00 2013 [ReM][D]: Req:8960 UID:0 VirtualMachinePoolInfo result SUCCESS, “”
Tue Jul 16 15:41:01 2013 [AuM][D]: Message received: LOG I 471 ExitCode: 0
@vpsee
你的QQ 多少
[root@manager ~]# ssh node1.icloud.com
Last login: Tue Jul 16 17:19:37 2013 from 183.136.148.98
[root@node1 ~]#
节点到各 KVM 节点之间可以无密码 ssh
[root@manager ~]# ssh manager.icloud.com
Last login: Tue Jul 16 17:20:40 2013 from 183.136.148.98
[root@manager ~]# ^C
[root@manager ~]# exit
控制节点到控制节点（也就是自己到自己）之间可以无密码 ssh；
[root@node1 ~]# ssh manager.icloud.com
Last login: Tue Jul 16 17:21:11 2013 from manager
[root@manager ~]#
KVM 节点到控制节点之间可以无密码 ssh
[root@manager ~]# su oneadmin
[oneadmin@manager root]$ ssh node1.icloud.com
oneadmin@node1.icloud.com‘s password:
Last login: Tue Jul 16 16:01:03 2013 from manager
[oneadmin@node1 ~]$
@hack
貌似你的 root 帐户都可以无密码 ssh，问题是你的 opennebula 管理员帐户是谁？是 root 还是 oneadmin？（一般来说安装后都是 oneadmin），如果是 oneadmin 的话，需要这个帐号都能无密码 ssh（貌似你上面要了密码 oneadmin@node1.icloud.com‘s password:）。
还有，需要用 oneadmin 来启动各个 opennebula 服务（而不是用 root 启动），比如用 oneadmin 帐号启动 $ one start 等。
oneadmin 权限有限 很多命令都用不了
@vpsee
我现在用oneadmin 满足了你前面所提的要求了，
1、确认从控制节点到各 KVM 节点之间可以无密码 ssh；
2、确认从各 KVM 节点到控制节点之间可以无密码 ssh；
3、确认从控制节点到控制节点（也就是自己到自己）之间可以无密码 ssh；
4、确认使用同一个用户 ssh，各个节点上都是同一个用户 oneadmin 来 ssh，不要控制节点上的 root 去 ssh 某个 KVM 节点上的 oneadmin.
但是加KVM 节点报如下错误码。。
Wed Jul 17 23:28:20 2013 [AuM][I]: ExitCode: 0
Wed Jul 17 23:28:20 2013 [AuM][D]: Message received: AUTHENTICATE SUCCESS 6 –
Wed Jul 17 23:28:20 2013 [ReM][D]: Req:8480 UID:0 ClusterPoolInfo invoked
Wed Jul 17 23:28:20 2013 [ReM][D]: Req:8480 UID:0 ClusterPoolInfo result SUCCESS, “<CLUST…"
Wed Jul 17 23:28:23 2013 [ReM][D]: Req:8000 UID:0 GroupPoolInfo invoked
Wed Jul 17 23:28:23 2013 [ReM][D]: Req:8000 UID:0 GroupPoolInfo result SUCCESS, "<…"
Wed Jul 17 23:28:26 2013 [ReM][D]: Req:8864 UID:0 ImagePoolInfo invoked, -2, -1, -1
Wed Jul 17 23:28:26 2013 [ReM][D]: Req:8864 UID:0 ImagePoolInfo result SUCCESS, "</IMAGE_…"
Wed Jul 17 23:28:27 2013 [InM][I]: Monitoring host node1.icloud.com (0)
Wed Jul 17 23:28:27 2013 [InM][I]: Command execution fail: 'if [ -x "/var/tmp/one/im/run_probes" ]; then /var/tmp/one/im/run_probes kvm 0 node1.icloud.com; else exit 42; fi'
Wed Jul 17 23:28:27 2013 [InM][I]: ExitCode: 42
Wed Jul 17 23:28:27 2013 [ONE][E]: Error monitoring Host node1.icloud.com (0): –
Wed Jul 17 23:28:28 2013 [ReM][D]: Req:2720 UID:0 TemplatePoolInfo invoked, -2, -1, -1
Wed Jul 17 23:28:28 2013 [ReM][D]: Req:2720 UID:0 TemplatePoolInfo result SUCCESS, "</V…"
Wed Jul 17 23:28:28 2013 [ReM][D]: Req:3824 UID:0 DatastorePoolInfo invoked
Wed Jul 17 23:28:28 2013 [ReM][D]: Req:3824 UID:0 DatastorePoolInfo result SUCCESS, "<DAT…"
[oneadmin@manager ~]$
@hack
看上面错误提示貌似没有这个文件 /var/tmp/one/im/run_probes 或者执行这个文件报错，你在命令行执行 /var/tmp/one/im/run_probes 看看。同时看看 /var/log/one 下的日志看看有什么错误提示。
用ROOT 用户如下：
[root@node1 im]# /var/tmp/one/im/run_probes
[root@node1 im]#
没前任何报错！
日志：
Fri Jul 19 22:06:57 2013 [InM][I]: ExitCode: 42
Fri Jul 19 22:06:57 2013 [ONE][E]: Error monitoring Host node1.icloud.com (0): –
Fri Jul 19 22:07:16 2013 [ReM][D]: Req:6704 UID:0 VirtualMachinePoolInfo invoked, -2, -1, -1, -1
Fri Jul 19 22:07:16 2013 [ReM][D]: Req:6704 UID:0 VirtualMachinePoolInfo result SUCCESS, “”
Fri Jul 19 22:07:16 2013 [ReM][D]: Req:2624 UID:0 VirtualMachinePoolInfo invoked, -2, -1, -1, -1
Fri Jul 19 22:07:16 2013 [ReM][D]: Req:2624 UID:0 VirtualMachinePoolInfo result SUCCESS, “”
Fri Jul 19 22:07:27 2013 [InM][I]: Monitoring host node1.icloud.com (0)
Fri Jul 19 22:07:27 2013 [InM][I]: Command execution fail: ‘if [ -x “/var/tmp/one/im/run_probes” ]; then /var/tmp/one/im/run_probes kvm 0 node1.icloud.com; else exit 42; fi’
Fri Jul 19 22:07:27 2013 [InM][I]: ExitCode: 42
Fri Jul 19 22:07:27 2013 [ONE][E]: Error monitoring Host node1.icloud.com (0): –
oneadmin 账户去执行！
[oneadmin@node1 im]$ /var/tmp/one/im/run_probes
bash: /var/tmp/one/im/run_probes: Permission denied
[oneadmin@node1 im]$ su root
Password:
[root@node1 im]# ll
total 20
drwxr-x—. 2 root root 4096 Jul 15 23:29 ganglia.d
drwxr-x—. 2 root root 4096 Jul 15 23:29 kvm.d
-rwxr-xr-x. 1 root root 1823 Jul 15 23:41 run_probes
drwxr-x—. 2 root root 4096 Jul 15 23:29 vmware.d
drwxr-x—. 2 root root 4096 Jul 15 23:29 xen.d
[root@node1 im]#
显示文件都是 ROOT 用户与组
@vpsee
我把 run_probes 文件贴出来了
[root@node1 ~]# more /var/tmp/one/im/run_probes
#!/bin/bash
# ————————————————————————– #
# Copyright 2002-2013, OpenNebula Project (OpenNebula.org), C12G Labs #
# #
# Licensed under the Apache License, Version 2.0 (the “License”); you may #
# not use this file except in compliance with the License. You may obtain #
# a copy of the License at #
# #
# http://www.apache.org/licenses/LICENSE-2.0 #
# #
# Unless required by applicable law or agreed to in writing, software #
# distributed under the License is distributed on an “AS IS” BASIS, #
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. #
# See the License for the specific language governing permissions and #
# limitations under the License. #
#————————————————————————— #
source $(dirname $0)/../scripts_common.sh
export LANG=C
HYPERVISOR_DIR=$1.d
ARGUMENTS=$*
SCRIPTS_DIR=`dirname $0`
cd $SCRIPTS_DIR
function run_dir {
(
cd $1
for i in `ls *`;do
if [ -x “$i” ]; then
./$i $ARGUMENTS
EXIT_CODE=$?
if [ “x$EXIT_CODE” != “x0” ]; then
error_message “Error executing $i”
exit $EXIT_CODE
fi
fi
done
)
}
data=$(
if [ -d “$HYPERVISOR_DIR” ]; then
run_dir “$HYPERVISOR_DIR”
fi
)
EXIT_CODE=$?
echo “$data”
if [ “x$EXIT_CODE” != “x0” ]; then
exit $EXIT_CODE
fi
[root@node1 ~]#
@hack
貌似你用 oneadmin 执行 run_probes 显示权限不够，检查一下 /var/tmp/one/im/run_probes 的权限，可能是因为刚开始安装运行 opennebula 的时候用了 root（帐户），导致生成的 /var/tmp/one/ 下面的内容也是 root 所有，导致 oneadmin 用户无权限执行。
@vpsee
谢谢你的支持，问题解决了，是权限用户组的问题。
有没有OpenNebula 4.0 操作使用手册!
例如 如何添加ISO镜像，如何添加存储资源池 如何创建模版，虚拟机等 等
@vpsee
节点到 KVM 都部署好了
我用过很多开源云平台，都成功创建虚拟机，以及HA 功能，
但为独用到OpenNebula 4.0 感觉有点难度了。
模版怎么建，镜像怎么建，虚拟机怎么创建==
@hack
模版可以去一些网站下载，不用自己建，非要建的话最简单的办法是创建一个 kvm 虚拟机 http://www.vpsee.com/2012/04/install-kvm-on-centos-6-2/
请教个问题，我建立kvm虚拟机之后，状态一直提示pending ，在oned.log中也查不到error 请问这有可能是哪方面的错误导致的
高手，我在网页上上传了image ，建立了模版，在 storage 中我选择了Image （选择了一个镜像）Volatile Disk（创建）了一块10G的空间， boot 选的cdrom。
但是建立好模版后，我生产虚拟机，首先是提升 could not read from cdrom
然后提示 no bootdable device
请问这个是哪里设置错误了
大侠，连接vmware 的时候报这个错误，我再官网上查了下，说以前有
Command execution fail: /var/lib/one/remotes/tm/shared/mkimage 10240 ext4 192.168.3.134:/vmfs/volumes/0/0/disk.0 0 0
@vpsee
在 CentOS 6.4 上安装和配置 OpenNebula 4.0 我已经按照你的文档安装成功，
但是我在OpenNebula 4.0 管理平台里加KVM节点设备出错，我的管理节点跟计算节点在一台机器上安装的。。已经解决无密码ssh。。但是还是无法添加host，
还是这报错Tue Aug 13 05:52:19 2013 : Error monitoring Host cloudlei (4):
希望楼主更新一下文档谢谢啦
你好，我原来是用cloudstack的，现在换成了opennebula,我遇到几个问题，我看了官方的说明，特别是存储的说明，不知道是我没有看明白还是官方没有说清楚，在cloudstack有主存储和二级存储的区分，好像在opennebula整理，没有看见详细的说明，现在在安装第一台的时候管理节点和KVM安装没有问题！但是不知道存储应该怎么做！请麻烦指导一下！我的存储打算用基本的NFS来做存储！
在安装管理节点的时候如果不安装上 EPEL 源，升级的话，是不是opennebula会安装出错？
@Alan
需要安装 epel 源。
@Alan
opennebula 可以用 nfs，把 nfs 挂载到每个物理机（计算结点）的 /var/lib/one/（或 /var/lib/one/datastores/）就可以了。
创建虚机报错，帮忙分析一下什么原因！
New VM state is ACTIVE.
Thu Aug 15 02:06:53 2013 [LCM][I]: New VM state is PROLOG.
Thu Aug 15 02:06:54 2013 [TM][I]: /var/lib/one/remotes/datastore/xpath.rb:61: undefined method `elements’ for nil:NilClass (NoMethodError)
Thu Aug 15 02:06:54 2013 [TM][I]: from /var/lib/one/remotes/datastore/xpath.rb:60:in `each’
Thu Aug 15 02:06:54 2013 [TM][I]: from /var/lib/one/remotes/datastore/xpath.rb:60
Thu Aug 15 02:06:54 2013 [TM][I]: clone: Cloning /var/lib/one/datastores/1/b722babd53f172288225c50e39a51029 in 192.168.18.140:/var/lib/one//datastores/0/3/disk.0
Thu Aug 15 02:06:54 2013 [TM][I]: ExitCode: 0
Thu Aug 15 02:06:56 2013 [TM][I]: context: Generating context block device at 192.168.18.140:/var/lib/one//datastores/0/3/disk.1
Thu Aug 15 02:06:56 2013 [TM][I]: ExitCode: 0
Thu Aug 15 02:06:56 2013 [LCM][I]: New VM state is BOOT
Thu Aug 15 02:06:56 2013 [VMM][I]: Generating deployment file: /var/lib/one/vms/3/deployment.0
Thu Aug 15 02:06:56 2013 [VMM][I]: ExitCode: 0
Thu Aug 15 02:06:56 2013 [VMM][I]: Successfully execute network driver operation: pre.
Thu Aug 15 02:06:56 2013 [VMM][I]: Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/deploy /var/lib/one//datastores/0/3/deployment.0 192.168.18.140 3 192.168.18.140
Thu Aug 15 02:06:56 2013 [VMM][I]: error: Failed to create domain from /var/lib/one//datastores/0/3/deployment.0
Thu Aug 15 02:06:56 2013 [VMM][I]: error: unsupported configuration: Domain requires KVM, but it is not available. Check that virtualization is enabled in the host BIOS, and host configuration is setup to load the kvm modules.
Thu Aug 15 02:06:56 2013 [VMM][E]: Could not create domain from /var/lib/one//datastores/0/3/deployment.0
Thu Aug 15 02:06:56 2013 [VMM][I]: ExitCode: 255
Thu Aug 15 02:06:56 2013 [VMM][I]: Failed to execute virtualization driver operation: deploy.
Thu Aug 15 02:06:56 2013 [VMM][E]: Error deploying virtual machine: Could not create domain from /var/lib/one//datastores/0/3/deployment.0
Thu Aug 15 02:06:56 2013 [DiM][I]: New VM state is FAILED
@vpsee
今天重装了 OpenNebula 4.0 也是按上面文档安装的，
安装全是用ROOT 用户安装的，
在oneadmin 下交换 SSH Key时 怎么都还是需要密码，不知道怎么办，
# ssh-keygen -t rsa
# ssh-copy-id -i ~/.ssh/id_rsa.pub node01
是按这个去操作的
但是我新建个test 用户，用以上的命令是可以的无密码登录的。
@hack
关闭SElinux就可以解决！
@双响炮
谢谢！问题解决了 ！
@all
我 OpenNebula 4.0全安装好了 节点也添加成功了，请问接下来怎么创建虚拟机 还是不会！
请前辈指教！
你好，我根据网站的介绍，这几天在研究和安装opennebula，发现几个问题，网站没有说清楚，官方说的也很含糊，所以我希望vpsee能把安装的详细情况补足，我在安装的过程中，有几个地方，是必须修改，不然添加节点不会成功，第一个是hosts，必须做本地解析，ssh配置文件，有几个地方必须修改，分别是：RSAAuthentication yes，PubkeyAuthentication yes，AuthorizedKeysFile ssh/authorized_keys，把#号去掉，关闭selinux，这样ssh才能无密码登陆！才能添加节点！这个是我这几天来的小小心得！希望贵网站越做越好，越做越大！顺便请教存储问题，请问在opennebula上面有没有什么比较好的存储方案呢？
@Alan
hosts 不必本地解析，如果自己有 dns 服务的话。嗯，需要关闭 selinux.
存储可以用 NFS，SAN 等，也可以用一些开源的分布式存储，比如 MooseFS 等。
NFS如何做沉余
我自己是没有DNS的，所以HOSTS必须做解析
@vpsee 装好后创建虚拟主机，为什么一直状态在“PENDDING”，日志里也没报错？
@millken
如果控制节点上的日志没有报错就去计算节点的日志看看，一般在 /var/log/libvirt/libvirtd.log 和 /var/log/libvirt/qemu 目录里。
@vpsee
昨天我已经成功装上了并创建了虚拟主机，不过今天过来发现无法监控节点。重装了节点的opennebula，还是一样。一直提示
Tue Jan 7 15:21:59 2014 [InM][I]: (gnome-ssh-askpass:18912): Gtk-WARNING **: cannot open display: :0.0
Tue Jan 7 15:21:59 2014 [InM][I]: Permission denied, please try again.
Tue Jan 7 15:21:59 2014 [InM][I]: No protocol specified
Tue Jan 7 15:21:59 2014 [InM][I]:
Tue Jan 7 15:21:59 2014 [InM][I]: (gnome-ssh-askpass:18913): Gtk-WARNING **: cannot open display: :0.0
Tue Jan 7 15:21:59 2014 [InM][I]: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).
Tue Jan 7 15:21:59 2014 [InM][I]: lost connection
Tue Jan 7 15:21:59 2014 [InM][I]: ExitCode: 1
Tue Jan 7 15:21:59 2014 [ONE][E]: Error monitoring Host 192.168.3.104 (14):
我测试发现，当node不mount /var/lib/one时，从控制机可以免登录ssh，一旦mount后，就提示要密码。
请教我该怎么做？
感谢 @vpsee 的文章。
请教我建立虚拟机时总是出现如下错误，不知道您是否遇到过类似问题。log中的XXX是我使用的公网IP。
Thu Mar 6 15:54:39 2014 [DiM][I]: New VM state is ACTIVE.
Thu Mar 6 15:54:39 2014 [LCM][I]: New VM state is PROLOG.
Thu Mar 6 15:54:40 2014 [LCM][I]: New VM state is BOOT
Thu Mar 6 15:54:40 2014 [VMM][I]: Generating deployment file: /var/lib/one/vms/12/deployment.0
Thu Mar 6 15:54:41 2014 [VMM][I]: ExitCode: 0
Thu Mar 6 15:54:41 2014 [VMM][I]: Successfully execute network driver operation: pre.
Thu Mar 6 15:54:41 2014 [VMM][I]: Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/deploy '/var/lib/one//datastores/0/12/deployment.0' 'XXX.XXX.XXX.XXX' 12 XXX.XXX.XXX.XXX
Thu Mar 6 15:54:41 2014 [VMM][I]: error: Failed to create domain from /var/lib/one//datastores/0/12/deployment.0
Thu Mar 6 15:54:41 2014 [VMM][I]: error: unable to set security context 'system_u:object_r:virt_content_t:s0' on '/var/lib/one//datastores/0/12/disk.1': Permission denied
Thu Mar 6 15:54:41 2014 [VMM][E]: Could not create domain from /var/lib/one//datastores/0/12/deployment.0
Thu Mar 6 15:54:41 2014 [VMM][I]: ExitCode: 255
Thu Mar 6 15:54:41 2014 [VMM][I]: Failed to execute virtualization driver operation: deploy.
Thu Mar 6 15:54:41 2014 [VMM][E]: Error deploying virtual machine: Could not create domain from /var/lib/one//datastores/0/12/deployment.0
Thu Mar 6 15:54:41 2014 [DiM][I]: New VM state is FAILED
@Coldman
关闭 SELINUX 试试。
Mon Jul 21 17:36:31 2014 [ReM][D]: Req:3472 UID:0 VirtualMachinePoolInfo result SUCCESS, “”
Mon Jul 21 17:36:31 2014 [ReM][D]: Req:8736 UID:0 HostMonitoring invoked, 1
Mon Jul 21 17:36:31 2014 [ReM][D]: Req:8736 UID:0 HostMonitoring result SUCCESS, “</M…"
Mon Jul 21 17:36:33 2014 [ReM][D]: Req:400 UID:0 HostInfo invoked, 1
Mon Jul 21 17:36:33 2014 [ReM][D]: Req:400 UID:0 HostInfo result SUCCESS, "1<NAM…"
Mon Jul 21 17:36:33 2014 [ReM][D]: Req:4592 UID:0 HostMonitoring invoked, 1
Mon Jul 21 17:36:33 2014 [ReM][D]: Req:4592 UID:0 HostMonitoring result SUCCESS, "</M…"
Mon Jul 21 17:36:51 2014 [ReM][D]: Req:1840 UID:0 VirtualMachinePoolInfo invoked, -2, -1, -1, -1
Mon Jul 21 17:36:51 2014 [ReM][D]: Req:1840 UID:0 VirtualMachinePoolInfo result SUCCESS, "”
Mon Jul 21 17:36:51 2014 [ReM][D]: Req:1840 UID:0 VirtualMachinePoolInfo invoked, -2, -1, -1, -1
Mon Jul 21 17:36:51 2014 [ReM][D]: Req:1840 UID:0 VirtualMachinePoolInfo result SUCCESS, “”
Mon Jul 21 17:37:04 2014 [InM][D]: Monitoring host localhost (1)
Mon Jul 21 17:37:04 2014 [InM][D]: Monitoring datastore default (1)
Mon Jul 21 17:37:04 2014 [InM][D]: Monitoring datastore files (2)
Mon Jul 21 17:37:04 2014 [InM][I]: Command execution fail: ‘if [ -x “/var/tmp/one/im/run_probes” ]; then /var/tmp/one/im/run_probes kvm-probes /var/lib/one//datastores 4124 20 1 localhost; else exit 42; fi’
Mon Jul 21 17:37:04 2014 [InM][I]: Warning: Permanently added ‘localhost’ (RSA) to the list of known hosts.
Mon Jul 21 17:37:04 2014 [InM][I]: ExitCode: 42
Mon Jul 21 17:37:04 2014 [ONE][E]: Error monitoring Host localhost (1): –
Mon Jul 21 17:37:04 2014 [ImM][D]: Datastore default (1) successfully monitored.
Mon Jul 21 17:37:04 2014 [ImM][D]: Datastore files (2) successfully monitored.
Mon Jul 21 17:37:21 2014 [ReM][D]: Req:1312 UID:0 VirtualMachinePoolInfo invoked, -2, -1, -1, -1
Mon Jul 21 17:37:21 2014 [ReM][D]: Req:1312 UID:0 VirtualMachinePoolInfo result SUCCESS, “”
Mon Jul 21 17:37:21 2014 [ReM][D]: Req:1312 UID:0 VirtualMachinePoolInfo invoked, -2, -1, -1, -1
Mon Jul 21 17:37:21 2014 [ReM][D]: Req:1312 UID:0 VirtualMachinePoolInfo result SUCCESS, “”
请问这是什么问题，我总是物理机添加不上去
[root@wang-pc network-scripts]# service network restart
Shutting down interface br0: [ OK ]
Shutting down interface p2p2: device p2p2 is not a slave of br0
[ OK ]
Shutting down interface wlan0:
** (process:9540): WARNING **: Error in getting active connection ‘Vpn’ property: (19) Method “Get” with signature “ss” on interface “org.freedesktop.DBus.Properties” doesn’t exist
** (process:9540): WARNING **: _nm_object_array_demarshal: couldn’t create object for /org/freedesktop/NetworkManager/ActiveConnection/44
Device state: 3 (disconnected)
[ OK ]
Shutting down loopback interface: [ OK ]
Bringing up loopback interface: [ OK ]
Bringing up interface p2p2: [ OK ]
Bringing up interface br0:
Determining IP information for br0…/etc/sysconfig/network-scripts/ifup-eth: line 282: 9813 Terminated /sbin/dhclient ${DHCLIENTARGS} ${DEVICE}
failed.
[FAILED]
重启失败了，怎么回事？？
ifconfig
br0 Link encap:Ethernet HWaddr A4:1F:72:75:AE:06
inet6 addr: fe80::f06f:efff:fe04:e2e1/64 Scope:Link
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:588 errors:0 dropped:0 overruns:0 frame:0
TX packets:48 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:64515 (63.0 KiB) TX bytes:15900 (15.5 KiB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:4731 errors:0 dropped:0 overruns:0 frame:0
TX packets:4731 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:440168 (429.8 KiB) TX bytes:440168 (429.8 KiB)
p2p2 Link encap:Ethernet HWaddr A4:1F:72:75:AE:06
inet6 addr: fe80::a61f:72ff:fe75:ae06/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:3725 errors:0 dropped:2 overruns:0 frame:0
TX packets:1151 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:480274 (469.0 KiB) TX bytes:106174 (103.6 KiB)
virbr0 Link encap:Ethernet HWaddr 1E:05:C8:78:7D:D6
inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)
wlan0 Link encap:Ethernet HWaddr 70:18:8B:AF:0B:B0
inet addr:10.80.102.232 Bcast:10.80.127.255 Mask:255.255.224.0
inet6 addr: fe80::7218:8bff:feaf:bb0/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:5625 errors:0 dropped:0 overruns:0 frame:0
TX packets:8020 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:3208207 (3.0 MiB) TX bytes:1148450 (1.0 MiB)
ifconfig
br0 Link encap:Ethernet HWaddr A4:1F:72:75:AE:06
inet6 addr: fe80::f06f:efff:fe04:e2e1/64 Scope:Link
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:588 errors:0 dropped:0 overruns:0 frame:0
TX packets:48 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:64515 (63.0 KiB) TX bytes:15900 (15.5 KiB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:4731 errors:0 dropped:0 overruns:0 frame:0
TX packets:4731 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:440168 (429.8 KiB) TX bytes:440168 (429.8 KiB)
p2p2 Link encap:Ethernet HWaddr A4:1F:72:75:AE:06
inet6 addr: fe80::a61f:72ff:fe75:ae06/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:3725 errors:0 dropped:2 overruns:0 frame:0
TX packets:1151 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:480274 (469.0 KiB) TX bytes:106174 (103.6 KiB)
virbr0 Link encap:Ethernet HWaddr 1E:05:C8:78:7D:D6
inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)
wlan0 Link encap:Ethernet HWaddr 70:18:8B:AF:0B:B0
inet addr:10.80.102.232 Bcast:10.80.127.255 Mask:255.255.224.0
inet6 addr: fe80::7218:8bff:feaf:bb0/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:5625 errors:0 dropped:0 overruns:0 frame:0
TX packets:8020 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:3208207 (3.0 MiB) TX bytes:1148450 (1.0 MiB)
/etc/one/sunstone-server.conf ip设置成哪个？？都试了下 不成功
oneflow-server start
Stale .lock detected. Erasing it.
Error executing oneflow-server.
Check /var/log/one/oneflow.error and /var/log/one/oneflow.log for more information
usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `gem_original_require’: no such file to load — treetop (LoadError)
from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `require’
from /usr/lib/one/oneflow/lib/models/role.rb:17
from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `gem_original_require’
from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `require’
from /usr/lib/one/oneflow/lib/models.rb:26
from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `gem_original_require’
from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `require’
from /usr/lib/one/oneflow/oneflow-server.rb:49
oneflow-server start启动不了 怎么弄？
Sun Aug 17 15:43:01 2014 [DiM][I]: New VM state is ACTIVE.
Sun Aug 17 15:43:01 2014 [LCM][I]: New VM state is PROLOG.
Sun Aug 17 15:43:04 2014 [LCM][I]: New VM state is BOOT
Sun Aug 17 15:43:04 2014 [VMM][I]: Generating deployment file: /var/lib/one/vms/27/deployment.0
Sun Aug 17 15:43:04 2014 [VMM][I]: ExitCode: 0
Sun Aug 17 15:43:04 2014 [VMM][I]: Successfully execute network driver operation: pre.
Sun Aug 17 15:43:04 2014 [VMM][I]: Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/deploy '/var/lib/one//datastores/0/27/deployment.0' '23.228.66.178' 27 23.228.66.178
Sun Aug 17 15:43:04 2014 [VMM][I]: error: Failed to create domain from /var/lib/one//datastores/0/27/deployment.0
Sun Aug 17 15:43:04 2014 [VMM][I]: error: Unable to add bridge br0 port vnet0: Operation not supported
Sun Aug 17 15:43:04 2014 [VMM][E]: Could not create domain from /var/lib/one//datastores/0/27/deployment.0
Sun Aug 17 15:43:04 2014 [VMM][I]: ExitCode: 255
Sun Aug 17 15:43:04 2014 [VMM][I]: Failed to execute virtualization driver operation: deploy.
Sun Aug 17 15:43:04 2014 [VMM][E]: Error deploying virtual machine: Could not create domain from /var/lib/one//datastores/0/27/deployment.0
Sun Aug 17 15:43:05 2014 [DiM][I]: New VM state is FAILED
Sun Aug 17 15:46:53 2014 [DiM][I]: New VM state is DONE.
Sun Aug 17 15:46:54 2014 [TM][W]: Ignored: TRANSFER SUCCESS 27 –
这个错误请问遇到过么.
问题解决了,谢谢!现在可以说说如何做windows的虚拟机不?
@Alan
嗯，已经说过了～ 参考：
为 OpenNebula 制作 Windows 镜像
@Alan我和你的问题一样，你是怎么解决的，Sun Aug 17 15:43:01 2014 [DiM][I]: New VM state is ACTIVE.
Sun Aug 17 15:43:01 2014 [LCM][I]: New VM state is PROLOG.
Sun Aug 17 15:43:04 2014 [LCM][I]: New VM state is BOOT
Sun Aug 17 15:43:04 2014 [VMM][I]: Generating deployment file: /var/lib/one/vms/27/deployment.0
Sun Aug 17 15:43:04 2014 [VMM][I]: ExitCode: 0
Sun Aug 17 15:43:04 2014 [VMM][I]: Successfully execute network driver operation: pre.
Sun Aug 17 15:43:04 2014 [VMM][I]: Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/deploy '/var/lib/one//datastores/0/27/deployment.0' '23.228.66.178' 27 23.228.66.178
Sun Aug 17 15:43:04 2014 [VMM][I]: error: Failed to create domain from /var/lib/one//datastores/0/27/deployment.0
Sun Aug 17 15:43:04 2014 [VMM][I]: error: Unable to add bridge br0 port vnet0: Operation not supported
Sun Aug 17 15:43:04 2014 [VMM][E]: Could not create domain from /var/lib/one//datastores/0/27/deployment.0
Sun Aug 17 15:43:04 2014 [VMM][I]: ExitCode: 255
Sun Aug 17 15:43:04 2014 [VMM][I]: Failed to execute virtualization driver operation: deploy.
Sun Aug 17 15:43:04 2014 [VMM][E]: Error deploying virtual machine: Could not create domain from /var/lib/one//datastores/0/27/deployment.0
Sun Aug 17 15:43:05 2014 [DiM][I]: New VM state is FAILED
Sun Aug 17 15:46:53 2014 [DiM][I]: New VM state is DONE.
Sun Aug 17 15:46:54 2014 [TM][W]: Ignored: TRANSFER SUCCESS 27 –
/etc/init.d/opennebula-sunstone start
Starting Sunstone Server daemon: Stale .lock detected. Erasing it.
Error executing sunstone-server.
Check /var/log/one/sunstone.error and /var/log/one/sunstone.log for more information
[FAILED]
root@open ~]# cat /var/log/one/sunstone.error
/usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `gem_original_require’: no such file to load — builder (LoadError)
from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `require’
from /usr/lib/one/ruby/vendors/rbvmomi/lib/rbvmomi/trivial_soap.rb:3
from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `gem_original_require’
from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `require’
from /usr/lib/one/ruby/vendors/rbvmomi/lib/rbvmomi/connection.rb:4
from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `gem_original_require’
from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `require’
from /usr/lib/one/ruby/vendors/rbvmomi/lib/rbvmomi.rb:11
from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `gem_original_require’
from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `require’
from /usr/lib/one/ruby/vcenter_driver.rb:39
from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `gem_original_require’
from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `require’
from /usr/lib/one/sunstone/routes/vcenter.rb:26
from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `gem_original_require’
from /usr/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `require’
from /usr/lib/one/sunstone/sunstone-server.rb:345
from /usr/lib/one/sunstone/sunstone-server.rb:344:in `each’
from /usr/lib/one/sunstone/sunstone-server.rb:344