Difference between revisions of "Agile testbed/Cloud"

From PDP/Grid Wiki
Jump to navigationJump to search
(add cloud services)
Line 27: Line 27:
 
===Continuous Integration: Hudson===
 
===Continuous Integration: Hudson===
 
A virtual machine will run [http://www.hudson-ci.org/ Hudson] with the [http://wiki.hudson-ci.org/display/HUDSON/Amazon+EC2+Plugin EC2 Plugin] so that builds are done on dynamic virtual machines. The current CruiseControl service for VL-e builds will migrate to this (see also [http://www.rpm.org/max-rpm/s1-rpm-anywhere-different-build-area.html RPM build area customisation]).
 
A virtual machine will run [http://www.hudson-ci.org/ Hudson] with the [http://wiki.hudson-ci.org/display/HUDSON/Amazon+EC2+Plugin EC2 Plugin] so that builds are done on dynamic virtual machines. The current CruiseControl service for VL-e builds will migrate to this (see also [http://www.rpm.org/max-rpm/s1-rpm-anywhere-different-build-area.html RPM build area customisation]).
 +
 +
Authentication will preferably be done using a custom client-side ssl certificate plugin, which has received some effort already.
  
 
==Future directions==
 
==Future directions==

Revision as of 13:38, 16 November 2010

There is an effort to add a cloud to the Agile testbed. It is based on OpenNebula and currently runs on autana.nikhef.nl as master and arauca.nikhef.nl as a slave. It is currently in development.

Installation notes


Networking

  • Plug'n'play networking
    • MAC and IP addresses handed out by OpenNebula
    • An OpenNebula hook will be added to register the machine's name with DNS dynamically
  • There will be three networks, initially:
    • Closed: no internet connection (10.198.5.0/24, domain .closed)
    • Private: internet access, masqueraded to the outside world (10.198.6.0/24, .private)
    • Public: public IP addresses, bridged (domain .nikhef.nl)

These networks are all connected via eth1, so that the networks across different physical hosts can reach each other safely. Autana then masquerades the internal range for internet connectivity. Autana also runs a nameserver on 10.198.x.240 that serves the dynamic DNS in addition to being a DNS cache.

Dynamic DNS DDNS on Fedora

Image repository

There will be an image repository in LVM. These will be updated daily by a cronjob.

Contextualisation

When a cloud machine is instantiated from a base image from the repository, the machine should still be configured for the specific instance. This is done by an init script that is present in all base images, which sets up the network and runs any machine-specific initialisation. The OpenNebula contextualisation features will be used for this.

Services in the Cloud

Continuous Integration: Hudson

A virtual machine will run Hudson with the EC2 Plugin so that builds are done on dynamic virtual machines. The current CruiseControl service for VL-e builds will migrate to this (see also RPM build area customisation).

Authentication will preferably be done using a custom client-side ssl certificate plugin, which has received some effort already.

Future directions

When the cloud is properly setup, future directions can be explored like:

  • Secure networking: ebtables hooks to only allow allocated mac from node
  • Using virtual machines from within Hudson
    • for on-demand build slaves (multiple platforms)
    • for tests running on virtual machines
  • Moving other parts of the testbed to the cloud, if it turns out to be an improvement.