User Tools

Site Tools


guide:cloud

This is an old revision of the document!


Cloud Resources

The CHPC Cloud System is a CentOS-based cloud computing infrastructure powered by Openstack and open source storage software Ceph. Openstack provide services like server virtualization, block & object storage systems, software defined networking, an image repository, a web based dashboard and authentication.You can read more about Openstack and its various projects.

The Centre for high performance Computing (CHPC) hosts an OpenStack cloud built on Supermicro server and storage systems, using the Supermicro TwinPro servers to provide 320cores/640threads (2.50 - 3.90GHz) and over 3TB DDR4 memory providing some 9GB RAM per core and all in just 4U of rack space. It is connected through Mellanox 100GB ethernet networking to Supermicro Ultra and Supermicro Simply Double Servers, providing a CEPH Storage cluster with over 1.5PB (1500TB) of mechanical disk storage and more than 220TB of flash storage, offering resources such as:

  • Compute Resource: provides you with access to a large set of CPU & RAM and are provisioned on a per Instance basis.
  • Storage Resource: Block & Object storage functionality based on the open source software 'Ceph'. Ceph provides a scalable and highly available storage solution across many commodity servers.
  • Networking Resource: provides 10Gbps Internet connectivity, 10Gbps inter-host and 240Gbps inter-rack network connectivity using Openstack's Software Defined Networking (SDN).
CPU cores Memory Storage Networking(Shared) Object Storage (raw) Block Storage
3452 78 TB 4.4 PB 10 Gbps 403 TB 403 TB

Fees for using the CHPC cloud system

The cloud resources are allocated on per project basis, then several instances are provisioned based on the available resources allocated to the project. The billing is calculated by allocation not by percentage of utilization. The current billing fees are calculated as follows:

  • R0.23 per vCPU hour.
  • R0.14 per GB hour of vMemory(vRAM).
  • R0.0017 per GB hour of storage (volumes, images and object storage).

The Cloud is now open to a broader community of researchers. Apply today and start using our resources. A new project account creation on the Cloud user database can be requested through the application process. Upon acquiring cloud user database account and submitting a project on the CHPC cloud user database, we will send you an email with further instructions.

Cloud users are expected to:

  • Make appropriate use of Cloud resources and use good social behavior.
  • Do not share private ssh keys or login information.
  • Cite the Cloud in any papers describing research.

Already a Cloud user? Login into the Cloud Dashboard and launch an instance/s for your workflow.


How can I use an OpenStack cloud?

As an OpenStack cloud end user, you can provision your own resources within the limits set by cloud administrators.

The examples in this guide show you how to perform tasks by using the following methods:

  • OpenStack dashboard: Use this web-based graphical interface, code named horizon, to view, create, and manage resources.
  • OpenStack command-line clients: Each core OpenStack project has a command-line client that you can use to run simple commands to view, create, and manage resources in a cloud and automate tasks by using scripts.

Using OpenStack dashboard

As a cloud end user, you can use the OpenStack dashboard to provision your own resources within the limits set by administrators. You can modify the examples provided in this section to create other types and sizes of server instances.

For your convenience, we offer these short instructions that you should follow in order to start a new instance, while also recommending you read the official user guide to familiarize with more advanced functionalities.

1. First please open https://openstack.chpc.ac.za in your browser and login using the credentials provided.


2. Launching a virtual machine, You have to accomplish a number of steps.

a) Provide the initial hostname for the instance, the availability zone where it will be deployed, and the instance count. Increase the Count to create multiple instances with the same settings.:

b) Select the instance source, the template used to create an instance. You can use an image, a snapshot of an instance (image snapshot), a volume or a volume snapshot (if enabled). You can also choose to use persistent storage by creating a new volume.

For this example. The instance is launched from the image source and a new volume is created with the instance. The allocated ubuntu-18 image is selected from the list of available images and is going to be an Operating System (OS) for the instance/s created.


c) Decide on the flavor needed when launching the instance, Flavors manage the sizing for the compute, memory and storage capacity of the instance.

For this example. The instance is launched with m1.tiny flavor selected from the list of available flavors. The m1.tiny flavor will allocate the instance with 2x vCPU, 5GB of vRAM and 20GB of root disk. In order to carefully manage our compute resources, Only allocate what you are expecting to use, This is the total compute resources allocated to the instance created.


d) Select the network that your instance will connect to. The network provide the communication channels for instances in the cloud.

For this example. The instance is launched with demo-vxlan network selected from the list of available networks. The network provide the communication channel for instance/s in the cloud.


e) Select the security groups to launch the instance in.

For this example. The instance is launched with Default security group selected from the list of available security groups. The security groups are set of restrictive rules defined for the IP space, The selected default security group allows only ssh(22) and HTTPS(443). Openstack allows security groups editing after the instance has started, so additional changes can be made later if the exact requirements are not clearly defined.


f) Select an existing key pair, import a key pair, or generate a new key pair. A key pair allows you to SSH into your newly created instance.


g) Optionally, You can customize your instance after it has launched using the options available here. “Customization Script” is analogous to “User Data” in other systems.


h) Finally, click the Launch button. It will take a few minutes for the instance to start, depending on how large the base image you chose was, and if it was already cached or not on the physical server where the VM will be scheduled to start.


i) Associate a floating/public IP address.

By default, the VM will receive a private IP that is only reachable from inside your virtual network (other VMs connected to the same network). Because public IPv4 addresses are limited and there is an inherent security risk when connecting to the Internet, it is recommended to associate a floating/public IP address only to a single VM and use that one as an access server into your cloud environment.


======How can I access the instance or virtual machine ?======
  • OpenStack dashboard: Use console, double-click on the instance name you want to access and select the console tab. Use the login credential to access your instance if previously created and password authentication method enabled.

 4000


  • ssh into virtual machine: When you started the VM and specified the name of your key pair, its public part was automatically added to the default user’s “~/.ssh/authorized_keys” file, which will allow you SSH access into it.

From your laptop, first change the permissions for the private SSH key, so your SSH client doesn’t complain when you will try to use the key:

  chmod 400 path_to_private_key 
  

Then, using the desired SSH client application, run:

  ssh -i path_to_private_key ubuntu@X.X.X.X  
  

NB The X.X.X.X denotes to the IP address (use public IP allocated to the instance). ubuntu is the default username for ubuntu images and centos for CentOS images

  1. Customize your virtual machine, upgrade the package index and existing packages, and it’s especially important to apply all the security updates available.
/app/dokuwiki/data/attic/guide/cloud.1597832122.txt.gz · Last modified: 2021/12/09 16:42 (external edit)