Differences

This shows you the differences between two versions of the page.

--- guide:cloud [2020/06/17 21:23]
lphukungoane [Cloud Resources]
+++ guide:cloud [2025/10/12 12:31] (current)
sfebruary [CHPC Cloud Resources]
@@ Line 1: / Line 1: @@
-======Cloud Resources======
+======CHPC Cloud Resources======
-The **CHPC Cloud System** is a CentOS-based cloud computing infrastructure powered by [[https://www.openstack.org/ | Openstack]] and open source storage software [[https://ceph.io/ | Ceph]]. Openstack provide services like server virtualization, block & object storage systems, software defined networking, an image repository, a web based dashboard and authentication.You can read more about [[https://docs.openstack.org/ussuri/ |Openstack and its various projects]].
+    *[[guide:cloud:overview|Overview]]
+    *[[guide:cloud:start|Getting Started]]
+    *[[guide:cloud|User Guide]]
+       *[[guide:cloud:advanced|IAC (Advanced)]]
+    *[[guide:cloud:practices|Best Practice and Policies]]
+    *[[guide:cloud:glossary|Glossary of Terms]]
+    *[[guide:cloud:faq|FAQs]]
-The **Centre for high performance Computing (CHPC)** hosts an OpenStack cloud with more than **2592** CPU cores and over **4.4PB** of storage, offering resources such as:
-  * **Compute Resource:**  provides you with access to a large set of CPU & RAM and are provisioned on a per Instance basis.
+======How can I use an OpenStack cloud?======
-  * **Storage Resource:** Block & Object storage functionality based on the open source software 'Ceph'. Ceph provides a scalable and highly available storage solution across many commodity servers.
-  * **Networking Resource:** provides 10Gbps Internet connectivity, 10Gbps inter-host and 240Gbps inter-rack network connectivity using Openstack's Software Defined Networking (SDN).
+As an OpenStack cloud end user, you can provision your own resources within the limits set by cloud administrators.
+The examples in this guide show you how to perform tasks by using the following methods:
-^   CPU cores  ^ Memory    ^ Storage   ^Networking(Shared) ^ Object Storage (raw) ^Block Storage ^
+  * **OpenStack dashboard:** Use this web-based graphical interface, code named [[ https://opendev.org/openstack/horizon/ | horizon]], to view, create, and manage resources.
-|  3452        | 78 TB     | 4.4 PB    |  10 Gbps          | 403 TB               | 403 TB       |
-| :::          | :::       | :::       |  :::              |:::                   | :::          |
+  * **OpenStack command-line clients:** Each core OpenStack project has a command-line client that you can use to run simple commands to view, create, and manage resources in a cloud and automate tasks by using scripts.
+----
-**Fees for using the CHPC cloud system**
-The cloud resources are allocated on per project basis, then several instances are provisioned based on the available resources allocated to the project. The billing is calculated by allocation not by percentage of utilization. The current billing fees are calculated as follows:
-  * R0.23 per vCPU hour.
-  * R0.14 per GB hour of vMemory(vRAM).
-  * R0.0017 per GB hour of storage (volumes, images and object storage).
+===== Introduction - Volumes=====
+Openstack volumes are logical block devices that can be attached to a single instance to provide a persistent location for data storage. Unlike a virtual machine's local disk which is destroyed along with the VM, volumes are decoupled from instances so that they may be attached and reattached to different instances. This allows you to create & destroy instances as you see fit while maintaining a persistent store for data.
-The Cloud is now open to a broader community of researchers. Apply today and start using our resources. Request for an account and register a project on our [[https://openstackusers.chpc.ac.za/ |Cloud resource system]].
+**1. Create Volume.**
-Already a Cloud user? Login to the [[https://openstack.chpc.ac.za | Cloud Console]] and get started with running your analysis.
+From the Openstack dashboard, click **Compute > Volumes > Create Volume**, fill out the form by providing a meaningful name, description and size. Once this is done, click **‘Create Volume’**. Your volume will be created and you can move on to the next step, ‘Attach a volume to an instance’.
-----
-======How can I use an OpenStack cloud?======
+{{ :guide:screenshot_2020-08-20_volumes_-_openstack_dashboard_1_.png?direct&900 |}}
-As an OpenStack cloud end user, you can provision your own resources within the limits set by cloud administrators.
+----
-The examples in this guide show you how to perform tasks by using the following methods:
+**2. Attach a volume to an Instance.**
-  * **OpenStack dashboard:** Use this web-based graphical interface, code named [[ https://opendev.org/openstack/horizon/ | horizon]], to view, create, and manage resources.
+From the Openstack dashboard, click **Compute > Volumes** and then on the Actions drop down for the volume you want to attach to an Instance, click **‘Manage Attachments’.**
-  * **OpenStack command-line clients:** Each core OpenStack project has a command-line client that you can use to run simple commands to view, create, and manage resources in a cloud and automate tasks by using scripts.
+{{ :guide:screenshot_2020-08-20_volumes_-_openstack_dashboard_2_.png?direct&900 |}}
-======OpenStack dashboard======
+//From the Manage Volume Attachments form, select the Instance you wish to attach to and click **‘Attach Volume’**. This will dynamically attach the volume as a new logical block device to your instance. Move on to the next section of identifying the block device from within your Instance.//
+----
-As a cloud end user, you can use the OpenStack dashboard to provision your own resources within the limits set by administrators. You can modify the examples provided in this section to create other types and sizes of server instances.
-Access this link [[https://openstack.chpc.ac.za]] in your browser and login using the credentials provided.
+**3. Identify A volume within Instance.**
+SSH into your instance, su to root and run **‘lsblk’**
-{{ :guide:screenshot_2020-06-17_login_-_openstack_dashboard.png?direct&300 |}}
-======OpenStack dashboard — Project tab======
-Projects are organizational units in the cloud and are also known as tenants or accounts. Each user is a member of one or more projects. Within a project, a user creates and manages instances.
+//**‘vda’** is the first disk of your Instance and contains one partition **‘vda1’** which contains the operating system. Any volumes attached to your Instance will be named **‘vdb, vdc, vdd’ & etc**. Identify the new disk by checking the size and comparing that to the size you created in the Openstack dashboard. Now that you have identified the logical block device from within the Instance you can move on to Formatting.//
-From the Project tab, you can view and manage the resources in a selected project, including instances and images. You can select the project from the drop-down menu at the top left. If the cloud supports multi-domain model, you can also select the domain from this menu.
+----
-{{ :guide:screenshot_2020-06-17_instance_overview_-_openstack_dashboard.png?800 |}}
+**4. Formatting the Volume.**
+Prerequisite: Install xfsprogs
+As root: On Ubuntu based systems
+    apt-get install xfsprogs -y
+**Format using xfs**
+We are using **xfs** in this example because it is widely supported and supports extremely large volume sizes (9 exabytes)
+    mkfs.xfs -f /dev/vdc
+----
+**5. Mounting a Volume.**
+Create a directory to mount the volume (example ‘data1’), mount the volume and then verify the mount.
+As root:
+      "mkdir data1
+       mount -t xfs /dev/vdc /data1
+       df -hT /data1"
+----
+**6. Re-attaching the volume to a different Instance.**
+**a) Unmount the volume.**
+As root, use the command **"umount"** to unmount the directory **data1**
+    umount /data1
+//NB Remove or comment out the line added in **/etc/fstab** if applicable.//
+**b) Detach a volume.**
+From the Openstack dashboard, click **Compute > Volumes** and then on the Actions drop down for the volume you want to attach to an Instance, click **‘Manage Attachments’**.
+{{ :guide:screenshot_2020-08-20_volumes_-_openstack_dashboard_3_.png?direct&900 |}}
+From the Manage Volume Attachments form, Click **‘Detach Volume’** for the instance you wish to detach the volume from.
+----
+**7. Re-attach Volume.**
+Follow the steps at the beginning of this guide to attach the volume to a desired instance. **DO NOT Format the volume from the new instance.** Skip that step and go directly to mounting. The volume is now mounted on a different Instance and the data is preserved.
+----
+**8. Extend Volume (Grow)**
+Volumes can also be extended in size. In order to Extend the volume it must be unmounted and detached from an Instance.
+     Note: Volumes cannot have their size reduced.
+{{ :guide:screenshot_2020-08-20_volumes_-_openstack_dashboard_4_.png?direct&900 |}}
+Enter the new size of the volume and click **Extend Volume**.
+Re-attach the volume to your Instance, and remount the volume from within the instance. You will need to grow the xfs filesystem before it will make the new space available.
+As root:
+     xfs_growfs /dev/vdc -d
+For more details, visit the openstack official pages:[[https://docs.openstack.org/mitaka/user-guide/dashboard_manage_volumes.html|Manage Volumes]]
+----
+===== Upload and manage images =====
+A virtual machine image, referred to in this document simply as an image, is a single file that contains a virtual disk that has a bootable operating system installed on it. Images are used to create virtual machine instances within the cloud. For information about creating image files, see the [[https://docs.openstack.org/image-guide/ | OpenStack Virtual Machine Image Guide.]]
+**1. Upload an image**
+Follow this procedure to upload an image to a project:
+   a) Log in to the dashboard.
+   b) Select the appropriate project from the drop down menu at the top left.
+   c) On the Project tab, open the Compute tab and click Images category.
+   d) Click Create Image.
+Then Create An Image dialog box appears
+{{ :guide:screenshot_2020-08-20_images_-_openstack_dashboard.png?direct&900 |}}
+//Select **"Create Image"**, After you have filled all the required information.//
+----
+**How to deploy windows on openstack**
+Windows Image for OpenStack: For most Linux distributions, it is possible to download a generic QCOW2 file for the purposes of running instances in a cloud environment. However, Microsoft does not provide such instances for any Cloud platform other than Azure.
+Since Microsoft Windows is still a major component in many IT infrastructures, there may be a need to run Windows-based instances on OpenStack.
+To upload Windows image, We suggest that you follow this tutorial for [[https://superuser.openstack.org/articles/how-to-deploy-windows-on-openstack/|Preparing windows images]] before uploading to the openstack environment.
+       Note: CHPC does not provide licenses, Appropriate licenses for any software run on the service by
+       users must be sought and applied by the users, including any licenses that may be required to run
+       instance operating systems.
+----
+===== Access and security for instances =====
+    work in progess...!

wiki.chpc.ac.za

User Tools

Site Tools

Differences

Page Tools