Quick Installation Guide

Choose a server outside your intended cluster to function as your control plane.

The control plane needs to be internet-capable with Github and a full OS installed.

Note

Omnia can be run on control planes running RHEL, Rocky, and Ubuntu. For a complete list of versions supported, check out the Support Matrix .

For RHEL and Rocky installations:

dnf install git -y

For Ubuntu installations:

apt install git -y

Note

Optionally, if the control plane has an Infiniband NIC installed on RHEL or Rocky, run the below command:

yum groupinstall "Infiniband Support" -y

Once the Omnia repository has been cloned on to the control plane:

git clone https://github.com/dell/omnia.git

Change directory to Omnia using:

cd omnia
./prereq.sh

Run the script prereq.sh to verify the system is ready for Omnia deployment.

Note

The permisssions on the Omnia directory are set to 0755 by default. Do not change these values.

• Running prereq.sh
• Local repositories for the cluster
  • Before you create local repositories
  • Input parameters for Local Repositories
  • Configuring specific local repositories
  • Running local repo
  • Configuring custom repositories
• Installing the provision tool
  • Before you run the provision tool
  • Discovery Mechanisms
    • mapping
    • switch_based
    • BMC
  • Input parameters for the provision tool
  • Provisioning the cluster
    • Optional configurations managed by the provision tool
    • Running the provision tool
      • After successfully running discovery_provision.yml, go to Building Clusters to setup Slurm, Kubernetes, NFS, BeeGFS and Authentication.
  • Checking node status
    • Via CLI
    • Via omniadb
  • Configuring additional NICs on the nodes
• Creating node inventory
• Configuring the cluster
  • Input parameters for the cluster
  • Before you build clusters
  • Building clusters
  • Centralized authentication on the cluster
    • Configuring FreeIPA/LDAP security
      • Create a new user on OpenLDAP
    • Configuring login node security
    • Installing LDAP Client
      • FreeIPA installation on the NFS node
      • Running the security role
      • Setting up Passwordless SSH
  • Granting Kubernetes access
  • BeeGFS bolt on
  • NFS
• Installing AI tools
  • Setup Jupyterhub
  • Setup Kubeflow
  • Setup vLLM
  • Setup PyTorch
  • Setup TensorFlow
  • Setup Kserve
• Adding new nodes
• Re-provisioning the cluster
• Configuring switches
  • Configuring infiniband switches
  • Configuring ethernet switches (S3 and S4 series)
  • Configuring ethernet switches (S5 series)
  • Configuring ethernet switches (Z series)
• Configuring PowerVault
• Running HPC benchmarks on omnia clusters
  • Automate installation oneAPI on Intel processors for MPI jobs
  • Open MPI AOCC HPL benchmark for AMD processors
  • Installing pmix and updating slurm configuration for AMD processors
  • Containerized HPC benchmark execution
• Remove Slurm/K8s configuration from a node
• Soft reset the cluster
• Delete provisioned node
• Uninstalling the provision tool

If you have any feedback about Omnia documentation, please reach out at omnia.readme@dell.com.