New Features

• Extensive Telemetry and Monitoring has been added to the Omnia stack, intended for consumption by customers that are using Dell systems and Omnia to provide SaaS/IaaS solutions. These include, but are not limited to:

– CPU Utilization and status

– GPU utilization

– Node Count

– Network Packet I/O

– HDD capacity and free space

– Memory capacity and utilization

– Queued and Running Job Count

– User Count

– Cluster HW Health Checks (PCIE, NVLINK, BMC, Temps)

– Cluster SW Health Checks (dmesg, BeeGFS, k8s nodes/pods, mySQL on control plane)

• Metrics are extracted using a combination of the following: PSUtil, Smartctl, beegfs-ctl, nvidia-smi, rocm-smi.

• Telemetry and health checks can be optionally disabled.

• Log Aggregation via xCAT syslog:

– Aggregated on control plane, grouping default is “severity” with others available.

– Uses Grafani-Loki for viewing.

• Hardware Support: Intel E810 NIC, ConnectX-5/6 NICs.

• Omnia github now hosts a “genesis” image with this functionality baked in for initial bootup.

• Host aliasing for Scheduler and IPA authentication.

• Login and Manager Node access from both public and private NIC.

• Validation check enhancements:

• Rearranged to occur as early as possible.

• Isolate checks when running smaller playbooks.

• Docker Registry Creation.

• Integration of apptainer for containerized HPC benchmark execution.

If you have any feedback about Omnia documentation, please reach out at omnia.readme@dell.com.