Chuyển tới nội dung chính

GPU Inventory

Accessing the GPU Inventory Page

Project mode: Scheduler > GPU Inventory

1. Summary Cards

CardMeaning
NodeNumber of GPU nodes
Total GPUTotal physical GPU chips
behaviorNumber of allocated GPUs
Idle occupancyAllocated but unused GPUs
UnallocatedFree/unallocated GPUs
Operating ratePercentage of GPUs in operation with a green progress bar

2. Filter Bar

FilterDescription
CLUSTERCluster dropdown, defaults to "entire" (all)
GPU MODELGPU model dropdown, defaults to "entire"
GPU STATUSGPU status dropdown, defaults to "entire"
TYPEGPU sharing-mode dropdown, defaults to "entire"
Search boxSearches "Node · UUID · Workload Search"

3. Explorer Tab - Left-hand tree

  • "Tree filter…" input above the tree.
  • Hierarchy: Cluster → Node → GPU, e.g. skpc-prod-cluster (11N) → Node-192-168-56-217 (x8) → GPU 0 … GPU 7.
  • Each GPU row shows its model (e.g. "H100 · NVLink")
  • Status indicators: | Color | Meaning | | --- | --- | | 🟢 Green | Healthy / Operating normally | | 🟡 Yellow | Warning condition | | 🔴 Red | Critical issue detected | | ⚪ Gray | Idle, disconnected, or status unavailable |
  • Selecting a GPU in the tree highlights that row (light purple background) and shows its detail on the right.

3.1. Cluster Detail

  • Cluster detail information:
FieldDescription
Cluster NameName of the selected cluster.
NodeTotal number of nodes in the cluster.
GPUTotal number of GPUs in the cluster.
In OperationNumber of GPUs currently running workloads.
IdleNumber of GPUs currently not assigned to workloads.
  • Node List Table
ColumnDescription
NodeNode hostname or identifier.
GPUTotal GPUs available on the node.
Average Operating RateAverage GPU utilization percentage across all GPUs on the node.

3.2. Node Detail

  • Node Detail Information
FieldDescription
Node NameName of the selected node.
ClusterCluster to which the node belongs.
GPUTotal number of GPUs installed on the node.
In OperationNumber of GPUs currently running workloads.
IdleNumber of GPUs currently not assigned to workloads.
ErrorNumber of GPUs currently reporting errors or abnormal conditions.
  • GPU List Table
ColumnDescription
GPUGPU identifier within the node.
ModeGPU operating mode or allocation mode.
SituationCurrent operational status of the GPU.
Operating RateCurrent GPU utilization percentage.
TemperatureCurrent GPU temperature in degrees Celsius.

3.3. GPU Detail

  • Outline Tab:
FieldDescription
GPU IDIdentifier of the selected GPU.
ModelGPU model and interconnect type.
StatusCurrent GPU operational status.
TypeGPU allocation mode.
LocationPhysical location of the GPU within the cluster hierarchy.
  • Characteristic Tab:
FieldDescription
Operating Rate (SM)Current streaming multiprocessor utilization.
MemoryCurrent GPU memory utilization.
TemperatureCurrent GPU temperature.
Electrical EnergyCurrent GPU power consumption.
  • Workload Tab:
ColumnDescription
WorkloadName of the workload currently assigned to the GPU.
ProjectProject associated with the workload.
GrassResource pool, namespace, or execution environment.
SituationCurrent workload status.

4. Topology Tab

The topology view provides a visual representation of all nodes and GPUs within the inventory.

Each node card contains:

FieldDescription
Node NameHostname of the node.
GPU CountNumber of GPUs installed on the node.
GPU BlocksVisual indicators representing individual GPUs.
Status IndicatorColor-coded status of each GPU.
• Green: In Operation (GPU is actively running workloads.)
• Orange: Idle Occupancy (GPU is allocated but currently idle.)
• Gray: Unallocated (GPU is available and not assigned.)
• Red: Uncle (GPU has reached the maximization.)

The GPU Detail panel appears when a user clicks an individual GPU block within the topology view.

FieldDescription
ModelGPU model and interconnect type.
GPU IdentifierUnique GPU identifier.
Allocation TypeGPU allocation mode.
StatusCurrent operating status.
OperatingCurrent GPU utilization
MemoryCurrent memory consumption
Detailed Information
FieldDescription
NodeHost node where the GPU is installed.
IndexGPU index within the node.
GPU PoolGPU resource pool assigned to the workload.
NamespaceKubernetes namespace or project namespace.
WorkloadCurrent workload using the GPU.

5. Inventory Tab

ColumnDescription
NodeHost node containing the GPU.
ModelGPU model and interconnect type.
TypeGPU allocation type.
UUID / IndexGPU index or unique identifier within the node.
SituationCurrent operating status of the GPU.
• Running: GPU is actively executing a workload.
• Idle: GPU is allocated but not currently being utilized.
• UNCLE: GPU is in an abnormal state and requires investigation.
• Error: GPU has reported a failure condition.
Operating RateCurrent GPU utilization percentage.
GrassGPU pool or resource group assigned to the workload.
WorkloadWorkload currently consuming the GPU resource.

The GPU Detail side panel is displayed when a user clicks a GPU row from the Inventory table.

FieldDescription
ModelGPU model and interconnect type.
GPU IdentifierUnique GPU identifier.
Allocation TypeGPU allocation mode.
StatusCurrent GPU state.
Operating RateCurrent GPU utilization percentage.
MemoryCurrent memory consumption versus total capacity.
Detailed Information
FieldDescription
NodeHost node where the GPU is installed.
IndexGPU device index within the node.
TemperatureCurrent GPU temperature.
Electrical EnergyCurrent power consumption.
GPU PoolResource pool assigned to the GPU workload.
NamespaceNamespace or project using the GPU.
WorkloadWorkload currently running on the GPU.