AI Platform Monitoring

Dashboards

NVIDIA DCGM Dashboard

GPU Metrics Dashboard

Monitors GPU utilization, temperature, power consumption, memory usage, and overall GPU health across all nodes in the AI platform.

VLLM Dashboard

VLLM Server Dashboard

Tracks VLLM server performance including request throughput, latency metrics, model-specific load, and server resource utilization.