Features

• non intruisive Instrumentation

• Validation Layers

• Automatic batch resizing

• Docker

• Hardware

  • ROCm 5.7

  • NVIDIA

  • XPU (OneAPI)

  • HPU (Habana)

• Metrics gathering

  • Performance throughput

  • GPU util

  • CPU util

  • IO util

Benchmarks