Hidekazu Hayashida

CUDA Inference Benchmark

The PyTorch/CUDA inference script used for the Ubuntu benchmark is available on GitHub.

• run_pipeline_real_timed.py - inference pipeline with timing measurements

The implementation uses standard PyTorch/torchvision with CUDA. No custom CUDA kernels are used.

Feedback on the CUDA execution or timing methodology is welcome.