TensorTensor offers batch processing of workloads initiated via torchrun (python training scripts) and batch inferrence workloads.