Transformer Inference Performance Lab
An experimental study of DistilBERT sentiment-classification inference using PyTorch and ONNX Runtime on CPU and NVIDIA TensorRT on an L4 GPU. Examined numerical agreement, latency, and throughput across 12 batch-size and sequence-length configurations, including FP32, INT8, and mixed-FP16 experiments.