Deepgram moves Nova-3 batch speech inference to Trainium2
Deepgram has ported offline Nova-3 speech-to-text inference to AWS Trainium2, running eight replicas on one trn2.3xlarge instance. The company reports 11–70 per cent more audio processed per dollar for its workload and a further 7.5 per cent throughput gain from a Rust runtime. The results depend on static graphs, custom kernels and workload-specific tuning.