NVIDIA and Jane Street tune Mamba-2 with CUDA Tile
NVIDIA and Jane Street engineers have implemented three Mamba-2 forward-pass kernels with CUDA Tile, the Python programming model built around tile-level GPU operations. Their work uses Tensor Cores, TMA-friendly layouts, latency hints and autotuning to improve performance while keeping kernel code more composable. Backward-pass optimisation remains future work.