SambaCloud Adds Automatic Prompt Caching for MiniMax M2.7
SambaNova has activated automatic prefix caching on SambaCloud for MiniMax M2.7. Reused prompt prefixes of at least 4,096 tokens can receive a 90 per cent input-token discount, while the company reports a median 6.1-times improvement in time to first token across its tests.