Kimi K2 Providers: Groq is serving Kimi K2 at >400 output tokens/s, 40X faster than Moonshot’s first-party API Congratulations to a number of providers to being quick to launch APIs for Kimi K2, including @GroqInc , @basetenco , @togethercompute, @FireworksAI_HQ, @parasail_io, @novita_labs, @DeepInfra, and of course @Kimi_Moonshot. This is impressive considering the size of the model at 1 trillion total parameters. Groq stands out for blazing fast speed. DeepInfra, Novita and Baseten stand out for their pricing, being the only providers pricing similarly to or more cheaply than Moonshot’s first party API. See below for further comparisons between the providers. We’re expecting fast increases in speed across some providers as teams optimize for the K2 model - our numbers below show median speeds over the last 72 hours but we’re already seeing DeepInfra jump up to 62 tokens/s in today’s measurements