docs: Add Moonshot Kimi public endpoint documentation #730
+296
−1
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,293 @@ | ||
| --- | ||
| title: "Moonshot Kimi" | ||
| sidebarTitle: "Moonshot Kimi" | ||
| description: "Moonshot's Kimi family of models handles advanced reasoning, chat, and coding, with extended thinking and a visible reasoning trace. See model inputs and outputs on Runpod Public Endpoints." | ||
| --- | ||
|
|
||
| Moonshot's Kimi family of models handles advanced reasoning and chat. It supports extended thinking with a visible reasoning trace before the final answer. A single endpoint serves three variants, each selected by setting the `model` field in the request body. | ||
|
|
||
| <Card title="Try in playground" icon="play" href="https://console.runpod.io/hub/playground/text/moonshot-kimi" horizontal> | ||
| Test Moonshot Kimi in the Runpod Hub playground. | ||
| </Card> | ||
|
|
||
| | | | | ||
| |---|---| | ||
| | **Endpoint** | `https://api.runpod.ai/v2/moonshot-kimi/runsync` | | ||
| | **Pricing** | \$4.00–\$15.00 per 1M tokens | | ||
|
Contributor
Author
There was a problem hiding this comment. Confirms overall pricing range $4.00-$15.00 per 1M tokens across the Kimi variant family, as shown in the live Runpod console Hub playground for Moonshot Kimi. Source: https://console.runpod.io/hub/playground/text/moonshot-kimi |
||
| | **Type** | Text generation | | ||
|
|
||
| <Note> | ||
| This endpoint is fully compatible with the OpenAI API. See the [OpenAI compatibility examples](#openai-api-compatibility) below. | ||
| </Note> | ||
|
|
||
| ## Model variants | ||
|
|
||
| Choose a variant by setting the `model` field in the request body (default `kimi-k2.6`). The endpoint slug stays `moonshot-kimi` for every variant. | ||
|
|
||
| | `model` value | Description | Context window | Price | | ||
| |---|---|---|---| | ||
| | `kimi-k2.6` (default) | General-purpose model with thinking and non-thinking modes, agentic capabilities, and multimodal input. | 256K (262,144 tokens) | \$4.00 per 1M tokens | | ||
|
Contributor
Author
There was a problem hiding this comment. Confirms kimi-k2.6 variant details: default model, general-purpose with thinking/non-thinking modes, agentic, multimodal input, 256K (262,144-token) context, $4.00 per 1M tokens; from the live Runpod console Hub playground for Moonshot Kimi. Source: https://console.runpod.io/hub/playground/text/moonshot-kimi |
||
| | `kimi-k2.7-code` | Coding-focused model with thinking mode and agentic capabilities. | 256K (262,144 tokens) | \$4.00 per 1M tokens | | ||
|
Contributor
Author
There was a problem hiding this comment. Confirms kimi-k2.7-code variant details: coding-focused, thinking mode, agentic, 256K (262,144-token) context, $4.00 per 1M tokens; from the live Runpod console Hub playground for Moonshot Kimi. Source: https://console.runpod.io/hub/playground/text/moonshot-kimi |
||
| | `kimi-k3` | Flagship model with always-on reasoning and configurable reasoning effort for long-horizon coding and knowledge work. | 1M (1,048,576 tokens) | \$15.00 per 1M tokens | | ||
|
Contributor
Author
There was a problem hiding this comment. Confirms kimi-k3 variant details: flagship, always-on reasoning with configurable reasoning effort, long-horizon coding/knowledge, 1M (1,048,576-token) context, $15.00 per 1M tokens; from the live Runpod console Hub playground for Moonshot Kimi. Source: https://console.runpod.io/hub/playground/text/moonshot-kimi |
||
|
|
||
| To target a variant other than the default, set the `model` field to its ID. For example, to use the flagship model, set `"model": "kimi-k3"` in the request body (or `model="kimi-k3"` with the OpenAI SDK). | ||
|
|
||
| ## Request | ||
|
|
||
| All parameters are passed within the `input` object in the request body. | ||
|
|
||
| <ParamField body="input.messages" type="array" required> | ||
| Array of message objects with role and content. | ||
| </ParamField> | ||
|
|
||
| <ParamField body="input.messages[].role" type="string" required> | ||
| The role of the message author. Use `system`, `user`, or `assistant`. | ||
| </ParamField> | ||
|
|
||
| <ParamField body="input.messages[].content" type="string" required> | ||
| The content of the message. | ||
| </ParamField> | ||
|
|
||
| <ParamField body="input.model" type="string" default="kimi-k2.6"> | ||
| The Kimi variant to use. One of `kimi-k2.6`, `kimi-k2.7-code`, or `kimi-k3`. | ||
| </ParamField> | ||
|
|
||
| <ParamField body="input.sampling_params.max_tokens" type="integer" default="2048"> | ||
| Maximum number of tokens to generate. | ||
| </ParamField> | ||
|
|
||
| <ParamField body="input.sampling_params.temperature" type="float" default="1"> | ||
| Controls randomness in generation. Lower values make output more deterministic. | ||
| </ParamField> | ||
|
|
||
| <ParamField body="input.sampling_params.seed" type="integer"> | ||
| Seed for reproducible results. | ||
| </ParamField> | ||
|
|
||
| <ParamField body="input.sampling_params.top_k" type="integer"> | ||
| Restricts sampling to the top K most probable tokens. | ||
| </ParamField> | ||
|
|
||
| <ParamField body="input.sampling_params.top_p" type="float"> | ||
| Nucleus sampling threshold. Range: 0.0-1.0. | ||
| </ParamField> | ||
|
|
||
| <RequestExample> | ||
| ```bash cURL | ||
| curl -X POST "https://api.runpod.ai/v2/moonshot-kimi/runsync" \ | ||
| -H "Authorization: Bearer $RUNPOD_API_KEY" \ | ||
| -H "Content-Type: application/json" \ | ||
| -d '{ | ||
| "input": { | ||
| "messages": [ | ||
| { | ||
| "role": "system", | ||
| "content": "You are Kimi." | ||
| }, | ||
| { | ||
| "role": "user", | ||
| "content": "What is Runpod?" | ||
| } | ||
| ], | ||
| "sampling_params": { | ||
| "max_tokens": 2048, | ||
| "temperature": 1 | ||
| }, | ||
| "model": "kimi-k2.6" | ||
| } | ||
| }' | ||
| ``` | ||
|
|
||
| ```python Python | ||
| import requests | ||
|
|
||
| response = requests.post( | ||
| "https://api.runpod.ai/v2/moonshot-kimi/runsync", | ||
| headers={ | ||
| "Authorization": f"Bearer {RUNPOD_API_KEY}", | ||
| "Content-Type": "application/json", | ||
| }, | ||
| json={ | ||
| "input": { | ||
| "messages": [ | ||
| {"role": "system", "content": "You are Kimi."}, | ||
| {"role": "user", "content": "What is Runpod?"}, | ||
| ], | ||
| "sampling_params": { | ||
| "max_tokens": 2048, | ||
| "temperature": 1, | ||
| }, | ||
| "model": "kimi-k2.6", | ||
| } | ||
| }, | ||
| ) | ||
|
|
||
| result = response.json() | ||
| print(result["output"]) | ||
| ``` | ||
|
|
||
| ```javascript JavaScript | ||
| const response = await fetch( | ||
| "https://api.runpod.ai/v2/moonshot-kimi/runsync", | ||
| { | ||
| method: "POST", | ||
| headers: { | ||
| Authorization: `Bearer ${RUNPOD_API_KEY}`, | ||
| "Content-Type": "application/json", | ||
| }, | ||
| body: JSON.stringify({ | ||
| input: { | ||
| messages: [ | ||
| { role: "system", content: "You are Kimi." }, | ||
| { role: "user", content: "What is Runpod?" }, | ||
| ], | ||
| sampling_params: { | ||
| max_tokens: 2048, | ||
| temperature: 1, | ||
| }, | ||
| model: "kimi-k2.6", | ||
| }, | ||
| }), | ||
| } | ||
| ); | ||
|
|
||
| const result = await response.json(); | ||
| console.log(result.output); | ||
| ``` | ||
| </RequestExample> | ||
|
|
||
| ## Response | ||
|
|
||
| <ResponseField name="id" type="string"> | ||
| Unique identifier for the request. | ||
| </ResponseField> | ||
|
|
||
| <ResponseField name="status" type="string"> | ||
| Request status. Returns `COMPLETED` on success, `FAILED` on error. | ||
| </ResponseField> | ||
|
|
||
| <ResponseField name="delayTime" type="integer"> | ||
| Time in milliseconds the request spent in queue before processing began. | ||
| </ResponseField> | ||
|
|
||
| <ResponseField name="executionTime" type="integer"> | ||
| Time in milliseconds the model took to generate the response. | ||
| </ResponseField> | ||
|
|
||
| <ResponseField name="workerId" type="string"> | ||
| Identifier of the worker that processed the request. | ||
| </ResponseField> | ||
|
|
||
| <ResponseField name="output" type="object"> | ||
| The generation result containing the text and usage information. | ||
|
|
||
| <ResponseField name="output.choices" type="array"> | ||
| Array containing the generated text. | ||
| </ResponseField> | ||
|
|
||
| <ResponseField name="output.cost" type="float"> | ||
| Cost of the generation in USD. | ||
| </ResponseField> | ||
|
|
||
| <ResponseField name="output.usage" type="object"> | ||
| Token usage information. | ||
| </ResponseField> | ||
| </ResponseField> | ||
|
|
||
| <ResponseExample> | ||
| ```json 200 | ||
| { | ||
| "id": "sync-a1b2c3d4-e5f6-7890-abcd-ef1234567890-u1", | ||
| "status": "COMPLETED", | ||
| "delayTime": 15, | ||
| "executionTime": 2345, | ||
| "workerId": "oqk7ao1uomckye", | ||
| "output": { | ||
| "choices": [ | ||
| { | ||
| "tokens": [ | ||
| "Runpod is a cloud computing platform that provides GPU resources for AI and machine learning workloads..." | ||
| ] | ||
| } | ||
| ], | ||
| "cost": 0.00074, | ||
| "usage": { | ||
| "input": 35, | ||
| "output": 150 | ||
| } | ||
| } | ||
| } | ||
| ``` | ||
|
|
||
| ```json 400 | ||
| { | ||
| "id": "sync-a1b2c3d4-e5f6-7890-abcd-ef1234567890-u1", | ||
| "status": "FAILED", | ||
| "error": "Invalid messages format" | ||
| } | ||
| ``` | ||
| </ResponseExample> | ||
|
|
||
| ## OpenAI API compatibility | ||
|
|
||
| Moonshot Kimi is fully compatible with the OpenAI API format. You can use the OpenAI Python client to interact with this endpoint. You can set `model` to any of the three variant IDs. | ||
|
|
||
| ```python Python (OpenAI SDK) | ||
| from openai import OpenAI | ||
|
|
||
| client = OpenAI( | ||
|
Contributor
Author
There was a problem hiding this comment. Confirms OpenAI-compatible base_url https://api.runpod.ai/v2/moonshot-kimi/openai/v1 for the Moonshot Kimi Public Endpoint family, verified via the live Runpod console Hub playground. Source: https://console.runpod.io/hub/playground/text/moonshot-kimi |
||
| api_key=RUNPOD_API_KEY, | ||
| base_url="https://api.runpod.ai/v2/moonshot-kimi/openai/v1", | ||
| ) | ||
|
|
||
| response = client.chat.completions.create( | ||
| model="kimi-k2.6", | ||
| messages=[ | ||
| { | ||
| "role": "system", | ||
| "content": "You are Kimi.", | ||
| }, | ||
| { | ||
| "role": "user", | ||
| "content": "What is Runpod?", | ||
| }, | ||
| ], | ||
| max_tokens=2048, | ||
| temperature=1, | ||
| reasoning_effort="max", # set for adding reasoning | ||
| top_p=0.9, | ||
| ) | ||
|
|
||
| print(response.choices[0].message.content) | ||
| ``` | ||
|
|
||
| For streaming responses, add `stream=True`: | ||
|
|
||
| ```python Python (Streaming) | ||
| response = client.chat.completions.create( | ||
| model="kimi-k2.6", | ||
| messages=[ | ||
| {"role": "system", "content": "You are Kimi."}, | ||
| {"role": "user", "content": "Explain quantum computing in simple terms."} | ||
| ], | ||
| max_tokens=2048, | ||
| stream=True, | ||
| ) | ||
|
|
||
| for chunk in response: | ||
| if chunk.choices[0].delta.content: | ||
| print(chunk.choices[0].delta.content, end="") | ||
| ``` | ||
|
|
||
| For more details, see [Send vLLM requests](/serverless/vllm/vllm-requests) and the [OpenAI API compatibility guide](/serverless/vllm/openai-compatibility). | ||
|
|
||
| ## Cost calculation | ||
|
|
||
| Moonshot Kimi uses tiered pricing based on the variant. Kimi K2.6 and Kimi K2.7 Code charge \$4.00 per 1M tokens, while Kimi K3 charges \$15.00 per 1M tokens. Example costs: | ||
|
|
||
| | Tokens | Kimi K2.6 & K2.7 Code (\$4.00/1M) | Kimi K3 (\$15.00/1M) | | ||
| |--------|-----------------------------------|----------------------| | ||
| | 1,000 tokens | \$0.004 | \$0.015 | | ||
| | 10,000 tokens | \$0.04 | \$0.15 | | ||
| | 100,000 tokens | \$0.40 | \$1.50 | | ||
| | 1,000,000 tokens | \$4.00 | \$15.00 | | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Confirms API endpoint URL https://api.runpod.ai/v2/moonshot-kimi/runsync (single slug serves the whole Kimi family; variant selected via model field, not URL) as shown in the live Runpod console Hub playground for Moonshot Kimi.
Source: https://console.runpod.io/hub/playground/text/moonshot-kimi