MarkBase Admin
ac75faa0cc
CI / build-and-test (push) Has been cancelled
- E4B-MarkBase model (42 layers, 4.4GB) loaded successfully - All Phase 1-6 tests passed (model loading, forward pass, vision/audio towers, token generation, performance) - All stress tests passed (5/5 in 127.6s) - Concurrent inference - Memory stress (67.5 tok/s, 0 NaN) - Continuous generation - Batch processing - Long-running stability - Swift Metal inference engine with multimodal support
2.5 KiB
2.5 KiB
API 參考文檔
端點
GET /health
健康檢查
響應:
{
"status": "healthy",
"model": "markbase-12b",
"layers": 48,
"vocabSize": 262144
}
GET /v1/models
獲取可用模型列表
響應:
{
"data": [
{
"id": "markbase-12b",
"object": "model",
"owned_by": "markbase"
}
]
}
POST /v1/chat/completions
對話生成
請求體:
{
"messages": [
{"role": "user", "content": "Hello"}
],
"max_tokens": 100,
"temperature": 0.7,
"top_p": 0.95,
"top_k": 40,
"stream": false
}
響應 (非流式):
{
"id": "chatcmpl-abc123",
"object": "chat.completion",
"created": 1234567890,
"model": "markbase-12b",
"choices": [
{
"index": 0,
"message": {
"role": "assistant",
"content": "Hello! How can I help you?"
},
"finish_reason": "stop"
}
],
"usage": {
"prompt_tokens": 10,
"completion_tokens": 50,
"total_tokens": 60
}
}
響應 (流式):
data: {"id":"chatcmpl-abc123","object":"chat.completion.chunk",...,"choices":[{"delta":{"role":"assistant"},"finish_reason":null}]}
data: {"id":"chatcmpl-abc123","object":"chat.completion.chunk",...,"choices":[{"delta":{"content":"Hello"},"finish_reason":null}]}
data: [DONE]
POST /v1/completions
文本補全
請求體:
{
"prompt": "Hello, world!",
"max_tokens": 100,
"temperature": 0.7,
"stream": false
}
參數說明
| 參數 | 類型 | 默認 | 說明 |
|---|---|---|---|
messages |
array | - | 對話消息列表 |
prompt |
string | - | 文本提示 |
max_tokens |
int | 100 | 最大生成 token 數 (1-4096) |
temperature |
float | 1.0 | 溫度 (0.0-2.0) |
top_p |
float | - | 核采樣閾值 (0.0-1.0) |
top_k |
int | - | Top-k 采樣 |
stream |
bool | false | 是否流式輸出 |
錯誤格式
{
"error": {
"message": "Invalid request: prompt cannot be empty",
"type": "invalid_request_error",
"code": 400
}
}
多模態格式
圖片
{
"messages": [
{
"role": "user",
"content": [
{"type": "text", "text": "描述這張圖片"},
{"type": "image_url", "image_url": {"url": "data:image/jpeg;base64,..."}}
]
}
]
}
音訊
{
"messages": [
{
"role": "user",
"content": [
{"type": "text", "text": "轉錄這段音訊"},
{"type": "audio_url", "audio_url": {"url": "data:audio/wav;base64,..."}}
]
}
]
}