deepseek-recipe/server-rs

server-rs

An Axum API example using the Rust components with mock inference. Requests use DeepSeek V4.1 prompt rendering and OpenCV image preprocessing.

Usage

Install the Rust and OpenCV prerequisites, then run from the repository root:

cargo run -p server-rs --locked

The server listens on 127.0.0.1:7777. Set SERVER_ADDR to change the address.

API

• POST /v1/chat/completions
• POST /v1/responses
• POST /v1/messages

All three protocols support JSON for stream=false and SSE for stream=true.

For example, in a second terminal:

curl http://127.0.0.1:7777/v1/chat/completions \
  -H 'Content-Type: application/json' \
  -d '{"model":"deepseek-flash","messages":[{"role":"user","content":"Hello"}],"stream":false}'

The response contains the mock answer Hello world!. Set "stream":true and add -N to curl to inspect SSE output. No API key or model weights are required.

Deployment scope

This example has no authentication and uses an image fetcher that does not filter private network addresses. Keep it on loopback for local use; see the deployment considerations before exposing it to other users. The Python example uses the same default port.