MiniCPM3-4B is the 3rd generation of MiniCPM series. The overall performance of MiniCPM3-4B surpasses Phi-3.5-mini-Instruct and GPT-3.5-Turbo-0125, being comparable with many recent 7B~9B models.

Model is trained and ready for deployment

MiniCPM3-4B

Process an OpenAI-compatible request and send it to the appropriate OpenAI endpoint.

Args:
    msg: JSON string containing the request parameters including 'openai_endpoint'

Returns:
    JSON string containing the response or error

openai_transport

return

Process an OpenAI-compatible request and return a streaming response iterator.
This method is used when stream=True and returns an iterator of strings directly,
without converting to a list or JSON serializing. Supports chat completions and responses endpoints.

Args:
    msg: The request as a JSON string.

Returns:
    Iterator[str]: An iterator yielding text chunks from the streaming response.

openai_stream_transport

prompt

images

audios

videos

chat_history

audio

video

image

tools

tool_choice

The system-level prompt used to define the assistant's behavior.

system_prompt

The maximum number of tokens to generate. Shorter token lengths will provide faster performance.

max_tokens

A decimal number that determines the degree of randomness in the response.

temperature

An alternative to sampling with temperature, where the model considers the results of the tokens with top_p probability mass.

top_p

predict

generate

MiniCPM3-4B is the 3rd generation of MiniCPM series. The overall performance of MiniCPM3-4B surpasses Phi-3.5-mini-Instruct and GPT-3.5-Turbo-0125, being

Run with API