GPT-4o is a multimodal AI model that excels in processing and generating text, audio, and images, offering rapid response times and improved performance across languages and tasks, while incorporating advanced safety features

Model is trained and ready for deployment

gpt-4o

Process an OpenAI-compatible request and send it to the appropriate OpenAI endpoint.

Args:
    msg: JSON string containing the request parameters including 'openai_endpoint'

Returns:
    JSON string containing the response or error

openai_transport

return

Process an OpenAI-compatible request and return a streaming response iterator.
This method is used when stream=True and returns an iterator of strings directly,
without converting to a list or JSON serializing. Supports chat completions and responses endpoints.

Args:
    msg: The request as a JSON string.

Returns:
    Iterator[str]: An iterator yielding text chunks from the streaming response.

openai_stream_transport

This method is used to predict the output of the model using the OpenAI gpt-4o model with streaming = False.

prompt

image

images

tools

tool_choice

chat_history

An upper bound for the number of tokens that can be generated for a completion.

max_tokens

A decimal number that determines the degree of randomness in the response

temperature

An alternative to sampling with temperature, where the model considers the results of the tokens with top_p probability mass.

top_p

predict

This method is used to generate the output of the model using the OpenAI gpt-4o model with streaming support.

generate

The single model method to get the OpenAI-compatible request and send it to the OpenAI server
then return its response.

Args:
    msg: JSON string containing the request parameters

Returns:
    JSON string containing the response or error

Process an OpenAI-compatible request and return a streaming response iterator.
This method is used when stream=True and returns an iterator of strings directly,
without converting to a list or JSON serializing.

Args:
    msg: The request as a JSON string.

Returns:
    Iterator[str]: An iterator yielding text chunks from the streaming response.

GPT-4o is a multimodal AI model that excels in processing and generating text, audio, and images, offering rapid response times and improved performance across

Run with API