DBRX-Instruct is a state-of-the-art, efficient, open LLM by Databricks, capable of handling input length up to 32K tokens. The model excels at a broad set of natural language tasks such as: text summarization, question-answering, extraction, and coding.
The maximum number of tokens to generate. Shorter token lengths will provide faster performance.
A decimal number that determines the degree of randomness in the response
An alternative to sampling with temperature, where the model considers the results of the tokens with top_p probability mass.
A system prompt sets the behavior and context for an AI assistant in a conversation, such as modifying its personality.
ResetModel loading...
Output
Notes
ID
Model Type ID
Text To Text
Input Type
text
Output Type
text
Description
DBRX-Instruct is a state-of-the-art, efficient, open LLM by Databricks, capable of handling input length up to 32K tokens. The model excels at a broad set of natural language tasks such as: text summarization, question-answering, extraction, and coding.