DeciLM-7B-Instruct is a state-of-the-art, efficient, and highly accurate 7-billion-parameter language model (LLM), setting new standards in AI text generation.

deciLM-7B-instruct

The maximum number of tokens to generate. Shorter token lengths will provide faster performance.

A decimal number that determines the degree of randomness in the response

An alternative to sampling with temperature, where the model considers the results of the tokens with top_p probability mass.

The top-k parameter limits the model's predictions to the top k most probable tokens at each step of generation.