CodeLlama-70b-Instruct is a state-of-the-art AI model specialized in code generation and understanding based on natural language instructions.

codeLlama-70b-Instruct

The maximum number of tokens to generate. Shorter token lengths will provide faster performance.

A decimal number that determines the degree of randomness in the response

An alternative to sampling with temperature, where the model considers the results of the tokens with top_p probability mass.

The top_k parameter is used to limit the number of choices for the next predicted word or token.

This stores the togetherAI API KEY, and this value will be encrypted. The API won't reveal this value as plain text