Phi-2 is a 2.7 billion-parameter LLM achieving state-of-the-art performance in QA, chat, and code tasks, with a focus on high-quality training data, demonstrating improved behavior in toxicity and bias.




phi-2

The maximum number of tokens to generate. Shorter token lengths will provide faster performance.

A decimal number that determines the degree of randomness in the response

An alternative to sampling with temperature, where the model considers the results of the tokens with top_p probability mass.

The top_k parameter is used to limit the number of choices for the next predicted word or token.

Phi-2 is a 2.7 billion-parameter LLM achieving state-of-the-art performance in QA, chat, and code tasks, with a focus on high-quality training data,