WizardCoder is a Code Large Language Model (LLM) that has been fine-tuned on Llama2 using the Evol-Instruct method and has demonstrated superior performance compared to other open-source and closed LLMs on prominent code generation benchmarks.