WizardCoder is a Code Large Language Model (LLM) that has been fine-tuned on Llama2 excelling in python code generation tasks and has demonstrated superior performance compared to other open-source and closed LLMs on prominent code generation benchmarks.