Tutorial on Code Llama

Описание

Code Llama is the newest open-source code generator based on Llama 2. It was released by Meta on August 24, 2023. Code Llama reached state-of-the-art performance among open models on several code benchmarks, surpassing StarCoder. Code Llama - Python 7B outperforms Llama 2 70B on HumanEval and MBPP, and outperforms every other publicly available model on MultiPL-E.

In this tutorial, I will review Code Llama, explain its fine tuning process, and what led to its outstanding performance. I will demonstrate how to run code Llama in a live Python notebook.