Model Overview

Description:

Code Llama is a large language artificial intelligence (AI) model that generates code and natural language about code built from a collection of models based on Llama 2.

Third-Party Community Consideration:

This model is not owned or developed by NVIDIA. This model has been developed and built to a third-party’s requirements for this application and use case; see Meta's Code Llama Model Card.

Terms of use

By accessing this model, you are agreeing to the LLama 2 Terms and Conditions of the License, Acceptable Use Policy and Meta’s Privacy Policy

References(s):

Code Llama: Open Foundation Models for Code Paper
Meta's Code Llama Model Card

Model Architecture:

Architecture Type: Transformer
Network Architecture: Llama 2
Model Version: 0.1

Input:

Input Format: Text
Input Parameters: Temperature, Top P (Nucleus Sampling); Max Token Input 100k

Output:

Output Format: Text (code)
Output Parameters: Max Output Tokens

Software Integration:

Supported Hardware Platform(s): Hopper, Ampere, Turing
Supported Operating System(s): Linux

Training & Finetuning:

Dataset:

Data Collection Method by dataset: Unknown

Labeling Method by dataset: Not applicable

Near-deduplicated dataset of publicly available code, property of Meta. 8% of samples data are sourced from natural language datasets related to code and contain discussions about code and code snippets included in natural language questions or answers. To help the model retain natural language understanding skills, dataset also inclues a small proportion of batches from a natural language dataset.

Inference:

Engine: Triton
Test Hardware: Other

Ethical Considerations:

NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their supporting model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse. For more detailed information on ethical considerations for this model, please see the Model Card++ Explainability, Bias, Safety & Security, and Privacy Subcards [Insert Link to Model Card++ here]. Please report security vulnerabilities or NVIDIA AI Concerns here.