| --- |
| license: llama2 |
| --- |
| |
| # LLaMA-PRO-Instruct Model Card |
|
|
| ## Model Description |
| LLaMA-PRO-Instruct is a transformative expansion of the LLaMA2-7B model, now boasting 8.3 billion parameters. It uniquely specializes in programming, coding, and mathematical reasoning, maintaining versatility in general language tasks. |
|
|
| ## Development and Training |
| This model, developed by Tencent ARC team, extends LLaMA2-7B using innovative block expansion techniques. It's meticulously trained on a diverse blend of coding and mathematical data, encompassing over 80 billion tokens. |
|
|
| ## Intended Use |
| LLaMA-PRO-Instruct is ideal for complex NLP challenges, excelling in programming, mathematical reasoning, and general language processing, suitable for both specialized and broad applications. |
|
|
| ## Performance |
| It surpasses its predecessors in the LLaMA series, especially in code domains, demonstrating exceptional competence as a comprehensive language model. |
|
|
| ## Limitations |
| Despite advancements, it may encounter difficulties in highly niche or nuanced tasks. |
|
|
| ## Ethical Considerations |
| Users are advised to consider inherent biases and responsibly manage its application across various fields. |
