Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
|
@@ -7,7 +7,7 @@ sdk: static
|
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
|
| 10 |
-
|
| 11 |
<div class="grid lg:grid-cols-2 gap-x-4 gap-y-7">
|
| 12 |
<p class="lg:col-span-3">
|
| 13 |
Welcome to CARROT-LLM-Routing! For a given desired trade off between performance and cost,
|
|
@@ -31,8 +31,7 @@ Edit this `README.md` markdown file to author your organization card.
|
|
| 31 |
<img alt="" src="logo.png" class="w-40" />
|
| 32 |
</div>
|
| 33 |
<div class="underline">Train CARROT</div>
|
| 34 |
-
>
|
| 35 |
-
|
| 36 |
As is, CARROT supports routing to the following collection of large language models.
|
| 37 |
|
| 38 |
| Model | Input Token Cost ($ per 1M tokens) | Output Token Cost ($ per 1M tokens) |
|
|
@@ -50,5 +49,6 @@ As is, CARROT supports routing to the following collection of large language mod
|
|
| 50 |
| llama-3-3-70b-instruct | 0.9 | 0.9 |
|
| 51 |
| mixtral-8x7b-instruct | 0.6 | 0.6 |
|
| 52 |
| llama-3-405b-instruct | 3.5 | 3.5 |
|
|
|
|
| 53 |
|
| 54 |
|
|
|
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
|
| 10 |
+
|
| 11 |
<div class="grid lg:grid-cols-2 gap-x-4 gap-y-7">
|
| 12 |
<p class="lg:col-span-3">
|
| 13 |
Welcome to CARROT-LLM-Routing! For a given desired trade off between performance and cost,
|
|
|
|
| 31 |
<img alt="" src="logo.png" class="w-40" />
|
| 32 |
</div>
|
| 33 |
<div class="underline">Train CARROT</div>
|
| 34 |
+
<p class="lg:col-span-3">
|
|
|
|
| 35 |
As is, CARROT supports routing to the following collection of large language models.
|
| 36 |
|
| 37 |
| Model | Input Token Cost ($ per 1M tokens) | Output Token Cost ($ per 1M tokens) |
|
|
|
|
| 49 |
| llama-3-3-70b-instruct | 0.9 | 0.9 |
|
| 50 |
| mixtral-8x7b-instruct | 0.6 | 0.6 |
|
| 51 |
| llama-3-405b-instruct | 3.5 | 3.5 |
|
| 52 |
+
</p>
|
| 53 |
|
| 54 |
|