tiennm99/cheahjs-free-llm-api-resources
1
0 Fork 0
mirror of https://github.com/tiennm99/cheahjs-free-llm-api-resources.git synced 2026-10-14 02:15:35 +00:00
Code Issues Packages Projects Releases Wiki Activity

sambanova: add rate limits

Browse Source
This commit is contained in:
Jun Siang Cheah committed 2024-10-04 23:16:06 +01:00
1 parent cddb37c498
commit 5aa91d17b3
2 files changed
+10 -10
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

README.md
+5 -5
View File
@@ -121,23 +121,23 @@ This lists various services that provide free access or credits towards API-base
<td rowspan="5"><a href="https://cloud.sambanova.ai/" target="_blank">SambaNova Cloud</a></td>
<td rowspan="5"></td>
<td>Llama 3.1 405B</td>
<td></td>
<td>10 requests/minute</td>
</tr>
<tr>
<td>Llama 3.1 70B</td>
<td></td>
<td>20 requests/minute</td>
</tr>
<tr>
<td>Llama 3.1 8B</td>
<td></td>
<td>30 requests/minute</td>
</tr>
<tr>
<td>Llama 3.2 3B</td>
<td></td>
<td>30 requests/minute</td>
</tr>
<tr>
<td>Llama 3.2 1B</td>
<td></td>
<td>30 requests/minute</td>
</tr><tr>
<td rowspan="2"><a href="https://cloud.cerebras.ai/" target="_blank">Cerebras</a></td>
<td rowspan="2">Waitlist<br>Free tier restricted to 8K context</td>
src/pull_available_models.py
+5 -5
View File
@@ -632,23 +632,23 @@ def main():
<td rowspan="5"><a href="https://cloud.sambanova.ai/" target="_blank">SambaNova Cloud</a></td>
<td rowspan="5"></td>
<td>Llama 3.1 405B</td>
<td></td>
<td>10 requests/minute</td>
</tr>
<tr>
<td>Llama 3.1 70B</td>
<td></td>
<td>20 requests/minute</td>
</tr>
<tr>
<td>Llama 3.1 8B</td>
<td></td>
<td>30 requests/minute</td>
</tr>
<tr>
<td>Llama 3.2 3B</td>
<td></td>
<td>30 requests/minute</td>
</tr>
<tr>
<td>Llama 3.2 1B</td>
<td></td>
<td>30 requests/minute</td>
</tr>"""
table += """<tr>