diff --git a/README.md b/README.md index d049a64..4dbec27 100644 --- a/README.md +++ b/README.md @@ -23,24 +23,6 @@ This lists various services that provide free access or credits towards API-base -GroqDistil Whisper Large v37,200 audio-seconds/minute
2,000 requests/day -Gemma 2 9B Instruct14,400 requests/day
15,000 tokens/minute -Llama 3 70B14,400 requests/day
6,000 tokens/minute -Llama 3 70B - Groq Tool Use Preview14,400 requests/day
15,000 tokens/minute -Llama 3 8B14,400 requests/day
30,000 tokens/minute -Llama 3 8B - Groq Tool Use Preview14,400 requests/day
15,000 tokens/minute -Llama 3.1 70B14,400 requests/day
6,000 tokens/minute -Llama 3.1 8B14,400 requests/day
20,000 tokens/minute -Llama 3.2 11B Vision7,000 requests/day
7,000 tokens/minute -Llama 3.2 1B7,000 requests/day
7,000 tokens/minute -Llama 3.2 3B7,000 requests/day
7,000 tokens/minute -Llama 3.2 90B Vision3,500 requests/day
7,000 tokens/minute -Llama 3.3 70B1,000 requests/day
6,000 tokens/minute -Llama 3.3 70B (Speculative Decoding)1,000 requests/day
6,000 tokens/minute -Llama Guard 3 8B14,400 requests/day
15,000 tokens/minute -Mixtral 8x7B14,400 requests/day
5,000 tokens/minute -Whisper Large v37,200 audio-seconds/minute
2,000 requests/day -Whisper Large v3 Turbo7,200 audio-seconds/minute
2,000 requests/day OpenRouter20 requests/minute
200 requests/dayGemma 2 9B Instruct Llama 3 8B Instruct Llama 3.1 405B Instruct @@ -142,7 +124,56 @@ This lists various services that provide free access or credits towards API-base Llama 3.3 70B 30 requests/minute
60,000 tokens/minute
900 requests/hour
1,000,000 tokens/hour
14,400 requests/day
1,000,000 tokens/day - GitHub ModelsExtremely restrictive input/output token limits.
Rate limits dependent on Copilot subscription tier (Free/Pro/Business/Enterprise)AI21 Jamba 1.5 Large + GroqDistil Whisper Large v37,200 audio-seconds/minute
2,000 requests/day +Gemma 2 9B Instruct14,400 requests/day
15,000 tokens/minute +Llama 3 70B14,400 requests/day
6,000 tokens/minute +Llama 3 70B - Groq Tool Use Preview14,400 requests/day
15,000 tokens/minute +Llama 3 8B14,400 requests/day
30,000 tokens/minute +Llama 3 8B - Groq Tool Use Preview14,400 requests/day
15,000 tokens/minute +Llama 3.1 70B14,400 requests/day
6,000 tokens/minute +Llama 3.1 8B14,400 requests/day
20,000 tokens/minute +Llama 3.2 11B Vision7,000 requests/day
7,000 tokens/minute +Llama 3.2 1B7,000 requests/day
7,000 tokens/minute +Llama 3.2 3B7,000 requests/day
7,000 tokens/minute +Llama 3.2 90B Vision3,500 requests/day
7,000 tokens/minute +Llama 3.3 70B1,000 requests/day
6,000 tokens/minute +Llama 3.3 70B (Speculative Decoding)1,000 requests/day
6,000 tokens/minute +Llama Guard 3 8B14,400 requests/day
15,000 tokens/minute +Mixtral 8x7B14,400 requests/day
5,000 tokens/minute +Whisper Large v37,200 audio-seconds/minute
2,000 requests/day +Whisper Large v3 Turbo7,200 audio-seconds/minute
2,000 requests/day +Scaleway Generative APIs (Free Beta)BGE-Multilingual-Gemma2600 requests/minute
1,000,000 tokens/minute +Llama 3.1 70B Instruct300 requests/minute
100,000 tokens/minute +Llama 3.1 8B Instruct300 requests/minute
100,000 tokens/minute +Mistral Nemo 2407300 requests/minute
100,000 tokens/minute +Pixtral 12B (2409)300 requests/minute
100,000 tokens/minute +Qwen2.5 Coder 32B Instruct +sentence-t5-xxl600 requests/minute
1,000,000 tokens/minute +OVH AI Endpoints (Free Beta)CodeLlama 13B Instruct12 requests/minute +Codestral Mamba 7B v0.112 requests/minute +Llama 2 13B Chat12 requests/minute +Llama 3 70B Instruct12 requests/minute +Llama 3 8B Instruct12 requests/minute +Llama 3.1 70B Instruct12 requests/minute +Mathstral 7B v0.112 requests/minute +Mistral 7B Instruct12 requests/minute +Mistral Nemo 240712 requests/minute +Mixtral 8x22B Instruct12 requests/minute +Mixtral 8x7B Instruct12 requests/minute + + Together + + Llama 3.2 11B Vision Instruct + Free for 2024 + + Cohere + 20 requests/min
1,000 requests/month + Command-R + Shared Limit + + + Command-R+ + GitHub ModelsExtremely restrictive input/output token limits.
Rate limits dependent on Copilot subscription tier (Free/Pro/Business/Enterprise)AI21 Jamba 1.5 Large AI21 Jamba 1.5 Mini Cohere Command R Cohere Command R 08-2024 @@ -181,24 +212,6 @@ This lists various services that provide free access or credits towards API-base Phi-3.5-MoE instruct (128k) Phi-3.5-mini instruct (128k) Phi-3.5-vision instruct (128k) -OVH AI Endpoints (Free Beta)CodeLlama 13B Instruct12 requests/minute -Codestral Mamba 7B v0.112 requests/minute -Llama 2 13B Chat12 requests/minute -Llama 3 70B Instruct12 requests/minute -Llama 3 8B Instruct12 requests/minute -Llama 3.1 70B Instruct12 requests/minute -Mathstral 7B v0.112 requests/minute -Mistral 7B Instruct12 requests/minute -Mistral Nemo 240712 requests/minute -Mixtral 8x22B Instruct12 requests/minute -Mixtral 8x7B Instruct12 requests/minute -Scaleway Generative APIs (Free Beta)BGE-Multilingual-Gemma2600 requests/minute
1,000,000 tokens/minute -Llama 3.1 70B Instruct300 requests/minute
100,000 tokens/minute -Llama 3.1 8B Instruct300 requests/minute
100,000 tokens/minute -Mistral Nemo 2407300 requests/minute
100,000 tokens/minute -Pixtral 12B (2409)300 requests/minute
100,000 tokens/minute -Qwen2.5 Coder 32B Instruct -sentence-t5-xxl600 requests/minute
1,000,000 tokens/minute Cloudflare Workers AI10,000 tokens/dayDeepseek Coder 6.7B Base (AWQ) Deepseek Coder 6.7B Instruct (AWQ) Deepseek Math 7B Instruct @@ -241,19 +254,6 @@ This lists various services that provide free access or credits towards API-base Una Cybertron 7B v2 (BF16) Zephyr 7B Beta (AWQ) - Together - - Llama 3.2 11B Vision Instruct - Free for 2024 - - Cohere - 20 requests/min
1,000 requests/month - Command-R - Shared Limit - - - Command-R+ - Google Cloud Vertex AI Very stringent payment verification for Google Cloud. Llama 3.1 70B Instruct @@ -331,8 +331,7 @@ This lists various services that provide free access or credits towards API-base $0.5 Various open models - Hyperbolic$10DeepSeek V2.5 -DeepSeek V3 + Hyperbolic$10DeepSeek V3 Hermes 3 Llama 3.1 70B Llama 3 70B Instruct Llama 3.1 405B Base @@ -348,7 +347,6 @@ This lists various services that provide free access or credits towards API-base Qwen2-VL 72B Instruct Qwen2-VL 7B Instruct Qwen2.5 72B Instruct -Qwen2.5 Coder 32B Instruct AI21 $10 for 3 months diff --git a/src/pull_available_models.py b/src/pull_available_models.py index ecbf0ee..f3d271d 100644 --- a/src/pull_available_models.py +++ b/src/pull_available_models.py @@ -765,19 +765,6 @@ def main(): """ - for idx, model in enumerate(groq_models): - table += "" - - if idx == 0: - table += f'' - table += 'Groq' - table += "" - table += f'' - - table += f"{model['name']}" - table += f"{get_human_limits(model)}" - table += "\n" - for idx, model in enumerate(openrouter_models): table += "" @@ -888,29 +875,15 @@ def main(): 30 requests/minute
60,000 tokens/minute
900 requests/hour
1,000,000 tokens/hour
14,400 requests/day
1,000,000 tokens/day """ - for idx, model in enumerate(github_models): + for idx, model in enumerate(groq_models): table += "" - table += ( - f'GitHub Models' - if idx == 0 - else "" - ) - table += ( - f'Extremely restrictive input/output token limits.
Rate limits dependent on Copilot subscription tier (Free/Pro/Business/Enterprise)' - if idx == 0 - else "" - ) - table += f"{model['name']}" - table += "" - table += "\n" - for idx, model in enumerate(ovh_models): - table += "" if idx == 0: - table += '' - table += 'OVH AI Endpoints (Free Beta)' + table += f'' + table += 'Groq' table += "" - table += '' + table += f'' + table += f"{model['name']}" table += f"{get_human_limits(model)}" table += "\n" @@ -926,17 +899,15 @@ def main(): table += f"{get_human_limits(model)}" table += "\n" - for idx, model in enumerate(cloudflare_models): + for idx, model in enumerate(ovh_models): table += "" if idx == 0: - table += '' - table += 'Cloudflare Workers AI' - table += "" - table += '' - table += '10,000 tokens/day' + table += '' + table += 'OVH AI Endpoints (Free Beta)' table += "" + table += '' table += f"{model['name']}" - table += "" + table += f"{get_human_limits(model)}" table += "\n" table += """ @@ -955,6 +926,35 @@ def main(): Command-R+ """ + + for idx, model in enumerate(github_models): + table += "" + table += ( + f'GitHub Models' + if idx == 0 + else "" + ) + table += ( + f'Extremely restrictive input/output token limits.
Rate limits dependent on Copilot subscription tier (Free/Pro/Business/Enterprise)' + if idx == 0 + else "" + ) + table += f"{model['name']}" + table += "" + table += "\n" + + for idx, model in enumerate(cloudflare_models): + table += "" + if idx == 0: + table += '' + table += 'Cloudflare Workers AI' + table += "" + table += '' + table += '10,000 tokens/day' + table += "" + table += f"{model['name']}" + table += "" + table += "\n" table += """ Google Cloud Vertex AI