mirror of
https://github.com/tiennm99/DocsGPT.git
synced 2026-10-13 10:15:21 +00:00
Alex
1e14605ee7
- check_usage treats a request through a keyless (draft) agent as agent traffic, matching how its usage rows are bucketed and the headless rule - dashboard edits carry the stored enabled flag instead of re-enabling the policy; disabled policies are labelled in the Quotas tab and the editor - quota 429s send x-should-retry: false so OpenAI SDK clients do not retry a refusal that cannot succeed before the reset - cached-input and cache-write rates for Anthropic, OpenRouter and Groq gpt-oss-120b; refresh OpenRouter deepseek-v3.2 list prices - UsageQuota reuses usagePercent; docs note that a user override needs an existing user
24 lines
882 B
YAML
24 lines
882 B
YAML
provider: groq
|
|
defaults:
|
|
supports_tools: true
|
|
context_window: 131072
|
|
|
|
models:
|
|
- id: openai/gpt-oss-120b
|
|
display_name: GPT-OSS 120B
|
|
description: OpenAI's open-weight 120B flagship served on Groq's LPU hardware; strong general reasoning with strict structured output support
|
|
supports_structured_output: true
|
|
input_cost_per_million: 0.15
|
|
output_cost_per_million: 0.6
|
|
cached_input_cost_per_million: 0.075
|
|
- id: llama-3.3-70b-versatile
|
|
display_name: Llama 3.3 70B Versatile
|
|
description: Meta's Llama 3.3 70B for general-purpose chat with parallel tool use
|
|
input_cost_per_million: 0.59
|
|
output_cost_per_million: 0.79
|
|
- id: llama-3.1-8b-instant
|
|
display_name: Llama 3.1 8B Instant
|
|
description: Small, very low-latency Llama model (~560 tok/s) with parallel tool use
|
|
input_cost_per_million: 0.05
|
|
output_cost_per_million: 0.08
|