mirror of
https://github.com/tiennm99/DocsGPT.git
synced 2026-10-15 18:15:33 +00:00
feat(pricing): per-million model rates and a cost module
Rename the unused *_cost_per_token capability fields to USD per 1M tokens, add prompt-cache read/write rates, and ship list prices for the hosted catalogs. The old per-token keys still load, scaled, with a warning. docsgpt/pricing.py turns a call's token bins into a USD cost. Models with no declared rate cost $0 unless QUOTA_UNPRICED_RATE_PER_MILLION is set.
This commit is contained in:
1 parent
1c1bc2538f
commit
b77561288d
16 files changed
+375
-12
No files matched your search
@@ -1451,6 +1451,23 @@ Type `int`, default `30`, must be `>= 1`.
|
||||
Days guardrail events are kept before the cleanup task removes them.
|
||||
|
||||
|
||||
## Quotas
|
||||
|
||||
Quota window and the treatment of unpriced models.
|
||||
|
||||
### `QUOTA_PERIOD`
|
||||
|
||||
Type `"day" | "week" | "month"`, default `month`.
|
||||
|
||||
Window every usage quota is measured over. Windows are calendar-aligned in UTC: a day starts at 00:00, a week on Monday, a month on the 1st.
|
||||
|
||||
### `QUOTA_UNPRICED_RATE_PER_MILLION`
|
||||
|
||||
Type `list[float]`, default unset.
|
||||
|
||||
Fallback `[input, output]` USD rates per 1M tokens for models that declare no price, e.g. `[0.5, 1.5]`. Unset, such calls are recorded at $0 and only count toward token quotas.
|
||||
|
||||
|
||||
## Scheduler
|
||||
|
||||
Cadence, quotas and timeouts of scheduled runs.
|
||||
|
||||
Reference in new issue
Block a user