mirror of
https://github.com/tiennm99/ccs.git
synced 2026-10-13 22:15:33 +00:00
fix(proxy): keep undici timeouts above the upstream request timeout (#1524)
Sets undici headersTimeout/bodyTimeout to request_timeout+30s so the AbortController is the single authority on upstream request lifetime, preventing premature socket closes on slow self-hosted upstreams. Verified undici v5 ProxyAgent object-signature compat.
This commit is contained in:
1 parent
0d856fc0ab
commit
8f9795bce2
5 files changed
+116
-13
No files matched your search
@@ -327,6 +327,14 @@ That flag is respected by both:
|
||||
- CCS now preserves upstream rate-limit errors and retry headers
|
||||
- Empty or malformed provider JSON is returned as Anthropic-style `api_error`
|
||||
|
||||
### Slow upstreams: `socket connection was closed unexpectedly`
|
||||
|
||||
- Long-running upstreams (self-hosted LLMs with queue/prefill phases) can stay
|
||||
silent for minutes before the first or next token. The proxy already allows up
|
||||
to 10 minutes per request; set `CCS_OPENAI_PROXY_REQUEST_TIMEOUT_MS` in the
|
||||
profile settings to raise or lower that ceiling.
|
||||
- Restart the proxy after changing the setting.
|
||||
|
||||
### Requests route to the wrong model/profile
|
||||
|
||||
- Use an explicit selector such as `profile:model`
|
||||
|
||||
Reference in new issue
Block a user