refactor: rename the application package to docsgpt

The backend import package is now docsgpt, the name it will carry on PyPI;
application was far too generic to install into anyone's site-packages.
git mv plus a mechanical rewrite of every import, dotted string and path
reference: 734 Python files, the compose files, Dockerfile, workflows, docs,
setup scripts, devcontainer, k8s manifests, vscode config, pytest and coverage
config, .gitignore. Behaviour is unchanged.

Kept for one release:
- A top-level application package whose meta-path finder resolves
  application.x.y to the already-imported docsgpt.x.y object, so old imports
  and entry points (celery -A application.app.celery,
  uvicorn application.asgi:asgi_app) keep working with a FutureWarning.
- Celery registers every application.* task name as an alias of its
  docsgpt.* task on start-up, so messages queued by the previous release still
  run. The redbeat key prefix moves to redbeat:docsgpt:v2: so schedule entries
  the previous release wrote are left unread instead of firing twice.

The backend image builds from the repository root (docker build -f
docsgpt/Dockerfile .) so it can ship the alias package; a root .dockerignore
allow-lists docsgpt/ and application/ and keeps caches, local data, .env
files, the sample index files and the Dockerfile out. Compose and the image
workflows point at the new context.
This commit is contained in:
Alex committed 2026-09-07 10:20:43 +01:00
1 parent 3e7f1f91b4
commit 574f96341e
984 files changed
+9847 -9682

No files matched your search

+8 -6
View File
@@ -26,7 +26,8 @@ services:
backend:
build:
context: ../application
context: ..
dockerfile: docsgpt/Dockerfile
args:
EXTRAS: ${EXTRAS:-}
INSTALL_DOCLING: ${INSTALL_DOCLING:-false}
@@ -43,9 +44,9 @@ services:
ports:
- "7091:7091"
volumes:
- ../application/indexes:/app/application/indexes
- ../application/inputs:/app/application/inputs
- ../application/vectors:/app/application/vectors
- ../docsgpt/indexes:/app/docsgpt/indexes
- ../docsgpt/inputs:/app/docsgpt/inputs
- ../docsgpt/vectors:/app/docsgpt/vectors
depends_on:
redis:
condition: service_started
@@ -54,7 +55,8 @@ services:
worker:
build:
context: ../application
context: ..
dockerfile: docsgpt/Dockerfile
args:
EXTRAS: ${EXTRAS:-}
INSTALL_DOCLING: ${INSTALL_DOCLING:-false}
@@ -62,7 +64,7 @@ services:
# must set INSTALL_TESSERACT=true before rebuilding (see docker-compose.yaml).
INSTALL_TESSERACT: ${INSTALL_TESSERACT:-false}
# `parsing` queue carries read_document/parse_document; required for its await to resolve.
command: celery -A application.app.celery worker -l INFO -Q docsgpt,parsing,embeddings
command: celery -A docsgpt.app.celery worker -l INFO -Q docsgpt,parsing,embeddings
env_file:
- ../.env
environment:
+7 -7
View File
@@ -44,9 +44,9 @@ services:
ports:
- "7091:7091"
volumes:
- ../application/indexes:/app/indexes
- ../application/inputs:/app/inputs
- ../application/vectors:/app/vectors
- ../docsgpt/indexes:/app/indexes
- ../docsgpt/inputs:/app/inputs
- ../docsgpt/vectors:/app/vectors
depends_on:
redis:
condition: service_started
@@ -58,7 +58,7 @@ services:
user: root
image: arc53/docsgpt:${DOCSGPT_IMAGE_TAG:-develop}${DOCSGPT_IMAGE_VARIANT:-}
# `parsing` queue carries read_document/parse_document; required for its await to resolve.
command: celery -A application.app.celery worker -l INFO -B -Q docsgpt,parsing,embeddings
command: celery -A docsgpt.app.celery worker -l INFO -B -Q docsgpt,parsing,embeddings
env_file:
- ../.env
environment:
@@ -68,9 +68,9 @@ services:
- CACHE_REDIS_URL=redis://redis:6379/2
- POSTGRES_URI=postgresql://docsgpt:docsgpt@postgres:5432/docsgpt
volumes:
- ../application/indexes:/app/indexes
- ../application/inputs:/app/inputs
- ../application/vectors:/app/vectors
- ../docsgpt/indexes:/app/indexes
- ../docsgpt/inputs:/app/inputs
- ../docsgpt/vectors:/app/vectors
depends_on:
redis:
condition: service_started
+1 -1
View File
@@ -82,7 +82,7 @@ services:
user: root
# Consumes the default queue plus `parsing` (read_document) and `embeddings`
# (query embedding); without the latter every search times out.
command: celery -A application.app.celery worker -l INFO -B -Q docsgpt,parsing,embeddings
command: celery -A docsgpt.app.celery worker -l INFO -B -Q docsgpt,parsing,embeddings
env_file:
- path: .env
required: false
+11 -9
View File
@@ -32,7 +32,8 @@ services:
backend:
user: root
build:
context: ../application
context: ..
dockerfile: docsgpt/Dockerfile
args:
# Optional extras to bake in (comma-separated): docling, milvus. The
# docling extra brings the layout-model parser/OCR backend and its
@@ -57,9 +58,9 @@ services:
ports:
- "7091:7091"
volumes:
- ../application/indexes:/app/indexes
- ../application/inputs:/app/inputs
- ../application/vectors:/app/vectors
- ../docsgpt/indexes:/app/indexes
- ../docsgpt/inputs:/app/inputs
- ../docsgpt/vectors:/app/vectors
depends_on:
redis:
condition: service_started
@@ -69,7 +70,8 @@ services:
worker:
user: root
build:
context: ../application
context: ..
dockerfile: docsgpt/Dockerfile
args:
EXTRAS: ${EXTRAS:-}
INSTALL_DOCLING: ${INSTALL_DOCLING:-false}
@@ -80,7 +82,7 @@ services:
# fails after EMBEDDINGS_DELEGATE_TIMEOUT, because EMBEDDINGS_DELEGATE_TO_WORKER
# is on by default. For heavy/OCR parsing run a separate worker with `-Q parsing`;
# to keep query latency off the ingest pool, another with `-Q embeddings`.
command: celery -A application.app.celery worker -l INFO -B -Q docsgpt,parsing,embeddings
command: celery -A docsgpt.app.celery worker -l INFO -B -Q docsgpt,parsing,embeddings
env_file:
- ../.env
environment:
@@ -91,9 +93,9 @@ services:
- CACHE_REDIS_URL=redis://redis:6379/2
- POSTGRES_URI=postgresql://docsgpt:docsgpt@postgres:5432/docsgpt
volumes:
- ../application/indexes:/app/indexes
- ../application/inputs:/app/inputs
- ../application/vectors:/app/vectors
- ../docsgpt/indexes:/app/indexes
- ../docsgpt/inputs:/app/inputs
- ../docsgpt/vectors:/app/vectors
depends_on:
redis:
condition: service_started
@@ -42,7 +42,7 @@ spec:
name: docsgpt-secrets
env:
- name: FLASK_APP
value: "application/app.py"
value: "docsgpt/app.py"
- name: DEPLOYMENT_TYPE
value: "cloud"
- name: POSTGRES_URI
@@ -87,7 +87,7 @@ spec:
image: arc53/docsgpt
# `parsing` queue carries read_document/parse_document; required for its await to resolve.
# For heavy/OCR parsing, run a separate deployment with `-Q parsing` (and GPU env).
command: ["celery", "-A", "application.app.celery", "worker", "-l", "INFO", "-n", "worker.%h", "-Q", "docsgpt,parsing,embeddings"]
command: ["celery", "-A", "docsgpt.app.celery", "worker", "-l", "INFO", "-n", "worker.%h", "-Q", "docsgpt,parsing,embeddings"]
resources:
limits:
memory: "4Gi"
+1 -1
View File
@@ -35,7 +35,7 @@ spec:
name: docsgpt-secrets
env:
- name: FLASK_APP
value: "application/app.py"
value: "docsgpt/app.py"
resources:
limits:
memory: "1Gi"
+3 -3
View File
@@ -190,7 +190,7 @@ Document reading no longer runs in this sandbox. The `read_document` tool and th
workflow native-file extract branch enqueue a `parse_document` Celery task that
parses the document **in the backend** (the `DOC_PARSER_ENGINE` parser — anydoc
by default; Docling only when the optional
`application/requirements-docling.txt` extra is installed) and awaits the
`docsgpt/requirements-docling.txt` extra is installed) and awaits the
result. The task is routed to a
dedicated **`parsing` queue** (`settings.DOCUMENT_PARSE_QUEUE`, default
`"parsing"`) so a parse enqueued from inside a Celery worker (headless/scheduled
@@ -199,7 +199,7 @@ agent) is served by a separate worker and never self-deadlocks the awaiting one.
Run a dedicated parsing worker that consumes the `parsing` queue:
```bash
celery -A application.app.celery worker -Q parsing -l INFO
celery -A docsgpt.app.celery worker -Q parsing -l INFO
```
It takes its own env, so parse-heavy work runs on a separate, optionally larger
@@ -214,7 +214,7 @@ and leaves this worker light.
worker must also consume `parsing`, or the tool's await never resolves:
```bash
celery -A application.app.celery worker -Q docsgpt,parsing,embeddings -l INFO
celery -A docsgpt.app.celery worker -Q docsgpt,parsing,embeddings -l INFO
```
Tuning settings: `DOCUMENT_PARSE_TIMEOUT` (seconds the tool awaits before