Pg 4 (#2390)

* feat: postgres tests

* feat: mongo cutoff

* feat: mongo cutoff

* feat: adjust docs and compose files

* fix: mini code mongo removals

* fix: tests and k8s mongo stuff

* feat: test fixes

* fix: ruff

* fix: vale

* Potential fix for pull request finding 'CodeQL / Clear-text logging of sensitive information'

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

* fix: mini suggestions

* vale lint fix 2

* fix: codeql columns thing

* fix: test mongo

* fix: tests coverage

* feat: better tests 4

* feat: more tests

* feat: decent coverage

* fix: ruff fixes

* fix: remove mongo mock

* feat: enhance workflow engine and API routes; add document retrieval and source handling

* feat: e2e tests

* fix: mcp, mongo and more

* fix: mini codeql warning

* fix: agent chunk view

* fix: mini issues

* fix: more pg fixes

* feat: postgres prep on start

* feat: qa tests

* fix: mini improvements

* fix: tests

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
Co-authored-by: Siddhant Rai <siddhant.rai.5686@gmail.com>

deployment/k8s/optional-mongo/README.md

@@ -0,0 +1,23 @@
+# Optional: MongoDB manifests
+
+These manifests are **opt-in**. The default DocsGPT install uses Postgres
+for user data (see `deployment/k8s/deployments/postgres-deploy.yaml`).
+
+Apply the manifests in this directory only if you run DocsGPT with the
+MongoDB-backed vector store (`VECTOR_STORE=mongodb`) and need an
+in-cluster MongoDB, or if you are intentionally running on the legacy
+MongoDB user-data store during the Postgres migration window.
+
+Mirrors `deployment/optional/` for compose — not applied by the default
+`kubectl apply -k deployment/k8s/`.
+
+## Usage
+
+```bash
+kubectl apply -f deployment/k8s/optional-mongo/deployments/mongo-deploy.yaml
+kubectl apply -f deployment/k8s/optional-mongo/services/mongo-service.yaml
+```
+
+Then extend `docsgpt-secrets.yaml` with a base64-encoded `MONGO_URI`
+pointing at `mongodb://mongodb-service:27017/docsgpt?retryWrites=true&w=majority`
+(or your Atlas/external URI) before re-applying the secret.

deployment/k8s/optional-mongo/deployments/mongo-deploy.yaml

@@ -0,0 +1,46 @@
+apiVersion: v1
+kind: PersistentVolumeClaim
+metadata:
+  name: mongodb-pvc
+spec:
+  accessModes:
+    - ReadWriteOnce
+  resources:
+    requests:
+      storage: 10Gi  # Adjust size as needed
+
+---
+
+apiVersion: apps/v1
+kind: Deployment
+metadata:
+  name: mongodb
+spec:
+  replicas: 1
+  selector:
+    matchLabels:
+      app: mongodb
+  template:
+    metadata:
+      labels:
+        app: mongodb
+    spec:
+      containers:
+      - name: mongodb
+        image: mongo:latest
+        ports:
+        - containerPort: 27017
+        resources:
+          limits:
+            memory: "1Gi"
+            cpu: "0.5"
+          requests:
+            memory: "512Mi"
+            cpu: "250m"
+        volumeMounts:
+        - name: mongodb-data
+          mountPath: /data/db
+      volumes:
+      - name: mongodb-data
+        persistentVolumeClaim:
+          claimName: mongodb-pvc

deployment/k8s/optional-mongo/services/mongo-service.yaml

@@ -0,0 +1,12 @@
+apiVersion: v1
+kind: Service
+metadata:
+  name: mongodb-service
+spec:
+  selector:
+    app: mongodb
+  ports:
+    - protocol: TCP
+      port: 27017
+      targetPort: 27017
+  type: ClusterIP