feat: implement automatic ChromaDB indexing and loop-based documentation generation

- Add automatic ChromaDB indexing after documentation generation
- Implement loop-based section generation for individual VM and container documentation
- Fix Celery anti-pattern in generate_proxmox_docs task (removed blocking .get() call)
- Share ChromaDB vector store volume between worker and chat services
- Add documentation management UI to frontend with manual job triggering and log viewing
- Fix frontend Socket.IO connection URL to point to correct chat service port
- Enhance DocumentationAgent.index_documentation() with automatic cleanup of old documents
- Update Proxmox template to generate individual files for each VM and container

This enables the RAG system to properly respond with infrastructure-specific information from the generated documentation.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

deploy/docker/Dockerfile.worker

@@ -39,6 +39,7 @@ RUN pip install --no-cache-dir -r requirements.txt
 # Copy application code and package definition
 COPY src/ /app/src/
 COPY config/ /app/config/
+COPY templates/ /app/templates/
 COPY pyproject.toml README.md /app/
 
 # Install poetry-core (required for install with pyproject.toml)
@@ -59,5 +60,5 @@ RUN useradd -m -u 1000 appuser && \
 
 USER appuser
 
-# Run the Celery worker
-CMD ["celery", "-A", "datacenter_docs.workers.celery_app", "worker", "--loglevel=info", "--concurrency=4"]
+# Run the Celery worker with specific queues
+CMD ["celery", "-A", "datacenter_docs.workers.celery_app", "worker", "--loglevel=info", "--concurrency=4", "-Q", "documentation,auto_remediation,data_collection,maintenance,celery"]

deploy/docker/docker-compose.dev.yml

@@ -58,7 +58,8 @@ services:
       - ../../src:/app/src
       - ../../config:/app/config
       - api-logs:/app/logs
-      - api-output:/app/output
+      - worker-output:/app/output  # Shared with worker for documentation files
+      - /var/run/docker.sock:/var/run/docker.sock:ro  # For accessing worker logs
     depends_on:
       mongodb:
         condition: service_healthy
@@ -82,7 +83,7 @@ services:
     volumes:
       - ../../src:/app/src:z
       - ../../config:/app/config:z
-      - ../../output:/app/output:z  # Documentation files
+      - worker-output:/app/output  # Shared documentation files with worker
       - ../../scripts:/app/scripts:z  # Indexing scripts
       - chat-logs:/app/logs
       - chat-data:/app/data  # Vector store persistence
@@ -109,6 +110,7 @@ services:
       - ../../config:/app/config
       - worker-logs:/app/logs
       - worker-output:/app/output
+      - chat-data:/app/data  # Shared ChromaDB vector store with chat
     depends_on:
       mongodb:
         condition: service_healthy
@@ -163,8 +165,6 @@ volumes:
     name: datacenter-docs-redis-data-dev
   api-logs:
     name: datacenter-docs-api-logs-dev
-  api-output:
-    name: datacenter-docs-api-output-dev
   chat-logs:
     name: datacenter-docs-chat-logs-dev
   chat-data: