Files
llm-automation-docs-and-rem…/.gitea/workflows/build.yml
dnviti 4d2bf99d12 feat: add comprehensive caching to CI/CD pipeline
Optimize Gitea Actions pipeline with multi-layer caching strategy:

**Lint Job:**
- Cache Poetry installation (~/.local) - avoids reinstalling Poetry
- Cache Poetry dependencies (.venv + ~/.cache/pypoetry) - reuses installed packages
- Cache key based on poetry.lock hash for automatic invalidation on dependency changes

**Build Job:**
- Cache Docker Buildx layers (/tmp/.buildx-cache) - speeds up incremental builds
- Dual cache strategy: local filesystem + container registry
- Cache rotation to prevent unlimited growth
- Per-component cache keys for optimal reuse

**Expected Performance:**
- Lint job: ~2-3x faster after first run (skip Poetry + deps installation)
- Build job: ~3-5x faster on incremental builds (reuse Docker layers)
- First run unchanged, subsequent runs significantly faster

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-21 15:13:48 +02:00

130 lines
3.6 KiB
YAML

# Build and Push Docker Images
# Runs on every push to main branch
# 1. Lint: Black, Ruff, MyPy
# 2. Build & Push: Docker images to registry
name: Build
on:
push:
branches: [ main ]
env:
POETRY_VERSION: 1.8.0
PYTHON_VERSION: "3.12"
REGISTRY: ${{ vars.PACKAGES_REGISTRY }}
IMAGE_NAME: ${{ gitea.repository }}
jobs:
lint:
name: Code Quality Checks
runs-on: ubuntu-latest
steps:
- name: Checkout code
uses: actions/checkout@v4
- name: Set up Python
uses: actions/setup-python@v5
with:
python-version: ${{ env.PYTHON_VERSION }}
- name: Cache Poetry installation
uses: actions/cache@v4
with:
path: ~/.local
key: poetry-${{ runner.os }}-${{ env.POETRY_VERSION }}
- name: Install Poetry
run: |
curl -sSL https://install.python-poetry.org | python3 -
echo "$HOME/.local/bin" >> $GITHUB_PATH
- name: Cache Poetry dependencies
uses: actions/cache@v4
with:
path: |
.venv
~/.cache/pypoetry
key: poetry-deps-${{ runner.os }}-${{ env.PYTHON_VERSION }}-${{ hashFiles('**/poetry.lock') }}
restore-keys: |
poetry-deps-${{ runner.os }}-${{ env.PYTHON_VERSION }}-
- name: Install dependencies
run: |
poetry config virtualenvs.in-project true
poetry install --no-root
- name: Run Black
run: poetry run black --check src/ tests/
- name: Run Ruff
run: poetry run ruff check src/ tests/
- name: Run MyPy
run: poetry run mypy src/
build-and-push:
name: Build & Push Docker Images
runs-on: ubuntu-latest
needs: lint
strategy:
matrix:
component: [api, chat, worker, frontend]
steps:
- name: Checkout code
uses: actions/checkout@v4
- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v3
with:
buildkitd-flags: --debug
- name: Cache Docker layers
uses: actions/cache@v4
with:
path: /tmp/.buildx-cache
key: buildx-${{ matrix.component }}-${{ github.sha }}
restore-keys: |
buildx-${{ matrix.component }}-
buildx-
- name: Log in to Container Registry
uses: docker/login-action@v3
with:
registry: ${{ vars.PACKAGES_REGISTRY }}
username: ${{ secrets.USERNAME }}
password: ${{ secrets.TOKEN }}
- name: Extract metadata
id: meta
uses: docker/metadata-action@v5
with:
images: ${{ vars.PACKAGES_REGISTRY }}/${{ env.IMAGE_NAME }}/${{ matrix.component }}
tags: |
type=ref,event=branch
type=sha,prefix={{branch}}-
type=raw,value=latest
- name: Build and push Docker image
uses: docker/build-push-action@v5
with:
context: .
file: deploy/docker/Dockerfile.${{ matrix.component }}
push: true
tags: ${{ steps.meta.outputs.tags }}
labels: ${{ steps.meta.outputs.labels }}
cache-from: |
type=local,src=/tmp/.buildx-cache
type=registry,ref=${{ vars.PACKAGES_REGISTRY }}/${{ env.IMAGE_NAME }}/${{ matrix.component }}:buildcache
cache-to: |
type=local,dest=/tmp/.buildx-cache-new,mode=max
type=registry,ref=${{ vars.PACKAGES_REGISTRY }}/${{ env.IMAGE_NAME }}/${{ matrix.component }}:buildcache,mode=max
- name: Rotate Docker cache
run: |
rm -rf /tmp/.buildx-cache
mv /tmp/.buildx-cache-new /tmp/.buildx-cache || true