CAPSTONE  ·  DAY 2

Ship the Acme AI Support Platform

Eight modules, one deployable product, end to end.

M1 · M2 M3 · M4 M5 · M6 M7 · M8 Acme AI ships on any OCI runtime

Gourav Shah  ·  School of DevOps & AI  ·  Capstone · Day 2

CAP·01

1 · The Platform at a Glance

CAP·02

You're about to assemble the whole platform

One native brain, containerized teams, sealed supply chain.

Host · native Ollama :11434 shared brain Containers Docs Assistant M5 Support Agent M6 Incident Crew M7 ChromaDB ToolHive Supply chain ModelKit M4 SBOM · sign M8 CI ship M8
CAP·03

How the modules connect

Every module maps to one platform capability.

M1 · container-native + host wiring M2 · OpenAI-compatible serving M3 · vLLM CPU serving path M4 · ModelKit, versioned artifact M5 · Docs Assistant, naive RAG M6 · declarative agent + MCP M7 · Incident Crew, multi-agent M8 · SBOM · scan · sign · CI Acme AI Support Platform
CAP·04

2 · Run It End-to-End

CAP·05

Move 1 serves the model

One model, two homes, one shared API.

Ollama · native Metal · unified memory vLLM · container CPU (SmolLM2) or GPU /v1 OpenAI API Every consumer app · agent · crew
CAP·06

Move 2 runs the Incident Crew

Four specialists, one shared model and memory.

Triage Investigate Fix Review ToolHive · MCP ChromaDB · docs one native model serves all four agents
CAP·07

Move 3 packages the ModelKit

Weights, prompt, and config sealed into one artifact.

model weights system prompt quant config ModelKit one OCI artifact kit push Registry GHCR · versioned
CAP·08

Move 4 secures the image

Inventory it, scan it, sign it, sandbox every tool.

SBOM Scan Sign Verify Syft Trivy · Grype Cosign any consumer fail threshold → rejected Sandboxed tool execution ToolHive isolates every MCP tool call
CAP·09

Move 5 ships it through CI

Push to main, the pipeline builds, scans, and ships.

push build scan sign to main image gate cosign GHCR signed failed scan blocks the push, nothing ships
CAP·10

3 · Portability Proof

CAP·11

Move 6 proves it's portable

Swap the runtime, the output stays identical.

Colima Rancher OrbStack Same platform OCI images · Compose Spec host.docker.internal ModelKit · Cosign referrers Identical output
CAP·12

4 · What You Built — and Where to Go Next

CAP·13

The arc you shipped

Naive RAG, then Agentic RAG, then Crew.

Naive RAG Agentic RAG Crew always retrieves routes, then acts decomposes the task simple & predictable ————————→ capable & auditable
CAP·14

YOU SHIPPED IT

You can now ship AI on any runtime

Same architecture, new domain, swap the runbooks.

serve · run · package · secure · ship Acme AI Any runtime

Now open Capstone · Lab.  ·  Gourav Shah · School of DevOps & AI

CAP·15