Agentic AI System Design / Reference / Reference

Concept coverage matrix

Every concept in the course, mapped to the module that teaches it.

This matrix answers a practical curriculum question: where is each production concept taught, built, broken, and assessed?

ConceptPrimary moduleAtlas evidence
Agent versus deterministic workflow01Decision memo and autonomy boundary
Bounded autonomy01, 02Allowed actions, step/time/cost limits
Structured decisions02NextAction schema and parser
Agent loop02Application-owned decision loop
Stop conditions02Success, no-progress, budget, escalation
Model gateway02, 13, 14Task/risk routing, versions, fallback
Prompt/version management02, 11, 14Release bundle and trace attributes
Tool schemas03Typed contracts and validation
Tool risk classes03, 10Read/reversible/material/prohibited
User/service/delegated identity03, 10, 14Tool and data authorization
Least privilege03, 10Scoped credentials and capabilities
Side effects03Publication/request tasks
Idempotency03, 07Stable keys and deduplication tests
Acknowledgment gap03, 07Crash after effect before record
Effect reconciliation03, 07, 12Query system of record before retry
Compensation/supersession03, 07Correct or reverse completed effects
Timeout taxonomy03, 07Attempt, total, heartbeat, deadline
Retry classification03, 07, 13Retryable/nonretryable/reconcile/human
Retrieval04Task-aware authorized evidence search
Context assembly04Instructions/state/evidence/tool package
Context/token budgets04, 13Per-step limits and compaction
Reranking04Evidence relevance before context
ACL-aware retrieval04, 10Tenant/user filters before model
Source authority04Registry/policy/source hierarchy
Freshness04, 13Source-specific policy and invalidation
Provenance04Evidence IDs and exact locators
Claim-level citations04, 11Deterministic claim validator
Conflict preservation04Evidence conflict ledger
Instruction/data separation04, 10Untrusted source content
Request-local state05One decision invocation
Run/checkpoint state05, 07Progress, pending work, budgets
Session/thread state05Multi-turn case interaction
Long-term memory05Governed preferences/facts across cases
Memory provenance05Actor/source/scope/time
Memory poisoning05, 10Adversarial retained fact
Memory deletion/expiry05, 10, 14Lifecycle and derived-store deletion
Artifact store05Documents, prompts, packets, test results
State machine06Explicit Atlas case states/transitions
Prompt chaining06Fixed bounded transformations
Routing06, 13Task/risk and workload routes
Parallel fan-out/fan-in06, 13Mandatory source checks
Join policy06Mandatory/optional/timeout/escalate
Orchestrator-worker06Bounded research workers
Evaluator-optimizer06, 11Draft/validation revision loop
Partial results06Incomplete packet and escalation
Durable execution07Multi-day case workflow
Event history07Persisted workflow events
Deterministic replay07Restore without redoing model/effects
Activities/tasks07Model/API/document external work
Timers/signals/callbacks07, 08Document arrival and approval
Heartbeats/checkpoints07Long document extraction
Cancellation07Stop new work and reconcile effects
Workflow versioning07, 14Historical replay tests and safe deploy
Human approval08Durable approve/edit/reject/request-more
Separation of duties08, 10Authorized approver distinct from requester
Approval expiry08Stale proposal cannot execute
Artifact-version binding08Exact draft approved/published
Agents as tools09Bounded specialist result
Handoffs09Responsibility transfer
Supervisor/specialists09Justification by boundary
MCP host/client/server09Read-only capability adapter
MCP security/consent09, 10Capability is not automatic authority
A2A task boundary09Independent review-agent decision record
Prompt injection10Direct and indirect attacks
Excessive agency10Policy and authority matrix
Cross-tenant isolation10, 14API/data/cache/tool/memory/trace tests
Secrets management10, 14No secrets in prompts or model-visible state
Sandbox/code execution10Process/filesystem/network/resource isolation
Output handling10Parameterized/validated downstream use
Audit trail10, 12, 14Actor, version, policy, effect, artifact
Data classification10, 14Capture/access/retention policy
Data residency10, 14Regional tenant data plane
Retention/deletion/legal hold10, 14Data inventory and deletion workflow
Threat modeling10Assets, boundaries, abuse cases, residual risk
Deterministic unit tests11Schemas, policies, reducers, idempotency
Component model evals11Entity/relevance/extraction/synthesis
Tool-selection evals11Required/prohibited tool and arguments
Trajectory/trace evals11Order, loops, policy, budget, recovery
Outcome evals11Evidence-backed analyst packet
Safety/adversarial evals11Injection, isolation, memory, effects
Golden/edge/incident/holdout sets1130-case versioned corpus
Model-judge calibration11Human-labeled agreement set
Release gates11, 14Quality/safety/latency/cost criteria
Run/trace/span/event12End-to-end causal telemetry
GenAI telemetry attributes12Model/prompt/tokens/cache/version
Tool proposal vs execution trace12Proposed/authorized/executed/observed
Metrics/logs/traces/artifacts12Correct signal by question
SLI/SLO/error budget12Valid completion and latency objectives
Zero-tolerance safety gate12Isolation/approval violations
No-progress detector02, 12Repeated signature with no evidence delta
Runaway-cost detector12, 13Soft/hard budget thresholds
Stuck-workflow detector12State-duration and queue-age alert
Incident response12Detect, contain, reconcile, recover, learn
Incident-to-regression loop11, 12Permanent fixture from production failure
Workload model13Cases, peaks, concurrency, tokens, waits
Critical-path latency13Stage budget and parallel source checks
Model routing13Task/risk/capability/eval matrix
Prompt caching13Stable prefix as optimization
Deterministic/result/semantic cache13Scope, freshness, authorization, version
Queue isolation13Interactive/research/extraction/bulk
Admission control13Quotas and safe rejection/defer
Backpressure/load shedding13Protect dependencies and valid work
Retry storm13Backoff, jitter, budgets, breaker
Bulkhead13Per-tool/tenant/workload resource pools
Circuit breaker13Stop failing dependency and probe recovery
Capacity planning13Request and token throughput with headroom
Unit economics13Model/tool/compute/storage/human cost
Graceful degradation13Remove optional work, never weaken invariants
Load/chaos testing13Burst, skew, failures, resumed workflows
Release bundle14Code/workflow/prompt/model/tool/policy/schema
Environment isolation14Dev/test/stage/prod identities and data
Shadow execution14No production effects
Canary/progressive rollout14Risk-stratified live traffic
Feature/authority flags14Trusted capability control and kill switch
Rollback14Code/config/tool/data and in-flight policy
Provider fallback13, 14Task-specific validated matrix
SSO/RBAC/ABAC/workload identity10, 14Enterprise access model
Multi-tenancy/noisy neighbor13, 14Isolation, quotas, fairness
Backup/RPO/RTO/disaster recovery14Restore/failover/reconciliation test
Operational ownership/runbooks12, 14Team, on-call, SLO, escalation
45-minute interview structure15Timed RUNTIME answer
Requirement-to-architecture reasoning00, 15Causal design statements
Tradeoff communication15Choice, cost, mitigation, switch trigger
Failure-first demo16Crash, injection, approval, trace, rollback
Portfolio evidence16Architecture, eval, threat, incident, cost