Agentic AI System Design / Practice / P07

Healthcare Prior-Authorization Preparation Agent

sensitive dataevidence and policyurgent workflowshuman authority

Advanced · 45 minutes · scenario 7 of 12

INTERVIEW MODE

Run this as a 45-minute design interview

Start the clock, design against the prompt, and take the constraint reveals as they land. The model answer stays hidden until you finish, because reading it first turns practice into recognition.

45:00

Not started

Cover in this order

  1. Outcome and risk
  2. Authority boundaries
  3. Topology
  4. Tools and context
  5. State and durable execution
  6. Security and human review
  7. Evals and SLOs
  8. Scale, cost, and rollout

Timeline

  1. 5m Clarification complete
  2. 8m Requirements and non-goals
  3. 13m First architecture
  4. 25m Core flow and state
  5. 34m Deep dive
  6. 40m Evals and operations
  7. 45m Failures, tradeoffs, close

Scratch architecture

Draw the boxes in words. Saved in this browser only, never uploaded.

Required checks0 / 9
Self-score0 / 40

Score each dimension 0 to 4 against what you actually said out loud, not what you intended to say. A 2 is a competent answer; a 4 is one you could defend to the team that operates it.

Candidate prompt

Design an agent that helps a healthcare provider prepare and track prior-authorization requests. It gathers clinical documentation, checks payer requirements, identifies missing evidence, drafts a submission packet, and monitors status.

Starting assumptions

Fictional design assumptions:

  • 30,000 requests per month across several specialties and payers.
  • Inputs include clinical notes, diagnoses, procedure codes, lab results, imaging reports, and payer policies.
  • Some requests are routine; others are urgent.
  • Payer responses may arrive through APIs, portals, fax, or human calls.
  • The agent does not diagnose, select treatment, or independently attest to medical necessity.
  • Authorized clinical and administrative staff review submissions.

What to clarify

  • Which specialty/procedure and payer are in v1?
  • What is the user outcome: preparation, submission, tracking, appeal support?
  • Who may review and attest?
  • What is the urgent-request SLA?
  • Which source is authoritative for eligibility and payer policy?
  • Which channels permit automated submission?
  • What data-retention, consent, and regional constraints apply?
  • How are clinical-document amendments handled?

Staged constraint reveals

Reveal 1: Payer policy variability

Payer policies differ by plan and change frequently. A policy indexed last week no longer applies to today’s request.

Expected update:

  • resolve payer, plan, procedure, jurisdiction, and effective date before policy retrieval;
  • versioned/effective-dated policy artifacts;
  • freshness and source-authority checks;
  • deterministic checklist/rules where possible;
  • retain policy snapshot and locator used for each requirement;
  • explicit “policy unavailable/ambiguous” state;
  • no unsupported model interpretation as final rule.

Reveal 2: Sensitive context

A note contains unrelated behavioral-health history. The prior-authorization packet only needs orthopedic evidence.

Expected update:

  • purpose-based minimum-necessary context;
  • section/field-level selection and redaction;
  • authorized user and service identity;
  • no broad note copying into prompts or traces;
  • protected artifact references;
  • data-access audit and retention;
  • separate clinical source from generated summary.

Reveal 3: Urgent path

An urgent request must be submitted within 30 minutes, but the document-extraction queue is backed up.

Expected update:

  • risk/urgency classification validated by policy/user;
  • separate priority queue and reserved capacity;
  • deterministic minimum packet path;
  • progress visibility and human takeover;
  • safe partial extraction with explicit gaps;
  • no relaxed identity, evidence, or approval controls;
  • SLO by urgency and queue-age alerts.

Reveal 4: Human attestation

A clinician approves a draft. A later note amendment changes a key clinical fact before submission.

Expected update:

  • approval binds to immutable packet and source versions;
  • source-change event invalidates affected claims/attestation;
  • material-diff detection;
  • re-review required before submission;
  • audit exact evidence and actor;
  • no stale approved artifact silently sent.

Strong answer signals

Product boundary

The system assembles, checks, drafts, routes, and tracks. Clinical judgment, attestation, and treatment decisions stay with authorized professionals. Start with a narrow procedure/payer combination.

Architecture

Text definition of this diagram
flowchart LR
    EHR[EHR / Scheduling] --> IN[Request Intake + Identity]
    IN --> WF[Durable Authorization Workflow]
    WF --> DP[Clinical Document Pipeline]
    WF --> AG[Bounded Preparation Agent]
    AG --> CX[Minimum-Necessary Context]
    AG --> PS[Payer Policy Service]
    AG --> TG[Submission / Status Gateway]
    TG --> PAY[Payer APIs / Portal / Fax Adapter]
    WF --> HR[Authorized Human Review]
    WF --> ART[(Versioned Evidence / Packet)]
    WF --> OBS[Audit / Trace / Evals / SLO]

State

  • patient/request identity and purpose;
  • payer/plan/procedure;
  • urgency and deadline;
  • required-evidence checklist;
  • selected source facts with provenance;
  • missing/conflicting evidence;
  • packet and attestation versions;
  • submission effect/status;
  • callbacks and appeal state;
  • policy/model/workflow versions.

Effects

Submission is an external effect. Use an idempotency/request identity where supported, store payer confirmation IDs, and reconcile after timeouts. Fax/portal channels may require channel-specific deduplication and human review.

Evals

  • policy requirement retrieval;
  • evidence checklist completeness;
  • field/claim support;
  • unnecessary sensitive-data inclusion;
  • urgent SLO adherence;
  • submission duplication;
  • human correction;
  • source-change invalidation;
  • injection/privacy tests;
  • denial reason feedback without treating payer outcome as perfect ground truth.

Failure follow-ups

  1. The payer portal has no API and changes its UI.
  2. Two patients share the same name and birth month.
  3. A payer status callback is delivered three times.
  4. The request is denied for a reason not present in the published policy.
  5. A clinician revokes approval after submission.
  6. An operator needs to debug a trace without seeing the full clinical note.

Scoring emphasis

DimensionWeight
Human/clinical authority20%
Minimum-necessary data and privacy20%
Policy/evidence provenance20%
Durable urgent workflow/effects20%
Evals and audit10%
Scale and operations10%

Model outline

Use a durable request workflow, a purpose-limited clinical context service, versioned payer-policy retrieval, and a bounded preparation agent. Deterministic rules own required checklists where available. Every generated claim links to a selected source fact and policy locator. Human attestation binds to immutable packet/source versions and is invalidated by material change. Submission is idempotent or reconciled. Urgent work has reserved capacity but does not bypass privacy, evidence, or authority controls.

Fill the design canvas for this scenario Open

DESIGN CANVAS

Healthcare Prior-Authorization Preparation Agent

Twelve sections, 72 fields. Everything you type is saved in this browser as you go. Nothing is uploaded, and nobody else can read it.

0 / 72 filled

01 Outcome

Start with the job, not the model. If you cannot name the metric, you cannot design the system.

02 Why agentic?

Agentic is a cost, not a default. Justify the judgment you are buying.

03 Risk and authority

Name what the model may never decide. The risk tier shapes the architecture; it is not a paragraph added at the end.

04 Journey and topology

The simplest topology that satisfies the requirements, plus the conditions that stop it.

05 Tools

Every tool is a contract: typed, scoped, rated for side effect, and idempotent where it touches the world.

06 Context and data

Rank sources by authority and freshness, and keep untrusted content on the far side of a boundary.

07 State, memory, and durability

Say what survives a crash and what must never happen twice.

08 Security and governance

Identity has to reach the data and the tools. Injection controls are architecture, not prompt text.

09 Evals

Measure the trajectory, not only the final text, and name the number that blocks a release.

10 Operations

One quantitative objective per axis, and the person who is paged when it breaks.

11 Rollout

How the change reaches production, and what pulls it back.

12 Open tradeoffs

Three decisions you made knowing what they cost. A design with no tradeoffs is a design nobody stress-tested.