Agent tool call with content safety and approval

Well-Architected review Agent tool call with content safety and approval · 2026-10-02 · mode full

Coverage audit

• Azure Well-Architected Framework — 5 pillars, 59 recommendations, from the live documentation index, snapshot 2026-10-02 (0 days old).
• Assessed 59 recommendations: 10 with diagram evidence, 49 cannot be determined.
• Evidence sources: architecture diagram (services, boundaries, relationships); cost estimate from the Azure Retail Prices API.
• Corpus read from a committed snapshot of the live documentation index (not re-fetched during this review). Re-read it with `archify-azure wa corpus --refresh`. Statuses reflect what the diagram and spec show. Process, configuration and runtime evidence are not observable here, so those recommendations are 'Cannot Determine' rather than guessed.

Executive summary

This Azure Well-Architected Framework (with the guidance for AI workloads) review of Agent tool call with content safety and approval (standard criticality) assessed the architecture diagram only. 10 of 59 framework recommendations have diagram evidence; the rest are Cannot Determine because process, configuration and runtime evidence is not in the diagram. It found 0 critical, 0 high, 1 medium and 0 low risk. Estimated run cost is $806/month (indicative).

10 of 59 recommendations have diagram evidence (17%); among those, 4 implemented, 4 partial, 2 not implemented. Provisional: scores cover evidenced practices only.

Strengths. Identity service shown; Observability shown; Content safety shown; Model telemetry destination shown; Model inference dominates cost.

Architecture overview

The reviewed architecture is the Diagram tab (7 components, sequence diagram). Hover a finding to highlight the components involved.

Pillar scorecard

Score = 1 + 4 × (implemented + ½ partial) ÷ evidenced recommendations; shown only when ≥ 3 recommendations are evidenced. It reflects evidenced practices, not the whole pillar.

Recommendation ledger 59 recommendations — nothing truncated

Findings

Medium risk (1)

To confirm not drawn, so not counted as gaps

• No threat detection or posture management shown SE:10, SE:01 — Enable Microsoft Defender for Cloud and Microsoft Sentinel, assign Azure Policy initiatives for the baseline, and send activity and diagnostic logs to a central, access-restricted Log Analytics workspace.
• No infrastructure-as-code or CI/CD shown OE:05, OE:11 — Define infrastructure as code (Bicep or Terraform) and deploy through a pipeline with small, reversible changes, environment promotion and automated rollback.
• No CDN / global edge shown for end users PE:03, PE:09 — Serve content and terminate TLS close to users with Azure Front Door or Azure CDN to reduce latency.
• No cost visibility shown CO:03, CO:04, CO:01 — Set Microsoft Cost Management budgets with alert thresholds and enforce cost-allocation tags (Azure Policy) so spend maps to this workload.
• No retrieval / grounding data source shown PE:03, PE:08 — Ground responses in enterprise data (RAG with Azure AI Search or a vector-enabled database) and measure retrieval relevance and latency.
• Single-region model inference RE:05, RE:06 — Plan for throttling and quota limits (retries, queuing, provisioned throughput units) and consider global or data-zone deployments, a second region or a fallback model.
• Model cost controls CO:07, CO:12 — Select the smallest model that meets quality targets; use prompt caching and batch deployments where possible; track cost per request.
• Agents and excessive agency SE:05, SE:08 — Give agents least-privilege managed identities and scoped tools, enforce policy at the tool boundary and add human approval for high-impact actions.

Cross-pillar trade-offs

• Content safety on model traffic Security ↔ Cost Optimization ↔ Performance Efficiency
  Content Safety costs $37.50/month (35% of AI spend) and adds a synchronous screening step to each model call. Resolution: Apply the strictest checks where harm is highest (final responses, PII) and measure per-check value before enabling every check on every call.
• Observability volume Operational Excellence ↔ Cost Optimization
  Log Analytics is $11.50/month in this estimate, mostly log ingestion; richer telemetry improves detection but ingestion is billed per GB. Resolution: Sample verbose traces, set retention per table (Basic logs for high-volume, low-value data) and keep full-fidelity logs for security and audit sources only.

Eisenhower prioritization

Prioritized remediation plan

Next steps

1. Add the missing process, configuration and runtime evidence to turn Cannot Determine practices into assessed ones.
2. Re-run the review after changes, and when the architecture or documentation changes.

Impact × Likelihood matrix from the AWS well-architected-review skill, applied to the Azure Well-Architected Framework (Severe+High = Critical; Severe+Medium/Low or Moderate+High = High; Moderate+Medium/Low or Minor+High = Medium; otherwise Low).