RAG chat assistant on Vertex AI

RAG chat assistant on Vertex AI RAG chat assistant on Vertex AI Authenticated API → orchestrator on Cloud Run → Model Armor-screened Gemini call grounded by AlloyDB vector search, with request-response logging Google Cloud Project: assistant-prod Region us-central1 Vertex AI 2. Apigee → Orchestrator2 safe prompt 4. Model Armor → Gemini on Vertex AI (safe prompt)4 sign in embeddings sink HTTPS 1. Users → Apigee (HTTPS)1 screen 3. Orchestrator → Model Armor (screen)3 vector search 5. Orchestrator → AlloyDB (vector search)5 logging Users (Users) Users Identity Platform (Identity Platform) Identity Platform sign-in, JWT Apigee (Apigee API Platform) Apigee auth, quotas, AI gateway Orchestrator (Cloud Run) Orchestrator Cloud Run Model Armor (Data Loss Prevention API) Model Armor prompt and response screening, DLP Gemini on Vertex AI (Vertex AI) Gemini on Vertex AI generation AlloyDB (AlloyDB) AlloyDB pgvector index, policy documents Cloud Storage (Cloud Storage) Cloud Storage source documents Cloud Logging (Cloud Logging) Cloud Logging request-response logs BigQuery (BigQuery) BigQuery prompt log analysis Cloud Monitoring (Cloud Monitoring) Cloud Monitoring latency, errors, quota

Flow

  1. 1Users → Apigee (HTTPS)
  2. 2Apigee → Orchestrator
  3. 3Orchestrator → Model Armor (screen)
  4. 4Model Armor → Gemini on Vertex AI (safe prompt)
  5. 5Orchestrator → AlloyDB (vector search)