Enterprise Agentic Architecture

Managed multi-agent runtime on Cloud Run & Vertex AI with OpenTelemetry tracing and DLP-sanitized RAG feedback

Vertex AI Agent Engine & Sanitized Knowledge Loop animated diagramTop-down architecture diagram; dashed connectors animate in the direction of flow and dots ride the main paths.Chat UI & Presentation Layer (Cloud Run)Managed Agent Runtime (Vertex AI Agent Engine)Specialist Sub-Agent PoolPersistent State & Observability PlaneSanitized Knowledge LoopUpload / FetchRead / Write Session Metadataagent_engines.stream_queryOTel GenAI SpansEnd-of-Turn HookHistorical RetrievalInteractive Chat Web UI/ Google Chat WebhookStateless Flask Gateway(IAP Auth + SSE Streamer)Cloud Storage (MultimodalUploads & User Metadata)Packaged AdkApp RuntimeRoot Orchestrator AgentCode Analysis Specialist(Git Repositories)Schema & Lineage Specialist(Data Dictionaries)WarehouseAnalytics Specialist(Read-Only SQL Engine)Table Inspection Specialist(Profiling & Data Freshness)Project OperationsSpecialist(Issue Tracking REST API)Vertex AI Session Service(Persistent Data Engine)Vertex AI Memory Bank(Cross-Session Recall)OpenTelemetry+ Cloud Trace(Token, Tool & Latency Spans)Cloud Pub/SubCloud DLP (PII Scrubbing)BigQuery SanitizedTranscriptsVertex AI Searchfrontendcloud infradataservicemessage bussecurityrequest in flight

Request & Orchestration Path

  • • UI streams queries through the IAP-authenticated Flask Gateway
  • • Gateway invokes Packaged AdkApp Runtime via agent_engines.stream_query
  • • Root Orchestrator dispatches tasks across 5 specialist sub-agents

State, Memory & Observability

  • • Vertex AI Session Service persists session state & metadata
  • • Vertex AI Memory Bank provides cross-session context recall
  • • AdkApp exports OpenTelemetry GenAI spans to Cloud Trace

Sanitized Knowledge Loop

  • • End-of-turn hook publishes interaction events to Cloud Pub/Sub
  • • Cloud DLP scrubs PII before landing in BigQuery Sanitized Transcripts
  • • Vertex AI Search indexes transcripts for historical retrieval

Vertex AI Agent Engine Architecture