Technical Overview

High-level architecture, data flows, and performance profile. Components are modular and provider-agnostic (LLMs, embeddings, storage, and identity).

Web App / DemosSquarespace / Streamlit API ConsumersBroker/Cedent systems API GatewayAuthN/Z, rate limit OrchestratorWorkflows, governance RAG ServiceParsing → chunking → embeddings → vector DBReranker + clause citations Model LayerProvider-agnostic (e.g., via OpenRouter) Policy/GuardrailsSafety, compliance checks ObservabilityLogs, metrics, traces Data Stores Object store (docs) Relational (metadata) Vector DB (semantic) KMS-encrypted keys

Highlights

  • Provider-agnostic model & embedding layer (swap OpenAI/Claude, etc.).
  • RAG with reranking and clause-level citations for explainability.
  • Policy/guardrails enforce safety, masking, and compliance.
  • Data stores are encrypted with KMS; access via least-privilege IAM.
  • Observability: logs/metrics/traces with audit-grade retention.

Data Lifecycle

  1. Ingest: documents & cedent data land in an encrypted object store.
  2. Process: parsing, normalization, chunking; metadata to relational DB.
  3. Index: embeddings to vector DB; private namespace per tenant.
  4. Retrieve: scoped semantic + keyword + rerank.
  5. Generate: LLM answers grounded with clause citations.
  6. Log: prompts, retrievals, and outputs for audit/QA.

Performance & Scale

  • RAG p95 retrieval ≈ ~500 ms at typical corpus sizes
  • Horizontal scale: stateless APIs + autoscaling workers
  • Batch ingestion throughput sized to dataset volume
  • Latency budgets split across retrieval, reasoning, and post-filters

Integration Options

  • REST APIs for ingestion, retrieval, and pricing runs
  • Webhooks for long-running jobs (scenario sims)
  • Service accounts & PATs for CI/CD
  • Export: CSV/JSON, board-ready PDF reports

Environments

  • Dev / Staging / Prod isolation
  • IaC deployments and blue/green releases
  • Feature flags for model/guardrail rollouts

Governance & Explainability

  • Clause-grounded citations and term diffs for pricing/wordings.
  • Decision logs capture inputs, retrievals, and final outputs.
  • Human approvals configurable for underwriting events.
  • Compliance reports mapped to NAIC/Solvency II/IFRS workflows.

Need a deeper technical review?

We’ll walk through the architecture, RAG safeguards, and integration options with your team.

Book a 30-min Call