Smartflow 1.20 — Halo released — MCP catalog pinning, cross-tool taint deny, IAL2-fresh agent profile, examiner pack. One sealed audit chain. Read release notes →
Skip to content
Docs
Documentation & Support Portal

Everything you need to
build with Smartflow

Complete guides, API reference, SDK documentation, architecture diagrams, and direct support — all in one place.

Quick Start Platform Overview API Reference
37
Platform Features
4-Phase
Semantic Cache
3
Protocol Support
(LLM · MCP · A2A)
0.97
Similarity threshold
we run (operator-set)
K8s
Helm + cert-manager
Validated
Up and running in minutes
Point any existing SDK at Smartflow — zero code changes required.
Your gateway  ·  yoursmartflow.yourcompany.com
OpenAI SDK
Anthropic SDK
cURL
Python (async)
Helm / K8s
# Any OpenAI SDK client — zero code changes
from openai import OpenAI

client = OpenAI(
    base_url="https://yoursmartflow.yourcompany.com/v1",
    api_key="sk-sf-your-virtual-key"
)

response = client.chat.completions.create(
    model="gpt-4o",          # or "claude-sonnet-4-6", "gemini-2.0-flash"…
    messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)
# Native Anthropic SDK — set ANTHROPIC_BASE_URL, nothing else changes
from anthropic import Anthropic

client = Anthropic(
    base_url="https://yoursmartflow.yourcompany.com/anthropic",
    api_key="sk-sf-your-virtual-key"
)

message = client.messages.create(
    model="claude-sonnet-4-6",
    max_tokens=1024,
    messages=[{"role": "user", "content": "Hello!"}]
)
print(message.content[0].text)
# OpenAI-compatible endpoint
curl https://yoursmartflow.yourcompany.com/v1/chat/completions \
  -H "Authorization: Bearer sk-sf-your-virtual-key" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "claude-sonnet-4-6",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

# Native Anthropic Messages API
curl https://yoursmartflow.yourcompany.com/anthropic/v1/messages \
  -H "x-api-key: sk-sf-your-virtual-key" \
  -H "anthropic-version: 2023-06-01" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "claude-sonnet-4-6",
    "max_tokens": 1024,
    "messages": [{"role": "user", "content": "Hello!"}]
  }'
import asyncio
from smartflow import SmartflowClient

async def main():
    async with SmartflowClient(
        base_url="https://yoursmartflow.yourcompany.com",
        api_key="sk-sf-your-virtual-key"
    ) as sf:
        # Chat completion (OpenAI-compatible)
        reply = await sf.chat("Explain quantum entanglement",
                                model="claude-sonnet-4-6")
        print(reply)

        # Cache stats — see your hit rates
        stats = await sf.get_cache_stats()
        print(f"Cache hit rate: {stats.hit_rate:.1%}")

asyncio.run(main())
# Install the chart from the package you were given
helm upgrade --install smartflow ./smartflow \
  --namespace smartflow --create-namespace \
  --set secrets.openaiApiKey="sk-..." \
  --set secrets.anthropicApiKey="sk-ant-..." \
  --set ingress.host="yoursmartflow.yourcompany.com" \
  --set ingress.tls="true"

# Check rollout
kubectl rollout status deployment/smartflow-proxy -n smartflow
Platform guides & references
Everything from platform overview to deep-dive feature guides.
Human in the loop
A clickable walkthrough. An agent starts a $50,000 wire, and four layers hand it to the person who owns it.
Walkthrough
Platform Overview
Complete technical overview of all Smartflow capabilities — proxy, caching, MCP gateway, A2A orchestration, policy engine, and enterprise identity.
Guide
Feature Matrix
One table of the live dashboard vs Portkey / Prisma AIRS, LiteLLM, Helicone, and Kong. Policies, identity, cache, FinOps, MCP, agents, Shield — and the primary advantages.
Sales · 1.0
Feature Guide & Competitive Map
Sales-facing guide: the top features that matter in each category — sovereignty, identity, audit, compliance, governance, FinOps, routing, cache — with an honest check-box map against the biggest name in each space, cut by LLM / MCP / Agent.
Sales · 1.10
Lowest-cost routing
Most turns don't need the expensive model. How Smartflow and Halo score the prompt, send easy work cheap, keep hard work on frontier, and how to install it.
Smartflow · Halo
Latency
Two pods, HTTPS, all-miss. v1.7.126 holds 80 RPS with a 2.1 s p95. On 25 September that tail was 14 seconds. At 40 RPS the gateway adds about 36 ms.
v1.7.126
audit-verifier
Independent MIT verifier for the tamper-evident audit chain. Download the crate, build it on your machine, run it against the sample chain. Exit 0 means the HMACs and prev_hash links check out.
OSS · MIT
Platform Capabilities
Detailed breakdown of all 37 features — OpenAI & Anthropic drop-ins, 4-phase BERT cache, local models, policy engine, K8s deployment, and more.
Guide
Cache Ecosystem
The three-layer cost reduction strategy: 4-phase MetaCache with VectorLite BERT KNN, in-flight prompt compression, and transparent LLM-side prompt cache injection.
Guide
SSO & Unified Identity
Microsoft Entra ID SSO integration, group sync, App Role mapping to Smartflow roles, and zero-touch team provisioning from directory membership.
Enterprise
Complete endpoint documentation
All proxy, management, compliance, MCP, A2A, and routing endpoints.
View Full API Reference
Smartflow Python SDK
Async and sync clients, type-safe responses, and built-in helpers for compliance, cache stats, and VAS audit logs.
SDK Reference
Full method reference for SmartflowClient and SyncSmartflowClient — chat, completions, Anthropic native, compliance, cache, VAS logs, MCP, A2A, and more.
Reference
Tool-Call Efficiency Guide
Discovery cache for MCP tool schemas, a trajectory cache for whole multi-step call sequences (one-line @smartflow_tool decorator), a reduction benchmark, and a verified compression quality delta.
New in v0.5.0
Install
pip install smartflow-sdk
Python 3.9+ · Async + Sync · v0.5.0
Deployment diagrams
Five reference architectures from single-node on-premises to full enterprise cloud orchestration.
On-Premises Arch 1 Hybrid Cloud Arch 2 Full Cloud Arch 3 Hybrid LLM Routing Arch 4 Enterprise Orchestration Arch 5 All Diagrams Index Index
What's new
Latest · Halo
Smartflow 1.20 — Halo
MCP catalog pinning and rug-pull detection · cross-tool secret→egress taint deny · regulated IAL2-fresh agent profile · examiner pack export over one sealed audit chain. Default-off at the enforcement layer until you turn a knob.
Optimize
Smartflow 1.10 — Optimize
Live FinOps dashboard — spend, budgets, reconciliation, anomaly detection, ROI · adversarial self-test harness · reversible PII tokenization · policy atomizer · agent tool-call efficiency · Python SDK v0.5.0.
Connect
Smartflow 1.9 — Connect
ACL-native Box connector · SharePoint / Microsoft 365 via Graph with Entra on-behalf-of · governed Skills at the router · connector presets · developer onramp with local models.
Sovereign
Smartflow 1.8 — Sovereign
EU AI Act Conformity Console · WORM audit archive · RFC 3161 timestamps · signed AI-BOM · MCP Trust Registry · independent audit verifier · GRC closed loop.
Smartflow 1.7
AI Packaging Platform · Provider Onboarding Wizard · Hybrid Analytics Bridge · Real-time cache metrics · Model-by-model routing performance.
Smartflow 1.6
Any-to-any provider routing · Per-request Trace UI · Prometheus /metrics · OIDC SSO dashboard config.
Smartflow 1.5
Phase 4 VectorLite BERT semantic KNN cache · Kubernetes/Helm production validation · Key store deadlock fix · Async compliance refactor.
Smartflow 1.3 / 1.4
MCP SSE + STDIO · Per-request cache controls · OAuth PKCE · A2A gateway · Entra ID SSO · Guardrail policy groups.
Get help
Multiple channels — from quick self-serve to direct enterprise support.
Email Support
Technical issues, billing, and account questions handled by the engineering team directly.
support@aperion.ai
Bug Reports
Bug reports, feature requests, and SDK issues — send them to the engineering team.
Contact engineering
Integration Tests
Run the full end-to-end test suite against your deployment to validate all services.
Testing guide
Full Documentation
Platform overview, API reference, SDK docs, and architecture guides all available above.
Browse docs