Skip to content
Architecture & Orchestration Layer

One Orchestration Layer:
Multi-Agent Orchestration & BYOK

Switchboard bridges your customer communication channels, foundational LLM models, and backend business applications with sub-second latency, deterministic API tools, and full control of your data.

Message flow5 lines · 3 agents
WhatsApp
Instagram
SMS
Email
Web chat
Router
Booking agentBookingCalendar + reminders
Support agentSupportOrders + FAQs
Sales agentSalesCRM + qualifying
WhatsApp · 21:42 · routed to booking"Can I move Thursday's cleaning to next week? Mornings are best."Moved to Wed 8:30· reminder set

Example conversations

Enterprise Architecture & Orchestration

How Switchboard Works:
Every channel, agent, and tool in one place

Switchboard acts as the intelligent orchestration layer between your customer channels, foundational LLM models, and backend business applications.

Input Control

Omnichannel Ingestion & Sub-2s Triage

Single unified gateway across WhatsApp, SMS, email, and web chat. Route every message to specialized vertical agents in under 2 seconds.

Deterministic Execution

Deep API Actions, Not Just Chat

Agents read and write through your systems' APIs, such as Shopify orders and Calendly bookings, with circuit-breaker safety. EHR and practice-management connections start from a workflow template and go live during onboarding.

Enterprise Security

Operator Multi-Tenancy & Data Isolation

Complete tenant data isolation, encrypted credentials at rest, custom tool tokens, and strict zero-model-training guarantees. Patient health data belongs on the BYOC tier.

INBOUND CUSTOMERS·8 OMNICHANNEL INLETS
Live Web ChatWhatsApp & Voice NotesSMS / Two-Way TextEmail InboxesInstagram DMFacebook MessengerTelegramCustom Webhooks & API
Inbound Direct Reply
Switchboard-AIOrchestration CoreActive Sub-Second Routing
Multi-Agent Router
Sub-2s intent triage
Lifecycle Campaigns
Email & SMS drips
Company Brain (RAG)
Entity & insight memory
AI Engine Scenarios
Visual DSL workflows
Deterministic Tools
Two-way read/write APIs
Smart Human Handoff
Context-rich agent handoff
Reasoning Synthesis
FOUNDATION MODELS & CLOUD AIUNIVERSAL RUNTIME
OpenAI(Frontier models)Claude(Frontier models)Gemini(Frontier models)DeepSeek(Open weights)xAI(Frontier models)Bedrock(AWS VPC)Azure OpenAI(Azure cloud)Groq(500 tok/s)Ollama(On-Prem)Qwen(Open weights)Mistral(Open weights)Cohere(Rerank & embed)View all 70+ providers & BYOK →
Tool Call Action Output
DETERMINISTIC INTEGRATION ENGINE (WORKFLOW RUNTIME)DIFY PLUGINS · N8N · WEBHOOKS
Autonomous Integration EngineDeterministic Action RuntimeSelf-Hosted Headless Runtime · n8n Nodes · Bull Queue Mode
Salesforce(CRM)HubSpot(CRM)Zendesk(Support)Intercom(Chat)Shopify(Commerce)Stripe(Billing)QuickBooks(Finance)NetSuite(ERP)Slack(Ops)MS Teams(Ops)Jira(Tickets)Linear(Issues)Notion(Knowledge)Airtable(Bases)PostgreSQL(Database)Snowflake(Warehouse)Twilio(SMS)athenahealth(FHIR template)Motive(Fleet)Explore the connector catalog →
Closed-Loop Circuit:Actions Synced Instantly Back to Channels < 1.8s
Isolated Multi-Tenancy BYOC Option Zero Model Training
Continuous Coverage

Always Available 24/7/365

Eliminate queue wait times and missed after-hours leads. Routine inquiries, order lookups, and scheduling are resolved instantly with zero staff fatigue.

Scalable Infrastructure

High-Throughput Enterprise Scale

Built on event streaming, distributed Redis caching, and resilient queuing. Scale from 100 to 1,000,000 monthly interactions with flat platform pricing—no per-seat penalties.

Measurable Impact

Target Operational ROI

Designed to reach 73% automated first-contact resolution, 40% fewer appointment no-shows, and 3.4x faster responses — modeled targets, not yet measured customer results.

Universal AI Engine Model Runtime

100% Model Agnostic:
Supports All 70+ AI Model Providers & BYOK

Switchboard does not lock you into any single AI lab. Connect your own API keys (BYOK), route dynamically between frontier reasoners and cost-optimized models, or run 100% air-gapped on private infrastructure.

Zero Token Markup & BYOK

Use your existing enterprise contracts with OpenAI, Anthropic, or AWS Bedrock. Zero markup on your model tokens.

Dynamic Multi-Agent Routing

Route complex triage to frontier models from Anthropic or OpenAI, high-volume chat to fast, low-cost models, and audio transcription to Whisper.

Private On-Prem & Open-Source

Host open-weight models on Ollama, Xinference, or any OpenAI-compatible vLLM cluster behind your firewall.

  • OpenAIFrontier ReasoningIndustry-standard multimodal & reasoning intelligence
  • AnthropicExtended ThinkingNuanced instruction following, long context & coding precision
  • Google GeminiMassive 2M ContextSub-second multimodal reasoning and native search grounding
  • DeepSeekOpen ReasoningState-of-the-art open-weights reasoning & MoE architecture
  • xAI (Grok)Real-Time SynthesisTruth-seeking reasoning engine with real-time world knowledge
  • Mistral AIEfficient Open WeightsHigh-performance European frontier models with frontier efficiency
  • Meta LlamaOpen Source BenchmarkUbiquitous open ecosystem foundation hosted on your choice of cloud
  • AWS BedrockAWS Private VPCZero egress fee, fully managed frontier models inside your AWS boundary
  • Azure OpenAIEnterprise SLADedicated Microsoft cloud infrastructure with strict HIPAA/SOC2 compliance
  • Azure AI StudioModel CatalogAccess to Phi-3, Mistral, and open frontier models on Azure compute
  • Google Cloud Vertex AIEnterprise GCPUnified Google Cloud machine learning platform with custom fine-tuning
  • AWS SageMakerCustom EndpointsHost proprietary weights, fine-tuned LoRAs, and private inference clusters
  • Oracle Cloud (OCI)Bare Metal AIHigh-performance cluster infrastructure with dedicated RDMA networking
  • NVIDIA NIMTensorRT-LLMStandardized microservices accelerated by NVIDIA AI Enterprise
  • NVIDIA API CatalogHosted CatalogHosted NVIDIA API catalog endpoints for open and partner models
  • Groq500+ tok/s LPUUltra-fast Language Processing Unit (LPU) silicon for instantaneous triage
  • Together AIServerless SpeedSub-second cold starts with flash-attention cloud cluster inference
  • Fireworks AIUltra Low LatencyCompound AI system serving with sub-100ms time-to-first-token
  • SambaNova SystemsDataflow SN40LFull-precision frontier reasoning at 400+ tokens per second
  • OpenRouterUniversal AggregatorSingle API endpoint routing intelligently to 200+ models with auto-fallback
  • ReplicateCloud ContainersServerless model hosting with pay-per-second hardware provisioning
  • SiliconFlowHigh ConcurrencyCost-optimized serverless inference engine with high token throughput
  • Novita AILow Cost APIScalable serverless GPU cloud optimized for conversational workflows
  • PerfxCloudAccelerated APITurnkey enterprise inference nodes with dedicated bandwidth guarantee
  • RegoloEuropean PrivacyGDPR-compliant European serverless inference cluster
  • CometAPIMulti-Model HubUnified multi-cloud model gateway with automated route failover
  • DeerAPIHigh AvailabilityRedundant cloud API connector with integrated token telemetry
  • AIHubMixGlobal EdgeEdge-distributed inference endpoints with low regional latency
  • GMI CloudNVIDIA H100 FleetSpecialized GPU cloud providing bare-metal compute for generative AI
  • TokenerUnified GatewayOne key for frontier and open-weight models
  • OpenCode GoCoding GatewayGateway tuned for coding and agentic workloads
  • OllamaLocal On-PremisesRun state-of-the-art models entirely on your own workstations or servers
  • XinferenceDistributed XorbitsCluster serving for LLMs, embeddings, and multimodal models on bare metal
  • LocalAIDrop-in OpenAISelf-hosted, air-gapped OpenAI-compatible API without cloud GPU dependencies
  • OpenAI API CompatibleAny vLLM / TGI GatewayConnect ANY proprietary or self-hosted endpoint implementing OpenAI REST spec
  • GPUStackHeterogeneous ClustersManage Apple Silicon, NVIDIA, and AMD GPUs under one private cluster orchestrator
  • Hugging Face HubCommunity WeightsDirect integration to 500,000+ open models, datasets, and serverless inference
  • Hugging Face TEIText Embeddings InferenceLightning-fast HuggingFace container for high-throughput vector extraction
  • Triton Inference ServerNVIDIA ProductionMulti-framework enterprise model serving across CPU and GPU hardware
  • OpenLLMBentoML FrameworkProduction serving framework with one-command containerization and Kubernetes deploy
  • Vessl AIMLOps PlatformHybrid cloud and multi-cloud GPU orchestrator for enterprise pipelines
  • LemonadeEdge AIEmbedded inference designed for local mobile and smart device hardware
  • Alibaba Tongyi (Qwen)Qwen3.7World-class bilingual coding, mathematics, and long-context capabilities
  • Baidu Wenxin (ERNIE)Enterprise ERNIE X1Industry-leading Chinese semantic comprehension, logic, and enterprise search
  • Zhipu AI (GLM)GLM-4 FrontierAdvanced bilingual reasoning, function calling, and multimodal visual reasoning
  • Moonshot AI (Kimi)2M Context WindowPioneering ultra-long context document analysis and deep conversational recall
  • 01.AI (Yi)Yi-LightningHigh-parameter efficiency bilingual models from Kai-Fu Lee's frontier lab
  • Tencent HunyuanEnterprise MoETencent's massive trillion-parameter foundation model integrated with enterprise tools
  • MiniMaxABAB 6.5 & VoiceMoE reasoning foundation paired with real-time expressive speech generation
  • ByteDance VolcengineDoubao LLMHigh-concurrency foundation powering TikTok and enterprise ByteDance ecosystem
  • Volcengine MaaSManaged ServiceManaged enterprise cloud platform for high-throughput model execution
  • StepFunStep-1 / Step-2Next-gen MoE multimodal understanding and step-by-step mathematical reasoning
  • Baichuan AIHealthcare & FinTechHigh-precision vertical model optimized for medical terminology and finance
  • ChatGLMBilingual StandardPioneering open foundation model with extensive tool-calling capabilities
  • ModelScopeAlibaba CommunityAlibaba's premier open-source model community and inference endpoints
  • Gitee AIOpen Source CloudCloud computing and model serverless API for domestic developer ecosystems
  • Huawei Cloud MaaSAscend AI CloudCloud infrastructure native to Huawei Ascend AI accelerators and NPU clusters
  • Huawei Cloud MaaS HKInternational NodeHong Kong availability zone offering global low-latency interconnects
  • UpstageSolar Mini / ProKorean frontier leader renowned for Document AI and high-precision RAG
  • 360 ZhinaoSecurity AICybersecurity-specialized foundation model with robust safety guardrails
  • Ant LingAnt Group FinTechFinancial intelligence and compliance-hardened language engine
  • BytePlusByteDance GlobalInternational enterprise cloud services with Doubao and vision models
  • MimoMultimodal EngineLightweight conversational agent architecture with fast visual reasoning
  • LongcatLong ContextHigh-efficiency context window scaling for legal and academic corpora
  • CohereRerank v4 & EmbedEnterprise search accuracy benchmark with multilingual neural reranking
  • Voyage AICustom EmbeddingsPrecision embeddings tailored for financial filings, legal docs, and source code
  • Jina AI8K Context EmbeddingsLong-sequence embeddings, universal reranking, and web reader APIs
  • Nomic AIMatryoshka VectorsFully reproducible open weights embedding models with flexible dimension truncating
  • Mixedbread.aimxbai EmbeddingsHigh-density dense and binary embeddings optimized for sub-millisecond retrieval
  • Fish AudioZero-Shot TTSUltra-expressive neural text-to-speech with emotion and accent cloning
  • FunASRReal-Time STTEnterprise speech recognition toolkit with voiceprint diarization
  • Tencent Cloud ASRSpeech RecognitionReal-time speech-to-text for voice channels
  • Typesafe AIIntent ClassifierLightweight model specialised for question classification

Need a Private Fine-Tuned or Custom Endpoint?

Connect any model server (vLLM, TGI, SGLang, FastChat, LMDeploy) via the universal OpenAI API compatible bridge.

100% Compatible
Turnkey Deployment Pipeline

From zero to production-grade AI customer operations without extensive engineering.

Live in days, not quarters

01

Connect Channels

5 minutes

Link WhatsApp, SMS, Web Chat, or Email via one-click credentials.

02

Pick or Build Scenarios

Day 1

Select turnkey industry playbooks or generate custom DSLs in natural language.

03

Deploy & Orchestrate

Instant

Live multi-agent routing with full unified inbox fallback for human oversight.

Deployment Topologies

Deploy Where Your Compliance Demands: SaaS, VPC, or BYOC

From turnkey multi-tenant SaaS to 100% air-gapped VPCs in your own AWS/GCP account. Switchboard adapts to your corporate infosec and data residency requirements.

Turnkey SaaS

Multi-Tenant Shared Cloud

Production-ready within 24 hours. Fully managed multi-tenant cluster with tenant-scoped data access and encrypted secrets at rest.

  • Zero infrastructure maintenance
  • Tenant-scoped queries on customer data
  • Managed Twilio & Meta API webhooks
View Platform Pricing
100% Data Residency

Self-Hosted BYOC (Your Cloud)

Deploy the complete Switchboard stack directly into your own AWS or GCP account under your existing cloud security agreements.

  • Customer-managed AWS/GCP account
  • 100% data residency & customer KMS keys
  • Runs under customer's own cloud BAAs
  • Air-gapped VPC inference compatible
Explore BYOC Architecture
Enterprise Risk & Governance

Architected for Regulated Operators: Zero Compromise

Customer operations touch sensitive business data. Switchboard is engineered with strict database isolation, contractual zero-training guarantees, and an enterprise compliance roadmap.

Healthcare & Clinical Architecture

Healthcare Deployments via BYOC

For workloads involving PHI, run Switchboard in your own cloud account so PHI stays under your cloud provider's BAA. Switchboard does not currently sign Business Associate Agreements.

BYOC
Enterprise Governance

Audit Trails & Access Control

Audit trails for every conversation and role-based access control (RBAC). Switchboard does not hold a SOC 2 or ISO 27001 report today; a formal audit is planned but has not started.

No SOC 2 Report Yet
Your data stays yours

Zero Model Training

Customer proprietary business data, knowledge bases, and message payloads are never retained or used to train foundation models across any provider.

Guaranteed Policy
Defense-in-Depth Storage

Tenant-Scoped Data Isolation

Every database query is scoped to your tenant ID and checked by automated isolation tests in CI. Sensitive API keys are encrypted at rest with Fernet.

Production Standard
Technical Specifications

Engineering Primitives: Isolation, Telemetry & Determinism

Engineered from the metal up for mission-critical operations. Tenant data is scoped by company with full audit observability.

Tenant Isolation & Encrypted Secrets

Every query scoped by tenant ID, enforced by CI isolation checks and a least-privilege database role. Credentials encrypted at rest with Fernet. Row-level security: Roadmap.

Tenant Scoping Checked in CI on Backend PRs

Integration Engine

Deterministic tool execution runs via a dedicated headless integration engine in queue mode. Inbound and outbound actions verified with HMAC-SHA256 signatures, Redis atomic deduplication, and circuit-breaker guardrails on every connector call.

Dify plugins · n8n · webhooks

Full-Stack OpenTelemetry Tracing

Distributed trace spans across every message hop. Real-time token consumption metrics, P95 intent latency tracking, and Grafana Faro browser session performance telemetry.

Sub-millisecond spans

Ready to Architect Your Customer Operations?

Schedule a technical architecture deep dive with our engineering team to review multi-agent topologies, CRM integrations, and turnkey playbooks.