Architecture overview

Choose the right AI request pattern

Every AI application is different. Choose the request pattern that best fits your use case, then explore how it works with interactive diagrams and side-by-side comparisons.

Detailed Comparison

A side-by-side break down of scaling properties and best use cases for each method.

CapabilityBackend PipelineAsync (Dual-Delivery)Sync
Best forCustomer-facing AI apps with live progressReliable background processingQuick AI requests
User experienceLive progress updatesWait, then receive final resultWait until AI finishes
Backend processingContinues after the responseRuns until completionEnds with the HTTP request
DifficultyMediumMediumEasy
ScalabilityExcellentExcellentLimited by HTTP connections
ReliabilityAutomatic retries & failoverAutomatic retriesDepends on request timeout
Response deliveryWebSocket + WebhookWebSocket + WebhookHTTP response
Typical examplesAI chat, CRM assistant, customer supportReports, document processing, batch jobsClassification, moderation, autocomplete