llm

Large Language Models

Streaming Chat

Streaming Chat is a large language models capability available through Anthropic, OpenAI, Groq and 2 more on Aweb. Real-time streaming text generation. Access it through a single unified API with automatic failover and intelligent routing.

Try Streaming ChatAPI docs

Best for

Highest quality

Anthropic, OpenAI

Premium tier

Most affordable

Groq, Google Gemini

Economy tier

Contract

Max Latency500ms
Streaming RequiredYes

Providers (5)

ProviderScoreQualityPricing
AnthropicDEFAULT
95premiumpremium
OpenAI
85premiumpremium
Groq
95premiumeconomy
Mistral AI
88premiumstandard
Google Gemini
88premiumeconomy

Public discovery and orchestration

Inspect the live capability descriptor directly, then route orchestration through a capability filter. Generic public execute examples are intentionally withheld until the canonical public execute contract is normalized.

cURL

curl "https://aweblabs.ai/api/v2/capabilities/llm.stream"

TypeScript

import Aweb from '@aweb/sdk';

const client = new Aweb({
  baseUrl: 'https://aweblabs.ai/api/v2',
});

const capability = await client.capabilities.get('llm.stream');

console.log(capability.data.runtime.providers);

Orchestration pipeline

import Aweb from '@aweb/sdk';

const aweb = new Aweb({ apiKey: process.env.AWEB_API_KEY });

const result = await aweb.orchestrate.run({
  query: 'Use Streaming Chat to help with a hello-world task and summarize the output',
  capabilities: ['llm.stream'],
  policy: 'balanced',
});

console.log(result.data.status);

Related Large Language Models capabilities

Chat Completion

llm

Vision Analysis

llm

Structured Output

llm

Fast LLM Inference

llm

Code Completion

llm

Getting started →API reference →All providers →All capabilities →