observability

Observability

LLM Experiments

LLM Experiments is a observability capability available through Arize Phoenix on Aweb. A/B testing and experimentation for LLM prompts. Access it through a single unified API with automatic failover and intelligent routing.

Try LLM ExperimentsAPI docs

Best for

Highest quality

Arize Phoenix

Premium tier

Most affordable

Arize Phoenix

Economy tier

Contract

Max Latency30000ms

Providers (1)

ProviderScoreQualityPricing
Arize PhoenixDEFAULT
80premiumeconomy

Public discovery and orchestration

Inspect the live capability descriptor directly, then route orchestration through a capability filter. Generic public execute examples are intentionally withheld until the canonical public execute contract is normalized.

cURL

curl "https://aweblabs.ai/api/v2/capabilities/observability.experiments"

TypeScript

import Aweb from '@aweb/sdk';

const client = new Aweb({
  baseUrl: 'https://aweblabs.ai/api/v2',
});

const capability = await client.capabilities.get('observability.experiments');

console.log(capability.data.runtime.providers);

Orchestration pipeline

import Aweb from '@aweb/sdk';

const aweb = new Aweb({ apiKey: process.env.AWEB_API_KEY });

const result = await aweb.orchestrate.run({
  query: 'Use LLM Experiments to help with a hello-world task and summarize the output',
  capabilities: ['observability.experiments'],
  policy: 'balanced',
});

console.log(result.data.status);

Related Observability capabilities

LLM Traces

observability

LLM Evaluations

observability

Error Tracking

observability

Alert Management

observability

AI Guardrails

observability

Getting started →API reference →All providers →All capabilities →