elizaos--eliza
426e9eeabd
Voice Workbench / headless workbench (mocked backends) (push) Has been cancelled
Voice Workbench / real acoustic lane (nightly, provisioned only) (push) Has been cancelled
ci / test (push) Has been cancelled
ci / lint-and-format (push) Has been cancelled
ci / build (push) Has been cancelled
ci / dev-startup (push) Has been cancelled
gitleaks / gitleaks (push) Has been cancelled
Markdown Links / Relative Markdown Links (push) Has been cancelled
Quality (Extended) / Homepage Build (PR smoke) (push) Has been cancelled
Quality (Extended) / Comment-only diff guard (push) Has been cancelled
Quality (Extended) / Format + Type Safety Ratchet (push) Has been cancelled
Quality (Extended) / Develop Gate (secret scan + UI determinism) (push) Has been cancelled
Quality (Extended) / Develop Gate (lint) (push) Has been cancelled
Chat shell gestures / Chat shell gesture + parity e2e (push) Has been cancelled
Cloud Gateway Discord / Test (push) Has been cancelled
Benchmark Bridge Tests / benchmark (bunx @biomejs/biome check packages/lifeops-bench/src, benchmark-lint) (push) Has been cancelled
Benchmark Bridge Tests / benchmark (bunx vitest run --config packages/lifeops-bench/vitest.config.ts --root packages/lifeops-bench --passWithNoTests, benchmark-tests) (push) Has been cancelled
Build Agent Image / build-and-push (push) Has been cancelled
Dev Smoke / bun run dev onboarding chat (push) Has been cancelled
Dev Smoke / Vite HMR dependency-level smoke (push) Has been cancelled
Electrobun Submodule Guard / electrobun gitlink is fetchable (push) Has been cancelled
Publish @elizaos/example-code / check_npm (push) Has been cancelled
Publish @elizaos/example-code / publish_npm (push) Has been cancelled
Publish @elizaos/plugin-elizacloud / verify_version (push) Has been cancelled
Publish @elizaos/plugin-elizacloud / publish_npm (push) Has been cancelled
Sandbox Live Smoke / Sandbox live smoke (push) Has been cancelled
Snap Build & Test / Build Snap (amd64) (push) Has been cancelled
Snap Build & Test / Build Snap (arm64) (push) Has been cancelled
Test Packaging / elizaos CLI global-install smoke (node + bun) (push) Has been cancelled
Cloud Gateway Webhook / Test (push) Has been cancelled
Cloud Tests / lint-and-types (push) Has been cancelled
Cloud Tests / unit-tests (push) Has been cancelled
Cloud Tests / integration-tests (push) Has been cancelled
Cloud Tests / e2e-tests (push) Has been cancelled
CodeQL Advanced / Analyze (javascript-typescript) (push) Has been cancelled
Deploy Apps Worker (Product 2) / Determine environment (push) Has been cancelled
Deploy Apps Worker (Product 2) / Deploy apps worker to apps-control host (${{ needs.determine-env.outputs.environment }}) (push) Has been cancelled
Deploy Eliza Provisioning Worker / Determine environment (push) Has been cancelled
Deploy Eliza Provisioning Worker / Deploy worker to Hetzner host (${{ needs.determine-env.outputs.environment }} @ ${{ needs.determine-env.outputs.deployment_sha }}) (push) Has been cancelled
Dev Smoke / Classify changed paths (push) Has been cancelled
supply-chain / sbom (push) Has been cancelled
supply-chain / vulnerability-scan (push) Has been cancelled
Build, Push & Deploy to Phala Cloud / build-and-push (push) Has been cancelled
Test Packaging / Validate Packaging Configs (push) Has been cancelled
Test Packaging / Build & Test PyPI Package (push) Has been cancelled
Test Packaging / PyPI on Python ${{ matrix.python }} (push) Has been cancelled
Test Packaging / Pack & Test JS Tarballs (push) Has been cancelled
UI Fixture E2E / ui-fixture-e2e (push) Has been cancelled
UI Fixture E2E / fixture-e2e (push) Has been cancelled
UI Story Gate / story-gate (push) Has been cancelled
vault-ci / test (macos-latest) (push) Has been cancelled
vault-ci / test (ubuntu-latest) (push) Has been cancelled
vault-ci / test (windows-latest) (push) Has been cancelled
vault-ci / app-core wiring tests (push) Has been cancelled
verify-patches / verify patches/CHECKSUMS.sha256 (push) Has been cancelled
Voice Benchmark Smoke / voice-emotion fixture smoke (push) Has been cancelled
Voice Benchmark Smoke / voiceagentbench fixture smoke (push) Has been cancelled
Voice Benchmark Smoke / voicebench-quality unit smoke (push) Has been cancelled
Voice Benchmark Smoke / voicebench TypeScript unit (no audio) (push) Has been cancelled
Voice Benchmark Smoke / voice bench smoke summary (push) Has been cancelled
Windows CI / windows ([bun run --cwd packages/app-core test bun run --cwd packages/elizaos test bun run --cwd packages/cloud/shared test], app-and-cli) (push) Has been cancelled
Windows CI / windows ([bun run --cwd packages/scenario-runner test bun run --cwd packages/vault test bun run --cwd packages/security test bun run --cwd plugins/plugin-coding-tools test], framework-packages) (push) Has been cancelled
Windows CI / windows ([bun run --cwd plugins/plugin-elizacloud test bun run --cwd plugins/plugin-discord test bun run --cwd plugins/plugin-anthropic test bun run --cwd plugins/plugin-openai test bun run --cwd plugins/plugin-app-control test bun run --cwd plugins/pl… (push) Has been cancelled
Windows CI / windows ([node packages/scripts/run-turbo.mjs run build --filter=@elizaos/core --filter=@elizaos/shared --filter=@elizaos/agent --concurrency=4 node packages/scripts/run-bash-linux-only.mjs scripts/verify-riscv64-buildpaths.sh node packages/scripts/run… (push) Has been cancelled
Windows CI / windows ([node packages/scripts/run-turbo.mjs run typecheck --filter=@elizaos/core --filter=@elizaos/shared --filter=@elizaos/cloud-shared --concurrency=4 bun run --cwd packages/core test bun run --cwd packages/shared test], core-runtime, 75) (push) Has been cancelled
194 行
4.7 KiB
Plaintext
194 行
4.7 KiB
Plaintext
---
|
|
title: Rate Limits
|
|
description: Understand rate limiting on elizaOS Cloud APIs and how to handle rate limit errors.
|
|
---
|
|
|
|
# Rate Limits
|
|
|
|
elizaOS Cloud applies rate limits to ensure fair usage and platform stability.
|
|
|
|
## Overview
|
|
|
|
Rate limits are applied per API key and vary by:
|
|
|
|
- **Endpoint type**: Different limits for different APIs
|
|
- **Time window**: Requests per minute or per 5 minutes
|
|
|
|
## Default Limits
|
|
|
|
Rate limits are applied per API key. All users share the same default limits — credits and billing control cost.
|
|
|
|
| Endpoint | Rate Limit | Preset |
|
|
| ---------------- | ---------- | -------- |
|
|
| Chat Completions | 200/min | RELAXED |
|
|
| Responses | 200/min | RELAXED |
|
|
| Embeddings | 60/min | STANDARD |
|
|
| Image Generation | 60/min | STANDARD |
|
|
| Video Generation | 5/5min | CRITICAL |
|
|
| Knowledge Query | 60/min | STANDARD |
|
|
|
|
### Enterprise
|
|
|
|
Custom rate limits based on your needs. Contact sales.
|
|
|
|
## Rate Limit Headers
|
|
|
|
Rate-limited responses include rate limit information. Some endpoints may also
|
|
include these headers on successful responses:
|
|
|
|
```
|
|
X-RateLimit-Limit: 200
|
|
X-RateLimit-Remaining: 185
|
|
X-RateLimit-Reset: 2026-01-15T12:01:00.000Z
|
|
X-RateLimit-Policy: redis
|
|
```
|
|
|
|
| Header | Description |
|
|
| ----------------------- | ----------------------------------- |
|
|
| `X-RateLimit-Limit` | Max requests in window |
|
|
| `X-RateLimit-Remaining` | Requests remaining |
|
|
| `X-RateLimit-Reset` | ISO timestamp when window resets |
|
|
| `X-RateLimit-Policy` | Backend: `redis` or `in-memory` |
|
|
|
|
## Handling Rate Limits
|
|
|
|
### 429 Response
|
|
|
|
When rate limited, you'll receive:
|
|
|
|
```json
|
|
{
|
|
"error": {
|
|
"code": "RATE_LIMITED",
|
|
"message": "Too many requests",
|
|
"retryAfter": 42
|
|
}
|
|
}
|
|
```
|
|
|
|
### Retry Strategy
|
|
|
|
Implement exponential backoff:
|
|
|
|
```javascript
|
|
async function fetchWithRetry(url, options, maxRetries = 3) {
|
|
for (let i = 0; i < maxRetries; i++) {
|
|
const response = await fetch(url, options);
|
|
|
|
if (response.status === 429) {
|
|
const retryAfter = response.headers.get("Retry-After");
|
|
const waitTime = retryAfter
|
|
? parseInt(retryAfter) * 1000
|
|
: Math.pow(2, i) * 1000;
|
|
|
|
console.log(`Rate limited. Waiting ${waitTime}ms...`);
|
|
await new Promise((resolve) => setTimeout(resolve, waitTime));
|
|
continue;
|
|
}
|
|
|
|
return response;
|
|
}
|
|
|
|
throw new Error("Max retries exceeded");
|
|
}
|
|
```
|
|
|
|
### Best Practices
|
|
|
|
1. **Monitor headers**: Track remaining requests
|
|
2. **Implement backoff**: Wait before retrying
|
|
3. **Queue requests**: Smooth out request spikes
|
|
4. **Cache responses**: Reduce redundant calls
|
|
|
|
## Request Queuing
|
|
|
|
For high-volume applications, implement a request queue:
|
|
|
|
```javascript
|
|
class RequestQueue {
|
|
constructor(rateLimit = 60, windowMs = 60000) {
|
|
this.queue = [];
|
|
this.rateLimit = rateLimit;
|
|
this.windowMs = windowMs;
|
|
this.requestTimes = [];
|
|
}
|
|
|
|
async add(request) {
|
|
return new Promise((resolve, reject) => {
|
|
this.queue.push({ request, resolve, reject });
|
|
this.process();
|
|
});
|
|
}
|
|
|
|
async process() {
|
|
if (this.queue.length === 0) return;
|
|
|
|
// Clean old request times
|
|
const now = Date.now();
|
|
this.requestTimes = this.requestTimes.filter(
|
|
(t) => now - t < this.windowMs,
|
|
);
|
|
|
|
// Check if we can make a request
|
|
if (this.requestTimes.length < this.rateLimit) {
|
|
const { request, resolve, reject } = this.queue.shift();
|
|
this.requestTimes.push(now);
|
|
|
|
try {
|
|
const result = await request();
|
|
resolve(result);
|
|
} catch (error) {
|
|
reject(error);
|
|
}
|
|
|
|
this.process();
|
|
} else {
|
|
// Wait until we can make another request
|
|
const waitTime = this.windowMs - (now - this.requestTimes[0]);
|
|
setTimeout(() => this.process(), waitTime);
|
|
}
|
|
}
|
|
}
|
|
```
|
|
|
|
## Increasing Limits
|
|
|
|
For specific use cases, contact support to request a custom limit increase.
|
|
|
|
## Burst Limits
|
|
|
|
The BURST preset (10 req/sec) is available for real-time features. Standard AI endpoints use per-minute windows only.
|
|
|
|
## Monitoring Usage
|
|
|
|
Track your API usage:
|
|
|
|
```bash
|
|
curl -X GET "https://elizacloud.ai/api/quotas/usage" \
|
|
-H "Authorization: Bearer YOUR_API_KEY"
|
|
```
|
|
|
|
```json
|
|
{
|
|
"period": "current_minute",
|
|
"usage": {
|
|
"chat": { "used": 45, "limit": 200 },
|
|
"embeddings": { "used": 12, "limit": 60 }
|
|
}
|
|
}
|
|
```
|
|
|
|
## Next Steps
|
|
|
|
<CardGroup>
|
|
<CardGroup.Card title="Error Handling" href="/cloud/errors">
|
|
Handle API errors gracefully
|
|
</CardGroup.Card>
|
|
<CardGroup.Card title="API Reference" href="/cloud/api">
|
|
Complete API documentation
|
|
</CardGroup.Card>
|
|
<CardGroup.Card title="Billing" href="/cloud/billing">
|
|
Upgrade your plan
|
|
</CardGroup.Card>
|
|
</CardGroup>
|