glean-rate-limits

# Glean Rate Limits ## Overview Glean's APIs split into two tiers: the Indexing API for pushing documents into the search corpus, and the Client API for executing searches. The Indexing API handles bulk document ingestion at approximately 100 requests per minute, while search queries are capped at 60 per minute per token. Organizations indexing large knowledge bases (100K+ documents from Confluence, Notion, or internal wikis) must implement careful batching to avoid 429 responses that can stall multi-hour ingestion pipelines. ## Rate Limit Reference | Endpoint | Limit | Window | Scope | |----------|-------|--------|-------| | Indexing - single document | 100 req | 1 minute | Per API token | | Indexing - bulk (100 docs/req) | 20 req | 1 minute | Per API token | | Search queries | 60 req | 1 minute | Per API token | | People search | 30 req | 1 minute | Per API token | | Entity extraction | 40 req | 1 minute | Per API token | ## Rate Limiter Implementation ```typescript class GleanRateLimiter { private tokens: number; private lastRefill: number; private readonly max: number; private readonly refillRate: number; private queue: Array<{ resolve: () => void }> = []; constructor(maxPerMinute: number) { this.max = maxPerMinute; this.tokens = maxPerMinute; this.lastRefill = Date.now(); this.refillRate = maxPerMinute / 60_000; } async acquire(): Promise<void> { this.refill(); if (this.tokens >= 1) { this.tokens -= 1; return; } return ...