exa-data-handling

# Exa Data Handling ## Overview Manage search result data from Exa's neural search API. Covers content extraction scope control (text vs highlights vs summary), result caching with TTL, citation deduplication, token budget management for LLM context windows, and structured summary extraction. ## Prerequisites - `exa-js` SDK installed and configured - Optional: `lru-cache` for in-memory caching, `ioredis` for Redis - Understanding of Exa content options (text, highlights, summary) ## Instructions ### Step 1: Control Content Extraction Scope ```typescript import Exa from "exa-js"; const exa = new Exa(process.env.EXA_API_KEY); // Tier 1: Metadata only (cheapest, fastest) async function searchMetadataOnly(query: string) { return exa.search(query, { type: "auto", numResults: 10, // No content options — returns URLs, titles, scores only }); } // Tier 2: Highlights only (balanced cost/value) async function searchWithHighlights(query: string) { return exa.searchAndContents(query, { numResults: 10, highlights: { maxCharacters: 500, query: query, // focus highlights on the original query }, }); } // Tier 3: Full text with character limit async function searchWithText(query: string, maxChars = 2000) { return exa.searchAndContents(query, { numResults: 5, text: { maxCharacters: maxChars }, highlights: { maxCharacters: 300 }, }); } // Tier 4: Structured summary (LLM-generated per result) async function searchWithSummary(...