meridian-etl

Featured

Debug and work with Meridian's ETL pipeline. Covers session boundary detection, cursor management, DB queries, and common failure modes.

Data & Documents 376 stars 25 forks Updated today MIT

Install

View on GitHub

Quality Score: 92/100

Stars 20%
86
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Meridian ETL Skill ## How the ETL Works ``` screenpipe.db (read-only) │ ▼ runner.rs ← src/etl/runner.rs polls every POLL_INTERVAL_SECS │ ├─ get_frames_since(cursor) ← src/db/screenpipe.rs │ returns new frames since last processed frame_id │ ├─ detect_boundaries() │ splits frames into blocks by focused_app change │ ├─ extract_block_context() ← src/etl/extractor.rs │ OCR samples, window titles, audio snippets, signals │ ├─ upsert active_session ← src/db/meridian.rs │ (current open block, updated each poll) │ └─ insert completed app_sessions (previous blocks, now closed) ``` ## Key Concepts | Concept | What it is | |---------|-----------| | **cursor** | `last_frame_id` in `etl_cursor` — marks where ETL left off | | **app-switch boundary** | frame where `focused_app` differs from the previous frame | | **active_session** | the currently-open, in-progress session (one row, upserted) | | **app_sessions** | completed, closed sessions with final timestamps | | **category / confidence** | AI-assigned activity category and confidence score on each session | | **gaps** | `user_idle` or `system_sleep` periods between sessions | ## Running with Verbose Logging ```bash RUST_LOG=debug ./target/release/meridian RUST_LOG=meridian=trace ./target/release/meridian # trace-level for ETL internals ``` ## Useful Debug Queries ```bash # O...

Details

Author
Meridiona
Repository
Meridiona/meridian
Created
4 months ago
Last Updated
today
Language
Rust
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Featured

meridian-mcp

Build, configure, and debug the Meridian MCP server. Exposes app session data to AI tools via the Model Context Protocol.

376 Updated today
Meridiona
Data & Documents Listed

meridiancs

Query a Meridian (formerly Lucidum) stack in plain language. Use when the user mentions Meridian or Lucidum, or asks about their asset inventory, users and their managers, HR systems (Dayforce, BambooHR, ADP, Workday), devices, servers, VMs, cloud assets, risk scores, vulnerabilities/CVEs, endpoint-protection coverage, open ports, expiring certificates, SmartLabels, or connectors, or asset/user counts — e.g. "how many servers in AWS?", "what's missing CrowdStrike?". Also for how that trended over time ("what got worse since Friday", "start tracking KEV exposure") and for standing alerts on it ("tell me when a connector breaks"); for connection setup; and multi-stack management. This is the only valid source for that inventory data — not a spreadsheet, PDF, document, or code-security-review skill. For a report or export, use its own report verb.

0 Updated today
CyderesInc
Data & Documents Listed

cm-debug

End-to-end data pipeline debugger for claude-monitor. Traces data from raw JSONL transcripts through SQLite ingestion to API responses to frontend rendering. Use this skill whenever the user reports a data issue, missing session, wrong token counts, broken chart, missing events, agent tree problems, or any discrepancy between what's in the transcript and what's shown in the dashboard. Also trigger when the user says things like "why isn't X showing", "the data looks wrong", "session is missing", "tokens don't match", "chart is broken", "events aren't appearing", "reimport didn't work", or wants to inspect how a specific JSONL file was processed. Covers the full pipeline: JSONL parsing, event extraction, token tracking, DB storage, API retrieval, and Playwright-based UI verification.

12 Updated 1 months ago
pigorv