sigma_ingest
FeaturedExtract durable ktx wiki knowledge from staged Sigma data model specs and workbook summaries. Load for WorkUnits with unitKey sigma-data-models or sigma-workbooks.
AI & Automation 1,602 stars
107 forks Updated 2 weeks ago Apache-2.0
Install
Quality Score: 94/100
Stars 20%
Recency 20%
Frontmatter 20%
Documentation 15%
Issue Health 10%
License 10%
Description 5%
Skill Content
# Sigma Ingest
Sigma ingest turns staged data model specs and workbook summaries into durable ktx wiki knowledge. The deterministic `project()` step has already written semantic-layer YAML for all warehouse-table data model elements before this skill runs — do not re-write those SL sources.
## Work unit structure
Sigma produces at minimum two work units per ingest run:
- `sigma-data-models` or `sigma-data-models-N`
- `rawFiles`: `data-models/<id>.json` files (one per data model in this batch)
- `peerFileIndex`: `workbooks/<id>.json` files + `sigma-manifest.json` + `sigma-projection-config.json`
- When the workspace has more than 50 data models, split into batches: `sigma-data-models-0`, `sigma-data-models-1`, … with `displayLabel` like `"Sigma: data models (1/8)"`. When ≤50 data models, the unitKey is simply `sigma-data-models` with no suffix.
- `sigma-workbooks` or `sigma-workbooks-N`
- `rawFiles`: `workbooks/<id>.json` files (one per workbook in this batch)
- `peerFileIndex`: `data-models/<id>.json` files + `sigma-manifest.json` + `sigma-projection-config.json`
- When the workspace has more than 2000 workbooks, split into batches: `sigma-workbooks-0`, `sigma-workbooks-1`, … with `displayLabel` like `"Sigma: workbooks (1/4)"`. When ≤2000 workbooks, the unitKey is simply `sigma-workbooks` with no suffix.
`sigma-manifest.json` and `sigma-projection-config.json` are never in `rawFiles`. They live at the staged dir root and always appear in `peerFileIndex`.
## ...
Details
- Author
- Kaelio
- Repository
- Kaelio/ktx
- Created
- 4 months ago
- Last Updated
- 2 weeks ago
- Language
- TypeScript
- License
- Apache-2.0
Similar Skills
Semantically similar based on skill content — not just same category
Data & Documents Featured
looker_ingest
Extract durable ktx knowledge and semantic-layer contribution proposals from staged Looker runtime dashboard, Look, and explore JSON. Load for WorkUnits whose raw files are under explores/, dashboards/, or looks/.
1,602 Updated 2 weeks ago
Kaelio AI & Automation Listed
ingest
Process source files from inbox/ into synthesized wiki pages — scan the inbox queue, read each file, search for existing knowledge, write pages with frontmatter, validate and commit. Source files move to raw/ on successful ingest.
2 Updated 3 weeks ago
geronimo-iia