seo-crawl

Solid

Crawlability and site structure for SEO: robots.txt, noindex, canonical, redirect chains, sitemap.xml; internal linking, click depth, orphan pages, URL hierarchy, breadcrumbs; competitor comparison (gaps, overlapping keywords, content gaps). Commands documented in commands/. Triggers: 'seo crawl', 'crawlability', 'robots txt', 'site structure', 'URL structure', 'competitor seo', 'индексация', 'структура сайта', 'конкуренты seo', 'краулинг'.

AI & Automation 5 stars 0 forks Updated yesterday MIT

Install

View on GitHub

Quality Score: 81/100

Stars 20%
26
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
56
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# SEO Crawl — crawlability, structure & competitors Use this skill for the **crawl/visibility** layer of SEO: whether search engines can reach the site, how it is internally linked, and how it compares to competitors. ## Commands (documented in `commands/`) | Command | What it does | |---|---| | `seo-crawl` | Crawlability: robots.txt, noindex, canonical, redirect chains, sitemap.xml | | `seo-structure` | Internal linking, click depth, orphan pages, URL hierarchy, breadcrumbs | | `seo-compare` | Competitor comparison: gaps, overlapping keywords, content gaps (URL mode) | Modes: **URL** (external sites) and **File** (local projects); `seo-compare` is URL-only. ## When to use - User asks for "seo crawl", "crawlability", "robots txt", "site structure", "URL structure", "competitor seo", "индексация", "структура сайта". - Indexation, linking structure or competitor gaps are the task. ## Do NOT use - For the full technical audit / CWV / reports / fixes — that is `seo-audit`. - For schema.org / meta tags — that is `seo-schema`. - For content / keywords / headings / images — that is `seo-content`.

Details

Author
bestdeejay-design
Repository
bestdeejay-design/agent-skills
Created
1 weeks ago
Last Updated
yesterday
Language
Python
License
MIT

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Solid

seo-audit

Technical SEO audit and health: full technical audit (meta, headings, alt, broken links, sitemap, robots.txt, canonical, URL structure), Core Web Vitals (LCP/CLS/INP, blocking resources, unused CSS/JS, caching), a comprehensive scored report (7 dimensions, weighted 100%), and the autonomous fix agent (P1-P5 prioritization, diff-before-apply). Commands documented in commands/. Triggers: 'seo audit', 'technical audit', 'core web vitals', 'site speed', 'seo report', 'seo fix', 'технический аудит', 'проверка seo', 'скорость сайта'.

5 Updated yesterday
bestdeejay-design
AI & Automation Solid

seo-technical

Find and fix what stops a site from being indexed, fast, and visible to AI crawlers. Input: a site or specific pages. Output: fixes for indexation, robots.txt, sitemaps, IndexNow, Core Web Vitals (LCP/INP/CLS), JS rendering, AI crawler access (GPTBot, ClaudeBot, PerplexityBot, and more), canonicals, hreflang, HTTPS, and migrations. Repo reference for AI crawler control. Use for a technical audit, pages not indexed, slow pages, robots.txt or sitemap issues, llms.txt, content invisible to ChatGPT, a migration, or a hacked site.

13 Updated today
Thibaultbm
AI & Automation Listed

seo-technical

Technical SEO audit across 9 categories: crawlability, indexability, security, URL structure, mobile, Core Web Vitals, structured data, JavaScript rendering, and IndexNow protocol. Use when user says "technical SEO", "crawl issues", "robots.txt", "Core Web Vitals", "site speed", or "security headers".

1 Updated 3 weeks ago
lasri97