apify-reference-architecture

Featured

Production-grade architecture patterns for Apify-powered applications. Use when designing scraping infrastructure, building multi-Actor pipelines, or integrating Apify into a larger system architecture. Trigger: "apify architecture", "apify best practices", "apify project structure", "scraping architecture", "apify system design".

AI & Automation 2,266 stars 315 forks Updated today MIT

Install

View on GitHub

Quality Score: 99/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Apify Reference Architecture ## Overview Production-ready architecture patterns for applications built on Apify. Covers standalone Actor projects, multi-Actor pipelines, and full-stack applications that integrate Apify as a data source. ## Architecture Pattern 1: Standalone Actor For a single scraper deployed to Apify platform. ``` my-scraper/ ├── .actor/ │ ├── actor.json # Actor metadata │ ├── INPUT_SCHEMA.json # Input definition (generates UI) │ └── Dockerfile # Build configuration ├── src/ │ ├── main.ts # Entry point (Actor.main) │ ├── routes/ │ │ ├── listing.ts # Router handler: listing pages │ │ └── detail.ts # Router handler: detail pages │ ├── types.ts # Input/output TypeScript types │ └── utils/ │ ├── extractors.ts # Data extraction functions │ └── validators.ts # Input/output validation ├── tests/ │ ├── extractors.test.ts # Unit tests for extraction logic │ └── integration.test.ts # Integration tests (live API) ├── storage/ # Local storage (git-ignored) ├── package.json ├── tsconfig.json └── .gitignore ``` ### Key Files ```typescript // src/main.ts — Actor entry point import { Actor } from 'apify'; import { CheerioCrawler } from 'crawlee'; import { router } from './routes/listing'; import { validateInput, ScraperInput } from './types'; await Actor.main(async () => { const rawInput = await Actor.getInput<ScraperInput>(); const inpu...

Details

Author
jeremylongshore
Repository
jeremylongshore/claude-code-plugins-plus-skills
Created
7 months ago
Last Updated
today
Language
Python
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Featured

apify-core-workflow-a

Build a complete web scraping Actor with Crawlee and deploy to Apify. Use when implementing end-to-end scraping: input schema, crawler, data extraction, dataset output, and platform deployment. Trigger: "apify scrape website", "build apify actor", "crawlee scraper", "apify main workflow".

2,266 Updated today
jeremylongshore
AI & Automation Featured

apify-sdk-patterns

Production-ready patterns for Apify SDK and apify-client in TypeScript. Use when building Actors with Crawlee, managing datasets/KV stores, or implementing robust client wrappers with retry and validation. Trigger: "apify SDK patterns", "apify best practices", "apify client wrapper", "crawlee patterns", "idiomatic apify".

2,266 Updated today
jeremylongshore
AI & Automation Featured

apify-deploy-integration

Deploy Apify Actors and integrate scraping into external applications. Use when deploying Actors to the platform, integrating Actor results into web apps, or connecting Apify with external services. Trigger: "deploy apify actor", "apify Vercel integration", "apify production deploy", "integrate apify results", "apify API endpoint".

2,266 Updated today
jeremylongshore
AI & Automation Solid

apify-actor-development

Important: Before you begin, fill in the generatedBy property in the meta section of .actor/actor.json. Replace it with the tool and model you're currently using, such as "Claude Code with Claude Sonnet 4.5". This helps Apify monitor and improve AGENTS.md for specific AI tools and models.

39,227 Updated today
sickn33
AI & Automation Listed

apify-automation

Automate web scraping and data extraction with Apify -- run Actors, manage datasets, create reusable tasks, and retrieve crawl results through the Composio Apify integration.

62,564 Updated 1 weeks ago
ComposioHQ