apify-reference-architecture

Featured

Production-grade architecture patterns for Apify-powered applications. Use when designing scraping infrastructure, building multi-Actor pipelines, or integrating Apify into a larger system architecture. Trigger: "apify architecture", "apify best practices", "apify project structure", "scraping architecture", "apify system design".

AI & Automation 2,926 stars 433 forks Updated yesterday MIT

Install

View on GitHub

Quality Score: 99/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Apify Reference Architecture ## Overview Production-ready architecture patterns for applications built on Apify. Covers standalone Actor projects, multi-Actor pipelines, and full-stack applications that integrate Apify as a data source. ## Architecture Pattern 1: Standalone Actor For a single scraper deployed to Apify platform. ``` my-scraper/ ├── .actor/ │ ├── actor.json # Actor metadata │ ├── INPUT_SCHEMA.json # Input definition (generates UI) │ └── Dockerfile # Build configuration ├── src/ │ ├── main.ts # Entry point (Actor.main) │ ├── routes/ │ │ ├── listing.ts # Router handler: listing pages │ │ └── detail.ts # Router handler: detail pages │ ├── types.ts # Input/output TypeScript types │ └── utils/ │ ├── extractors.ts # Data extraction functions │ └── validators.ts # Input/output validation ├── tests/ │ ├── extractors.test.ts # Unit tests for extraction logic │ └── integration.test.ts # Integration tests (live API) ├── storage/ # Local storage (git-ignored) ├── package.json ├── tsconfig.json └── .gitignore ``` ### Key Files ```typescript // src/main.ts — Actor entry point import { Actor } from 'apify'; import { CheerioCrawler } from 'crawlee'; import { router } from './routes/listing'; import { validateInput, ScraperInput } from './types'; await Actor.main(async () => { const rawInput = await Actor.getInput<ScraperInput>(); const inpu...

Details

Author
jeremylongshore
Repository
jeremylongshore/claude-code-plugins-plus-skills
Created
1 years ago
Last Updated
yesterday
Language
Python
License
MIT

Integrates with

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category