MacroCrawler is a local-first AI crawling and data intelligence platform. Chrome extension + manually installed desktop engine + optional local dashboard — engineered so crawled data stays on your machine by default.

Install the Chrome extension to capture, structure, and stage data directly from any page you visit.
Install the signed desktop engine manually. It orchestrates crawls, parses responses, enforces runtime policy bundles, and supports signed updates plus offline capability.
Add a fully local dashboard and AI stack for enrichment, classification, and extraction. Zero network round-trips.

Every request, every parse, every enrichment step runs on your hardware — logged, replayable, and auditable. No black boxes, no shadow pipelines.
A local-first platform that runs on your hardware — with the discipline of infrastructure and the trust of a desktop security product.
Selector-free extraction. AI-assisted schema inference on every page. Policy-governed by default.
Export JSON, CSV, or Parquet. Connect to your local warehouse, CRM, or analytics stack.
Uses your real browser session. Signed engine, one-time account pairing, production installation challenges, signed updates, durable rate limits, and secure extension binding.
Scale across cores with the local desktop engine — bounded by your hardware, not a plan tier.
Watch every DOM diff, network call, and extractor decision in real time. Full audit trail.
Fork, branch, and diff crawl recipes like code. Reproducible and auditable.

Most crawling tools ship your data to the cloud. MacroCrawler keeps every crawl, parse, and enrichment step on your hardware — with full transparency.
MacroCrawler.com handles account, checkout, license, signed download, and failover metadata. The crawled business intelligence remains on the user's machine by default.
Stripe, PayPal, and Paddle run hosted checkout. MacroCrawler stores account, plan, provider event IDs, and receipts — never card numbers.
Extension, manually installed local engine, and optional Tauri dashboard bind into one account with short-lived signed sessions.
The extension or local engine starts a pairing challenge, the website completes it, and the client claims the account handoff once with a short-lived secret.
The website issues a signed download ticket, redirects to the configured release store, and publishes the engine checksum for verification.
Browser-session requests consume one-time nonces, bind extension + engine identities, and reject acceptance mismatches before active crawling.
License activation tracks HMAC-only installation records, enforces plan device limits, and checks account/engine revocation lists.
The local engine can send bounded usage counters and receipt-head hashes for account status without uploading crawl pages, leads, CRM data, or browser state.
The website publishes signed crawl/export boundaries for the local engine: public-business sources only, bounded missions, no hidden private areas, and no automatic outreach.
License activation can require a fresh one-time challenge that binds account, engine hash, extension hash, and installation metadata without uploading crawl output.
Backup control-plane nodes are metadata-only failover points. Crawl payloads, browser pages, CRM tokens, and OpenAI keys stay out of the website.
Durable rate limits, provider price-ID webhook binding, key-id tagged HMAC tokens, dynamic revocations, magic-link auth, and metadata-only anomaly events protect account/payment flows.
MacroCrawler.com can issue account, payment, download, and policy metadata. The local engine keeps crawl data local and applies bounded rules before a mission starts.
Company websites, business directories, chambers, public tender/opportunity sources, contact/about/team/service pages.
Private dashboards, login areas, checkout/admin/cart/account paths, access-control bypass, project-board payloads, and automatic outreach.
Per-mission pages, per-host pages, max hosts, depth, response size, host delay, and browser automation budgets are explicitly capped.
Free gets preview exports. Paid plans unlock full CSV. CRM push and client delivery remain review-gated.
Every plan is local-first. Your data stays on your machine.
Large-scale workflows, custom policy packs, team controls, priority support, B2B verification, custom CRM/data integrations, and a 60–90 day enterprise pilot.
One local engine for recruitment, lead intelligence, competitive monitoring, and market research. Trusted by businesses that keep their data close.
Set up in minutes. Free forever for individual use.