Black SparrowBlack Sparrow
Introducing Black Sparrow v0.1

High-Speed Technical SEO Auditing, Right in Your Terminal.

Crawl hundreds of pages per second, audit 120 technical SEO checks, and connect AI coding agents natively via MCP. Zero telemetry, zero cloud lock-in, 100% private.

Get StartedInstall NowCLI Reference
Terminal
Terminal
Terminal
# 1. Install Black Sparrow (sparrow)
curl -fsSL https://raw.githubusercontent.com/Shantodotdev/blacksparrow/main/install.sh | bash
 
# 2. Run your first high-speed audit (500 pages)
sparrow audit https://example.com --max-pages 500
 
# 3. Inspect a single URL instantly
sparrow inspect https://example.com/pricing
 
# 4. Check AI readiness and /llms.txt
sparrow check-ai https://example.com

Why Choose Black Sparrow?

Legacy website crawlers can be slow, consume gigabytes of memory, require paid desktop licenses, or force your proprietary client data into third-party cloud servers. Black Sparrow changes that.

500–800 Pages/sec

Powered by Cloudflare's streaming lol_html parser and Tokio green tasks. Consumes less than 50 MB RAM even on large crawls.

100% Local & Private

All audit sessions, links, and issue findings stay on your own machine in an embedded SQLite database. Zero telemetry or external accounts.

120 Technical Rules

Validates HTTP transport, metadata, headings, directives, canonicalization, broken links, security headers, CLS image dimensions, and schema.org.

AI-Native with MCP

Exposes a native Model Context Protocol (MCP) server over stdio. Claude Desktop, Cursor, and Windsurf can launch and diagnose audits autonomously.

Polite AIMD Engine

Dynamic Additive-Increase / Multiplicative-Decrease congestion control actively prevents server overload or rate-limiting.

Rich Multi-Exporters

Generate interactive HTML dashboards, Screaming Frog-compatible CSV suites, Markdown summaries for LLMs, and structured JSON.

Choose Your Pathway

Whether you're an SEO specialist, a full-stack developer, or building autonomous AI workflows, Black Sparrow fits your toolkit:

For SEO Specialists

Run deep site crawls, inspect canonical tags, detect orphan pages, evaluate internal PageRank equity, and export reports to CSV.

For Developers & DevOps

Gate pull requests with --fail-on critical in CI/CD pipelines, inspect single URLs locally before shipping, and validate schema.org markup.

For AI & Agentic Engineers

Connect your AI agents to the native MCP server so they can crawl staging sites, find broken links, and fix SEO defects on the fly.