Developer Docs

What You Build With It

Crawler Access And Firewalls

If every URL fails to fetch, or the site returns 401, 403, 429, connection errors, or empty HTTP status, treat it as an access problem before treating it as an SEO problem. The customer should allow the Index Pulse crawler for the verified site, then run the analysis again.

Customer Allowlist Request

Allow the Index Pulse crawler for this verified site.
User-Agent: IndexPulseAPI/1.0 (+https://indexpulseapi.com/crawler)
Contact: support@indexpulseapi.com
Outbound IPs: 74.220.48.0/24, 74.220.56.0/24, 216.151.17.91, 216.151.17.92

Access Options

What Index Pulse Will Not Do

Index Pulse does not pretend to be Googlebot, Bingbot, AhrefsBot, SemrushBot, or another crawler. Google-side evidence comes from customer-authorized Search Console access; live HTML evidence comes from the published Index Pulse crawler or a future customer-side connector.

Owner Or Self-Hosted Setup

Set INDEXPULSE_CRAWLER_OUTBOUND_IPS to the hosted outbound CIDR ranges or dedicated crawler IPs before offering IP allowlisting to customers. On a Render deployment, copy these from the service's Connect menu under the Outbound tab. If a customer cannot allowlist CIDR ranges, use dedicated outbound IPs.

Endpoint Map

Sample Data

Indexation Snapshot

{
  "snapshots": [{
    "url": "https://example.com/pricing",
    "priority": "high",
    "risk": { "level": "critical", "score": 100 },
    "gsc": { "coverage_state": "excluded_by_noindex" },
    "issues": ["noindex_detected", "gsc_not_indexed"],
    "actions": [
      "Remove noindex if accidental.",
      "Review GSC Coverage and live page eligibility."
    ]
  }]
}

Crawl Waste Report

{
  "summary": {
    "analyzed_urls": 100,
    "wasted_urls": 12,
    "crawl_waste_score": 34,
    "redirecting_urls": 3,
    "sitemap_leak_urls": 4
  },
  "issues": [{
    "type": "sitemap_leak",
    "severity": "high",
    "url": "https://example.com/noindex-page",
    "recommended_action": "Remove blocked, noindex, erroring, or non-canonical URLs from indexable sitemaps."
  }]
}

Schema Audit

{
  "summary": {
    "pages_audited": 10,
    "pages_with_structured_data": 10,
    "invalid_json_ld_blocks": 0,
    "average_schema_score": 99,
    "average_evidence_score": 100
  },
  "pages": [{
    "url": "https://example.com/",
    "schema_types": ["Organization", "WebSite"],
    "entities": ["Example", "Search Evidence API"],
    "same_as": ["https://www.linkedin.com/company/example"],
    "issues": []
  }]
}

Entity Map

{
  "entities": [{
    "name": "Example",
    "type": "Organization",
    "pages": ["https://example.com/"],
    "evidence": ["json_ld", "same_as", "page_copy"]
  }]
}

Report Example Hub

The client-facing report templates and use-case walkthroughs now live on a dedicated page. Each template includes a visual preview, report sections, generation logic, API inputs, and MCP prompts.

Credit Planning

A practical estimate: 100 watched URLs refreshed weekly is roughly 3,000 credits per month in the current build. That includes weekly page crawls, crawl waste analysis, weekly GSC rows, sitemap checks, and a small alert/report allowance.

MCP Positioning

MCP-ready workflows are included on every paid plan because MCP is an access method for the same evidence API. Signed-in workspace users can open /app/mcp to create an assistant token, copy the remote MCP server URL, and see first prompts. Platform pricing is for white-label API usage, custom MCP server packaging, higher limits, custom retention, and embedded product support.

Google Search Console

Most users connect Search Console from the app. Click Connect, choose the Google account that can access the property, and approve read-only access. No Google Cloud setup is needed.

Developer / DIY Environment

GOOGLE_CLIENT_ID=your-google-oauth-client-id
GOOGLE_CLIENT_SECRET=your-google-oauth-client-secret
GOOGLE_REDIRECT_URI=https://your-domain.com/app/gsc/callback
INDEXPULSE_TOKEN_SECRET=a-long-random-token-encryption-secret

MCP / API Requests

curl.exe -H "Authorization: Bearer YOUR_WORKSPACE_TOKEN" ^
  http://localhost:8787/v1/connectors/gsc

curl.exe -H "Authorization: Bearer YOUR_WORKSPACE_TOKEN" ^
  http://localhost:8787/v1/connectors/gsc/url-inspection-jobs

Production Setup Surfaces