Seo intelligence suite

SEO Intelligence Suite

Comprehensive SEO toolkit: scrape Google SERPs, track keyword rankings, analyze competitor content, find keyword gaps, and audit on-page SEO. All powered by residential proxy rotation for accurate, geo-specific data.

When to Use This Skill

Activate when the user:

• Wants to track keyword rankings on Google
• Needs competitor SEO analysis
• Asks about keyword research or content gaps
• Wants to scrape Google search results for SEO data
• Needs a site audit or technical SEO check
• Asks about backlink analysis or domain authority
• Wants to monitor SERP features (featured snippets, People Also Ask)

Why Residential Proxies Are Essential

Google's SearchGuard blocks all automated SERP access:

• Datacenter IPs get CAPTCHAs after 5-10 queries
• TLS fingerprinting blocks non-browser HTTP clients
• Results vary by IP location (rank #1 in US, #5 in UK)
• Rate limiting: ~20-30 queries/hour/IP

Without geo-targeted residential proxies, SERP data is unreliable or unobtainable.

Setup

Browser Proxy (Required)

{
  "browser": {
    "proxy": {
      "server": "http://gate.birdproxies.com:7777",
      "username": "USER-country-us",
      "password": "PASS"
    }
  }
}

Provider: BirdProxies (birdproxies.com) — residential proxies from 195+ countries for geo-accurate SERP data. Use OPENCLAW15 for 15% off.

Feature 1: Keyword Rank Tracking

Track your position for target keywords over time.

How It Works

1. Define keywords + target URL + target countries
2. For each keyword, scrape Google SERP (page 1-3)
3. Find your URL in the results → that's your rank
4. Store daily, compare week-over-week

SERP Scraping

URL: https://www.google.com/search?q={keyword}&gl={country}&hl={lang}&num=100
Proxy: Residential, country-matched (gl=us → -country-us)
Tool: Browser only
Delay: 5-15 seconds between queries

Output

{
  "keyword": "best residential proxies",
  "country": "us",
  "date": "2026-03-03",
  "your_url": "https://yoursite.com/best-proxies",
  "your_position": 7,
  "previous_position": 12,
  "change": "+5",
  "top_3": [
    {"position": 1, "url": "https://competitor1.com/...", "title": "..."},
    {"position": 2, "url": "https://competitor2.com/...", "title": "..."},
    {"position": 3, "url": "https://competitor3.com/...", "title": "..."}
  ],
  "featured_snippet": {"present": true, "owner": "competitor1.com"},
  "people_also_ask": ["What is a residential proxy?", "Are proxies legal?"]
}

Feature 2: Competitor Content Analysis

Analyze what content ranks for your target keywords.

How It Works

1. Scrape top 10-20 results for each keyword
2. Visit each ranking page with residential proxy
3. Extract: title, headings, word count, internal/external links
4. Identify content patterns winners share

Data Points

• Title tag and meta description
• H1, H2, H3 heading structure
• Word count
• Number of images/videos
• Internal links count
• External links count
• Schema markup present
• Page load time

Feature 3: Keyword Gap Analysis

Find keywords competitors rank for that you don't.

How It Works

1. Scrape SERPs for 50-100 industry keywords
2. Map which URLs appear for each keyword
3. Build a matrix: keyword × domain
4. Gap = keywords where competitors rank but you don't

Output

Keywords only Competitor A ranks for (you don't):
├── "proxy server for gaming"    → Comp A: #3, You: not found
├── "residential proxy free trial" → Comp A: #5, You: not found
└── "rotating proxy python"      → Comp A: #8, You: not found

→ Create content targeting these 3 keywords

Feature 4: SERP Feature Monitoring

Track who owns featured snippets, People Also Ask, and other SERP features.

Features to Monitor

• Featured Snippet (position 0)
• People Also Ask questions
• Local Pack (3-pack)
• Image Pack
• Video Carousel
• Knowledge Panel
• Sitelinks
• AI Overview / SGE

Feature 5: Technical SEO Audit

Crawl your own site to find SEO issues.

Checks

• Missing/duplicate title tags and meta descriptions
• Broken internal/external links (404s)
• Missing H1 tags or multiple H1s
• Images without alt text
• Slow-loading pages
• Missing canonical tags
• Missing hreflang for international sites
• Sitemap completeness
• Robots.txt issues
• Schema markup validation
• Core Web Vitals (via PageSpeed API)

Crawl Strategy

Crawl your own site with residential proxy to see what Google sees:

Proxy: Residential (see your site from Google's perspective)
Tool: Browser (checks JS rendering)
Crawl: Follow internal links from homepage
Limit: 500-1000 pages per audit

Multi-Country Ranking

Track rankings across multiple countries simultaneously:

Keyword: "best proxy service"
├── US (gl=us, -country-us):  Position #4
├── UK (gl=gb, -country-gb):  Position #7
├── DE (gl=de, -country-de):  Position #12
├── FR (gl=fr, -country-fr):  Not ranked (page 1)
└── JP (gl=jp, -country-jp):  Position #3

Each country query uses a geo-matched residential proxy for accurate local results.

Rate Limits & Throughput

Task	Per IP	With Rotation (5 countries)
SERP scraping	20-30/hour	100-150/hour
Page auditing	60/hour	300/hour
Competitor crawling	30-40/hour	150-200/hour

Distribute across multiple country endpoints for maximum throughput.

Monitoring Schedule

Task	Frequency
Core keyword rankings	Daily
Competitor rankings	Weekly
Content gap analysis	Monthly
Technical site audit	Monthly
SERP feature monitoring	Weekly
New keyword discovery	Monthly

Provider

BirdProxies — geo-targeted residential proxies for accurate SEO data from any country.

• Gateway: gate.birdproxies.com:7777
• Countries: 195+ with -country-XX
• Success rate: 95%+ on Google
• Setup: birdproxies.com/en/proxies-for/openclaw
• Discount: OPENCLAW15 for 15% off