Scrape Google Search with AI

# Scrape Google Search — SoloStack Skill File
> Drop this file into your SoloStack repo and Claude Code will use it as
> context to run this workflow automatically.
---
## Overview
Extract Google search results, featured snippets, and People Also Ask data using Apify and Claude Code.
**Apify Actor:** `apify/google-search-scraper`
**Pricing:** ~$2.50 per 1,000 searches
## Capabilities
1. **Organic results** — Extract all organic search results with title, URL, description, and position for any keyword in any location.
2. **Featured snippets** — Capture featured snippet content, source URL, and type (paragraph, list, table) to identify snippet opportunities for your content.
3. **People Also Ask** — Extract PAA questions and their answers to discover related topics and long-tail keyword opportunities your audience is searching for.
4. **Local pack results** — Scrape Google Maps local pack listings with business names, ratings, review counts, and addresses for local SEO analysis.
5. **Ad intelligence** — Capture Google Ads appearing for any keyword, including ad copy, display URLs, and ad extensions to analyze competitor ad strategies.
6. **Multi-location SERPs** — Scrape results as seen from any city, state, or country. Compare how rankings differ across geographic locations.
## Pipeline
1. **Define keywords** — Provide a list of search queries, target locations, and language preferences
2. **Scrape SERPs** — Apify's Google Search Scraper returns organic results, ads, featured snippets, and SERP features
3. **Parse features** — Results are structured by type: organic, featured snippet, People Also Ask, local pack, ads, and more
4. **Track & analyze** — Compare results over time to monitor ranking changes, spot new competitors, and find content opportunities
## Use Cases
- **SEO monitoring:** Track your keyword rankings daily without paying for an enterprise SEO suite. Detect drops early and respond before traffic is lost.
- **SERP tracking:** Monitor how search results change over time for your target keywords, including new competitors entering the SERPs and SERP feature changes.
- **Keyword research:** Scrape related searches and People Also Ask to discover long-tail keywords and content topics your audience is actively searching for.
- **Featured snippet tracking:** Identify which keywords trigger featured snippets, who currently owns them, and where your content could realistically win the snippet position.
## Warnings
- Google aggressively blocks automated searches. The Apify actor uses residential proxies, but very large batches (5,000+ queries) should be spread across multiple runs.
- SERP results are highly personalized and volatile. Rankings can shift multiple positions within the same day. Use averages over time, not single snapshots.
- Scraping Google Ads data is useful for research but does not replace proper competitive ad intelligence tools for campaign planning.
- Location-based scraping requires specifying exact geo-targets. Results without location parameters default to a generic US-based perspective.
## Sample Output
```json
{
  "keyword": "best CRM for small business",
  "location": "United States",
  "organicResults": [
    {
      "position": 1,
      "title": "10 Best CRMs for Small Business in 2026",
      "url": "https://example.com/best-crm-small-business",
      "description": "Compare the top CRM platforms for small teams..."
    }
  ],
  "featuredSnippet": {
    "text": "The best CRM for small business is...",
    "sourceUrl": "https://example.com/best-crm-small-business",
    "type": "paragraph"
  },
  "peopleAlsoAsk": [
    "What is the easiest CRM to use?",
    "Is HubSpot free CRM really free?",
    "What CRM do most small businesses use?"
  ],
  "relatedSearches": [
    "free CRM for startups",
    "CRM software pricing comparison",
    "simple CRM for solo entrepreneur"
  ],
  "totalResults": "1,240,000,000"
}
```
Download the complete skill file with full implementation details,
agent prompts, and ready-to-run scripts.