A field guide to scraping with AI

Learn to scrape like a pro with Claude.

Point Claude at the public internet and get back almost anything you need: a list of your whole market, a content angle, a dataset nobody else has. The free playbook shows you how.

Scrape With Claude, the free playbook

Use cases

The three ways pros use Claude in 2026.

Pebble Beach Golf Links ✓ verified
Erin Hills ✓ verified
Chambers Bay ✓ verified
1
Build the list

Find all of the companies and contacts you want to sell to. Their names, the software each company runs, verified email addresses, phone numbers and websites.

1,680 rows scraped dataset
nobody else has it
→ one post nobody can copy
2
Create content

Scrape a dataset nobody else has, then turn it into content nobody else can make. Proprietary data is the unfair advantage in a feed full of the same takes.

pebblebeach.com legacy system
erinhills.com modern system
chambersbaygolf.com legacy system
3
Find the signal

The best conversations start with a clue. Something public about a company that gives you a reason to reach out, an angle the next rep won't have. Claude pulls those signals at scale.

Golf course

See a real scraping project

Scrape all 16,000 golf courses in the US.

Imagine you sell booking software to golf courses. Here's your whole market, mapped: every course, the kind it is, the system it already runs. 91% of private clubs run just three platforms. That kind of pattern is what turns a list into a pipeline.

See the whole project

Inside the playbook

Seven scraping techniques explained in detail.

The full method in plain English, with prompts you can copy.

01
The workhorse
Turn any website into a clean list
02
Pages that load late
Scrape the sites that need a real browser
03
Hidden data
Get the data a site loads behind the scenes
04
Customer lists
Build a competitor's customer list
05
Hidden pages
Find a website's hidden pages
06
Blocked sites
Reach the sites that try to block you
07
Technographics
See what software any business runs
+
Bonus chapter · Contacts
Find anyone's work email for three cents

The shortcut

30 free APIs (or free trials) you can use for your first scrape.

The fastest scrape is the one you don't have to do. A lot of what you'd scrape the hard way is already published, clean and free. Thirty of them are in the playbook. Here's a taste.

Free · no key18 in the book
OpenStreetMap / Overpassevery business on a map
SEC EDGARevery US public company filing
NPI Registryevery US healthcare provider
ProPublica Nonprofits1.8M nonprofits with officers
crt.shevery subdomain a company owns
Common Crawl250B web pages, searchable
Free · just sign up9 in the book
Serper.devreal Google results as an API
Socrata / data.govthousands of open gov datasets
GitHub APIdevs, orgs, repos, commit emails
Reddit APIposts and users by subreddit
YouTube Data APIchannels, videos, comments
US Census / USAspendingbusiness stats, who won contracts
Cheap · not free3 in the book
Huntera company's email pattern, 25 free/mo
Bouncerverify an email, ~half a cent each
Perplexity Sonarfind an email or fact, half a cent

The tools

The sources, scrapers, and destinations it all runs on.

Everything runs in Claude Code. These are the tools the plays reach for, the places the data comes from, and where it lands when you're done.

Claude Code Playwright CloakBrowser Bright Data Apify OpenRouter Google Maps LinkedIn Reddit Instagram YouTube industry directories government datasets any prospect's website HubSpot Salesforce Google Sheets Instantly Smartlead ad audiences anything with an API

The next step

Get the playbook. Run your first scrape this week.

Seven techniques, 30 free data sources, four copy-paste playbooks, a five-minute setup. Free.

Who's behind this

I'm Chris. I do marketing and GTM engineering, with over 10 years in B2B SaaS. I've used Claude to create over $10,700,000 in pipeline, so I wrote down how I actually do it.

@chris_as_is