Real estate scraping

Skill thirdwatch-dev/scraping-skills/skills/real-estate-scraping

Use when you need property or real-estate listing data — sale and rental listings, asking prices, BHK / bed-bath counts, carpet/built-up area, floor, location and coordinates, and agent/owner details. Covers Rightmove (UK), 99acres, MagicBricks, NoBroker, CommonFloor (India), and Craigslist housing. Triggers on "scrape property listings", "real estate data", "rental prices", "property prices", "housing", "for-sale listings", "rental comps", "real estate lead gen".From its SKILL.md

Install

npx -y skills add thirdwatch-dev/scraping-skills --skill real-estate-scraping

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

4 things to look at

reads credentialsReads from 1 credential source: `YOUR_APIFY_TOKEN`.
3 stars3 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.
runs commandsInstructs the agent to run 1 command, including `curl -X POST "https://api.apify.com/v2/acts/thirdwatch~rightmove-scraper/run-sync-get-dataset-items?token=YOUR_APIFY_TOKEN" \ -H "Content-Type: application/json" \ -d '{ "location": "London", `.
fetches URLsInstructs the agent to fetch 1 URL, including https://api.apify.com/v2/acts/thirdwatch~rightmove-scraper/run-sync-get-dataset-items?token=YOUR_APIFY_TOKEN.

What its file declares

Copied from the file, not written here

The file declares its own license as MIT. That is the author’s claim about this one file, and it is not the same thing as the license GitHub reports for the repository, which is listed with the other numbers below.

SKILL.md

3.6 KB, 852 tokens by cl100k_base, as published. Nobody here has run it

Real-Estate Scraping

Property portals are some of the most JSON-friendly targets on the web. Most render listing data server-side and embed it in __NEXT_DATA__ / __NUXT__ or a JSON-LD block, or load it from an internal search API you can call directly — so you rarely need a browser. The fields that matter for almost every use case:

Price — asking price (sale) or monthly rent; watch for currency, "price on request", and per-sqft figures.
Configuration — BHK / bedrooms + bathrooms, furnishing status, property type (apartment, villa, plot, PG, commercial).
Area — carpet, built-up, and super built-up area (and the unit — sqft vs sqm).
Location — locality, city, full address, and lat/lng coordinates for mapping and comps.
Listing meta — floor / total floors, listing age, sale-vs-rent, photos.
Source — agent vs owner-direct, agent/brokerage name, and (in India) the RERA registration ID.

Common use cases: price monitoring, market/area analysis, rental comps, and lead generation for agents.

Ready-made scrapers

These are maintained, pay-per-result scrapers — anti-bot upkeep and field extraction are handled for you.

Target	Scraper	From	Notes
Rightmove (UK)	Rightmove	$0.002/result	for-sale + to-rent, agent data, coords, 20+ fields
99acres (India)	99acres	$0.003/result	rent/buy/PG/commercial, RERA ID, 40+ fields
MagicBricks (India)	MagicBricks	$0.003/result	rent/buy, BHK/area/floor/furnishing
NoBroker (India)	NoBroker	$0.003/result	owner-direct, no brokerage
CommonFloor (India)	CommonFloor	$0.003/result	rent/buy/PG, 25+ fields
Craigslist (housing)	Craigslist	$0.0015/result	apartments/rooms by city

Run one

Each scraper returns listing rows as JSON. Run one from the command line:

curl -X POST "https://api.apify.com/v2/acts/thirdwatch~rightmove-scraper/run-sync-get-dataset-items?token=YOUR_APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "location": "London",
    "listingType": "for-sale",
    "maxResults": 25
  }'

Get a free token at console.apify.com. Exact input fields are on each actor's Store page (linked in the table above).

Build your own

No maintained scraper for the portal you need? Start with web-scraping-playbook for the build-vs-buy decision and the cost-first technique ladder (try the internal search API / embedded JSON before reaching for a browser). If the site fights back with Cloudflare, DataDome, or similar, see anti-bot-scraping. To package your scraper as a deployable, monetizable Apify Actor, see apify-actor-builder.

Maintained by Thirdwatch. 70+ ready-made scrapers on the Apify Store.

What ships with it

Read from the repository

Just SKILL.md. No reference files, no scripts.