agentsclimarketplace

Real estate scraping

Skill thirdwatch-dev/scraping-skills/skills/real-estate-scraping

Web scraping skills for Claude & coding agents — anti-bot bypass, build-vs-buy, and ready-made scrapers for jobs, e-commerce, reviews, social, leads, real estate, travel, food & SEO. npx skills add thirdwatch-dev/scraping-skills

Install
npx -y skills add thirdwatch-dev/scraping-skills --skill real-estate-scraping

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

  • 3 stars3 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

What its author says it does

Copied from the file, not written here

Use when you need property or real-estate listing data — sale and rental listings, asking prices, BHK / bed-bath counts, carpet/built-up area, floor, location and coordinates, and agent/owner details. Covers Rightmove (UK), 99acres, MagicBricks, NoBroker, CommonFloor (India), and Craigslist housing. Triggers on "scrape property listings", "real estate data", "rental prices", "property prices", "housing", "for-sale listings", "rental comps", "real estate lead gen".

The file declares its own license as MIT. That is the author’s claim about this one file, and it is not the same thing as the license GitHub reports for the repository, which is listed with the other numbers below.

SKILL.md

3.6 KB, as published. Nobody here has run it

Real-Estate Scraping

Property portals are some of the most JSON-friendly targets on the web. Most render listing data server-side and embed it in __NEXT_DATA__ / __NUXT__ or a JSON-LD block, or load it from an internal search API you can call directly — so you rarely need a browser. The fields that matter for almost every use case:

  • Price — asking price (sale) or monthly rent; watch for currency, "price on request", and per-sqft figures.
  • Configuration — BHK / bedrooms + bathrooms, furnishing status, property type (apartment, villa, plot, PG, commercial).
  • Area — carpet, built-up, and super built-up area (and the unit — sqft vs sqm).
  • Location — locality, city, full address, and lat/lng coordinates for mapping and comps.
  • Listing meta — floor / total floors, listing age, sale-vs-rent, photos.
  • Source — agent vs owner-direct, agent/brokerage name, and (in India) the RERA registration ID.

Common use cases: price monitoring, market/area analysis, rental comps, and lead generation for agents.

Ready-made scrapers

These are maintained, pay-per-result scrapers — anti-bot upkeep and field extraction are handled for you.

TargetScraperFromNotes
Rightmove (UK)Rightmove$0.002/resultfor-sale + to-rent, agent data, coords, 20+ fields
99acres (India)99acres$0.003/resultrent/buy/PG/commercial, RERA ID, 40+ fields
MagicBricks (India)MagicBricks$0.003/resultrent/buy, BHK/area/floor/furnishing
NoBroker (India)NoBroker$0.003/resultowner-direct, no brokerage
CommonFloor (India)CommonFloor$0.003/resultrent/buy/PG, 25+ fields
Craigslist (housing)Craigslist$0.0015/resultapartments/rooms by city

Run one

Each scraper returns listing rows as JSON. Run one from the command line:

curl -X POST "https://api.apify.com/v2/acts/thirdwatch~rightmove-scraper/run-sync-get-dataset-items?token=YOUR_APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "location": "London",
    "listingType": "for-sale",
    "maxResults": 25
  }'

Get a free token at console.apify.com. Exact input fields are on each actor's Store page (linked in the table above).

Build your own

No maintained scraper for the portal you need? Start with web-scraping-playbook for the build-vs-buy decision and the cost-first technique ladder (try the internal search API / embedded JSON before reaching for a browser). If the site fights back with Cloudflare, DataDome, or similar, see anti-bot-scraping. To package your scraper as a deployable, monetizable Apify Actor, see apify-actor-builder.


Maintained by Thirdwatch. 70+ ready-made scrapers on the Apify Store.

Keep looking

Skills are one crate of 328,083. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.