Bright Data | Pre-Built Scrapers That Only Charge for Success

Bright Data has a reputation problem among solo directory builders. People see it as the expensive enterprise option, the one with 50,000 business customers and an account manager, and most of them skip straight past it.

What they miss is that the Web Scraper API has a permanent free tier of 5,000 records a month, with no credit card required.

Five thousand records is a working directory. It isn't a demo, ten rows or a seven-day window. You get it every month for nothing.

That changes who this tool is for.

Why data quality decides whether a directory works

A directory is only as useful as its listings. If half the phone numbers are wrong, the same business appears three times, or a shop that closed last year is still listed, visitors stop trusting the site. Google tends to treat thin or duplicate listing pages the same way: it crawls them and declines to index them.

So the job isn't just "get 1,000 rows." It's getting rows that are:

• Complete. Every listing has the fields your template displays, so no page looks half-built.
• Unique. Each business appears once, matched on a stable ID rather than a name that might be spelled two ways.
• Current. You can re-check listings on a schedule instead of letting them rot.
• Structured. You get clean fields that map to your CSV importer, not a wall of HTML you have to parse.

Bright Data is strong on all four, and the reasons are below.

The billing model is the real story

Bright Data bills per delivered record, and it doesn't charge for failures.

That sounds like small print until you've used a credit-metered scraper. On most tools, a run that hits CAPTCHAs, gets rate limited and returns half-empty rows still burns your credits. You pay for the attempt, so a misconfigured scrape or a hardened target can cost real money and return nothing.

Here you pay only for records that actually arrive, and Bright Data carries the risk of failure.

If you're learning, that matters more than a lower headline rate. Your first few scrapes will be misconfigured. Everyone's are.

One caveat on price. Bright Data doesn't publish a flat per-record figure. The pay-as-you-go and Scale rates are calculated at checkout in your local currency, and the USD price is the binding one. Budget from a real quote, not a number you read somewhere.

Pricing structure

Every tier gets the full feature set, not a stripped-down version. That covers:

• automated proxy management and residential proxies
• full browser rendering and CAPTCHA solving
• worldwide geotargeting, user-agent rotation and custom headers
• unlimited concurrent requests
• batch and scheduled collection, plus job management APIs
• data validation, JSON or CSV output, and delivery by webhook or API

Unlimited concurrency on the free tier is unusual. Most tools throttle free users hard.

The scraper library, and the one that matters most

You aren't writing scrapers. You pick one from a library of pre-built extractors, each of which already knows its target's output shape.

Google Maps full information is the one that matters for a local directory. Each record returns place_id, URL, country, name, category, address, description and business details. The place_id is Google's own identifier for a place. That gives you a reliable key to deduplicate on, and a way to re-query a listing later without matching on fuzzy business names. There's also a version that discovers records by location search, so you can point it at an area instead of feeding it URLs.

Beyond Maps, the library covers:

• LinkedIn people profiles, company information and job listings
• Amazon products, with several discovery methods
• Instagram profiles
• Crunchbase companies

Those map neatly onto real directory types.

Use cases: what this looks like for a real directory

1. Seeding a local service directory

Say you're launching "Dog Groomers in Texas."

1. Run the Google Maps location-search scraper for "dog groomer" across your target cities.
2. Export to CSV with name, category, address, URL and place_id.
3. Deduplicate on place_id. Chains and businesses listed under two categories collapse to one row.
4. Import into your directory, then write your own short description for each listing rather than reusing Google's text.

A few hundred groomers across a handful of cities fits comfortably inside the free 5,000 a month, so you can launch with real listings before spending anything.

2. Building a startup or B2B tools directory

For a directory like "AI startups in fintech," Maps doesn't help. Combine two sources instead:

• Crunchbase companies for the company list, description and category.
• LinkedIn company information to add headcount, industry and a profile link.

Because both scrapers come from one account with one billing model, you aren't stitching two vendors together. Listings with headcount and industry filled in also give you filters, such as "under 50 employees", which turn a plain list into a useful directory page.

3. Running a niche job board

A job board is a directory that goes stale weekly. The LinkedIn job listings scraper, set on a schedule, pulls new roles for your niche (say, "remote Rust developer") every few days. Expired roles drop out when they stop appearing in the feed. Scheduled collection is included on every tier, so this works on the free plan if your volume is modest.

4. Keeping an existing directory fresh

Already have 2,000 listings? Re-run the Maps scraper against the place_ids you stored and compare. A changed address, a new phone number or a missing record tells you which listings to update or retire. That's how you stop a directory rotting without checking every listing by hand.

Where it beats the alternatives

Against Apify: first-party maintenance. Apify's Actors are community-built, so quality varies and some are abandoned. Bright Data builds and maintains its own scrapers as its product, so you don't have to check a last-updated date before you commit.

Against ScraperAPI: you get structured records, not HTML. ScraperAPI hands you a page and you write the parser. Bright Data hands you parsed fields, which means less control but far less work.

Against everything: the failure billing. None of the others promise not to charge for what they couldn't deliver, and on hardened targets that's where the money leaks.

Where it doesn't fit

The pricing is opaque. Every other tool in this category puts a number on a page. Here you get a slider and a checkout quote, which makes comparison harder and surprises easier.

It's built for volume. The interface, the docs and the support model all assume you're a company with a data pipeline, not one person building a niche site. Nothing about it is hostile to solo users, but nothing is designed for them either.

The library is broad but not infinite. If your source is a regional trade association's member page, there's no pre-built scraper for it and there won't be one. Use Browse AI or Octoparse for that.

The free tier refills monthly. You get 5,000 records a month, not 5,000 at once. If you need 30,000 rows to launch, you either wait six months or pay.

Common questions

Is the free tier really permanent? Yes. It's a recurring monthly allowance on the Web Scraper API, not a trial, and you don't need a card to start.

What counts as a record? One delivered item, such as one business from Maps or one profile from LinkedIn. Failed deliveries aren't counted or charged.

Do I need to code? Less than you'd think. There are no-code scraper options alongside the API, and delivery can go by webhook to wherever your directory reads from. It's still more technical than Octoparse.

How does this compare to Outscraper for Google Maps? Outscraper is simpler and cheaper to start with if Google Maps is your only source. Bright Data is better if you want several sources under one account, need serious concurrency, or want the failure-billing protection.

Can I use scraped Google Maps data on my directory? Business facts like names, addresses and categories are generally fine to aggregate. Don't republish descriptions, reviews or photos word for word. Write your own descriptions and check each source's terms. This isn't legal advice.

Verdict

Ignore the enterprise framing and look at the free tier.

You get 5,000 delivered records a month with unlimited concurrency, a first-party Google Maps scraper that returns place_id, and no charge for failed attempts. That's a better starting position than most paid plans elsewhere. The catch is the monthly pace, not what the tool can do.

Use it this way: run the free 5,000 against your best source, check that the fields match what your listing pages need, and let the allowance refill while you build the site. If your directory outgrows that, you'll know the data is good before you put a card in.

Get 5,000 free records a month with Bright Data

This is an affiliate link. If you upgrade to a paid plan, I may earn a commission at no extra cost to you. Details here.

Comparing options? See every tool in scraping tools for directories.