A Directory website showcasing the best platforms and software tools to build an online directory website. Hey 👋 I'm Andrew. I created this site to help simplify the process of creating niche directories.
Bright Data | Pre-Built Scrapers That Only Charge for Success
Contact
Bright Data | Pre-Built Scrapers That Only Charge for Success
A library of ready-made scrapers including Google Maps, LinkedIn and Crunchbase, billed per delivered record with nothing charged for failures. The free tier gives 5,000 records a month.
Bright Data Review: The Enterprise Tool With a Free Tier Nobody Mentions
Bright Data has a reputation problem among solo directory builders. It reads as the expensive enterprise option, the one with 50,000 business customers and an account manager, and most people skip straight past it.
So here is the thing that gets missed. The Web Scraper API has a permanent free tier of 5,000 records a month, with no credit card required.
Five thousand records is a working directory. Not a demo, not ten rows, not a seven-day window. Every month, for nothing.
That changes who this tool is for.
The billing model is the real story
Bright Data bills per delivered record, and it does not charge for failures.
That sounds like small print until you have used a credit-metered scraper. On most tools, a run that hits CAPTCHAs, gets rate limited and returns half-empty rows still burns your credits. You pay for the attempt. Which means a misconfigured scrape or a hardened target can cost you real money and return nothing.
Here you pay for records that actually arrive. The failure risk sits with Bright Data, not with you.
For someone learning, that is worth more than a lower headline rate. Your first few scrapes will be misconfigured. Everyone's are.
One caveat on the price itself. Bright Data does not publish a flat per-record figure. The pay-as-you-go and Scale rates are calculated at checkout in your local currency, and USD is the binding price. So budget from a real quote rather than a number you read somewhere, and note that they were running a 25% discount code on Scraper API at the time of writing.
Pricing structure
| Tier | What you get |
|---|---|
| Free | 5,000 records per month, no credit card, expert support |
| Pay as you go | Per 1,000 records, monthly spend limits, unlimited concurrency |
| Scale | 384,000 records included, slider-adjustable, cheaper per additional 1,000 |
| Enterprise | Custom volume, account manager, premium SLA, SSO, priority support |
Every tier gets the full feature set rather than a stripped-down version. That means automated proxy management, full browser rendering, CAPTCHA solving, worldwide geotargeting, residential proxies, user agent rotation, custom headers, unlimited concurrent requests, batch and scheduled collection, job management APIs, data validation, JSON or CSV parsing, and delivery by webhook or API.
Unlimited concurrency on the free tier is unusual and worth noting. Most tools throttle their free users hard.
The scraper library, and the one that matters here
You are not writing scrapers. You are picking one from a library of pre-built extractors, each of which knows its target's output shape already.
Google Maps full information is the one that matters for a local directory. It returns place_id, URL, country, name, category, address, description and business details per record. That place_id is Google's own canonical identifier, which gives you a reliable deduplication key and a way to re-query a listing later without matching on fuzzy business names.
There is also a version that discovers records by location search, so you can point it at an area rather than feeding it URLs.
Beyond Maps, the library covers LinkedIn people profiles, LinkedIn company information, LinkedIn job listings, Amazon products across several discovery methods, Instagram profiles and Crunchbase companies. That range maps onto real directory types. Crunchbase for a startup directory, LinkedIn jobs for a niche job board, Instagram for a creator directory.
Where it beats the alternatives
Against Apify: first-party maintenance. Apify's Actors are community-built, so quality varies and some are abandoned. Bright Data builds and maintains its own scrapers as its product, so you are not checking a last-updated date before you commit.
Against ScraperAPI: you get structured records, not HTML. ScraperAPI hands you a page and you write the parser. Bright Data hands you parsed fields. Less control, far less work.
Against everything: the failure billing. Nobody else here says "we do not charge for what we could not deliver," and on hardened targets that is where the money leaks.
Where it does not fit
The pricing opacity is genuinely annoying. Every other tool in this category puts a number on a page. Here you get a slider and a checkout quote, which makes it harder to compare and easier to be surprised.
It is built for volume, and the product design shows it. The interface, the docs and the support model all assume you are a company with a data pipeline, not one person building a niche site. Nothing about it is hostile to solo users, but nothing is shaped for them either.
The library is broad but not infinite. If your source is a regional trade association's member page, there is no pre-built scraper and there never will be. That is Browse AI or Octoparse territory.
And the free tier is 5,000 records a month, not 5,000 records at once. If you need 30,000 rows to launch, you are waiting six months or you are paying.
Common questions
Is the free tier really permanent?
Yes, it is a recurring monthly allowance on the Web Scraper API rather than a trial. No card required to start.
What counts as a record?
One delivered item. One business from Maps, one profile from LinkedIn. Failed deliveries are not counted or charged.
Do I need to code?
Less than you would think. There are no-code scraper options alongside the API, and delivery can go out by webhook to somewhere your directory reads from. It is still more technical than Octoparse.
How does this compare to Outscraper for Maps?
Outscraper is simpler and cheaper to start if Google Maps is your only source. Bright Data is better if you want several sources under one account, need serious concurrency, or want the failure-billing protection.
Can I schedule collection?
Yes, batch and scheduled collection are included on every tier, which makes it viable for keeping a directory fresh rather than only seeding it.
Verdict
Ignore the enterprise framing and look at the free tier.
5,000 delivered records a month, with unlimited concurrency, a first-party Google Maps scraper returning place_id, and no charge for failed attempts, is a better starting position than most paid plans elsewhere. The catch is monthly pacing rather than capability.
The realistic use is this: run the free 5,000 against your best source, see whether the fields match what your listing pages need, and let the allowance refill while you build the site. If your directory outgrows that, you already know the data is good before you put a card in.