Bright Data
Search, Crawl and Scrape any site, at scale, without getting blocked
1.0.2Bright Data is a web data platform that enables scraping, searching, and structured data extraction from any site at scale without being blocked. This toolkit gives Arcade agents access to Bright Data's proxy and data infrastructure for web research and data collection workflows.
Capabilities
- Web scraping: Fetch any public webpage and return its content as clean Markdown, suitable for LLM consumption or downstream processing.
- Multi-engine search: Query Google, Bing, or Yandex with configurable result count, country targeting, and content type (web, images, etc.).
- Structured data feeds: Extract pre-structured JSON records from a wide range of platforms including Amazon, LinkedIn, Instagram, Facebook, X, YouTube, Zillow, Booking.com, and ZoomInfo — no custom parsing required.
Secrets
This toolkit requires no OAuth flow but does require two secrets configured in Arcade.
BRIGHTDATA_API_KEY
Your Bright Data API key authenticates all requests to the Bright Data platform. Obtain it from the Bright Data dashboard under Account Settings → API Tokens. You must have an active Bright Data account; free trials are available but some endpoints may require a paid plan.
BRIGHTDATA_ZONE
A Bright Data "zone" identifies the proxy or dataset product (e.g., a Web Unlocker zone or a specific dataset zone) your requests route through. Zones are created and named in the Bright Data control panel under Proxies & Scraping Infrastructure. The zone name is a short string (e.g., web_unlocker1) shown in the zone's settings page. Different tools may require different zone types — confirm the zone type matches the capability you intend to use (scraping/search vs. structured data feeds).
Store both secrets in Arcade at https://api.arcade.dev/dashboard/auth/secrets. For general guidance on secrets in Arcade tools, see https://docs.arcade.dev/en/guides/create-tools/tool-basics/create-tool-secrets.
Available tools(3)
| Tool name | Description | Secrets | |
|---|---|---|---|
Scrape a webpage and return content in Markdown format using Bright Data.
Examples:
scrape_as_markdown("https://example.com") -> "# Example Page
Content..."
scrape_as_markdown("https://news.ycombinator.com") -> "# Hacker News
..."
| 2 | ||
Search using Google, Bing, or Yandex with advanced parameters using Bright Data.
Examples:
search_engine("climate change") -> "# Search Results
## Climate Change - Wikipedia
..."
search_engine("Python tutorials", engine="bing", num_results=5) -> "# Bing Results
..."
search_engine("cats", search_type="images", country_code="us") -> "# Image Results
..."
| 2 | ||
Extract structured data from various websites like LinkedIn, Amazon, Instagram, etc.
NEVER MAKE UP LINKS. IF LINKS ARE NEEDED, FIND THEM WITH A WEB SEARCH FIRST.
Supported source types:
- amazon_product, amazon_product_reviews
- linkedin_person_profile, linkedin_company_profile
- zoominfo_company_profile
- instagram_profiles, instagram_posts, instagram_reels, instagram_comments
- facebook_posts, facebook_marketplace_listings, facebook_company_reviews
- x_posts
- zillow_properties_listing
- booking_hotel_listings
- youtube_videos
Examples:
web_data_feed("amazon_product", "https://amazon.com/dp/B08N5WRWNW")
-> "{"title": "Product Name", ...}"
web_data_feed("linkedin_person_profile", "https://linkedin.com/in/johndoe")
-> "{"name": "John Doe", ...}"
web_data_feed(
"facebook_company_reviews", "https://facebook.com/company", num_of_reviews=50
) -> "[{"review": "...", ...}]" | 1 |