Yelp Scraping Parameters
Web Scraper API Yelp Scraping Parameters
Configure Yelp Scraping Parameters using Thordata's Web Scraper API, including Search URL, Business URL, Category, Location, and other parameters.
Unique Identifier:
token，Access token(required)
This parameter is used as the API access token to ensure the legitimacy of the scraping request.
Request examples:
Authorization: Bearer ********************
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer ********************" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=yelp.com" ^
-d "spider_id=yelp_business-overview_by-search-filters" ^
-d "spider_parameters=[{\"category\": \"cafe\",\"location\": \"new york\",\"business_page_turning\": \"1\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
Product - Scrape business information:
1. Yelp - Scrape business information by Search Filters
spider_id ，Scraper tool (required)
Defines which scraper tool to use.
Request examples:
spider_id=yelp_business-overview_by-search-filters
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=yelp.com" ^
-d "spider_id=yelp_business-overview_by-search-filters" ^
-d "spider_parameters=[{\"category\": \"cafe\",\"location\": \"new york\",\"business_page_turning\": \"1\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
category ，Category (required)
This parameter specifies the category to be scraped.
Request examples:
"category": "cafe"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=yelp.com" ^
-d "spider_id=yelp_business-overview_by-search-filters" ^
-d "spider_parameters=[{\"category\": \"cafe\",\"location\": \"new york\",\"business_page_turning\": \"1\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
location ，Location (required)
This parameter specifies the location to be scraped.
Request examples:
"location": "new york"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=yelp.com" ^
-d "spider_id=yelp_business-overview_by-search-filters" ^
-d "spider_parameters=[{\"category\": \"cafe\",\"location\": \"new york\",\"business_page_turning\": \"1\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
business_page_turning，Max business pages (optional)
This parameter specifies the pages to collect.
Request examples:
"business_page_turning": "1"
2. Yelp - Scrape business information by Search URL
spider_id ，Scraper tool (required)
Defines which scraper tool to use.
Request examples:
spider_id=yelp_business-overview_by-search-url
search_url ，Search URL (required)
This parameter specifies the Search URL to be scraped.
Request examples:
"search_url": "https://www.yelp.com/search?find_desc=Cafes%26find_loc=Stowe%2C%2BVT"
business_page_turning，Max business pages (optional)
This parameter specifies the pages to collect.
Request examples:
"business_page_turning": "1"
3. Yelp - Scrape business information by Business URL
spider_id ，Scraper tool (required)
Defines which scraper tool to use.
Request examples:
spider_id=yelp_business-overview_by-business-url
business_url ，Business URL (required)
This parameter specifies the Business URL to search.
Request examples:
"business_url": "https://www.yelp.com/biz/the-round-hearth-caf%C3%A9-and-marketplace-stowe?osq=Sandwiches"
Product - Scrape business reviews information:
1. Yelp - Scrape business reviews information by Search Filters
spider_id ，Scraper tool(required)
Defines which scraper tool to use.
Request examples:
spider_id=yelp_business-reviews_by-search-filters
category， Category（required）
This parameter specifies the business category for crawling.
Request examples:
"category": "cafe"
location，Location（required）
This parameter specifies the business location for crawling.
Request examples:
"location": "Stowe, VT"
business_page_turning，Max business pages（optional）
This parameter specifies the max business pages for crawling.
Request examples:
"business_page_turning": "1"
review_page_turning，Max review pages（optional）
This parameter specifies the max review pages for crawling.
Request examples:
"max review pages": "1"
2. Yelp - Scrape business reviews information by Search URL
spider_id ，Scraper tool (required)
Defines which scraper tool to use.
Request examples:
spider_id=yelp_business-overview_by-search-url
search_url，Search URL (required)
This parameter specifies the Search URL for crawling.
Request examples:
"search_url": "https://www.yelp.com/search?find_desc=Cafes%26find_loc=Stowe%2C%2BVT"
3. Yelp - Scrape business reviews information by Business URL
spider_id ，Scraper tool (required)
Defines which scraper tool to use.
Request examples:
spider_id=yelp_business-overview_by-business-url
business_url，Business URL(required)
This parameter specifies the Business URL for crawling.
Request examples:
"business_url": "https://www.yelp.com/biz/the-round-hearth-caf%C3%A9-and-marketplace-stowe?osq=Sandwiches"
unrecommended_reviews，Unrecommended Reviews(required)
This parameter is used to specify whether to capture unrecommended comments.
Request examples:
"unrecommended_reviews": "yes"
sort_by，Sort by(optional)
This parameter is used to specify the sorting method for capturing comments.
Request examples:
"sort_by": "DATE_DESC"
review_page_turning，Max review pages(optional)
This parameter is used to specify the max review pages to collect.
Request examples:
"review_page_turning": "1"
If you need further assistance, please contact us via email at [email protected].
Last updated
Was this helpful?