Amazon Scraping Parameters

Using Thordata's Web Scraper API to configure Amazon scraping parameters, including: Product, Token, Scraping URLs, Seller URLs, Domain, Keywords, Sort Method, UPC, Max Page Count, Subcategories, etc.

Unique Identifier:

token ,Access Token (Required)

This parameter is used as an API access token to ensure the legitimacy of crawling requests.

Request Example: "Authorization: Bearer ********************************" 

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer ********************************" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"zip_code\": \"94107\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

I、Product - Tool for Scraping Product Information:

  1. Amazon - Collect product information via URL

spider_id ,Associated Scraping Tool (Required)

This parameter defines which scraping tool to use.

Request Example: spider_id=amazon_product_by-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"zip_code\": \"94107\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
url ,Target URL for Scraping (Required)

This parameter specifies the Amazon URL to be scraped.

Request Example: "url": "https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"zip_code\": \"94107\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
zip_code ，Postal code (Optional)

This parameter is used to specify the postal code of the delivery area in the crawled page.

Request Example:

"zip_code": "94107"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"zip_code\": \"94107\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

  1. Amazon - Collect product information via bestseller URLs

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: spider_id=amazon_product_by-best-sellers

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-best-sellers" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"collect_child_categories\": \"\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
url ,Target URL for Scraping (Required)

This parameter specifies the Amazon category page URL to be scraped.

Request Example: "url": "https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-best-sellers" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"collect_child_categories\": \"\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
collect_child_categories ,Subcategories (Optional)

This parameter specifies the scope of subcategory products to collect under the main category.

Request Example: "collect_child_categories":""

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-best-sellers" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"collect_child_categories\": \"\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

  1. Amazon - Collect product data via Category URL

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: spider_id=amazon_product_by-category-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-category-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
url，Crawl category template link (required)

This parameter is used to specify the Amazon access URL address to be crawled.

Request Example:

"url":"https://www.amazon.com/s?i=luggage-intl-ship"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-category-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
sort_by ,Sort Method (Optional)

This parameter configures the sorting method when scraping category pages. Supported values include:

Best Sellers Newest Arrivals Average Rating Price: High to Low Price: Low to High Featured Recommendations

Request Example: "sort_by":"Best Sellers"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-category-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

  1. Amazon - Collect product info via Keywords

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: spider_id=amazon_product_by-keywords

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-keywords" ^
  -d "spider_parameters=[{\"keyword\": \"Apple Watch\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
keyword ,Keyword (Required)

This parameter specifies the search keyword used when scraping Amazon products.

Request Example: "keyword":"Apple Watch"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-keywords" ^
  -d "spider_parameters=[{\"keyword\": \"Apple Watch\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

  1. Amazon - Collect product info via UPC

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: spider_id=amazon_product_by-upc

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-upc" ^
  -d "spider_parameters=[{\"upc\": \"841710108224\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
upc ,UPC (Required)

The UPC corresponding to the Amazon product. Note that a single UPC may be associated with multiple products.

Request Example: "upc":"841710108224"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-upc" ^
  -d "spider_parameters=[{\"upc\": \"841710108224\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

II、Product - Product Review Scraping Tools:

  1. Amazon - Collect product reviews via URL

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: spider_id=amazon_comment_by-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_comment_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
url ,Target URL for Scraping (Required)

This parameter specifies the Amazon URL to scrape.

Request Example: "url": "https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_comment_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

III、Product - Global Product Info Scraping Tools:

  1. Amazon - Collect global product data via URL

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: spider_id=amazon_global-product_by-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/dp/B0CHHSFMRL/\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
url ,Target URL for Scraping (Required)

This parameter specifies the Amazon URL to be scraped.

Request Example: "url": "https://www.amazon.com/dp/B0CHHSFMRL/"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/dp/B0CHHSFMRL/\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

2.1 Amazon - Collect global product data via Brand

spider_id , Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: spider_id=amazon_global-product_by-brand

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-brand" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?k=football%26i=fashion%26rh=n%3A7141123011%2Cp_123%3A233083\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
url ,Target URL for Scraping (Required)

This parameter specifies the Amazon URL to be scraped.

Request Example: "url": "https://www.amazon.com/s?k=football%26i=fashion%26rh=n%3A7141123011%2Cp_123%3A233083"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-brand" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?k=football%26i=fashion%26rh=n%3A7141123011%2Cp_123%3A233083\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

2.2. Amazon - Collecting global product data by keyword or brand

spider_id ，Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example:

spider_id=amazon_global-product_by-keywords-brand 

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-keywords-brand" ^
  -d "spider_parameters=[{\"keyword\": \"shirts\",\"brands\": \"Adidas\",\"page_turning\": \"2\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
keyword ， Keywords (Required)

This parameter is used to specify the search keywords used when crawling Amazon products.

Request Example:

"keyword": "shirts"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-keywords-brand" ^
  -d "spider_parameters=[{\"keyword\": \"shirts\",\"brands\": \"Adidas\",\"page_turning\": \"2\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
brands ，Brand (Required)

This parameter is used to specify the brand information to be crawled. Please enter a brand name that exists on the Amazon platform. If the brand option is not found, the crawl field will be empty.

Request Example:

"brands": "Adidas"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-keywords-brand" ^
  -d "spider_parameters=[{\"keyword\": \"shirts\",\"brands\": \"Adidas\",\"page_turning\": \"2\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
page_turning ，Number of crawled pages (Required)

This parameter is used to set the number of pages of search results to crawl. Entering a number n means crawling all product data from page 1 to page n. Parameter value：1-100000

Request Example:

"page_turning": "2"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-keywords-brand" ^
  -d "spider_parameters=[{\"keyword\": \"shirts\",\"brands\": \"Adidas\",\"page_turning\": \"2\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

  1. Amazon - Collect global product data via Category URL

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: spider_id=amazon_global-product_by-category-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-category-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
url，Crawl category template link (Required)

This parameter is used to specify the Amazon access URL address to be crawled.

Request Example:

"url": "https://www.amazon.com/s?i=luggage-intl-ship"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-category-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
sort_by ,Sort Method (Optional)

This parameter configures the sorting method when scraping category pages. Supported values include:

Best Sellers Newest Arrivals Average Rating Price: High to Low Price: Low to High Featured Recommendations

Request Example: "sort_by":"Best Sellers"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-category-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
get_sponsored ,Get Sponsored Products (Optional)

This parameter is used to configure whether sponsored products should also be collected, even if they don't belong to the specified category. Parameter values: true or false

Request Example: "get_sponsored":"true"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-category-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

  1. Amazon - Collect global product data via Keywords

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: spider_id=amazon_global-product_by-keywords

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-keywords" ^
  -d "spider_parameters=[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
keyword ,Keyword (Required)

This parameter specifies the search keyword used when scraping Amazon products.

Request Example: "keyword":"Mitutoyo"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-keywords" ^
  -d "spider_parameters=[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
domain ,Main Domain (Required)

This parameter is used to specify the seller's homepage URL in order to scrape product data sold by that seller.

Request Example: "domain":"https://www.amazon.com"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-keywords" ^
  -d "spider_parameters=[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
page_turning ,Pages to Search back (Optional)

This parameter sets the number of search result pages to scrape. Entering a number n means products from page 1 to page n will be scraped.

Request Example: "page_turning":"1"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-keywords" ^
  -d "spider_parameters=[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

  1. Amazon - Collect global product data through sellers

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool is used.

Request Example: spider_id=amazon_global-product_by-seller-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-seller-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.de/stores/page/DE4854A4-1CF9-4C69-BF27-17B0E692ACF0\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
url ,Target URL for Scraping (Required)

This parameter specifies the Amazon URL to be scraped.

Request Example: "url":"https://www.amazon.de/stores/page/DE4854A4-1CF9-4C69-BF27-17B0E692ACF0"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-seller-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.de/stores/page/DE4854A4-1CF9-4C69-BF27-17B0E692ACF0\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

IV、Product - Tool for Scraping Seller Information:

  1. Amazon - Collect seller information via URL

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool is used.

Request Example: spider_id=amazon_seller_by-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_seller_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/sp?ie=UTF8%26seller=ADZ7LD48GVFQJ%26asin=B07H56J7K1%26ref_=dp_merchant_link%26isAmazonFulfilled=1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
url ,Target URL for Scraping (Required)

This parameter specifies the Amazon URL to be scraped.

Request Example:

"url": "https://www.amazon.com/sp?ie=UTF8%26seller=ADZ7LD48GVFQJ%26asin=B07H56J7K1%26ref_=dp_merchant_link%26isAmazonFulfilled=1"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_seller_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/sp?ie=UTF8%26seller=ADZ7LD48GVFQJ%26asin=B07H56J7K1%26ref_=dp_merchant_link%26isAmazonFulfilled=1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

V、Product - Scraping Product Lists:

  1. Amazon - Collect product lists via keywords

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: spider_id=amazon_product-list_by-keywords-domain

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product-list_by-keywords-domain" ^
  -d "spider_parameters=[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
keyword ,Keyword (Required)

This parameter specifies the search keyword used when scraping Amazon products.

Request Example: "keyword": "X-box"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product-list_by-keywords-domain" ^
  -d "spider_parameters=[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
domain ,Main Domain (Required)

This parameter is used to specify the seller's homepage URL in order to scrape product data sold by that seller.

Request Example: "domain": "https://www.amazon.com/"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product-list_by-keywords-domain" ^
  -d "spider_parameters=[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
page_turning ,Pages to Search back (Optional)

This parameter sets the number of search result pages to scrape. Entering a number n means products from page 1 to page n will be scraped.

Request Example: "page_turning":"1"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product-list_by-keywords-domain" ^
  -d "spider_parameters=[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

If you need further help, please contact us at [email protected].

PreviousYouTube Scraping ParametersNextFacebook Scraping Parameters

Last updated

Was this helpful?