Amazon Scraping Parameters

Using Thordata's Web Scraper API to configure Amazon scraping parameters, including: Product, Token, Scraping URLs, Seller URLs, Domain, Keywords, Sort Method, UPC, Max Page Count, Subcategories, etc.

Unique Identifier:

token ,Access Token (Required)

This parameter is used to verify the legitimacy of the scraping request via an API access token.

Request Example: header "Authorization: Bearer ********************************" 

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer ********************************" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726\",\"zip_code\": \"94107\"}],\"spider_id\":\"amazon_product_by-url\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"

Product - Product Info Scraping Tools:

  1. Amazon - Collect product info via URL

spider_id ,Associated Scraping Tool (Required)

This parameter defines which scraping tool to use.

Request Example: "spider_id":"amazon_product_by-url"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726\",\"zip_code\": \"94107\"}],\"spider_id\":\"amazon_product_by-url\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
url ,Target URL for Scraping (Required)

This parameter specifies the Amazon URL to be scraped.

Request Example: "url": "https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726\",\"zip_code\": \"94107\"}],\"spider_id\":\"amazon_product_by-url\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"

  1. Amazon - Collect product info via Best Seller URL

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: "spider_id":"amazon_product_by-best-sellers"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"collect_child_categories\": \"\"}],\"spider_id\":\"amazon_product_by-best-sellers\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
url ,Target URL for Scraping (Required)

This parameter specifies the Amazon category page URL to be scraped.

Request Example: [{\"url\":\"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\"}]

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"collect_child_categories\": \"\"}],\"spider_id\":\"amazon_product_by-best-sellers\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
collect_child_categories ,Subcategories (Optional)

This parameter specifies the scope of subcategory products to collect under the main category.

Request Example: "collect_child_categories":""

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"collect_child_categories\": \"\"}],\"spider_id\":\"amazon_product_by-best-sellers\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"

  1. Amazon - Collect product data via Category URL

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: "spider_id":"amazon_product_by-category-url"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/s?i=baby-products-intl-ship\",\"sort_by\": \"Best Sellers\"}],\"spider_id\":\"amazon_product_by-category-url\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
url，Crawl category template link (required)

This parameter is used to specify the Amazon access URL address to be crawled.

Request Example:

"url": "https://www.amazon.com/s?i=baby-products-intl-ship"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/s?i=baby-products-intl-ship\",\"sort_by\": \"Best Sellers\"}],\"spider_id\":\"amazon_product_by-category-url\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
sort_by ,Sort Method (Optional)

This parameter configures the sorting method when scraping category pages. Supported values include:

Best Sellers Newest Arrivals Average Rating Price: High to Low Price: Low to High Featured Recommendations

Request Example: "sort_by":"Best Sellers"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/s?i=baby-products-intl-ship\",\"sort_by\": \"Best Sellers\"}],\"spider_id\":\"amazon_product_by-category-url\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"

  1. Amazon - Collect product info via Keywords

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: "spider_id":"amazon_product_by-keywords"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"keyword\": \"Apple Watch\"}],\"spider_id\":\"amazon_product_by-keywords\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
keyword ,Keyword (Required)

This parameter specifies the search keyword used when scraping Amazon products.

Request Example: \"keyword\":\"Apple Watch\"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"keyword\": \"Apple Watch\"}],\"spider_id\":\"amazon_product_by-keywords\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"

  1. Amazon - Collect product info via UPC

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: "spider_id":"amazon_product_by-upc"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"upc\": \"841710108224\"}],\"spider_id\":\"amazon_product_by-upc\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
upc ,UPC (Required)

The UPC corresponding to the Amazon product. Note that a single UPC may be associated with multiple products.

Request Example: [{\"upc\":\"841710108224\"}]

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"upc\": \"841710108224\"}],\"spider_id\":\"amazon_product_by-upc\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"

Product - Product Review Scraping Tools:

  1. Amazon - Collect product reviews via URL

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: "spider_id":"amazon_comment_by-url"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/LAURA-GELLER-NEW-YORK-Retractable/dp/B086H4VCBJ\"}],\"spider_id\":\"amazon_comment_by-url\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
url ,Target URL for Scraping (Required)

This parameter specifies the Amazon URL to scrape.

Request Example: "url": "https://www.amazon.com/LAURA-GELLER-NEW-YORK-Retractable/dp/B086H4VCBJ"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/LAURA-GELLER-NEW-YORK-Retractable/dp/B086H4VCBJ\"}],\"spider_id\":\"amazon_comment_by-url\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"

Product - Global Product Info Scraping Tools:

  1. Amazon - Collect global product data via URL

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: "spider_id":"amazon_global-product_by-url"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/dp/B0CHHSFMRL/\"}],\"spider_id\":\"amazon_global-product_by-url\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
url ,Target URL for Scraping (Required)

This parameter specifies the Amazon URL to be scraped.

Request Example: [{\"url\":\"https://www.amazon.com/dp/B0CHHSFMRL/\"}]

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/dp/B0CHHSFMRL/\"}],\"spider_id\":\"amazon_global-product_by-url\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"

  1. Amazon - Collect global product data via Brand

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: "spider_id":"amazon_global-product_by-brand"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/s?k=football%26i=fashion%26rh=n%3A7141123011%2Cp_123%3A233083\"}],\"spider_id\":\"amazon_global-product_by-brand\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
url ,Target URL for Scraping (Required)

This parameter specifies the Amazon URL to be scraped.

Request Example: [{\"url\":\"https://www.amazon.com/s?k=football^&i=fashion^&rh=n%3A7141123011%2Cp_123%3A233083\"}]

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/s?k=football%26i=fashion%26rh=n%3A7141123011%2Cp_123%3A233083\"}],\"spider_id\":\"amazon_global-product_by-brand\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"

  1. Amazon - Collect global product data via Category URL

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: "spider_id":"amazon_global-product_by-category-url"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}],\"spider_id\":\"amazon_global-product_by-category-url\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
url，Crawl category template link (required)

This parameter is used to specify the Amazon access URL address to be crawled.

Request Example:

"url": "https://www.amazon.com/s?i=luggage-intl-ship" 

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}],\"spider_id\":\"amazon_global-product_by-category-url\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
sort_by ,Sort Method (Optional)

This parameter configures the sorting method when scraping category pages. Supported values include:

Best Sellers Newest Arrivals Average Rating Price: High to Low Price: Low to High Featured Recommendations

Request Example: "sort_by":"Best Sellers"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}],\"spider_id\":\"amazon_global-product_by-category-url\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
get_sponsored ,Get Sponsored Products (Optional)

This parameter is used to configure whether sponsored products should also be collected, even if they don't belong to the specified category. Parameter values: true or false

Request Example: "get_sponsored":"true"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}],\"spider_id\":\"amazon_global-product_by-category-url\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"

  1. Amazon - Collect global product data via Keywords

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: "spider_id":"amazon_global-product_by-keywords"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}],\"spider_id\":\"amazon_global-product_by-keywords\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
keyword ,Keyword (Required)

This parameter specifies the search keyword used when scraping Amazon products.

Request Example: "keyword":"Mitutoyo"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}],\"spider_id\":\"amazon_global-product_by-keywords\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
domain ,Main Domain (Required)

This parameter is used to specify the seller's homepage URL in order to scrape product data sold by that seller.

Request Example: "domain":"https://www.amazon.com"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}],\"spider_id\":\"amazon_global-product_by-keywords\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
page_turning ,Pages to Search back (Optional)

This parameter sets the number of search result pages to scrape. Entering a number n means products from page 1 to page n will be scraped.

Request Example: "page_turning":"1"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}],\"spider_id\":\"amazon_global-product_by-keywords\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"

  1. Amazon - Collect global product data via Seller

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool is used.

Request Example: "spider_id":"amazon_global-product_by-seller-url"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.de/stores/page/DE4854A4-1CF9-4C69-BF27-17B0E692ACF0\"}],\"spider_id\":\"amazon_global-product_by-seller-url\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
url ,Target URL for Scraping (Required)

This parameter specifies the Amazon URL to be scraped.

Request Example: [{"url":"https://www.amazon.de/stores/page/DE4854A4-1CF9-4C69-BF27-17B0E692ACF0"}]

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.de/stores/page/DE4854A4-1CF9-4C69-BF27-17B0E692ACF0\"}],\"spider_id\":\"amazon_global-product_by-seller-url\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"

Product - Seller Info Scraping Tools:

  1. Amazon - Collect seller info via URL

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool is used.

Request Example: "spider_id":"amazon_seller_by-url"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/sp?ie=UTF8%26seller=ADZ7LD48GVFQJ%26asin=B07H56J7K1%26ref_=dp_merchant_link%26isAmazonFulfilled=1\"}],\"spider_id\":\"amazon_seller_by-url\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
url ,Target URL for Scraping (Required)

This parameter specifies the Amazon URL to be scraped.

Request Example:

[{"url":"https://www.amazon.com/sp?ie=UTF8^&seller=ADZ7LD48GVFQJ^&asin=B07H56J7K1^&ref_=dp_merchant_link^&isAmazonFulfilled=1"}]

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/sp?ie=UTF8%26seller=ADZ7LD48GVFQJ%26asin=B07H56J7K1%26ref_=dp_merchant_link%26isAmazonFulfilled=1\"}],\"spider_id\":\"amazon_seller_by-url\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"

Product - Product List Scraping Tools:

  1. Amazon - Collect product list via Keywords

spider_id ,Associated Scraping Tool (Required)

Defines which scraping tool to use.

Request Example: "spider_id":"amazon_product-list_by-keywords-domain"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}],\"spider_id\":\"amazon_product-list_by-keywords-domain\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
keyword ,Keyword (Required)

This parameter specifies the search keyword used when scraping Amazon products.

Request Example: "keyword": "X-box"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}],\"spider_id\":\"amazon_product-list_by-keywords-domain\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
domain ,Main Domain (Required)

This parameter is used to specify the seller's homepage URL in order to scrape product data sold by that seller.

Request Example: "domain":"https://www.amazon.com"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}],\"spider_id\":\"amazon_product-list_by-keywords-domain\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"
page_turning ,Pages to Search back (Optional)

This parameter sets the number of search result pages to scrape. Entering a number n means products from page 1 to page n will be scraped.

Request Example: "page_turning":"1"

curl -X POST "http://scraperapi.thordata.com/builder" \
  -H "Authorization: Bearer Token-ID" \
  -H "Content-Type: application/x-www-form-urlencoded" \
  -d "spider_name=amazon.com" \
  -d "individual_params={\"spider_parameters\":[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}],\"spider_id\":\"amazon_product-list_by-keywords-domain\",\"spider_errors\":true}" \
  -d "file_name={{TasksID}}"

If you need further help, please contact us at [email protected].

PreviousYouTube Scraping ParametersNextFacebook Scraping Parameters

Last updated

Was this helpful?