Amazon Scraping Parameters
Using Thordata's Web Scraper API to configure Amazon scraping parameters, including: Product, Token, Scraping URLs, Seller URLs, Domain, Keywords, Sort Method, UPC, Max Page Count, Subcategories, etc.
Unique Identifier:
token
,Access Token (Required)
This parameter is used to verify the legitimacy of the scraping request via an API access token.
Request Example:
header "Authorization: Bearer ********************************"
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=3 --header "Authorization: Bearer ********************************" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726\"}],\"spider_id\":\"3\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
Product - Product Info Scraping Tools:
Amazon - Collect product info via URL
prodect_id
,Associated Scraping Tool (Required)
This parameter defines which scraping tool to use.
Request Example:
prodect_id=3
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=3 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726\"}],\"spider_id\":\"3\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
url
,Target URL for Scraping (Required)
This parameter specifies the Amazon URL to be scraped.
Request Example:
[{\"url\":\"https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726\"}]
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=3 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726\"}],\"spider_id\":\"3\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
Amazon - Collect product info via Best Seller URL
prodect_id
,Associated Scraping Tool (Required)
Defines which scraping tool to use.
Request Example:
prodect_id=366
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=366 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"collect_child_categories\":\"\"}],\"spider_id\":\"366\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
url
,Category Target URL for Scraping (Required)
This parameter specifies the Amazon category page URL to be scraped.
Request Example:
[{\"url\":\"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\"}]
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=366 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"collect_child_categories\":\"\"}],\"spider_id\":\"366\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
collect_child_categories
,Subcategories (Optional)
This parameter specifies the scope of subcategory products to collect under the main category.
Request Example:
"collect_child_categories":""
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=366 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"collect_child_categories\":\"\"}],\"spider_id\":\"366\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
Amazon - Collect product data via Category URL
prodect_id
,Associated Scraping Tool (Required)
Defines which scraping tool to use.
Request Example:
prodect_id=353
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=353 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\":\"Best Sellers\"}],\"spider_id\":\"353\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
sort_b
,Sort Method (Optional)
This parameter configures the sorting method when scraping category pages. Supported values include:
Best Sellers
Newest Arrivals
Average Rating
Price: High to Low
Price: Low to High
Featured Recommendations
Request Example:
"sort_by":"Best Sellers"
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=353 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\":\"Best Sellers\"}],\"spider_id\":\"353\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
Amazon - Collect product info via Keywords
prodect_id
,Associated Scraping Tool (Required)
Defines which scraping tool to use.
Request Example:
prodect_id=352
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=352 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"keyword\":\"Apple Watch\"}],\"spider_id\":\"352\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
keyword
,Keyword (Required)
This parameter specifies the search keyword used when scraping Amazon products.
Request Example:
[{\"keyword\":\"Apple Watch\"}]
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=352 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"keyword\":\"Apple Watch\"}],\"spider_id\":\"352\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
Amazon - Collect product info via UPC
prodect_id
,Associated Scraping Tool (Required)
Defines which scraping tool to use.
Request Example:
prodect_id=367
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=367 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"upc\":\"841710108224\"}],\"spider_id\":\"367\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
upc
,UPC (Required)
The UPC corresponding to the Amazon product. Note that a single UPC may be associated with multiple products.
Request Example:
[{\"upc\":\"841710108224\"}]
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=367 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"upc\":\"841710108224\"}],\"spider_id\":\"367\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
Product - Product Review Scraping Tools:
Amazon - Collect product reviews via URL
prodect_id
,Associated Scraping Tool (Required)
Defines which scraping tool to use.
Request Example:
prodect_id=368
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=368 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726\"}],\"spider_id\":\"368\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
url
,Target URL for Scraping (Required)
This parameter specifies the Amazon URL to scrape.
Request Example:
[{\"url\":\"https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726\"}]
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=368 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726\"}],\"spider_id\":\"368\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
Product - Global Product Info Scraping Tools:
Amazon - Collect global product data via URL
prodect_id
,Associated Scraping Tool (Required)
Defines which scraping tool to use.
Request Example:
prodect_id=377
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=377 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/dp/B0CHHSFMRL/\"}],\"spider_id\":\"377\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
url
,Target URL for Scraping (Required)
This parameter specifies the Amazon URL to be scraped.
Request Example:
[{\"url\":\"https://www.amazon.com/dp/B0CHHSFMRL/\"}]
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=377 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/dp/B0CHHSFMRL/\"}],\"spider_id\":\"377\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
Amazon - Collect global product data via Brand
prodect_id
,Associated Scraping Tool (Required)
Defines which scraping tool to use.
Request Example:
prodect_id=376
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=376 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/s?k=football^&i=fashion^&rh=n%3A7141123011%2Cp_123%3A233083\"}],\"spider_id\":\"376\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
url
,Target URL for Scraping (Required)
This parameter specifies the Amazon URL to be scraped.
Request Example:
[{\"url\":\"https://www.amazon.com/s?k=football^&i=fashion^&rh=n%3A7141123011%2Cp_123%3A233083\"}]
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=376 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/s?k=football^&i=fashion^&rh=n%3A7141123011%2Cp_123%3A233083\"}],\"spider_id\":\"376\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
Amazon - Collect global product data via Category URL
prodect_id
,Associated Scraping Tool (Required)
Defines which scraping tool to use.
Request Example:
prodect_id=375
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=375 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\":\"Best Sellers\",\"get_sponsored\":\"true\"}],\"spider_id\":\"375\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
sort_b
,Sort Method (Optional)
This parameter configures the sorting method when scraping category pages. Supported values include:
Best Sellers
Newest Arrivals
Average Rating
Price: High to Low
Price: Low to High
Featured Recommendations
Request Example:
"sort_by":"Best Sellers"
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=375 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\":\"Best Sellers\",\"get_sponsored\":\"true\"}],\"spider_id\":\"375\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
get_sponsored
,Get Sponsored Products (Optional)
This parameter is used to configure whether sponsored products should also be collected, even if they don't belong to the specified category.
Parameter values: true
or false
Request Example:
"get_sponsored":"true"
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=375 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\":\"Best Sellers\",\"get_sponsored\":\"true\"}],\"spider_id\":\"375\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
Amazon - Collect global product data via Keywords
prodect_id
,Associated Scraping Tool (Required)
Defines which scraping tool to use.
Request Example:
prodect_id=354
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=354 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"keyword\":\"Mitutoyo\",\"domain\":\"https://www.amazon.com\",\"page_turning\":\"1\"}],\"spider_id\":\"354\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
keyword
,Keyword (Required)
This parameter specifies the search keyword used when scraping Amazon products.
Request Example:
"keyword":"Mitutoyo"
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=354 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"keyword\":\"Mitutoyo\",\"domain\":\"https://www.amazon.com\",\"page_turning\":\"1\"}],\"spider_id\":\"354\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
domain
,Main Domain (Required)
This parameter is used to specify the seller's homepage URL in order to scrape product data sold by that seller.
Request Example:
"domain":"https://www.amazon.com"
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=354 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"keyword\":\"Mitutoyo\",\"domain\":\"https://www.amazon.com\",\"page_turning\":\"1\"}],\"spider_id\":\"354\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
page_turning
,Page Count (Optional)
This parameter sets the number of search result pages to scrape. Entering a number n
means products from page 1 to page n
will be scraped.
Request Example:
"page_turning":"1"
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=354 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"keyword\":\"Mitutoyo\",\"domain\":\"https://www.amazon.com\",\"page_turning\":\"1\"}],\"spider_id\":\"354\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
Amazon - Collect global product data via Seller
prodect_id
,Associated Scraping Tool (Required)
Defines which scraping tool is used.
Request Example:
prodect_id=374
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=374 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/stores/page/4750579C-0CF4-4BF9-B7E8-F782E52D7683?ingress=0^&visitId=63ba151f-9b4f-4938-b6a3-fd23c249b72f\"}],\"spider_id\":\"374\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
url
,Target URL for Scraping (Required)
This parameter specifies the Amazon URL to be scraped.
Request Example:
[{\"url\":\"https://www.amazon.com/stores/page/4750579C-0CF4-4BF9-B7E8-F782E52D7683?ingress=0^&visitId=63ba151f-9b4f-4938-b6a3-fd23c249b72f\"}]
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=374 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/stores/page/4750579C-0CF4-4BF9-B7E8-F782E52D7683?ingress=0^&visitId=63ba151f-9b4f-4938-b6a3-fd23c249b72f\"}],\"spider_id\":\"374\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
Product - Seller Info Scraping Tools:
Amazon - Collect seller info via URL
prodect_id
,Associated Scraping Tool (Required)
Defines which scraping tool is used.
Request Example:
prodect_id=369
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=369 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/sp?ie=UTF8^&seller=ADZ7LD48GVFQJ^&asin=B07H56J7K1^&ref_=dp_merchant_link^&isAmazonFulfilled=1\"}],\"spider_id\":\"369\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
url
,Target URL for Scraping (Required)
This parameter specifies the Amazon URL to be scraped.
Request Example:
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=369 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"url\":\"https://www.amazon.com/sp?ie=UTF8^&seller=ADZ7LD48GVFQJ^&asin=B07H56J7K1^&ref_=dp_merchant_link^&isAmazonFulfilled=1\"}],\"spider_id\":\"369\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
Product - Product List Scraping Tools:
Amazon - Collect product list via Keywords
prodect_id
,Associated Scraping Tool (Required)
Defines which scraping tool to use.
Request Example:
prodect_id=370
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=370 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"keyword\":\"Dry Dog Food\",\"domain\":\"https://www.amazon.com/\",\"page_turning\":\"1\"}],\"spider_id\":\"370\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
keyword
,Keyword (Required)
This parameter specifies the search keyword used when scraping Amazon products.
Request Example:
"keyword":"Dry Dog Food"
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=370 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"keyword\":\"Dry Dog Food\",\"domain\":\"https://www.amazon.com/\",\"page_turning\":\"1\"}],\"spider_id\":\"370\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
domain
,Main Domain (Required)
This parameter is used to specify the seller's homepage URL in order to scrape product data sold by that seller.
Request Example:
"domain":"https://www.amazon.com"
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=370 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"keyword\":\"Dry Dog Food\",\"domain\":\"https://www.amazon.com/\",\"page_turning\":\"1\"}],\"spider_id\":\"370\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
page_turning
,Page Count (Optional)
This parameter sets the number of search result pages to scrape. Entering a number n
means products from page 1 to page n
will be scraped.
Request Example:
"page_turning":"1"
curl --request POST --url https://scraperapi.thordata.com/builder?prodect_id=370 --header "Authorization: Bearer Token-ID" --header "content-type: application/json" --data "{\"spider_info\":{\"spider_parameters\":[{\"keyword\":\"Dry Dog Food\",\"domain\":\"https://www.amazon.com/\",\"page_turning\":\"1\"}],\"spider_id\":\"370\",\"spider_errors\":true},\"spider_name\":\"amazon.com\"}"
If you need further help, please contact us at support@thordata.com.
Last updated
Was this helpful?