Amazon 抓取参数
Web Scraper API Amazon 抓取参数
使用 Thordata 的 Web Scraper API 配置 Amazon 抓取参数,包括产品、Token、抓取URLs、卖家URLs、域名、关键词、排序方式、UPC、抓取最大页数、子类别等参数。
唯一标识:
token
,访问令牌(必填)
该参数用于确保爬取请求合法性的 API 访问令牌。
示例请求:
header "Authorization: Bearer ********************************"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer ********************************" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726\",\"zip_code\": \"94107\"}],\"spider_id\":\"amazon_product_by-url\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
产品-抓取产品信息工具: 1. Amazon - 通过 URL 收集产品信息
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
"spider_id":"amazon_product_by-url"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726\",\"zip_code\": \"94107\"}],\"spider_id\":\"amazon_product_by-url\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
url
,抓取目标链接(必填)
该参数用于指定待抓取的 Amazon 的访问 URL 地址。
示例请求:
"url": "https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726\",\"zip_code\": \"94107\"}],\"spider_id\":\"amazon_product_by-url\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
Amazon - 通过畅销商品 URL 收集产品信息
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
"spider_id":"amazon_product_by-best-sellers"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"collect_child_categories\": \"\"}],\"spider_id\":\"amazon_product_by-best-sellers\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
url
,抓取目标链接(必填)
该参数用于指定待抓取的 Amazon 的访问 URL 地址。
示例请求:
[{"url":"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1"}]
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"collect_child_categories\": \"\"}],\"spider_id\":\"amazon_product_by-best-sellers\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
collect_child_categories
,子类别(可选)
该参数用于指定在主类别下要采集的子类别商品范围。
示例请求:
"collect_child_categories":""
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"collect_child_categories\": \"\"}],\"spider_id\":\"amazon_product_by-best-sellers\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
Amazon - 通过类别 URL 收集产品数据
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
"spider_id":"amazon_product_by-category-url"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/s?i=baby-products-intl-ship\",\"sort_by\": \"Best Sellers\"}],\"spider_id\":\"amazon_product_by-category-url\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
url
,抓取类别目标链接(必填)
该参数用于指定待抓取的 Amazon 的访问 URL 地址。
示例请求:
"url":"https://www.amazon.com/s?i=luggage-intl-ship"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/s?i=baby-products-intl-ship\",\"sort_by\": \"Best Sellers\"}],\"spider_id\":\"amazon_product_by-category-url\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
sort_by
,排序方式(可选)
该参数用于配置类别页面抓取时的排序方式,支持按畅销品、最新到货、客户评论、价格或特色排序。参数值:
Best Sellers
Newest Arrivals
Average Rating
Price: High to Low
Price: Low to High
Featured Recommendations
示例请求:
"sort_by":"Best Sellers"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/s?i=baby-products-intl-ship\",\"sort_by\": \"Best Sellers\"}],\"spider_id\":\"amazon_product_by-category-url\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
Amazon - 通过关键词收集产品信息
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
"spider_id":"amazon_product_by-keywords"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"keyword\": \"Apple Watch\"}],\"spider_id\":\"amazon_product_by-keywords\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
keyword
,关键词(必填)
该参数用于指定抓取 Amazon 产品时使用的搜索关键词。
示例请求:
[{"keyword":"Apple Watch"}]
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"keyword\": \"Apple Watch\"}],\"spider_id\":\"amazon_product_by-keywords\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
Amazon - 通过 UPC 收集产品信息
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
"spider_id":"amazon_product_by-upc"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"upc\": \"841710108224\"}],\"spider_id\":\"amazon_product_by-upc\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
upc
,UPC(必填)
Amazon 产品所对应的UPC。需注意,每个 UPC 可能关联多个产品。
示例请求:
[{"upc":"841710108224"}]
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"upc\": \"841710108224\"}],\"spider_id\":\"amazon_product_by-upc\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
产品-抓取产品评论工具 1. Amazon - 通过 URL 收集产品评论
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
"spider_id":"amazon_comment_by-url"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/LAURA-GELLER-NEW-YORK-Retractable/dp/B086H4VCBJ\"}],\"spider_id\":\"amazon_comment_by-url\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
url
,抓取目标链接(必填)
该参数用于指定待抓取的 Amazon 的访问 URL 地址。
示例请求:
[{"url": "https://www.amazon.com/LAURA-GELLER-NEW-YORK-Retractable/dp/B086H4VCBJ"}]
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/LAURA-GELLER-NEW-YORK-Retractable/dp/B086H4VCBJ\"}],\"spider_id\":\"amazon_comment_by-url\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
产品-抓取全球产品信息工具 1. Amazon - 通过 URL 收集全球产品数据
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
"spider_id":"amazon_global-product_by-url"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/dp/B0CHHSFMRL/\"}],\"spider_id\":\"amazon_global-product_by-url\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
url
,抓取目标链接(必填)
该参数用于指定待抓取的 Amazon 的访问 URL 地址。
示例请求:
[{"url":"https://www.amazon.com/dp/B0CHHSFMRL/"}]
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/dp/B0CHHSFMRL/\"}],\"spider_id\":\"amazon_global-product_by-url\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
2.Amazon - 通过品牌收集全球产品数据
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
"spider_id":"amazon_global-product_by-brand"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/s?k=football%26i=fashion%26rh=n%3A7141123011%2Cp_123%3A233083\"}],\"spider_id\":\"amazon_global-product_by-brand\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
url
,抓取目标链接(必填)
该参数用于指定待抓取的 Amazon 的访问 URL 地址。
示例请求:
[{"url":"https://www.amazon.com/s?k=football^&i=fashion^&rh=n%3A7141123011%2Cp_123%3A233083"}]
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/s?k=football%26i=fashion%26rh=n%3A7141123011%2Cp_123%3A233083\"}],\"spider_id\":\"amazon_global-product_by-brand\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
Amazon - 通过类别 URL 收集全球产品数据
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
"spider_id":"amazon_global-product_by-category-url"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}],\"spider_id\":\"amazon_global-product_by-category-url\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
url
,抓取类别目标链接(必填)
该参数用于指定待抓取的 Amazon 的访问 URL 地址。
示例请求:
"url": "https://www.amazon.com/s?i=luggage-intl-ship"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}],\"spider_id\":\"amazon_global-product_by-category-url\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
sort_by
,排序方式(可选)
该参数用于配置类别页面抓取时的排序方式,支持按畅销品、最新到货、客户评论、价格或特色排序。 参数值:
Best Sellers
Newest Arrivals
Average Rating
Price: High to Low
Price: Low to High
Featured Recommendations
示例请求:
"sort_by":"Best Sellers"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}],\"spider_id\":\"amazon_global-product_by-category-url\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
get_sponsored
,获取赞助商品(可选)
该参数用于配置 勾选 “True” 可同时收集赞助商品,即使它们不属于该类别。
参数值:true
false
示例请求:
"get_sponsored":"true"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}],\"spider_id\":\"amazon_global-product_by-category-url\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
Amazon - 通过关键词收集全球产品数据
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
"spider_id":"amazon_global-product_by-keywords"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}],\"spider_id\":\"amazon_global-product_by-keywords\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
keyword
,关键词(必填)
该参数用于指定抓取 Amazon 产品时使用的搜索关键词。
示例请求:
"keyword":"Mitutoyo"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}],\"spider_id\":\"amazon_global-product_by-keywords\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
domain
,主域名(必填)
该参数用于指定卖家主页的 URL,以便抓取该卖家所售产品的数据。
示例请求:
"domain":"https://www.amazon.com"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}],\"spider_id\":\"amazon_global-product_by-keywords\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
page_turning
,抓取页数(可选)
该参数用于设置抓取搜索结果的页数。输入数字 n 表示抓取从第一页到第 n 页的所有产品数据。
示例请求:
"page_turning":"1"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}],\"spider_id\":\"amazon_global-product_by-keywords\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
Amazon - 通过卖家收集全球产品数据
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
"spider_id":"amazon_global-product_by-seller-url"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.de/stores/page/DE4854A4-1CF9-4C69-BF27-17B0E692ACF0\"}],\"spider_id\":\"amazon_global-product_by-seller-url\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
url
,抓取目标链接(必填)
该参数用于指定待抓取的 Amazon 的访问 URL 地址。
示例请求:
[{"url":"https://www.amazon.de/stores/page/DE4854A4-1CF9-4C69-BF27-17B0E692ACF0"}]
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.de/stores/page/DE4854A4-1CF9-4C69-BF27-17B0E692ACF0\"}],\"spider_id\":\"amazon_global-product_by-seller-url\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
产品-抓取卖家信息工具 1.Amazon - 通过 URL 收集卖家信息
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
"spider_id":"amazon_seller_by-url"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/sp?ie=UTF8%26seller=ADZ7LD48GVFQJ%26asin=B07H56J7K1%26ref_=dp_merchant_link%26isAmazonFulfilled=1\"}],\"spider_id\":\"amazon_seller_by-url\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
url
,抓取目标链接(必填)
该参数用于指定待抓取的 Amazon 的访问 URL 地址。
示例请求:
[{"url":"https://www.amazon.com/sp?ie=UTF8^&seller=ADZ7LD48GVFQJ^&asin=B07H56J7K1^&ref_=dp_merchant_link^&isAmazonFulfilled=1"}]
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"url\": \"https://www.amazon.com/sp?ie=UTF8%26seller=ADZ7LD48GVFQJ%26asin=B07H56J7K1%26ref_=dp_merchant_link%26isAmazonFulfilled=1\"}],\"spider_id\":\"amazon_seller_by-url\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
产品-抓取产品列表 1.Amazon - 通过关键词收集产品列表
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
"spider_id":"amazon_product-list_by-keywords-domain"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}],\"spider_id\":\"amazon_product-list_by-keywords-domain\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
keyword
,关键词(必填)
该参数用于指定抓取 Amazon 产品时使用的搜索关键词。
示例请求:
"keyword": "X-box"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}],\"spider_id\":\"amazon_product-list_by-keywords-domain\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
domain
,主域名(必填)
该参数用于指定卖家主页的 URL,以便抓取该卖家所售产品的数据。
示例请求:
"domain":"https://www.amazon.com/"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}],\"spider_id\":\"amazon_product-list_by-keywords-domain\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
page_turning
,抓取页数(可选)
该参数用于设置抓取搜索结果的页数。输入数字 n 表示抓取从第一页到第 n 页的所有产品数据。
示例请求:
"page_turning":"1"
curl -X POST "http://scraperapi.thordata.com/builder" \
-H "Authorization: Bearer Token-ID" \
-H "Content-Type: application/x-www-form-urlencoded" \
-d "spider_name=amazon.com" \
-d "individual_params={\"spider_parameters\":[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}],\"spider_id\":\"amazon_product-list_by-keywords-domain\",\"spider_errors\":true}" \
-d "file_name={{TasksID}}"
如果您需要更多帮助,请通过邮箱[email protected]联系我们。
Last updated
Was this helpful?