Amazon 抓取参数
Web Scraper API Amazon 抓取参数
使用 Thordata 的 Web Scraper API 配置 Amazon 抓取参数,包括产品、Token、抓取URLs、卖家URLs、域名、关键词、排序方式、UPC、抓取最大页数、子类别等参数。
唯一标识:
token
,访问令牌(必填)
此参数用作 API 访问令牌,以确保抓取请求的合法性。
示例请求:
"Authorization: Bearer ********************************"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer ********************************" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_product_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"zip_code\": \"94107\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
一、产品-抓取产品信息工具: 1. Amazon - 通过 URL 收集产品信息
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
spider_id=amazon_product_by-url
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_product_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"zip_code\": \"94107\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
url
,抓取目标链接(必填)
该参数用于指定待抓取的 Amazon 的访问 URL 地址。
示例请求:
"url": "https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_product_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"zip_code\": \"94107\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
zip_code
,邮政编码(可选)
该参数用于指定抓取页面中配送区域的邮政编码。
示例请求:
"zip_code": "94107"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_product_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"zip_code\": \"94107\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
Amazon - 通过畅销商品 URL 收集产品信息
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
spider_id=amazon_product_by-best-sellers
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_product_by-best-sellers" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"collect_child_categories\": \"\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
url
,抓取目标链接(必填)
该参数用于指定待抓取的 Amazon 的访问 URL 地址。
示例请求:
"url": "https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_product_by-best-sellers" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"collect_child_categories\": \"\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
collect_child_categories
,子类别(可选)
该参数用于指定在主类别下要采集的子类别商品范围。
示例请求:
"collect_child_categories":""
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_product_by-best-sellers" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"collect_child_categories\": \"\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
Amazon - 通过类别 URL 收集产品数据
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
spider_id=amazon_product_by-category-url
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_product_by-category-url" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
url
,抓取类别目标链接(必填)
该参数用于指定待抓取的 Amazon 的访问 URL 地址。
示例请求:
"url":"https://www.amazon.com/s?i=luggage-intl-ship"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_product_by-category-url" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
sort_by
,排序方式(可选)
该参数用于配置类别页面抓取时的排序方式,支持按畅销品、最新到货、客户评论、价格或特色排序。参数值:
Best Sellers
Newest Arrivals
Average Rating
Price: High to Low
Price: Low to High
Featured Recommendations
示例请求:
"sort_by":"Best Sellers"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_product_by-category-url" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
Amazon - 通过关键词收集产品信息
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
spider_id=amazon_product_by-keywords
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_product_by-keywords" ^
-d "spider_parameters=[{\"keyword\": \"Apple Watch\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
keyword
,关键词(必填)
该参数用于指定抓取 Amazon 产品时使用的搜索关键词。
示例请求:
"keyword":"Apple Watch"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_product_by-keywords" ^
-d "spider_parameters=[{\"keyword\": \"Apple Watch\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
Amazon - 通过 UPC 收集产品信息
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
spider_id=amazon_product_by-upc
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_product_by-upc" ^
-d "spider_parameters=[{\"upc\": \"841710108224\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
upc
,UPC(必填)
Amazon 产品所对应的UPC。需注意,每个 UPC 可能关联多个产品。
示例请求:
"upc":"841710108224"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_product_by-upc" ^
-d "spider_parameters=[{\"upc\": \"841710108224\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
二、产品-抓取产品评论工具 1. Amazon - 通过 URL 收集产品评论
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
spider_id=amazon_comment_by-url
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_comment_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
url
,抓取目标链接(必填)
该参数用于指定待抓取的 Amazon 的访问 URL 地址。
示例请求:
"url": "https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_comment_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
三、产品-抓取全球产品信息工具 1. Amazon - 通过 URL 收集全球产品数据
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
spider_id=amazon_global-product_by-url
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_global-product_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/dp/B0CHHSFMRL/\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
url
,抓取目标链接(必填)
该参数用于指定待抓取的 Amazon 的访问 URL 地址。
示例请求:
"url": "https://www.amazon.com/dp/B0CHHSFMRL/"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_global-product_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/dp/B0CHHSFMRL/\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
2.1.Amazon - 通过品牌收集全球产品数据
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
spider_id=amazon_global-product_by-brand
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_global-product_by-brand" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?k=football%26i=fashion%26rh=n%3A7141123011%2Cp_123%3A233083\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
url
,抓取目标链接(必填)
该参数用于指定待抓取的 Amazon 的访问 URL 地址。
示例请求:
"url": "https://www.amazon.com/s?k=football%26i=fashion%26rh=n%3A7141123011%2Cp_123%3A233083"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_global-product_by-brand" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?k=football%26i=fashion%26rh=n%3A7141123011%2Cp_123%3A233083\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
2.2. Amazon - 通过关键词 or 品牌收集全球产品数据
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
amazon_global-product_by-keywords-brand
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_global-product_by-keywords-brand" ^
-d "spider_parameters=[{\"keyword\": \"shirts\",\"brands\": \"Adidas\",\"page_turning\": \"2\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
keyword
, 关键词(必填)
该参数用于指定抓取 Amazon 产品时使用的搜索关键词。
示例请求:
"keyword": "shirts"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_global-product_by-keywords-brand" ^
-d "spider_parameters=[{\"keyword\": \"shirts\",\"brands\": \"Adidas\",\"page_turning\": \"2\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
brands
,品牌(必填)
该参数用于指定抓取的品牌信息,请输入 Amazon 平台有的品牌名称,如果找不到该品牌选项,则抓取字段将为空。
示例请求:
"brands": "Adidas"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_global-product_by-keywords-brand" ^
-d "spider_parameters=[{\"keyword\": \"shirts\",\"brands\": \"Adidas\",\"page_turning\": \"2\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
page_turning
,抓取页数(必填)
该参数用于设置抓取搜索结果的页数。输入数字 n 表示抓取从第一页到第 n 页的所有产品数据。
参数值:1-100000
示例请求:
"page_turning": "2"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_global-product_by-keywords-brand" ^
-d "spider_parameters=[{\"keyword\": \"shirts\",\"brands\": \"Adidas\",\"page_turning\": \"2\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
Amazon - 通过类别 URL 收集全球产品数据
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
spider_id=amazon_global-product_by-category-url
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_global-product_by-category-url" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
url
,抓取类别目标链接(必填)
该参数用于指定待抓取的 Amazon 的访问 URL 地址。
示例请求:
"url": "https://www.amazon.com/s?i=luggage-intl-ship"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_global-product_by-category-url" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
sort_by
,排序方式(可选)
该参数用于配置类别页面抓取时的排序方式,支持按畅销品、最新到货、客户评论、价格或特色排序。 参数值:
Best Sellers
Newest Arrivals
Average Rating
Price: High to Low
Price: Low to High
Featured Recommendations
示例请求:
"sort_by":"Best Sellers"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_global-product_by-category-url" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
get_sponsored
,获取赞助商品(可选)
该参数用于配置 勾选 “True” 可同时收集赞助商品,即使它们不属于该类别。
参数值:true
false
示例请求:
"get_sponsored":"true"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_global-product_by-category-url" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
Amazon - 通过关键词收集全球产品数据
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
spider_id=amazon_global-product_by-keywords
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_global-product_by-keywords" ^
-d "spider_parameters=[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
keyword
,关键词(必填)
该参数用于指定抓取 Amazon 产品时使用的搜索关键词。
示例请求:
"keyword":"Mitutoyo"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_global-product_by-keywords" ^
-d "spider_parameters=[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
domain
,主域名(必填)
该参数用于指定卖家主页的 URL,以便抓取该卖家所售产品的数据。
示例请求:
"domain":"https://www.amazon.com"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_global-product_by-keywords" ^
-d "spider_parameters=[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
page_turning
,抓取页数(可选)
该参数用于设置抓取搜索结果的页数。输入数字 n 表示抓取从第一页到第 n 页的所有产品数据。
示例请求:
"page_turning":"1"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_global-product_by-keywords" ^
-d "spider_parameters=[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
Amazon - 通过卖家收集全球产品数据
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
spider_id=amazon_global-product_by-seller-url
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_global-product_by-seller-url" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.de/stores/page/DE4854A4-1CF9-4C69-BF27-17B0E692ACF0\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
url
,抓取目标链接(必填)
该参数用于指定待抓取的 Amazon 的访问 URL 地址。
示例请求:
"url":"https://www.amazon.de/stores/page/DE4854A4-1CF9-4C69-BF27-17B0E692ACF0"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_global-product_by-seller-url" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.de/stores/page/DE4854A4-1CF9-4C69-BF27-17B0E692ACF0\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
四、产品-抓取卖家信息工具 1.Amazon - 通过 URL 收集卖家信息
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
spider_id=amazon_seller_by-url
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_seller_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/sp?ie=UTF8%26seller=ADZ7LD48GVFQJ%26asin=B07H56J7K1%26ref_=dp_merchant_link%26isAmazonFulfilled=1\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
url
,抓取目标链接(必填)
该参数用于指定待抓取的 Amazon 的访问 URL 地址。
示例请求:
"url": "https://www.amazon.com/sp?ie=UTF8%26seller=ADZ7LD48GVFQJ%26asin=B07H56J7K1%26ref_=dp_merchant_link%26isAmazonFulfilled=1"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_seller_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.amazon.com/sp?ie=UTF8%26seller=ADZ7LD48GVFQJ%26asin=B07H56J7K1%26ref_=dp_merchant_link%26isAmazonFulfilled=1\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
五、产品-抓取产品列表 1.Amazon - 通过关键词收集产品列表
spider_id
,所属抓取工具(必填)
定义了使用哪个抓取工具。
示例请求:
spider_id=amazon_product-list_by-keywords-domain
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_product-list_by-keywords-domain" ^
-d "spider_parameters=[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
keyword
,关键词(必填)
该参数用于指定抓取 Amazon 产品时使用的搜索关键词。
示例请求:
"keyword": "X-box"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_product-list_by-keywords-domain" ^
-d "spider_parameters=[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
domain
,主域名(必填)
该参数用于指定卖家主页的 URL,以便抓取该卖家所售产品的数据。
示例请求:
"domain": "https://www.amazon.com/"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_product-list_by-keywords-domain" ^
-d "spider_parameters=[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
page_turning
,抓取页数(可选)
该参数用于设置抓取搜索结果的页数。输入数字 n 表示抓取从第一页到第 n 页的所有产品数据。
示例请求:
"page_turning":"1"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=amazon.com" ^
-d "spider_id=amazon_product-list_by-keywords-domain" ^
-d "spider_parameters=[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
如果您需要更多帮助,请通过邮箱[email protected]联系我们。
Last updated
Was this helpful?