Amazon 抓取参数

Web Scraper API Amazon 抓取参数

使用 Thordata 的 Web Scraper API 配置 Amazon 抓取参数,包括产品、Token、抓取URLs、卖家URLs、域名、关键词、排序方式、UPC、抓取最大页数、子类别等参数。

唯一标识:

token ,访问令牌(必填)

此参数用作 API 访问令牌,以确保抓取请求的合法性。

示例请求:

"Authorization: Bearer ********************************"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer ********************************" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"zip_code\": \"94107\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

一、产品-抓取产品信息工具: 1. Amazon - 通过 URL 收集产品信息

spider_id ,所属抓取工具(必填)

定义了使用哪个抓取工具。

示例请求:

spider_id=amazon_product_by-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"zip_code\": \"94107\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
url ,抓取目标链接(必填)

该参数用于指定待抓取的 Amazon 的访问 URL 地址。

示例请求:

"url": "https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"zip_code\": \"94107\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
zip_code邮政编码(可选)

该参数用于指定抓取页面中配送区域的邮政编码。

示例请求:

"zip_code": "94107"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"zip_code\": \"94107\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
  1. Amazon - 通过畅销商品 URL 收集产品信息

spider_id ,所属抓取工具(必填)

定义了使用哪个抓取工具。

示例请求:

spider_id=amazon_product_by-best-sellers

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-best-sellers" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"collect_child_categories\": \"\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
url ,抓取目标链接(必填)

该参数用于指定待抓取的 Amazon 的访问 URL 地址。

示例请求:

"url": "https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-best-sellers" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"collect_child_categories\": \"\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
collect_child_categories,子类别(可选)

该参数用于指定在主类别下要采集的子类别商品范围。

示例请求:

"collect_child_categories":""

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-best-sellers" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/Best-Sellers-Tools-Home-Improvement-Kitchen-Bath-Fixtures/zgbs/hi/3754161/ref=zg_bs_unv_hi_2_680350011_1\",\"collect_child_categories\": \"\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
  1. Amazon - 通过类别 URL 收集产品数据

spider_id ,所属抓取工具(必填)

定义了使用哪个抓取工具。

示例请求:

spider_id=amazon_product_by-category-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-category-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
url ,抓取类别目标链接(必填)

该参数用于指定待抓取的 Amazon 的访问 URL 地址。

示例请求:

"url":"https://www.amazon.com/s?i=luggage-intl-ship"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-category-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
sort_by ,排序方式(可选)

该参数用于配置类别页面抓取时的排序方式,支持按畅销品、最新到货、客户评论、价格或特色排序。参数值:

Best Sellers Newest Arrivals Average Rating Price: High to Low Price: Low to High Featured Recommendations

示例请求:

"sort_by":"Best Sellers"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-category-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
  1. Amazon - 通过关键词收集产品信息

spider_id,所属抓取工具(必填)

定义了使用哪个抓取工具。

示例请求:

spider_id=amazon_product_by-keywords

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-keywords" ^
  -d "spider_parameters=[{\"keyword\": \"Apple Watch\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
keyword ,关键词(必填)

该参数用于指定抓取 Amazon 产品时使用的搜索关键词。

示例请求:

"keyword":"Apple Watch"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-keywords" ^
  -d "spider_parameters=[{\"keyword\": \"Apple Watch\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
  1. Amazon - 通过 UPC 收集产品信息

spider_id ,所属抓取工具(必填)

定义了使用哪个抓取工具。

示例请求:

spider_id=amazon_product_by-upc

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-upc" ^
  -d "spider_parameters=[{\"upc\": \"841710108224\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
upc ,UPC(必填)

Amazon 产品所对应的UPC。需注意,每个 UPC 可能关联多个产品。

示例请求:

"upc":"841710108224"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product_by-upc" ^
  -d "spider_parameters=[{\"upc\": \"841710108224\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

二、产品-抓取产品评论工具 1. Amazon - 通过 URL 收集产品评论

spider_id ,所属抓取工具(必填)

定义了使用哪个抓取工具。

示例请求:

spider_id=amazon_comment_by-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_comment_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
url ,抓取目标链接(必填)

该参数用于指定待抓取的 Amazon 的访问 URL 地址。

示例请求:

"url": "https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_comment_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/HISDERN-Checkered-Handkerchief-Classic-Necktie/dp/B0BRXPR726\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

三、产品-抓取全球产品信息工具 1. Amazon - 通过 URL 收集全球产品数据

spider_id ,所属抓取工具(必填)

定义了使用哪个抓取工具。

示例请求:

spider_id=amazon_global-product_by-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/dp/B0CHHSFMRL/\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
url ,抓取目标链接(必填)

该参数用于指定待抓取的 Amazon 的访问 URL 地址。

示例请求:

"url": "https://www.amazon.com/dp/B0CHHSFMRL/"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/dp/B0CHHSFMRL/\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

2.1.Amazon - 通过品牌收集全球产品数据

spider_id ,所属抓取工具(必填)

定义了使用哪个抓取工具。

示例请求:

spider_id=amazon_global-product_by-brand

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-brand" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?k=football%26i=fashion%26rh=n%3A7141123011%2Cp_123%3A233083\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
url ,抓取目标链接(必填)

该参数用于指定待抓取的 Amazon 的访问 URL 地址。

示例请求:

"url": "https://www.amazon.com/s?k=football%26i=fashion%26rh=n%3A7141123011%2Cp_123%3A233083"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-brand" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?k=football%26i=fashion%26rh=n%3A7141123011%2Cp_123%3A233083\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

2.2. Amazon - 通过关键词 or 品牌收集全球产品数据

spider_id ,所属抓取工具(必填)

定义了使用哪个抓取工具。

示例请求:

amazon_global-product_by-keywords-brand

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-keywords-brand" ^
  -d "spider_parameters=[{\"keyword\": \"shirts\",\"brands\": \"Adidas\",\"page_turning\": \"2\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
keyword关键词(必填)

该参数用于指定抓取 Amazon 产品时使用的搜索关键词。

示例请求:

"keyword": "shirts"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-keywords-brand" ^
  -d "spider_parameters=[{\"keyword\": \"shirts\",\"brands\": \"Adidas\",\"page_turning\": \"2\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
brands品牌(必填)

该参数用于指定抓取的品牌信息,请输入 Amazon 平台有的品牌名称,如果找不到该品牌选项,则抓取字段将为空。

示例请求:

"brands": "Adidas"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-keywords-brand" ^
  -d "spider_parameters=[{\"keyword\": \"shirts\",\"brands\": \"Adidas\",\"page_turning\": \"2\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
page_turning抓取页数(必填)

该参数用于设置抓取搜索结果的页数。输入数字 n 表示抓取从第一页到第 n 页的所有产品数据。 参数值:1-100000

示例请求:

"page_turning": "2"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-keywords-brand" ^
  -d "spider_parameters=[{\"keyword\": \"shirts\",\"brands\": \"Adidas\",\"page_turning\": \"2\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
  1. Amazon - 通过类别 URL 收集全球产品数据

spider_id ,所属抓取工具(必填)

定义了使用哪个抓取工具。

示例请求:

spider_id=amazon_global-product_by-category-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-category-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
url ,抓取类别目标链接(必填)

该参数用于指定待抓取的 Amazon 的访问 URL 地址。

示例请求:

"url": "https://www.amazon.com/s?i=luggage-intl-ship"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-category-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
sort_by ,排序方式(可选)

该参数用于配置类别页面抓取时的排序方式,支持按畅销品、最新到货、客户评论、价格或特色排序。 参数值:

Best Sellers Newest Arrivals Average Rating Price: High to Low Price: Low to High Featured Recommendations

示例请求:

"sort_by":"Best Sellers"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-category-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
get_sponsored ,获取赞助商品(可选)

该参数用于配置 勾选 “True” 可同时收集赞助商品,即使它们不属于该类别。

参数值:true false

示例请求:

"get_sponsored":"true"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-category-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/s?i=luggage-intl-ship\",\"sort_by\": \"Best Sellers\",\"get_sponsored\": \"true\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
  1. Amazon - 通过关键词收集全球产品数据

spider_id ,所属抓取工具(必填)

定义了使用哪个抓取工具。

示例请求:

spider_id=amazon_global-product_by-keywords

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-keywords" ^
  -d "spider_parameters=[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
keyword ,关键词(必填)

该参数用于指定抓取 Amazon 产品时使用的搜索关键词。

示例请求:

"keyword":"Mitutoyo"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-keywords" ^
  -d "spider_parameters=[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
domain ,主域名(必填)

该参数用于指定卖家主页的 URL,以便抓取该卖家所售产品的数据。

示例请求:

"domain":"https://www.amazon.com"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-keywords" ^
  -d "spider_parameters=[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
page_turning ,抓取页数(可选)

该参数用于设置抓取搜索结果的页数。输入数字 n 表示抓取从第一页到第 n 页的所有产品数据。

示例请求:

"page_turning":"1"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-keywords" ^
  -d "spider_parameters=[{\"keyword\": \"Mitutoyo\",\"domain\": \"https://www.amazon.com\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
  1. Amazon - 通过卖家收集全球产品数据

spider_id ,所属抓取工具(必填)

定义了使用哪个抓取工具。

示例请求:

spider_id=amazon_global-product_by-seller-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-seller-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.de/stores/page/DE4854A4-1CF9-4C69-BF27-17B0E692ACF0\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
url ,抓取目标链接(必填)

该参数用于指定待抓取的 Amazon 的访问 URL 地址。

示例请求:

"url":"https://www.amazon.de/stores/page/DE4854A4-1CF9-4C69-BF27-17B0E692ACF0"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_global-product_by-seller-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.de/stores/page/DE4854A4-1CF9-4C69-BF27-17B0E692ACF0\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

四、产品-抓取卖家信息工具 1.Amazon - 通过 URL 收集卖家信息

spider_id ,所属抓取工具(必填)

定义了使用哪个抓取工具。

示例请求:

spider_id=amazon_seller_by-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_seller_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/sp?ie=UTF8%26seller=ADZ7LD48GVFQJ%26asin=B07H56J7K1%26ref_=dp_merchant_link%26isAmazonFulfilled=1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
url ,抓取目标链接(必填)

该参数用于指定待抓取的 Amazon 的访问 URL 地址。

示例请求:

"url": "https://www.amazon.com/sp?ie=UTF8%26seller=ADZ7LD48GVFQJ%26asin=B07H56J7K1%26ref_=dp_merchant_link%26isAmazonFulfilled=1"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_seller_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.amazon.com/sp?ie=UTF8%26seller=ADZ7LD48GVFQJ%26asin=B07H56J7K1%26ref_=dp_merchant_link%26isAmazonFulfilled=1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

五、产品-抓取产品列表 1.Amazon - 通过关键词收集产品列表

spider_id ,所属抓取工具(必填)

定义了使用哪个抓取工具。

示例请求:

spider_id=amazon_product-list_by-keywords-domain

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product-list_by-keywords-domain" ^
  -d "spider_parameters=[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
keyword ,关键词(必填)

该参数用于指定抓取 Amazon 产品时使用的搜索关键词。

示例请求:

"keyword": "X-box"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product-list_by-keywords-domain" ^
  -d "spider_parameters=[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
domain ,主域名(必填)

该参数用于指定卖家主页的 URL,以便抓取该卖家所售产品的数据。

示例请求:

"domain": "https://www.amazon.com/"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product-list_by-keywords-domain" ^
  -d "spider_parameters=[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"
page_turning ,抓取页数(可选)

该参数用于设置抓取搜索结果的页数。输入数字 n 表示抓取从第一页到第 n 页的所有产品数据。

示例请求:

"page_turning":"1"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=amazon.com" ^
  -d "spider_id=amazon_product-list_by-keywords-domain" ^
  -d "spider_parameters=[{\"keyword\": \"X-box\",\"domain\": \"https://www.amazon.com/\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

如果您需要更多帮助,请通过邮箱[email protected]联系我们。

Last updated

Was this helpful?