Walmart Scraping Parameters
Web Scraper API Walmart Parameters
Configure Walmart scraping parameters using Thordata’s Web Scraper API, including URL, category URL, all variations, keywords, main domain, SKU, and other parameters.
Unique Identifier:
token ，Access token (required)
This parameter is used as the API access token to ensure the legitimacy of the scraping request.
Request examples:
Authorization: Bearer ********************
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer ********************" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=walmart.com" ^
-d "spider_id=walmart_product_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.walmart.com/ip/Starburst-Pink-Yellow-Mix-Chewy-Fruit-Candy-3-lbs-Original-Strawberry-Lemon-Soft-Chew-Candies-Bulk-Family-Size-Assortment-Pack-Individually-Wrapped-4/1016450755?adsRedirect=true\",\"all_variations\": \"false\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
Product - Scrape Walmart product information:
Walmart - Scrape product information by URL
spider_id ，Scraper tool (required)
Defines which scraper tool to use.
Request examples:
spider_id=walmart_product_by-url
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=walmart.com" ^
-d "spider_id=walmart_product_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.walmart.com/ip/Starburst-Pink-Yellow-Mix-Chewy-Fruit-Candy-3-lbs-Original-Strawberry-Lemon-Soft-Chew-Candies-Bulk-Family-Size-Assortment-Pack-Individually-Wrapped-4/1016450755?adsRedirect=true\",\"all_variations\": \"false\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"url ，URL (required)
This parameter specifies the Walmart product URL to be scraped.
Request examples:
"url": "https://www.walmart.com/ip/Starburst-Pink-Yellow-Mix-Chewy-Fruit-Candy-3-lbs-Original-Strawberry-Lemon-Soft-Chew-Candies-Bulk-Family-Size-Assortment-Pack-Individually-Wrapped-4/1016450755?adsRedirect=true"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=walmart.com" ^
-d "spider_id=walmart_product_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.walmart.com/ip/Starburst-Pink-Yellow-Mix-Chewy-Fruit-Candy-3-lbs-Original-Strawberry-Lemon-Soft-Chew-Candies-Bulk-Family-Size-Assortment-Pack-Individually-Wrapped-4/1016450755?adsRedirect=true\",\"all_variations\": \"false\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"all_variations, all variations (optional)
This parameter specifies whether to collect all product variations. Set to true to enable.
Values: true, false
Request examples:
"all_variations": "false"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=walmart.com" ^
-d "spider_id=walmart_product_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.walmart.com/ip/Starburst-Pink-Yellow-Mix-Chewy-Fruit-Candy-3-lbs-Original-Strawberry-Lemon-Soft-Chew-Candies-Bulk-Family-Size-Assortment-Pack-Individually-Wrapped-4/1016450755?adsRedirect=true\",\"all_variations\": \"false\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"Walmart - Scrape product information by category URL
spider_id ，Scraper tool (required)
Defines which scraper tool to use.
Request examples:
spider_id=walmart_product_by-category-url
category_url, category URL (required)
This parameter specifies a Walmart category URL to find new products.
Request examples:
"category_url": "https://www.walmart.com/shop/deals/food/beverages?povid=976759_itemcarousel_976782_Drinkupthesavings_Viewall_Rweb_May_08"
all_variations, all variations (optional)
This parameter specifies whether to collect all product variations. Set to true to enable.
Values: true, false
Request examples:
"all_variations": "false"
Walmart - Scrape product information by keyword
spider_id ，Scraper tool (required)
Defines which scraper tool to use.
Request examples:
spider_id=walmart_product_by-keywords
keyword, keyword (required)
This parameter specifies the search keyword for scraping Walmart products.
Request examples:
"keyword": "leggins"
domain, main domain (optional)
This parameter specifies the main domain for scraping Walmart product information.
Request examples:
"domain": "https://www.walmart.com/"
all_variations, all variations (optional)
This parameter specifies whether to collect all product variations. Set to true to enable.
Values: true,false
Request examples:
"all_variations": "false"
Walmart - Scrape product information by SKU
spider_id ，Scraper tool (required)
Defines which scraper tool to use.
Request examples:
spider_id=walmart_product_by-sku
sku, SKU (required)
This parameter specifies the unique SKU code of the product to be scraped.
Request examples:
"sku": "439179861"
all_variations, all variations (optional)
This parameter specifies whether to collect all product variations. Set to true to enable.
Values: true,false
Request examples:
"all_variations": "false"
If you need further assistance, please contact us via email at [email protected].
Last updated