Walmart Scraping Parameters

Web Scraper API Walmart Parameters

Configure Walmart scraping parameters using Thordata’s Web Scraper API, including URL, category URL, all variations, keywords, main domain, SKU, and other parameters.

Unique Identifier:

token ，access token (required)

This parameter is used as the API access token to ensure the legitimacy of the scraping request.

Request examples:

Authorization: Bearer ********************

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer ********************" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=walmart.com" ^
  -d "spider_id=walmart_product_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.walmart.com/ip/Starburst-Pink-Yellow-Mix-Chewy-Fruit-Candy-3-lbs-Original-Strawberry-Lemon-Soft-Chew-Candies-Bulk-Family-Size-Assortment-Pack-Individually-Wrapped-4/1016450755?adsRedirect=true\",\"all_variations\": \"false\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

Product - Scrape Walmart product information:

1. Walmart - Scrape product information by URL

spider_id ，Scraper tool (required)

Defines which scraper tool to use.

Request examples:

spider_id=walmart_product_by-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=walmart.com" ^
  -d "spider_id=walmart_product_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.walmart.com/ip/Starburst-Pink-Yellow-Mix-Chewy-Fruit-Candy-3-lbs-Original-Strawberry-Lemon-Soft-Chew-Candies-Bulk-Family-Size-Assortment-Pack-Individually-Wrapped-4/1016450755?adsRedirect=true\",\"all_variations\": \"false\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

url ，URL (required)

This parameter specifies the Walmart product URL to be scraped.

Request examples:

"url": "https://www.walmart.com/ip/Starburst-Pink-Yellow-Mix-Chewy-Fruit-Candy-3-lbs-Original-Strawberry-Lemon-Soft-Chew-Candies-Bulk-Family-Size-Assortment-Pack-Individually-Wrapped-4/1016450755?adsRedirect=true"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=walmart.com" ^
  -d "spider_id=walmart_product_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.walmart.com/ip/Starburst-Pink-Yellow-Mix-Chewy-Fruit-Candy-3-lbs-Original-Strawberry-Lemon-Soft-Chew-Candies-Bulk-Family-Size-Assortment-Pack-Individually-Wrapped-4/1016450755?adsRedirect=true\",\"all_variations\": \"false\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

all_variations, all variations (optional)

This parameter specifies whether to collect all product variations. Set to true to enable. Values: true, false

Request examples:

"all_variations": "false"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=walmart.com" ^
  -d "spider_id=walmart_product_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.walmart.com/ip/Starburst-Pink-Yellow-Mix-Chewy-Fruit-Candy-3-lbs-Original-Strawberry-Lemon-Soft-Chew-Candies-Bulk-Family-Size-Assortment-Pack-Individually-Wrapped-4/1016450755?adsRedirect=true\",\"all_variations\": \"false\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

1. Walmart - Scrape product information by category URL

spider_id ，Scraper tool (required)

Defines which scraper tool to use.

Request examples:

spider_id=walmart_product_by-category-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=walmart.com" ^
  -d "spider_id=walmart_product_by-category-url" ^
  -d "spider_parameters=[{\"category_url\": \"https://www.walmart.com/shop/deals/food/beverages?povid=976759_itemcarousel_976782_Drinkupthesavings_Viewall_Rweb_May_08\",\"all_variations\": \"false\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

category_url, category URL (required)

This parameter specifies a Walmart category URL to find new products.

Request examples:

"category_url": "https://www.walmart.com/shop/deals/food/beverages?povid=976759_itemcarousel_976782_Drinkupthesavings_Viewall_Rweb_May_08"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=walmart.com" ^
  -d "spider_id=walmart_product_by-category-url" ^
  -d "spider_parameters=[{\"category_url\": \"https://www.walmart.com/shop/deals/food/beverages?povid=976759_itemcarousel_976782_Drinkupthesavings_Viewall_Rweb_May_08\",\"all_variations\": \"false\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

all_variations, all variations (optional)

This parameter specifies whether to collect all product variations. Set to true to enable. Values: true, false

Request examples:

"all_variations": "false"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=walmart.com" ^
  -d "spider_id=walmart_product_by-category-url" ^
  -d "spider_parameters=[{\"category_url\": \"https://www.walmart.com/shop/deals/food/beverages?povid=976759_itemcarousel_976782_Drinkupthesavings_Viewall_Rweb_May_08\",\"all_variations\": \"false\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

1. Walmart - Scrape product information by keyword

spider_id ，Scraper tool (required)

Defines which scraper tool to use.

Request examples:

spider_id=walmart_product_by-keywords

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=walmart.com" ^
  -d "spider_id=walmart_product_by-keywords" ^
  -d "spider_parameters=[{\"keyword\": \"leggins\",\"domain\": \"https://www.walmart.com/\",\"all_variations\": \"false\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

keyword, keyword (required)

This parameter specifies the search keyword for scraping Walmart products.

Request examples:

"keyword": "leggins"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=walmart.com" ^
  -d "spider_id=walmart_product_by-keywords" ^
  -d "spider_parameters=[{\"keyword\": \"leggins\",\"domain\": \"https://www.walmart.com/\",\"all_variations\": \"false\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

domain, main domain (optional)

This parameter specifies the main domain for scraping Walmart product information.

Request examples:

"domain": "https://www.walmart.com/"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=walmart.com" ^
  -d "spider_id=walmart_product_by-keywords" ^
  -d "spider_parameters=[{\"keyword\": \"leggins\",\"domain\": \"https://www.walmart.com/\",\"all_variations\": \"false\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

all_variations, all variations (optional)

This parameter specifies whether to collect all product variations. Set to true to enable. Values: true,false

Request examples:

"all_variations": "false"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=walmart.com" ^
  -d "spider_id=walmart_product_by-keywords" ^
  -d "spider_parameters=[{\"keyword\": \"leggins\",\"domain\": \"https://www.walmart.com/\",\"all_variations\": \"false\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

1. Walmart - Scrape product information by SKU

spider_id ，Scraper tool (required)

Defines which scraper tool to use.

Request examples:

spider_id=walmart_product_by-sku

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=walmart.com" ^
  -d "spider_id=walmart_product_by-sku" ^
  -d "spider_parameters=[{\"sku\": \"439179861\",\"all_variations\": \"false\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

sku, SKU (required)

This parameter specifies the unique SKU code of the product to be scraped.

Request examples:

"sku": "439179861"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=walmart.com" ^
  -d "spider_id=walmart_product_by-sku" ^
  -d "spider_parameters=[{\"sku\": \"439179861\",\"all_variations\": \"false\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

all_variations, all variations (optional)

This parameter specifies whether to collect all product variations. Set to true to enable. Values: true,false

Request examples:

"all_variations": "false"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=walmart.com" ^
  -d "spider_id=walmart_product_by-sku" ^
  -d "spider_parameters=[{\"sku\": \"439179861\",\"all_variations\": \"false\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

If you need further assistance, please contact us via email at [email protected].