Indeed Scraping Parameters

Web Scraper API Indeed Scraping Parameters

Configure Indeed Scraping Parameters using Thordata's Web Scraper API, including URL, Job URL, Job Listing URL, keywords, industry, state, and other parameters.

Unique Identifier:

token，Access token(required)

This parameter is used as the API access token to ensure the legitimacy of the scraping request.

Request examples:

Authorization: Bearer ********************

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer ********************" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_companies-info_by-company-url" ^
  -d "spider_parameters=[{\"company_url\": \"https://www.indeed.com/cmp/Allstate-Insurance\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

Product - Scrape company information:

1. Indeed - Scrape company information by Company URL

spider_id ，Scraper tool (required)

Defines which scraper tool to use.

Request examples:

spider_id=indeed_companies-info_by-company-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_companies-info_by-company-url" ^
  -d "spider_parameters=[{\"company_url\": \"https://www.indeed.com/cmp/Allstate-Insurance\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

url ，Company URL (required)

This parameter specifies the company URL to be scraped.

Request examples:

"url": "https://www.linkedin.com/company/dynamo-software"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_companies-info_by-company-url" ^
  -d "spider_parameters=[{\"company_url\": \"https://www.indeed.com/cmp/Allstate-Insurance\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

2. Indeed - Scrape company information by Company List URL

spider_id ，Scraper tool (required)

Defines which scraper tool to use.

Request examples:

spider_id=indeed_companies-info_by-company-list-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_companies-info_by-company-list-url" ^
  -d "spider_parameters=[{\"company_url\": \"https://www.indeed.com/cmp/Allstate-Insurance\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

url ，Company List URL (required)

This parameter specifies the company list URL to be scraped.

Request examples:

"url": "https://www.indeed.com/companies/browse-companies"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_companies-info_by-company-list-url" ^
  -d "spider_parameters=[{\"company_list_url\": \"https://www.indeed.com/companies/browse-companies\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

3. Indeed - Scrape company information by Keyword

spider_id ，Scraper tool (required)

Defines which scraper tool to use.

Request examples:

spider_id=indeed_companies-info_by-keyword

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_companies-info_by-keyword" ^
  -d "spider_parameters=[{\"keyword\": \"openai\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

keyword ，Keyword (required)

This parameter specifies the keyword to search.

Request examples:

"keyword": "openai"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_companies-info_by-keyword" ^
  -d "spider_parameters=[{\"keyword\": \"openai\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

4. Indeed - Scrape company information by Industry and State

spider_id ，Scraper tool (required)

Defines which scraper tool to use.

Request examples:

spider_id=indeed_companies-info_by-industry-and-state

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_companies-info_by-industry-and-state" ^
  -d "spider_parameters=[{\"industry\": \"Advertising %26 Public Relations\",\"state\": \"United States\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

industry ，Industry (required)

This parameter specifies the industry to collect.

Request examples:

"industry": "Advertising %26 Public Relations"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_companies-info_by-industry-and-state" ^
  -d "spider_parameters=[{\"industry\": \"Advertising %26 Public Relations\",\"state\": \"United States\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

state ，State (optional)

This parameter specifies the state to collect.

Request examples:

"state": "United States"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_companies-info_by-industry-and-state" ^
  -d "spider_parameters=[{\"industry\": \"Advertising %26 Public Relations\",\"state\": \"United States\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

Product - Scrape job listing information:

1. Indeed - Scrape job listing information by Job URL

spider_id ，Scraper tool(required)

Defines which scraper tool to use.

Request examples:

spider_id=indeed_job-listings_by-job-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_job-listings_by-job-url" ^
  -d "spider_parameters=[{\"job_url\": \"https://fr.indeed.com/viewjob?jk=55b3e5dfa0c2ff66\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

job_url， Job URL（required）

This parameter specifies the Job URL for crawling.

Request examples:

"job_url": "https://fr.indeed.com/viewjob?jk=55b3e5dfa0c2ff66"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_job-listings_by-job-url" ^
  -d "spider_parameters=[{\"job_url\": \"https://fr.indeed.com/viewjob?jk=55b3e5dfa0c2ff66\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

2. Indeed - Scrape job listing information by Keyword

spider_id ，Scraper tool (required)

Defines which scraper tool to use.

Request examples:

spider_id=indeed_job-listings_by-keyword

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_job-listings_by-keyword" ^
  -d "spider_parameters=[{\"country\": \"BR\",\"domain\": \"indeed.com\",\"keyword\": \"analyst\",\"location\": \"New York, NY\",\"date_posted\": \"The past 24 hours\",\"posted_by\": \"Employer\",\"pay\": \"\",\"location_radius\": \"Exact location only\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

country，Country (required)

This parameter specifies the country for crawling.

Request examples:

"country": "BR"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_job-listings_by-keyword" ^
  -d "spider_parameters=[{\"country\": \"BR\",\"domain\": \"indeed.com\",\"keyword\": \"analyst\",\"location\": \"New York, NY\",\"date_posted\": \"The past 24 hours\",\"posted_by\": \"Employer\",\"pay\": \"\",\"location_radius\": \"Exact location only\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

domain，Indeed Domian (required)

This parameter specifies the Indeed Domaiin for crawling.

Request examples:

"domain": "indeed.com"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_job-listings_by-keyword" ^
  -d "spider_parameters=[{\"country\": \"BR\",\"domain\": \"indeed.com\",\"keyword\": \"analyst\",\"location\": \"New York, NY\",\"date_posted\": \"The past 24 hours\",\"posted_by\": \"Employer\",\"pay\": \"\",\"location_radius\": \"Exact location only\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

keyword，Keyword (required)

This parameter specifies the keyword to search.

Request examples:

"keyword": "analyst"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_job-listings_by-keyword" ^
  -d "spider_parameters=[{\"country\": \"BR\",\"domain\": \"indeed.com\",\"keyword\": \"analyst\",\"location\": \"New York, NY\",\"date_posted\": \"The past 24 hours\",\"posted_by\": \"Employer\",\"pay\": \"\",\"location_radius\": \"Exact location only\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

location，Location (required)

This parameter specifies the location to search.

Request examples:

"location": "New York, NY"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_job-listings_by-keyword" ^
  -d "spider_parameters=[{\"country\": \"BR\",\"domain\": \"indeed.com\",\"keyword\": \"analyst\",\"location\": \"New York, NY\",\"date_posted\": \"The past 24 hours\",\"posted_by\": \"Employer\",\"pay\": \"\",\"location_radius\": \"Exact location only\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

date_posted，Date Posted (optional)

This parameter specifies the posting time range of the position to be captured. .

Request examples:

"date_posted": "The past 24 hours"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_job-listings_by-keyword" ^
  -d "spider_parameters=[{\"country\": \"BR\",\"domain\": \"indeed.com\",\"keyword\": \"analyst\",\"location\": \"New York, NY\",\"date_posted\": \"The past 24 hours\",\"posted_by\": \"Employer\",\"pay\": \"\",\"location_radius\": \"Exact location only\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

posted_by，Posted by (optional)

This parameter is used to specify the publisher of the position to be crawled.

Request examples:

"posted_by": "Employer"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
 -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_job-listings_by-keyword" ^
  -d "spider_parameters=[{\"country\": \"BR\",\"domain\": \"indeed.com\",\"keyword\": \"analyst\",\"location\": \"New York, NY\",\"date_posted\": \"The past 24 hours\",\"posted_by\": \"Employer\",\"pay\": \"\",\"location_radius\": \"Exact location only\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

pay，Pay (optional)

This parameter is used to specify the salary range of the position to be captured.

Request examples:

"pay": "50"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_job-listings_by-keyword" ^
  -d "spider_parameters=[{\"country\": \"BR\",\"domain\": \"indeed.com\",\"keyword\": \"analyst\",\"location\": \"New York, NY\",\"date_posted\": \"The past 24 hours\",\"posted_by\": \"Employer\",\"pay\": \"50\",\"location_radius\": \"Exact location only\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

location_radius，Location Radius (optional)

This parameter is used to specify the positional distance of the position to be grabbed.

Request examples:

"location_radius": "Exact location only"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=indeed.com" ^
  -d "spider_id=indeed_job-listings_by-keyword" ^
  -d "spider_parameters=[{\"country\": \"BR\",\"domain\": \"indeed.com\",\"keyword\": \"analyst\",\"location\": \"New York, NY\",\"date_posted\": \"The past 24 hours\",\"posted_by\": \"Employer\",\"pay\": \"50\",\"location_radius\": \"Exact location only\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

If you need further assistance, please contact us via email at [email protected].