LinkedIn Scraping Parameters

Web Scraper API LinkedIn Scraping Parameters

Configure LinkedIn Scraping Parameters using Thordata's Web Scraper API, including URL, Job URL, Job Listing URL, keywords, and other parameters.

Unique Identifier:

token ，Access token(required)

This parameter is used as the API access token to ensure the legitimacy of the scraping request.

Request examples:

Authorization: Bearer ********************

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer ********************" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_job_listings_information_by-job-listing-url" ^
  -d "spider_parameters=[{\"job_listing_url\": \"https://www.linkedin.com/jobs/reddit-inc.-jobs-worldwide?f_C=150573\",\"page_turning\": \"\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

Product - Scrape company information:

1. LinkedIn - Scrape company information by URL

spider_id ，Scraper tool (required)

Defines which scraper tool to use.

Request examples:

spider_id=linkedin_company_information_by-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_company_information_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.linkedin.com/company/dynamo-software\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

url ，URL (required)

This parameter specifies the company LinkedIn URL to be scraped.

Request examples:

"url": "https://www.linkedin.com/company/dynamo-software"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_company_information_by-url" ^
  -d "spider_parameters=[{\"url\": \"https://www.linkedin.com/company/dynamo-software\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

Product - Scrape job listing information:

1. LinkedIn - Scrape job listing information by Job Listing URL

spider_id ，Scraper tool(required)

Defines which scraper tool to use.

Request examples:

spider_id=linkedin_job_listings_information_by-job-listing-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_job_listings_information_by-job-listing-url" ^
  -d "spider_parameters=[{\"job_listing_url\": \"https://www.linkedin.com/jobs/reddit-inc.-jobs-worldwide?f_C=150573\",\"page_turning\": \"\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

job_listing_url， Job Listing URL（required）

This parameter specifies the Job Listing URL for crawling.

Request examples:

"job_listing_url": "https://www.linkedin.com/jobs/reddit-inc.-jobs-worldwide?f_C=150573"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_job_listings_information_by-job-listing-url" ^
  -d "spider_parameters=[{\"job_listing_url\": \"https://www.linkedin.com/jobs/reddit-inc.-jobs-worldwide?f_C=150573\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

page_turning，Page Turning（optional）

This parameter specifies the page turning for crawling.

Request examples:

"page_turning": "1"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_job_listings_information_by-job-listing-url" ^
  -d "spider_parameters=[{\"job_listing_url\": \"https://www.linkedin.com/jobs/reddit-inc.-jobs-worldwide?f_C=150573\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

2. LinkedIn - Scrape job listing information by Job URL

spider_id ，Scraper tool (required)

Defines which scraper tool to use.

Request examples:

spider_id=linkedin_job_listings_information_by-job-url

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_job_listings_information_by-job-url" ^
  -d "spider_parameters=[{\"job_url\": \"https://www.linkedin.com/jobs/view/senior-client-partner-large-customer-sales-gaming-at-reddit-inc-4303761033?position=10%26pageNum=0%26refId=kHRQtl6Ws14VG9y3UloI4w%3D%3D%26trackingId=%2Fb2esqHHEjp1FoEkC8PfuQ%3D%3D\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

job_url，Job URL (required)

This parameter specifies the job url for crawling.

Request examples:

"job_url": "https://www.linkedin.com/jobs/view/senior-client-partner-large-customer-sales-gaming-at-reddit-inc-4303761033?position=10&pageNum=0&refId=kHRQtl6Ws14VG9y3UloI4w%3D%3D&trackingId=%2Fb2esqHHEjp1FoEkC8PfuQ%3D%3D"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_job_listings_information_by-job-url" ^
  -d "spider_parameters=[{\"job_url\": \"https://www.linkedin.com/jobs/view/senior-client-partner-large-customer-sales-gaming-at-reddit-inc-4303761033?position=10%26pageNum=0%26refId=kHRQtl6Ws14VG9y3UloI4w%3D%3D%26trackingId=%2Fb2esqHHEjp1FoEkC8PfuQ%3D%3D\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

3. LinkedIn - Scrape job listing information by Keyword

spider_id ，Scraper tool (required)

Defines which scraper tool to use.

Request examples:

spider_id=linkedin_job_listings_information_by-keyword

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_job_listings_information_by-keyword" ^
  -d "spider_parameters=[{\"location\": \"New York\",\"keyword\": \"product manager\",\"time_range\": \"\",\"experience_level\": \"\",\"job_type\": \"\",\"remote\": \"\",\"company\": \"\",\"selective_search\": \"\",\"jobs_to_not_include\": \"\",\"location_radius\": \"\",\"page_turning\": \"\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

location，Job Location (required)

This parameter specifies the job location for crawling.

Request examples:

"location": "New York"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_job_listings_information_by-keyword" ^
  -d "spider_parameters=[{\"location\": \"New York\",\"keyword\": \"product manager\",\"time_range\": \"Any_time\",\"experience_level\": \"Internship\",\"job_type\": \"Full_time\",\"remote\": \"On_site\",\"company\": \"Reddit, Inc.\",\"selective_search\": \"true\",\"jobs_to_not_include\": \"4321229455\",\"location_radius\": \"Exact_location\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

keyword，Keyword (optional)

This parameter specifies the Keyword for crawling.

Request examples:

"Keyword": "product manager"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_job_listings_information_by-keyword" ^
  -d "spider_parameters=[{\"location\": \"New York\",\"keyword\": \"product manager\",\"time_range\": \"Any_time\",\"experience_level\": \"Internship\",\"job_type\": \"Full_time\",\"remote\": \"On_site\",\"company\": \"Reddit, Inc.\",\"selective_search\": \"true\",\"jobs_to_not_include\": \"4321229455\",\"location_radius\": \"Exact_location\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

time_range，Time Range (optional)

This parameter specifies the time range for crawling.

Request examples:

"time_range": "Any_time"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_job_listings_information_by-keyword" ^
  -d "spider_parameters=[{\"location\": \"New York\",\"keyword\": \"product manager\",\"time_range\": \"Any_time\",\"experience_level\": \"Internship\",\"job_type\": \"Full_time\",\"remote\": \"On_site\",\"company\": \"Reddit, Inc.\",\"selective_search\": \"true\",\"jobs_to_not_include\": \"4321229455\",\"location_radius\": \"Exact_location\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

experience_level，Experience Level (optional)

This parameter specifies the experience level for crawling.

Request examples:

"experience_level": "Internship"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_job_listings_information_by-keyword" ^
  -d "spider_parameters=[{\"location\": \"New York\",\"keyword\": \"product manager\",\"time_range\": \"Any_time\",\"experience_level\": \"Internship\",\"job_type\": \"Full_time\",\"remote\": \"On_site\",\"company\": \"Reddit, Inc.\",\"selective_search\": \"true\",\"jobs_to_not_include\": \"4321229455\",\"location_radius\": \"Exact_location\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

job_type，Job Type (optional)

This parameter specifies the job type for crawling.

Request examples:

"job_type": "Full_time"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_job_listings_information_by-keyword" ^
  -d "spider_parameters=[{\"location\": \"New York\",\"keyword\": \"product manager\",\"time_range\": \"Any_time\",\"experience_level\": \"Internship\",\"job_type\": \"Full_time\",\"remote\": \"On_site\",\"company\": \"Reddit, Inc.\",\"selective_search\": \"true\",\"jobs_to_not_include\": \"4321229455\",\"location_radius\": \"Exact_location\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

remote，Remote (optional)

This parameter specifies the job remote type for crawling.

Request examples:

"remote": "On_site"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_job_listings_information_by-keyword" ^
  -d "spider_parameters=[{\"location\": \"New York\",\"keyword\": \"product manager\",\"time_range\": \"Any_time\",\"experience_level\": \"Internship\",\"job_type\": \"Full_time\",\"remote\": \"On_site\",\"company\": \"Reddit, Inc.\",\"selective_search\": \"true\",\"jobs_to_not_include\": \"4321229455\",\"location_radius\": \"Exact_location\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

company，Company (optional)

This parameter specifies the company for crawling.

Request examples:

"company": "Reddit, Inc."

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_job_listings_information_by-keyword" ^
  -d "spider_parameters=[{\"location\": \"New York\",\"keyword\": \"product manager\",\"time_range\": \"Any_time\",\"experience_level\": \"Internship\",\"job_type\": \"Full_time\",\"remote\": \"On_site\",\"company\": \"Reddit, Inc.\",\"selective_search\": \"true\",\"jobs_to_not_include\": \"4321229455\",\"location_radius\": \"Exact_location\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

selective_search，Selective Search (optional)

When set to true, the filter excludes titles that do not contain thespecified keyword.

Request examples:

"selective_search": "true"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_job_listings_information_by-keyword" ^
  -d "spider_parameters=[{\"location\": \"New York\",\"keyword\": \"product manager\",\"time_range\": \"Any_time\",\"experience_level\": \"Internship\",\"job_type\": \"Full_time\",\"remote\": \"On_site\",\"company\": \"Reddit, Inc.\",\"selective_search\": \"true\",\"jobs_to_not_include\": \"4321229455\",\"location_radius\": \"Exact_location\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

jobs_to_not_include，Jobs not include (optional)

This parameter specifies the job id search to exclude.

Request examples:

"jobs_to_not_include": "4321229455"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_job_listings_information_by-keyword" ^
  -d "spider_parameters=[{\"location\": \"New York\",\"keyword\": \"product manager\",\"time_range\": \"Any_time\",\"experience_level\": \"Internship\",\"job_type\": \"Full_time\",\"remote\": \"On_site\",\"company\": \"Reddit, Inc.\",\"selective_search\": \"true\",\"jobs_to_not_include\": \"4321229455\",\"location_radius\": \"Exact_location\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

location_radius，Location Radius (optional)

This parameter specifies the job search for jobs within a specificdistance range.

Request examples:

"location_radius": "Exact_location"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_job_listings_information_by-keyword" ^
  -d "spider_parameters=[{\"location\": \"New York\",\"keyword\": \"product manager\",\"time_range\": \"Any_time\",\"experience_level\": \"Internship\",\"job_type\": \"Full_time\",\"remote\": \"On_site\",\"company\": \"Reddit, Inc.\",\"selective_search\": \"true\",\"jobs_to_not_include\": \"4321229455\",\"location_radius\": \"Exact_location\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

page_turning，Page Turning (optional)

This parameter is used to specify the limit on the number ofcrawled results.

Request examples:

"page_turning": "1"

curl -X POST "https://scraperapi.thordata.com/builder" ^
  -H "Authorization: Bearer Token-ID" ^
  -H "Content-Type: application/x-www-form-urlencoded" ^
  -d "spider_name=linkedin.com" ^
  -d "spider_id=linkedin_job_listings_information_by-keyword" ^
  -d "spider_parameters=[{\"location\": \"New York\",\"keyword\": \"product manager\",\"time_range\": \"Any_time\",\"experience_level\": \"Internship\",\"job_type\": \"Full_time\",\"remote\": \"On_site\",\"company\": \"Reddit, Inc.\",\"selective_search\": \"true\",\"jobs_to_not_include\": \"4321229455\",\"location_radius\": \"Exact_location\",\"page_turning\": \"1\"}]" ^
  -d "spider_errors=true" ^
  -d "file_name={{TasksID}}"

If you need further assistance, please contact us via email at [email protected].