LinkedIn Scraping Parameters
Web Scraper API LinkedIn Scraping Parameters
Configure LinkedIn Scraping Parameters using Thordata's Web Scraper API, including URL, Job URL, Job Listing URL, keywords, and other parameters.
Unique Identifier:
token ，Access token(required)
This parameter is used as the API access token to ensure the legitimacy of the scraping request.
Request examples:
Authorization: Bearer ********************
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer ********************" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=linkedin.com" ^
-d "spider_id=linkedin_job_listings_information_by-job-listing-url" ^
-d "spider_parameters=[{\"job_listing_url\": \"https://www.linkedin.com/jobs/reddit-inc.-jobs-worldwide?f_C=150573\",\"page_turning\": \"\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
Product - Scrape company information:
1. LinkedIn - Scrape company information by URL
spider_id ，Scraper tool (required)
Defines which scraper tool to use.
Request examples:
spider_id=linkedin_company_information_by-url
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=linkedin.com" ^
-d "spider_id=linkedin_company_information_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.linkedin.com/company/dynamo-software\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"
url ，URL (required)
This parameter specifies the company LinkedIn URL to be scraped.
Request examples:
"url": "https://www.linkedin.com/company/dynamo-software"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=linkedin.com" ^
-d "spider_id=linkedin_company_information_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.linkedin.com/company/dynamo-software\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"Product - Scrape job listing information:
1. LinkedIn - Scrape job listing information by Job Listing URL
spider_id ，Scraper tool(required)
Defines which scraper tool to use.
Request examples:
spider_id=linkedin_job_listings_information_by-job-listing-url
job_listing_url， Job Listing URL（required）
This parameter specifies the Job Listing URL for crawling.
Request examples:
"job_listing_url": "https://www.linkedin.com/jobs/reddit-inc.-jobs-worldwide?f_C=150573"
page_turning，Page Turning（optional）
This parameter specifies the page turning for crawling.
Request examples:
"page_turning": "1"
2. LinkedIn - Scrape job listing information by Job URL
spider_id ，Scraper tool (required)
Defines which scraper tool to use.
Request examples:
spider_id=linkedin_job_listings_information_by-job-url
job_url，Job URL (required)
This parameter specifies the job url for crawling.
Request examples:
"job_url": "https://www.linkedin.com/jobs/view/senior-client-partner-large-customer-sales-gaming-at-reddit-inc-4303761033?position=10&pageNum=0&refId=kHRQtl6Ws14VG9y3UloI4w%3D%3D&trackingId=%2Fb2esqHHEjp1FoEkC8PfuQ%3D%3D"
3. LinkedIn - Scrape job listing information by Keyword
spider_id ，Scraper tool (required)
Defines which scraper tool to use.
Request examples:
spider_id=linkedin_job_listings_information_by-keyword
location，Job Location (required)
This parameter specifies the job location for crawling.
Request examples:
"location": "New York"
keyword，Keyword (optional)
This parameter specifies the Keyword for crawling.
Request examples:
"Keyword": "product manager"
time_range，Time Range (optional)
This parameter specifies the time range for crawling.
Request examples:
"time_range": "Any_time"
experience_level，Experience Level (optional)
This parameter specifies the experience level for crawling.
Request examples:
"experience_level": "Internship"
job_type，Job Type (optional)
This parameter specifies the job type for crawling.
Request examples:
"job_type": "Full_time"
remote，Remote (optional)
This parameter specifies the job remote type for crawling.
Request examples:
"remote": "On_site"
company，Company (optional)
This parameter specifies the company for crawling.
Request examples:
"company": "Reddit, Inc."
selective_search，Selective Search (optional)
When set to true, the filter excludes titles that do not contain thespecified keyword.
Request examples:
"selective_search": "true"
jobs_to_not_include，Jobs not include (optional)
This parameter specifies the job id search to exclude.
Request examples:
"jobs_to_not_include": "4321229455"
location_radius，Location Radius (optional)
This parameter specifies the job search for jobs within a specificdistance range.
Request examples:
"location_radius": "Exact_location"
page_turning，Page Turning (optional)
This parameter is used to specify the limit on the number ofcrawled results.
Request examples:
"page_turning": "1"
If you need further assistance, please contact us via email at [email protected].
Last updated
Was this helpful?