Create a crawling task description

Basic Information

Interface Description: Create a crawling task for the Web Scraper API through the interface.

Text request address: https://scraperapi.thordata.com/builder YouTube audio/video request address: https://scraperapi.thordata.com/video_builder

Request Method: POST

Request parameters

Header:

Parameter name
Type
Required
Describe

token

string

Yes

Please log in to the Dashboard-MENU-My Accountarrow-up-right to view your token parameter value

Authorization

string

Yes

Please log in to the Dashboardarrow-up-right to view your Authorization token parameter value. Example: "Authorization: Bearer *********************"

Body:

Parameter name
Type
Required
Describe

spider_name

string

Yes

Facebook:

spider_name facebook.com

Amazon:

spider_name amazon.com

YouTube:

spider_name youtube.com

spider_id

string

Yes

Amazon:

spider_id amazon_product_by-url, amazon_product_by-best-sellers, etc.

YouTube:

spider_id youtube_video_by-url, youtube_audio_by-url, etc.

For more ids, please see the parameter descriptionarrow-up-right.

spider_parameters

text

Yes

Amazon:

url crawling link, zip_code zip code, sort_by sorting method, etc.

YouTube:

url crawling link.

For more parameters, please see the parameter descriptionarrow-up-right.

spider_errors

string

Yes

true

file_name

string

Yes

Customize the name of the downloaded file.

{{TasksID}}, {{VideoID}}, etc.

Response example

circle-info

If the returned code value is not 200, please check the error code description listarrow-up-right and modify it.

Parameter name
Type
Required
Describe

code

number

Yes

The returned code value.

data

object

No

The returned details.

task_id

number

No

The id of the task.

Last updated