Create a crawling task description

Basic Information

Interface Description: Create a crawling task for the Web Scraper API through the interface.

Text request address: https://scraperapi.thordata.com/builder YouTube audio/video request address: https://scraperapi.thordata.com/video_builder

Request Method: POST

Request parameters

Header:

Parameter name
Type
Required
Describe

token

string

Yes

Please log in to the Dashboard-MENU-My Account to view your token parameter value

key

string

Yes

Please log in to the Dashboard-MENU-My Account to view your key parameter value

Authorization

string

Yes

Please log in to the Dashboard to view your Authorization token parameter value. Example: "Authorization: Bearer *********************"

Body:

Parameter name
Type
Required
Describe

file_name

string

Yes

Customize the name of the downloaded file. {{TasksID}}, {{VideoID}}

individual_params

text

Yes

Facebook:

keyword keyword, recent_postswhether it is a recent post, date year, number number of posts, spider_id product unique identifier.

For more parameters, please see the parameter description .

Amazon:

url crawling link, zip_code zip code, sort_by sorting method, etc.

For more parameters, please see the parameter description.

YouTube:

url crawling link.

For more parameters, please see the parameter description.

spider_id

string

Yes

Included in individual_params。Unique product identifier. facebook.comamazon.com

common_settings

string

Yes

YouTube-Video: resolution resolution YouTube-Audio: audio_format audio format, bitrate bitrate, is_subtitles whether subtitles are needed, subtitles_language subtitles language. For more parameters, please see the parameter description.

Response example

{
    "code": 200,
    "data": {
        "task_id": "68a21d2e8f2645e39f3d62231ef6d829"
    }
}

If the returned code value is not 200, please check the error code description list and modify it.

Parameter name
Type
Required
Describe

code

number

Yes

data

object

No

task_id

number

No

Last updated