Create a crawling task description
Basic Information
Interface Description: Create a crawling task for the Web Scraper API through the interface.
Text request address: https://scraperapi.thordata.com/builder YouTube audio/video request address: https://scraperapi.thordata.com/video_builder
Request Method: POST
Request parameters
Header:
Authorization
string
Yes
Please log in to the Dashboard to view your Authorization token parameter value. Example: "Authorization: Bearer *********************"
Body:
file_name
string
Yes
Customize the name of the downloaded file. {{TasksID}}
, {{VideoID}}
individual_params
text
Yes
Facebook:
keyword
keyword, recent_posts
whether it is a recent post, date
year, number
number of posts, spider_id
product unique identifier.
For more parameters, please see the parameter description .
Amazon:
url
crawling link, zip_code
zip code, sort_by
sorting method, etc.
For more parameters, please see the parameter description.
YouTube:
url
crawling link.
For more parameters, please see the parameter description.
spider_id
string
Yes
Included in individual_params
。Unique product identifier. facebook.com
、amazon.com
common_settings
string
Yes
YouTube-Video: resolution resolution YouTube-Audio: audio_format audio format, bitrate bitrate, is_subtitles whether subtitles are needed, subtitles_language subtitles language. For more parameters, please see the parameter description.
Response example
{
"code": 200,
"data": {
"task_id": "68a21d2e8f2645e39f3d62231ef6d829"
}
}
code
number
Yes
data
object
No
task_id
number
No
Last updated