Google Scraping Parameters
Web Scraper API Google Scraping Parameters
Configure Google scraping parameters using Thordata's Web Scraper API, including URL, day limit, keywords, CID, longitude, latitude, business ID, country, and other parameters.
Unique Identifier:
token， Access token (required)
This parameter is used as the API access token to ensure the legitimacy of the scraping request.
Request examples:
Authorization: Bearer ********************
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer ********************" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=google.com" ^
-d "spider_id=google_comment_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.google.com/maps/place/Waterfront+Botanical+Gardens/@38.2630366,-85.7288454,15z/data=!4m8!3m7!1s0x8869731e16a7bdbd:0x2f5d238fefed7ca1!8m2!3d38.2632837!4d-85.7239738!9m1!1b1!16s%2Fg%2F11c709xzzx?hl=en%26entry=ttu\",\"days_limit\": \"10\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"Product - Scrape Google maps reviews information:
1. Google - Scrape Google maps reviews information by URL
spider_id ， Scraper tool (required)
Defines which scraper tool to use.
Request examples:
spider_id=google_comment_by-url
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=google.com" ^
-d "spider_id=google_comment_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.google.com/maps/place/Waterfront+Botanical+Gardens/@38.2630366,-85.7288454,15z/data=!4m8!3m7!1s0x8869731e16a7bdbd:0x2f5d238fefed7ca1!8m2!3d38.2632837!4d-85.7239738!9m1!1b1!16s%2Fg%2F11c709xzzx?hl=en%26entry=ttu\",\"days_limit\": \"10\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"url ，URL (required)
This parameter specifies the access link for the Google Maps reviews to be scraped.
Request examples:
"url":"https://www.google.com/maps/place/Waterfront+Botanical+Gardens/@38.2630366,-85.7288454,15z/data=!4m8!3m7!1s0x8869731e16a7bdbd:0x2f5d238fefed7ca1!8m2!3d38.2632837!4d-85.7239738!9m1!1b1!16s%2Fg%2F11c709xzzx?hl=en%26entry=ttu"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=google.com" ^
-d "spider_id=google_comment_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.google.com/maps/place/Waterfront+Botanical+Gardens/@38.2630366,-85.7288454,15z/data=!4m8!3m7!1s0x8869731e16a7bdbd:0x2f5d238fefed7ca1!8m2!3d38.2632837!4d-85.7239738!9m1!1b1!16s%2Fg%2F11c709xzzx?hl=en%26entry=ttu\",\"days_limit\": \"10\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"days_limit ，days limit (optional)
This parameter specifies the day limit for publishing Google Maps reviews to be scraped. It defines the number of days to look back from the current date when retrieving reviews.
Request examples:
"days_limit": "10"
curl -X POST "https://scraperapi.thordata.com/builder" ^
-H "Authorization: Bearer Token-ID" ^
-H "Content-Type: application/x-www-form-urlencoded" ^
-d "spider_name=google.com" ^
-d "spider_id=google_comment_by-url" ^
-d "spider_parameters=[{\"url\": \"https://www.google.com/maps/place/Waterfront+Botanical+Gardens/@38.2630366,-85.7288454,15z/data=!4m8!3m7!1s0x8869731e16a7bdbd:0x2f5d238fefed7ca1!8m2!3d38.2632837!4d-85.7239738!9m1!1b1!16s%2Fg%2F11c709xzzx?hl=en%26entry=ttu\",\"days_limit\": \"10\"}]" ^
-d "spider_errors=true" ^
-d "file_name={{TasksID}}"Product - Scrape Google maps details information:
1. Google - Scrape Google maps details information by URL
spider_id ， Scraper tool (required)
Defines which scraper tool to use.
Request examples:
spider_id=google_map-details_by-url
url ，URL (required)
This parameter specifies the access link for the Google Maps to be scraped.
Request examples:
"url":"https://www.google.com/maps/place/Pizza+Inn+Magdeburg/@52.1263086,11.6094743,761m/data=!3m2!1e3!4b1!4m6!3m5!1s0x47a5f50c083530a3:0xfdba8746b538141!8m2!3d52.1263086!4d11.6094743!16s%2Fg%2F11kqmtk3dt?authuser=0%26hl=en%26entry=ttu%26g_ep=EgoyMDI1MDMxMi4wIKXMDSoASAFQAw%3D%3D"
2. Google - Scrape Google maps details information by CID
spider_id ， Scraper tool (required)
Defines which scraper tool to use.
Request examples:
spider_id=google_map-details_by-cid
CID，CID (required)
This parameter specifies the CID information to be scraped. CID is a unique identifier in Google Map and Google My Business (GMB) used to represent and identify a specific business location or place.
Request examples:
"CID": "2476046430038551731"
3. Google - Scrape Google maps details information by keyword
spider_id ，Scraper tool (required)
Defines which scraper tool to use.
Request examples:
spider_id=google_map-details_by-location
keyword，keyword (required)
This parameter specifies the keywords used to search for map information, which can be a location, postal code, or category.
Request examples:
"keyword": "Jio Store, 1449/137, Main 100 Ft Road"
country， country (required)
This parameter specifies the country to be searched.
Parameter value：
gb,af,al,dz,ax,as,ad,ao,ai,aq,ag,ar,am,aw,au,at,az,bs,bh,je,bd,bb,by,be,bz,bj,bm,bt,bo,bq,ba,bw,br,bn,bg,bf,bi,kh,cm,ca,cv,ky,cf,td,cl,cn,cx,cc,co,km,cg,ck,cr,ci,hr,cu,cw,cy,cz,cd,dk,dj,dm,do,ec,eg,sv,gq,er,eu,ee,et,fk,fo,fj,fi,fr,gf,pf,tf,ga,gm,ge,de,gh,gi,gb,gr,gl,gd,gu,gp,gt,gg,gn,gw,gy,ht,hn,hk,hu,is,in,id,io,ir,iq,ie,im,il,jm,jp,jo,kz,ke,ki,xk,kw,kg,la,lv,lb,ls,lr,ly,li,lt,lu,mo,mk,mg,mw,my,mv,ml,mt,mh,mq,mr,mu,yt,mx,fm,md,mc,mn,me,ms,ma,mz,mm,na,nr,np,nl,an,nc,nz,ni,ne,ng,nu,nf,kp,mp,no,om,pk,pw,ps,pa,pg,py,pe,ph,pn,pl,pm,pt,pr,qa,re,ro,ru,rw,bl,sh,kn,lc,mf,vc,sm,st,sa,sn,rs,sc,sl,sg,sx,sk,si,sb,so,za,gs,kr,ss,es,lk,sd,sr,se,ch,sy,tw,tj,tz,th,tl,tg,tk,to,tt,tn,tr,tm,tc,tv,ug,ua,ae,uk,us,uz,vu,va,ve,vn,vg,vi,wf,eh,ws,ye,zm,zw,bv,hm,dz
Request examples:
"country": "gb"
lat，latitude (optional)
This parameter specifies the latitude of the location to be searched.
Request examples:
"lat": "28.6444225"
long， longitude (optional)
This parameter specifies the longitude of the location to be searched.
Request examples:
"long": "77.2416932"
zoom_level，zoom level (optional)
This parameter indicates the zoom level for the search.
Request examples:
"zoom_level": "1"
4. Google - Scrape Google maps details information by place_id
spider_id ， Scraper tool (required)
Defines which scraper tool to use.
Request examples:
spider_id=google_map-details_by-placeid
place_id，place_id (required)
This parameter specifies the Business ID for Google Maps.
Request examples:
"place_id": "ChIJS5WVcqWh9YgRHU08rJqLNsQ"
Product - Scrape Google shopping information:
1. Google - Scrape Google shopping information by URL
spider_id ， Scraper tool (required)
Defines which scraper tool to use.
Request examples:
spider_id=google_shopping_by-url
url ，URL (required)
This parameter specifies the access link for Google products to be scraped.
Request examples:
"url": "https://www.google.com/shopping/product/r/IL/16127099509847096080?prds=oid:7606538425324351917,eto:7606538425324351917_0,epd:7606538425324351917,prmr:1,rsk:PC_9055274590772580661%26rss=ChZQQ185MDU1Mjc0NTkwNzcyNTgwNjYx%26hl=en%26sa=X%26ved=2ahUKEwjOjry57OuEAxXqhloFHTg7CCwQkLoIegQIAhAM"
country ，country (optional)
This parameter specifies the country to be searched.
Parameter value:United States,us
、United Kingdom,gb
、Canada,ca
、Australia,au
、Japan,jp
、Germany,de
、France,fr
、Italy,it
、Spain,es
、Netherlands,nl
、Sweden,se
、Switzerland,ch
、New Zealand,nz
、India,in
、South Korea,kr
、Singapore,sg
、Malaysia,my
、Mexico,mx
、Brazil,br
、Argentina,ar
、South Africa,za
、Colombia,co
、Turkey,tr
、United Arab Emirates,ae
、Poland,pl
、Portugal,pt
、Romania,ro
、Russia,ru
、Thailand,th
、Vietnam,vn
、Taiwan,tw
、Israel,il
、Indonesia,id
、Philippines,ph
、Finland,fi
、Denmark,dk
、Belgium,be
、Austria,at
、UK,gb
、Switzerland,ch
Request examples:
"country": "DZ"
2. Google -Scrape Google shopping information by keyword
spider_id ， Scraper tool (required)
Defines which scraper tool to use.
Request examples:
spider_id=google_shopping_by-keywords
keyword，keyword (required)
This parameter specifies the keywords used to collect product data.
Request examples:
"keyword": "iphone"
country，country (required)
This parameter specifies the country to be searched.
Parameter value:United States,us
、United Kingdom,gb
、Canada,ca
、Australia,au
、Japan,jp
、Germany,de
、France,fr
、Italy,it
、Spain,es
、Netherlands,nl
、Sweden,se
、Switzerland,ch
、New Zealand,nz
、India,in
、South Korea,kr
、Singapore,sg
、Malaysia,my
、Mexico,mx
、Brazil,br
、Argentina,ar
、South Africa,za
、Colombia,co
、Turkey,tr
、United Arab Emirates,ae
、Poland,pl
、Portugal,pt
、Romania,ro
、Russia,ru
、Thailand,th
、Vietnam,vn
、Taiwan,tw
、Israel,il
、Indonesia,id
、Philippines,ph
、Finland,fi
、Denmark,dk
、Belgium,be
、Austria,at
、UK,gb
、Switzerland,ch
Request examples:
"country": "DZ"
If you need further assistance, please contact us via email at [email protected].
Last updated
Was this helpful?