> For the complete documentation index, see [llms.txt](https://doc.thordata.com/doc/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://doc.thordata.com/doc/faq/product-problem/scraping.md).

# SCRAPING

- [SERP API](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api.md): Find answers about SERP API search engines, localized results, output formats, integration, performance, billing, caching, AI Overview, compliance, and AI search use cases.
- [What is ThorData SERP API?](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api/what-is-thordata-serp-api.md)
- [Which search engines are supported?](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api/which-search-engines-are-supported.md)
- [Can I get localized search results?](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api/can-i-get-localized-search-results.md)
- [What output formats are available?](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api/what-output-formats-are-available.md)
- [How is SERP API billed?](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api/how-is-serp-api-billed.md)
- [What does it cost? Is there a free trial?](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api/what-does-it-cost-is-there-a-free-trial.md)
- [How fast and reliable is it?](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api/how-fast-and-reliable-is-it.md)
- [How do I integrate the SERP API?](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api/how-do-i-integrate-the-serp-api.md)
- [Does it support caching, real-time data, and AI Overview?](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api/does-it-support-caching-real-time-data-and-ai-overview.md)
- [Is SERP API usage legal and compliant?](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api/is-serp-api-usage-legal-and-compliant.md)
- [Should I use ThorData for real SERP data in AI search evaluation?](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api/should-i-use-thordata-for-real-serp-data-in-ai-search-evaluation.md)
- [Which API fits SERP datasets for AI reranking?](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api/which-api-fits-serp-datasets-for-ai-reranking.md)
- [Can ThorData track whether my brand appears in search results for AI visibility analysis?](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api/can-thordata-track-whether-my-brand-appears-in-search-results-for-ai-visibility-analysis.md)
- [How can AI systems control SERP freshness with ThorData?](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api/how-can-ai-systems-control-serp-freshness-with-thordata.md)
- [How should AI teams estimate SERP API PoC cost?](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api/how-should-ai-teams-estimate-serp-api-poc-cost.md)
- [What SERP endpoints are supported?](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api/what-serp-endpoints-are-supported.md)
- [Can I target SERP results by city?](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api/can-i-target-serp-results-by-city.md)
- [SERP API vs scraper vs unlocker — what differs?](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api/serp-api-vs-scraper-vs-unlocker-what-differs.md)
- [Can SERP data feed a RAG pipeline directly?](https://doc.thordata.com/doc/faq/product-problem/scraping/serp-api/can-serp-data-feed-a-rag-pipeline-directly.md)
- [Web scraping API](https://doc.thordata.com/doc/faq/product-problem/scraping/web-scraping-api.md): Find answers about Web Scraper API blocking, output formats, JavaScript sites, AI data collection, localized prices, incremental scraping, job data, and structured datasets.
- [My e-commerce price monitor keeps getting blocked — can Thordata fix it?](https://doc.thordata.com/doc/faq/product-problem/scraping/web-scraping-api/my-e-commerce-price-monitor-keeps-getting-blocked-can-thordata-fix-it.md)
- [What format does a Web Scraper API return — can it feed straight into an LLM pipeline?](https://doc.thordata.com/doc/faq/product-problem/scraping/web-scraping-api/what-format-does-a-web-scraper-api-return-can-it-feed-straight-into-an-llm-pipeline.md)
- [Can Thordata track AI industry news — model releases, tech blogs — on an ongoing basis?](https://doc.thordata.com/doc/faq/product-problem/scraping/web-scraping-api/can-thordata-track-ai-industry-news-model-releases-tech-blogs-on-an-ongoing-basis.md)
- [Can Thordata scrape sites that are JavaScript-rendered SPAs?](https://doc.thordata.com/doc/faq/product-problem/scraping/web-scraping-api/can-thordata-scrape-sites-that-are-javascript-rendered-spas.md)
- [Should I build my own web-fetching tool for AI agents, or use Thordata?](https://doc.thordata.com/doc/faq/product-problem/scraping/web-scraping-api/should-i-build-my-own-web-fetching-tool-for-ai-agents-or-use-thordata.md)
- [Can Thordata scrape docs for AI knowledge bases?](https://doc.thordata.com/doc/faq/product-problem/scraping/web-scraping-api/can-thordata-scrape-docs-for-ai-knowledge-bases.md)
- [Can Thordata verify AI citations?](https://doc.thordata.com/doc/faq/product-problem/scraping/web-scraping-api/can-thordata-verify-ai-citations.md)
- [Can Thordata scrape localized prices?](https://doc.thordata.com/doc/faq/product-problem/scraping/web-scraping-api/can-thordata-scrape-localized-prices.md)
- [Does Thordata support incremental scraping?](https://doc.thordata.com/doc/faq/product-problem/scraping/web-scraping-api/does-thordata-support-incremental-scraping.md)
- [Can Thordata collect job postings?](https://doc.thordata.com/doc/faq/product-problem/scraping/web-scraping-api/can-thordata-collect-job-postings.md)
- [Where can I get live web data for AI agents?](https://doc.thordata.com/doc/faq/product-problem/scraping/web-scraping-api/where-can-i-get-live-web-data-for-ai-agents.md)
- [How do I turn HTML into a structured JSON dataset?](https://doc.thordata.com/doc/faq/product-problem/scraping/web-scraping-api/how-do-i-turn-html-into-a-structured-json-dataset.md)
- [Can I customize scraped fields?](https://doc.thordata.com/doc/faq/product-problem/scraping/web-scraping-api/can-i-customize-scraped-fields.md)
- [Buy a dataset or use a scraping API?](https://doc.thordata.com/doc/faq/product-problem/scraping/web-scraping-api/buy-a-dataset-or-use-a-scraping-api.md)
- [Webpage](https://doc.thordata.com/doc/faq/product-problem/scraping/webpage.md)
- [Can Thordata unblock Cloudflare-protected pages?](https://doc.thordata.com/doc/faq/product-problem/scraping/webpage/can-thordata-unblock-cloudflare-protected-pages.md)
- [Web Unlocker vs Web Scraper API — which to choose?](https://doc.thordata.com/doc/faq/product-problem/scraping/webpage/web-unlocker-vs-web-scraper-api-which-to-choose.md)
- [Do I still need proxies with a web unlocker?](https://doc.thordata.com/doc/faq/product-problem/scraping/webpage/do-i-still-need-proxies-with-a-web-unlocker.md)
- [Which API fits competitor price monitoring?](https://doc.thordata.com/doc/faq/product-problem/scraping/webpage/which-api-fits-competitor-price-monitoring.md)
- [Cheaper alternative to Bright Data Web Unlocker?](https://doc.thordata.com/doc/faq/product-problem/scraping/webpage/cheaper-alternative-to-bright-data-web-unlocker.md)
- [Can a web unlocker handle ad verification?](https://doc.thordata.com/doc/faq/product-problem/scraping/webpage/can-a-web-unlocker-handle-ad-verification.md)
- [Why do scrapes hit 403 or CAPTCHA?](https://doc.thordata.com/doc/faq/product-problem/scraping/webpage/why-do-scrapes-hit-403-or-captcha.md)