SERP API as an alternative for Google scraping

Tim · May 17, 2024, 5:04pm

1. The problem

Require high volume access to Google without proxies

Use a paid API

bukit · May 17, 2024, 5:40pm

Yes please hopefully the users can also integrate their favorite SERP API service to SCM. Thank you.

Tim · November 16, 2024, 6:37pm

Free search plans 100 searches with serpapi!

bukit · November 17, 2024, 12:21am

Recommendation: serper.dev and dataforseo, for LTD spaceserp @ AppSumo (haven’t tried it).

Also google custom search JSON API.

Tim · November 17, 2024, 9:11am

Thanks will check them out as well.

Hopefully we can have a few cheap providers on the list.

bukit · November 17, 2024, 9:14am

There is also a self hosted OSS, but it’s too technical for regular user. SearXNG

Tim · November 22, 2024, 2:27am

SERP api supports People also ask scraping! Which is important part of google search scraping that is not always available!

Scrape owl doesn’t seem to support this in their Google api (but I have asked to confirm)

The scrape owl premium proxy solution does not solve captchas unfortunately.

Tim · November 26, 2024, 5:14am

New location to enter SERP API key

To switch to SERP API

Select it in settings search

If selected correctly, it appears next to search engine settings in tasks.