How to fix Google Search scraping errors

With Google search making it harder to scrape its search results, here are some tips.

How to test Google search for errors

The easiest way to visibly check for errors is to click on the test Google button.

Go to settings.

image

Go to settings > utility.

image

Click on test Google button.

image

SCM will open a browser window with a Google search for cat.

image

If you see any captcha requests or the page doesn’t load it means SCM has problems reading Google search.

Example Google search errors

|2/3/2025, 4:36:59 PM| Retry 1/1 in 10s 
|2/3/2025, 4:36:58 PM| Warning ERR_ABORTED (-3) loading 'https://www.google.com/search?q=Chinese%20Cultural%20Acts%20for%20Hire&ie=utf-8&oe=utf-8&lr=lang_en&sei=O46gZ8vaF5iy0-kP6vuI8Q0'
|2/3/2025, 4:36:55 PM| Querying Google  for 'Chinese Cultural Acts for Hire'
|2/3/2025, 4:36:55 PM| Searching Google Current Region:English for 'Chinese Cultural Acts for Hire'
|2/3/2025, 4:36:55 PM| Found 0 article variables in your keyword string
|2/3/2025, 4:36:55 PM| Starting keyword (1/1) 'Chinese Cultural Acts for Hire'

How to reduce Google search captcha requests via a Google account

If you open a test search it may show a captcha challenge.

image

You can solve this manually to unblock Google search.

The best way to avoid captchas is to Sign in to a Google account.

How to sign in to a Google account

Under settings > utility.
Click Google account button.

image

This will open a Google sign in page.

image

Sign in normally using a Google account.

Google will respond with ‘This browser may not be secure’

image

Click Try again.

After 2-3 retries, Google will accept the login.

Enter your password.

image

Finish the login.

You will be on your Google account page.

image

When you click test Google button, notice the presence of the logged in menu items.

image

Google also doesn’t show as many captchas when you provide a logged in account.