Did Google make a change? A lot slower all of the sudden. 4 different proxy providers same result. Thanks.
Not much if anything we can do until Google stops being so aggressive on blocking proxies. Usually happens a few times a year for 3-4 days and then they ease back again. At the moment scraping mobile version does perform better than desktop but it is still slower than usual. I did notice one server of mine that is running version 1.2.2662 is scraping faster than 1.2.2672 no idea why. (Aparser preset, proxies, and server hardware exactly the same)
Are there any updates? I just updated script to 1.2.2704 and no changes. About 10% queries are ok - 20 retries, 2000 private proxy. Current settings with chrome browser & headless mode disabled.
Unfortunately no. Google has the bot detection throttled really high. Mobile scraping works a lot better than desktop. The two jobs below have the exact same settings, proxies, keywords, etc. Only difference is the top task is Mobile and bottom is Desktop. This is also with using sessions disabled. Even worse performance for both mobile and desktop with sessions enabled. Wish I only needed mobile results but I need desktop as well.
I know I'm beating a dead horse at this point but is there really nothing to be done with Google desktop scraping? I've tried a dozen different proxy sources and none of them work for desktop but they all work fine for Mobile Google scraping. Nothing changed at all with the sessions or the js redirect detection? The obvious solution is to just scrape mobile but I need desktop unfortunately Thanks, appreciate your patience with me!
Try the latest Beta version in members area downloads. Works a lot better. Still some issues but they are still working on it.
what settings are you using? with chrome - almost 0% succes. Now trying http + xevil for solving captchas