1) are all the footprints detectable without using a headless browser option through net::http parser? It's just checking source code of page for regex matches? 2) what is the difference in speed and accuracy of selecting/not selecting "emulate browser headers" option? 3) What is difference between "built-in" and "RE2" regex engines? 4) Benefit of running queries through net:http if not using headless browser option?
Yes, it's checking source code of page for regex matches. It's unlikely there will be a noticeable difference in speed. This option only affects the likelihood of receiving the correct page and reducing the risk of a ban. Just different regular expression engines. RE2 may be more performant in some cases. The advantage is that you can use all the functionality of Net::HTTP. For example, bypassing CloudFlare.
The advantage is that you can use all the functionality of Net::HTTP. For example, bypassing CloudFlare.
