Anay Posted March 24, 2023 Posted March 24, 2023 Grabbers use curl to make request, we use proxy to distribute grab jobs to multiple IPs however, is it possible to set custom user-agent via grabber or KVS already adds some user-agent in there ? And what are the optimal settings for proxy used for grabbing ? Quote
Tech Support Posted March 24, 2023 Posted March 24, 2023 Not possible to customize the user-agent for grabbers via KVS. We need to add this option. Quote
Anay Posted March 24, 2023 Author Posted March 24, 2023 Which proxy server or setup you suggest if need to customize string etc. ? Quote
Tech Support Posted March 25, 2023 Posted March 25, 2023 We do not suggest any proxy server, as we never used any of them. We saw customers sometimes use some paid proxies, but cannot tell exactly which ones. Quote
Anay Posted March 26, 2023 Author Posted March 26, 2023 On 3/25/2023 at 10:11 AM, Tech Support said: We do not suggest any proxy server, as we never used any of them. We saw customers sometimes use some paid proxies, but cannot tell exactly which ones. You mean, for grabber you don't use proxy, then how you rotate IPs ? Quote
Tech Support Posted March 27, 2023 Posted March 27, 2023 10 hours ago, Anay said: You mean, for grabber you don't use proxy, then how you rotate IPs ? We do not use grabbers, we do not run any tubes ourselves. Why do you think we should use proxies, or rotate IPs? We just sell KVS software. Quote
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.