Jump to content

Custom user agent for Proxy in grabber


Anay

Recommended Posts

Grabbers use curl to make request, we use proxy to distribute grab jobs to multiple IPs however, is it possible to set custom user-agent via grabber or KVS already adds some user-agent in there ?

And what are the optimal settings for proxy used for grabbing ?

Link to comment
Share on other sites

On 3/25/2023 at 10:11 AM, Tech Support said:

We do not suggest any proxy server, as we never used any of them. We saw customers sometimes use some paid proxies, but cannot tell exactly which ones.

You mean, for grabber you don't use proxy, then how you rotate IPs ?

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...