Anay
-
Posts
15 -
Joined
-
Last visited
-
Days Won
1
Posts posted by Anay
-
-
@xvids, multiple DBs can be considered but better approach would be separation of read / write operation, it is pretty common with large operations or deployments.
-
1
-
-
KVS with its caching is quite optimized but you have limits and hence as you grow you will need horizontal scaling.
@Helmuts DNMUM.com, @Mich we have more than 200K videos and initially we went for vertical scaling but it was getting slow, now with horizontal scaling ie. cluster, its doing good and looks like it has quite a room left for future growth.
-
1
-
-
On 3/25/2023 at 10:11 AM, Tech Support said:
We do not suggest any proxy server, as we never used any of them. We saw customers sometimes use some paid proxies, but cannot tell exactly which ones.
You mean, for grabber you don't use proxy, then how you rotate IPs ?
-
Which proxy server or setup you suggest if need to customize string etc. ?
-
Grabbers use curl to make request, we use proxy to distribute grab jobs to multiple IPs however, is it possible to set custom user-agent via grabber or KVS already adds some user-agent in there ?
And what are the optimal settings for proxy used for grabbing ?
-
13 hours ago, hbarnetworks said:
Hi Anay,
I have the same setup using a 3 server Galera cluster with proxySQL in front, with proxySQL you can send all write requests to the same server. And send the reads to all 3.With READ-WRITE separation using ProxyQL, do you find any deadlock or other issues. How long you have been running the setup?
-
3 hours ago, Tech Support said:
I would add, if you want to reduce database load and do not get any side effects, you can put a change in functions_base.php sql() function to redirect all requests that have this "ktvs_videos.video_id<>" to secondary databases. These requests are for requesting related videos, they are the most overloading requests for the database. Moving them will give database performance benefits.
However if you have the latest KVS version, you can also move them to SphinxSearch using external search plugin and reduce MySQL load as well. Same effect with no custom changes in KVS code.
Have already implemented sphinx search and it was helpful.
-
Hello,
We have been handling few high traffic KVS websites for our client and are using cluster of 3 big separate database servers for database load balancing. So far it is working fine and we can handle a lot more traffic now than compared to single DB server setup and that too with comparative lower expanses. However, time to time we are facing Deadlock Transaction issue. They are not much but we assume that in future with more traffic and increased write operations it could be an issue. And simple solution is to separate READ and WRITE operations at APP level.
I went through previous multiple discussions here on KVS forums and I see that there is no Load Balancer support for Database yet. However, I was thinking, is it possible to configure KVS to separate READ and WRITE operations.
Something in the order that via Config, instead of one DB server, we have ability to specify separate WRITE server and READ server, and if only 1 server is specified then it is used for both READ/WRITE operations.
On coding level, though I have not seen any code but I am sure you must be using some custom layer/routine where all queries are centrally processed , so there we can use logic and send queries to separate servers based on function or routine called. ie if write or read.
If it is already there or there is quick way around to achieve then would love to hear.-
1
-
-
Ok, understood.
Hoping to get that feature soon. -
Totally understandable, however, is there any way to do something like sponsored feature ie. if some webmasters those are willing to pay some premium to expedite certain feature development. That way for certain fee, a feature may get added sooner than other and will also help community as well as your software.
-
Ok, thank you, do we have some kind of roadmap or feature request section for KVS available ?
-
Hi,
Is there way to speed up execution of background tasks, say there is not much traffic and almost all the resource are idle, then I think it would be nice if we can clear the pending tasks and keeping the queue clean. I know we can increase priority of certain tasks but I am looking for way to speed up processing of all pending tasks. Is there any settings where we can decide how much tasks to be processed at once ?
-
Hi,
Google will eventually find your site and index it but to make it faster, try to promote your sites on social media, social sharing sites etc or blogs which it is allowed. And as naughtyking said, you can also register your site on google search console and upload your sitemap link there.-
1
-
-
On 1/12/2023 at 11:15 AM, Mich said:
Hi, this is not my last version template currently used but you could use it for improving your nginx configuration :)
Here : https://github.com/MaximeMichaud/KVS-install/tree/main/conf/nginx
This is actually a nice sample or starting point for nginx, was helpful.
-
1
-
Remote Database with KVS
in Technical Support
Posted
First you have to decide why you need remote database, if your traffic is growing and single server is not able to handle then you you should opt for remote db server. Have been successfully running KVS on external DB server for my clients and have been not issue. But as @Tech Support said, if they are across separate DC or Facilities, instead of gains, you will see deteriorated performance.